-- Logs begin at Sat 2022-02-19 20:01:15 UTC, end at Sat 2022-02-19 22:17:27 UTC. -- Feb 19 20:34:10.575493 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Feb 19 20:34:10.584247 ncdv-master-1 devstack@keystone.service[96895]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 19 20:34:10 2022] *** Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: nodename: ncdv-master-1 Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: machine: x86_64 Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: clock source: unix Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: pcre jit disabled Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: detected number of CPU cores: 4 Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: current working directory: / Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: detected binary path: /usr/bin/uwsgi-core Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: your processes number limit is 47680 Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: your memory page size is 4096 bytes Feb 19 20:34:10.589173 ncdv-master-1 devstack@keystone.service[96895]: detected max file descriptor number: 2048 Feb 19 20:34:10.589895 ncdv-master-1 devstack@keystone.service[96895]: lock engine: pthread robust mutexes Feb 19 20:34:10.589895 ncdv-master-1 devstack@keystone.service[96895]: thunder lock: enabled Feb 19 20:34:10.589895 ncdv-master-1 devstack@keystone.service[96895]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 19 20:34:10.589895 ncdv-master-1 devstack@keystone.service[96895]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 19 20:34:10.640668 ncdv-master-1 devstack@keystone.service[96895]: Python main interpreter initialized at 0x55e8be9a99c0 Feb 19 20:34:10.640668 ncdv-master-1 devstack@keystone.service[96895]: python threads support enabled Feb 19 20:34:10.640668 ncdv-master-1 devstack@keystone.service[96895]: your server socket listen backlog is limited to 100 connections Feb 19 20:34:10.640668 ncdv-master-1 devstack@keystone.service[96895]: your mercy for graceful operations on workers is 90 seconds Feb 19 20:34:10.640997 ncdv-master-1 devstack@keystone.service[96895]: mapped 403077 bytes (393 KB) for 2 cores Feb 19 20:34:10.641218 ncdv-master-1 devstack@keystone.service[96895]: *** Operational MODE: preforking *** Feb 19 20:34:10.641365 ncdv-master-1 devstack@keystone.service[96895]: *** uWSGI is running in multiple interpreter mode *** Feb 19 20:34:10.641365 ncdv-master-1 devstack@keystone.service[96895]: spawned uWSGI master process (pid: 96895) Feb 19 20:34:10.645006 ncdv-master-1 devstack@keystone.service[96895]: spawned uWSGI worker 1 (pid: 96909, cores: 1) Feb 19 20:34:10.645006 ncdv-master-1 devstack@keystone.service[96895]: spawned uWSGI worker 2 (pid: 96910, cores: 1) Feb 19 20:34:10.645006 ncdv-master-1 devstack@keystone.service[96895]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 19 20:34:10.641563 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Feb 19 20:34:16.643788 ncdv-master-1 devstack@keystone.service[96910]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:34:16.643788 ncdv-master-1 devstack@keystone.service[96910]: from cryptography.utils import int_from_bytes Feb 19 20:34:16.644616 ncdv-master-1 devstack@keystone.service[96910]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:34:16.644616 ncdv-master-1 devstack@keystone.service[96910]: from cryptography.utils import int_from_bytes Feb 19 20:34:16.644731 ncdv-master-1 devstack@keystone.service[96909]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:34:16.644731 ncdv-master-1 devstack@keystone.service[96909]: from cryptography.utils import int_from_bytes Feb 19 20:34:16.644731 ncdv-master-1 devstack@keystone.service[96909]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:34:16.644731 ncdv-master-1 devstack@keystone.service[96909]: from cryptography.utils import int_from_bytes Feb 19 20:34:16.690439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 19 20:34:16.690718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 19 20:34:16.690815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] command line args: [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 19 20:34:16.691074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 19 20:34:16.691160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 19 20:34:16.691289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ================================================================================ {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 19 20:34:16.691380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 19 20:34:16.691449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] command line args: [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 19 20:34:16.691506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] admin_token = **** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.691713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 19 20:34:16.691803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] config_dir = [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.691933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ================================================================================ {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 19 20:34:16.692021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.692083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] config_source = [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.692145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] admin_token = **** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.692301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] debug = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.692406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] config_dir = [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.692478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.694813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.694813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] config_source = [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.694941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] debug = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] insecure_debug = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] insecure_debug = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] list_limit = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] log_config_append = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] log_dir = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] list_limit = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] log_file = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] log_config_append = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.695950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] log_dir = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] log_file = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.696977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] notification_format = cadf {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.697917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.698644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] notification_format = cadf {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.698859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.699028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.699223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] publish_errors = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.699223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.699597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.699805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.700005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] publish_errors = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.700198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.700465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.700635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.700828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.701022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.701306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.701531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] standard_threads = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.701739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.701902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] strict_password_check = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.702098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.702289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.702525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] standard_threads = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.702698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] use_eventlog = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.702698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] use_journal = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.703063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] strict_password_check = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.703252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] use_json = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.703450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.703618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] use_stderr = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.703789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] use_eventlog = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.703949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] use_syslog = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.704080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] use_journal = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.704214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] watch_log_file = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.704214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.708086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] use_json = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.708246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.708441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] use_stderr = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.708441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] use_syslog = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.708703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.708833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] watch_log_file = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:34:16.708970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.709100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.709276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.709406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.709540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.709540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.709859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.709990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.711859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.712625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.712767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.712926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.713065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.713195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.713323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.713456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.713585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.713721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.713852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.713985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.714112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.714240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.715477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.715683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.715992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.716161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.716438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.716641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.716808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.716808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.717182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.717182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.717547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.717736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.717960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.718144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.718334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.718334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.718700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.718888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.719117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.719280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.719468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.719657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.719845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.719845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.720859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.721027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.721160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.721331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.721463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.721592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.721829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.721964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.722091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.722220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.722353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.722522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.722662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.722798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.722926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.723053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.723190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.723325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.723461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.723589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.723716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.723872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.724004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.724131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.724269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.729274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.729434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.729576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.729712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.729847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.730004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.730137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.730265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.730394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.730522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.730652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.730795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.730932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.731062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.731189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.731317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.731444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.731580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.731710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.731849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.731978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.732112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.732240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.732400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.732536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.732664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.732799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.732957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.733099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.733228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.733357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.733484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.733622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.733751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.733887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.734016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.734144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.734272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.734400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.734527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.734663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.734793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.734922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.735050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.735185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.735338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.735472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.735612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.735750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.735888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.736018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.736146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.736281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.736466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.736608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.736738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.736873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.737011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.737140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.737278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.737416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.737551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.737680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.737809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.737939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.738068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.738207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.738336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.738466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.738594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.738727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.738855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.739008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.enabled = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.739138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.739272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.739406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.739536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.739664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.739866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.739996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.740125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.740253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.enabled = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.740415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.740547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.740687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.740816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.740955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.741085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.741213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.741341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.741477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.741606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.741734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.741862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.741990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.742118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.742256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.742385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.742513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.742651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.742780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.742907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.743047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.743182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.743311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.743439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.743576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.743713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.743849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.743985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.744114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.744242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.744388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.744531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.744661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.744799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.744936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.745065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.745263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.745415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.745545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.745682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.745812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.745940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.746069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.746197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.746326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.746472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.746603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.746732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.746860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] auth.external = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.746992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.747121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] auth.mapped = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.747257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.747387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.747517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.747652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.747780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.747914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] auth.password = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.748079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] auth.external = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.748230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] auth.token = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.748390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] auth.mapped = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.748529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.748529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] catalog.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.748773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.748902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.749082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.749229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.749360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] auth.password = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.749491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.749620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] auth.token = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.749620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.749863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.749863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.750125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] catalog.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.750255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] credential.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.750466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.750603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] credential.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.750733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.750869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.751000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.751130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.751258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.751387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.751517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.751517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] credential.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.751778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.751778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.752032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] credential.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.752032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.752275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.752275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.752596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.752726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.752856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.752856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.753109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.753247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.753378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.753513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.753643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.753791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.753922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.754058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.754189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.754318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.754539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.754539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] federation.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.754823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.754962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.755093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.755222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] federation.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.755361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.755491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.755693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.755837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.755967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.756097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.756227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] federation.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.756398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.756545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.756685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.756817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] federation.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.756946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.757081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.757211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.757348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.757477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.757620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.757750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.757881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.758082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.758323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.758459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.758644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.758787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.758920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.759050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.759188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.759318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.759449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.759593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.759724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.759853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.759991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.760122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.760251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.760401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.760534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.760664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.760803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.760934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.761064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.761194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.761323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.761462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.761600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.761737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.761868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.761997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.762127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.762256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.762393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.762529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.762659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.762789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.762918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.763048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.763195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.763326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.763455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.763584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.763713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.763848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.763986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.764117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.764248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.764395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.764530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.764660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.764800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.764930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.765075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.765206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.765345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.765482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.765613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.765742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.765925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.766060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.766190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.766328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.766459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.766589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.766717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.766847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.767470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.767613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.767744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.767874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.768004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.768134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.768263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.768451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.password = **** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.768590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.768721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.768850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.768979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.769109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.769259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.769391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.769520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.769649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.769779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.769908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.password = **** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.770048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.770179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.770309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.770444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.770581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.770711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.770849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.770979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.771118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.771248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.771377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.771508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.771650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.771782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.771912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.772041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.772170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.772306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.772531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.772531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.772788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.772918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.772918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.773175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.773313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.773444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.773444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.773689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.773818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.773948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.774084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.774215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.774344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.774474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.774474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.774729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.774868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.774998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.775133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.775270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.775403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.775532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.775669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.775801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.775931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.776061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.776190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.776319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.776494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.776635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.776635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.776881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.776881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.777124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.777265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.777395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.777524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.777653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.777783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.777912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.778050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.778181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.778310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.778578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.778747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.778881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.779020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.779151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.779281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.779410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.779540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] policy.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.779706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.779848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.779979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.780109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.780238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.780394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.780530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.780671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] receipt.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.780802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.780931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.781061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.781190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.781319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.781456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.781587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] policy.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.781717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.781846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.781976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.782110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.782323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] resource.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.782456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.782633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.783382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] receipt.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.783529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] resource.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.783661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.783800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.783936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.784068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.784197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.784394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.784543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.784675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] revoke.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.784805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.784946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.785076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] resource.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.785206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.785350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.785485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] role.cache_time = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.785615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] resource.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.785744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] role.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.785874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.786004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] role.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.786141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.786273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] role.list_limit = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.786403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.786534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.786674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] revoke.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.786805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.786943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.787074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.787203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.787334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.787464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] role.cache_time = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.787593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.787730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] role.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.787861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.787991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] role.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.788121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.788251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] role.list_limit = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.788400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.788553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.788685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.789085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.789216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.789347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.789477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.789615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.789747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.789877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.790007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.790136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.790136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.790392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.790534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.790665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.790795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.790925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.791984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.792241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.792434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.792586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.792888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.793027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.793158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.793289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.793418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.793549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.793687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.793818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.793949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.794080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.794220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.794350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.794487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.794620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.794751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.794881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.795011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.795140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.795278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] token.cache_time = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.795425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.795557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] token.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.795688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.795817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.795947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.796094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] token.provider = fernet {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.796225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.796374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.796511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.796641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.796773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.796913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.797045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.797175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.797305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] token.cache_time = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.797434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.797565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] token.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.797703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.797835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.797974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] trust.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.798105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] token.provider = fernet {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.798272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.798409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.798548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.798678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.798809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.798939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.799070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.799199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.799337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.799467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.799603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.799743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.799874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.800006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] trust.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.800143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.800274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.800443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.connection = **** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.800587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.800727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.800859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.800988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.801126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.801257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.801387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.801516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.801656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.801787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.801925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.802056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.802186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.802315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.802315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.802560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.connection = **** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.802708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.802847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.802987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.803118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.803249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.803379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.803519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.803649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.803787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.803918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.804049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.804185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.804323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.804477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.804689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.804828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.804959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:34:16.805752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 19 20:34:16.808237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.808486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.808716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.809355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.809591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.809821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.817619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.818642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.846690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.846930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.847869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.848108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.901216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.901694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.951533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.951938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.953521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:16.953764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.018865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.019091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.019281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.019432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.019589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.019743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.019881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.020017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.020152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.020296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.020296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.020593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.045450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.045702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.045841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.046010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.046220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.046372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.046508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.046642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.046791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.046927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.047141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.047279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.047413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.047413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.058916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.059318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.073016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.073297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.073454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.073596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.073731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.073864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.073999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.074133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.074277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.074425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.074562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96909) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.074696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.074696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.074696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96910) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 19 20:34:17.093621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.093913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.094054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 19 20:34:17.094189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 19 20:34:17.094324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.094483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.094638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 19 20:34:17.094773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 19 20:34:17.094908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.095041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.095667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.095806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.095940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.096109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.096249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.096421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.106941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.107529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.107676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.107817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.107953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.108101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.108237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.108237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.116751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.117178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.120032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.120320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.120519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.120654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.120818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.120959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.121107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.121241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.121373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.121504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.121646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.121788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.121922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.122064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.122197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.122328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.122469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.122601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.122733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.122866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.122998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.123137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.148860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.149174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.150495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.150780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.150932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.151078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.156236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.156374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.156679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.156822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.156906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.156976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.164910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.165072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.165229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.165375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.169711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.169853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.170022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.170108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.170292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.170414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.170576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.170665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.170853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.170942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.171126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.171215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.171395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.171661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.171807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.172070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.190956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.191267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.193956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.194265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.195779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.198835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.199411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.199713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.202448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.202745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.206920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.207902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.210976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.212051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.215494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.215668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.215797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.215926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.216077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.216216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.216387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.216524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.216665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.216817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.216982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.217088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.236620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.236899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.236988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.237163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.237262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.237448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.237535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.237685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.245236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.245551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.246907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.247185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.247273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.247486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.250268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.250550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.250644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.250840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.250923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.251134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.251219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.251448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.251532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.251727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.264344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.264625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.264907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.265034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.265185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.265315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.265470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.265597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.265877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.266154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.267148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.267446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.267853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.268147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.285315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.286381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.288487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.289861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.291975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.293134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.396822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.398056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.398465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.398750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.399033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.399701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.399989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.400276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.406101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.407389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.407785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.409493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.411586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.411873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.412153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.412463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.412815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.413106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.413390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.413667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.421524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.421811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.422088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.422769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.423065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.423876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.430243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=96909) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.430524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.430918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.431196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.431471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.431553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=96910) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 19 20:34:17.431746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.431828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.432031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.432183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.432297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.432487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.432592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.432764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.432884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.433040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.433155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.433318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.433407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.433606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.433688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.433880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.433962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=96909) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.434169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.434443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.434706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.434971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.435249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=96910) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 19 20:34:17.471631 ncdv-master-1 devstack@keystone.service[96909]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e8be9a99c0 pid: 96909 (default app) Feb 19 20:34:17.474530 ncdv-master-1 devstack@keystone.service[96910]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e8be9a99c0 pid: 96910 (default app) Feb 19 20:34:17.476559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf06b2-8415-478a-8242-c582fee88500 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:17.477016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf06b2-8415-478a-8242-c582fee88500 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:17.477577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf06b2-8415-478a-8242-c582fee88500 None None] PATH_INFO: `/v3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:17.482957 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Sat Feb 19 20:34:17 2022] GET /identity/v3/ => generated 255 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:25.917070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83a5cf-cc17-40cf-a609-4ff313f1f243 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:25.917611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83a5cf-cc17-40cf-a609-4ff313f1f243 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:25.917611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83a5cf-cc17-40cf-a609-4ff313f1f243 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:25.922665 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:34:25.928284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:25.928709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:25.928860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:25.958711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG oslo_db.sqlalchemy.engines [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:34:26.140077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG passlib.handlers.bcrypt [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=96909) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 19 20:34:26.140534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG passlib.handlers.bcrypt [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=96909) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 19 20:34:26.201092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:26.202684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:26.329404 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:26.486960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83a5cf-cc17-40cf-a609-4ff313f1f243 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:26.520195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG oslo_db.sqlalchemy.engines [None req-1a83a5cf-cc17-40cf-a609-4ff313f1f243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:34:26.647621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83a5cf-cc17-40cf-a609-4ff313f1f243 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:26.651843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8af71-3a06-4408-8ad4-4a0cc726c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:26.652528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8af71-3a06-4408-8ad4-4a0cc726c4bc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:26.652816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8af71-3a06-4408-8ad4-4a0cc726c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:26.653094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8af71-3a06-4408-8ad4-4a0cc726c4bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:26.661039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8af71-3a06-4408-8ad4-4a0cc726c4bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:26.711865 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0ad8af71-3a06-4408-8ad4-4a0cc726c4bc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 19 20:34:26.712217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8af71-3a06-4408-8ad4-4a0cc726c4bc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:26.722372 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 20:34:26.728280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:26.742488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2499e-25ca-4327-b7c2-ad0689108ed5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:26.746947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942c564-f3e4-43c3-abe0-45538c4767fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:26.748043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c564-f3e4-43c3-abe0-45538c4767fa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:26.748355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c564-f3e4-43c3-abe0-45538c4767fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:26.748632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c564-f3e4-43c3-abe0-45538c4767fa admin admin] PATH_INFO: `/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:26.750164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942c564-f3e4-43c3-abe0-45538c4767fa admin admin] RBAC: Authorizing `identity:get_project(project_id=8848562c8fea4a5fbbab0bbfcc0a45f0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:26.803277 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0942c564-f3e4-43c3-abe0-45538c4767fa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 19 20:34:26.803620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942c564-f3e4-43c3-abe0-45538c4767fa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:26.808257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:26 2022] GET /identity/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:29.127765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd6c3d-b30f-4f41-8918-c8aecc463089 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:29.128292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd6c3d-b30f-4f41-8918-c8aecc463089 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:29.128292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd6c3d-b30f-4f41-8918-c8aecc463089 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:29.132867 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:34:29.138102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19132158-f14c-4808-a086-35fea1c81648 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:29.138524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19132158-f14c-4808-a086-35fea1c81648 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:29.138664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19132158-f14c-4808-a086-35fea1c81648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:29.157159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-19132158-f14c-4808-a086-35fea1c81648 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:29.159164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-19132158-f14c-4808-a086-35fea1c81648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:29.167277 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:29.191004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd6c3d-b30f-4f41-8918-c8aecc463089 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:29.202866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd6c3d-b30f-4f41-8918-c8aecc463089 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:29.207042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7031ba-8d68-4188-98c8-87607888a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:29.207654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7031ba-8d68-4188-98c8-87607888a918 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:29.207935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7031ba-8d68-4188-98c8-87607888a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:29.208209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7031ba-8d68-4188-98c8-87607888a918 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:29.215622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7031ba-8d68-4188-98c8-87607888a918 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:29.217420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7031ba-8d68-4188-98c8-87607888a918 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:29.226495 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:29.231643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19132158-f14c-4808-a086-35fea1c81648 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:29.241338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19132158-f14c-4808-a086-35fea1c81648 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:29.246611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1544df4-dfe7-47c7-a23c-eaeda8b0b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:29.248066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1544df4-dfe7-47c7-a23c-eaeda8b0b771 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:29.248605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1544df4-dfe7-47c7-a23c-eaeda8b0b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:29.249098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1544df4-dfe7-47c7-a23c-eaeda8b0b771 admin admin] PATH_INFO: `/v3/users/e41a610bfe5c492388b0f1e7872c9a2c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:29.251564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1544df4-dfe7-47c7-a23c-eaeda8b0b771 admin admin] RBAC: Authorizing `identity:get_user(user_id=e41a610bfe5c492388b0f1e7872c9a2c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:29.254899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1544df4-dfe7-47c7-a23c-eaeda8b0b771 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:29.256661 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:29 2022] GET /identity/v3/users/e41a610bfe5c492388b0f1e7872c9a2c => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:31.697144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cdcf-3c37-4b99-91fc-ad3cea39d5ed None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.697669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cdcf-3c37-4b99-91fc-ad3cea39d5ed None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.697762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cdcf-3c37-4b99-91fc-ad3cea39d5ed None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.699467 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:31.704864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca159eb-e8ca-406a-be0c-906ea8dc6fac None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.705256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca159eb-e8ca-406a-be0c-906ea8dc6fac None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.705421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca159eb-e8ca-406a-be0c-906ea8dc6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.722820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fca159eb-e8ca-406a-be0c-906ea8dc6fac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:31.724012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fca159eb-e8ca-406a-be0c-906ea8dc6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:31.731071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b7b5a-1a72-4c12-8647-b70d98a3cd88 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.731370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b7b5a-1a72-4c12-8647-b70d98a3cd88 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.731656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b7b5a-1a72-4c12-8647-b70d98a3cd88 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.732126 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:31.733440 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 6/12] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:31.738884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd624d6-b4d0-459e-bf4e-4bd7e30e17f8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.739174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd624d6-b4d0-459e-bf4e-4bd7e30e17f8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.739455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd624d6-b4d0-459e-bf4e-4bd7e30e17f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.756909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b7b5a-1a72-4c12-8647-b70d98a3cd88 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:31.757196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0cd624d6-b4d0-459e-bf4e-4bd7e30e17f8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:31.758390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0cd624d6-b4d0-459e-bf4e-4bd7e30e17f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:31.766009 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:31.768685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b7b5a-1a72-4c12-8647-b70d98a3cd88 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:31.772871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1818e-7c42-4fc5-a9c8-e2ff82d09284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:31.773635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1818e-7c42-4fc5-a9c8-e2ff82d09284 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.773920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1818e-7c42-4fc5-a9c8-e2ff82d09284 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.774200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1818e-7c42-4fc5-a9c8-e2ff82d09284 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.789421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd624d6-b4d0-459e-bf4e-4bd7e30e17f8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:31.790219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1818e-7c42-4fc5-a9c8-e2ff82d09284 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:31.797103 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-90d1818e-7c42-4fc5-a9c8-e2ff82d09284 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:34:31.798789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd624d6-b4d0-459e-bf4e-4bd7e30e17f8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:31.798912 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:34:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:34:31.803255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ebfd4-f5f2-4b41-8fcf-18cff058a859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:31.803885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ebfd4-f5f2-4b41-8fcf-18cff058a859 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.804169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ebfd4-f5f2-4b41-8fcf-18cff058a859 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.804426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1818e-7c42-4fc5-a9c8-e2ff82d09284 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:31.804515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ebfd4-f5f2-4b41-8fcf-18cff058a859 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.812393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ebfd4-f5f2-4b41-8fcf-18cff058a859 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:31.814393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1818e-7c42-4fc5-a9c8-e2ff82d09284 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:31.814733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ebfd4-f5f2-4b41-8fcf-18cff058a859 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:31.818745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:31.819359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.819646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.819927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.820712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:31.821023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:31.822792 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:31.822792 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:34:31.822792 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:34:31.823711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:31.823838 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 20:34:31.829099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ebfd4-f5f2-4b41-8fcf-18cff058a859 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:31.837402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ebfd4-f5f2-4b41-8fcf-18cff058a859 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:31.838629 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 8/16] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:31.841906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85234-ebab-469e-8bd8-e8702fdb9b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:31.842746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85234-ebab-469e-8bd8-e8702fdb9b8a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.843033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85234-ebab-469e-8bd8-e8702fdb9b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.843302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85234-ebab-469e-8bd8-e8702fdb9b8a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.843658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:31.844614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85234-ebab-469e-8bd8-e8702fdb9b8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:31.846303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85234-ebab-469e-8bd8-e8702fdb9b8a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:31.847990 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:31.853203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3111a6-4860-4ee2-982c-0666c266a8df admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:31.857796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd034c-bb29-46c7-9d6b-9c11456549c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:31.858697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd034c-bb29-46c7-9d6b-9c11456549c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.858983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd034c-bb29-46c7-9d6b-9c11456549c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.859265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd034c-bb29-46c7-9d6b-9c11456549c2 admin admin] PATH_INFO: `/v3/users/e41a610bfe5c492388b0f1e7872c9a2c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.861663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd034c-bb29-46c7-9d6b-9c11456549c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=e41a610bfe5c492388b0f1e7872c9a2c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:31.863883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd034c-bb29-46c7-9d6b-9c11456549c2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:31.865668 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:31 2022] GET /identity/v3/users/e41a610bfe5c492388b0f1e7872c9a2c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:31.871324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85234-ebab-469e-8bd8-e8702fdb9b8a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:31.882272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85234-ebab-469e-8bd8-e8702fdb9b8a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:31.886941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc56884-fd71-4f25-963b-374ef5ecff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:31.887758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56884-fd71-4f25-963b-374ef5ecff53 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.888045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56884-fd71-4f25-963b-374ef5ecff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.888340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56884-fd71-4f25-963b-374ef5ecff53 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.889598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc56884-fd71-4f25-963b-374ef5ecff53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:31.891355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc56884-fd71-4f25-963b-374ef5ecff53 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:31.893594 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:31.900855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd034c-bb29-46c7-9d6b-9c11456549c2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:31.911728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd034c-bb29-46c7-9d6b-9c11456549c2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:31.916697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391a9ef-6db2-473f-9a4c-1330540c0417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:31.917370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a9ef-6db2-473f-9a4c-1330540c0417 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:31.917656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a9ef-6db2-473f-9a4c-1330540c0417 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:31.917937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a9ef-6db2-473f-9a4c-1330540c0417 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:31.918778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391a9ef-6db2-473f-9a4c-1330540c0417 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.domain.id=default, user.id=e41a610bfe5c492388b0f1e7872c9a2c) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:31.919093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391a9ef-6db2-473f-9a4c-1330540c0417 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:31.920117 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-b391a9ef-6db2-473f-9a4c-1330540c0417 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:31.920117 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:34:31.920117 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:34:31.921329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391a9ef-6db2-473f-9a4c-1330540c0417 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:31.931717 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1343 bytes} [Sat Feb 19 20:34:31 2022] GET /identity/v3/role_assignments?user.id=e41a610bfe5c492388b0f1e7872c9a2c&scope.domain.id=default&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:34.878509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e230-d200-485c-8042-6b506d2baf6d None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:34.878509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e230-d200-485c-8042-6b506d2baf6d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:34.878509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e230-d200-485c-8042-6b506d2baf6d None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:34.878509 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 11/21] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:34.890025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:34.890464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:34.890653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:34.952538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG passlib.handlers.bcrypt [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=96910) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 19 20:34:34.952888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG passlib.handlers.bcrypt [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=96910) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 19 20:34:34.987999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5becd-0e98-46b9-b7ae-a77603a20f09 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:34.988669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5becd-0e98-46b9-b7ae-a77603a20f09 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:34.989149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5becd-0e98-46b9-b7ae-a77603a20f09 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:34.991369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:35.002486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ba29-fa34-4589-b634-adb6efe34af2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.003039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ba29-fa34-4589-b634-adb6efe34af2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.003621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ba29-fa34-4589-b634-adb6efe34af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.021430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:35.023091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:35.036885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-04d3ba29-fa34-4589-b634-adb6efe34af2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:35.038429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-04d3ba29-fa34-4589-b634-adb6efe34af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:35.071641 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:35.073717 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 13/24] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:35.099923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.111175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b3a75-b381-4d40-84ab-8aa79cd886dc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.116124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3ba29-fa34-4589-b634-adb6efe34af2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.125508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3ba29-fa34-4589-b634-adb6efe34af2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.131801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.133538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.134347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.135600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ecbe2-c3bd-4a16-aeb7-1d7f9962743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.136651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ecbe2-c3bd-4a16-aeb7-1d7f9962743e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.137136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.138259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:35.138739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ecbe2-c3bd-4a16-aeb7-1d7f9962743e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.139229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ecbe2-c3bd-4a16-aeb7-1d7f9962743e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.140515 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:35.140515 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:34:35.140515 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:34:35.144040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:35.164639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ecbe2-c3bd-4a16-aeb7-1d7f9962743e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:35.172433 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-354ecbe2-c3bd-4a16-aeb7-1d7f9962743e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:34:35.174950 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 14/25] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:34:35.193697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ecbe2-c3bd-4a16-aeb7-1d7f9962743e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.214286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ecbe2-c3bd-4a16-aeb7-1d7f9962743e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.228723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.229803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.230290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.230767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.231755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:35.232270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:35.234260 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:35.234260 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:34:35.234260 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:34:35.236044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:35.274687 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 15/26] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:35.294224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.309411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37314fe0-a60f-4f4e-9371-61fae3b247fe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.317280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3540ab1-a86c-4bfc-b19a-2815dca01520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.329856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540ab1-a86c-4bfc-b19a-2815dca01520 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.330358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540ab1-a86c-4bfc-b19a-2815dca01520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.330839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540ab1-a86c-4bfc-b19a-2815dca01520 admin admin] PATH_INFO: `/v3/users/e41a610bfe5c492388b0f1e7872c9a2c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.332363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3540ab1-a86c-4bfc-b19a-2815dca01520 admin admin] RBAC: Authorizing `identity:get_user(user_id=e41a610bfe5c492388b0f1e7872c9a2c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:35.334382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3540ab1-a86c-4bfc-b19a-2815dca01520 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:35.336298 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 16/27] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:35 2022] GET /identity/v3/users/e41a610bfe5c492388b0f1e7872c9a2c => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:35.349153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3540ab1-a86c-4bfc-b19a-2815dca01520 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.359490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3540ab1-a86c-4bfc-b19a-2815dca01520 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.372295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d3f4a-9ce1-4a10-b979-46f8132c689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.373640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d3f4a-9ce1-4a10-b979-46f8132c689e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.374127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d3f4a-9ce1-4a10-b979-46f8132c689e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.374608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d3f4a-9ce1-4a10-b979-46f8132c689e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.376076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d3f4a-9ce1-4a10-b979-46f8132c689e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:35.380096 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 12/28] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:34:35 2022] POST /identity/v3/roles => generated 219 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:35.381272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d3f4a-9ce1-4a10-b979-46f8132c689e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:35.384772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 17/29] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:35.393651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.415537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c6dc-7d40-45e2-9619-4475c1522f30 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.430281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e8975-2dbc-4eb1-92bd-c794584f1cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.431199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8975-2dbc-4eb1-92bd-c794584f1cde admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.431488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8975-2dbc-4eb1-92bd-c794584f1cde admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.431771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8975-2dbc-4eb1-92bd-c794584f1cde admin admin] PATH_INFO: `/v3/domains/default/users/e41a610bfe5c492388b0f1e7872c9a2c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.434660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e8975-2dbc-4eb1-92bd-c794584f1cde admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e41a610bfe5c492388b0f1e7872c9a2c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:35.435891 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-d23e8975-2dbc-4eb1-92bd-c794584f1cde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:35.435891 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:34:35.435891 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:34:35.437944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e8975-2dbc-4eb1-92bd-c794584f1cde admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:35.482808 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 13/30] 10.222.0.30 () {58 vars in 1382 bytes} [Sat Feb 19 20:34:35 2022] PUT /identity/v3/domains/default/users/e41a610bfe5c492388b0f1e7872c9a2c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:34:35.527600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ae44-3c09-41a4-8f3d-a1359fc9f235 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.527600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ae44-3c09-41a4-8f3d-a1359fc9f235 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.527600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ae44-3c09-41a4-8f3d-a1359fc9f235 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.529844 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 18/31] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:35.536193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ce41f-f79e-4ad2-aff5-17ca9ff89f90 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.536557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ce41f-f79e-4ad2-aff5-17ca9ff89f90 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.536806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ce41f-f79e-4ad2-aff5-17ca9ff89f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.568956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cb7ce41f-f79e-4ad2-aff5-17ca9ff89f90 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:35.570544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cb7ce41f-f79e-4ad2-aff5-17ca9ff89f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:35.721381 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 14/32] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:35.772033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2ae44-3c09-41a4-8f3d-a1359fc9f235 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.790737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2ae44-3c09-41a4-8f3d-a1359fc9f235 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.800106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.800937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.801294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.801581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.817923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:35.819837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:35.842002 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:34:35.843239 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 19/33] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:35.849125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ce41f-f79e-4ad2-aff5-17ca9ff89f90 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.866000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ce41f-f79e-4ad2-aff5-17ca9ff89f90 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.873874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ad12-ed4a-4fca-9ee4-b2a28c876915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.874558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ad12-ed4a-4fca-9ee4-b2a28c876915 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.874847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ad12-ed4a-4fca-9ee4-b2a28c876915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.875129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ad12-ed4a-4fca-9ee4-b2a28c876915 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.875889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62ad12-ed4a-4fca-9ee4-b2a28c876915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:35.876836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62ad12-ed4a-4fca-9ee4-b2a28c876915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:35.877933 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-6f62ad12-ed4a-4fca-9ee4-b2a28c876915 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:35.877933 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:34:35.877933 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:34:35.878864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62ad12-ed4a-4fca-9ee4-b2a28c876915 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:35.901674 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 15/34] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:35.909752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:35.923865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1a94-bb5b-4594-bba3-82b65376300c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:35.932221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65fee5-909d-49dc-b480-a889fcc7d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:35.932923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65fee5-909d-49dc-b480-a889fcc7d403 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:35.933207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65fee5-909d-49dc-b480-a889fcc7d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:35.933484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65fee5-909d-49dc-b480-a889fcc7d403 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:35.934238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65fee5-909d-49dc-b480-a889fcc7d403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:35.935285 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-7a65fee5-909d-49dc-b480-a889fcc7d403 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:35.935285 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:34:35.935285 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:34:35.936580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65fee5-909d-49dc-b480-a889fcc7d403 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:36.015126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5787-0704-47e7-9404-9bc1e7a969a4 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.015470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5787-0704-47e7-9404-9bc1e7a969a4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.015735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5787-0704-47e7-9404-9bc1e7a969a4 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.018476 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 16/35] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:36.023406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff5a2-09ec-4e19-9344-eb4b6b5b62cb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.023628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff5a2-09ec-4e19-9344-eb4b6b5b62cb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.023918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff5a2-09ec-4e19-9344-eb4b6b5b62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.056263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3beff5a2-09ec-4e19-9344-eb4b6b5b62cb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:36.057513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3beff5a2-09ec-4e19-9344-eb4b6b5b62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:36.082973 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 17/36] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:36.102429 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 20/37] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:34:35 2022] POST /identity/v3/projects => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:36.116252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beff5a2-09ec-4e19-9344-eb4b6b5b62cb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:36.127971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beff5a2-09ec-4e19-9344-eb4b6b5b62cb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:36.199337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab4de-7ad0-44eb-839e-c16fe9b0b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:36.200041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab4de-7ad0-44eb-839e-c16fe9b0b53e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.200345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab4de-7ad0-44eb-839e-c16fe9b0b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.200631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ab4de-7ad0-44eb-839e-c16fe9b0b53e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.201414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ab4de-7ad0-44eb-839e-c16fe9b0b53e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:36.203040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ab4de-7ad0-44eb-839e-c16fe9b0b53e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:36.218213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c580a-264c-44e2-9a63-744610c1d6cf None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.218511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c580a-264c-44e2-9a63-744610c1d6cf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.218836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c580a-264c-44e2-9a63-744610c1d6cf None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.221631 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 21/38] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:36.227285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d815-efc4-4757-85c7-4d66c5397880 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.227575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d815-efc4-4757-85c7-4d66c5397880 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.227862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d815-efc4-4757-85c7-4d66c5397880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.255362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a459d815-efc4-4757-85c7-4d66c5397880 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:36.260460 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 18/39] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:34:36 2022] POST /identity/v3/roles => generated 225 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:36.262054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a459d815-efc4-4757-85c7-4d66c5397880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:36.283374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 22/40] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:36.320734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab4de-7ad0-44eb-839e-c16fe9b0b53e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:36.334842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ab4de-7ad0-44eb-839e-c16fe9b0b53e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:36.342753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148d65-bff5-464b-818a-5de517af41c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:36.343824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148d65-bff5-464b-818a-5de517af41c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.344317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148d65-bff5-464b-818a-5de517af41c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.345457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148d65-bff5-464b-818a-5de517af41c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.346453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7148d65-bff5-464b-818a-5de517af41c0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:36.348485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7148d65-bff5-464b-818a-5de517af41c0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:36.353503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f15b3-18ef-479e-89fc-29ef2a516c61 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.353503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f15b3-18ef-479e-89fc-29ef2a516c61 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.353503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f15b3-18ef-479e-89fc-29ef2a516c61 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.354833 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 23/41] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:34:36.361542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b9e42-b318-4659-a45c-cb3503ec5f92 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.361898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b9e42-b318-4659-a45c-cb3503ec5f92 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.362186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b9e42-b318-4659-a45c-cb3503ec5f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.384376 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 19/42] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:34:36 2022] POST /identity/v3/roles => generated 223 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:36.393846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e39b9e42-b318-4659-a45c-cb3503ec5f92 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:36.395378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e39b9e42-b318-4659-a45c-cb3503ec5f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:36.404792 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 24/43] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:36.434341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148d65-bff5-464b-818a-5de517af41c0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:36.445781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148d65-bff5-464b-818a-5de517af41c0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:36.450951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baa2ac-f95f-4753-a9ca-465600c89ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:36.451838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baa2ac-f95f-4753-a9ca-465600c89ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.452184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baa2ac-f95f-4753-a9ca-465600c89ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.452508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baa2ac-f95f-4753-a9ca-465600c89ae9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.453950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baa2ac-f95f-4753-a9ca-465600c89ae9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:36.456436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baa2ac-f95f-4753-a9ca-465600c89ae9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:36.458328 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 20/44] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:36.465461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b9e42-b318-4659-a45c-cb3503ec5f92 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:36.477093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b9e42-b318-4659-a45c-cb3503ec5f92 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:36.482181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ba815-dd90-4a63-9ab2-cc48c06f5b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:36.482919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ba815-dd90-4a63-9ab2-cc48c06f5b62 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:36.483201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ba815-dd90-4a63-9ab2-cc48c06f5b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:36.483484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ba815-dd90-4a63-9ab2-cc48c06f5b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:36.484255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ba815-dd90-4a63-9ab2-cc48c06f5b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:36.487281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ba815-dd90-4a63-9ab2-cc48c06f5b62 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:36.530153 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 25/45] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:34:36 2022] POST /identity/v3/projects => generated 312 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:38.300184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5867a-1936-4342-bcc4-c5dc00698c51 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.300735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5867a-1936-4342-bcc4-c5dc00698c51 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.300815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5867a-1936-4342-bcc4-c5dc00698c51 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.302606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 21/46] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:38.307904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc58-8478-4020-8cf1-905011177ce8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.308290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc58-8478-4020-8cf1-905011177ce8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.308624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc58-8478-4020-8cf1-905011177ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.326654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d9d7dc58-8478-4020-8cf1-905011177ce8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:38.327848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d9d7dc58-8478-4020-8cf1-905011177ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:38.383329 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 26/47] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:38.407755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5867a-1936-4342-bcc4-c5dc00698c51 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:38.420042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5867a-1936-4342-bcc4-c5dc00698c51 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:38.424888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529ba0-2ad4-4e7a-adae-60b51e49e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:38.425659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529ba0-2ad4-4e7a-adae-60b51e49e91a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.425944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529ba0-2ad4-4e7a-adae-60b51e49e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.426222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529ba0-2ad4-4e7a-adae-60b51e49e91a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.436425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02529ba0-2ad4-4e7a-adae-60b51e49e91a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:38.443709 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-02529ba0-2ad4-4e7a-adae-60b51e49e91a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:34:38.444913 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 22/48] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:34:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:38.450522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7dc58-8478-4020-8cf1-905011177ce8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:38.459505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7dc58-8478-4020-8cf1-905011177ce8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:38.463933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:38.464619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.464906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.465184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.465937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:38.466246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:38.467855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:38.476004 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 27/49] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:38.481392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529ba0-2ad4-4e7a-adae-60b51e49e91a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:38.492224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529ba0-2ad4-4e7a-adae-60b51e49e91a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:38.496683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278974-c0fa-4494-870a-acefedcd381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:38.497526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278974-c0fa-4494-870a-acefedcd381a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.497808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278974-c0fa-4494-870a-acefedcd381a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.498082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278974-c0fa-4494-870a-acefedcd381a admin admin] PATH_INFO: `/v3/users/e41a610bfe5c492388b0f1e7872c9a2c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.499288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278974-c0fa-4494-870a-acefedcd381a admin admin] RBAC: Authorizing `identity:get_user(user_id=e41a610bfe5c492388b0f1e7872c9a2c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:38.501791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278974-c0fa-4494-870a-acefedcd381a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:38.503383 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 23/50] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:38 2022] GET /identity/v3/users/e41a610bfe5c492388b0f1e7872c9a2c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:38.508525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:38.518412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9d53-fe75-4f54-85ce-471cf65c83d3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:38.523100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a774d-260b-43ed-9ea6-895df887cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:38.523925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a774d-260b-43ed-9ea6-895df887cd64 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.524213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a774d-260b-43ed-9ea6-895df887cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.524526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a774d-260b-43ed-9ea6-895df887cd64 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.525799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a774d-260b-43ed-9ea6-895df887cd64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:38.527583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a774d-260b-43ed-9ea6-895df887cd64 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:38.529653 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 28/51] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:38.537441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278974-c0fa-4494-870a-acefedcd381a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:38.548436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278974-c0fa-4494-870a-acefedcd381a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:38.552996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999db06c-1365-4505-b825-d1936b0cd976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:38.553601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db06c-1365-4505-b825-d1936b0cd976 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.553891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db06c-1365-4505-b825-d1936b0cd976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.554175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db06c-1365-4505-b825-d1936b0cd976 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.555015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999db06c-1365-4505-b825-d1936b0cd976 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.domain.id=default, user.id=e41a610bfe5c492388b0f1e7872c9a2c) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:38.555335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999db06c-1365-4505-b825-d1936b0cd976 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:38.557261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999db06c-1365-4505-b825-d1936b0cd976 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:38.563304 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 24/52] 10.222.0.30 () {56 vars in 1343 bytes} [Sat Feb 19 20:34:38 2022] GET /identity/v3/role_assignments?user.id=e41a610bfe5c492388b0f1e7872c9a2c&scope.domain.id=default&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:38.903514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4e42-6ce0-440c-821b-b55921752045 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.903731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4e42-6ce0-440c-821b-b55921752045 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.904017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4e42-6ce0-440c-821b-b55921752045 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.905905 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 29/53] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:38.911498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1bff-225e-4a4b-a08f-50b620fddf63 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.911791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1bff-225e-4a4b-a08f-50b620fddf63 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.912078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1bff-225e-4a4b-a08f-50b620fddf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.930368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0dbb1bff-225e-4a4b-a08f-50b620fddf63 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:38.931567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0dbb1bff-225e-4a4b-a08f-50b620fddf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:38.939016 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 25/54] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:38.962857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4e42-6ce0-440c-821b-b55921752045 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:38.975215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4e42-6ce0-440c-821b-b55921752045 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:38.979491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a09755-94b7-4ca4-8322-e18089ed3523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:38.980248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09755-94b7-4ca4-8322-e18089ed3523 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:38.980586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09755-94b7-4ca4-8322-e18089ed3523 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:38.980868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09755-94b7-4ca4-8322-e18089ed3523 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:38.982038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a09755-94b7-4ca4-8322-e18089ed3523 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:38.983736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a09755-94b7-4ca4-8322-e18089ed3523 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:38.985949 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 30/55] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:38.990722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1bff-225e-4a4b-a08f-50b620fddf63 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:38.999420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1bff-225e-4a4b-a08f-50b620fddf63 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:39.003743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2663ac1-787d-46e3-a92b-514f553b477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:39.004408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663ac1-787d-46e3-a92b-514f553b477a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:39.004697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663ac1-787d-46e3-a92b-514f553b477a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:39.004974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2663ac1-787d-46e3-a92b-514f553b477a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:39.005670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2663ac1-787d-46e3-a92b-514f553b477a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:39.006671 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-a2663ac1-787d-46e3-a92b-514f553b477a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:39.006671 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:34:39.006671 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:34:39.007882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2663ac1-787d-46e3-a92b-514f553b477a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:39.033688 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 26/56] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Feb 19 20:34:38 2022] POST /identity/v3/projects => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:41.396162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb13e2-73f7-4df2-a4db-76109b3d68eb None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:41.396704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb13e2-73f7-4df2-a4db-76109b3d68eb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:41.396809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb13e2-73f7-4df2-a4db-76109b3d68eb None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:41.398508 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 31/57] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:41.403675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b08c6-70e4-4313-bde7-c8413b509374 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:41.404069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b08c6-70e4-4313-bde7-c8413b509374 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:41.404237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b08c6-70e4-4313-bde7-c8413b509374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:41.424196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5e7b08c6-70e4-4313-bde7-c8413b509374 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:41.425417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e7b08c6-70e4-4313-bde7-c8413b509374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:41.478663 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 27/58] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:41.505107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb13e2-73f7-4df2-a4db-76109b3d68eb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:41.516898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb13e2-73f7-4df2-a4db-76109b3d68eb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:41.521091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29bcc4-124b-45f4-99e9-56adc9a8aafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:41.521847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29bcc4-124b-45f4-99e9-56adc9a8aafe admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:41.522128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29bcc4-124b-45f4-99e9-56adc9a8aafe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:41.522402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29bcc4-124b-45f4-99e9-56adc9a8aafe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:41.523549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29bcc4-124b-45f4-99e9-56adc9a8aafe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:41.525266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29bcc4-124b-45f4-99e9-56adc9a8aafe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:41.526823 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 32/59] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:41.531861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b08c6-70e4-4313-bde7-c8413b509374 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:41.540871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b08c6-70e4-4313-bde7-c8413b509374 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:41.545406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c69fc5-c6e4-4228-89c1-91f0cdbf740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:41.546058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69fc5-c6e4-4228-89c1-91f0cdbf740a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:41.546347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69fc5-c6e4-4228-89c1-91f0cdbf740a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:41.546630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69fc5-c6e4-4228-89c1-91f0cdbf740a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:41.547349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69fc5-c6e4-4228-89c1-91f0cdbf740a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:41.548875 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-58c69fc5-c6e4-4228-89c1-91f0cdbf740a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:41.548875 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:34:41.548875 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:34:41.550097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69fc5-c6e4-4228-89c1-91f0cdbf740a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:41.575199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 28/60] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:34:41 2022] POST /identity/v3/users => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:45.056357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594cc65-1c71-4536-8294-b46bd64fa5dd None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.056357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594cc65-1c71-4536-8294-b46bd64fa5dd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.056357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594cc65-1c71-4536-8294-b46bd64fa5dd None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.059146 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 33/61] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:45.065672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8146c-6b2e-418d-bb52-82fad790e7de None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.066568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8146c-6b2e-418d-bb52-82fad790e7de None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.067065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8146c-6b2e-418d-bb52-82fad790e7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.087866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e2a8146c-6b2e-418d-bb52-82fad790e7de None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:45.089477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2a8146c-6b2e-418d-bb52-82fad790e7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:45.104475 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 29/62] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:45.124271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594cc65-1c71-4536-8294-b46bd64fa5dd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.145009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594cc65-1c71-4536-8294-b46bd64fa5dd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.150035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64e7d-8edb-49d6-b19c-8ba94e3e1865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.151067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64e7d-8edb-49d6-b19c-8ba94e3e1865 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.151548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64e7d-8edb-49d6-b19c-8ba94e3e1865 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.152037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64e7d-8edb-49d6-b19c-8ba94e3e1865 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.176167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f64e7d-8edb-49d6-b19c-8ba94e3e1865 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:45.183414 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-77f64e7d-8edb-49d6-b19c-8ba94e3e1865 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:34:45.184904 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 34/63] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:45.192595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8146c-6b2e-418d-bb52-82fad790e7de None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.210291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8146c-6b2e-418d-bb52-82fad790e7de None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.223408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.224502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.224941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.225370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.226619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:45.227107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.233833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.257926 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 30/64] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:45.265003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64e7d-8edb-49d6-b19c-8ba94e3e1865 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.279921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64e7d-8edb-49d6-b19c-8ba94e3e1865 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.287986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494528-7645-4fa5-adc0-c6b96c6cf641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.289402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494528-7645-4fa5-adc0-c6b96c6cf641 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.289885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494528-7645-4fa5-adc0-c6b96c6cf641 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.290355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494528-7645-4fa5-adc0-c6b96c6cf641 admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.314988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494528-7645-4fa5-adc0-c6b96c6cf641 admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.317482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494528-7645-4fa5-adc0-c6b96c6cf641 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.319411 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 35/65] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:45.325044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.342730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c67bc1-1bca-49b7-9e28-dfcd7c01d40f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.352513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85c69b-1593-44d4-9eae-f509d7c6054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.353171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85c69b-1593-44d4-9eae-f509d7c6054b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.353457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85c69b-1593-44d4-9eae-f509d7c6054b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.353739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85c69b-1593-44d4-9eae-f509d7c6054b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.367896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85c69b-1593-44d4-9eae-f509d7c6054b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.369706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85c69b-1593-44d4-9eae-f509d7c6054b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.382354 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 31/66] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:45.387952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494528-7645-4fa5-adc0-c6b96c6cf641 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.397982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494528-7645-4fa5-adc0-c6b96c6cf641 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.402687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb8c78-2027-4a12-a441-3c25c14f1aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.403812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8c78-2027-4a12-a441-3c25c14f1aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.404291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8c78-2027-4a12-a441-3c25c14f1aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.404797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8c78-2027-4a12-a441-3c25c14f1aa5 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.406182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb8c78-2027-4a12-a441-3c25c14f1aa5 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.408500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb8c78-2027-4a12-a441-3c25c14f1aa5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.410680 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 36/67] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:45.417633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85c69b-1593-44d4-9eae-f509d7c6054b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.429559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85c69b-1593-44d4-9eae-f509d7c6054b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.436624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb304f7-1c1b-4ac3-bfae-b66216f5060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.437275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb304f7-1c1b-4ac3-bfae-b66216f5060c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.437565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb304f7-1c1b-4ac3-bfae-b66216f5060c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.437850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb304f7-1c1b-4ac3-bfae-b66216f5060c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.439248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb304f7-1c1b-4ac3-bfae-b66216f5060c admin admin] RBAC: Adding query filter params (role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2, user.id=448ba5fdb5894afc8dd742016d40b4f5) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:45.439564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb304f7-1c1b-4ac3-bfae-b66216f5060c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.441502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb304f7-1c1b-4ac3-bfae-b66216f5060c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.452840 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 32/68] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/role_assignments?user.id=448ba5fdb5894afc8dd742016d40b4f5&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:45.614587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a724-8e07-4460-a79b-e1c95bd37703 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.615278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a724-8e07-4460-a79b-e1c95bd37703 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.615806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a724-8e07-4460-a79b-e1c95bd37703 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.618474 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 37/69] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:45.624347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9a05-fe13-4805-a273-cc9923d93a11 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.624728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9a05-fe13-4805-a273-cc9923d93a11 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.625165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9a05-fe13-4805-a273-cc9923d93a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.633501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398a49-f7be-4a90-862f-8892eeb9bd22 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.634177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398a49-f7be-4a90-862f-8892eeb9bd22 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.634665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398a49-f7be-4a90-862f-8892eeb9bd22 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.637282 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 38/70] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:45.649219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acc16e-1d4c-43cf-ae0d-973c5ec30622 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.649842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acc16e-1d4c-43cf-ae0d-973c5ec30622 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.650313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acc16e-1d4c-43cf-ae0d-973c5ec30622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.652870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5c5f9a05-fe13-4805-a273-cc9923d93a11 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:45.654104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5c5f9a05-fe13-4805-a273-cc9923d93a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:45.666159 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 33/71] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:45.667876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180678-73c4-4feb-b672-7c27903746f2 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.668431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180678-73c4-4feb-b672-7c27903746f2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.668906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a180678-73c4-4feb-b672-7c27903746f2 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.671095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-78acc16e-1d4c-43cf-ae0d-973c5ec30622 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:45.671325 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 34/72] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:45.672795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-78acc16e-1d4c-43cf-ae0d-973c5ec30622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:45.676861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb3fc-0f60-42af-aa8d-468edaa85423 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.677154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb3fc-0f60-42af-aa8d-468edaa85423 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.677435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb3fc-0f60-42af-aa8d-468edaa85423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.683693 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 39/73] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:45.701368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acc16e-1d4c-43cf-ae0d-973c5ec30622 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.703267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-861fb3fc-0f60-42af-aa8d-468edaa85423 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:45.705105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-861fb3fc-0f60-42af-aa8d-468edaa85423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:45.714145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acc16e-1d4c-43cf-ae0d-973c5ec30622 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.719286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac959d8-9973-48cf-8137-534cd9f0d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.720011 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 35/74] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:45.720118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac959d8-9973-48cf-8137-534cd9f0d3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.720441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac959d8-9973-48cf-8137-534cd9f0d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.720727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac959d8-9973-48cf-8137-534cd9f0d3d5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.721433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3585e9d-20da-4670-a6a6-d17cd4b03224 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.721732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3585e9d-20da-4670-a6a6-d17cd4b03224 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.722018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3585e9d-20da-4670-a6a6-d17cd4b03224 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.723994 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 36/75] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:45.724748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3585e9d-20da-4670-a6a6-d17cd4b03224 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.739179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac959d8-9973-48cf-8137-534cd9f0d3d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:45.743134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3585e9d-20da-4670-a6a6-d17cd4b03224 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.747576 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-bac959d8-9973-48cf-8137-534cd9f0d3d5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:34:45.747732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731bc48-a715-407b-be60-d5b196553f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.748548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731bc48-a715-407b-be60-d5b196553f93 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.748838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731bc48-a715-407b-be60-d5b196553f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.749119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731bc48-a715-407b-be60-d5b196553f93 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.749877 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 40/76] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:45.750348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731bc48-a715-407b-be60-d5b196553f93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.752069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757578-e6ce-4280-9430-586d24fb183b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.752572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757578-e6ce-4280-9430-586d24fb183b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.752760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731bc48-a715-407b-be60-d5b196553f93 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.753191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757578-e6ce-4280-9430-586d24fb183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.754891 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 37/77] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:45.755682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731bc48-a715-407b-be60-d5b196553f93 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.765869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731bc48-a715-407b-be60-d5b196553f93 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.770990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e22e8b-8193-47b2-96a5-2da451647f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.771785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e22e8b-8193-47b2-96a5-2da451647f5b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.772070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e22e8b-8193-47b2-96a5-2da451647f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.772365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e22e8b-8193-47b2-96a5-2da451647f5b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.773217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8b757578-e6ce-4280-9430-586d24fb183b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:45.774628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8b757578-e6ce-4280-9430-586d24fb183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:45.782893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e22e8b-8193-47b2-96a5-2da451647f5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:45.788173 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 41/78] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:45.792401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b757578-e6ce-4280-9430-586d24fb183b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.792509 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b6e22e8b-8193-47b2-96a5-2da451647f5b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:34:45.792509 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 38/79] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:45.793135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e22e8b-8193-47b2-96a5-2da451647f5b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.803412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b757578-e6ce-4280-9430-586d24fb183b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.805879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e22e8b-8193-47b2-96a5-2da451647f5b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.810307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2738b3-00ec-4d4d-b882-7f2ed0c3cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.810992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2738b3-00ec-4d4d-b882-7f2ed0c3cffa admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.811268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2738b3-00ec-4d4d-b882-7f2ed0c3cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.811739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2738b3-00ec-4d4d-b882-7f2ed0c3cffa admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.812678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2738b3-00ec-4d4d-b882-7f2ed0c3cffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.812865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.814104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.814459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.814805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.815656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:45.815965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.816064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2738b3-00ec-4d4d-b882-7f2ed0c3cffa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.817621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.826099 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 42/80] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:45.826946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.837726 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 39/81] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:34:45 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:45.838543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2738b3-00ec-4d4d-b882-7f2ed0c3cffa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.840544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9f746-f226-4cf1-b4ce-affc57d21482 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.847244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.848397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.848503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2738b3-00ec-4d4d-b882-7f2ed0c3cffa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.849240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.849831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.851124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:45.851918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.853321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068ec7-fe35-426c-8293-14fc068f034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.854137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068ec7-fe35-426c-8293-14fc068f034a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.854417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068ec7-fe35-426c-8293-14fc068f034a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.854694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068ec7-fe35-426c-8293-14fc068f034a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.855294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.867025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5068ec7-fe35-426c-8293-14fc068f034a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:45.868546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 43/82] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:45.869848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.879167 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b5068ec7-fe35-426c-8293-14fc068f034a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:34:45.885673 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 40/83] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:45.885673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068ec7-fe35-426c-8293-14fc068f034a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.885901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2af9-4e0a-4584-859d-9ce3bedc6b8c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.894125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38ebdd-37bc-4883-b644-529edb0f7756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.896179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ebdd-37bc-4883-b644-529edb0f7756 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.896795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ebdd-37bc-4883-b644-529edb0f7756 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.897281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ebdd-37bc-4883-b644-529edb0f7756 admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.897384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068ec7-fe35-426c-8293-14fc068f034a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.899717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38ebdd-37bc-4883-b644-529edb0f7756 admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.902427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c3743-c548-4562-b280-52f4e3df7464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.903310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38ebdd-37bc-4883-b644-529edb0f7756 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.903418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3743-c548-4562-b280-52f4e3df7464 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.903760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3743-c548-4562-b280-52f4e3df7464 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.904122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c3743-c548-4562-b280-52f4e3df7464 admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.905585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c3743-c548-4562-b280-52f4e3df7464 admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.906793 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 44/84] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:45.908181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38ebdd-37bc-4883-b644-529edb0f7756 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.913030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c3743-c548-4562-b280-52f4e3df7464 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.915399 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 41/85] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:45.924251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c3743-c548-4562-b280-52f4e3df7464 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.927403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38ebdd-37bc-4883-b644-529edb0f7756 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.932468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.933279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.933607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.933964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.934870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:45.935255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.937116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.945106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c3743-c548-4562-b280-52f4e3df7464 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.948838 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 45/86] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:45.952771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.955920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49205283-e900-4393-b8d1-0ea7cc1272f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.956868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205283-e900-4393-b8d1-0ea7cc1272f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.957422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205283-e900-4393-b8d1-0ea7cc1272f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.958002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205283-e900-4393-b8d1-0ea7cc1272f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.965625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585bfe9-a1a4-42e8-bade-7f5e68f7842a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.968677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49205283-e900-4393-b8d1-0ea7cc1272f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.971041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6b021-fcb5-4fe1-8282-76ad13c9f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:45.971203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49205283-e900-4393-b8d1-0ea7cc1272f7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.972027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6b021-fcb5-4fe1-8282-76ad13c9f196 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:45.972495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6b021-fcb5-4fe1-8282-76ad13c9f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:45.972939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6b021-fcb5-4fe1-8282-76ad13c9f196 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:45.982109 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 42/87] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 20:34:45.982627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6b021-fcb5-4fe1-8282-76ad13c9f196 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:45.983212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49205283-e900-4393-b8d1-0ea7cc1272f7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.984853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6b021-fcb5-4fe1-8282-76ad13c9f196 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:45.994448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49205283-e900-4393-b8d1-0ea7cc1272f7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:45.996316 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 46/88] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:45.997417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6b021-fcb5-4fe1-8282-76ad13c9f196 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:45.999381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a65c8-0c78-4324-afd6-2558767037e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:46.000369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a65c8-0c78-4324-afd6-2558767037e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:46.000757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a65c8-0c78-4324-afd6-2558767037e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:46.001718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a65c8-0c78-4324-afd6-2558767037e8 admin admin] PATH_INFO: `/v3/users/e41a610bfe5c492388b0f1e7872c9a2c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:46.003029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a65c8-0c78-4324-afd6-2558767037e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=e41a610bfe5c492388b0f1e7872c9a2c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:46.005100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a65c8-0c78-4324-afd6-2558767037e8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:46.007030 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 43/89] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/users/e41a610bfe5c492388b0f1e7872c9a2c => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:46.007836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a65c8-0c78-4324-afd6-2558767037e8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:46.009957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6b021-fcb5-4fe1-8282-76ad13c9f196 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:46.020309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51760a77-1be1-4dc5-b9fe-77892878119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:46.021720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51760a77-1be1-4dc5-b9fe-77892878119e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:46.022137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51760a77-1be1-4dc5-b9fe-77892878119e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:46.022514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51760a77-1be1-4dc5-b9fe-77892878119e admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:46.023690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a65c8-0c78-4324-afd6-2558767037e8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:46.024029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51760a77-1be1-4dc5-b9fe-77892878119e admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:46.026474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51760a77-1be1-4dc5-b9fe-77892878119e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:46.029124 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 47/90] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:45 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:46.029481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b12a-9441-4ae0-be9f-793dea418674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:46.030107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51760a77-1be1-4dc5-b9fe-77892878119e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:46.030688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b12a-9441-4ae0-be9f-793dea418674 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:46.031244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b12a-9441-4ae0-be9f-793dea418674 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:46.031694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b12a-9441-4ae0-be9f-793dea418674 admin admin] PATH_INFO: `/v3/projects/21b7dd2a6cf244178e3d3131effcb7ce` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:46.033207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44b12a-9441-4ae0-be9f-793dea418674 admin admin] RBAC: Authorizing `identity:get_project(project_id=21b7dd2a6cf244178e3d3131effcb7ce)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:46.037258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44b12a-9441-4ae0-be9f-793dea418674 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:46.040043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 44/91] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:46 2022] GET /identity/v3/projects/21b7dd2a6cf244178e3d3131effcb7ce => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:46.040996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b12a-9441-4ae0-be9f-793dea418674 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:46.041738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51760a77-1be1-4dc5-b9fe-77892878119e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:46.052190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b12a-9441-4ae0-be9f-793dea418674 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:46.052696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f3bc0-4345-45bd-86cb-24a3d1a4ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:46.053338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f3bc0-4345-45bd-86cb-24a3d1a4ad83 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:46.053621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f3bc0-4345-45bd-86cb-24a3d1a4ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:46.053897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f3bc0-4345-45bd-86cb-24a3d1a4ad83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:46.059116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:46.059116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:46.059116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:46.059116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:46.059423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] RBAC: Adding query filter params (role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2, user.id=448ba5fdb5894afc8dd742016d40b4f5) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:46.059423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:46.061517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:46.064273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f3bc0-4345-45bd-86cb-24a3d1a4ad83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:46.066868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f3bc0-4345-45bd-86cb-24a3d1a4ad83 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:46.070610 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 45/92] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:46 2022] GET /identity/v3/role_assignments?user.id=448ba5fdb5894afc8dd742016d40b4f5&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:46.071847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:46.080439 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 48/93] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:46.082531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84a5b0-2051-4807-b9ee-4b1a8de1b104 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:46.089247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f3bc0-4345-45bd-86cb-24a3d1a4ad83 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:46.092467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:46.093519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:46.094005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:46.094466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:46.095536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] RBAC: Adding query filter params (role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=21b7dd2a6cf244178e3d3131effcb7ce, user.id=448ba5fdb5894afc8dd742016d40b4f5) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:46.095915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:46.097945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:46.100049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f3bc0-4345-45bd-86cb-24a3d1a4ad83 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:46.105691 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 46/94] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:46 2022] GET /identity/v3/role_assignments?user.id=448ba5fdb5894afc8dd742016d40b4f5&scope.project.id=21b7dd2a6cf244178e3d3131effcb7ce&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:46.106345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ad59e-6467-4967-95c6-08f8e2f34d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:46.107423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ad59e-6467-4967-95c6-08f8e2f34d93 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:46.107865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ad59e-6467-4967-95c6-08f8e2f34d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:46.108397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ad59e-6467-4967-95c6-08f8e2f34d93 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:46.110798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ad59e-6467-4967-95c6-08f8e2f34d93 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:46.113465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ad59e-6467-4967-95c6-08f8e2f34d93 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:46.115810 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 49/95] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:46 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:46.123643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:46.137722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297575-e5fd-4aa0-b35c-5360cfb62e93 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:46.143084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52121210-109c-4001-8b9a-663ef95a77ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:46.144241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52121210-109c-4001-8b9a-663ef95a77ae admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:46.144781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52121210-109c-4001-8b9a-663ef95a77ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:46.145401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52121210-109c-4001-8b9a-663ef95a77ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:46.146538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52121210-109c-4001-8b9a-663ef95a77ae admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2, user.id=e41a610bfe5c492388b0f1e7872c9a2c) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:46.147116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52121210-109c-4001-8b9a-663ef95a77ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:46.149530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52121210-109c-4001-8b9a-663ef95a77ae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:46.156379 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 47/96] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:46 2022] GET /identity/v3/role_assignments?user.id=e41a610bfe5c492388b0f1e7872c9a2c&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:48.671365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ecf3d-b0a3-4191-8ebb-9dafe42e22cf None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:48.672387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ecf3d-b0a3-4191-8ebb-9dafe42e22cf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:48.672934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ecf3d-b0a3-4191-8ebb-9dafe42e22cf None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:48.675292 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 50/97] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:48.681733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a726-43bd-43ea-bb54-37c3dac65ee5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:48.682618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a726-43bd-43ea-bb54-37c3dac65ee5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:48.683100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a726-43bd-43ea-bb54-37c3dac65ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:48.709369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f065a726-43bd-43ea-bb54-37c3dac65ee5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:48.710873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f065a726-43bd-43ea-bb54-37c3dac65ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:48.719131 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 48/98] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:48.784411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ecf3d-b0a3-4191-8ebb-9dafe42e22cf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:48.804007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ecf3d-b0a3-4191-8ebb-9dafe42e22cf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:48.813546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb6528-1f9f-4a68-bcd8-93e1121a6365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:48.814351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb6528-1f9f-4a68-bcd8-93e1121a6365 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:48.814634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb6528-1f9f-4a68-bcd8-93e1121a6365 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:48.814911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb6528-1f9f-4a68-bcd8-93e1121a6365 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:48.830260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb6528-1f9f-4a68-bcd8-93e1121a6365 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:48.837656 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-7beb6528-1f9f-4a68-bcd8-93e1121a6365 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:34:48.839157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 51/99] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:48.845373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065a726-43bd-43ea-bb54-37c3dac65ee5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:48.857557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065a726-43bd-43ea-bb54-37c3dac65ee5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:48.864953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:48.865890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:48.866382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:48.866863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:48.867817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:48.872400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:48.874311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:48.883609 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 49/100] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:48.889415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb6528-1f9f-4a68-bcd8-93e1121a6365 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:48.911044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb6528-1f9f-4a68-bcd8-93e1121a6365 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:48.918707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986711b-52de-4742-99cb-3c378befbe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:48.919620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986711b-52de-4742-99cb-3c378befbe43 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:48.919911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986711b-52de-4742-99cb-3c378befbe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:48.920190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986711b-52de-4742-99cb-3c378befbe43 admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:48.925124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986711b-52de-4742-99cb-3c378befbe43 admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:48.927221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986711b-52de-4742-99cb-3c378befbe43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:48.929176 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 52/101] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:48 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:48.934180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:48.949482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248869-7df0-4247-a14a-6c1e4b901f8a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:48.957061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ef3dc-df4c-40d7-a955-134d0f9864b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:48.958144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef3dc-df4c-40d7-a955-134d0f9864b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:48.958654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef3dc-df4c-40d7-a955-134d0f9864b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:48.959134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef3dc-df4c-40d7-a955-134d0f9864b6 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:48.965068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ef3dc-df4c-40d7-a955-134d0f9864b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:48.967431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ef3dc-df4c-40d7-a955-134d0f9864b6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:48.969384 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 50/102] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:48 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:48.975815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986711b-52de-4742-99cb-3c378befbe43 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:48.989301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986711b-52de-4742-99cb-3c378befbe43 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:48.996700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:48.997582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:48.997863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:48.998141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/users/448ba5fdb5894afc8dd742016d40b4f5/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.005659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a486af8aa3c4f399c582c62fa59d1b2, user_id=448ba5fdb5894afc8dd742016d40b4f5, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.006691 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:49.006691 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:34:49.006691 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:34:49.008668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.044363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1483a-5baf-4741-b151-8f0c5f0277a6 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.044974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1483a-5baf-4741-b151-8f0c5f0277a6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.045460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1483a-5baf-4741-b151-8f0c5f0277a6 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.047522 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 51/103] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:34:49.054873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875683e5-1484-4f58-8024-f70c6e298773 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.055459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875683e5-1484-4f58-8024-f70c6e298773 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.055946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875683e5-1484-4f58-8024-f70c6e298773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.059971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 53/104] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:34:48 2022] PUT /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/users/448ba5fdb5894afc8dd742016d40b4f5/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:34:49.085717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-875683e5-1484-4f58-8024-f70c6e298773 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:49.086956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-875683e5-1484-4f58-8024-f70c6e298773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:49.166415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 52/105] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:49.205814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.216165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd95d2-b471-45d3-b206-974b3959338f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.224897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e60e-0b3d-4bd8-8bcb-a218548892e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.225715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e60e-0b3d-4bd8-8bcb-a218548892e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.226003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e60e-0b3d-4bd8-8bcb-a218548892e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.226283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e60e-0b3d-4bd8-8bcb-a218548892e9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.241432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5e60e-0b3d-4bd8-8bcb-a218548892e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:49.244481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad36bb-b32b-4309-ba33-56c47e2b1876 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.244776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad36bb-b32b-4309-ba33-56c47e2b1876 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.245061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad36bb-b32b-4309-ba33-56c47e2b1876 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.246901 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 53/106] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:49.253077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe565d37-402b-4bf7-b38d-b6ee267d7e30 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.253374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe565d37-402b-4bf7-b38d-b6ee267d7e30 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.253654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe565d37-402b-4bf7-b38d-b6ee267d7e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.259936 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-5ff5e60e-0b3d-4bd8-8bcb-a218548892e9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:34:49.261213 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 54/107] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:49.267498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e60e-0b3d-4bd8-8bcb-a218548892e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.281047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e60e-0b3d-4bd8-8bcb-a218548892e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.285146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fe565d37-402b-4bf7-b38d-b6ee267d7e30 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:49.286386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe565d37-402b-4bf7-b38d-b6ee267d7e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:49.290064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.291095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.291585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.292137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.293282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:49.293830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.295739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.300649 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 54/108] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:49.311728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 55/109] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:49.318083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe565d37-402b-4bf7-b38d-b6ee267d7e30 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.334174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe565d37-402b-4bf7-b38d-b6ee267d7e30 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.339016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d08506-034d-4d9a-84a5-08da805d34b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.339934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08506-034d-4d9a-84a5-08da805d34b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.340212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08506-034d-4d9a-84a5-08da805d34b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.340524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08506-034d-4d9a-84a5-08da805d34b0 admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.341891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d08506-034d-4d9a-84a5-08da805d34b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.344152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d08506-034d-4d9a-84a5-08da805d34b0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.346989 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 55/110] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:49.352820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.359787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d08506-034d-4d9a-84a5-08da805d34b0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.368423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afe4d9-5acd-49c6-b25a-96383693b6f0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.373942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6444b97-e947-4eb5-b56d-fdff5804fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.374770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6444b97-e947-4eb5-b56d-fdff5804fceb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.375053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6444b97-e947-4eb5-b56d-fdff5804fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.375329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6444b97-e947-4eb5-b56d-fdff5804fceb admin admin] PATH_INFO: `/v3/projects/21b7dd2a6cf244178e3d3131effcb7ce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.378555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6444b97-e947-4eb5-b56d-fdff5804fceb admin admin] RBAC: Authorizing `identity:get_project(project_id=21b7dd2a6cf244178e3d3131effcb7ce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.380879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6444b97-e947-4eb5-b56d-fdff5804fceb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.382679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 56/111] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/projects/21b7dd2a6cf244178e3d3131effcb7ce => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:49.385823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d08506-034d-4d9a-84a5-08da805d34b0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.389362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6444b97-e947-4eb5-b56d-fdff5804fceb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.391007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6db1-f57f-40ce-ad99-d040a530b0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.391836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6db1-f57f-40ce-ad99-d040a530b0dc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.392125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6db1-f57f-40ce-ad99-d040a530b0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.392433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6db1-f57f-40ce-ad99-d040a530b0dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.404065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6444b97-e947-4eb5-b56d-fdff5804fceb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.408053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc6db1-f57f-40ce-ad99-d040a530b0dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:49.411724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046125-aa19-453b-8721-9e30d24297e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.412715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046125-aa19-453b-8721-9e30d24297e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.413071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046125-aa19-453b-8721-9e30d24297e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.413423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046125-aa19-453b-8721-9e30d24297e8 admin admin] PATH_INFO: `/v3/projects/21b7dd2a6cf244178e3d3131effcb7ce/users/448ba5fdb5894afc8dd742016d40b4f5/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.415718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046125-aa19-453b-8721-9e30d24297e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b7dd2a6cf244178e3d3131effcb7ce, user_id=448ba5fdb5894afc8dd742016d40b4f5, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.416781 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-80bc6db1-f57f-40ce-ad99-d040a530b0dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:34:49.418221 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 56/112] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:49.418645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046125-aa19-453b-8721-9e30d24297e8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.424699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6db1-f57f-40ce-ad99-d040a530b0dc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.436658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6db1-f57f-40ce-ad99-d040a530b0dc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.442623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.443733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.444197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.444832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.445991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:49.446473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.448484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.451656 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 57/113] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:34:49 2022] PUT /identity/v3/projects/21b7dd2a6cf244178e3d3131effcb7ce/users/448ba5fdb5894afc8dd742016d40b4f5/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:34:49.460826 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 57/114] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:49.467359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046125-aa19-453b-8721-9e30d24297e8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.561787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046125-aa19-453b-8721-9e30d24297e8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.567167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91661-b247-4e3d-8b86-7a75a05ff295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.568139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91661-b247-4e3d-8b86-7a75a05ff295 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.568549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91661-b247-4e3d-8b86-7a75a05ff295 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.568930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91661-b247-4e3d-8b86-7a75a05ff295 admin admin] PATH_INFO: `/v3/users/e41a610bfe5c492388b0f1e7872c9a2c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.570243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa91661-b247-4e3d-8b86-7a75a05ff295 admin admin] RBAC: Authorizing `identity:get_user(user_id=e41a610bfe5c492388b0f1e7872c9a2c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.572141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa91661-b247-4e3d-8b86-7a75a05ff295 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.573950 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 58/115] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/users/e41a610bfe5c492388b0f1e7872c9a2c => generated 247 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:49.580223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.594851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e469-9090-43f5-b7c1-e9ce471c1682 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.606036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af661615-07ed-4617-85f0-48b2b414082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.609995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af661615-07ed-4617-85f0-48b2b414082e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.609995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af661615-07ed-4617-85f0-48b2b414082e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.609995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af661615-07ed-4617-85f0-48b2b414082e admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.611303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af661615-07ed-4617-85f0-48b2b414082e admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.614311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af661615-07ed-4617-85f0-48b2b414082e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.616609 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 58/116] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:49.622613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91661-b247-4e3d-8b86-7a75a05ff295 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.643316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91661-b247-4e3d-8b86-7a75a05ff295 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.648205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2328f-719c-4bac-93e7-30db33e65607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.649243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2328f-719c-4bac-93e7-30db33e65607 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.649633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2328f-719c-4bac-93e7-30db33e65607 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.650026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2328f-719c-4bac-93e7-30db33e65607 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/users/e41a610bfe5c492388b0f1e7872c9a2c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.652109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2328f-719c-4bac-93e7-30db33e65607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a486af8aa3c4f399c582c62fa59d1b2, user_id=e41a610bfe5c492388b0f1e7872c9a2c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.654917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2328f-719c-4bac-93e7-30db33e65607 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.690514 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 59/117] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:34:49 2022] PUT /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/users/e41a610bfe5c492388b0f1e7872c9a2c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:34:49.768702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2a285-cd5c-4cd0-9fc1-faa2f754e93d None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.769636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2a285-cd5c-4cd0-9fc1-faa2f754e93d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.770066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2a285-cd5c-4cd0-9fc1-faa2f754e93d None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.772221 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 59/118] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:49.778262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be66f-ba4e-4183-a0b1-2bc36c2d7d29 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.778722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be66f-ba4e-4183-a0b1-2bc36c2d7d29 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.779098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be66f-ba4e-4183-a0b1-2bc36c2d7d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.803224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3f9be66f-ba4e-4183-a0b1-2bc36c2d7d29 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:49.804651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3f9be66f-ba4e-4183-a0b1-2bc36c2d7d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:49.885304 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 60/119] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:49.930557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2a285-cd5c-4cd0-9fc1-faa2f754e93d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.950394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2a285-cd5c-4cd0-9fc1-faa2f754e93d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.958142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406e86-6433-4f02-b1ec-1c8e3004e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.959271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406e86-6433-4f02-b1ec-1c8e3004e745 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.959867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406e86-6433-4f02-b1ec-1c8e3004e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.960351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406e86-6433-4f02-b1ec-1c8e3004e745 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.962551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406e86-6433-4f02-b1ec-1c8e3004e745 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.964549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406e86-6433-4f02-b1ec-1c8e3004e745 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:49.966454 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 60/120] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:49.972849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9be66f-ba4e-4183-a0b1-2bc36c2d7d29 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:49.982526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9be66f-ba4e-4183-a0b1-2bc36c2d7d29 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:49.987347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdac32f-09d7-45b3-8329-4f112ae7e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:49.988133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdac32f-09d7-45b3-8329-4f112ae7e867 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:49.988564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdac32f-09d7-45b3-8329-4f112ae7e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:49.988944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdac32f-09d7-45b3-8329-4f112ae7e867 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:49.989760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdac32f-09d7-45b3-8329-4f112ae7e867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:49.992359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdac32f-09d7-45b3-8329-4f112ae7e867 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.025629 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 61/121] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:34:49 2022] POST /identity/v3/projects => generated 302 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:34:50.185288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48429d13-4d03-4f1c-96c0-de6150831c2d None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.185823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48429d13-4d03-4f1c-96c0-de6150831c2d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.186298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48429d13-4d03-4f1c-96c0-de6150831c2d None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.188224 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 61/122] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:50.194622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a68cc-05f3-427d-b435-71d03a09a8ea None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.195204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a68cc-05f3-427d-b435-71d03a09a8ea None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.195587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a68cc-05f3-427d-b435-71d03a09a8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.221428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8f5a68cc-05f3-427d-b435-71d03a09a8ea None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:50.222659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8f5a68cc-05f3-427d-b435-71d03a09a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:50.293299 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 62/123] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:50.329984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48429d13-4d03-4f1c-96c0-de6150831c2d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.346044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48429d13-4d03-4f1c-96c0-de6150831c2d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.350800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b936af-5c04-47a6-9023-f399c3fd0b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.351902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b936af-5c04-47a6-9023-f399c3fd0b2a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.352409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b936af-5c04-47a6-9023-f399c3fd0b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.352914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b936af-5c04-47a6-9023-f399c3fd0b2a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.373337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b936af-5c04-47a6-9023-f399c3fd0b2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:50.382999 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-f4b936af-5c04-47a6-9023-f399c3fd0b2a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:34:50.384668 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 62/124] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:50.390625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a68cc-05f3-427d-b435-71d03a09a8ea None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.410519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a68cc-05f3-427d-b435-71d03a09a8ea None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.415877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.416573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.416855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.417133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.417888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:50.418192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.419811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.436125 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 63/125] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:50.442438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b936af-5c04-47a6-9023-f399c3fd0b2a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.459901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b936af-5c04-47a6-9023-f399c3fd0b2a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.465621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4389acf-e6d0-4430-87b4-616920ce1e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.467217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4389acf-e6d0-4430-87b4-616920ce1e01 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.467891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4389acf-e6d0-4430-87b4-616920ce1e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.468586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4389acf-e6d0-4430-87b4-616920ce1e01 admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.471333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4389acf-e6d0-4430-87b4-616920ce1e01 admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.478719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4389acf-e6d0-4430-87b4-616920ce1e01 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.481571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 63/126] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:50.488239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.506171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d311a-f482-4a42-980c-8e9ef1b080d4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.515950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff3fd9-f17b-4187-b96c-25efd10c9cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.517356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3fd9-f17b-4187-b96c-25efd10c9cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.517638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3fd9-f17b-4187-b96c-25efd10c9cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.517915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3fd9-f17b-4187-b96c-25efd10c9cc6 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.525055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff3fd9-f17b-4187-b96c-25efd10c9cc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.527128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff3fd9-f17b-4187-b96c-25efd10c9cc6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.528858 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 64/127] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:50.535836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4389acf-e6d0-4430-87b4-616920ce1e01 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.546166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7543-34e9-4301-8cdd-cec9c29f9491 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.546407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7543-34e9-4301-8cdd-cec9c29f9491 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.546678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7543-34e9-4301-8cdd-cec9c29f9491 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.548527 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 65/128] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:34:50.550824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4389acf-e6d0-4430-87b4-616920ce1e01 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.554158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6e45-ddf9-4a95-85ad-67fde1f31583 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.554467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6e45-ddf9-4a95-85ad-67fde1f31583 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.554821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6e45-ddf9-4a95-85ad-67fde1f31583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.559675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74de48-bd3e-446b-bee5-06111cae6f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.559675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74de48-bd3e-446b-bee5-06111cae6f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.559675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74de48-bd3e-446b-bee5-06111cae6f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.559675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74de48-bd3e-446b-bee5-06111cae6f0f admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/users/448ba5fdb5894afc8dd742016d40b4f5/roles/f163b9739a604fe9934c537c47ceeae5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.567395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74de48-bd3e-446b-bee5-06111cae6f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a486af8aa3c4f399c582c62fa59d1b2, user_id=448ba5fdb5894afc8dd742016d40b4f5, role_id=f163b9739a604fe9934c537c47ceeae5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.570119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74de48-bd3e-446b-bee5-06111cae6f0f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.583566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-96ad6e45-ddf9-4a95-85ad-67fde1f31583 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:50.584869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-96ad6e45-ddf9-4a95-85ad-67fde1f31583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:50.596127 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 66/129] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:50.602809 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 64/130] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:34:50 2022] PUT /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/users/448ba5fdb5894afc8dd742016d40b4f5/roles/f163b9739a604fe9934c537c47ceeae5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:34:50.621944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6e45-ddf9-4a95-85ad-67fde1f31583 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.631756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6e45-ddf9-4a95-85ad-67fde1f31583 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.691232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d827af-2d0e-4ada-9b39-1546f75072ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.692020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d827af-2d0e-4ada-9b39-1546f75072ca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.692301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d827af-2d0e-4ada-9b39-1546f75072ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.692607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d827af-2d0e-4ada-9b39-1546f75072ca admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.710555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d827af-2d0e-4ada-9b39-1546f75072ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:50.718704 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-26d827af-2d0e-4ada-9b39-1546f75072ca admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:34:50.720199 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 67/131] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:50.728705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74de48-bd3e-446b-bee5-06111cae6f0f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.745507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74de48-bd3e-446b-bee5-06111cae6f0f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.755981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.757022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.757481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.757867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.758554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:50.758857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.760535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.770140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 65/132] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:50.775964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d827af-2d0e-4ada-9b39-1546f75072ca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.787047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d827af-2d0e-4ada-9b39-1546f75072ca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.797390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422f9c-902a-4b18-9910-515b303c842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.798896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422f9c-902a-4b18-9910-515b303c842c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.799176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422f9c-902a-4b18-9910-515b303c842c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.799452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422f9c-902a-4b18-9910-515b303c842c admin admin] PATH_INFO: `/v3/users/ea9bc80865604d87b59f2f7df3a09ea8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.825184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30422f9c-902a-4b18-9910-515b303c842c admin admin] RBAC: Authorizing `identity:get_user(user_id=ea9bc80865604d87b59f2f7df3a09ea8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.827422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30422f9c-902a-4b18-9910-515b303c842c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.829311 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 68/133] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/users/ea9bc80865604d87b59f2f7df3a09ea8 => generated 289 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:50.835087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.850467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946da5-0549-4d4c-918e-c6ec3318ea5c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.864042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac216d7a-6b08-43c8-a9b5-2bb5bc406036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.864745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac216d7a-6b08-43c8-a9b5-2bb5bc406036 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.865028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac216d7a-6b08-43c8-a9b5-2bb5bc406036 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.865303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac216d7a-6b08-43c8-a9b5-2bb5bc406036 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.880571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac216d7a-6b08-43c8-a9b5-2bb5bc406036 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.882344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac216d7a-6b08-43c8-a9b5-2bb5bc406036 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.891693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 66/134] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:50.897375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422f9c-902a-4b18-9910-515b303c842c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.909191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422f9c-902a-4b18-9910-515b303c842c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.917490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f80d3-a442-44a5-b826-b700360317df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.918405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f80d3-a442-44a5-b826-b700360317df admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.918740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f80d3-a442-44a5-b826-b700360317df admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.919040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f80d3-a442-44a5-b826-b700360317df admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.925102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f80d3-a442-44a5-b826-b700360317df admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.927420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f80d3-a442-44a5-b826-b700360317df admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.929247 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 69/135] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:50.936795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac216d7a-6b08-43c8-a9b5-2bb5bc406036 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:50.945993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac216d7a-6b08-43c8-a9b5-2bb5bc406036 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:50.956233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63743c41-0844-47ff-9d61-f19e3069b938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:50.956926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743c41-0844-47ff-9d61-f19e3069b938 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:50.957209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743c41-0844-47ff-9d61-f19e3069b938 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:50.957488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743c41-0844-47ff-9d61-f19e3069b938 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:50.958321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63743c41-0844-47ff-9d61-f19e3069b938 admin admin] RBAC: Adding query filter params (role.id=181868f756544d47a2b84e5e3ad3ae43, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2, user.id=ea9bc80865604d87b59f2f7df3a09ea8) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:50.958633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63743c41-0844-47ff-9d61-f19e3069b938 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:50.960530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63743c41-0844-47ff-9d61-f19e3069b938 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:50.966605 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 67/136] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:50 2022] GET /identity/v3/role_assignments?user.id=ea9bc80865604d87b59f2f7df3a09ea8&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=181868f756544d47a2b84e5e3ad3ae43 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:53.094352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888711-6944-4a9a-b77e-84095b07d49c None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.095630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888711-6944-4a9a-b77e-84095b07d49c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.095630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888711-6944-4a9a-b77e-84095b07d49c None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.097252 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 70/137] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:53.110042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fd4e0-6551-481a-9396-d85a019e7b63 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.111263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fd4e0-6551-481a-9396-d85a019e7b63 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.111432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fd4e0-6551-481a-9396-d85a019e7b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.149374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-010fd4e0-6551-481a-9396-d85a019e7b63 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:53.150599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-010fd4e0-6551-481a-9396-d85a019e7b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:53.161787 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 68/138] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:53.202624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888711-6944-4a9a-b77e-84095b07d49c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.221341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888711-6944-4a9a-b77e-84095b07d49c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.228357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fba9a8-1134-42d7-878f-110b6f1901fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.229197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba9a8-1134-42d7-878f-110b6f1901fd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.229443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba9a8-1134-42d7-878f-110b6f1901fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.229724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba9a8-1134-42d7-878f-110b6f1901fd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.245544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fba9a8-1134-42d7-878f-110b6f1901fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:53.252929 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-42fba9a8-1134-42d7-878f-110b6f1901fd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:34:53.260752 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 71/139] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:53.267429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fd4e0-6551-481a-9396-d85a019e7b63 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.281031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fd4e0-6551-481a-9396-d85a019e7b63 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.289435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10011-b266-47b1-b5e7-79562512477f None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.289762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10011-b266-47b1-b5e7-79562512477f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.290006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10011-b266-47b1-b5e7-79562512477f None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.292155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 72/140] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:53.293156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.293858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.294145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.294425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.295196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:53.295504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.297174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.307910 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 69/141] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:53.313130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.313473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353ea1-4ae5-4628-bbaf-ffec26ee354a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.313635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353ea1-4ae5-4628-bbaf-ffec26ee354a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.313884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353ea1-4ae5-4628-bbaf-ffec26ee354a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.323448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732340d-4342-4b53-9768-3973cba66c21 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.332219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade1e2-728c-473b-b6ad-06541995ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.333128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade1e2-728c-473b-b6ad-06541995ffd0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.333405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade1e2-728c-473b-b6ad-06541995ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.333682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade1e2-728c-473b-b6ad-06541995ffd0 admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.341335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade1e2-728c-473b-b6ad-06541995ffd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.343553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade1e2-728c-473b-b6ad-06541995ffd0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.346018 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 70/142] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:53.348956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-10353ea1-4ae5-4628-bbaf-ffec26ee354a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:53.350173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-10353ea1-4ae5-4628-bbaf-ffec26ee354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:53.351656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade1e2-728c-473b-b6ad-06541995ffd0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.367139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade1e2-728c-473b-b6ad-06541995ffd0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.372361 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 73/143] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:53.381061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfd64c-0a75-46bb-90d7-2be1f1b70ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.381781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfd64c-0a75-46bb-90d7-2be1f1b70ebd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.382019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfd64c-0a75-46bb-90d7-2be1f1b70ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.382304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfd64c-0a75-46bb-90d7-2be1f1b70ebd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.390888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfd64c-0a75-46bb-90d7-2be1f1b70ebd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.393201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfd64c-0a75-46bb-90d7-2be1f1b70ebd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.411016 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 71/144] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 20:34:53.416975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353ea1-4ae5-4628-bbaf-ffec26ee354a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.417219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfd64c-0a75-46bb-90d7-2be1f1b70ebd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.426722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfd64c-0a75-46bb-90d7-2be1f1b70ebd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.432717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353ea1-4ae5-4628-bbaf-ffec26ee354a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.439614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51be2-1d02-4c43-b452-017561904897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.440462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51be2-1d02-4c43-b452-017561904897 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.440749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51be2-1d02-4c43-b452-017561904897 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.441022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51be2-1d02-4c43-b452-017561904897 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.448083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ef039-ac26-45a2-9207-6f7be5e77611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.448997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ef039-ac26-45a2-9207-6f7be5e77611 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.449278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ef039-ac26-45a2-9207-6f7be5e77611 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.449556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ef039-ac26-45a2-9207-6f7be5e77611 admin admin] PATH_INFO: `/v3/projects/21b7dd2a6cf244178e3d3131effcb7ce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.453184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ef039-ac26-45a2-9207-6f7be5e77611 admin admin] RBAC: Authorizing `identity:get_project(project_id=21b7dd2a6cf244178e3d3131effcb7ce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.455858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ef039-ac26-45a2-9207-6f7be5e77611 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.457673 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 74/145] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/projects/21b7dd2a6cf244178e3d3131effcb7ce => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:53.457988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb51be2-1d02-4c43-b452-017561904897 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:53.464905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ef039-ac26-45a2-9207-6f7be5e77611 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.470538 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-6fb51be2-1d02-4c43-b452-017561904897 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:34:53.472023 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 72/146] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:53.477437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51be2-1d02-4c43-b452-017561904897 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.478743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ef039-ac26-45a2-9207-6f7be5e77611 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.492624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.493290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.493576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.493858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.494648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51be2-1d02-4c43-b452-017561904897 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.494832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] RBAC: Adding query filter params (role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=21b7dd2a6cf244178e3d3131effcb7ce, user.id=448ba5fdb5894afc8dd742016d40b4f5) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:53.494992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.496015 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:53.496015 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:34:53.496015 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:34:53.497201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.508405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.509075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.509362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.509645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.510395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:53.510708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.512449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.513188 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 75/147] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/role_assignments?user.id=448ba5fdb5894afc8dd742016d40b4f5&scope.project.id=21b7dd2a6cf244178e3d3131effcb7ce&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:53.526178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 73/148] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:53.531768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.546739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4bbfd-0782-4cca-ba15-539bea9a152f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.551717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7beb00-7a6c-4c43-aaf2-f3fea3959e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.552765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7beb00-7a6c-4c43-aaf2-f3fea3959e76 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.553054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7beb00-7a6c-4c43-aaf2-f3fea3959e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.553334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7beb00-7a6c-4c43-aaf2-f3fea3959e76 admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.554775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7beb00-7a6c-4c43-aaf2-f3fea3959e76 admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.557225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7beb00-7a6c-4c43-aaf2-f3fea3959e76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.558987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 76/149] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:53.564976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.575099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e9165-57a8-4e9c-80bb-6eaf48f6a301 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.580535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e6ab-a8ed-4350-88b8-0be706ef17c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.581270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e6ab-a8ed-4350-88b8-0be706ef17c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.581609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e6ab-a8ed-4350-88b8-0be706ef17c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.581895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e6ab-a8ed-4350-88b8-0be706ef17c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.591179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e6ab-a8ed-4350-88b8-0be706ef17c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.593116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e6ab-a8ed-4350-88b8-0be706ef17c5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.603815 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 74/150] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:53.609497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7beb00-7a6c-4c43-aaf2-f3fea3959e76 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.620184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7beb00-7a6c-4c43-aaf2-f3fea3959e76 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.629653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0913d-6131-4be7-90c4-5830b6775daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.630589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0913d-6131-4be7-90c4-5830b6775daa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.630876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0913d-6131-4be7-90c4-5830b6775daa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.631160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0913d-6131-4be7-90c4-5830b6775daa admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.633271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0913d-6131-4be7-90c4-5830b6775daa admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.635488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0913d-6131-4be7-90c4-5830b6775daa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.637463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 77/151] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:53.645606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e6ab-a8ed-4350-88b8-0be706ef17c5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.658096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e6ab-a8ed-4350-88b8-0be706ef17c5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.663735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd866d-7508-45e3-9699-36e9e2ce61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.664763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd866d-7508-45e3-9699-36e9e2ce61d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.665142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd866d-7508-45e3-9699-36e9e2ce61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.665421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd866d-7508-45e3-9699-36e9e2ce61d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.666279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd866d-7508-45e3-9699-36e9e2ce61d5 admin admin] RBAC: Adding query filter params (role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2, user.id=448ba5fdb5894afc8dd742016d40b4f5) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:53.666651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd866d-7508-45e3-9699-36e9e2ce61d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.668903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd866d-7508-45e3-9699-36e9e2ce61d5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.679304 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 75/152] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/role_assignments?user.id=448ba5fdb5894afc8dd742016d40b4f5&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:53.730915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b06526-f61b-4ef4-a3ac-e9b66bde7624 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.731241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b06526-f61b-4ef4-a3ac-e9b66bde7624 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.731481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b06526-f61b-4ef4-a3ac-e9b66bde7624 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.733679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 78/153] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:53.739735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204602e-907f-4e21-91b4-daa649ea8a78 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.740052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204602e-907f-4e21-91b4-daa649ea8a78 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.740291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204602e-907f-4e21-91b4-daa649ea8a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.766195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4204602e-907f-4e21-91b4-daa649ea8a78 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:53.768087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4204602e-907f-4e21-91b4-daa649ea8a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:53.776766 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 76/154] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:53.814767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b06526-f61b-4ef4-a3ac-e9b66bde7624 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.828293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b06526-f61b-4ef4-a3ac-e9b66bde7624 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.833794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91448180-529c-4ca3-8cae-76936862f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.834632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91448180-529c-4ca3-8cae-76936862f64a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.834965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91448180-529c-4ca3-8cae-76936862f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.835261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91448180-529c-4ca3-8cae-76936862f64a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.849066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91448180-529c-4ca3-8cae-76936862f64a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:53.856392 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-91448180-529c-4ca3-8cae-76936862f64a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:34:53.857641 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 79/155] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:53.869534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204602e-907f-4e21-91b4-daa649ea8a78 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.879973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204602e-907f-4e21-91b4-daa649ea8a78 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.881911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e3c6-e28e-476b-9a33-589558d41de6 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.882196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e3c6-e28e-476b-9a33-589558d41de6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.882474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e3c6-e28e-476b-9a33-589558d41de6 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.884806 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 80/156] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:53.889854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.890433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7756-b413-44e3-a34d-321d07909687 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.890613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.890773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7756-b413-44e3-a34d-321d07909687 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.890916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.891054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7756-b413-44e3-a34d-321d07909687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.891203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.892547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:53.892850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.894450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.910166 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 77/157] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:53.916713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.928942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a77d7756-b413-44e3-a34d-321d07909687 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:53.930838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a77d7756-b413-44e3-a34d-321d07909687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:53.936071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519e3df-9148-422a-b69f-b743bb2c99d9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.939897 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 81/158] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:53.950919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934aa5de-38e3-4af0-a9ec-69945fa5b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.951813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aa5de-38e3-4af0-a9ec-69945fa5b875 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.952094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aa5de-38e3-4af0-a9ec-69945fa5b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.952395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aa5de-38e3-4af0-a9ec-69945fa5b875 admin admin] PATH_INFO: `/v3/users/e41a610bfe5c492388b0f1e7872c9a2c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.957131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934aa5de-38e3-4af0-a9ec-69945fa5b875 admin admin] RBAC: Authorizing `identity:get_user(user_id=e41a610bfe5c492388b0f1e7872c9a2c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.958974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934aa5de-38e3-4af0-a9ec-69945fa5b875 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.960700 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 78/159] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/users/e41a610bfe5c492388b0f1e7872c9a2c => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:53.966658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7756-b413-44e3-a34d-321d07909687 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.973839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934aa5de-38e3-4af0-a9ec-69945fa5b875 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:53.977909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7756-b413-44e3-a34d-321d07909687 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.983005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f07cc-66d8-4fa8-a871-d5ac8d7b0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.983657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f07cc-66d8-4fa8-a871-d5ac8d7b0283 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.983932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f07cc-66d8-4fa8-a871-d5ac8d7b0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.984205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f07cc-66d8-4fa8-a871-d5ac8d7b0283 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.988211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934aa5de-38e3-4af0-a9ec-69945fa5b875 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:53.993821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f07cc-66d8-4fa8-a871-d5ac8d7b0283 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.994403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad03d8-2c9e-4a1a-9b5c-b0ac6fa03199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:53.995253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad03d8-2c9e-4a1a-9b5c-b0ac6fa03199 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:53.995516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f07cc-66d8-4fa8-a871-d5ac8d7b0283 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:53.995687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad03d8-2c9e-4a1a-9b5c-b0ac6fa03199 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:53.995842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad03d8-2c9e-4a1a-9b5c-b0ac6fa03199 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:53.997062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad03d8-2c9e-4a1a-9b5c-b0ac6fa03199 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:53.998860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad03d8-2c9e-4a1a-9b5c-b0ac6fa03199 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.002520 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 79/160] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:54.008553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad03d8-2c9e-4a1a-9b5c-b0ac6fa03199 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.010578 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 82/161] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:54.016707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f07cc-66d8-4fa8-a871-d5ac8d7b0283 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.019825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad03d8-2c9e-4a1a-9b5c-b0ac6fa03199 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.026983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0bcf0-d0f5-4f12-8aeb-d716a5d3feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.027616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f07cc-66d8-4fa8-a871-d5ac8d7b0283 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.027832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0bcf0-d0f5-4f12-8aeb-d716a5d3feb0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.028022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0bcf0-d0f5-4f12-8aeb-d716a5d3feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.028308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0bcf0-d0f5-4f12-8aeb-d716a5d3feb0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.029128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0bcf0-d0f5-4f12-8aeb-d716a5d3feb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.031187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0bcf0-d0f5-4f12-8aeb-d716a5d3feb0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.032650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387ba74-064b-4ffc-9484-efc8069f0395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.033489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387ba74-064b-4ffc-9484-efc8069f0395 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.033767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387ba74-064b-4ffc-9484-efc8069f0395 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.034037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387ba74-064b-4ffc-9484-efc8069f0395 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.035219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387ba74-064b-4ffc-9484-efc8069f0395 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.038048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387ba74-064b-4ffc-9484-efc8069f0395 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.040667 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 83/162] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:54.050180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387ba74-064b-4ffc-9484-efc8069f0395 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.061919 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 80/163] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:34:54 2022] POST /identity/v3/users => generated 283 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:34:54.062605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387ba74-064b-4ffc-9484-efc8069f0395 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.067654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25597145-9dd8-4c66-b570-fea8eca6ad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.068477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597145-9dd8-4c66-b570-fea8eca6ad57 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.068761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597145-9dd8-4c66-b570-fea8eca6ad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.069037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597145-9dd8-4c66-b570-fea8eca6ad57 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.069910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25597145-9dd8-4c66-b570-fea8eca6ad57 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2, user.id=e41a610bfe5c492388b0f1e7872c9a2c) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:54.070273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25597145-9dd8-4c66-b570-fea8eca6ad57 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.072362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25597145-9dd8-4c66-b570-fea8eca6ad57 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.079865 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 84/164] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/role_assignments?user.id=e41a610bfe5c492388b0f1e7872c9a2c&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:54.297023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743816f-15db-4392-a8d7-1e7c7139a7d9 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.297779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743816f-15db-4392-a8d7-1e7c7139a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.297779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743816f-15db-4392-a8d7-1e7c7139a7d9 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.299522 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 81/165] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:54.305321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc236-e50d-4b00-8bf8-401f3afd89d1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.305867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc236-e50d-4b00-8bf8-401f3afd89d1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.305867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc236-e50d-4b00-8bf8-401f3afd89d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.325856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bccbc236-e50d-4b00-8bf8-401f3afd89d1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:54.327012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bccbc236-e50d-4b00-8bf8-401f3afd89d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:54.340079 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 85/166] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:54.365406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743816f-15db-4392-a8d7-1e7c7139a7d9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.379549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743816f-15db-4392-a8d7-1e7c7139a7d9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.384614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3018f21-8e54-4d97-abc3-27415689a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.385417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3018f21-8e54-4d97-abc3-27415689a726 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.385697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3018f21-8e54-4d97-abc3-27415689a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.385969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3018f21-8e54-4d97-abc3-27415689a726 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.400384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3018f21-8e54-4d97-abc3-27415689a726 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:54.408693 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-c3018f21-8e54-4d97-abc3-27415689a726 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:34:54.410103 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 82/167] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:54.416321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbc236-e50d-4b00-8bf8-401f3afd89d1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.426251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbc236-e50d-4b00-8bf8-401f3afd89d1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.433293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.435371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.435898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.436126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.437926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:54.438270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.439913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.451598 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 86/168] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:54.457750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3018f21-8e54-4d97-abc3-27415689a726 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.468415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3018f21-8e54-4d97-abc3-27415689a726 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.473440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7538b3-c269-47e5-869e-80098337039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.474295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7538b3-c269-47e5-869e-80098337039d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.474577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7538b3-c269-47e5-869e-80098337039d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.474849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7538b3-c269-47e5-869e-80098337039d admin admin] PATH_INFO: `/v3/users/448ba5fdb5894afc8dd742016d40b4f5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.476053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7538b3-c269-47e5-869e-80098337039d admin admin] RBAC: Authorizing `identity:get_user(user_id=448ba5fdb5894afc8dd742016d40b4f5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.478228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7538b3-c269-47e5-869e-80098337039d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.480023 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 83/169] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/users/448ba5fdb5894afc8dd742016d40b4f5 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:54.485477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.496310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae2ed-8a74-41ed-81e1-20cec14ba9cf None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.496867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae2ed-8a74-41ed-81e1-20cec14ba9cf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.497124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfcfee-d251-452b-95ef-8b3208952c26 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.497522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae2ed-8a74-41ed-81e1-20cec14ba9cf None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.499695 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 84/170] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:34:54.503252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede966cf-2e7d-47db-bf87-cf48e062f30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.503947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede966cf-2e7d-47db-bf87-cf48e062f30b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.504322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede966cf-2e7d-47db-bf87-cf48e062f30b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.504651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede966cf-2e7d-47db-bf87-cf48e062f30b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.506104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c012914-e6f3-498e-ad3b-962f7044ba76 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.506598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c012914-e6f3-498e-ad3b-962f7044ba76 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.506881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c012914-e6f3-498e-ad3b-962f7044ba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.514054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede966cf-2e7d-47db-bf87-cf48e062f30b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.517292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede966cf-2e7d-47db-bf87-cf48e062f30b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.526424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8c012914-e6f3-498e-ad3b-962f7044ba76 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:54.527613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c012914-e6f3-498e-ad3b-962f7044ba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:54.527719 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 87/171] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:54.533167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede966cf-2e7d-47db-bf87-cf48e062f30b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.535693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 85/172] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:54.542580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede966cf-2e7d-47db-bf87-cf48e062f30b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.546995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af801271-7d3e-4ea1-a0f2-43328d77f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.548014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af801271-7d3e-4ea1-a0f2-43328d77f052 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.548243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af801271-7d3e-4ea1-a0f2-43328d77f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.548547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af801271-7d3e-4ea1-a0f2-43328d77f052 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.549756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af801271-7d3e-4ea1-a0f2-43328d77f052 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.551888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af801271-7d3e-4ea1-a0f2-43328d77f052 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.553756 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 88/173] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:54.561324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c012914-e6f3-498e-ad3b-962f7044ba76 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.568358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af801271-7d3e-4ea1-a0f2-43328d77f052 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.577407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c012914-e6f3-498e-ad3b-962f7044ba76 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.583397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af801271-7d3e-4ea1-a0f2-43328d77f052 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.583940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.584832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.585263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.585635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.586671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] RBAC: Adding query filter params (role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2, user.id=448ba5fdb5894afc8dd742016d40b4f5) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:54.586979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.588943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.589060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9832e5-6b16-4f19-8e8b-e513a331ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.589839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9832e5-6b16-4f19-8e8b-e513a331ab39 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.590175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9832e5-6b16-4f19-8e8b-e513a331ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.590525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9832e5-6b16-4f19-8e8b-e513a331ab39 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.596125 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 86/174] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/role_assignments?user.id=448ba5fdb5894afc8dd742016d40b4f5&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:54.610084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9832e5-6b16-4f19-8e8b-e513a331ab39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:54.617237 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-fc9832e5-6b16-4f19-8e8b-e513a331ab39 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:34:54.618709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 89/175] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:34:54.624753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.635658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f9f9-865b-4925-8804-0b58ff16874c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.642104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.642861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.643125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.643426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.644230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:54.644620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.646338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.656615 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 87/176] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:54.662592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9832e5-6b16-4f19-8e8b-e513a331ab39 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.674412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9832e5-6b16-4f19-8e8b-e513a331ab39 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.681740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f4b73-691e-4c45-abf7-406e9e9ccb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.682687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f4b73-691e-4c45-abf7-406e9e9ccb39 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.682967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f4b73-691e-4c45-abf7-406e9e9ccb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.683241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f4b73-691e-4c45-abf7-406e9e9ccb39 admin admin] PATH_INFO: `/v3/users/ea9bc80865604d87b59f2f7df3a09ea8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.684649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f4b73-691e-4c45-abf7-406e9e9ccb39 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea9bc80865604d87b59f2f7df3a09ea8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.686961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f4b73-691e-4c45-abf7-406e9e9ccb39 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.689383 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 90/177] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/users/ea9bc80865604d87b59f2f7df3a09ea8 => generated 289 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:54.695424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.710883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff782fc3-ada7-44b4-84c3-e4d31328f807 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.716644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc0144-d289-4cf4-9834-54b275c50135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.717810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0144-d289-4cf4-9834-54b275c50135 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.718313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0144-d289-4cf4-9834-54b275c50135 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.718794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0144-d289-4cf4-9834-54b275c50135 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.721021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc0144-d289-4cf4-9834-54b275c50135 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.723464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc0144-d289-4cf4-9834-54b275c50135 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.733888 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 88/178] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:54 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:54.744269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f4b73-691e-4c45-abf7-406e9e9ccb39 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:54.755920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f4b73-691e-4c45-abf7-406e9e9ccb39 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:54.760969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b8252-e2e6-43a0-9b2a-7b4cfa86987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:54.762157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b8252-e2e6-43a0-9b2a-7b4cfa86987c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:54.762704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b8252-e2e6-43a0-9b2a-7b4cfa86987c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:54.763155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b8252-e2e6-43a0-9b2a-7b4cfa86987c admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/users/ea9bc80865604d87b59f2f7df3a09ea8/roles/181868f756544d47a2b84e5e3ad3ae43` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:54.765467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b8252-e2e6-43a0-9b2a-7b4cfa86987c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a486af8aa3c4f399c582c62fa59d1b2, user_id=ea9bc80865604d87b59f2f7df3a09ea8, role_id=181868f756544d47a2b84e5e3ad3ae43)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:54.768411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b8252-e2e6-43a0-9b2a-7b4cfa86987c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:54.788374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 91/179] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:34:54 2022] PUT /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/users/ea9bc80865604d87b59f2f7df3a09ea8/roles/181868f756544d47a2b84e5e3ad3ae43 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:34:56.717881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41115d-b6e0-46af-a249-13ba75d9a1a8 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:56.718374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41115d-b6e0-46af-a249-13ba75d9a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:56.718447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41115d-b6e0-46af-a249-13ba75d9a1a8 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:56.720238 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 89/180] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:56.725656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a2e0-1fc3-4338-8a2e-4505490a6a90 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:56.726095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a2e0-1fc3-4338-8a2e-4505490a6a90 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:56.726237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a2e0-1fc3-4338-8a2e-4505490a6a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:56.748976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7ce3a2e0-1fc3-4338-8a2e-4505490a6a90 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:56.750170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7ce3a2e0-1fc3-4338-8a2e-4505490a6a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:56.808691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 92/181] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:56.833705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41115d-b6e0-46af-a249-13ba75d9a1a8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:56.846601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41115d-b6e0-46af-a249-13ba75d9a1a8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:56.850964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62ceb8-26cd-42ba-97f3-83c19d35bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:56.851739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62ceb8-26cd-42ba-97f3-83c19d35bac5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:56.852021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62ceb8-26cd-42ba-97f3-83c19d35bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:56.852298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62ceb8-26cd-42ba-97f3-83c19d35bac5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:56.863339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62ceb8-26cd-42ba-97f3-83c19d35bac5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:56.870208 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-6b62ceb8-26cd-42ba-97f3-83c19d35bac5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:34:56.871421 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 90/182] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:56.877343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a2e0-1fc3-4338-8a2e-4505490a6a90 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:56.891060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a2e0-1fc3-4338-8a2e-4505490a6a90 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:56.895904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:56.896626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:56.896907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:56.897182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:56.897948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:56.898255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:56.899895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:56.912193 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 93/183] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:56.918214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62ceb8-26cd-42ba-97f3-83c19d35bac5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:56.929443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62ceb8-26cd-42ba-97f3-83c19d35bac5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:56.933996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a43fd-685b-47a5-ba3d-67d9e985e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:56.934853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a43fd-685b-47a5-ba3d-67d9e985e6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:56.935133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a43fd-685b-47a5-ba3d-67d9e985e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:56.935406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a43fd-685b-47a5-ba3d-67d9e985e6a0 admin admin] PATH_INFO: `/v3/users/394bda8716e64d539f33062137f585e0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:56.950679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a43fd-685b-47a5-ba3d-67d9e985e6a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=394bda8716e64d539f33062137f585e0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:56.952788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a43fd-685b-47a5-ba3d-67d9e985e6a0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:56.954553 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 91/184] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:56 2022] GET /identity/v3/users/394bda8716e64d539f33062137f585e0 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:56.960009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:56.970928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bfe70-0ba7-4397-999d-455a9e137032 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:56.975530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fa276-09d2-4757-9d61-d0d663133f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:56.976170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fa276-09d2-4757-9d61-d0d663133f63 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:56.976485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fa276-09d2-4757-9d61-d0d663133f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:56.976762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fa276-09d2-4757-9d61-d0d663133f63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:56.984938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fa276-09d2-4757-9d61-d0d663133f63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:56.987247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fa276-09d2-4757-9d61-d0d663133f63 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:56.996133 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 94/185] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:57.002182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a43fd-685b-47a5-ba3d-67d9e985e6a0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.005748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b463-16b9-45f4-a76e-c9b6c5ea7d8f None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.006034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b463-16b9-45f4-a76e-c9b6c5ea7d8f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.006309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b463-16b9-45f4-a76e-c9b6c5ea7d8f None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.008289 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 95/186] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:57.012080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a43fd-685b-47a5-ba3d-67d9e985e6a0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.014773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509fea8-5fb2-4e42-8c0a-806db3c519b5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.015061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509fea8-5fb2-4e42-8c0a-806db3c519b5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.015344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509fea8-5fb2-4e42-8c0a-806db3c519b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.019123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3afa16-85eb-4bc9-9980-2b03d4baedcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.020204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3afa16-85eb-4bc9-9980-2b03d4baedcc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.020709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3afa16-85eb-4bc9-9980-2b03d4baedcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.021246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3afa16-85eb-4bc9-9980-2b03d4baedcc admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.022740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3afa16-85eb-4bc9-9980-2b03d4baedcc admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.025370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3afa16-85eb-4bc9-9980-2b03d4baedcc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.027316 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 92/187] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:57.034816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3afa16-85eb-4bc9-9980-2b03d4baedcc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.035783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7509fea8-5fb2-4e42-8c0a-806db3c519b5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:57.037137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7509fea8-5fb2-4e42-8c0a-806db3c519b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:57.045642 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 96/188] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:57.046230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3afa16-85eb-4bc9-9980-2b03d4baedcc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.055135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e58f27-79a3-4637-a462-e15b17553e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.056023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e58f27-79a3-4637-a462-e15b17553e8f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.056571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e58f27-79a3-4637-a462-e15b17553e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.057049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e58f27-79a3-4637-a462-e15b17553e8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.058087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e58f27-79a3-4637-a462-e15b17553e8f admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=c8f2f4af38ad45168a360caf81aa0542, user.id=394bda8716e64d539f33062137f585e0) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:57.058615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e58f27-79a3-4637-a462-e15b17553e8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.060761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e58f27-79a3-4637-a462-e15b17553e8f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.067439 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 93/189] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/role_assignments?user.id=394bda8716e64d539f33062137f585e0&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:57.072407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509fea8-5fb2-4e42-8c0a-806db3c519b5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.082668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509fea8-5fb2-4e42-8c0a-806db3c519b5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.087363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a15ad-40bb-459c-989b-0b1684449033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.088199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a15ad-40bb-459c-989b-0b1684449033 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.088515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a15ad-40bb-459c-989b-0b1684449033 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.088790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a15ad-40bb-459c-989b-0b1684449033 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.089225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22a1f-be2c-42d3-b04f-6c5848d89013 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.089884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22a1f-be2c-42d3-b04f-6c5848d89013 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.090382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22a1f-be2c-42d3-b04f-6c5848d89013 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.092798 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 94/190] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:57.098442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39015-6e99-4425-841e-425c9738dcdc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.098995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39015-6e99-4425-841e-425c9738dcdc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.099491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39015-6e99-4425-841e-425c9738dcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.100620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a15ad-40bb-459c-989b-0b1684449033 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:57.108524 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-3b5a15ad-40bb-459c-989b-0b1684449033 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:34:57.109791 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 97/191] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:57.115641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a15ad-40bb-459c-989b-0b1684449033 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.120601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8db39015-6e99-4425-841e-425c9738dcdc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:57.122817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8db39015-6e99-4425-841e-425c9738dcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:57.126832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a15ad-40bb-459c-989b-0b1684449033 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.131952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.132825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.133200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.133588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.133731 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 95/192] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:57.134520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:57.134896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.136601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.148271 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 98/193] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:34:57.153858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db39015-6e99-4425-841e-425c9738dcdc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.159877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.167306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db39015-6e99-4425-841e-425c9738dcdc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.170452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddd9d0-3568-4278-87a5-4aec3e2f697f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.175355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2020af-3185-4bf6-a35f-1bbe601f6c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.176433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec075977-2425-4a66-8ad7-1bde638ee45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.177087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2020af-3185-4bf6-a35f-1bbe601f6c8b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.177191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075977-2425-4a66-8ad7-1bde638ee45c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.177471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075977-2425-4a66-8ad7-1bde638ee45c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.177749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075977-2425-4a66-8ad7-1bde638ee45c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.178053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2020af-3185-4bf6-a35f-1bbe601f6c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.178709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2020af-3185-4bf6-a35f-1bbe601f6c8b admin admin] PATH_INFO: `/v3/users/394bda8716e64d539f33062137f585e0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.178971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec075977-2425-4a66-8ad7-1bde638ee45c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.180574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2020af-3185-4bf6-a35f-1bbe601f6c8b admin admin] RBAC: Authorizing `identity:get_user(user_id=394bda8716e64d539f33062137f585e0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.180783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec075977-2425-4a66-8ad7-1bde638ee45c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.183584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2020af-3185-4bf6-a35f-1bbe601f6c8b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.186043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 96/195] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/users/394bda8716e64d539f33062137f585e0 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:57.191570 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 99/195] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:57.191570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec075977-2425-4a66-8ad7-1bde638ee45c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.192972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2020af-3185-4bf6-a35f-1bbe601f6c8b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.202287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec075977-2425-4a66-8ad7-1bde638ee45c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.207995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.208720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.209003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.209291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.209944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2020af-3185-4bf6-a35f-1bbe601f6c8b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.210050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.211078 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:34:57.211078 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:34:57.211078 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:34:57.212578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.216241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2084e-4c60-4333-a782-c6bfeb548621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.217239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2084e-4c60-4333-a782-c6bfeb548621 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.217748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2084e-4c60-4333-a782-c6bfeb548621 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.218215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2084e-4c60-4333-a782-c6bfeb548621 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.228111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2084e-4c60-4333-a782-c6bfeb548621 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.230486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2084e-4c60-4333-a782-c6bfeb548621 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.243181 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 100/196] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:34:57 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:34:57.243549 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 97/197] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:57.255155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.266632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467d7f-2f96-48c6-b46e-b6b1a819a9af admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.274139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457c31d-0518-4d2f-a5c6-c66a95d05a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.275378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c31d-0518-4d2f-a5c6-c66a95d05a75 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.275836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c31d-0518-4d2f-a5c6-c66a95d05a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.276392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c31d-0518-4d2f-a5c6-c66a95d05a75 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.278033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457c31d-0518-4d2f-a5c6-c66a95d05a75 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.280461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457c31d-0518-4d2f-a5c6-c66a95d05a75 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.282619 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 101/198] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:57.290589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2084e-4c60-4333-a782-c6bfeb548621 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.301477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2084e-4c60-4333-a782-c6bfeb548621 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.306609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99737425-46c7-4b95-b20f-2a1c888949fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.307573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99737425-46c7-4b95-b20f-2a1c888949fd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.308058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99737425-46c7-4b95-b20f-2a1c888949fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.308545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99737425-46c7-4b95-b20f-2a1c888949fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.309596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99737425-46c7-4b95-b20f-2a1c888949fd admin admin] RBAC: Adding query filter params (role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=c8f2f4af38ad45168a360caf81aa0542, user.id=394bda8716e64d539f33062137f585e0) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:57.310091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99737425-46c7-4b95-b20f-2a1c888949fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.312172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99737425-46c7-4b95-b20f-2a1c888949fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.320309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8aea-f0e7-4adf-9e54-61b96b6cf3ef None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.320973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8aea-f0e7-4adf-9e54-61b96b6cf3ef None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.321194 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 98/199] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/role_assignments?user.id=394bda8716e64d539f33062137f585e0&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:57.321705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8aea-f0e7-4adf-9e54-61b96b6cf3ef None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.323830 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 102/200] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:57.330649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d294-12f9-4e8d-9bf7-2d3501c22e4b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.330933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d294-12f9-4e8d-9bf7-2d3501c22e4b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.331213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d294-12f9-4e8d-9bf7-2d3501c22e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.352804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b4b5d294-12f9-4e8d-9bf7-2d3501c22e4b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:57.354230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b4b5d294-12f9-4e8d-9bf7-2d3501c22e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:57.363052 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 99/201] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:57.389970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8aea-f0e7-4adf-9e54-61b96b6cf3ef None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.404269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8aea-f0e7-4adf-9e54-61b96b6cf3ef None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.409784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b112eef-8bc5-4bb7-8fd2-a4f08de38ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.410674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112eef-8bc5-4bb7-8fd2-a4f08de38ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.410954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112eef-8bc5-4bb7-8fd2-a4f08de38ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.411229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112eef-8bc5-4bb7-8fd2-a4f08de38ae6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.425290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b112eef-8bc5-4bb7-8fd2-a4f08de38ae6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:57.432708 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6b112eef-8bc5-4bb7-8fd2-a4f08de38ae6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:34:57.434155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 103/202] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:57.440746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5d294-12f9-4e8d-9bf7-2d3501c22e4b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.450593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5d294-12f9-4e8d-9bf7-2d3501c22e4b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.455536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.456149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.456465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.456765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.457514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:57.457806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.459448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.468813 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 100/203] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:57.474513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b112eef-8bc5-4bb7-8fd2-a4f08de38ae6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.486562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b112eef-8bc5-4bb7-8fd2-a4f08de38ae6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.492067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183b90-0451-4ba2-8dd5-06dc89c2e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.493021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183b90-0451-4ba2-8dd5-06dc89c2e2ca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.493291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183b90-0451-4ba2-8dd5-06dc89c2e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.493567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183b90-0451-4ba2-8dd5-06dc89c2e2ca admin admin] PATH_INFO: `/v3/users/ea9bc80865604d87b59f2f7df3a09ea8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.494816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e183b90-0451-4ba2-8dd5-06dc89c2e2ca admin admin] RBAC: Authorizing `identity:get_user(user_id=ea9bc80865604d87b59f2f7df3a09ea8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.497113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e183b90-0451-4ba2-8dd5-06dc89c2e2ca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.499196 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 104/204] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/users/ea9bc80865604d87b59f2f7df3a09ea8 => generated 289 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:57.505294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.515512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ebe86-cd7f-44d1-9e12-330d4100969d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.520356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2409-329d-4daa-8e20-769642126cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.521108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2409-329d-4daa-8e20-769642126cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.521390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2409-329d-4daa-8e20-769642126cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.521665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2409-329d-4daa-8e20-769642126cd9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.530993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2409-329d-4daa-8e20-769642126cd9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.533439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2409-329d-4daa-8e20-769642126cd9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.543044 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 101/205] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:34:57.549123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183b90-0451-4ba2-8dd5-06dc89c2e2ca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.558951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183b90-0451-4ba2-8dd5-06dc89c2e2ca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.564080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e354-055a-4cb4-8f9a-fcbb15f4e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.565003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e354-055a-4cb4-8f9a-fcbb15f4e90d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.565340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e354-055a-4cb4-8f9a-fcbb15f4e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.565616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e354-055a-4cb4-8f9a-fcbb15f4e90d admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.566904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831e354-055a-4cb4-8f9a-fcbb15f4e90d admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.569021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831e354-055a-4cb4-8f9a-fcbb15f4e90d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.570713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 105/206] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:57.577901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2409-329d-4daa-8e20-769642126cd9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:57.588447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2409-329d-4daa-8e20-769642126cd9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:57.593477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5278b7e-c992-4cbe-b54b-a86f29baf6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:57.594125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278b7e-c992-4cbe-b54b-a86f29baf6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:57.594429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278b7e-c992-4cbe-b54b-a86f29baf6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:57.594710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278b7e-c992-4cbe-b54b-a86f29baf6b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:57.595548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5278b7e-c992-4cbe-b54b-a86f29baf6b6 admin admin] RBAC: Adding query filter params (role.id=181868f756544d47a2b84e5e3ad3ae43, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2, user.id=ea9bc80865604d87b59f2f7df3a09ea8) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:57.595861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5278b7e-c992-4cbe-b54b-a86f29baf6b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:57.597783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5278b7e-c992-4cbe-b54b-a86f29baf6b6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:57.603996 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 102/207] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:34:57 2022] GET /identity/v3/role_assignments?user.id=ea9bc80865604d87b59f2f7df3a09ea8&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=181868f756544d47a2b84e5e3ad3ae43 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:59.552839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073667d-34d5-48b8-9d83-045a798c9f61 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.553556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073667d-34d5-48b8-9d83-045a798c9f61 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.553556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073667d-34d5-48b8-9d83-045a798c9f61 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.555424 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 106/208] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:59.560909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097375ad-7bc0-4f45-b7bb-eab1bfd5a353 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.561389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097375ad-7bc0-4f45-b7bb-eab1bfd5a353 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.561536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097375ad-7bc0-4f45-b7bb-eab1bfd5a353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.580347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-097375ad-7bc0-4f45-b7bb-eab1bfd5a353 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:59.581630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-097375ad-7bc0-4f45-b7bb-eab1bfd5a353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:59.590066 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 103/209] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:34:59.614546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073667d-34d5-48b8-9d83-045a798c9f61 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:59.627537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073667d-34d5-48b8-9d83-045a798c9f61 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:59.632074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78b02d-5935-485b-81e6-86459920522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:59.632905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78b02d-5935-485b-81e6-86459920522a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.633177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78b02d-5935-485b-81e6-86459920522a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.633443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78b02d-5935-485b-81e6-86459920522a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.646056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78b02d-5935-485b-81e6-86459920522a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:59.652872 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6d78b02d-5935-485b-81e6-86459920522a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:34:59.654158 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 107/210] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:34:59.661373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097375ad-7bc0-4f45-b7bb-eab1bfd5a353 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:59.670823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097375ad-7bc0-4f45-b7bb-eab1bfd5a353 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:59.676631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:59.677274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.682124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.682534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.683307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:59.683623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:59.685310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:59.694749 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 104/211] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:59.700002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78b02d-5935-485b-81e6-86459920522a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:59.713876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78b02d-5935-485b-81e6-86459920522a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:59.718802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c4f0-a7fa-487e-9403-e166bdfb2e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:59.720263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c4f0-a7fa-487e-9403-e166bdfb2e62 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.720573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c4f0-a7fa-487e-9403-e166bdfb2e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.720844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c4f0-a7fa-487e-9403-e166bdfb2e62 admin admin] PATH_INFO: `/v3/users/394bda8716e64d539f33062137f585e0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.722194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c4f0-a7fa-487e-9403-e166bdfb2e62 admin admin] RBAC: Authorizing `identity:get_user(user_id=394bda8716e64d539f33062137f585e0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:59.724428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c4f0-a7fa-487e-9403-e166bdfb2e62 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:59.727175 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 108/212] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:34:59 2022] GET /identity/v3/users/394bda8716e64d539f33062137f585e0 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:59.733743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:59.744033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce035-9367-47ec-96fb-8b2a19e36112 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:59.748619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ae5f7-896e-4dec-884b-2444806eab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:59.749483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae5f7-896e-4dec-884b-2444806eab8d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.749759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae5f7-896e-4dec-884b-2444806eab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.750031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae5f7-896e-4dec-884b-2444806eab8d admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.751811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae5f7-896e-4dec-884b-2444806eab8d admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:59.753895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae5f7-896e-4dec-884b-2444806eab8d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:59.756034 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 105/213] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:34:59 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:34:59.761568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c4f0-a7fa-487e-9403-e166bdfb2e62 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:59.784556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c4f0-a7fa-487e-9403-e166bdfb2e62 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:59.792385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d511-7c8d-4739-b86d-6f23607a028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:59.792385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d511-7c8d-4739-b86d-6f23607a028a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.792385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d511-7c8d-4739-b86d-6f23607a028a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.792385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d511-7c8d-4739-b86d-6f23607a028a admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542/users/394bda8716e64d539f33062137f585e0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.797267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15d511-7c8d-4739-b86d-6f23607a028a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f2f4af38ad45168a360caf81aa0542, user_id=394bda8716e64d539f33062137f585e0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:59.797491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a03fa-ee3a-4517-8e02-cb869fb83f93 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.797491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a03fa-ee3a-4517-8e02-cb869fb83f93 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.797491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a03fa-ee3a-4517-8e02-cb869fb83f93 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.797960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15d511-7c8d-4739-b86d-6f23607a028a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:59.798097 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 106/214] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:34:59.803655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2853-4f6b-45ae-866c-7aee93ca5970 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.803847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2853-4f6b-45ae-866c-7aee93ca5970 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.804145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2853-4f6b-45ae-866c-7aee93ca5970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.815032 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 109/215] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:34:59 2022] PUT /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542/users/394bda8716e64d539f33062137f585e0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:34:59.834691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dacd2853-4f6b-45ae-866c-7aee93ca5970 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:59.836304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dacd2853-4f6b-45ae-866c-7aee93ca5970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:59.901264 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 107/216] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:59.905515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bddde-6e06-4615-8ce6-cce7e3f3fe65 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.906035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bddde-6e06-4615-8ce6-cce7e3f3fe65 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.906501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bddde-6e06-4615-8ce6-cce7e3f3fe65 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.908660 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 110/217] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:34:59.916685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177a72-bdde-428b-b867-e9fff4a7f760 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.916685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177a72-bdde-428b-b867-e9fff4a7f760 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.916685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177a72-bdde-428b-b867-e9fff4a7f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.925237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bddde-6e06-4615-8ce6-cce7e3f3fe65 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:59.940543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bddde-6e06-4615-8ce6-cce7e3f3fe65 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:59.941571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2e177a72-bdde-428b-b867-e9fff4a7f760 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:34:59.943415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2e177a72-bdde-428b-b867-e9fff4a7f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:34:59.945104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a26575-b996-4a3b-af7d-a496a1cf3934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:59.945942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a26575-b996-4a3b-af7d-a496a1cf3934 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.946242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a26575-b996-4a3b-af7d-a496a1cf3934 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.946519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a26575-b996-4a3b-af7d-a496a1cf3934 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.954640 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 108/218] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:34:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:34:59.961525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a26575-b996-4a3b-af7d-a496a1cf3934 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:34:59.968895 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-46a26575-b996-4a3b-af7d-a496a1cf3934 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:34:59.970782 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 111/219] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:34:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:34:59.976779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e177a72-bdde-428b-b867-e9fff4a7f760 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:59.980642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a26575-b996-4a3b-af7d-a496a1cf3934 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:34:59.987839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e177a72-bdde-428b-b867-e9fff4a7f760 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:59.992883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:59.993090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a26575-b996-4a3b-af7d-a496a1cf3934 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:34:59.994030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.994557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:34:59.995086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:34:59.996162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:34:59.996703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:34:59.998378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0f67e-82bc-42ba-ab9e-68c90e0c72d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:34:59.999013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:34:59.999372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0f67e-82bc-42ba-ab9e-68c90e0c72d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:34:59.999763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0f67e-82bc-42ba-ab9e-68c90e0c72d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.000134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0f67e-82bc-42ba-ab9e-68c90e0c72d4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.008978 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 109/220] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:00.015422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.018516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0f67e-82bc-42ba-ab9e-68c90e0c72d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:00.025631 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-18a0f67e-82bc-42ba-ab9e-68c90e0c72d4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:00.025826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4f10-4176-47e5-ac4f-2224c173b1ac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.027389 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 112/221] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:34:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:00.030342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3cdac-a646-41e6-8f8f-ad123df4e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.031315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3cdac-a646-41e6-8f8f-ad123df4e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.031697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3cdac-a646-41e6-8f8f-ad123df4e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.033081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3cdac-a646-41e6-8f8f-ad123df4e8a2 admin admin] PATH_INFO: `/v3/users/394bda8716e64d539f33062137f585e0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.033909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3cdac-a646-41e6-8f8f-ad123df4e8a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=394bda8716e64d539f33062137f585e0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.034321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0f67e-82bc-42ba-ab9e-68c90e0c72d4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.036396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3cdac-a646-41e6-8f8f-ad123df4e8a2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.038080 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 110/222] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:00 2022] GET /identity/v3/users/394bda8716e64d539f33062137f585e0 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:00.044613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3cdac-a646-41e6-8f8f-ad123df4e8a2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.050295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0f67e-82bc-42ba-ab9e-68c90e0c72d4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.055227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.055654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3cdac-a646-41e6-8f8f-ad123df4e8a2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.056262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.056809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.057349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.058483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:00.058639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.060635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.061465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59710089-3bc9-44c9-b82a-90d4b7f8da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.062451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710089-3bc9-44c9-b82a-90d4b7f8da32 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.062840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710089-3bc9-44c9-b82a-90d4b7f8da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.063761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710089-3bc9-44c9-b82a-90d4b7f8da32 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.065136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59710089-3bc9-44c9-b82a-90d4b7f8da32 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.067275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59710089-3bc9-44c9-b82a-90d4b7f8da32 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.071425 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 111/223] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:00 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:00.071562 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 113/224] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:00.074827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59710089-3bc9-44c9-b82a-90d4b7f8da32 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.080502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.085742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59710089-3bc9-44c9-b82a-90d4b7f8da32 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.090638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6af27e-4616-447b-8fe6-b9dc552898a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.090785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddec39-ccdc-427d-a0b1-2d9c29b4d365 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.091889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6af27e-4616-447b-8fe6-b9dc552898a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.092414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6af27e-4616-447b-8fe6-b9dc552898a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.092891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6af27e-4616-447b-8fe6-b9dc552898a7 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542/users/394bda8716e64d539f33062137f585e0/roles/f163b9739a604fe9934c537c47ceeae5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.095858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6af27e-4616-447b-8fe6-b9dc552898a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f2f4af38ad45168a360caf81aa0542, user_id=394bda8716e64d539f33062137f585e0, role_id=f163b9739a604fe9934c537c47ceeae5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.096066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15a195-55fe-47ac-8afa-4b182835f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.097073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a195-55fe-47ac-8afa-4b182835f4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.097398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a195-55fe-47ac-8afa-4b182835f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.097674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a195-55fe-47ac-8afa-4b182835f4f2 admin admin] PATH_INFO: `/v3/users/8561ff0a86514197b2a9c049bf9e1f4e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.099603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6af27e-4616-447b-8fe6-b9dc552898a7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.113459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15a195-55fe-47ac-8afa-4b182835f4f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=8561ff0a86514197b2a9c049bf9e1f4e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.116086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15a195-55fe-47ac-8afa-4b182835f4f2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.117893 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 114/225] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:00 2022] GET /identity/v3/users/8561ff0a86514197b2a9c049bf9e1f4e => generated 297 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:00.118389 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 112/226] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:00 2022] PUT /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542/users/394bda8716e64d539f33062137f585e0/roles/f163b9739a604fe9934c537c47ceeae5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:00.120788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09b04-3d23-4e95-a978-f056bde82442 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.121080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09b04-3d23-4e95-a978-f056bde82442 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.121362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09b04-3d23-4e95-a978-f056bde82442 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.123493 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 115/227] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:00.124813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6af27e-4616-447b-8fe6-b9dc552898a7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.128752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a60d1-7a7a-4f47-953d-cb21094b9ac9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.129045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a60d1-7a7a-4f47-953d-cb21094b9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.129321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a60d1-7a7a-4f47-953d-cb21094b9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.151361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6e7a60d1-7a7a-4f47-953d-cb21094b9ac9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:00.152637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6e7a60d1-7a7a-4f47-953d-cb21094b9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:00.200744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6af27e-4616-447b-8fe6-b9dc552898a7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.207183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3dc3-62ae-4d92-a7cc-06469cc6a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.208200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3dc3-62ae-4d92-a7cc-06469cc6a8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.208759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3dc3-62ae-4d92-a7cc-06469cc6a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.209238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3dc3-62ae-4d92-a7cc-06469cc6a8b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.218945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b3dc3-62ae-4d92-a7cc-06469cc6a8b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.221662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b3dc3-62ae-4d92-a7cc-06469cc6a8b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.230011 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 116/228] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:00.232972 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 113/229] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:00.238744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a60d1-7a7a-4f47-953d-cb21094b9ac9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.249333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a60d1-7a7a-4f47-953d-cb21094b9ac9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.255107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63dd83-26d3-49fd-81b7-ba843a4553c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.256447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63dd83-26d3-49fd-81b7-ba843a4553c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.256937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63dd83-26d3-49fd-81b7-ba843a4553c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.257411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63dd83-26d3-49fd-81b7-ba843a4553c8 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.259038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3dc3-62ae-4d92-a7cc-06469cc6a8b1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.261590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63dd83-26d3-49fd-81b7-ba843a4553c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.263764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63dd83-26d3-49fd-81b7-ba843a4553c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.267043 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 117/230] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:00 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:00.270379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3dc3-62ae-4d92-a7cc-06469cc6a8b1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.274096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63dd83-26d3-49fd-81b7-ba843a4553c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.276029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfca53-1be8-418c-a74e-4e5c09966dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.277225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfca53-1be8-418c-a74e-4e5c09966dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.277768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfca53-1be8-418c-a74e-4e5c09966dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.278247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfca53-1be8-418c-a74e-4e5c09966dc7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.279979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfca53-1be8-418c-a74e-4e5c09966dc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.281978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfca53-1be8-418c-a74e-4e5c09966dc7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.284258 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 114/231] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:00.284883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63dd83-26d3-49fd-81b7-ba843a4553c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.289824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfca53-1be8-418c-a74e-4e5c09966dc7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:00.290073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ee908-feb8-4d3f-a495-dd2bc44e4ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.290685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee908-feb8-4d3f-a495-dd2bc44e4ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.290964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee908-feb8-4d3f-a495-dd2bc44e4ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.291293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee908-feb8-4d3f-a495-dd2bc44e4ea8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.292134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ee908-feb8-4d3f-a495-dd2bc44e4ea8 admin admin] RBAC: Adding query filter params (role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=c8f2f4af38ad45168a360caf81aa0542, user.id=8561ff0a86514197b2a9c049bf9e1f4e) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:00.292643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ee908-feb8-4d3f-a495-dd2bc44e4ea8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.294640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ee908-feb8-4d3f-a495-dd2bc44e4ea8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.302644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 118/232] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:00 2022] GET /identity/v3/role_assignments?user.id=8561ff0a86514197b2a9c049bf9e1f4e&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:00.303784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfca53-1be8-418c-a74e-4e5c09966dc7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:00.309591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4f5f0-9f8d-48eb-ad55-d9fdce1bc6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:00.310581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4f5f0-9f8d-48eb-ad55-d9fdce1bc6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:00.310933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4f5f0-9f8d-48eb-ad55-d9fdce1bc6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:00.311284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4f5f0-9f8d-48eb-ad55-d9fdce1bc6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:00.312089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4f5f0-9f8d-48eb-ad55-d9fdce1bc6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:00.314848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4f5f0-9f8d-48eb-ad55-d9fdce1bc6b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:00.340606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 115/233] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:00 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:02.846442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f385-c9f1-400c-af79-49f734725801 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:02.847059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f385-c9f1-400c-af79-49f734725801 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:02.847059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f385-c9f1-400c-af79-49f734725801 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:02.848788 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 119/234] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:02.856846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98b5c-259e-410f-8a57-93b2248dc82f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:02.857314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98b5c-259e-410f-8a57-93b2248dc82f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:02.857394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98b5c-259e-410f-8a57-93b2248dc82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:02.885685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f2d98b5c-259e-410f-8a57-93b2248dc82f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:02.886957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f2d98b5c-259e-410f-8a57-93b2248dc82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:02.895825 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 116/235] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:02.902650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e931-5474-4657-875d-d2977a48040d None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:02.902962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e931-5474-4657-875d-d2977a48040d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:02.903199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e931-5474-4657-875d-d2977a48040d None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:02.905114 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 120/236] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:02.914999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477286a-1bfe-444d-b409-30d223a81ae1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:02.915320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477286a-1bfe-444d-b409-30d223a81ae1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:02.915551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477286a-1bfe-444d-b409-30d223a81ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:02.924954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0e931-5474-4657-875d-d2977a48040d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:02.941935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0e931-5474-4657-875d-d2977a48040d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:02.943825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a477286a-1bfe-444d-b409-30d223a81ae1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:02.945221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a477286a-1bfe-444d-b409-30d223a81ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:02.953235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7779c-e28d-40ea-96b5-8946f06f4312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:02.954082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7779c-e28d-40ea-96b5-8946f06f4312 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:02.954270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7779c-e28d-40ea-96b5-8946f06f4312 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:02.954485 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 117/237] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:02.954581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7779c-e28d-40ea-96b5-8946f06f4312 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:02.980323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477286a-1bfe-444d-b409-30d223a81ae1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:02.983384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7779c-e28d-40ea-96b5-8946f06f4312 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:02.990027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477286a-1bfe-444d-b409-30d223a81ae1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:02.994599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64b842-2e02-44fc-b92d-9469bbb9a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:02.995049 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-06a7779c-e28d-40ea-96b5-8946f06f4312 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:02.995386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b842-2e02-44fc-b92d-9469bbb9a3ca admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:02.995662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b842-2e02-44fc-b92d-9469bbb9a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:02.995935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b842-2e02-44fc-b92d-9469bbb9a3ca admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:02.996584 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 121/238] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:03.004243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7779c-e28d-40ea-96b5-8946f06f4312 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.011078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64b842-2e02-44fc-b92d-9469bbb9a3ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:03.018325 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-9a64b842-2e02-44fc-b92d-9469bbb9a3ca admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:35:03.019680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 118/239] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:03.020719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7779c-e28d-40ea-96b5-8946f06f4312 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.025244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64b842-2e02-44fc-b92d-9469bbb9a3ca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.034396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.035061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.035337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.035609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.035710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64b842-2e02-44fc-b92d-9469bbb9a3ca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.036500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:03.036807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.038392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.040250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.040928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.041206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.041480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.042225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:03.042528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.044092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.053570 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 119/240] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.054820 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 122/241] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:03.063328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.072360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.079478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3221ad2-fc81-46d4-b940-a903aad08ecc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.084441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a35aa-f651-4fe6-b66b-48423dbb3aef admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.090261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0038f9-aa3a-4937-8f0d-683a5af8696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.091173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0038f9-aa3a-4937-8f0d-683a5af8696a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.091450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0038f9-aa3a-4937-8f0d-683a5af8696a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.091722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0038f9-aa3a-4937-8f0d-683a5af8696a admin admin] PATH_INFO: `/v3/users/394bda8716e64d539f33062137f585e0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.093437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0038f9-aa3a-4937-8f0d-683a5af8696a admin admin] RBAC: Authorizing `identity:get_user(user_id=394bda8716e64d539f33062137f585e0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.097817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0038f9-aa3a-4937-8f0d-683a5af8696a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.100060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2161f-f635-41ee-b3ee-0d0a780788e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.100982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2161f-f635-41ee-b3ee-0d0a780788e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.101252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2161f-f635-41ee-b3ee-0d0a780788e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.101517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2161f-f635-41ee-b3ee-0d0a780788e9 admin admin] PATH_INFO: `/v3/users/394bda8716e64d539f33062137f585e0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.102922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2161f-f635-41ee-b3ee-0d0a780788e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=394bda8716e64d539f33062137f585e0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.105490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2161f-f635-41ee-b3ee-0d0a780788e9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.105716 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 120/242] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/users/394bda8716e64d539f33062137f585e0 => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:03.106461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0038f9-aa3a-4937-8f0d-683a5af8696a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.108476 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 123/243] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/users/394bda8716e64d539f33062137f585e0 => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.118877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2161f-f635-41ee-b3ee-0d0a780788e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.128017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0038f9-aa3a-4937-8f0d-683a5af8696a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.133561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2161f-f635-41ee-b3ee-0d0a780788e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.138172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2332f-2e63-4395-9e33-40f1e9397a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.138926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2332f-2e63-4395-9e33-40f1e9397a98 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.139211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2332f-2e63-4395-9e33-40f1e9397a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.139618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2332f-2e63-4395-9e33-40f1e9397a98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.146259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20edba0-6221-44a5-88e7-aca1422a27bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.146899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20edba0-6221-44a5-88e7-aca1422a27bb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.147170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20edba0-6221-44a5-88e7-aca1422a27bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.147441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20edba0-6221-44a5-88e7-aca1422a27bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.161359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2332f-2e63-4395-9e33-40f1e9397a98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.163118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2332f-2e63-4395-9e33-40f1e9397a98 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.173858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20edba0-6221-44a5-88e7-aca1422a27bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.175626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20edba0-6221-44a5-88e7-aca1422a27bb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.185127 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 121/244] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:03.191941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2332f-2e63-4395-9e33-40f1e9397a98 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.197094 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 124/245] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 20:35:03.204785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20edba0-6221-44a5-88e7-aca1422a27bb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.205968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2332f-2e63-4395-9e33-40f1e9397a98 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.210753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37c559-2582-437a-b37a-8764a4e3a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.211602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37c559-2582-437a-b37a-8764a4e3a790 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.211883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37c559-2582-437a-b37a-8764a4e3a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.212156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37c559-2582-437a-b37a-8764a4e3a790 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.213388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37c559-2582-437a-b37a-8764a4e3a790 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.215410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37c559-2582-437a-b37a-8764a4e3a790 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.218842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20edba0-6221-44a5-88e7-aca1422a27bb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.220297 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 122/246] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:03.225005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37c559-2582-437a-b37a-8764a4e3a790 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.235355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37c559-2582-437a-b37a-8764a4e3a790 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.237207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741943-26fc-46fa-b1f8-c416f8a971ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.238010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741943-26fc-46fa-b1f8-c416f8a971ce admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.238295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741943-26fc-46fa-b1f8-c416f8a971ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.238574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741943-26fc-46fa-b1f8-c416f8a971ce admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.239864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08741943-26fc-46fa-b1f8-c416f8a971ce admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.240784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c9ae8-b97a-47c5-a66b-2755710c3b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.241696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9ae8-b97a-47c5-a66b-2755710c3b22 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.241990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08741943-26fc-46fa-b1f8-c416f8a971ce admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.242283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9ae8-b97a-47c5-a66b-2755710c3b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.242695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9ae8-b97a-47c5-a66b-2755710c3b22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.243678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c9ae8-b97a-47c5-a66b-2755710c3b22 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=c8f2f4af38ad45168a360caf81aa0542, user.id=394bda8716e64d539f33062137f585e0) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:03.243804 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 125/247] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.250929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c9ae8-b97a-47c5-a66b-2755710c3b22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.253102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c9ae8-b97a-47c5-a66b-2755710c3b22 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.256595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741943-26fc-46fa-b1f8-c416f8a971ce admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.260170 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 123/248] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/role_assignments?user.id=394bda8716e64d539f33062137f585e0&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.279361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741943-26fc-46fa-b1f8-c416f8a971ce admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.293889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd9520-5406-450a-bb4b-105563d6b959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.294569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd9520-5406-450a-bb4b-105563d6b959 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.294850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd9520-5406-450a-bb4b-105563d6b959 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.295124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd9520-5406-450a-bb4b-105563d6b959 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.295975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd9520-5406-450a-bb4b-105563d6b959 admin admin] RBAC: Adding query filter params (role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=c8f2f4af38ad45168a360caf81aa0542, user.id=394bda8716e64d539f33062137f585e0) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:03.296291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd9520-5406-450a-bb4b-105563d6b959 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.298044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc6e6c-d38b-4d9d-a495-743474b84360 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.298228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd9520-5406-450a-bb4b-105563d6b959 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.298621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc6e6c-d38b-4d9d-a495-743474b84360 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.299054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc6e6c-d38b-4d9d-a495-743474b84360 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.304987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 126/249] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/role_assignments?user.id=394bda8716e64d539f33062137f585e0&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.309758 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 124/250] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:03.311598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e980-3a82-4834-aceb-d707ed378cac None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.312038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e980-3a82-4834-aceb-d707ed378cac None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.312529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e980-3a82-4834-aceb-d707ed378cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.341630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1b19e980-3a82-4834-aceb-d707ed378cac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:03.343152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1b19e980-3a82-4834-aceb-d707ed378cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:03.357922 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 127/251] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:03.399941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc6e6c-d38b-4d9d-a495-743474b84360 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.418946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc6e6c-d38b-4d9d-a495-743474b84360 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.423873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f87dfc-b8a9-4f8a-a526-8e53e045f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.424705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f87dfc-b8a9-4f8a-a526-8e53e045f158 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.425183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f87dfc-b8a9-4f8a-a526-8e53e045f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.425461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f87dfc-b8a9-4f8a-a526-8e53e045f158 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.439613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f87dfc-b8a9-4f8a-a526-8e53e045f158 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:03.447098 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-53f87dfc-b8a9-4f8a-a526-8e53e045f158 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:03.448797 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 125/252] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:03.450680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd97d48-40aa-4a22-832f-22ee3f5a7c32 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.451333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd97d48-40aa-4a22-832f-22ee3f5a7c32 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.451980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd97d48-40aa-4a22-832f-22ee3f5a7c32 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.454948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f87dfc-b8a9-4f8a-a526-8e53e045f158 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.455806 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 128/253] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:03.461969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab63f-a9d7-4ed3-8bf3-81f4adc63eea None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.462387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab63f-a9d7-4ed3-8bf3-81f4adc63eea None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.462797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab63f-a9d7-4ed3-8bf3-81f4adc63eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.467041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f87dfc-b8a9-4f8a-a526-8e53e045f158 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.472473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.473499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.474035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.474496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.475558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:03.476058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.478086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.490248 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 126/254] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.499597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.504468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-452ab63f-a9d7-4ed3-8bf3-81f4adc63eea None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:03.505728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-452ab63f-a9d7-4ed3-8bf3-81f4adc63eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:03.512999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911c4f9-c588-4a50-9d68-1722140ca989 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.517691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00011d60-f067-4021-bfbc-ff0112073d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.518570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00011d60-f067-4021-bfbc-ff0112073d8b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.518919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00011d60-f067-4021-bfbc-ff0112073d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.519199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00011d60-f067-4021-bfbc-ff0112073d8b admin admin] PATH_INFO: `/v3/users/8561ff0a86514197b2a9c049bf9e1f4e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.520475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00011d60-f067-4021-bfbc-ff0112073d8b admin admin] RBAC: Authorizing `identity:get_user(user_id=8561ff0a86514197b2a9c049bf9e1f4e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.520787 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 129/255] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:03.523047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00011d60-f067-4021-bfbc-ff0112073d8b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.528366 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 127/256] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/users/8561ff0a86514197b2a9c049bf9e1f4e => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.531218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab63f-a9d7-4ed3-8bf3-81f4adc63eea None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.541080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab63f-a9d7-4ed3-8bf3-81f4adc63eea None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.545676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb9636-6a37-41e1-9afb-252fa0b98578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.546638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9636-6a37-41e1-9afb-252fa0b98578 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.547012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9636-6a37-41e1-9afb-252fa0b98578 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.547380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9636-6a37-41e1-9afb-252fa0b98578 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.549277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb9636-6a37-41e1-9afb-252fa0b98578 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.551422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb9636-6a37-41e1-9afb-252fa0b98578 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.553257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 130/257] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.555128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00011d60-f067-4021-bfbc-ff0112073d8b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.559146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb9636-6a37-41e1-9afb-252fa0b98578 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.567278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00011d60-f067-4021-bfbc-ff0112073d8b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.569331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb9636-6a37-41e1-9afb-252fa0b98578 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.573197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ffaab-38ff-4aaa-b16c-44c1da82da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.573980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8d34-c655-46eb-b379-3b7c39da4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.574534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ffaab-38ff-4aaa-b16c-44c1da82da8c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.574845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8d34-c655-46eb-b379-3b7c39da4913 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.575120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8d34-c655-46eb-b379-3b7c39da4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.575392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8d34-c655-46eb-b379-3b7c39da4913 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542/users/8561ff0a86514197b2a9c049bf9e1f4e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.575646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ffaab-38ff-4aaa-b16c-44c1da82da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.576187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ffaab-38ff-4aaa-b16c-44c1da82da8c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.577849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a8d34-c655-46eb-b379-3b7c39da4913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f2f4af38ad45168a360caf81aa0542, user_id=8561ff0a86514197b2a9c049bf9e1f4e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.580512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a8d34-c655-46eb-b379-3b7c39da4913 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.591499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ffaab-38ff-4aaa-b16c-44c1da82da8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:03.599070 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 131/258] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:03 2022] PUT /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542/users/8561ff0a86514197b2a9c049bf9e1f4e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:35:03.601430 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d15ffaab-38ff-4aaa-b16c-44c1da82da8c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:35:03.602905 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 128/259] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:03.609095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8d34-c655-46eb-b379-3b7c39da4913 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.681049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8d34-c655-46eb-b379-3b7c39da4913 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.686183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.687238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.687817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.688868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.689939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:03.690781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.692732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.704585 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 132/260] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:03.709498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261801b-b414-440e-8313-e19efc6be024 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.710149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261801b-b414-440e-8313-e19efc6be024 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.710641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261801b-b414-440e-8313-e19efc6be024 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.711296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.712915 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 129/261] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:03.721275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21db93-c5f0-4568-a27a-7a8a7ebfe931 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.721831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21db93-c5f0-4568-a27a-7a8a7ebfe931 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.722229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21db93-c5f0-4568-a27a-7a8a7ebfe931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.724384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ff07-606a-4ce9-9efa-86e8fd9c4592 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.736223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84032761-a4cb-4f36-b289-6b56f0d98c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.737154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032761-a4cb-4f36-b289-6b56f0d98c5e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.737437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032761-a4cb-4f36-b289-6b56f0d98c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.737713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032761-a4cb-4f36-b289-6b56f0d98c5e admin admin] PATH_INFO: `/v3/users/0fa93bb1647f4671977d3962de67c252` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.748673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-db21db93-c5f0-4568-a27a-7a8a7ebfe931 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:03.750550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-db21db93-c5f0-4568-a27a-7a8a7ebfe931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:03.756445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84032761-a4cb-4f36-b289-6b56f0d98c5e admin admin] RBAC: Authorizing `identity:get_user(user_id=0fa93bb1647f4671977d3962de67c252)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.758615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84032761-a4cb-4f36-b289-6b56f0d98c5e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.759428 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 130/262] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:03.760662 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 133/263] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/users/0fa93bb1647f4671977d3962de67c252 => generated 297 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.766053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21db93-c5f0-4568-a27a-7a8a7ebfe931 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.776447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21db93-c5f0-4568-a27a-7a8a7ebfe931 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.780992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eb6ae-6f98-4310-9659-c4972c9c2b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.781655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eb6ae-6f98-4310-9659-c4972c9c2b37 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.782506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eb6ae-6f98-4310-9659-c4972c9c2b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.783041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eb6ae-6f98-4310-9659-c4972c9c2b37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.786280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84032761-a4cb-4f36-b289-6b56f0d98c5e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.791990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eb6ae-6f98-4310-9659-c4972c9c2b37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.793985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eb6ae-6f98-4310-9659-c4972c9c2b37 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.800193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84032761-a4cb-4f36-b289-6b56f0d98c5e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.805408 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 131/264] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 20:35:03.807971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a91f03-34ad-4015-8356-972e4fbc9dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.808793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91f03-34ad-4015-8356-972e4fbc9dbc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.809073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91f03-34ad-4015-8356-972e4fbc9dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.809345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91f03-34ad-4015-8356-972e4fbc9dbc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.810738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a91f03-34ad-4015-8356-972e4fbc9dbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.811259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eb6ae-6f98-4310-9659-c4972c9c2b37 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.812440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a91f03-34ad-4015-8356-972e4fbc9dbc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.814275 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 134/265] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.819409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a91f03-34ad-4015-8356-972e4fbc9dbc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.820513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eb6ae-6f98-4310-9659-c4972c9c2b37 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.825022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519db0c-0428-4d0d-a421-d5ae75c6b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.826400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519db0c-0428-4d0d-a421-d5ae75c6b570 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.826683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519db0c-0428-4d0d-a421-d5ae75c6b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.827221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519db0c-0428-4d0d-a421-d5ae75c6b570 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.828432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519db0c-0428-4d0d-a421-d5ae75c6b570 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.829016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a91f03-34ad-4015-8356-972e4fbc9dbc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.830493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519db0c-0428-4d0d-a421-d5ae75c6b570 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.832298 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 132/266] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:03.833364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6035b-fd32-4f3f-8039-470229b9b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.834014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6035b-fd32-4f3f-8039-470229b9b6da admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.834293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6035b-fd32-4f3f-8039-470229b9b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.834568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6035b-fd32-4f3f-8039-470229b9b6da admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.835267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6035b-fd32-4f3f-8039-470229b9b6da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.837186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6035b-fd32-4f3f-8039-470229b9b6da admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.839210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519db0c-0428-4d0d-a421-d5ae75c6b570 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:03.851501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519db0c-0428-4d0d-a421-d5ae75c6b570 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:03.856428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba60aa7-5ed5-4824-bb23-14ac0665b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:03.857060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba60aa7-5ed5-4824-bb23-14ac0665b245 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:03.857612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba60aa7-5ed5-4824-bb23-14ac0665b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:03.857612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba60aa7-5ed5-4824-bb23-14ac0665b245 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:03.858406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba60aa7-5ed5-4824-bb23-14ac0665b245 admin admin] RBAC: Adding query filter params (role.id=181868f756544d47a2b84e5e3ad3ae43, scope.project.id=c8f2f4af38ad45168a360caf81aa0542, user.id=0fa93bb1647f4671977d3962de67c252) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:03.858714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba60aa7-5ed5-4824-bb23-14ac0665b245 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:03.859273 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 135/267] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:03 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:35:03.861106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba60aa7-5ed5-4824-bb23-14ac0665b245 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:03.867584 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 133/268] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:03 2022] GET /identity/v3/role_assignments?user.id=0fa93bb1647f4671977d3962de67c252&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=181868f756544d47a2b84e5e3ad3ae43 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:06.003636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3665-cc7a-4fd9-9274-8095b3216f69 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.004141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3665-cc7a-4fd9-9274-8095b3216f69 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.004141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3665-cc7a-4fd9-9274-8095b3216f69 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.006073 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 136/269] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:06.011155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb043f-cf5b-49a1-a254-5de57f25f7e7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.011580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb043f-cf5b-49a1-a254-5de57f25f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.011740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb043f-cf5b-49a1-a254-5de57f25f7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.029524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-06fb043f-cf5b-49a1-a254-5de57f25f7e7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:06.030710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-06fb043f-cf5b-49a1-a254-5de57f25f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:06.039892 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 134/270] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:06.065515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd3665-cc7a-4fd9-9274-8095b3216f69 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.078579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd3665-cc7a-4fd9-9274-8095b3216f69 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.083203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5bf4f-874b-41bf-974f-996cccee2b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.084008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5bf4f-874b-41bf-974f-996cccee2b6b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.084287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5bf4f-874b-41bf-974f-996cccee2b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.084609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5bf4f-874b-41bf-974f-996cccee2b6b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.097314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5bf4f-874b-41bf-974f-996cccee2b6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:06.104260 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-71e5bf4f-874b-41bf-974f-996cccee2b6b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:06.105562 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 137/271] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:06.112042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb043f-cf5b-49a1-a254-5de57f25f7e7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.121290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb043f-cf5b-49a1-a254-5de57f25f7e7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.125795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.126455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.126738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.127015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.127762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:06.128065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.129692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.138318 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 135/272] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:06.144398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5bf4f-874b-41bf-974f-996cccee2b6b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.154761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5bf4f-874b-41bf-974f-996cccee2b6b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.159820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ddfbc-4986-403d-9ef1-8fccdadaeb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.160707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ddfbc-4986-403d-9ef1-8fccdadaeb51 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.160982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ddfbc-4986-403d-9ef1-8fccdadaeb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.161255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ddfbc-4986-403d-9ef1-8fccdadaeb51 admin admin] PATH_INFO: `/v3/users/8561ff0a86514197b2a9c049bf9e1f4e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.162453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ddfbc-4986-403d-9ef1-8fccdadaeb51 admin admin] RBAC: Authorizing `identity:get_user(user_id=8561ff0a86514197b2a9c049bf9e1f4e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.164849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ddfbc-4986-403d-9ef1-8fccdadaeb51 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.166873 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 138/273] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/users/8561ff0a86514197b2a9c049bf9e1f4e => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:06.171975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.181942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78168d-206e-4cfb-a1b6-21f91ca12d17 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.186793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a7502-d56e-412b-8ee5-6db92ca6db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.188116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a7502-d56e-412b-8ee5-6db92ca6db13 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.188116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a7502-d56e-412b-8ee5-6db92ca6db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.188116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a7502-d56e-412b-8ee5-6db92ca6db13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.196348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a7502-d56e-412b-8ee5-6db92ca6db13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.198103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a7502-d56e-412b-8ee5-6db92ca6db13 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.208341 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 136/274] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:06.213834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ddfbc-4986-403d-9ef1-8fccdadaeb51 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.224425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ddfbc-4986-403d-9ef1-8fccdadaeb51 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.229013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa326f1-7829-40ab-adaa-0d641af89479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.229860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa326f1-7829-40ab-adaa-0d641af89479 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.230135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa326f1-7829-40ab-adaa-0d641af89479 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.230408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa326f1-7829-40ab-adaa-0d641af89479 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.231582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa326f1-7829-40ab-adaa-0d641af89479 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.233646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa326f1-7829-40ab-adaa-0d641af89479 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.236069 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 139/275] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:06.243211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a7502-d56e-412b-8ee5-6db92ca6db13 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.252965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a7502-d56e-412b-8ee5-6db92ca6db13 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.257480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7255-a41b-4fad-9bcc-73885d07ee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.258122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7255-a41b-4fad-9bcc-73885d07ee30 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.258406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7255-a41b-4fad-9bcc-73885d07ee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.258681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7255-a41b-4fad-9bcc-73885d07ee30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.259509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c7255-a41b-4fad-9bcc-73885d07ee30 admin admin] RBAC: Adding query filter params (role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=c8f2f4af38ad45168a360caf81aa0542, user.id=8561ff0a86514197b2a9c049bf9e1f4e) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:06.259819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c7255-a41b-4fad-9bcc-73885d07ee30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.261676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c7255-a41b-4fad-9bcc-73885d07ee30 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.267781 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 137/276] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/role_assignments?user.id=8561ff0a86514197b2a9c049bf9e1f4e&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:06.282627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a47263-0a17-469f-a6dd-530f480d0046 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.282911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a47263-0a17-469f-a6dd-530f480d0046 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.283192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a47263-0a17-469f-a6dd-530f480d0046 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.285129 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 140/277] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:06.291195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105cf47-b030-4934-8d7c-c3ed701bcc7a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.291773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105cf47-b030-4934-8d7c-c3ed701bcc7a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.292234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105cf47-b030-4934-8d7c-c3ed701bcc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.312128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8105cf47-b030-4934-8d7c-c3ed701bcc7a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:06.314226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8105cf47-b030-4934-8d7c-c3ed701bcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:06.322623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 138/278] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:06.347855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a47263-0a17-469f-a6dd-530f480d0046 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.363004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a47263-0a17-469f-a6dd-530f480d0046 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.367524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97329a1-7364-418a-9afe-c41dc607b748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.368347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97329a1-7364-418a-9afe-c41dc607b748 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.368639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97329a1-7364-418a-9afe-c41dc607b748 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.368914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97329a1-7364-418a-9afe-c41dc607b748 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.381488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97329a1-7364-418a-9afe-c41dc607b748 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:06.388949 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-a97329a1-7364-418a-9afe-c41dc607b748 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:35:06.390208 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 141/279] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:06.396378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105cf47-b030-4934-8d7c-c3ed701bcc7a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.406125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105cf47-b030-4934-8d7c-c3ed701bcc7a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.411257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42a169-8401-4a11-b5b2-ad45690db240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.412277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42a169-8401-4a11-b5b2-ad45690db240 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.412850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42a169-8401-4a11-b5b2-ad45690db240 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.413347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42a169-8401-4a11-b5b2-ad45690db240 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.414305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42a169-8401-4a11-b5b2-ad45690db240 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:06.415066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42a169-8401-4a11-b5b2-ad45690db240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.417009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42a169-8401-4a11-b5b2-ad45690db240 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.427503 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 139/280] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:06.433547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97329a1-7364-418a-9afe-c41dc607b748 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.444958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97329a1-7364-418a-9afe-c41dc607b748 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.449875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4aec-ab7e-4006-b081-6cd15f001341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.450275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9b28-2eb6-4f1e-ba93-5cf3db245c8c None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.450564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9b28-2eb6-4f1e-ba93-5cf3db245c8c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.450753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4aec-ab7e-4006-b081-6cd15f001341 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.450845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9b28-2eb6-4f1e-ba93-5cf3db245c8c None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.451012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4aec-ab7e-4006-b081-6cd15f001341 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.451286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4aec-ab7e-4006-b081-6cd15f001341 admin admin] PATH_INFO: `/v3/users/0fa93bb1647f4671977d3962de67c252` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.452667 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 140/281] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:06.452986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4aec-ab7e-4006-b081-6cd15f001341 admin admin] RBAC: Authorizing `identity:get_user(user_id=0fa93bb1647f4671977d3962de67c252)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.455339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4aec-ab7e-4006-b081-6cd15f001341 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.457452 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 142/282] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/users/0fa93bb1647f4671977d3962de67c252 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:06.458071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8d91-30c2-4c94-846f-48f954221640 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.458351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8d91-30c2-4c94-846f-48f954221640 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.458624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8d91-30c2-4c94-846f-48f954221640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.463581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4aec-ab7e-4006-b081-6cd15f001341 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.478738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4aec-ab7e-4006-b081-6cd15f001341 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.480857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9e9e8d91-30c2-4c94-846f-48f954221640 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:06.482209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e9e8d91-30c2-4c94-846f-48f954221640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:06.484557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b8e1-f43d-4ad8-a410-174d0c964747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.485942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b8e1-f43d-4ad8-a410-174d0c964747 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.486223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b8e1-f43d-4ad8-a410-174d0c964747 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.486493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b8e1-f43d-4ad8-a410-174d0c964747 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.487657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6b8e1-f43d-4ad8-a410-174d0c964747 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.489796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6b8e1-f43d-4ad8-a410-174d0c964747 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.491516 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 141/283] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:06.491813 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 143/284] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:06.492847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89428222-7a09-446f-9bd8-1adda4ac73f2 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.493099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89428222-7a09-446f-9bd8-1adda4ac73f2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.493381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89428222-7a09-446f-9bd8-1adda4ac73f2 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.495217 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 142/285] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:06.499868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b8e1-f43d-4ad8-a410-174d0c964747 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.500113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3f256-3e79-4386-91c3-d290e70531a8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.500420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3f256-3e79-4386-91c3-d290e70531a8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.501256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3f256-3e79-4386-91c3-d290e70531a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.511406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b8e1-f43d-4ad8-a410-174d0c964747 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.515872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf8087-7051-4224-83c6-b2b4509870af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.516979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf8087-7051-4224-83c6-b2b4509870af admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.517257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf8087-7051-4224-83c6-b2b4509870af admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.517532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf8087-7051-4224-83c6-b2b4509870af admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542/users/0fa93bb1647f4671977d3962de67c252/roles/181868f756544d47a2b84e5e3ad3ae43` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.519759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a1b3f256-3e79-4386-91c3-d290e70531a8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:06.520740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf8087-7051-4224-83c6-b2b4509870af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f2f4af38ad45168a360caf81aa0542, user_id=0fa93bb1647f4671977d3962de67c252, role_id=181868f756544d47a2b84e5e3ad3ae43)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.520969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a1b3f256-3e79-4386-91c3-d290e70531a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:06.523401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf8087-7051-4224-83c6-b2b4509870af admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.529500 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 143/286] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:06.530266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3f256-3e79-4386-91c3-d290e70531a8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.540452 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 144/287] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:06 2022] PUT /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542/users/0fa93bb1647f4671977d3962de67c252/roles/181868f756544d47a2b84e5e3ad3ae43 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:35:06.541304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3f256-3e79-4386-91c3-d290e70531a8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.562670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf8087-7051-4224-83c6-b2b4509870af admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.620685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febbc80-1348-4a88-bcab-94afb37a3b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.621831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbc80-1348-4a88-bcab-94afb37a3b5d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.622274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbc80-1348-4a88-bcab-94afb37a3b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.622552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbc80-1348-4a88-bcab-94afb37a3b5d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.624285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febbc80-1348-4a88-bcab-94afb37a3b5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.626402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febbc80-1348-4a88-bcab-94afb37a3b5d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.628294 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 144/288] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:06.633876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febbc80-1348-4a88-bcab-94afb37a3b5d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.638163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf8087-7051-4224-83c6-b2b4509870af admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.643677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f05ff-0c07-4f98-b31b-a36553db14a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.644092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febbc80-1348-4a88-bcab-94afb37a3b5d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.645070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f05ff-0c07-4f98-b31b-a36553db14a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.645527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f05ff-0c07-4f98-b31b-a36553db14a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.645985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f05ff-0c07-4f98-b31b-a36553db14a3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.648508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb524-43f8-4e9b-aec5-a1a82c76cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.649184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb524-43f8-4e9b-aec5-a1a82c76cb59 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.649466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb524-43f8-4e9b-aec5-a1a82c76cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.649745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb524-43f8-4e9b-aec5-a1a82c76cb59 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.650469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edb524-43f8-4e9b-aec5-a1a82c76cb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.652450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edb524-43f8-4e9b-aec5-a1a82c76cb59 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.659851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f05ff-0c07-4f98-b31b-a36553db14a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:06.667818 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-452f05ff-0c07-4f98-b31b-a36553db14a3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:06.669101 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 145/289] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:06.674600 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 145/290] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:06 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:35:06.684604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f05ff-0c07-4f98-b31b-a36553db14a3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.686380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f05ff-0c07-4f98-b31b-a36553db14a3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.691425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.692179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.692626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.692899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.693672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:06.693980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.697651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.709544 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 146/291] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:06.715529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb524-43f8-4e9b-aec5-a1a82c76cb59 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.726789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb524-43f8-4e9b-aec5-a1a82c76cb59 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.739037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba02c57-3f9c-4ea1-aa9a-4bbbeeb3e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.739826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02c57-3f9c-4ea1-aa9a-4bbbeeb3e85b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.740094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02c57-3f9c-4ea1-aa9a-4bbbeeb3e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.741253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02c57-3f9c-4ea1-aa9a-4bbbeeb3e85b admin admin] PATH_INFO: `/v3/users/5ed0c6298caf469998a4c1bba834df8b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.759177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba02c57-3f9c-4ea1-aa9a-4bbbeeb3e85b admin admin] RBAC: Authorizing `identity:get_user(user_id=5ed0c6298caf469998a4c1bba834df8b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.761504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba02c57-3f9c-4ea1-aa9a-4bbbeeb3e85b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.763449 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 146/292] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/users/5ed0c6298caf469998a4c1bba834df8b => generated 293 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:06.769805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:06.779991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab271b32-ba1f-47ed-a493-65378f83eb5f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:06.785243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72e7ac-96ef-4d3f-aee4-f4254e78428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:06.785997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e7ac-96ef-4d3f-aee4-f4254e78428a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:06.786352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e7ac-96ef-4d3f-aee4-f4254e78428a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:06.786702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e7ac-96ef-4d3f-aee4-f4254e78428a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:06.787642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72e7ac-96ef-4d3f-aee4-f4254e78428a admin admin] RBAC: Adding query filter params (role.id=ee0b0a89e5e9450e8a292e5c29635e9c, user.id=5ed0c6298caf469998a4c1bba834df8b, scope.system=all) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:06.788024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72e7ac-96ef-4d3f-aee4-f4254e78428a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:06.790275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72e7ac-96ef-4d3f-aee4-f4254e78428a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:06.804354 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 147/293] 10.222.0.30 () {56 vars in 1329 bytes} [Sat Feb 19 20:35:06 2022] GET /identity/v3/role_assignments?user.id=5ed0c6298caf469998a4c1bba834df8b&scope.system=all&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:08.946165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fad76-9834-4ae3-9875-34f553aab2b3 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:08.946677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fad76-9834-4ae3-9875-34f553aab2b3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:08.946757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fad76-9834-4ae3-9875-34f553aab2b3 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:08.948676 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 147/294] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:08.953880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cfb7c-44cb-411c-8df2-965bcb3e4877 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:08.954297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cfb7c-44cb-411c-8df2-965bcb3e4877 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:08.954373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cfb7c-44cb-411c-8df2-965bcb3e4877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:08.974303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-824cfb7c-44cb-411c-8df2-965bcb3e4877 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:08.975796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-824cfb7c-44cb-411c-8df2-965bcb3e4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:08.983939 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 148/295] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:09.009203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fad76-9834-4ae3-9875-34f553aab2b3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.021739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fad76-9834-4ae3-9875-34f553aab2b3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.026305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49baf-1ef1-4a26-a63e-0ff35bdcab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.027319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49baf-1ef1-4a26-a63e-0ff35bdcab9e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.027820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49baf-1ef1-4a26-a63e-0ff35bdcab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.028296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49baf-1ef1-4a26-a63e-0ff35bdcab9e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.039076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd49baf-1ef1-4a26-a63e-0ff35bdcab9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:09.046339 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-0cd49baf-1ef1-4a26-a63e-0ff35bdcab9e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:35:09.048571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 148/296] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:09.054398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cfb7c-44cb-411c-8df2-965bcb3e4877 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.064032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cfb7c-44cb-411c-8df2-965bcb3e4877 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.068787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.069693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.070174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.070669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.071609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:09.072109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.073931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.083093 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 149/297] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:09.088781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49baf-1ef1-4a26-a63e-0ff35bdcab9e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.099259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49baf-1ef1-4a26-a63e-0ff35bdcab9e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.103926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dfce9-b3aa-4f31-8ef9-3dccf744db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.105055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dfce9-b3aa-4f31-8ef9-3dccf744db0a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.105542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dfce9-b3aa-4f31-8ef9-3dccf744db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.106037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dfce9-b3aa-4f31-8ef9-3dccf744db0a admin admin] PATH_INFO: `/v3/users/0fa93bb1647f4671977d3962de67c252` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.107420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28dfce9-b3aa-4f31-8ef9-3dccf744db0a admin admin] RBAC: Authorizing `identity:get_user(user_id=0fa93bb1647f4671977d3962de67c252)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.109852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28dfce9-b3aa-4f31-8ef9-3dccf744db0a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.112224 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 149/298] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/users/0fa93bb1647f4671977d3962de67c252 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:09.117868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.128046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e27d8-00ee-425c-bc85-8a7114750a82 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.132721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0bf3f-f602-4b3c-b7c0-eaea430c0def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.133583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bf3f-f602-4b3c-b7c0-eaea430c0def admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.134061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bf3f-f602-4b3c-b7c0-eaea430c0def admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.134553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bf3f-f602-4b3c-b7c0-eaea430c0def admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.143661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0bf3f-f602-4b3c-b7c0-eaea430c0def admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.145670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0bf3f-f602-4b3c-b7c0-eaea430c0def admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.155112 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 150/299] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:09.161405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dfce9-b3aa-4f31-8ef9-3dccf744db0a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.172034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dfce9-b3aa-4f31-8ef9-3dccf744db0a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.177373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b33ee3-a552-48ea-b185-205f4b138482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.178573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33ee3-a552-48ea-b185-205f4b138482 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.179068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33ee3-a552-48ea-b185-205f4b138482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.179532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33ee3-a552-48ea-b185-205f4b138482 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.181078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33ee3-a552-48ea-b185-205f4b138482 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.183291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33ee3-a552-48ea-b185-205f4b138482 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.185182 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 150/300] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:09.193109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0bf3f-f602-4b3c-b7c0-eaea430c0def admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.202580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0bf3f-f602-4b3c-b7c0-eaea430c0def admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.207373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b062dda-3b57-4515-9874-aaa89e6e6609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.208218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b062dda-3b57-4515-9874-aaa89e6e6609 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.208700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b062dda-3b57-4515-9874-aaa89e6e6609 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.209151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b062dda-3b57-4515-9874-aaa89e6e6609 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.210146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b062dda-3b57-4515-9874-aaa89e6e6609 admin admin] RBAC: Adding query filter params (role.id=181868f756544d47a2b84e5e3ad3ae43, scope.project.id=c8f2f4af38ad45168a360caf81aa0542, user.id=0fa93bb1647f4671977d3962de67c252) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:09.210731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b062dda-3b57-4515-9874-aaa89e6e6609 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.212762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b062dda-3b57-4515-9874-aaa89e6e6609 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.219469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 151/301] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/role_assignments?user.id=0fa93bb1647f4671977d3962de67c252&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=181868f756544d47a2b84e5e3ad3ae43 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:09.234110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede6c15-910a-47aa-b9fe-46491b037a21 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.234392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede6c15-910a-47aa-b9fe-46491b037a21 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.234668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede6c15-910a-47aa-b9fe-46491b037a21 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.237302 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 151/302] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:09.242893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52711808-238c-4b67-a487-d9a2120bd98d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.243176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52711808-238c-4b67-a487-d9a2120bd98d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.243463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52711808-238c-4b67-a487-d9a2120bd98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.251853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b952d0-969f-4001-a286-a12ff886bbcb None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.252148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b952d0-969f-4001-a286-a12ff886bbcb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.252432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b952d0-969f-4001-a286-a12ff886bbcb None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.256610 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 152/303] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:09.258521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522abf1-a70d-40fc-bccd-cca87576f1a8 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.258521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522abf1-a70d-40fc-bccd-cca87576f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.258521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522abf1-a70d-40fc-bccd-cca87576f1a8 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.260244 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 153/304] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:09.262374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791822-c4bf-4d5d-b3ec-2cb3af839b21 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.262664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791822-c4bf-4d5d-b3ec-2cb3af839b21 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.262940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791822-c4bf-4d5d-b3ec-2cb3af839b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.264192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-52711808-238c-4b67-a487-d9a2120bd98d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:09.265465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-52711808-238c-4b67-a487-d9a2120bd98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:09.273502 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 152/305] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:09.274619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71bc2-c638-4d47-af5a-2ee68347bf3a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.274911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71bc2-c638-4d47-af5a-2ee68347bf3a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.275177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71bc2-c638-4d47-af5a-2ee68347bf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.282449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-81791822-c4bf-4d5d-b3ec-2cb3af839b21 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:09.283665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-81791822-c4bf-4d5d-b3ec-2cb3af839b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:09.296435 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 154/306] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:09.301335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b5f71bc2-c638-4d47-af5a-2ee68347bf3a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:09.302969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81791822-c4bf-4d5d-b3ec-2cb3af839b21 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.305140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b5f71bc2-c638-4d47-af5a-2ee68347bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:09.313966 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 153/307] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:09.320020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81791822-c4bf-4d5d-b3ec-2cb3af839b21 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.320117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f71bc2-c638-4d47-af5a-2ee68347bf3a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.323553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139a49-f322-407b-a4a4-a405bde5684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.324564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139a49-f322-407b-a4a4-a405bde5684e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.324954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139a49-f322-407b-a4a4-a405bde5684e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.325333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139a49-f322-407b-a4a4-a405bde5684e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.327907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f71bc2-c638-4d47-af5a-2ee68347bf3a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.333070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ff8a-4024-4b36-b281-1d4e8cf27088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.334267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ff8a-4024-4b36-b281-1d4e8cf27088 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.334720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ff8a-4024-4b36-b281-1d4e8cf27088 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.335182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ff8a-4024-4b36-b281-1d4e8cf27088 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.336789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30ff8a-4024-4b36-b281-1d4e8cf27088 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.338166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d139a49-f322-407b-a4a4-a405bde5684e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:09.338977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30ff8a-4024-4b36-b281-1d4e8cf27088 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.341012 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 154/308] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:09.346089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ff8a-4024-4b36-b281-1d4e8cf27088 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.346232 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-9d139a49-f322-407b-a4a4-a405bde5684e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:09.347509 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 155/309] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:09.348144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139a49-f322-407b-a4a4-a405bde5684e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.356561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ff8a-4024-4b36-b281-1d4e8cf27088 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.361955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222264b8-e43a-4b1b-b064-45a3a3fdf80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.362753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222264b8-e43a-4b1b-b064-45a3a3fdf80c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.363033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222264b8-e43a-4b1b-b064-45a3a3fdf80c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.363252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139a49-f322-407b-a4a4-a405bde5684e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.363351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222264b8-e43a-4b1b-b064-45a3a3fdf80c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.367726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.368442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.368730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.369015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.369718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.370745 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:09.370745 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:09.370745 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:09.371951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.375144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222264b8-e43a-4b1b-b064-45a3a3fdf80c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:09.382745 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-222264b8-e43a-4b1b-b064-45a3a3fdf80c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:35:09.384162 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 155/310] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:09.389434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222264b8-e43a-4b1b-b064-45a3a3fdf80c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.390861 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 156/311] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 20:35:09 2022] POST /identity/v3/groups => generated 229 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:09.391580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.406098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674245-0322-4f0b-939e-e05d5e1376f0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.406771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222264b8-e43a-4b1b-b064-45a3a3fdf80c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.411140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.412016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.412463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.412832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.413462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.413818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:09.414233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.415022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.415444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.415859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.416553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.417034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:09.418487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.420808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.436679 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 157/312] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:09.436897 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 156/313] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:09.439033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.445566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.457712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5985e-2b4c-4114-9df5-b3cb03c37b79 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.457909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f8f5-1bd7-4cf8-8302-33d1b9890327 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.464159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318befd7-10b0-4d53-bef6-f1d58220b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.464159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318befd7-10b0-4d53-bef6-f1d58220b233 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.464159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318befd7-10b0-4d53-bef6-f1d58220b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.464543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318befd7-10b0-4d53-bef6-f1d58220b233 admin admin] PATH_INFO: `/v3/users/0c477fa54e124fbdbcedc9d21c2edf61` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.467082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9949f26-ecd4-4bc6-a310-c04767a2195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.467983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9949f26-ecd4-4bc6-a310-c04767a2195c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.468256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9949f26-ecd4-4bc6-a310-c04767a2195c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.468579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9949f26-ecd4-4bc6-a310-c04767a2195c admin admin] PATH_INFO: `/v3/users/5ed0c6298caf469998a4c1bba834df8b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.470857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9949f26-ecd4-4bc6-a310-c04767a2195c admin admin] RBAC: Authorizing `identity:get_user(user_id=5ed0c6298caf469998a4c1bba834df8b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.473040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9949f26-ecd4-4bc6-a310-c04767a2195c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.475086 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 157/314] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/users/5ed0c6298caf469998a4c1bba834df8b => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:09.481035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9949f26-ecd4-4bc6-a310-c04767a2195c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.483973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318befd7-10b0-4d53-bef6-f1d58220b233 admin admin] RBAC: Authorizing `identity:get_user(user_id=0c477fa54e124fbdbcedc9d21c2edf61)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.487032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318befd7-10b0-4d53-bef6-f1d58220b233 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.489538 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 158/315] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/users/0c477fa54e124fbdbcedc9d21c2edf61 => generated 293 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:09.492103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9949f26-ecd4-4bc6-a310-c04767a2195c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.495511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318befd7-10b0-4d53-bef6-f1d58220b233 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:09.505820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cae04-1468-4d12-836f-fc7047ab8b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.506765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cae04-1468-4d12-836f-fc7047ab8b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.507041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cae04-1468-4d12-836f-fc7047ab8b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.507361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cae04-1468-4d12-836f-fc7047ab8b6f admin admin] PATH_INFO: `/v3/system/users/5ed0c6298caf469998a4c1bba834df8b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.509133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cae04-1468-4d12-836f-fc7047ab8b6f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5ed0c6298caf469998a4c1bba834df8b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.510169 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-7c0cae04-1468-4d12-836f-fc7047ab8b6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:09.510169 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:09.510169 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:09.511052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cae04-1468-4d12-836f-fc7047ab8b6f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.511508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318befd7-10b0-4d53-bef6-f1d58220b233 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:09.517573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70292dd-365c-436a-be2f-ae0e63aad022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:09.518908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70292dd-365c-436a-be2f-ae0e63aad022 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:09.518908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70292dd-365c-436a-be2f-ae0e63aad022 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:09.518908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70292dd-365c-436a-be2f-ae0e63aad022 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:09.520120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70292dd-365c-436a-be2f-ae0e63aad022 admin admin] RBAC: Adding query filter params (role.id=181868f756544d47a2b84e5e3ad3ae43, user.id=0c477fa54e124fbdbcedc9d21c2edf61, scope.system=all) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:09.520573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70292dd-365c-436a-be2f-ae0e63aad022 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:09.522637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70292dd-365c-436a-be2f-ae0e63aad022 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:09.523539 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 158/316] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 20:35:09 2022] PUT /identity/v3/system/users/5ed0c6298caf469998a4c1bba834df8b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:35:09.533766 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 159/317] 10.222.0.30 () {56 vars in 1329 bytes} [Sat Feb 19 20:35:09 2022] GET /identity/v3/role_assignments?user.id=0c477fa54e124fbdbcedc9d21c2edf61&scope.system=all&role.id=181868f756544d47a2b84e5e3ad3ae43 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:11.816091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c95ff-d51e-4477-98f9-d8329fa8accc None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.816744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c95ff-d51e-4477-98f9-d8329fa8accc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.816744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c95ff-d51e-4477-98f9-d8329fa8accc None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.818604 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 159/318] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:11.823654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf795-692f-422f-a489-c7089d9b8e7a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.824068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf795-692f-422f-a489-c7089d9b8e7a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.824227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf795-692f-422f-a489-c7089d9b8e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.841903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-02bcf795-692f-422f-a489-c7089d9b8e7a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:11.843110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-02bcf795-692f-422f-a489-c7089d9b8e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:11.852370 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 160/319] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:11.875776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c95ff-d51e-4477-98f9-d8329fa8accc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:11.887958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c95ff-d51e-4477-98f9-d8329fa8accc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:11.892289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cddb79-ad73-4134-8643-c7a4eb826e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:11.893190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddb79-ad73-4134-8643-c7a4eb826e9e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.893476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddb79-ad73-4134-8643-c7a4eb826e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.893755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddb79-ad73-4134-8643-c7a4eb826e9e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.894918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cddb79-ad73-4134-8643-c7a4eb826e9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:11.896627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cddb79-ad73-4134-8643-c7a4eb826e9e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:11.898211 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 160/320] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:11.903557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcf795-692f-422f-a489-c7089d9b8e7a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:11.913401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcf795-692f-422f-a489-c7089d9b8e7a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:11.913930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265722a-8f7d-45ae-9f77-30584ebbe503 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.914213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265722a-8f7d-45ae-9f77-30584ebbe503 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.914758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265722a-8f7d-45ae-9f77-30584ebbe503 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.916519 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 161/321] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:11.918641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291933-d39e-4997-b364-442bda7df1d6 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.918935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291933-d39e-4997-b364-442bda7df1d6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.919219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291933-d39e-4997-b364-442bda7df1d6 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.920169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d0833-4612-44ff-9e0d-d0fe5d57b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:11.920638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0833-4612-44ff-9e0d-d0fe5d57b21b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.920915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0833-4612-44ff-9e0d-d0fe5d57b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.921025 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 162/322] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:11.921214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0833-4612-44ff-9e0d-d0fe5d57b21b admin admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.921856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d0833-4612-44ff-9e0d-d0fe5d57b21b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:11.922069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce176f-fade-4605-99a8-6781a2fdd020 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.922347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce176f-fade-4605-99a8-6781a2fdd020 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.923163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce176f-fade-4605-99a8-6781a2fdd020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.924460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d0833-4612-44ff-9e0d-d0fe5d57b21b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:11.944352 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 161/323] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 20:35:11 2022] POST /identity/v3/groups => generated 226 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:11.944352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962168-0693-4614-9c23-6557c8d3e12c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.944352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962168-0693-4614-9c23-6557c8d3e12c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.944352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962168-0693-4614-9c23-6557c8d3e12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.944759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a0ce176f-fade-4605-99a8-6781a2fdd020 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:11.944759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a0ce176f-fade-4605-99a8-6781a2fdd020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:11.950285 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 163/324] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:11.958292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3c962168-0693-4614-9c23-6557c8d3e12c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:11.959502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3c962168-0693-4614-9c23-6557c8d3e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:11.967107 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 162/325] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:11.974981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce176f-fade-4605-99a8-6781a2fdd020 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:11.984322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce176f-fade-4605-99a8-6781a2fdd020 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:11.989346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53329774-e57f-49fb-a0b1-c3c59ea179be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:11.990139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53329774-e57f-49fb-a0b1-c3c59ea179be admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:11.990416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53329774-e57f-49fb-a0b1-c3c59ea179be admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:11.990689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53329774-e57f-49fb-a0b1-c3c59ea179be admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:11.993190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962168-0693-4614-9c23-6557c8d3e12c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:12.002711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53329774-e57f-49fb-a0b1-c3c59ea179be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:12.003529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962168-0693-4614-9c23-6557c8d3e12c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:12.008269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a184e-0aee-4078-8cbc-cd85da47ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:12.009106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a184e-0aee-4078-8cbc-cd85da47ca3c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:12.009392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a184e-0aee-4078-8cbc-cd85da47ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:12.009670 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-53329774-e57f-49fb-a0b1-c3c59ea179be admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:35:12.009790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a184e-0aee-4078-8cbc-cd85da47ca3c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:12.010969 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 164/326] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:12.016900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53329774-e57f-49fb-a0b1-c3c59ea179be admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:12.022651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a184e-0aee-4078-8cbc-cd85da47ca3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:12.026726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53329774-e57f-49fb-a0b1-c3c59ea179be admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:12.031304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:12.032299 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-3f3a184e-0aee-4078-8cbc-cd85da47ca3c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:12.032504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:12.032776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:12.033049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:12.033823 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 163/327] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:12.033926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:12.034090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:12.035784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:12.040682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a184e-0aee-4078-8cbc-cd85da47ca3c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:12.047365 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 165/328] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:12.052578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a184e-0aee-4078-8cbc-cd85da47ca3c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:12.053365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:12.057228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:12.057904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:12.058186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:12.058464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:12.059230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:12.059540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:12.061230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:12.065286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc23efd-316c-4deb-9cea-a22b3a0c8759 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:12.070832 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 164/329] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:12.071131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8320a-597a-474b-bf61-f5bc4f04fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:12.072171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8320a-597a-474b-bf61-f5bc4f04fad1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:12.072625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8320a-597a-474b-bf61-f5bc4f04fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:12.073063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8320a-597a-474b-bf61-f5bc4f04fad1 admin admin] PATH_INFO: `/v3/users/0c477fa54e124fbdbcedc9d21c2edf61` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:12.074463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8320a-597a-474b-bf61-f5bc4f04fad1 admin admin] RBAC: Authorizing `identity:get_user(user_id=0c477fa54e124fbdbcedc9d21c2edf61)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:12.076574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:12.077117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8320a-597a-474b-bf61-f5bc4f04fad1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:12.079311 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 166/330] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:12 2022] GET /identity/v3/users/0c477fa54e124fbdbcedc9d21c2edf61 => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:12.085020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8320a-597a-474b-bf61-f5bc4f04fad1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:12.086756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289dd19-06e2-4a43-807f-b93bf8ead71b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:12.091122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bf514-288b-4910-bc9a-93b93e15d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:12.092061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bf514-288b-4910-bc9a-93b93e15d43d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:12.092380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bf514-288b-4910-bc9a-93b93e15d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:12.092667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bf514-288b-4910-bc9a-93b93e15d43d admin admin] PATH_INFO: `/v3/users/5ed0c6298caf469998a4c1bba834df8b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:12.093920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bf514-288b-4910-bc9a-93b93e15d43d admin admin] RBAC: Authorizing `identity:get_user(user_id=5ed0c6298caf469998a4c1bba834df8b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:12.096427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8320a-597a-474b-bf61-f5bc4f04fad1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:12.096605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bf514-288b-4910-bc9a-93b93e15d43d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:12.098283 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 165/331] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:12 2022] GET /identity/v3/users/5ed0c6298caf469998a4c1bba834df8b => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:12.101389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf7d1c-beee-43ec-8243-c4e8db1327fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:12.102258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7d1c-beee-43ec-8243-c4e8db1327fa admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:12.102536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7d1c-beee-43ec-8243-c4e8db1327fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:12.102806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7d1c-beee-43ec-8243-c4e8db1327fa admin admin] PATH_INFO: `/v3/system/users/0c477fa54e124fbdbcedc9d21c2edf61/roles/181868f756544d47a2b84e5e3ad3ae43` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:12.104361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bf514-288b-4910-bc9a-93b93e15d43d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:12.105417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf7d1c-beee-43ec-8243-c4e8db1327fa admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0c477fa54e124fbdbcedc9d21c2edf61, role_id=181868f756544d47a2b84e5e3ad3ae43)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:12.107310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf7d1c-beee-43ec-8243-c4e8db1327fa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:12.115247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bf514-288b-4910-bc9a-93b93e15d43d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:12.119495 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 167/332] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 20:35:12 2022] PUT /identity/v3/system/users/0c477fa54e124fbdbcedc9d21c2edf61/roles/181868f756544d47a2b84e5e3ad3ae43 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:12.120821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a68559-e10b-4354-b125-be24b7535f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:12.121555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68559-e10b-4354-b125-be24b7535f6e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:12.121834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68559-e10b-4354-b125-be24b7535f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:12.122104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68559-e10b-4354-b125-be24b7535f6e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:12.122996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a68559-e10b-4354-b125-be24b7535f6e admin admin] RBAC: Adding query filter params (role.id=ee0b0a89e5e9450e8a292e5c29635e9c, user.id=5ed0c6298caf469998a4c1bba834df8b, scope.system=all) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:12.123332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a68559-e10b-4354-b125-be24b7535f6e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:12.125680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a68559-e10b-4354-b125-be24b7535f6e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:12.144265 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 166/333] 10.222.0.30 () {56 vars in 1329 bytes} [Sat Feb 19 20:35:12 2022] GET /identity/v3/role_assignments?user.id=5ed0c6298caf469998a4c1bba834df8b&scope.system=all&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:14.794227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddee75-1265-4b86-a6fc-b39ff6501ff5 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:14.794730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddee75-1265-4b86-a6fc-b39ff6501ff5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:14.794835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddee75-1265-4b86-a6fc-b39ff6501ff5 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:14.797249 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 168/334] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:14.802894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c6bf9-aa96-44f6-9377-b9a0bdb9d066 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:14.803351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c6bf9-aa96-44f6-9377-b9a0bdb9d066 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:14.803429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c6bf9-aa96-44f6-9377-b9a0bdb9d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:14.830283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-451c6bf9-aa96-44f6-9377-b9a0bdb9d066 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:14.831472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-451c6bf9-aa96-44f6-9377-b9a0bdb9d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:14.844365 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 167/335] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:14.890333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddee75-1265-4b86-a6fc-b39ff6501ff5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:14.906176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddee75-1265-4b86-a6fc-b39ff6501ff5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:14.911430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d5e5a-c5e4-4f2d-93fc-7ad0fd9524ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:14.912259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d5e5a-c5e4-4f2d-93fc-7ad0fd9524ca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:14.912565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d5e5a-c5e4-4f2d-93fc-7ad0fd9524ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:14.912898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d5e5a-c5e4-4f2d-93fc-7ad0fd9524ca admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:14.927871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d5e5a-c5e4-4f2d-93fc-7ad0fd9524ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:14.934755 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-522d5e5a-c5e4-4f2d-93fc-7ad0fd9524ca admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 19 20:35:14.936262 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 169/336] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:14.942484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c6bf9-aa96-44f6-9377-b9a0bdb9d066 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:14.951931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c6bf9-aa96-44f6-9377-b9a0bdb9d066 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:14.959046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:14.959708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:14.959987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:14.960263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:14.961035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:14.961339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:14.962934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:14.975984 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 168/337] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:14.981478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d5e5a-c5e4-4f2d-93fc-7ad0fd9524ca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:14.998036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d5e5a-c5e4-4f2d-93fc-7ad0fd9524ca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.009004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a374d-1703-42e2-8df3-4becf6593469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.009886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a374d-1703-42e2-8df3-4becf6593469 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.010158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a374d-1703-42e2-8df3-4becf6593469 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.010428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a374d-1703-42e2-8df3-4becf6593469 admin admin] PATH_INFO: `/v3/users/0c477fa54e124fbdbcedc9d21c2edf61` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.011697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a374d-1703-42e2-8df3-4becf6593469 admin admin] RBAC: Authorizing `identity:get_user(user_id=0c477fa54e124fbdbcedc9d21c2edf61)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.013837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a374d-1703-42e2-8df3-4becf6593469 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.015745 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 170/338] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:35:14 2022] GET /identity/v3/users/0c477fa54e124fbdbcedc9d21c2edf61 => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:15.021991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.040931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a61f7-9716-46a4-905f-b4c0f890a037 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.048421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20644078-1303-4881-8581-d5259d8eb5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.049072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644078-1303-4881-8581-d5259d8eb5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.049351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644078-1303-4881-8581-d5259d8eb5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.049624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644078-1303-4881-8581-d5259d8eb5c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.050445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644078-1303-4881-8581-d5259d8eb5c7 admin admin] RBAC: Adding query filter params (role.id=181868f756544d47a2b84e5e3ad3ae43, user.id=0c477fa54e124fbdbcedc9d21c2edf61, scope.system=all) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:15.050748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644078-1303-4881-8581-d5259d8eb5c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.052601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644078-1303-4881-8581-d5259d8eb5c7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.067043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 169/339] 10.222.0.30 () {56 vars in 1329 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/role_assignments?user.id=0c477fa54e124fbdbcedc9d21c2edf61&scope.system=all&role.id=181868f756544d47a2b84e5e3ad3ae43 => generated 510 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:15.098187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4d93-a1db-48ae-8f27-e5d8ffbb7c52 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.098520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4d93-a1db-48ae-8f27-e5d8ffbb7c52 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.098746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4d93-a1db-48ae-8f27-e5d8ffbb7c52 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.100916 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 171/340] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:15.106128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919c20-b94b-4cd0-b796-fe9db78c760c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.106417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919c20-b94b-4cd0-b796-fe9db78c760c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.106691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919c20-b94b-4cd0-b796-fe9db78c760c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.131596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e5919c20-b94b-4cd0-b796-fe9db78c760c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:15.132903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e5919c20-b94b-4cd0-b796-fe9db78c760c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:15.144589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 170/341] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:15.188764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4d93-a1db-48ae-8f27-e5d8ffbb7c52 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.201653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4d93-a1db-48ae-8f27-e5d8ffbb7c52 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.207002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c2ee-5d6e-40af-98b1-a6a944e47374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.207726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c2ee-5d6e-40af-98b1-a6a944e47374 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.208001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c2ee-5d6e-40af-98b1-a6a944e47374 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.208269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c2ee-5d6e-40af-98b1-a6a944e47374 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.224831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719c2ee-5d6e-40af-98b1-a6a944e47374 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:15.231718 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-8719c2ee-5d6e-40af-98b1-a6a944e47374 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:15.233063 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 172/342] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:15.239697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5919c20-b94b-4cd0-b796-fe9db78c760c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.249525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5919c20-b94b-4cd0-b796-fe9db78c760c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.256662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.257356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.257635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.257908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.258664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:15.258968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.260635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.271823 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 171/343] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:15.277282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c2ee-5d6e-40af-98b1-a6a944e47374 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.294201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c2ee-5d6e-40af-98b1-a6a944e47374 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.305917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701905c-0cde-4408-816b-5e7ed2b161a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.306587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701905c-0cde-4408-816b-5e7ed2b161a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.306866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701905c-0cde-4408-816b-5e7ed2b161a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.307138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701905c-0cde-4408-816b-5e7ed2b161a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.318243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701905c-0cde-4408-816b-5e7ed2b161a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.320640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701905c-0cde-4408-816b-5e7ed2b161a4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.332265 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 173/344] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:15.337727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.347635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111b08-3b19-462b-a3a4-6b0fa49b978a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.356500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2b2b-f1b6-41aa-a76f-ce820f53a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.357372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2b2b-f1b6-41aa-a76f-ce820f53a949 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.357652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2b2b-f1b6-41aa-a76f-ce820f53a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.357928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2b2b-f1b6-41aa-a76f-ce820f53a949 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.359136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d2b2b-f1b6-41aa-a76f-ce820f53a949 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.361716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d2b2b-f1b6-41aa-a76f-ce820f53a949 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.363577 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 172/345] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:15.368902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701905c-0cde-4408-816b-5e7ed2b161a4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.378470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701905c-0cde-4408-816b-5e7ed2b161a4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.383041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d95c0-313e-4c4c-9a74-612d5e8d41c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.383879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d95c0-313e-4c4c-9a74-612d5e8d41c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.384156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d95c0-313e-4c4c-9a74-612d5e8d41c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.384454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d95c0-313e-4c4c-9a74-612d5e8d41c8 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.392960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d95c0-313e-4c4c-9a74-612d5e8d41c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.393987 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-f25d95c0-313e-4c4c-9a74-612d5e8d41c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:15.393987 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:15.393987 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:15.395150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d95c0-313e-4c4c-9a74-612d5e8d41c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.397121 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 174/346] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:15.404069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2b2b-f1b6-41aa-a76f-ce820f53a949 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.413936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2b2b-f1b6-41aa-a76f-ce820f53a949 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.422824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fc0d9-07c5-4678-846c-259639433f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.423481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fc0d9-07c5-4678-846c-259639433f51 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.423757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fc0d9-07c5-4678-846c-259639433f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.424027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fc0d9-07c5-4678-846c-259639433f51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.424943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fc0d9-07c5-4678-846c-259639433f51 admin admin] RBAC: Adding query filter params (group.id=2a94e12793fc4bed81c35c89de27d859, role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:15.425258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fc0d9-07c5-4678-846c-259639433f51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.427089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fc0d9-07c5-4678-846c-259639433f51 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.436768 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 173/347] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/role_assignments?group.id=2a94e12793fc4bed81c35c89de27d859&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:15.626099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cd50a-4059-4669-b8af-2913b8f4c98b None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.626477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cd50a-4059-4669-b8af-2913b8f4c98b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.626647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cd50a-4059-4669-b8af-2913b8f4c98b None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.628732 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 175/348] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:15.643022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc595-cc7e-4bd3-9d43-b8809e0f5965 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.643351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc595-cc7e-4bd3-9d43-b8809e0f5965 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.643572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc595-cc7e-4bd3-9d43-b8809e0f5965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.668654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3b3cc595-cc7e-4bd3-9d43-b8809e0f5965 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:15.669861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3b3cc595-cc7e-4bd3-9d43-b8809e0f5965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:15.684223 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 174/349] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:15.736061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cd50a-4059-4669-b8af-2913b8f4c98b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.749026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cd50a-4059-4669-b8af-2913b8f4c98b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.753662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a12eae-ce61-4402-b216-a1972eaed680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.754468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a12eae-ce61-4402-b216-a1972eaed680 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.754745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a12eae-ce61-4402-b216-a1972eaed680 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.755017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a12eae-ce61-4402-b216-a1972eaed680 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.768377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a12eae-ce61-4402-b216-a1972eaed680 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:15.770939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089816-a95f-45e3-88a2-df55f6502780 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.771227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089816-a95f-45e3-88a2-df55f6502780 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.771505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089816-a95f-45e3-88a2-df55f6502780 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.773358 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 175/350] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:15.775495 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-63a12eae-ce61-4402-b216-a1972eaed680 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:35:15.776965 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 176/351] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:15.779770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82233b97-ee4c-406f-abea-6ca507bd1def None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.780059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82233b97-ee4c-406f-abea-6ca507bd1def None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.780358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82233b97-ee4c-406f-abea-6ca507bd1def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.783776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a12eae-ce61-4402-b216-a1972eaed680 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.796508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a12eae-ce61-4402-b216-a1972eaed680 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.802954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.803638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.803914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.804190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.804995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:15.805302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.805536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-82233b97-ee4c-406f-abea-6ca507bd1def None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:15.806792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-82233b97-ee4c-406f-abea-6ca507bd1def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:15.806980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.821282 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 176/352] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:15.824959 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 177/353] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:15.831007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82233b97-ee4c-406f-abea-6ca507bd1def None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.841338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82233b97-ee4c-406f-abea-6ca507bd1def None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.850103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.850449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d706fb9-53b7-4dac-b84a-d6e68639f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.851161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d706fb9-53b7-4dac-b84a-d6e68639f3dd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.851452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d706fb9-53b7-4dac-b84a-d6e68639f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.851787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d706fb9-53b7-4dac-b84a-d6e68639f3dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.861077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d706fb9-53b7-4dac-b84a-d6e68639f3dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.862904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d706fb9-53b7-4dac-b84a-d6e68639f3dd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.870522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b54325-464e-4e85-8721-cea7279b41f9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.874773 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 177/354] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:15.880762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d706fb9-53b7-4dac-b84a-d6e68639f3dd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.891772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d706fb9-53b7-4dac-b84a-d6e68639f3dd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.893177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44056e6-d78d-489e-8cd4-a510cb6725a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.893979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44056e6-d78d-489e-8cd4-a510cb6725a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.894255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44056e6-d78d-489e-8cd4-a510cb6725a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.894523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44056e6-d78d-489e-8cd4-a510cb6725a9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.896722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70928-d4f8-433f-bd14-c0c233ead364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.897622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70928-d4f8-433f-bd14-c0c233ead364 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.897900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70928-d4f8-433f-bd14-c0c233ead364 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.898180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70928-d4f8-433f-bd14-c0c233ead364 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.899523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae70928-d4f8-433f-bd14-c0c233ead364 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.902378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae70928-d4f8-433f-bd14-c0c233ead364 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.904690 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 178/355] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:15.909826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70928-d4f8-433f-bd14-c0c233ead364 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.920628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70928-d4f8-433f-bd14-c0c233ead364 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.925236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44056e6-d78d-489e-8cd4-a510cb6725a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:15.925963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.926877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.927254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.927584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.928847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.929980 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:15.929980 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:15.929980 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:15.931214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.932058 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b44056e6-d78d-489e-8cd4-a510cb6725a9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:15.933330 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 179/356] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:15.936475 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 178/357] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:15.940781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.954042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e73887-8634-400a-aacf-16377b597c66 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.958109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44056e6-d78d-489e-8cd4-a510cb6725a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:15.960473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.961289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.961575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.961899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.962736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] RBAC: Adding query filter params (group.id=2a94e12793fc4bed81c35c89de27d859, role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:15.963049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.965333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:15.973990 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 180/358] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/role_assignments?group.id=2a94e12793fc4bed81c35c89de27d859&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:15.975062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44056e6-d78d-489e-8cd4-a510cb6725a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:15.990778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:15.991475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:15.991753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:15.992026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:15.993028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:15.993340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:15.995059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.013591 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 179/359] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:16.019125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.038090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43407030-8568-4a0e-907d-6349485d3a1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.053778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51ec60-09c9-4425-bf04-558031079fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.054439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51ec60-09c9-4425-bf04-558031079fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.054724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51ec60-09c9-4425-bf04-558031079fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.054994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51ec60-09c9-4425-bf04-558031079fe6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.072283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51ec60-09c9-4425-bf04-558031079fe6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.074070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51ec60-09c9-4425-bf04-558031079fe6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.086179 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 181/360] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:16.091877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.105790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163ce0-1570-4641-98ba-204d6c5e4ca4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.115766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cf72f-d2fa-4480-b0eb-0ab1c3ed713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.116661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cf72f-d2fa-4480-b0eb-0ab1c3ed713f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.116962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cf72f-d2fa-4480-b0eb-0ab1c3ed713f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.117204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cf72f-d2fa-4480-b0eb-0ab1c3ed713f admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.121130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cf72f-d2fa-4480-b0eb-0ab1c3ed713f admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.123214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cf72f-d2fa-4480-b0eb-0ab1c3ed713f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.125078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 180/361] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:16.131288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51ec60-09c9-4425-bf04-558031079fe6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.146198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51ec60-09c9-4425-bf04-558031079fe6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.157269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37acb89-bfa1-47d5-9599-0dc50a3e793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.158136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acb89-bfa1-47d5-9599-0dc50a3e793b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.158481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acb89-bfa1-47d5-9599-0dc50a3e793b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.158760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acb89-bfa1-47d5-9599-0dc50a3e793b admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.165490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37acb89-bfa1-47d5-9599-0dc50a3e793b admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.167441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37acb89-bfa1-47d5-9599-0dc50a3e793b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.169180 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 182/362] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:16.176974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cf72f-d2fa-4480-b0eb-0ab1c3ed713f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.194292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cf72f-d2fa-4480-b0eb-0ab1c3ed713f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.205280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75941d-d6ad-4d30-8894-4532e570dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.205942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75941d-d6ad-4d30-8894-4532e570dff1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.206222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75941d-d6ad-4d30-8894-4532e570dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.206490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75941d-d6ad-4d30-8894-4532e570dff1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.207320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75941d-d6ad-4d30-8894-4532e570dff1 admin admin] RBAC: Adding query filter params (group.id=2a94e12793fc4bed81c35c89de27d859, role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=c8f2f4af38ad45168a360caf81aa0542) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:16.207626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75941d-d6ad-4d30-8894-4532e570dff1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.209510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75941d-d6ad-4d30-8894-4532e570dff1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.221787 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 181/363] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/role_assignments?group.id=2a94e12793fc4bed81c35c89de27d859&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:16.465638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f441b6e-bb7d-4859-908f-17a5bc320fb7 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.466001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f441b6e-bb7d-4859-908f-17a5bc320fb7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.466169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f441b6e-bb7d-4859-908f-17a5bc320fb7 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.468138 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 183/364] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:16.473311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe5de-b38f-410d-b8a4-2c0c38d9ece3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.473592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe5de-b38f-410d-b8a4-2c0c38d9ece3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.473867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe5de-b38f-410d-b8a4-2c0c38d9ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.497411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a5afe5de-b38f-410d-b8a4-2c0c38d9ece3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:16.498611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a5afe5de-b38f-410d-b8a4-2c0c38d9ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:16.507579 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 182/365] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:16.546551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f441b6e-bb7d-4859-908f-17a5bc320fb7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.562148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f441b6e-bb7d-4859-908f-17a5bc320fb7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.569825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e11817-f455-426e-8114-7af6fa5834e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.570738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e11817-f455-426e-8114-7af6fa5834e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.571021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e11817-f455-426e-8114-7af6fa5834e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.571293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e11817-f455-426e-8114-7af6fa5834e7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.585447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e11817-f455-426e-8114-7af6fa5834e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:16.592777 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-95e11817-f455-426e-8114-7af6fa5834e7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:35:16.593999 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 184/366] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:16.600437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe5de-b38f-410d-b8a4-2c0c38d9ece3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.609614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe5de-b38f-410d-b8a4-2c0c38d9ece3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.618552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.619217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.619494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.619762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.620539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:16.620843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.622423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.635756 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 183/367] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:16.642028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e11817-f455-426e-8114-7af6fa5834e7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.658205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e11817-f455-426e-8114-7af6fa5834e7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.662770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445b36-6f2c-4993-b5a7-6ccd03a0779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.663406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445b36-6f2c-4993-b5a7-6ccd03a0779f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.663684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445b36-6f2c-4993-b5a7-6ccd03a0779f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.663957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445b36-6f2c-4993-b5a7-6ccd03a0779f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.676912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35445b36-6f2c-4993-b5a7-6ccd03a0779f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.678661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35445b36-6f2c-4993-b5a7-6ccd03a0779f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.695021 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 185/368] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:16.704020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.714497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e804db-f418-408c-a8b7-a2942de3f084 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.721650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551481d-eb43-470f-8be4-58436872f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.722443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551481d-eb43-470f-8be4-58436872f916 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.722719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551481d-eb43-470f-8be4-58436872f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.722989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551481d-eb43-470f-8be4-58436872f916 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.724193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551481d-eb43-470f-8be4-58436872f916 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.726475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551481d-eb43-470f-8be4-58436872f916 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.732727 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 184/369] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:16.738634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445b36-6f2c-4993-b5a7-6ccd03a0779f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.754280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445b36-6f2c-4993-b5a7-6ccd03a0779f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.759287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92857107-e13d-446c-96a5-375f34742210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.760212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857107-e13d-446c-96a5-375f34742210 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.760516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857107-e13d-446c-96a5-375f34742210 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.760785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857107-e13d-446c-96a5-375f34742210 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.764834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92857107-e13d-446c-96a5-375f34742210 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.766760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92857107-e13d-446c-96a5-375f34742210 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.768606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 186/370] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:16.778810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551481d-eb43-470f-8be4-58436872f916 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:16.789336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551481d-eb43-470f-8be4-58436872f916 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:16.795640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a392e9-6706-4eb6-995b-1544cf26f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:16.796280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a392e9-6706-4eb6-995b-1544cf26f658 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:16.796585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a392e9-6706-4eb6-995b-1544cf26f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:16.798009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a392e9-6706-4eb6-995b-1544cf26f658 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:16.798287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a392e9-6706-4eb6-995b-1544cf26f658 admin admin] RBAC: Adding query filter params (group.id=2a94e12793fc4bed81c35c89de27d859, role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=c8f2f4af38ad45168a360caf81aa0542) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:16.798730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a392e9-6706-4eb6-995b-1544cf26f658 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:16.800759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a392e9-6706-4eb6-995b-1544cf26f658 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:16.808631 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 185/371] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:16 2022] GET /identity/v3/role_assignments?group.id=2a94e12793fc4bed81c35c89de27d859&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:17.445110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c5e09-8f32-49c5-9a87-6785b7eb06fa None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:17.445988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c5e09-8f32-49c5-9a87-6785b7eb06fa None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:17.445988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c5e09-8f32-49c5-9a87-6785b7eb06fa None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:17.447860 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 187/372] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:17.453189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466fce-7daa-4c20-ac89-c910e8014cc4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:17.454011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466fce-7daa-4c20-ac89-c910e8014cc4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:17.454273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466fce-7daa-4c20-ac89-c910e8014cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:17.478191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e3466fce-7daa-4c20-ac89-c910e8014cc4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:17.479492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e3466fce-7daa-4c20-ac89-c910e8014cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:17.492153 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 186/373] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:17.537565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c5e09-8f32-49c5-9a87-6785b7eb06fa None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:17.554164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c5e09-8f32-49c5-9a87-6785b7eb06fa None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:17.561229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fcd68-aefc-40a8-832d-860f98b651da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:17.562030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fcd68-aefc-40a8-832d-860f98b651da admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:17.562303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fcd68-aefc-40a8-832d-860f98b651da admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:17.562570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fcd68-aefc-40a8-832d-860f98b651da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:17.576969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fcd68-aefc-40a8-832d-860f98b651da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:17.584715 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-410fcd68-aefc-40a8-832d-860f98b651da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:17.585975 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 188/374] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:17.591903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466fce-7daa-4c20-ac89-c910e8014cc4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:17.605405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466fce-7daa-4c20-ac89-c910e8014cc4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:17.613480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:17.614152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:17.614431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:17.614704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:17.615530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:17.615836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:17.617473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:17.631796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 187/375] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:17.637291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fcd68-aefc-40a8-832d-860f98b651da admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:17.653015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fcd68-aefc-40a8-832d-860f98b651da admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:17.660951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87790a-b597-4635-a302-38e2490a77a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:17.661580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87790a-b597-4635-a302-38e2490a77a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:17.661856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87790a-b597-4635-a302-38e2490a77a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:17.662131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87790a-b597-4635-a302-38e2490a77a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:17.670998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87790a-b597-4635-a302-38e2490a77a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:17.673293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87790a-b597-4635-a302-38e2490a77a2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:17.686072 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 189/376] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:17.692212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:17.706056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ed34d-7d74-4c8e-8887-e78d20514397 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:17.713542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bada2b8-a13c-4526-8850-fa2ec2b10b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:17.714393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bada2b8-a13c-4526-8850-fa2ec2b10b54 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:17.714672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bada2b8-a13c-4526-8850-fa2ec2b10b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:17.714947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bada2b8-a13c-4526-8850-fa2ec2b10b54 admin admin] PATH_INFO: `/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:17.716127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bada2b8-a13c-4526-8850-fa2ec2b10b54 admin admin] RBAC: Authorizing `identity:get_project(project_id=8848562c8fea4a5fbbab0bbfcc0a45f0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:17.717920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bada2b8-a13c-4526-8850-fa2ec2b10b54 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:17.720471 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 188/377] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:17 2022] GET /identity/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:17.725895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87790a-b597-4635-a302-38e2490a77a2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:17.737267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87790a-b597-4635-a302-38e2490a77a2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:17.745135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53796083-f018-4d01-96dd-6da81dc03a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:17.745981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796083-f018-4d01-96dd-6da81dc03a62 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:17.746255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796083-f018-4d01-96dd-6da81dc03a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:17.746522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796083-f018-4d01-96dd-6da81dc03a62 admin admin] PATH_INFO: `/v3/groups/5355456335954edbbf44aa60cd460d44` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:17.757102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53796083-f018-4d01-96dd-6da81dc03a62 admin admin] RBAC: Authorizing `identity:get_group(group_id=5355456335954edbbf44aa60cd460d44)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:17.759273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53796083-f018-4d01-96dd-6da81dc03a62 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:17.761231 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 190/378] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:17 2022] GET /identity/v3/groups/5355456335954edbbf44aa60cd460d44 => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:17.768959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bada2b8-a13c-4526-8850-fa2ec2b10b54 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:17.781616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bada2b8-a13c-4526-8850-fa2ec2b10b54 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:17.792161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e61a6e-dd0c-43db-ab58-db17659b14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:17.793030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61a6e-dd0c-43db-ab58-db17659b14e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:17.793311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61a6e-dd0c-43db-ab58-db17659b14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:17.793585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61a6e-dd0c-43db-ab58-db17659b14e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:17.794417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e61a6e-dd0c-43db-ab58-db17659b14e0 admin admin] RBAC: Adding query filter params (group.id=5355456335954edbbf44aa60cd460d44, role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=8848562c8fea4a5fbbab0bbfcc0a45f0) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:17.794726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e61a6e-dd0c-43db-ab58-db17659b14e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:17.796580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e61a6e-dd0c-43db-ab58-db17659b14e0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:17.809236 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 189/379] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:17 2022] GET /identity/v3/role_assignments?group.id=5355456335954edbbf44aa60cd460d44&scope.project.id=8848562c8fea4a5fbbab0bbfcc0a45f0&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:18.902734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9c1e-168a-4a8f-b668-78ccb41c4a2c None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:18.903404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9c1e-168a-4a8f-b668-78ccb41c4a2c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:18.903404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9c1e-168a-4a8f-b668-78ccb41c4a2c None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:18.905360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 191/380] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:18.911064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01c48-4a2d-4f9f-847a-1ede6fb25abb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:18.911606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01c48-4a2d-4f9f-847a-1ede6fb25abb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:18.911606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01c48-4a2d-4f9f-847a-1ede6fb25abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:18.937545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-75d01c48-4a2d-4f9f-847a-1ede6fb25abb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:18.939285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-75d01c48-4a2d-4f9f-847a-1ede6fb25abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:18.951644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 190/381] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:18.986000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed7db7-13c6-448f-8362-1a35a669750c None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:18.986299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed7db7-13c6-448f-8362-1a35a669750c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:18.986538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed7db7-13c6-448f-8362-1a35a669750c None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:18.988416 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 192/382] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:18.989389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01c48-4a2d-4f9f-847a-1ede6fb25abb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:18.999166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01c48-4a2d-4f9f-847a-1ede6fb25abb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.004512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c19060-0b37-4a8f-8de1-1dda3c5c6430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.005301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c19060-0b37-4a8f-8de1-1dda3c5c6430 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.005575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c19060-0b37-4a8f-8de1-1dda3c5c6430 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.005843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c19060-0b37-4a8f-8de1-1dda3c5c6430 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.010446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80510-fa72-4064-8313-ba07413d6918 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.010729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80510-fa72-4064-8313-ba07413d6918 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.011013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80510-fa72-4064-8313-ba07413d6918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.033368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-11e80510-fa72-4064-8313-ba07413d6918 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:19.033713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c19060-0b37-4a8f-8de1-1dda3c5c6430 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:19.035263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-11e80510-fa72-4064-8313-ba07413d6918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:19.041209 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b5c19060-0b37-4a8f-8de1-1dda3c5c6430 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:35:19.042450 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 191/383] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:19.048147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 193/384] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:19.052517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c19060-0b37-4a8f-8de1-1dda3c5c6430 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.066126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c19060-0b37-4a8f-8de1-1dda3c5c6430 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.076470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.077131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.077409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.077683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.078451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:19.078759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.080364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.103958 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 192/385] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:19.109441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80510-fa72-4064-8313-ba07413d6918 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.112961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.122522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80510-fa72-4064-8313-ba07413d6918 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.122672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305442d-8aac-4ee4-80bb-b77fb035ef32 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.134177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e922c-386c-486a-9cf3-38cd85a37bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.134964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e922c-386c-486a-9cf3-38cd85a37bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.135244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e922c-386c-486a-9cf3-38cd85a37bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.135519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e922c-386c-486a-9cf3-38cd85a37bd3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.136575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47c9e0-60d0-4417-9470-a01f0dedb24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.137418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c9e0-60d0-4417-9470-a01f0dedb24c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.137688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c9e0-60d0-4417-9470-a01f0dedb24c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.137953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c9e0-60d0-4417-9470-a01f0dedb24c admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.139296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47c9e0-60d0-4417-9470-a01f0dedb24c admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.142561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47c9e0-60d0-4417-9470-a01f0dedb24c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.144180 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 194/386] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:19.152730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47c9e0-60d0-4417-9470-a01f0dedb24c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.164753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e922c-386c-486a-9cf3-38cd85a37bd3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:19.166762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47c9e0-60d0-4417-9470-a01f0dedb24c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.171653 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-398e922c-386c-486a-9cf3-38cd85a37bd3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:19.173865 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 193/387] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:19.182040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e922c-386c-486a-9cf3-38cd85a37bd3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.182245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78268df-dbe0-4f86-bff6-67b6bc8f09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.183098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78268df-dbe0-4f86-bff6-67b6bc8f09c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.183423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78268df-dbe0-4f86-bff6-67b6bc8f09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.183696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78268df-dbe0-4f86-bff6-67b6bc8f09c8 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.184921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78268df-dbe0-4f86-bff6-67b6bc8f09c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.187052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78268df-dbe0-4f86-bff6-67b6bc8f09c8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.196193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e922c-386c-486a-9cf3-38cd85a37bd3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.196805 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 195/388] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:19.197720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78268df-dbe0-4f86-bff6-67b6bc8f09c8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.209736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.210364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.210639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.210910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.211657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:19.211959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.216675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.217707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78268df-dbe0-4f86-bff6-67b6bc8f09c8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.228894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a3285-5b1a-4483-9ecb-dbaaaca42a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.230596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3285-5b1a-4483-9ecb-dbaaaca42a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.230986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3285-5b1a-4483-9ecb-dbaaaca42a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.231256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3285-5b1a-4483-9ecb-dbaaaca42a4d admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/groups/2a94e12793fc4bed81c35c89de27d859/roles/f163b9739a604fe9934c537c47ceeae5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.239149 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 194/389] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:19.239415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a3285-5b1a-4483-9ecb-dbaaaca42a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a486af8aa3c4f399c582c62fa59d1b2, group_id=2a94e12793fc4bed81c35c89de27d859, role_id=f163b9739a604fe9934c537c47ceeae5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.241897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a3285-5b1a-4483-9ecb-dbaaaca42a4d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.253051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.269109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8940-5154-4c99-bfec-12e88615f096 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.271595 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 196/390] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 20:35:19 2022] PUT /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/groups/2a94e12793fc4bed81c35c89de27d859/roles/f163b9739a604fe9934c537c47ceeae5 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:19.336227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c1325-0240-4c46-9425-adc88f497117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.337117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c1325-0240-4c46-9425-adc88f497117 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.337375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c1325-0240-4c46-9425-adc88f497117 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.337649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c1325-0240-4c46-9425-adc88f497117 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.338866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c1325-0240-4c46-9425-adc88f497117 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.340878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c1325-0240-4c46-9425-adc88f497117 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.342659 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 195/391] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:19.348431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a3285-5b1a-4483-9ecb-dbaaaca42a4d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.360169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a3285-5b1a-4483-9ecb-dbaaaca42a4d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.364937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98063e2-2dea-4205-82e7-557cb83df3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.365888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98063e2-2dea-4205-82e7-557cb83df3dd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.366214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98063e2-2dea-4205-82e7-557cb83df3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.366489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98063e2-2dea-4205-82e7-557cb83df3dd admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.367773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98063e2-2dea-4205-82e7-557cb83df3dd admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.370091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98063e2-2dea-4205-82e7-557cb83df3dd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.372242 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 197/392] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:19.379030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c1325-0240-4c46-9425-adc88f497117 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.389954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c1325-0240-4c46-9425-adc88f497117 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.395703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64210f-e13e-4155-909b-c126ca836725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.396688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64210f-e13e-4155-909b-c126ca836725 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.396969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64210f-e13e-4155-909b-c126ca836725 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.397304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64210f-e13e-4155-909b-c126ca836725 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/groups/2a94e12793fc4bed81c35c89de27d859/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.399719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64210f-e13e-4155-909b-c126ca836725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a486af8aa3c4f399c582c62fa59d1b2, group_id=2a94e12793fc4bed81c35c89de27d859, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.402701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64210f-e13e-4155-909b-c126ca836725 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.421666 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 196/393] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 20:35:19 2022] PUT /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2/groups/2a94e12793fc4bed81c35c89de27d859/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:19.515038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043dce-240e-4173-a229-99a7b9bde080 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.515391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043dce-240e-4173-a229-99a7b9bde080 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.515606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043dce-240e-4173-a229-99a7b9bde080 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.518369 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 198/394] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:19.524508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb465dd-3f8b-4867-a052-c1f31a672d38 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.524806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb465dd-3f8b-4867-a052-c1f31a672d38 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.525046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb465dd-3f8b-4867-a052-c1f31a672d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.546019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-aeb465dd-3f8b-4867-a052-c1f31a672d38 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:19.547302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aeb465dd-3f8b-4867-a052-c1f31a672d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:19.637429 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 197/395] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:19.664944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5043dce-240e-4173-a229-99a7b9bde080 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.677757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5043dce-240e-4173-a229-99a7b9bde080 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.682180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf4ef6-c3cc-4997-9a61-0e2d03254c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.683068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4ef6-c3cc-4997-9a61-0e2d03254c4b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.683346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4ef6-c3cc-4997-9a61-0e2d03254c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.683620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4ef6-c3cc-4997-9a61-0e2d03254c4b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.695235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf4ef6-c3cc-4997-9a61-0e2d03254c4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:19.702546 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-f8bf4ef6-c3cc-4997-9a61-0e2d03254c4b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:19.704793 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 199/396] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:19.710170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb465dd-3f8b-4867-a052-c1f31a672d38 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.720431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb465dd-3f8b-4867-a052-c1f31a672d38 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.727362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.727362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.727362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.727362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.727697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:19.727697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.728971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.738593 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 198/397] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:19.744197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf4ef6-c3cc-4997-9a61-0e2d03254c4b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.755102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf4ef6-c3cc-4997-9a61-0e2d03254c4b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.759973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61136c3-656b-4c57-8ed8-d35f4f23a43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.760880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61136c3-656b-4c57-8ed8-d35f4f23a43e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.761158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61136c3-656b-4c57-8ed8-d35f4f23a43e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.761422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61136c3-656b-4c57-8ed8-d35f4f23a43e admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.762586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61136c3-656b-4c57-8ed8-d35f4f23a43e admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.764544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61136c3-656b-4c57-8ed8-d35f4f23a43e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.767076 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 200/398] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:19.772202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.786875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c819-ec2b-43da-a4e0-c0afc455236c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.796633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ecade-4295-48ff-83a1-c755f38b3c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.798032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ecade-4295-48ff-83a1-c755f38b3c4b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.798313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ecade-4295-48ff-83a1-c755f38b3c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.798585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ecade-4295-48ff-83a1-c755f38b3c4b admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.805165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ecade-4295-48ff-83a1-c755f38b3c4b admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.807237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ecade-4295-48ff-83a1-c755f38b3c4b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.809406 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 199/399] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:19.815235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61136c3-656b-4c57-8ed8-d35f4f23a43e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.825741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61136c3-656b-4c57-8ed8-d35f4f23a43e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:19.832035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3783-77df-4b42-85aa-01310dc81df1 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.832353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3783-77df-4b42-85aa-01310dc81df1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.832639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3783-77df-4b42-85aa-01310dc81df1 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.834704 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 200/400] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:19.835016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9808af6-888b-4b7e-ae84-9680c9d3f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:19.835988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9808af6-888b-4b7e-ae84-9680c9d3f8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.836318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9808af6-888b-4b7e-ae84-9680c9d3f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.836609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9808af6-888b-4b7e-ae84-9680c9d3f8c2 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542/groups/2a94e12793fc4bed81c35c89de27d859/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.838975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9808af6-888b-4b7e-ae84-9680c9d3f8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f2f4af38ad45168a360caf81aa0542, group_id=2a94e12793fc4bed81c35c89de27d859, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:19.839964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05c76-d7cf-4f90-958d-dc7cc450d4a3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:19.840253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05c76-d7cf-4f90-958d-dc7cc450d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:19.840571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05c76-d7cf-4f90-958d-dc7cc450d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:19.841820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9808af6-888b-4b7e-ae84-9680c9d3f8c2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:19.864002 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 201/401] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 20:35:19 2022] PUT /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542/groups/2a94e12793fc4bed81c35c89de27d859/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:19.873563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-45a05c76-d7cf-4f90-958d-dc7cc450d4a3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:19.874903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-45a05c76-d7cf-4f90-958d-dc7cc450d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:19.944026 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 201/402] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:19.985940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9808af6-888b-4b7e-ae84-9680c9d3f8c2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:19.996928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9808af6-888b-4b7e-ae84-9680c9d3f8c2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:20.003889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e1392-5610-437b-8b17-532fb05d6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:20.004880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1392-5610-437b-8b17-532fb05d6fec admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:20.005158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1392-5610-437b-8b17-532fb05d6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:20.005559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1392-5610-437b-8b17-532fb05d6fec admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:20.018573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e1392-5610-437b-8b17-532fb05d6fec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:20.026123 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-0c8e1392-5610-437b-8b17-532fb05d6fec admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:35:20.027708 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 202/403] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:20.034563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a05c76-d7cf-4f90-958d-dc7cc450d4a3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:20.044483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a05c76-d7cf-4f90-958d-dc7cc450d4a3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:20.052195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:20.052891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:20.053218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:20.053490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:20.054300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:20.054656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:20.056423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:20.066385 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 202/404] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:20.071901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e1392-5610-437b-8b17-532fb05d6fec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:20.082553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e1392-5610-437b-8b17-532fb05d6fec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:20.092206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1c252-a884-4804-9e23-1f51fbcb6c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:20.093329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1c252-a884-4804-9e23-1f51fbcb6c43 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:20.093607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1c252-a884-4804-9e23-1f51fbcb6c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:20.093882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1c252-a884-4804-9e23-1f51fbcb6c43 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:20.095628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1c252-a884-4804-9e23-1f51fbcb6c43 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:20.097681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1c252-a884-4804-9e23-1f51fbcb6c43 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:20.099624 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 203/405] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:20 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:20.105469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:20.116316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f42b43-6265-4367-be04-e219656daf19 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:20.122719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eb99f-52c1-4fe2-9535-1ee4ca28f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:20.123617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb99f-52c1-4fe2-9535-1ee4ca28f421 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:20.123892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb99f-52c1-4fe2-9535-1ee4ca28f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:20.124210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eb99f-52c1-4fe2-9535-1ee4ca28f421 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:20.126082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407eb99f-52c1-4fe2-9535-1ee4ca28f421 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:20.128281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407eb99f-52c1-4fe2-9535-1ee4ca28f421 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:20.130198 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 203/406] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:20 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:20.135634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1c252-a884-4804-9e23-1f51fbcb6c43 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:20.147467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1c252-a884-4804-9e23-1f51fbcb6c43 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:20.156247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad568a-eff1-4b90-bb99-9c62d90485f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:20.157466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad568a-eff1-4b90-bb99-9c62d90485f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:20.157747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad568a-eff1-4b90-bb99-9c62d90485f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:20.158021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad568a-eff1-4b90-bb99-9c62d90485f1 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542/groups/2a94e12793fc4bed81c35c89de27d859/roles/f163b9739a604fe9934c537c47ceeae5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:20.160434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad568a-eff1-4b90-bb99-9c62d90485f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f2f4af38ad45168a360caf81aa0542, group_id=2a94e12793fc4bed81c35c89de27d859, role_id=f163b9739a604fe9934c537c47ceeae5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:20.163211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad568a-eff1-4b90-bb99-9c62d90485f1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:20.197931 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 204/407] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 20:35:20 2022] PUT /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542/groups/2a94e12793fc4bed81c35c89de27d859/roles/f163b9739a604fe9934c537c47ceeae5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:21.433900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c89e4-5359-41a0-8636-7f4ba7a73184 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:21.434600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c89e4-5359-41a0-8636-7f4ba7a73184 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:21.434600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c89e4-5359-41a0-8636-7f4ba7a73184 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:21.436191 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 204/408] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:21.458550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10e4d-7bff-475d-aef0-7dd48632fe83 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:21.459157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10e4d-7bff-475d-aef0-7dd48632fe83 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:21.459329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10e4d-7bff-475d-aef0-7dd48632fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:21.482267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-82a10e4d-7bff-475d-aef0-7dd48632fe83 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:21.483451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-82a10e4d-7bff-475d-aef0-7dd48632fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:21.559052 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 205/409] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:21.599937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c89e4-5359-41a0-8636-7f4ba7a73184 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:21.612287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c89e4-5359-41a0-8636-7f4ba7a73184 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:21.619860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f546b-7dfc-4ca4-b3ff-7942777f4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:21.620783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f546b-7dfc-4ca4-b3ff-7942777f4a27 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:21.621064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f546b-7dfc-4ca4-b3ff-7942777f4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:21.621503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f546b-7dfc-4ca4-b3ff-7942777f4a27 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:21.632799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f546b-7dfc-4ca4-b3ff-7942777f4a27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:21.639549 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-e41f546b-7dfc-4ca4-b3ff-7942777f4a27 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:21.641126 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 205/410] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:21.647647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a10e4d-7bff-475d-aef0-7dd48632fe83 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:21.656975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a10e4d-7bff-475d-aef0-7dd48632fe83 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:21.661919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:21.662631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:21.662913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:21.663236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:21.663981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:21.664283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:21.666211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:21.675341 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 206/411] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:21.680608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f546b-7dfc-4ca4-b3ff-7942777f4a27 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:21.691653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f546b-7dfc-4ca4-b3ff-7942777f4a27 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:21.699784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0ab27-4878-4f98-a311-36f6f8d6af92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:21.699784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0ab27-4878-4f98-a311-36f6f8d6af92 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:21.699784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0ab27-4878-4f98-a311-36f6f8d6af92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:21.699784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0ab27-4878-4f98-a311-36f6f8d6af92 admin admin] PATH_INFO: `/v3/groups/5355456335954edbbf44aa60cd460d44` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:21.701074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0ab27-4878-4f98-a311-36f6f8d6af92 admin admin] RBAC: Authorizing `identity:get_group(group_id=5355456335954edbbf44aa60cd460d44)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:21.701074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0ab27-4878-4f98-a311-36f6f8d6af92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:21.702710 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 206/412] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:21 2022] GET /identity/v3/groups/5355456335954edbbf44aa60cd460d44 => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:21.709210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:21.719528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cca5e-36fb-488a-9b05-afa86818a930 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:21.729546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856938a-89f7-4828-a418-e4b617104896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:21.729546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856938a-89f7-4828-a418-e4b617104896 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:21.729546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856938a-89f7-4828-a418-e4b617104896 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:21.729546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856938a-89f7-4828-a418-e4b617104896 admin admin] PATH_INFO: `/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:21.730230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856938a-89f7-4828-a418-e4b617104896 admin admin] RBAC: Authorizing `identity:get_project(project_id=8848562c8fea4a5fbbab0bbfcc0a45f0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:21.730230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856938a-89f7-4828-a418-e4b617104896 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:21.734990 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 207/413] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:21 2022] GET /identity/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:21.737767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0ab27-4878-4f98-a311-36f6f8d6af92 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:21.747885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0ab27-4878-4f98-a311-36f6f8d6af92 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:21.754870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac36a7-eae3-44d9-a656-53880a914077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:21.755891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac36a7-eae3-44d9-a656-53880a914077 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:21.756168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac36a7-eae3-44d9-a656-53880a914077 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:21.756489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac36a7-eae3-44d9-a656-53880a914077 admin admin] PATH_INFO: `/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0/groups/5355456335954edbbf44aa60cd460d44/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:21.762675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac36a7-eae3-44d9-a656-53880a914077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8848562c8fea4a5fbbab0bbfcc0a45f0, group_id=5355456335954edbbf44aa60cd460d44, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:21.765540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac36a7-eae3-44d9-a656-53880a914077 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:21.780767 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 207/414] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 20:35:21 2022] PUT /identity/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0/groups/5355456335954edbbf44aa60cd460d44/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:22.558896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba94c-7a95-4f76-9bdd-0ae107a63960 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.559672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba94c-7a95-4f76-9bdd-0ae107a63960 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.559672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba94c-7a95-4f76-9bdd-0ae107a63960 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.561398 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 208/415] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:22.567424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115bcad-b9f4-4bfb-aed2-52d5dc87e205 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.567982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115bcad-b9f4-4bfb-aed2-52d5dc87e205 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.567982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115bcad-b9f4-4bfb-aed2-52d5dc87e205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.591203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9115bcad-b9f4-4bfb-aed2-52d5dc87e205 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:22.592408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9115bcad-b9f4-4bfb-aed2-52d5dc87e205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:22.663829 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 208/416] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:22.713570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfba94c-7a95-4f76-9bdd-0ae107a63960 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:22.730996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfba94c-7a95-4f76-9bdd-0ae107a63960 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:22.735515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8a78b-2ec9-43f9-b568-921f6994604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:22.736408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8a78b-2ec9-43f9-b568-921f6994604a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.736686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8a78b-2ec9-43f9-b568-921f6994604a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.736950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8a78b-2ec9-43f9-b568-921f6994604a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.747898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8a78b-2ec9-43f9-b568-921f6994604a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:22.758033 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-7be8a78b-2ec9-43f9-b568-921f6994604a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:35:22.759703 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 209/417] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:22.765547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115bcad-b9f4-4bfb-aed2-52d5dc87e205 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:22.775344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115bcad-b9f4-4bfb-aed2-52d5dc87e205 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:22.783239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:22.783897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.784175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.784478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.785231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:22.785535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:22.787128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:22.798409 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 209/418] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:22.803953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8a78b-2ec9-43f9-b568-921f6994604a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:22.814476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8a78b-2ec9-43f9-b568-921f6994604a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:22.824249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de4e5-f89a-46be-9208-b97af5efa158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:22.824972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de4e5-f89a-46be-9208-b97af5efa158 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.825251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de4e5-f89a-46be-9208-b97af5efa158 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.825674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de4e5-f89a-46be-9208-b97af5efa158 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.835096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3de4e5-f89a-46be-9208-b97af5efa158 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:22.836884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3de4e5-f89a-46be-9208-b97af5efa158 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:22.850781 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 210/419] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:22.856685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:22.867227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80f2b-127f-42ac-9fbc-6f24b48c4111 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:22.874003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0d848-d3bc-48b8-b4ab-5e05f1981794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:22.874946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d848-d3bc-48b8-b4ab-5e05f1981794 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.875222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d848-d3bc-48b8-b4ab-5e05f1981794 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.875534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d848-d3bc-48b8-b4ab-5e05f1981794 admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.876831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0d848-d3bc-48b8-b4ab-5e05f1981794 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:22.879003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0d848-d3bc-48b8-b4ab-5e05f1981794 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:22.880948 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 210/420] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:22 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:22.886465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de4e5-f89a-46be-9208-b97af5efa158 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:22.897972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de4e5-f89a-46be-9208-b97af5efa158 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:22.907533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f34f-68fe-4193-a410-554f4c4075c3 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.907833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f34f-68fe-4193-a410-554f4c4075c3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.908109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f34f-68fe-4193-a410-554f4c4075c3 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.910084 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 211/421] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:22.911961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9267c07-4671-4b5c-aff1-afeaae65a4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:22.912918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267c07-4671-4b5c-aff1-afeaae65a4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.913194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267c07-4671-4b5c-aff1-afeaae65a4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.913461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267c07-4671-4b5c-aff1-afeaae65a4c0 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.915262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c18c-705f-41c9-a35b-0cbc60593629 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.915538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c18c-705f-41c9-a35b-0cbc60593629 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.915865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c18c-705f-41c9-a35b-0cbc60593629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.918826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9267c07-4671-4b5c-aff1-afeaae65a4c0 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:22.920982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9267c07-4671-4b5c-aff1-afeaae65a4c0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:22.925491 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 211/422] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:22 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:22.926799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc530b9-2338-4a0f-9d8a-3659665ff099 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.927085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc530b9-2338-4a0f-9d8a-3659665ff099 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.927362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc530b9-2338-4a0f-9d8a-3659665ff099 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.930197 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 212/423] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:22.930932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc530b9-2338-4a0f-9d8a-3659665ff099 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:22.935823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d7c3c18c-705f-41c9-a35b-0cbc60593629 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:22.937844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d7c3c18c-705f-41c9-a35b-0cbc60593629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:22.952047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc530b9-2338-4a0f-9d8a-3659665ff099 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:22.952279 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 212/424] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:22.954097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716199-a829-43d7-9f44-45b226b9cb89 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.954381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716199-a829-43d7-9f44-45b226b9cb89 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.954655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716199-a829-43d7-9f44-45b226b9cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.957414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:22.958200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:22.958479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:22.958794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:22.959903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] RBAC: Adding query filter params (group.id=2a94e12793fc4bed81c35c89de27d859, role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:22.960219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:22.962265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:22.968774 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 213/425] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:22 2022] GET /identity/v3/role_assignments?group.id=2a94e12793fc4bed81c35c89de27d859&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 611 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:22.974170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fe716199-a829-43d7-9f44-45b226b9cb89 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:22.975393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fe716199-a829-43d7-9f44-45b226b9cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:22.983716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 213/426] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:22.998046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.011347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716199-a829-43d7-9f44-45b226b9cb89 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.013863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667ee43-456f-48ad-8567-2826c655a0a2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.018901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afecc7-4fda-40b4-aaad-e622cd2c5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.019688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afecc7-4fda-40b4-aaad-e622cd2c5799 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.019965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afecc7-4fda-40b4-aaad-e622cd2c5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.020234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afecc7-4fda-40b4-aaad-e622cd2c5799 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.022029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716199-a829-43d7-9f44-45b226b9cb89 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.042920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a7101-b856-44f0-9276-4fce0e1d83ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.043250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afecc7-4fda-40b4-aaad-e622cd2c5799 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:23.043409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a7101-b856-44f0-9276-4fce0e1d83ec admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.043409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a7101-b856-44f0-9276-4fce0e1d83ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.043409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a7101-b856-44f0-9276-4fce0e1d83ec admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.050473 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-f5afecc7-4fda-40b4-aaad-e622cd2c5799 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:23.051939 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 214/427] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:23.058238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afecc7-4fda-40b4-aaad-e622cd2c5799 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.061971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a7101-b856-44f0-9276-4fce0e1d83ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:23.072663 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-067a7101-b856-44f0-9276-4fce0e1d83ec admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 19 20:35:23.073338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afecc7-4fda-40b4-aaad-e622cd2c5799 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.074871 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 214/428] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:23.080887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a7101-b856-44f0-9276-4fce0e1d83ec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.093550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.094285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.095845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.096142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.096940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:23.098170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.101225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.106655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a7101-b856-44f0-9276-4fce0e1d83ec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.119800 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 215/429] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:23.127094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.129166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.129961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.130236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.130509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.131419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:23.131767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.133554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.154500 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 215/430] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:23.155267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8ced1-327a-40da-884c-6bc8c4661208 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.165550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc0c8-1836-4325-b195-c3b74ef247ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.166293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc0c8-1836-4325-b195-c3b74ef247ad admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.166624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc0c8-1836-4325-b195-c3b74ef247ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.166897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc0c8-1836-4325-b195-c3b74ef247ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.169480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.187984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e05a6c-62bf-492f-afe6-7262d4e69c22 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.190425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fc0c8-1836-4325-b195-c3b74ef247ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.192490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fc0c8-1836-4325-b195-c3b74ef247ad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.198505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420476-cc89-47ea-a83b-000b76686cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.199488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420476-cc89-47ea-a83b-000b76686cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.200000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420476-cc89-47ea-a83b-000b76686cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.200518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420476-cc89-47ea-a83b-000b76686cf4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.207042 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 216/431] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:23.215898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46420476-cc89-47ea-a83b-000b76686cf4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.216077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc0c8-1836-4325-b195-c3b74ef247ad admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.218028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46420476-cc89-47ea-a83b-000b76686cf4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.227521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc0c8-1836-4325-b195-c3b74ef247ad admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.231018 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 216/432] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:23.237406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f70e9-e287-4df2-ae36-429e5f0708d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.238468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f70e9-e287-4df2-ae36-429e5f0708d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.239497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420476-cc89-47ea-a83b-000b76686cf4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.244006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f70e9-e287-4df2-ae36-429e5f0708d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.244503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f70e9-e287-4df2-ae36-429e5f0708d6 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.249515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f70e9-e287-4df2-ae36-429e5f0708d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.249696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420476-cc89-47ea-a83b-000b76686cf4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.252641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f70e9-e287-4df2-ae36-429e5f0708d6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.254875 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 217/433] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:23.257305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdf8c0-e61f-4075-b3d7-ee491b0d49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.258189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdf8c0-e61f-4075-b3d7-ee491b0d49ee admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.258477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdf8c0-e61f-4075-b3d7-ee491b0d49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.258747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdf8c0-e61f-4075-b3d7-ee491b0d49ee admin admin] PATH_INFO: `/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.260073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f70e9-e287-4df2-ae36-429e5f0708d6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.260323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdf8c0-e61f-4075-b3d7-ee491b0d49ee admin admin] RBAC: Authorizing `identity:get_project(project_id=2a486af8aa3c4f399c582c62fa59d1b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.262493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdf8c0-e61f-4075-b3d7-ee491b0d49ee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.265280 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 217/434] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/projects/2a486af8aa3c4f399c582c62fa59d1b2 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:23.271100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdf8c0-e61f-4075-b3d7-ee491b0d49ee admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.278793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f70e9-e287-4df2-ae36-429e5f0708d6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.282474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdf8c0-e61f-4075-b3d7-ee491b0d49ee admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.287049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6e4f-f36f-4b3f-b60d-7365b1df36f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.287870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6e4f-f36f-4b3f-b60d-7365b1df36f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.288147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6e4f-f36f-4b3f-b60d-7365b1df36f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.288450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6e4f-f36f-4b3f-b60d-7365b1df36f4 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.289878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e6e4f-f36f-4b3f-b60d-7365b1df36f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.291767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e6e4f-f36f-4b3f-b60d-7365b1df36f4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.294345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3565f-5231-48bf-b446-193f32e58f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.295174 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 218/435] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:23.295486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3565f-5231-48bf-b446-193f32e58f09 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.295776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3565f-5231-48bf-b446-193f32e58f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.296048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3565f-5231-48bf-b446-193f32e58f09 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.301066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3565f-5231-48bf-b446-193f32e58f09 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.302200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6e4f-f36f-4b3f-b60d-7365b1df36f4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.302994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3565f-5231-48bf-b446-193f32e58f09 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.304917 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 218/436] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:23.312077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6e4f-f36f-4b3f-b60d-7365b1df36f4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.314155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3565f-5231-48bf-b446-193f32e58f09 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.324495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141a0d0-b714-4c2a-89d5-0ffc82920eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.325655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141a0d0-b714-4c2a-89d5-0ffc82920eee admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.326099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141a0d0-b714-4c2a-89d5-0ffc82920eee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.326578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141a0d0-b714-4c2a-89d5-0ffc82920eee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.327578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141a0d0-b714-4c2a-89d5-0ffc82920eee admin admin] RBAC: Adding query filter params (group.id=2a94e12793fc4bed81c35c89de27d859, role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:23.328072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141a0d0-b714-4c2a-89d5-0ffc82920eee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.328184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3565f-5231-48bf-b446-193f32e58f09 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.331465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141a0d0-b714-4c2a-89d5-0ffc82920eee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.333666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab0768-d708-48e7-8d8d-68ad5911daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.334675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab0768-d708-48e7-8d8d-68ad5911daa8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.335053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab0768-d708-48e7-8d8d-68ad5911daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.335474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab0768-d708-48e7-8d8d-68ad5911daa8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.339015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab0768-d708-48e7-8d8d-68ad5911daa8 admin admin] RBAC: Adding query filter params (group.id=2a94e12793fc4bed81c35c89de27d859, role.id=ee0b0a89e5e9450e8a292e5c29635e9c, scope.project.id=c8f2f4af38ad45168a360caf81aa0542) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:23.339015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab0768-d708-48e7-8d8d-68ad5911daa8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.341249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab0768-d708-48e7-8d8d-68ad5911daa8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.341554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 219/437] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/role_assignments?group.id=2a94e12793fc4bed81c35c89de27d859&scope.project.id=2a486af8aa3c4f399c582c62fa59d1b2&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:23.356591 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 219/438] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/role_assignments?group.id=2a94e12793fc4bed81c35c89de27d859&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=ee0b0a89e5e9450e8a292e5c29635e9c => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:23.631474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d258f-4e48-45ee-81b1-560a5da36a8a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.631955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d258f-4e48-45ee-81b1-560a5da36a8a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.631955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d258f-4e48-45ee-81b1-560a5da36a8a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.634009 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 220/439] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:23.639229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aa9fe-6432-4a1f-bf4f-8bcc8b35cabf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.639650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aa9fe-6432-4a1f-bf4f-8bcc8b35cabf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.639785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aa9fe-6432-4a1f-bf4f-8bcc8b35cabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.659608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9b7aa9fe-6432-4a1f-bf4f-8bcc8b35cabf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:23.660824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9b7aa9fe-6432-4a1f-bf4f-8bcc8b35cabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:23.671646 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 220/440] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:23.697161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d258f-4e48-45ee-81b1-560a5da36a8a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.710704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d258f-4e48-45ee-81b1-560a5da36a8a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.715076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162f004-749f-49c5-aabe-f99bd2e26fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.715853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f004-749f-49c5-aabe-f99bd2e26fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.716137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f004-749f-49c5-aabe-f99bd2e26fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.716522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f004-749f-49c5-aabe-f99bd2e26fd9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.728153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162f004-749f-49c5-aabe-f99bd2e26fd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:23.735366 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-1162f004-749f-49c5-aabe-f99bd2e26fd9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:35:23.736761 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 221/441] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:23.742280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aa9fe-6432-4a1f-bf4f-8bcc8b35cabf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.752022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aa9fe-6432-4a1f-bf4f-8bcc8b35cabf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.756487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.757138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.757419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.757699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.758441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:23.758746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.760321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.769513 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 221/442] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:23.774856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162f004-749f-49c5-aabe-f99bd2e26fd9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.786025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162f004-749f-49c5-aabe-f99bd2e26fd9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.790682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114544e-9c6b-4a63-ad90-d798ba3cf583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.791304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114544e-9c6b-4a63-ad90-d798ba3cf583 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.791586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114544e-9c6b-4a63-ad90-d798ba3cf583 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.791861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114544e-9c6b-4a63-ad90-d798ba3cf583 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.802749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114544e-9c6b-4a63-ad90-d798ba3cf583 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.804523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114544e-9c6b-4a63-ad90-d798ba3cf583 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.814190 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 222/443] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:23.819538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.829957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824bd9-c82c-4f95-883c-67abb6ca4242 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.837415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e2497-9ba8-4793-8a3d-20327faf1444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.838268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2497-9ba8-4793-8a3d-20327faf1444 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.838554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2497-9ba8-4793-8a3d-20327faf1444 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.838834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2497-9ba8-4793-8a3d-20327faf1444 admin admin] PATH_INFO: `/v3/projects/c8f2f4af38ad45168a360caf81aa0542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.840025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e2497-9ba8-4793-8a3d-20327faf1444 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8f2f4af38ad45168a360caf81aa0542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.842154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e2497-9ba8-4793-8a3d-20327faf1444 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.843819 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 222/444] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/projects/c8f2f4af38ad45168a360caf81aa0542 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:23.849408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114544e-9c6b-4a63-ad90-d798ba3cf583 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.858494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114544e-9c6b-4a63-ad90-d798ba3cf583 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.862958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d564f6-5b84-4ed0-90fb-b70dc50bce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.863782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d564f6-5b84-4ed0-90fb-b70dc50bce39 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.864059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d564f6-5b84-4ed0-90fb-b70dc50bce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.864353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d564f6-5b84-4ed0-90fb-b70dc50bce39 admin admin] PATH_INFO: `/v3/groups/2a94e12793fc4bed81c35c89de27d859` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.865523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d564f6-5b84-4ed0-90fb-b70dc50bce39 admin admin] RBAC: Authorizing `identity:get_group(group_id=2a94e12793fc4bed81c35c89de27d859)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.867448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d564f6-5b84-4ed0-90fb-b70dc50bce39 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.869157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 223/445] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/groups/2a94e12793fc4bed81c35c89de27d859 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:23.876755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e2497-9ba8-4793-8a3d-20327faf1444 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:23.886527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e2497-9ba8-4793-8a3d-20327faf1444 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:23.890818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81667f63-7bfb-4a78-839f-897f6e3f4765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:23.892023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f63-7bfb-4a78-839f-897f6e3f4765 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:23.892305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f63-7bfb-4a78-839f-897f6e3f4765 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:23.892611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f63-7bfb-4a78-839f-897f6e3f4765 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:23.893437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81667f63-7bfb-4a78-839f-897f6e3f4765 admin admin] RBAC: Adding query filter params (group.id=2a94e12793fc4bed81c35c89de27d859, role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=c8f2f4af38ad45168a360caf81aa0542) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:23.893746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81667f63-7bfb-4a78-839f-897f6e3f4765 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:23.895574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81667f63-7bfb-4a78-839f-897f6e3f4765 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:23.901897 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 223/446] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:23 2022] GET /identity/v3/role_assignments?group.id=2a94e12793fc4bed81c35c89de27d859&scope.project.id=c8f2f4af38ad45168a360caf81aa0542&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:24.753517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a17a-764d-4539-bdf8-fb498a5d9fd5 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:24.754025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a17a-764d-4539-bdf8-fb498a5d9fd5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:24.754025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a17a-764d-4539-bdf8-fb498a5d9fd5 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:24.755825 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 224/447] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:24.760743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2226-8dfc-4bc9-9b4c-d2051ac0db35 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:24.761153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2226-8dfc-4bc9-9b4c-d2051ac0db35 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:24.761297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2226-8dfc-4bc9-9b4c-d2051ac0db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:24.778595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-145d2226-8dfc-4bc9-9b4c-d2051ac0db35 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:24.779755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-145d2226-8dfc-4bc9-9b4c-d2051ac0db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:24.787677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 224/448] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:24.812030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44a17a-764d-4539-bdf8-fb498a5d9fd5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:24.824111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44a17a-764d-4539-bdf8-fb498a5d9fd5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:24.828262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae31ac-80c4-4c90-aecd-1d4e5713ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:24.829617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae31ac-80c4-4c90-aecd-1d4e5713ffce admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:24.829892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae31ac-80c4-4c90-aecd-1d4e5713ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:24.830165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae31ac-80c4-4c90-aecd-1d4e5713ffce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:24.839893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae31ac-80c4-4c90-aecd-1d4e5713ffce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:24.846499 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-04ae31ac-80c4-4c90-aecd-1d4e5713ffce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:24.847600 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 225/449] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:24.852728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2226-8dfc-4bc9-9b4c-d2051ac0db35 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:24.861319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2226-8dfc-4bc9-9b4c-d2051ac0db35 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:24.865614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:24.866246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:24.866527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:24.866797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:24.867531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:24.867834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:24.869448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:24.877901 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 225/450] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:24.882634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae31ac-80c4-4c90-aecd-1d4e5713ffce admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:24.892369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae31ac-80c4-4c90-aecd-1d4e5713ffce admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:24.896597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160ba9-7512-401c-9dd7-5c06139c99fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:24.897193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160ba9-7512-401c-9dd7-5c06139c99fb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:24.897472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160ba9-7512-401c-9dd7-5c06139c99fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:24.897740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160ba9-7512-401c-9dd7-5c06139c99fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:24.905657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160ba9-7512-401c-9dd7-5c06139c99fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:24.907406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160ba9-7512-401c-9dd7-5c06139c99fb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:24.916097 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 226/451] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:24.921052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:24.930620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed0510-3f33-486e-a6b9-3e5d8fbba457 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:24.934911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d9f2-287e-46ae-90d9-edc38e8bd288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:24.935743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d9f2-287e-46ae-90d9-edc38e8bd288 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:24.936029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d9f2-287e-46ae-90d9-edc38e8bd288 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:24.936301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d9f2-287e-46ae-90d9-edc38e8bd288 admin admin] PATH_INFO: `/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:24.937480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177d9f2-287e-46ae-90d9-edc38e8bd288 admin admin] RBAC: Authorizing `identity:get_project(project_id=8848562c8fea4a5fbbab0bbfcc0a45f0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:24.939816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177d9f2-287e-46ae-90d9-edc38e8bd288 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:24.941445 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 226/452] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:35:24 2022] GET /identity/v3/projects/8848562c8fea4a5fbbab0bbfcc0a45f0 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:24.946286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160ba9-7512-401c-9dd7-5c06139c99fb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:24.954763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160ba9-7512-401c-9dd7-5c06139c99fb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:24.958969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfe4ed-1e88-48d5-9935-44e902ceef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:24.959749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfe4ed-1e88-48d5-9935-44e902ceef86 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:24.960020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfe4ed-1e88-48d5-9935-44e902ceef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:24.960287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfe4ed-1e88-48d5-9935-44e902ceef86 admin admin] PATH_INFO: `/v3/groups/5355456335954edbbf44aa60cd460d44` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:24.961447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfe4ed-1e88-48d5-9935-44e902ceef86 admin admin] RBAC: Authorizing `identity:get_group(group_id=5355456335954edbbf44aa60cd460d44)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:24.963252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfe4ed-1e88-48d5-9935-44e902ceef86 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:24.964827 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 227/453] 10.222.0.30 () {56 vars in 1201 bytes} [Sat Feb 19 20:35:24 2022] GET /identity/v3/groups/5355456335954edbbf44aa60cd460d44 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:24.971141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d9f2-287e-46ae-90d9-edc38e8bd288 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:24.980189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d9f2-287e-46ae-90d9-edc38e8bd288 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:24.984406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a466-4257-4a6f-a737-9b8b32a85a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:24.985497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a466-4257-4a6f-a737-9b8b32a85a03 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:24.985771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a466-4257-4a6f-a737-9b8b32a85a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:24.986040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a466-4257-4a6f-a737-9b8b32a85a03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:24.986836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04a466-4257-4a6f-a737-9b8b32a85a03 admin admin] RBAC: Adding query filter params (group.id=5355456335954edbbf44aa60cd460d44, role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=8848562c8fea4a5fbbab0bbfcc0a45f0) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:24.987138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04a466-4257-4a6f-a737-9b8b32a85a03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:24.988941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04a466-4257-4a6f-a737-9b8b32a85a03 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:24.994439 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 227/454] 10.222.0.30 () {56 vars in 1397 bytes} [Sat Feb 19 20:35:24 2022] GET /identity/v3/role_assignments?group.id=5355456335954edbbf44aa60cd460d44&scope.project.id=8848562c8fea4a5fbbab0bbfcc0a45f0&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:27.985763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08930f-c929-4bcd-9696-b0bcd0adbac8 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:27.986684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08930f-c929-4bcd-9696-b0bcd0adbac8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:27.987113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08930f-c929-4bcd-9696-b0bcd0adbac8 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:27.989257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 228/455] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:27.995370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11f989-cc31-4879-b47f-90083c93de41 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:27.996292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11f989-cc31-4879-b47f-90083c93de41 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:27.996771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11f989-cc31-4879-b47f-90083c93de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.025380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5e11f989-cc31-4879-b47f-90083c93de41 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:28.026830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e11f989-cc31-4879-b47f-90083c93de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:28.035459 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 228/456] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:28.079729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08930f-c929-4bcd-9696-b0bcd0adbac8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.097524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08930f-c929-4bcd-9696-b0bcd0adbac8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.102186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.103124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.103551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.103991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.115435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.121494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.143263 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:28.144717 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 229/457] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:28.150451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11f989-cc31-4879-b47f-90083c93de41 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.165565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11f989-cc31-4879-b47f-90083c93de41 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.176681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362182-521b-47ff-ad2c-184ddf044e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.177334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362182-521b-47ff-ad2c-184ddf044e87 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.177612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362182-521b-47ff-ad2c-184ddf044e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.177882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362182-521b-47ff-ad2c-184ddf044e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.178598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f362182-521b-47ff-ad2c-184ddf044e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:28.178896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f362182-521b-47ff-ad2c-184ddf044e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.181731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f362182-521b-47ff-ad2c-184ddf044e87 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.197437 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 229/458] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:28.204024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.214168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42203ee-8815-4f4c-ab76-a28080ceedc2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.223362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b993-2688-4976-afb3-dde2aba254d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.224024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b993-2688-4976-afb3-dde2aba254d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.224304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b993-2688-4976-afb3-dde2aba254d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.224611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b993-2688-4976-afb3-dde2aba254d9 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.225321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b993-2688-4976-afb3-dde2aba254d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.227247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b993-2688-4976-afb3-dde2aba254d9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.230526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00383e06-67ff-4225-9511-e05f4d0ec30f None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.230814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00383e06-67ff-4225-9511-e05f4d0ec30f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.231088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00383e06-67ff-4225-9511-e05f4d0ec30f None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.233184 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 230/459] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:28.239005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b25d8e-eab7-4e0a-a201-89497e7e6afc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.239230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b25d8e-eab7-4e0a-a201-89497e7e6afc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.239504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b25d8e-eab7-4e0a-a201-89497e7e6afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.260346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d4b25d8e-eab7-4e0a-a201-89497e7e6afc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:28.261561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4b25d8e-eab7-4e0a-a201-89497e7e6afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:28.270074 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 230/460] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:28 2022] POST /identity/v3/users => generated 248 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:28.283454 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 231/461] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:28.327716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b993-2688-4976-afb3-dde2aba254d9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.341652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b993-2688-4976-afb3-dde2aba254d9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.350646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.351453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.351735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.352009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.369217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.371066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.385460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66c0c-5679-4538-8a71-1cac6bd92ac7 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.385908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66c0c-5679-4538-8a71-1cac6bd92ac7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.386287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66c0c-5679-4538-8a71-1cac6bd92ac7 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.388538 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 232/462] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:28.391663 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:28.393326 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 231/463] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:28.393678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd8df7-e7a7-4b30-bf6a-8ca3a6984189 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.394091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd8df7-e7a7-4b30-bf6a-8ca3a6984189 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.394438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd8df7-e7a7-4b30-bf6a-8ca3a6984189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.398528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.409167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acd1cb-3c7d-4dcc-a11c-010658592cfa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.413848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.414523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.415060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.415338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.416074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:28.416411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.417462 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:28.417462 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:28.417462 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:28.418538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.425086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aabd8df7-e7a7-4b30-bf6a-8ca3a6984189 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:28.427795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aabd8df7-e7a7-4b30-bf6a-8ca3a6984189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:28.443148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 232/464] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:28.447568 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 233/465] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:28.450559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.460631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd5320-dea6-457a-b8f0-ed5db838d91f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.473363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae5a3e-1edd-4d5b-8390-569ecd4bed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.474391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5a3e-1edd-4d5b-8390-569ecd4bed31 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.474863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5a3e-1edd-4d5b-8390-569ecd4bed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.475308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5a3e-1edd-4d5b-8390-569ecd4bed31 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.476196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5a3e-1edd-4d5b-8390-569ecd4bed31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.478329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5a3e-1edd-4d5b-8390-569ecd4bed31 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.487001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb6fd8-ac56-4b38-8d48-420c5c1ae564 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.487337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb6fd8-ac56-4b38-8d48-420c5c1ae564 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.487597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb6fd8-ac56-4b38-8d48-420c5c1ae564 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.489615 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 234/466] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:28.490199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb6fd8-ac56-4b38-8d48-420c5c1ae564 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.505254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb6fd8-ac56-4b38-8d48-420c5c1ae564 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.510246 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 233/467] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:28 2022] POST /identity/v3/users => generated 246 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:28.510523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.511427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.511533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783d4b6-2c3e-4461-93ce-ae60212023a6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.511714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.511899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783d4b6-2c3e-4461-93ce-ae60212023a6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.511974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.512128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783d4b6-2c3e-4461-93ce-ae60212023a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.530829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.533286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.534377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9783d4b6-2c3e-4461-93ce-ae60212023a6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:28.535874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9783d4b6-2c3e-4461-93ce-ae60212023a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:28.546756 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 234/468] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:28.556780 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:28.558380 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 235/469] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:28.565372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783d4b6-2c3e-4461-93ce-ae60212023a6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.575741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783d4b6-2c3e-4461-93ce-ae60212023a6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.576540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.581170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.581850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.582133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.582410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.583151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:28.583460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.585391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.589259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d8a4-dfc0-4133-b9ef-390f89709a21 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.598599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.599359 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 235/470] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:28.599694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.600113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.600452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.608959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.615037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.618087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.620975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f90ae-1d39-4b29-9689-79755cb77d3f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.626638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77c0a3-b140-4808-8a1c-a9fcf297b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.627676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77c0a3-b140-4808-8a1c-a9fcf297b029 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.628162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77c0a3-b140-4808-8a1c-a9fcf297b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.628700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77c0a3-b140-4808-8a1c-a9fcf297b029 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.629625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77c0a3-b140-4808-8a1c-a9fcf297b029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.631853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77c0a3-b140-4808-8a1c-a9fcf297b029 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.639291 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:28.641450 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 236/471] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:28.649570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.659939 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 236/472] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:28 2022] POST /identity/v3/users => generated 249 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:28.661641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1550652-0584-4ea6-babe-0127ed24203c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.678161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd96caa-5aaf-4019-b7dc-28c8fbdbfb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.678846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd96caa-5aaf-4019-b7dc-28c8fbdbfb96 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.679126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd96caa-5aaf-4019-b7dc-28c8fbdbfb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.679402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd96caa-5aaf-4019-b7dc-28c8fbdbfb96 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.680204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd96caa-5aaf-4019-b7dc-28c8fbdbfb96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:28.680494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd96caa-5aaf-4019-b7dc-28c8fbdbfb96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.682191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd96caa-5aaf-4019-b7dc-28c8fbdbfb96 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.704080 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 237/473] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:28.712793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77c0a3-b140-4808-8a1c-a9fcf297b029 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:28.725112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77c0a3-b140-4808-8a1c-a9fcf297b029 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:28.732573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff475d42-6a2e-40dc-859c-db419f62be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:28.733746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff475d42-6a2e-40dc-859c-db419f62be7a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:28.734255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff475d42-6a2e-40dc-859c-db419f62be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:28.734803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff475d42-6a2e-40dc-859c-db419f62be7a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:28.735806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff475d42-6a2e-40dc-859c-db419f62be7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:28.738557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff475d42-6a2e-40dc-859c-db419f62be7a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:28.764282 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 237/474] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:28 2022] POST /identity/v3/users => generated 248 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:29.363799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3eee-e0db-496b-8b50-a2f2f3bcb25d None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:29.364359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3eee-e0db-496b-8b50-a2f2f3bcb25d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:29.364359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3eee-e0db-496b-8b50-a2f2f3bcb25d None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:29.366289 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 238/475] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:29.371645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe900-6420-498d-b5f1-a96666fba9e7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:29.372053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe900-6420-498d-b5f1-a96666fba9e7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:29.372234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe900-6420-498d-b5f1-a96666fba9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:29.395551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-400fe900-6420-498d-b5f1-a96666fba9e7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:29.396782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-400fe900-6420-498d-b5f1-a96666fba9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:29.407715 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 238/476] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:29.457738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d3eee-e0db-496b-8b50-a2f2f3bcb25d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:29.473893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d3eee-e0db-496b-8b50-a2f2f3bcb25d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:29.478576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:29.479227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:29.479503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:29.479777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:29.480540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:29.482127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:29.502221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.sql.core [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 19 20:35:29.502221 ncdv-master-1 devstack@keystone.service[96910]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 19 20:35:29.502221 ncdv-master-1 devstack@keystone.service[96910]: [parameters: {'id': '745152f0d0ae433c813637f69650247b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 19 20:35:29.502221 ncdv-master-1 devstack@keystone.service[96910]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96910) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 19 20:35:29.517580 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 19 20:35:29.519257 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 239/477] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:35:29 2022] POST /identity/v3/roles => generated 144 bytes in 62 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:29.524927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe900-6420-498d-b5f1-a96666fba9e7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:29.537334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe900-6420-498d-b5f1-a96666fba9e7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:29.548639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef4699-95f9-432f-914c-6ac5337180fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:29.549452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4699-95f9-432f-914c-6ac5337180fa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:29.549733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4699-95f9-432f-914c-6ac5337180fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:29.550012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4699-95f9-432f-914c-6ac5337180fa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:29.569261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef4699-95f9-432f-914c-6ac5337180fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:29.576548 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-43ef4699-95f9-432f-914c-6ac5337180fa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 19 20:35:29.578091 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 239/478] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:29.584238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:29.596538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b885488-12ea-416a-b95a-7be48bff3a24 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:29.607864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762c6e2-91f5-4e82-a91c-8fbd525c2beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:29.608897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762c6e2-91f5-4e82-a91c-8fbd525c2beb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:29.609185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762c6e2-91f5-4e82-a91c-8fbd525c2beb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:29.609460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762c6e2-91f5-4e82-a91c-8fbd525c2beb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:29.610994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762c6e2-91f5-4e82-a91c-8fbd525c2beb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:29.611299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762c6e2-91f5-4e82-a91c-8fbd525c2beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:29.612960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762c6e2-91f5-4e82-a91c-8fbd525c2beb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:29.629965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 240/479] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:31.444714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307764f-3ffe-492f-8564-d0af579491dc None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.445473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307764f-3ffe-492f-8564-d0af579491dc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.445632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307764f-3ffe-492f-8564-d0af579491dc None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.447834 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 240/480] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:31.461943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae8e6-bafd-4368-a728-a58e40cdafee None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.462432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae8e6-bafd-4368-a728-a58e40cdafee None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.462506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae8e6-bafd-4368-a728-a58e40cdafee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.493525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-143ae8e6-bafd-4368-a728-a58e40cdafee None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:31.494737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-143ae8e6-bafd-4368-a728-a58e40cdafee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:31.506569 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 241/481] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:31.552474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307764f-3ffe-492f-8564-d0af579491dc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.570905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307764f-3ffe-492f-8564-d0af579491dc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.576500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b86c-84be-4573-9f64-a4906ab6728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.577300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b86c-84be-4573-9f64-a4906ab6728d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.577573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b86c-84be-4573-9f64-a4906ab6728d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.577841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b86c-84be-4573-9f64-a4906ab6728d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.593759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0b86c-84be-4573-9f64-a4906ab6728d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:31.600713 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-0ad0b86c-84be-4573-9f64-a4906ab6728d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:31.601966 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 241/482] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:31.607837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae8e6-bafd-4368-a728-a58e40cdafee None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.617003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae8e6-bafd-4368-a728-a58e40cdafee None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.624373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.625035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.625853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.626129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.626870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:31.627170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.628795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.638025 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 242/483] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:31.638263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff8e7-4417-4369-8f33-c76dcdac1e36 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.638560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff8e7-4417-4369-8f33-c76dcdac1e36 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.638850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff8e7-4417-4369-8f33-c76dcdac1e36 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.642286 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 242/484] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:31.643544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.646925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465ed1-37ad-4572-959d-a41f51318d60 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.647215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465ed1-37ad-4572-959d-a41f51318d60 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.647500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465ed1-37ad-4572-959d-a41f51318d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.653390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf703-8c85-47b0-b82f-1d11248c4292 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.662343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098207b0-ffb3-4758-81bb-684c55f44f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.663135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098207b0-ffb3-4758-81bb-684c55f44f11 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.663417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098207b0-ffb3-4758-81bb-684c55f44f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.663690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098207b0-ffb3-4758-81bb-684c55f44f11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.669671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6b465ed1-37ad-4572-959d-a41f51318d60 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:31.670953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6b465ed1-37ad-4572-959d-a41f51318d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:31.677530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098207b0-ffb3-4758-81bb-684c55f44f11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.680056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098207b0-ffb3-4758-81bb-684c55f44f11 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.684437 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 243/485] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:31.685971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f5512-3129-4e02-aa9c-09b2cd26b4c8 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.686261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f5512-3129-4e02-aa9c-09b2cd26b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.686540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f5512-3129-4e02-aa9c-09b2cd26b4c8 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.701376 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 244/486] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:31.701726 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-098207b0-ffb3-4758-81bb-684c55f44f11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:31.704665 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 243/487] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:31.705371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f5512-3129-4e02-aa9c-09b2cd26b4c8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.709774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59435-82b4-4c99-b14c-d164f0ff2657 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.710063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59435-82b4-4c99-b14c-d164f0ff2657 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.710347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59435-82b4-4c99-b14c-d164f0ff2657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.729050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f5512-3129-4e02-aa9c-09b2cd26b4c8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.730230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-82d59435-82b4-4c99-b14c-d164f0ff2657 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:31.731430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-82d59435-82b4-4c99-b14c-d164f0ff2657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:31.735653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.736304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.736627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.736902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.737629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:31.737982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.739539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.740303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 244/488] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:31.744470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59435-82b4-4c99-b14c-d164f0ff2657 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.761133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59435-82b4-4c99-b14c-d164f0ff2657 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.765011 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 245/489] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:31.768963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed335d2d-41e5-47bd-a18d-4cfa1f1f866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.770609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.771407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335d2d-41e5-47bd-a18d-4cfa1f1f866b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.776124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335d2d-41e5-47bd-a18d-4cfa1f1f866b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.776451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed335d2d-41e5-47bd-a18d-4cfa1f1f866b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.783211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890df309-9609-45cb-ac28-99918f40257b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.789348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.790599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.791095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.791817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.792037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed335d2d-41e5-47bd-a18d-4cfa1f1f866b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:31.799952 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-ed335d2d-41e5-47bd-a18d-4cfa1f1f866b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:31.801318 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 245/490] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:31.802969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.805234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.806603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed335d2d-41e5-47bd-a18d-4cfa1f1f866b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.817359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed335d2d-41e5-47bd-a18d-4cfa1f1f866b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.821721 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 19 20:35:31.822007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f305-9c4e-49e5-a718-f27dbee1f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.822770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f305-9c4e-49e5-a718-f27dbee1f446 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.823149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f305-9c4e-49e5-a718-f27dbee1f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.823428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f305-9c4e-49e5-a718-f27dbee1f446 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.824670 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 246/491] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:31.829569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.840779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6996ca-9f7f-45ae-ad33-61ccd713f6a7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.842983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1f305-9c4e-49e5-a718-f27dbee1f446 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:31.845713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.846578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.847008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.847474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.848378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:31.848893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.850728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.851551 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-57c1f305-9c4e-49e5-a718-f27dbee1f446 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:31.853081 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 246/492] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:31.856887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f305-9c4e-49e5-a718-f27dbee1f446 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.869447 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 247/493] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:31.869875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f305-9c4e-49e5-a718-f27dbee1f446 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.870642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.875004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.876693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.877091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.877544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.879081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:31.879514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.880960 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:31.880960 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:31.880960 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:31.882295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.882465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595afb-dd61-46a3-877a-d0d51a8d4705 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.887314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.888253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.888755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.889237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.890148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:31.890712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.893186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.903111 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 248/494] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:31.904212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.917706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15a0c-378d-4f6f-a60a-432f8ac02d24 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.923672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.924779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.925236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.925730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.932426 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 247/495] 10.222.0.30 () {56 vars in 1158 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:31.937200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.941416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.943244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.955269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1fbd-738a-4ff8-aa17-7a5a1a8a971a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.961280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.962330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.962881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.963401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.967028 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:31.968215 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 249/496] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:31.974389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:31.976303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:31.978467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:31.984434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc09ba5-1ecc-4ad4-9e3f-032c8bd02ad5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:31.989353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed92e54-b7f0-4632-b46c-81d46f7f2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:31.990000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed92e54-b7f0-4632-b46c-81d46f7f2c3d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:31.990281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed92e54-b7f0-4632-b46c-81d46f7f2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:31.990555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed92e54-b7f0-4632-b46c-81d46f7f2c3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:31.998801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed92e54-b7f0-4632-b46c-81d46f7f2c3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.001141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed92e54-b7f0-4632-b46c-81d46f7f2c3d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.004488 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:32.006108 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 248/497] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.006688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.013853 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 250/498] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:32.018137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65b78-8638-4826-a2a8-7b44cb483cf3 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.018137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65b78-8638-4826-a2a8-7b44cb483cf3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.018137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65b78-8638-4826-a2a8-7b44cb483cf3 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.018137 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 251/499] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:32.019173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65b78-8638-4826-a2a8-7b44cb483cf3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.021933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73167736-62c4-405f-ab76-3971fff6cbba admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.026823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.027691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.028182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.028640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.029418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.029728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.031982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.032231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65b78-8638-4826-a2a8-7b44cb483cf3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.036585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d874a-38f8-4416-8955-266d5e8d0192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.037217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d874a-38f8-4416-8955-266d5e8d0192 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.037498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d874a-38f8-4416-8955-266d5e8d0192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.037773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d874a-38f8-4416-8955-266d5e8d0192 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.038476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d874a-38f8-4416-8955-266d5e8d0192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.038786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d874a-38f8-4416-8955-266d5e8d0192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.040619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d874a-38f8-4416-8955-266d5e8d0192 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.050752 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 249/500] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.050752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.053069 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 252/501] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.057712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d7521-5705-4917-9fa0-7c0d2ac4502a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.058001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d7521-5705-4917-9fa0-7c0d2ac4502a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.058547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d7521-5705-4917-9fa0-7c0d2ac4502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.060368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5e4a7-7ec0-41aa-a345-143841350446 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.064737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.065506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.065786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.066066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.076996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.077993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-727d7521-5705-4917-9fa0-7c0d2ac4502a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:32.079004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.079187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-727d7521-5705-4917-9fa0-7c0d2ac4502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:32.087191 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 253/502] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:32.096686 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:32.097111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d7521-5705-4917-9fa0-7c0d2ac4502a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.102282 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 250/503] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.102282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.112192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e8fcd-3588-4f01-a2c7-0d90e32abfad admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.114290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d7521-5705-4917-9fa0-7c0d2ac4502a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.117019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.117754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.118039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.118315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.120762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.122193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.122621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.123040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.126571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.128270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.131970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.134441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.141425 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:35:32.142578 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 251/504] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.144767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.149284 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 19 20:35:32.150494 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 254/505] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.151247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.157286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90fc3-1c1b-47b3-8c94-c8a222d398c6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.161599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542899-f6b0-4984-80f0-917af1b29e83 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.161732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.162300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.162587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.162867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.163972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.163972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.165736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.167396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6193b4f-0b76-4955-ab05-ac4f0f245abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.168696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6193b4f-0b76-4955-ab05-ac4f0f245abc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.168696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6193b4f-0b76-4955-ab05-ac4f0f245abc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.168882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6193b4f-0b76-4955-ab05-ac4f0f245abc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.181263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6193b4f-0b76-4955-ab05-ac4f0f245abc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:32.185824 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 252/506] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.185824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.188635 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-c6193b4f-0b76-4955-ab05-ac4f0f245abc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:32.190096 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 255/507] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.194110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6193b4f-0b76-4955-ab05-ac4f0f245abc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.196389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a11926-db13-4cf7-ad91-7f532bd2df4a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.201126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.201387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.201673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.201947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.202789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.203098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.205002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.206758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6193b4f-0b76-4955-ab05-ac4f0f245abc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.212421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.213423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.214670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.215149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.216170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.216688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.217873 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:32.217873 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:32.217873 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:32.220355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.223030 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 253/508] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.223603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.237152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50f3d-1926-4fab-8887-dfb531291ef1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.241515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.242285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.242566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.242839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.249626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.252018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.260892 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 256/509] 10.222.0.30 () {56 vars in 1160 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.261932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.265198 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:32.266582 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 254/510] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.267278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.277747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db70eb-0c75-45d2-8543-07beac0329d3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.279080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c4704-0fd5-4aa0-9bbc-4ac7df49f70c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.283328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d85eb-80b1-4855-9a24-554c1af249c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.283992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.284444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d85eb-80b1-4855-9a24-554c1af249c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.284670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.284953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.285231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.285521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d85eb-80b1-4855-9a24-554c1af249c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.285976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.286168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d85eb-80b1-4855-9a24-554c1af249c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.286262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.287907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.294754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d85eb-80b1-4855-9a24-554c1af249c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.296517 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 257/511] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.296942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d85eb-80b1-4855-9a24-554c1af249c6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.297844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.306899 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 255/512] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:32.307918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d85eb-80b1-4855-9a24-554c1af249c6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.313907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc0ad-46c3-40a1-8fc5-66e49a2b163f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.316660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d85eb-80b1-4855-9a24-554c1af249c6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.318311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5a652-7df8-4be7-ae42-dd6628f4dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.318929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a652-7df8-4be7-ae42-dd6628f4dadd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.319212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a652-7df8-4be7-ae42-dd6628f4dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.319490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a652-7df8-4be7-ae42-dd6628f4dadd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.321223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.321882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.322213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.322487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.323311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.323616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.324685 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:32.324685 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:32.324685 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:32.325887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.327343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5a652-7df8-4be7-ae42-dd6628f4dadd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.329167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5a652-7df8-4be7-ae42-dd6628f4dadd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.338240 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 258/513] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:32.338811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5a652-7df8-4be7-ae42-dd6628f4dadd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.347058 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 256/514] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.348248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.352645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5a652-7df8-4be7-ae42-dd6628f4dadd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.357648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.357853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6af09-da49-4e2e-a736-3835c136e5d7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.358430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.358710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.359087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.364955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.365803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.366167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.366911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.370508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.372367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.378018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.379855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.389221 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:32.390226 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 259/515] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.391518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.401753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced9c44-635e-4c68-853f-75a64cfeb790 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.404430 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:32.405852 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 257/516] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.410986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.411195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.411195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.411195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.411195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.423622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.423947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a2524-e251-4543-8e7e-2a3946cb0e72 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.425531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.429150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.429806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.430089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.430364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.431199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=f02b510f78c341c29320f011ef4beaca) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.431511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.434246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.447990 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 258/517] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/role_assignments?user.id=f02b510f78c341c29320f011ef4beaca&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.447990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.448216 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:32.448216 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 260/518] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.448216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.455766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd14ad-1f0f-422d-9fcb-ed36a1920e90 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.460692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.460865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3f96f-f489-4df2-b467-454cee21f337 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.461331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.461622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.461903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.462641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.463023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.464801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.466336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.467783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.469016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.469965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.470899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.471364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.473212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.480600 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 261/519] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.481632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.489123 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 259/520] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.490935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.493854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c8f2-8cea-4a12-8848-5aa40cade358 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.498804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.499648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.499996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.500419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.501281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.501703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.503525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.503947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe416d-4bcc-4f69-b8dd-98fcf95c3a18 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.509755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.510854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.511917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.512420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.517952 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 262/521] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.519067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.522444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.525010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.529378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31976990-2f85-4527-a6cb-88dc3a92751c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.534782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.535707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.536067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.536479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.544947 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:32.546662 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 260/522] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.547690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.550599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.553036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.558067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa660314-01cd-4dbe-bd7e-23295114f0e9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.563008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.563992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.564364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.564804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.569868 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 19 20:35:32.571705 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 263/523] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.572693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.573080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.575299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.583823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e547a-6ea0-4abf-af65-dd9e54ef88a3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.589108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.590127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.590585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.591051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.591899 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:32.592241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.592897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.593754 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 261/524] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.595214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.595481 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:32.595481 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:32.595481 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:32.597000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.607293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294857-0b0d-484a-8068-aa4c09f662f3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.612787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.613574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.614002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.614419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.615962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.616586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.618591 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 264/525] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.618741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.619878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.629848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ca355-fb8b-44b8-8a1d-3133a4bb38c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.634667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.635587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.635868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.636148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.636983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.637298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.639220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.641913 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 262/526] 10.222.0.30 () {56 vars in 1158 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.643653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.654654 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 265/527] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.655002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404dcfe-b5c2-4662-8db3-2a506120fcf3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.656161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.660237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.661186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.661477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.661766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.662614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=a20eaaff207f4d1b870c6abf0a50f1c8) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.662930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.665633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.669714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f72fa-c126-4906-a677-791e29b5c4be admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.671613 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 263/528] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/role_assignments?user.id=a20eaaff207f4d1b870c6abf0a50f1c8&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.673016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.675983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa48f18-be33-450c-9938-9a6342a74fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.676943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa48f18-be33-450c-9938-9a6342a74fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.677434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa48f18-be33-450c-9938-9a6342a74fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.677911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa48f18-be33-450c-9938-9a6342a74fd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.684049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434ea8-3d04-4cf3-a358-26e618dd0d63 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.687508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa48f18-be33-450c-9938-9a6342a74fd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.689808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.690311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa48f18-be33-450c-9938-9a6342a74fd1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.691008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.691501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.691927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.693233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=700225331647423aa8bc458f1ac82fac) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.693722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.695972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.701891 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 266/529] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:32.706074 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 264/530] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/role_assignments?user.id=700225331647423aa8bc458f1ac82fac&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.719327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa48f18-be33-450c-9938-9a6342a74fd1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.735722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa48f18-be33-450c-9938-9a6342a74fd1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.745327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe526c8-cc14-454c-ad3d-adffaca74e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.746573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe526c8-cc14-454c-ad3d-adffaca74e5d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.747110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe526c8-cc14-454c-ad3d-adffaca74e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.747631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe526c8-cc14-454c-ad3d-adffaca74e5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.764189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe526c8-cc14-454c-ad3d-adffaca74e5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.767705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe526c8-cc14-454c-ad3d-adffaca74e5d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.794751 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-abe526c8-cc14-454c-ad3d-adffaca74e5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:32.796775 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 267/531] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.803072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.810460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c40b1d-d60f-441b-8c01-d128e21b2b33 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.812242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c40b1d-d60f-441b-8c01-d128e21b2b33 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.813954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c40b1d-d60f-441b-8c01-d128e21b2b33 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.816038 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 268/532] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:32.820628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adcf9a-34c1-49d4-b606-145a50d0995f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.824436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8cb40-2145-4358-9e74-1665e61c0c27 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.824436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8cb40-2145-4358-9e74-1665e61c0c27 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.824436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8cb40-2145-4358-9e74-1665e61c0c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.839652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.840643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.843779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.845036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.847172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.848471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.853006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.867611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4cd8cb40-2145-4358-9e74-1665e61c0c27 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:32.869193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4cd8cb40-2145-4358-9e74-1665e61c0c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:32.880668 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 265/533] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:32.884186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.886195 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 269/534] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:32.902720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dccdd1-5f94-459e-b593-f4e9caab8b62 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.908641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.909765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.910256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.910736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.913198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8cb40-2145-4358-9e74-1665e61c0c27 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.921168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.923693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.923900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8cb40-2145-4358-9e74-1665e61c0c27 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.928935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.930563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.930840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.931110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.941090 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:32.942640 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 266/535] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:32.947564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.947564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:32.948445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.967721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bc6b-130f-40a3-96da-77512aefea91 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:32.974563 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:32.976129 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 270/536] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:32.981881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:32.985057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:32.985732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:32.986000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:32.986277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:32.987069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:32.987378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:32.989251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:33.001076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2e3ba-1e25-421a-97d5-e7dca51eac61 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:33.011660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:33.012801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:33.013803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:33.014288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:33.020442 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 267/537] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:33.020843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:33.021373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:33.023295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:33.026883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:33.039275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ab44b-db28-475b-a373-daa293dbfd82 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:33.044429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eca1f-b530-4750-b95f-0feb45f96ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:33.045332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eca1f-b530-4750-b95f-0feb45f96ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:33.045842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eca1f-b530-4750-b95f-0feb45f96ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:33.046314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eca1f-b530-4750-b95f-0feb45f96ee4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:33.047376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eca1f-b530-4750-b95f-0feb45f96ee4 admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=9398233d060c43048d49d758695153a3) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:33.048010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eca1f-b530-4750-b95f-0feb45f96ee4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:33.050068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eca1f-b530-4750-b95f-0feb45f96ee4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:33.054716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 271/538] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:33.061302 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 268/539] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:33 2022] GET /identity/v3/role_assignments?user.id=9398233d060c43048d49d758695153a3&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:33.071410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:33.092242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1a75a-0c2a-4eff-b46d-8bafb5a6cea9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:33.121146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb66563-f3ac-4fa3-a114-02a841993c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:33.121843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb66563-f3ac-4fa3-a114-02a841993c5e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:33.122123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb66563-f3ac-4fa3-a114-02a841993c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:33.122400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb66563-f3ac-4fa3-a114-02a841993c5e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:33.123122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb66563-f3ac-4fa3-a114-02a841993c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:33.125719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb66563-f3ac-4fa3-a114-02a841993c5e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:33.161194 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 272/540] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:33 2022] POST /identity/v3/users => generated 247 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:35.392903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d6fe-3e54-41de-91dc-28e90853242a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.393941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d6fe-3e54-41de-91dc-28e90853242a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.394427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d6fe-3e54-41de-91dc-28e90853242a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.396679 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 269/541] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:35.401803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb0bce-c6b8-4ebd-8c89-b81119348132 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.402611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb0bce-c6b8-4ebd-8c89-b81119348132 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.403105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb0bce-c6b8-4ebd-8c89-b81119348132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.425042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eccb0bce-c6b8-4ebd-8c89-b81119348132 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:35.426561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eccb0bce-c6b8-4ebd-8c89-b81119348132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:35.440295 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 273/542] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:35.476648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d6fe-3e54-41de-91dc-28e90853242a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.490604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d6fe-3e54-41de-91dc-28e90853242a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.495707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a5ec9-c52f-41bc-b365-6d220d1fe693 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.496425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091938-e960-47ff-9141-86fc654d0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.496728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a5ec9-c52f-41bc-b365-6d220d1fe693 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.497215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091938-e960-47ff-9141-86fc654d0023 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.497500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091938-e960-47ff-9141-86fc654d0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.497758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a5ec9-c52f-41bc-b365-6d220d1fe693 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.497882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091938-e960-47ff-9141-86fc654d0023 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.502835 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 274/543] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:35.508061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c252d-d92f-4a78-a637-e0af00d6251b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.508373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c252d-d92f-4a78-a637-e0af00d6251b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.508673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c252d-d92f-4a78-a637-e0af00d6251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.523881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091938-e960-47ff-9141-86fc654d0023 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:35.536488 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b4091938-e960-47ff-9141-86fc654d0023 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:35.537734 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 270/544] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:35.544578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091938-e960-47ff-9141-86fc654d0023 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.553352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-615c252d-d92f-4a78-a637-e0af00d6251b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:35.554572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-615c252d-d92f-4a78-a637-e0af00d6251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:35.555130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091938-e960-47ff-9141-86fc654d0023 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.563451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d20da4-f2f9-4f42-8d79-f3497d3dbca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.564155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d20da4-f2f9-4f42-8d79-f3497d3dbca0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.564466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d20da4-f2f9-4f42-8d79-f3497d3dbca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.566008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d20da4-f2f9-4f42-8d79-f3497d3dbca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.566761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d20da4-f2f9-4f42-8d79-f3497d3dbca0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:35.567069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d20da4-f2f9-4f42-8d79-f3497d3dbca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.570465 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 275/545] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:35.571018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d20da4-f2f9-4f42-8d79-f3497d3dbca0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.583896 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 271/546] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:35.586330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c252d-d92f-4a78-a637-e0af00d6251b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.592440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff56b-914a-47a9-9fa9-76e8e597c1a5 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.592730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff56b-914a-47a9-9fa9-76e8e597c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.593009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff56b-914a-47a9-9fa9-76e8e597c1a5 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.595647 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 272/547] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:35.596929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c252d-d92f-4a78-a637-e0af00d6251b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.600552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332663-5eb8-4b01-8c43-c8fb7eb85d31 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.600837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332663-5eb8-4b01-8c43-c8fb7eb85d31 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.601172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332663-5eb8-4b01-8c43-c8fb7eb85d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.601886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.602769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.603051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.603330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.614491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.616347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.622611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b7332663-5eb8-4b01-8c43-c8fb7eb85d31 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:35.623794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b7332663-5eb8-4b01-8c43-c8fb7eb85d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:35.631789 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 273/548] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:35.632582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7332663-5eb8-4b01-8c43-c8fb7eb85d31 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.634297 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:35.635746 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 276/549] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:35.645263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.646390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7332663-5eb8-4b01-8c43-c8fb7eb85d31 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.650876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7ca1c-e5d9-4ac2-8823-aeb0773380cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.651648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7ca1c-e5d9-4ac2-8823-aeb0773380cd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.651930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7ca1c-e5d9-4ac2-8823-aeb0773380cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.652199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7ca1c-e5d9-4ac2-8823-aeb0773380cd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.655305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94076a-86b6-4d58-949f-25a6371c640d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.663978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7ca1c-e5d9-4ac2-8823-aeb0773380cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:35.670800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.671021 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d7a7ca1c-e5d9-4ac2-8823-aeb0773380cd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:35.671860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.672233 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 274/550] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:35.672627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.673002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7ca1c-e5d9-4ac2-8823-aeb0773380cd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.673377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.674429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:35.674948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.676785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.689306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7ca1c-e5d9-4ac2-8823-aeb0773380cd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.691664 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 277/551] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:35.692830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.699251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2286a-88c8-4155-9384-07c7d4634ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.700305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2286a-88c8-4155-9384-07c7d4634ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.700305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2286a-88c8-4155-9384-07c7d4634ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.701609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2286a-88c8-4155-9384-07c7d4634ca8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.713147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e172657-a72a-4d5a-aecd-e21aec52536a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.715036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2286a-88c8-4155-9384-07c7d4634ca8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:35.718497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.719969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.720494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.720997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.721942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:35.722448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.722550 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-c9f2286a-88c8-4155-9384-07c7d4634ca8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:35.723951 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 275/552] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:35.728770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2286a-88c8-4155-9384-07c7d4634ca8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.735386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.744887 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 278/553] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:35.746478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.754645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2286a-88c8-4155-9384-07c7d4634ca8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.757869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364803-29d0-4b15-abe6-ceaa3f1a4ede admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.762580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.763451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.763949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.764482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.765553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:35.766628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.768555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.782656 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 279/554] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:35.784254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.794713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.795889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.796432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.797032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.810810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b184d-3a8f-4a31-8764-3193eebdd037 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.814981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.818468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.820840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.821873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.824450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.824976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.845985 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 19 20:35:35.850040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.852102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.855285 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 276/555] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:35.857319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.883058 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:35.883874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b6275-b353-4761-878d-546bde9bb12c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.888657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.889679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.890248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.892045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.894505 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 280/556] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:35.895609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.916217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc918b-30d9-4539-a84a-38588f9350f1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.917670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.919710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.931238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.932254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.932759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.933251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.934284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:35.936307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.940859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.951273 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:35.957811 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 277/557] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:35.958765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.968538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44193815-8f81-44b8-b072-f106e8107ac8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:35.970991 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 281/558] 10.222.0.30 () {56 vars in 1158 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:35.971981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:35.973977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:35.974695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:35.975039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:35.975388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:35.976166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:35.976565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:35.978286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:35.996402 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 278/559] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:35.997755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.005406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e8e77-1727-4e8f-a516-471f7c840b94 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.007181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d39683-f26f-479f-a994-6ea546df5e79 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.011823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.012724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.013078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.013430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.025407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.027002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.027397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.029555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.031196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.032935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.034522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.036888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.040770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.045943 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:36.049376 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 279/560] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.051091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.068010 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 282/561] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.068890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.071434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e094262-5cb9-40df-816f-4afb477b1a01 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.082005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.083430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.083991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.084505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.092362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758981d9-bb0a-47f2-a5d8-db04dbcaf39f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.101278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.105888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.107172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.107390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.108549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.110222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.112628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.113377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.117943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.139736 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:35:36.144278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 283/562] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.145367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.148713 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 280/563] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.152597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.160298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f24210-6718-428a-a6bd-6e450e45c916 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.165556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b9fe-3448-4298-bf5d-f3e65e1466e4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.166263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.167186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.167467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.167858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.173378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff29ea1-7baa-411a-886c-30347dd8e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.174540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff29ea1-7baa-411a-886c-30347dd8e676 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.175047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff29ea1-7baa-411a-886c-30347dd8e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.175528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff29ea1-7baa-411a-886c-30347dd8e676 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.177728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.180756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.185199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff29ea1-7baa-411a-886c-30347dd8e676 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.187522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff29ea1-7baa-411a-886c-30347dd8e676 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.199092 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 19 20:35:36.200500 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 284/564] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.203725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.203841 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-aff29ea1-7baa-411a-886c-30347dd8e676 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:36.206599 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 281/565] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.206599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f55f-5c2a-4415-b82a-a36185dbe3ec None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.206599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f55f-5c2a-4415-b82a-a36185dbe3ec None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.206956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f55f-5c2a-4415-b82a-a36185dbe3ec None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.208635 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 282/566] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:36.209403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18f55f-5c2a-4415-b82a-a36185dbe3ec None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.217300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141c6c-3d9e-4159-a196-b7c5bc8c4123 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.222335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.223032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.223259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.223533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.224398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.224603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18f55f-5c2a-4415-b82a-a36185dbe3ec None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.224714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.226532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.228972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae6a17-3c83-4f8d-aec5-e4967ed9ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.229622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6a17-3c83-4f8d-aec5-e4967ed9ea87 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.229904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6a17-3c83-4f8d-aec5-e4967ed9ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.230190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6a17-3c83-4f8d-aec5-e4967ed9ea87 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.231017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae6a17-3c83-4f8d-aec5-e4967ed9ea87 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.231331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae6a17-3c83-4f8d-aec5-e4967ed9ea87 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.233218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae6a17-3c83-4f8d-aec5-e4967ed9ea87 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.245852 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 285/567] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.246464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.259330 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 283/568] 10.222.0.30 () {56 vars in 1160 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.259487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cfa1f-c5f5-4a81-85f1-9e947eec11a7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.259599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8e78-6c67-4be6-85bd-f9a6bae5df79 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.259599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8e78-6c67-4be6-85bd-f9a6bae5df79 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.259599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8e78-6c67-4be6-85bd-f9a6bae5df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.263771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.264443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.264727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.264999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.265812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.266122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.267977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.276286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-942a8e78-6c67-4be6-85bd-f9a6bae5df79 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:36.277519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-942a8e78-6c67-4be6-85bd-f9a6bae5df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:36.279967 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 286/569] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.281242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.287859 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 284/570] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:36.288996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8e78-6c67-4be6-85bd-f9a6bae5df79 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.291706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b2313-274e-4c66-a1c3-6304e6f3570f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.299028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.300125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.300422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.300708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.302746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8e78-6c67-4be6-85bd-f9a6bae5df79 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.307668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.308768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.309306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.309831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.314764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.316641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.321260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.323096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.336475 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:36.338614 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 287/571] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.338718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.339672 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:36.340851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 285/572] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.341605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.350815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411d70c-71ee-48c2-ae5f-054fa1fd7390 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.354229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d658ce4-e7ab-4cd9-8b18-8455c229c836 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.355202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b3152-4f8f-4b0c-ac2f-d579cde85624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.356045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b3152-4f8f-4b0c-ac2f-d579cde85624 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.356392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b3152-4f8f-4b0c-ac2f-d579cde85624 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.356641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b3152-4f8f-4b0c-ac2f-d579cde85624 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/f02b510f78c341c29320f011ef4beaca/roles/6af0e115d1f04a48893aa10bf6753ced` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.358561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3298a2-048a-4966-a753-ab00e5f3e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.359287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3298a2-048a-4966-a753-ab00e5f3e003 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.360363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3298a2-048a-4966-a753-ab00e5f3e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.360482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3298a2-048a-4966-a753-ab00e5f3e003 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.370874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3298a2-048a-4966-a753-ab00e5f3e003 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:36.371917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b3152-4f8f-4b0c-ac2f-d579cde85624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=f02b510f78c341c29320f011ef4beaca, role_id=6af0e115d1f04a48893aa10bf6753ced)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.374619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b3152-4f8f-4b0c-ac2f-d579cde85624 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.378248 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-eb3298a2-048a-4966-a753-ab00e5f3e003 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:36.379442 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 286/573] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.380272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3298a2-048a-4966-a753-ab00e5f3e003 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.392100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3298a2-048a-4966-a753-ab00e5f3e003 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.392250 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 288/574] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:36 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/f02b510f78c341c29320f011ef4beaca/roles/6af0e115d1f04a48893aa10bf6753ced => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:36.405412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b3152-4f8f-4b0c-ac2f-d579cde85624 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.460867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.462767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.463202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.463998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.465265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.465730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.468560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.485636 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 287/575] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.485971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b3152-4f8f-4b0c-ac2f-d579cde85624 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.486936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.491963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.492870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.493331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.493713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.494667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.495090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.497210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.502074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f4aa-8cb8-4b9f-89d9-7e9d42db7a15 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.508717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.510178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.510955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.511387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.512323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.512813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.518131 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 289/576] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.518131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.520076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.530101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836e82b-786f-4867-9096-8252d0b7d109 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.531034 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 288/577] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.532912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.535738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.537035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.537382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.537667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.546093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.546643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39da629-e1dd-4561-aaaa-bd448360e13f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.548899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.553271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199b85c-987b-4a7a-bd60-dcb2546956dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.554489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199b85c-987b-4a7a-bd60-dcb2546956dd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.554804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199b85c-987b-4a7a-bd60-dcb2546956dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.555156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199b85c-987b-4a7a-bd60-dcb2546956dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.563319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199b85c-987b-4a7a-bd60-dcb2546956dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.565332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199b85c-987b-4a7a-bd60-dcb2546956dd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.565435 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:36.568372 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 290/578] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.568372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.578083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2d09-1e03-4a3b-bba9-d90b83a85861 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.583203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dc1d1-658e-4774-9975-61b87e1c5d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.583340 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b199b85c-987b-4a7a-bd60-dcb2546956dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:36.583992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc1d1-658e-4774-9975-61b87e1c5d17 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.584275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc1d1-658e-4774-9975-61b87e1c5d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.584759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc1d1-658e-4774-9975-61b87e1c5d17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.584860 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 289/579] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.585861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da923-2f1d-47cf-bae2-b6f75879134b None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.586265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da923-2f1d-47cf-bae2-b6f75879134b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.586657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da923-2f1d-47cf-bae2-b6f75879134b None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.588165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 290/580] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:36.589078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da923-2f1d-47cf-bae2-b6f75879134b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.600065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dc1d1-658e-4774-9975-61b87e1c5d17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.602002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dc1d1-658e-4774-9975-61b87e1c5d17 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.606266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da923-2f1d-47cf-bae2-b6f75879134b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.615359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.616311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.616896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.617514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.618180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.619143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.622141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.623839 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-026dc1d1-658e-4774-9975-61b87e1c5d17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:36.625263 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 291/581] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.626358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa290-9c34-49b9-8eaa-f9d246d86bfc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.626646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa290-9c34-49b9-8eaa-f9d246d86bfc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.626925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa290-9c34-49b9-8eaa-f9d246d86bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.640797 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 291/582] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.641387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.644592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-55dfa290-9c34-49b9-8eaa-f9d246d86bfc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:36.646036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55dfa290-9c34-49b9-8eaa-f9d246d86bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:36.651108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dff673-7c6f-4b89-bfdb-b27fd8a46795 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.654233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 292/583] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:36.654831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfa290-9c34-49b9-8eaa-f9d246d86bfc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.656263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.657671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.658131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.658593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.659552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.660224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.663122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.664708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfa290-9c34-49b9-8eaa-f9d246d86bfc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.670007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.670772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.671168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.671556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.673028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.673422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.675199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.679304 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 292/584] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.680429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.687807 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 293/585] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.688801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.692738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370e252-328f-4ebc-a53e-87b364549e25 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.697276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a827f-8616-44bd-9cf4-c9856ef1c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.698301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a827f-8616-44bd-9cf4-c9856ef1c937 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.698582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a827f-8616-44bd-9cf4-c9856ef1c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.698860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a827f-8616-44bd-9cf4-c9856ef1c937 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/a20eaaff207f4d1b870c6abf0a50f1c8/roles/6af0e115d1f04a48893aa10bf6753ced` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.702521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc6792-563a-4053-9a14-a2541da9caa3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.707254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fe167-c015-490d-a82c-6df937a4ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.708285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe167-c015-490d-a82c-6df937a4ec70 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.708741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe167-c015-490d-a82c-6df937a4ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.709172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe167-c015-490d-a82c-6df937a4ec70 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/700225331647423aa8bc458f1ac82fac/roles/6af0e115d1f04a48893aa10bf6753ced` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.714152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a827f-8616-44bd-9cf4-c9856ef1c937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=a20eaaff207f4d1b870c6abf0a50f1c8, role_id=6af0e115d1f04a48893aa10bf6753ced)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.716830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a827f-8616-44bd-9cf4-c9856ef1c937 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.725514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fe167-c015-490d-a82c-6df937a4ec70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=700225331647423aa8bc458f1ac82fac, role_id=6af0e115d1f04a48893aa10bf6753ced)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.728374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fe167-c015-490d-a82c-6df937a4ec70 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.733256 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 293/586] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:36 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/a20eaaff207f4d1b870c6abf0a50f1c8/roles/6af0e115d1f04a48893aa10bf6753ced => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:36.734202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a827f-8616-44bd-9cf4-c9856ef1c937 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.742529 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 294/587] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:36 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/700225331647423aa8bc458f1ac82fac/roles/6af0e115d1f04a48893aa10bf6753ced => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:36.743539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fe167-c015-490d-a82c-6df937a4ec70 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.817667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a827f-8616-44bd-9cf4-c9856ef1c937 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.832020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fe167-c015-490d-a82c-6df937a4ec70 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.837833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.839397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.839788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.840172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.851470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.854058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.873607 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 19 20:35:36.880231 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 295/588] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.884591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.910236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87c6b-e06d-4197-8aba-b0c5c579b2b9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.917082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def7469-00ae-4a26-bfac-bfc17e5ecc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.917926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7469-00ae-4a26-bfac-bfc17e5ecc2b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.918210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7469-00ae-4a26-bfac-bfc17e5ecc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.918487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7469-00ae-4a26-bfac-bfc17e5ecc2b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.927347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:36.928026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:36.928305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:36.928602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:36.929453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:36.929761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:36.932904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:36.946159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def7469-00ae-4a26-bfac-bfc17e5ecc2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:36.953821 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-7def7469-00ae-4a26-bfac-bfc17e5ecc2b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:36.955115 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 294/589] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:36.964418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def7469-00ae-4a26-bfac-bfc17e5ecc2b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.975079 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 296/590] 10.222.0.30 () {56 vars in 1158 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:36.981858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:36.986654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def7469-00ae-4a26-bfac-bfc17e5ecc2b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:36.999071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.001242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035764a-bc6b-4df2-a08e-bb696c9bf272 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.001797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.002498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.003636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.004605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:37.005496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.009767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.012929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.013866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.015211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.019866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.031379 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 295/591] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:37.034209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.036249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.038050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.048091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41560f7-8998-4d77-ac55-9bd65b9a9e4e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.054181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.055086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.055474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.055890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.059905 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:37.061408 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 297/592] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:37.066856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.067976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.069011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.080567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065f8b-628f-45cd-97fc-c3791f1760d0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.085311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.086262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.086736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.087146 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:37.087429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.088356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:37.088461 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 296/593] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:37.088962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.090753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.094838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.107591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3771d3b-6487-4f9d-9134-73ac3335e8a6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.108490 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 298/594] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:37.112833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.113628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.114288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.114572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.114852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.115581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:37.115889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.117542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.125942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a36f6-ec35-4fde-8805-d5aaabc73433 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.134802 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 297/595] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:37.140471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.141323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.142124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.142405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.142695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.154760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a665-35bd-49a7-9dd5-b90223705a1f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.163466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.165057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.166604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.167934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.169290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.169705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.185530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.186858 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:37.187762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.189149 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 299/596] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:37.199089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.215708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b9472-5164-4494-98ba-ceae5f9bcc62 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.220745 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 19 20:35:37.223972 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 298/597] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:37.224393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.225107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.225440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.225718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.226556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:37.226865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.228803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.232018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.251482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8ef7e-0ca7-4464-bf07-c39e358994d1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.257624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 300/598] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:37.265241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.265882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.266704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.266989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.267265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.268157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:37.268539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.270441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.283325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f317-b02d-4b9f-a421-e61c59f2a6e2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.290979 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 299/599] 10.222.0.30 () {56 vars in 1156 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:37.298522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.300294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048065d0-2f6b-4ce6-9914-5489530d8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.303374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048065d0-2f6b-4ce6-9914-5489530d8599 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.304848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048065d0-2f6b-4ce6-9914-5489530d8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.306450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048065d0-2f6b-4ce6-9914-5489530d8599 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/9398233d060c43048d49d758695153a3/roles/6af0e115d1f04a48893aa10bf6753ced` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.326560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c50a66-e953-4b7a-94b8-b4cf0329f188 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.332407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048065d0-2f6b-4ce6-9914-5489530d8599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=9398233d060c43048d49d758695153a3, role_id=6af0e115d1f04a48893aa10bf6753ced)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.336973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaee68e-03de-4fdb-8400-9445c4698adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.337880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee68e-03de-4fdb-8400-9445c4698adf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.338948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee68e-03de-4fdb-8400-9445c4698adf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.339363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee68e-03de-4fdb-8400-9445c4698adf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.340441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048065d0-2f6b-4ce6-9914-5489530d8599 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.354327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaee68e-03de-4fdb-8400-9445c4698adf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.356391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaee68e-03de-4fdb-8400-9445c4698adf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.371386 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 301/600] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:37 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/9398233d060c43048d49d758695153a3/roles/6af0e115d1f04a48893aa10bf6753ced => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:37.374819 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 300/601] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:37.380927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048065d0-2f6b-4ce6-9914-5489530d8599 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.449165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048065d0-2f6b-4ce6-9914-5489530d8599 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.454650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.455596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.456076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.456557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.467740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.470532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.489323 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:37.491106 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 302/602] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:37.497022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaee68e-03de-4fdb-8400-9445c4698adf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.507123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaee68e-03de-4fdb-8400-9445c4698adf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.512087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.512940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.513363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.513858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.514727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:37.515177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.517215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.536280 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 301/603] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:37.542357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.557706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95098d2e-a2cc-4982-b0a6-6ad41fc605ef admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.562839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.563883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.564410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.564823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.575946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.578247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.591702 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:37.593529 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 303/604] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:37.600052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.611350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4de6cf-c14e-46a9-927b-5c11a9186bea admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.616449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7998210-25bc-4f46-ac9b-e134589d76e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.617378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998210-25bc-4f46-ac9b-e134589d76e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.617846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998210-25bc-4f46-ac9b-e134589d76e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.618265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998210-25bc-4f46-ac9b-e134589d76e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.619249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7998210-25bc-4f46-ac9b-e134589d76e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:37.619700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7998210-25bc-4f46-ac9b-e134589d76e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.621837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7998210-25bc-4f46-ac9b-e134589d76e3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.639761 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 302/605] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:37.646752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:37.664354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcce0c6-40a0-4cd4-81c4-579c5cdb230d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:37.674865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71175c-0096-4cac-b6a8-4b12731ae56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:37.675825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71175c-0096-4cac-b6a8-4b12731ae56f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:37.676347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71175c-0096-4cac-b6a8-4b12731ae56f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:37.676764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71175c-0096-4cac-b6a8-4b12731ae56f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:37.677748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71175c-0096-4cac-b6a8-4b12731ae56f admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=4b7a16fa195446e18f5c5982a127b88e) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:37.678287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71175c-0096-4cac-b6a8-4b12731ae56f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:37.680374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71175c-0096-4cac-b6a8-4b12731ae56f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:37.688189 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 304/606] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:37 2022] GET /identity/v3/role_assignments?user.id=4b7a16fa195446e18f5c5982a127b88e&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:39.069223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0787-c541-482f-9643-670ca02c48c6 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.069749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0787-c541-482f-9643-670ca02c48c6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.069749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0787-c541-482f-9643-670ca02c48c6 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.071772 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 303/607] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:39.077355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed56e3-0325-45af-87bf-22f3643e20b6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.077779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed56e3-0325-45af-87bf-22f3643e20b6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.077867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed56e3-0325-45af-87bf-22f3643e20b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.098265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f1ed56e3-0325-45af-87bf-22f3643e20b6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:39.099653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f1ed56e3-0325-45af-87bf-22f3643e20b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:39.116847 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 305/608] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:39.155892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea0787-c541-482f-9643-670ca02c48c6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.175175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea0787-c541-482f-9643-670ca02c48c6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.184661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36efc5-d61e-45a6-b296-553c028f0d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.185749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36efc5-d61e-45a6-b296-553c028f0d24 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.186173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36efc5-d61e-45a6-b296-553c028f0d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.186644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36efc5-d61e-45a6-b296-553c028f0d24 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.205338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36efc5-d61e-45a6-b296-553c028f0d24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:39.212385 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-ff36efc5-d61e-45a6-b296-553c028f0d24 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:39.214089 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 304/609] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:39.219583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed56e3-0325-45af-87bf-22f3643e20b6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.235259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed56e3-0325-45af-87bf-22f3643e20b6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.244876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.245659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.246045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.246428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.247291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:39.247717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.249434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.264910 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 306/610] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:39.270218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36efc5-d61e-45a6-b296-553c028f0d24 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.285943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36efc5-d61e-45a6-b296-553c028f0d24 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.296583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.298242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.298668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.299137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.319936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.321985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.350091 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:39.351528 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 305/611] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:39.357087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.369801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65df5-dc57-4cc4-a9ca-983ee5c83e1e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.382687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.383426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.383777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.384142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.384946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:39.385319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.387011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.406959 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 307/612] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:39.412031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.427507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668f82-87e5-4ad3-b244-d3c9ae614774 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.437476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.438556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.439057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.439561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.453924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.457116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.474542 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 19 20:35:39.476275 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 306/613] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:39.482791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.497940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f690-05d9-4f64-9261-ae6979318abf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.506823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.507540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.507822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.508096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.508949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:39.509254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.511202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.540465 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 308/614] 10.222.0.30 () {56 vars in 1158 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:39.545854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.558837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6847eb-f4aa-4a32-bf66-b2e986001278 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.570475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d1ef9-8e49-4848-b201-4ffd168994c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.571067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1ef9-8e49-4848-b201-4ffd168994c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.571354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1ef9-8e49-4848-b201-4ffd168994c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.571631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1ef9-8e49-4848-b201-4ffd168994c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.588367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1ef9-8e49-4848-b201-4ffd168994c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.590173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1ef9-8e49-4848-b201-4ffd168994c1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.602592 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 307/615] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:39.608123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.624013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a5ab0-76d0-42ca-89ac-e9727ec41f28 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.636226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.637034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.637512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.637789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.659085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.660966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.674363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524943-1bb8-4fbb-8371-1d9818d222c3 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.674363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524943-1bb8-4fbb-8371-1d9818d222c3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.674633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524943-1bb8-4fbb-8371-1d9818d222c3 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.676638 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 308/616] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:39.683173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae6389-5d1b-429d-9c0f-700170b71196 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.683456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae6389-5d1b-429d-9c0f-700170b71196 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.683737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae6389-5d1b-429d-9c0f-700170b71196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.688364 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:39.690179 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 309/617] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:39.697357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.708269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb765a-59ce-416d-88d2-e1198d70a0cb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.713871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.714705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.715083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.715458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.716276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:39.716740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.718434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.725746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1bae6389-5d1b-429d-9c0f-700170b71196 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:39.726960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1bae6389-5d1b-429d-9c0f-700170b71196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:39.733023 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 310/618] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:39.738403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.744262 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 309/619] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:39.751675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d3001-8473-46c7-b785-0a39c5f8d997 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.756757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.758275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.758898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.759563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.768013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.770341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.772004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae6389-5d1b-429d-9c0f-700170b71196 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.782788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae6389-5d1b-429d-9c0f-700170b71196 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.794153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f91e6c-8a1b-4a67-ab5e-ab5670f64608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.794988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91e6c-8a1b-4a67-ab5e-ab5670f64608 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.795268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91e6c-8a1b-4a67-ab5e-ab5670f64608 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.795537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91e6c-8a1b-4a67-ab5e-ab5670f64608 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.806041 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:39.810348 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 311/620] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:39.813945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f91e6c-8a1b-4a67-ab5e-ab5670f64608 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:39.816595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.822243 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-42f91e6c-8a1b-4a67-ab5e-ab5670f64608 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:39.829068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377876-8fc1-47df-843e-8a8341af22b3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.829524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 310/621] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:39.833088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.833780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.834060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.834335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.835172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:39.835471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.836637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f91e6c-8a1b-4a67-ab5e-ab5670f64608 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.844509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.850838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f91e6c-8a1b-4a67-ab5e-ab5670f64608 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.863000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.863713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.863992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.864267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.865372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:39.865681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.868440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 312/622] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:39.869793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.874787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.891705 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 311/623] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:39.893843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b04a0-5ed1-4c27-9bb6-2be3a00c62a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.897077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.905047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.907859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.908152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.908506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.910011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=f02b510f78c341c29320f011ef4beaca) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:39.910334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.914419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c637f-4b75-4612-9201-b7f6b8bbbfea admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.915365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.924824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.926743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.927020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.928282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.932711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 313/624] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/role_assignments?user.id=f02b510f78c341c29320f011ef4beaca&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:39.944718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.946661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:39.965691 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:39.967277 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 312/625] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:39.973307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:39.986502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82ad8-f551-4000-898c-4b4ce1b5468c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:39.991352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780a5ad-dea3-48aa-a107-ff6b752b5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:39.992039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a5ad-dea3-48aa-a107-ff6b752b5ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:39.992314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a5ad-dea3-48aa-a107-ff6b752b5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:39.992797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a5ad-dea3-48aa-a107-ff6b752b5ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:39.993544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780a5ad-dea3-48aa-a107-ff6b752b5ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:39.993849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780a5ad-dea3-48aa-a107-ff6b752b5ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:39.995578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780a5ad-dea3-48aa-a107-ff6b752b5ab9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.010030 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 314/626] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.017581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.027962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c300-0a0a-45b5-8f6e-fc635d476f07 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.037566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.038394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.038719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.038994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.048657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.050836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.071400 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 19 20:35:40.076976 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 313/627] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:40.081069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ce0a-974b-4134-8152-8cae5a491acf None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.081661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ce0a-974b-4134-8152-8cae5a491acf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.081661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ce0a-974b-4134-8152-8cae5a491acf None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.083405 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 315/628] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:40.085818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.096305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094f0fd-bcc1-4d68-a50e-094280f2afa1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.103286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1b2c-dce7-443e-9251-c19fcb8d6dc7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.103672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1b2c-dce7-443e-9251-c19fcb8d6dc7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.103850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1b2c-dce7-443e-9251-c19fcb8d6dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.104769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.105615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.105891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.106172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.107030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.107390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.110000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.132812 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 314/629] 10.222.0.30 () {56 vars in 1160 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.139721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.149940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce3c05-e5aa-4886-af88-de29867e613a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.153826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-736f1b2c-dce7-443e-9251-c19fcb8d6dc7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:40.155379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-736f1b2c-dce7-443e-9251-c19fcb8d6dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:40.161121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d0f82-f1c4-4c5c-96a5-e8395a767317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.162578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d0f82-f1c4-4c5c-96a5-e8395a767317 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.162578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d0f82-f1c4-4c5c-96a5-e8395a767317 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.162578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d0f82-f1c4-4c5c-96a5-e8395a767317 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.168535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 316/630] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:40.181371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d0f82-f1c4-4c5c-96a5-e8395a767317 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.183147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d0f82-f1c4-4c5c-96a5-e8395a767317 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.194365 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 315/631] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:40.195177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f1b2c-dce7-443e-9251-c19fcb8d6dc7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.199793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d0f82-f1c4-4c5c-96a5-e8395a767317 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.209415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d0f82-f1c4-4c5c-96a5-e8395a767317 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.212451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f1b2c-dce7-443e-9251-c19fcb8d6dc7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.214332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.215115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.215392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.215663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.227392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.229320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.230238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bcd0c-2c76-4f85-94b6-c96f5c2719f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.231068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcd0c-2c76-4f85-94b6-c96f5c2719f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.231339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcd0c-2c76-4f85-94b6-c96f5c2719f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.231615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcd0c-2c76-4f85-94b6-c96f5c2719f0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.247179 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:40.248621 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 316/632] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:40.254516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.258270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bcd0c-2c76-4f85-94b6-c96f5c2719f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:40.266255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed544ff-ed87-465e-9972-379544078d04 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.266936 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-145bcd0c-2c76-4f85-94b6-c96f5c2719f0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:40.268575 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 317/633] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:40.271299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.271966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.272228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.272551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.273884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.273884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.275140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bcd0c-2c76-4f85-94b6-c96f5c2719f0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.275253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.287192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bcd0c-2c76-4f85-94b6-c96f5c2719f0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.289153 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 317/634] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:40.292423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.293356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.293942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.295104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.295959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.300291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.302206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.305223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.311236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bdf62-c569-4746-9a5e-0efb2e9e129c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.318257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 318/635] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.323774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.323930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.324611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.324874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.325139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.336291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32a115-4dbc-4bed-9fe4-3d7febe1dcf2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.338309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.340776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.342499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.344648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.344648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.344648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.357596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.361159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.361768 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:40.363518 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 318/636] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:40.368932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.378285 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:40.380826 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 319/637] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:40.384750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.387611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7739d-21c8-4269-94e6-79afe30642e4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.392973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.393631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.393915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.394192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.394985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.395293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.396323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7806c7-f20f-49ce-8a71-83c293da0a12 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.397267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.403376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.404039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.404321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.404625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.405348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.405655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.409447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.414222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 319/638] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.421341 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 320/639] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.424418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.427391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.438146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ffb10-6321-4d49-a821-976ab85c527f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.439633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d9a14-a189-4178-bcf4-107fe41761e6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.443208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.443968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.444253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.444554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.445277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.445457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=700225331647423aa8bc458f1ac82fac) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.445792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.446644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.447082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.447792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.448150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.455308 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 320/640] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/role_assignments?user.id=700225331647423aa8bc458f1ac82fac&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.461169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.464815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.479838 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:35:40.481756 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 321/641] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:40.488466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.498656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2973ef-ed7c-4173-9c8f-b2ac31da35e2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.504143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd9a51-5765-4684-8c20-9dbdf4d32c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.504916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9a51-5765-4684-8c20-9dbdf4d32c68 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.505198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9a51-5765-4684-8c20-9dbdf4d32c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.505473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd9a51-5765-4684-8c20-9dbdf4d32c68 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.506327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd9a51-5765-4684-8c20-9dbdf4d32c68 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.506692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd9a51-5765-4684-8c20-9dbdf4d32c68 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.508561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd9a51-5765-4684-8c20-9dbdf4d32c68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.528427 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 321/642] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.534268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.544717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b654c7f-a105-4a0e-823a-9867eb4a02f9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.549432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180807bb-6815-46a4-b9aa-162b21bb345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.550135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180807bb-6815-46a4-b9aa-162b21bb345e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.550415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180807bb-6815-46a4-b9aa-162b21bb345e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.550738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180807bb-6815-46a4-b9aa-162b21bb345e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.555899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb23e7d-a273-4114-9573-7302044f5b4a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.556083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb23e7d-a273-4114-9573-7302044f5b4a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.556535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb23e7d-a273-4114-9573-7302044f5b4a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.558486 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 322/643] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:40.559872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180807bb-6815-46a4-b9aa-162b21bb345e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.561798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180807bb-6815-46a4-b9aa-162b21bb345e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.564902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9655b0-2a37-4ea4-8d7e-d61958624817 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.565298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9655b0-2a37-4ea4-8d7e-d61958624817 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.565675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9655b0-2a37-4ea4-8d7e-d61958624817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.581682 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 322/644] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:40.588110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180807bb-6815-46a4-b9aa-162b21bb345e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.601299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9a9655b0-2a37-4ea4-8d7e-d61958624817 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:40.603730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180807bb-6815-46a4-b9aa-162b21bb345e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.605168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9a9655b0-2a37-4ea4-8d7e-d61958624817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:40.613923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.615595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.616343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.617316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.623578 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 323/645] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:40.638211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.640368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.663144 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:40.664635 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 323/646] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:40.670507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9655b0-2a37-4ea4-8d7e-d61958624817 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.683484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9655b0-2a37-4ea4-8d7e-d61958624817 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.690289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a05b51-98ce-4ac5-91ba-d55293cb2d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.691115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05b51-98ce-4ac5-91ba-d55293cb2d5e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.691532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05b51-98ce-4ac5-91ba-d55293cb2d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.691908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05b51-98ce-4ac5-91ba-d55293cb2d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.692842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a05b51-98ce-4ac5-91ba-d55293cb2d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.693269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a05b51-98ce-4ac5-91ba-d55293cb2d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.695145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a05b51-98ce-4ac5-91ba-d55293cb2d5e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.708303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.716802 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 324/647] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.718270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cd39-cc13-43de-8b33-20f5628ccc71 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.718560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cd39-cc13-43de-8b33-20f5628ccc71 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.718869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cd39-cc13-43de-8b33-20f5628ccc71 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.720204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563d2de-49d2-4898-bb05-01334a92cc86 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.727693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 325/648] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:40.727693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6cd39-cc13-43de-8b33-20f5628ccc71 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.732040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300898b-1523-406e-bc82-ca66b0a850b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.733358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300898b-1523-406e-bc82-ca66b0a850b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.733846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300898b-1523-406e-bc82-ca66b0a850b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.734883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300898b-1523-406e-bc82-ca66b0a850b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.744973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6cd39-cc13-43de-8b33-20f5628ccc71 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.748929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300898b-1523-406e-bc82-ca66b0a850b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:40.749349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.750684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.750970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.751247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.756498 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-9300898b-1523-406e-bc82-ca66b0a850b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:40.757959 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 324/649] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:40.758678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.759130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945fbe-bde6-43d5-abc3-1ac6367da535 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.759413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945fbe-bde6-43d5-abc3-1ac6367da535 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.759693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945fbe-bde6-43d5-abc3-1ac6367da535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.760659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.774502 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:40.775686 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 326/650] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:40.776534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.783961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-47945fbe-bde6-43d5-abc3-1ac6367da535 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:40.785278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-47945fbe-bde6-43d5-abc3-1ac6367da535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:40.787122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954de5-07f3-4bc9-a6f2-8d5b044c4bb1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.792958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.793798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.799933 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 325/651] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:40.799933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47945fbe-bde6-43d5-abc3-1ac6367da535 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.800108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.800108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.800108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.800108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.800108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.805028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47945fbe-bde6-43d5-abc3-1ac6367da535 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.809761 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 327/652] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.813158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.813969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.814499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.814916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.815516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.816139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.816722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.818998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.826373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d06b2-6227-428e-9a92-15eb3de74c3e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.831839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.832671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.832953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.833225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.833583 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 326/653] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.834975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.845327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b59f2-aab0-4397-8766-07bee769fe63 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.846763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.848887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.858937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e82c7-1b43-4904-8a4d-e676035dda36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.860637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e82c7-1b43-4904-8a4d-e676035dda36 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.861065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e82c7-1b43-4904-8a4d-e676035dda36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.861503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e82c7-1b43-4904-8a4d-e676035dda36 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.868722 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:40.870378 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 328/654] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:40.871370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.873523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e82c7-1b43-4904-8a4d-e676035dda36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:40.881240 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b21e82c7-1b43-4904-8a4d-e676035dda36 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:40.882069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dd27a-457b-4332-9f21-d8827b7acc5a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.882854 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 327/655] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:40.883747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e82c7-1b43-4904-8a4d-e676035dda36 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.892145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.893042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.893436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.893823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.894784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=a20eaaff207f4d1b870c6abf0a50f1c8) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.895207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.895492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e82c7-1b43-4904-8a4d-e676035dda36 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.897294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.900544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.901390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.901849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.902399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.903387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.903881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.905749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.912512 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 329/656] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/role_assignments?user.id=a20eaaff207f4d1b870c6abf0a50f1c8&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.913513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.919805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 328/657] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.926526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:40.932454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7773d54-7580-4bb0-b19b-66f2bae1432c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.945040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.946213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.946730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.947224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.948279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:40.949713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676ea7-9002-44fe-92a0-b11698e2fd97 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:40.950282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.954070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.960842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:40.962580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:40.963864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:40.964493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:40.972441 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 330/658] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:40.973805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:40.976155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:40.979363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.004996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b726-ad84-490e-bc1a-68704d0e30c1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.005906 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 19 20:35:41.007825 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 329/659] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:41.011403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.012345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.012738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.013113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.016854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.034206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5a380-c793-4696-a6bb-bdc62720eb60 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.037586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.040928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.047774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.048663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.049655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.050069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.050917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:41.051220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.056446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.075512 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:41.077091 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 331/660] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:41.085618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.101079 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 330/661] 10.222.0.30 () {56 vars in 1158 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:41.107329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.109241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123856-7567-4657-b4b6-948159e4919a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.119160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520432-1398-4a10-b706-4a86ca72a5fa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.121767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.122438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.122765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.123038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.123750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:41.124066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.125710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85994e-b98e-45d8-886d-35ff892f60c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.125829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.126656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85994e-b98e-45d8-886d-35ff892f60c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.127146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85994e-b98e-45d8-886d-35ff892f60c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.127615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85994e-b98e-45d8-886d-35ff892f60c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.136287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85994e-b98e-45d8-886d-35ff892f60c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.138379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85994e-b98e-45d8-886d-35ff892f60c6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.147060 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 332/662] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:41.152365 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 331/663] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 20:35:41.154950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.158950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85994e-b98e-45d8-886d-35ff892f60c6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.168274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85994e-b98e-45d8-886d-35ff892f60c6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.170483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e0000-1b08-4b04-9fcc-3a8f606f8454 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.174241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.175483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.176067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.176653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.178305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.179184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.179546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.179768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.189642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.191489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.192006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.193672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.210749 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 19 20:35:41.211303 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:41.212248 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 333/664] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:41.213112 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 332/665] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:41.218155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.218812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.228758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1128-8cd9-4d9d-8ae7-4a2da141da48 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.230673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e04d87-fe0a-43c9-8885-1e28944fadb5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.234275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.235284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.235699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.235853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.236255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.236674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.237044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.237447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.237600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:41.238036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.238587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:41.238990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.240067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.241077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.257683 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 333/666] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:41.265568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.270987 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 334/667] 10.222.0.30 () {56 vars in 1156 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:41.277731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429515-ce93-4990-b7b1-b99abff8886c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.278756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.288710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.289641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.290187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.290466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.292280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48e71-8876-4319-b61e-c1c060a1e509 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.298114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.300162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.307244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.308092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.308392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.308665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.314457 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:41.315878 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 334/668] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:41.321616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.331615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.331855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0059f1-14e0-4d88-be0a-67a6cc1a21b4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.334653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.337320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.337974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.338259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.338539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.339320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:41.339633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.341488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.355774 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:41.357164 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 335/670] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:41.358119 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 335/670] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:41.362039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.363286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.379761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710b491-842d-470c-9c03-74c79b326624 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.382445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7bf1d-1728-4f89-99f7-606964450d37 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.390018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.390769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.391869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.391869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.392557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:41.392869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.394465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.396554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.397205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.397481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.397764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.398587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=9398233d060c43048d49d758695153a3) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:41.398898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.400759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.412470 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 336/671] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/role_assignments?user.id=9398233d060c43048d49d758695153a3&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:41.413511 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 336/672] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:41.419525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.430664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05332e-de76-4a28-9d3c-dccd5c8bd93c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.435571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.436414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.436739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.437070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.446087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.448082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.462566 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:41.464129 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 337/673] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:41.470174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.482494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b4b0c-0fcc-421b-a9d3-6bdb88a4b42e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.487884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201248a-73a2-4335-ba6f-88807ac4139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.488586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201248a-73a2-4335-ba6f-88807ac4139d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.489080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201248a-73a2-4335-ba6f-88807ac4139d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.489361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201248a-73a2-4335-ba6f-88807ac4139d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.490228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201248a-73a2-4335-ba6f-88807ac4139d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:41.490542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201248a-73a2-4335-ba6f-88807ac4139d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.492733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201248a-73a2-4335-ba6f-88807ac4139d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.507371 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 337/674] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:41.528398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:41.528398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa725-4905-4780-8489-386e8859942c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:41.536928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539735-8994-41af-ad5b-97ac08fbe027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:41.538207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539735-8994-41af-ad5b-97ac08fbe027 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:41.538661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539735-8994-41af-ad5b-97ac08fbe027 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:41.539161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539735-8994-41af-ad5b-97ac08fbe027 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/4b7a16fa195446e18f5c5982a127b88e/roles/6af0e115d1f04a48893aa10bf6753ced` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:41.558324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de539735-8994-41af-ad5b-97ac08fbe027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=4b7a16fa195446e18f5c5982a127b88e, role_id=6af0e115d1f04a48893aa10bf6753ced)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:41.561390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de539735-8994-41af-ad5b-97ac08fbe027 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:41.611504 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 338/675] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:41 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/4b7a16fa195446e18f5c5982a127b88e/roles/6af0e115d1f04a48893aa10bf6753ced => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:42.998300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff083e-43ba-4a99-852e-be1721340d59 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:42.998805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff083e-43ba-4a99-852e-be1721340d59 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:42.998805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff083e-43ba-4a99-852e-be1721340d59 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.000760 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 338/676] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:43.018831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57951a-4e6e-4bae-b951-de78184b9588 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.019357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57951a-4e6e-4bae-b951-de78184b9588 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.019357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57951a-4e6e-4bae-b951-de78184b9588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.044226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ed57951a-4e6e-4bae-b951-de78184b9588 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:43.046378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ed57951a-4e6e-4bae-b951-de78184b9588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:43.105765 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 339/677] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:43.147001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff083e-43ba-4a99-852e-be1721340d59 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:43.177885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff083e-43ba-4a99-852e-be1721340d59 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:43.185122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:43.185903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.186181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.186449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.200373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:43.202215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:43.222712 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:43.224937 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 339/678] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:43.229545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57951a-4e6e-4bae-b951-de78184b9588 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:43.242748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57951a-4e6e-4bae-b951-de78184b9588 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:43.247212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc5b7-564b-4111-93ca-9be1a4282fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:43.247868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc5b7-564b-4111-93ca-9be1a4282fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.248149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc5b7-564b-4111-93ca-9be1a4282fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.248503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc5b7-564b-4111-93ca-9be1a4282fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.249168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc5b7-564b-4111-93ca-9be1a4282fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:43.249472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc5b7-564b-4111-93ca-9be1a4282fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:43.251581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc5b7-564b-4111-93ca-9be1a4282fd9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:43.276140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 340/679] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:43.283438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:43.301649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01834ef7-1df2-4e44-93e8-b184922563b2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:43.314070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632cfac-2b0f-4a80-a0e6-c583016ba8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:43.315007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632cfac-2b0f-4a80-a0e6-c583016ba8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.315496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632cfac-2b0f-4a80-a0e6-c583016ba8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.315988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632cfac-2b0f-4a80-a0e6-c583016ba8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.316952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632cfac-2b0f-4a80-a0e6-c583016ba8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:43.319089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632cfac-2b0f-4a80-a0e6-c583016ba8d3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:43.374100 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 340/680] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:35:43 2022] POST /identity/v3/users => generated 254 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:43.471183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca0574-12f1-474d-9c91-e3f6e6f062de None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.471505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca0574-12f1-474d-9c91-e3f6e6f062de None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.471753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca0574-12f1-474d-9c91-e3f6e6f062de None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.473982 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 341/681] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:43.479594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d45b-3427-4deb-88bc-e38617eacd62 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.479886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d45b-3427-4deb-88bc-e38617eacd62 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.480153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d45b-3427-4deb-88bc-e38617eacd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.502597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ad91d45b-3427-4deb-88bc-e38617eacd62 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:43.503734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ad91d45b-3427-4deb-88bc-e38617eacd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:43.516733 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 341/682] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:43.552742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca0574-12f1-474d-9c91-e3f6e6f062de None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:43.566283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca0574-12f1-474d-9c91-e3f6e6f062de None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:43.575222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:43.576082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.576377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.576655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.577319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:43.579026 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:43.579026 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:43.579026 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:43.579985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:43.601008 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 19 20:35:43.602619 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 342/683] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:43 2022] GET /identity/v3/services/network => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:43.608229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91d45b-3427-4deb-88bc-e38617eacd62 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:43.623766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91d45b-3427-4deb-88bc-e38617eacd62 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:43.631929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a833b-fada-4d9d-87fc-45ad962a982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:43.632994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a833b-fada-4d9d-87fc-45ad962a982e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.633471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a833b-fada-4d9d-87fc-45ad962a982e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.633959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a833b-fada-4d9d-87fc-45ad962a982e admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.634938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a833b-fada-4d9d-87fc-45ad962a982e admin admin] RBAC: Adding query filter params (name=network) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:43.635435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a833b-fada-4d9d-87fc-45ad962a982e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:43.636698 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-852a833b-fada-4d9d-87fc-45ad962a982e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:43.636698 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:43.636698 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:43.638008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a833b-fada-4d9d-87fc-45ad962a982e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:43.644182 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 342/684] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:35:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:43.652369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:43.659964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5edfe-c8ce-46a0-8026-5afb8f78a1e4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:43.664398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ce1fa-f3ef-4a03-81f1-6f104a8c52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:43.665299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce1fa-f3ef-4a03-81f1-6f104a8c52ae admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:43.665580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce1fa-f3ef-4a03-81f1-6f104a8c52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:43.665856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce1fa-f3ef-4a03-81f1-6f104a8c52ae admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:43.666554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce1fa-f3ef-4a03-81f1-6f104a8c52ae admin admin] RBAC: Adding query filter params (type=network) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:43.666864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce1fa-f3ef-4a03-81f1-6f104a8c52ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:43.667862 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-8e8ce1fa-f3ef-4a03-81f1-6f104a8c52ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:43.667862 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:43.667862 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:43.668788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce1fa-f3ef-4a03-81f1-6f104a8c52ae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:43.675392 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 343/685] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:35:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:44.324502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f47d3-04f9-4545-97f2-de761f040c05 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.325024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f47d3-04f9-4545-97f2-de761f040c05 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.325101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f47d3-04f9-4545-97f2-de761f040c05 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.327098 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 343/686] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:44.332610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70acf-8984-402f-bf7c-66b0f458d80a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.333017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70acf-8984-402f-bf7c-66b0f458d80a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.333211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70acf-8984-402f-bf7c-66b0f458d80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.355273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-14e70acf-8984-402f-bf7c-66b0f458d80a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:44.356489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-14e70acf-8984-402f-bf7c-66b0f458d80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:44.364125 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 344/687] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:44.388872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f47d3-04f9-4545-97f2-de761f040c05 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.410020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f47d3-04f9-4545-97f2-de761f040c05 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.416495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939b858-0779-4867-9096-9139df68594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.417499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b858-0779-4867-9096-9139df68594f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.417970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b858-0779-4867-9096-9139df68594f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.418470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b858-0779-4867-9096-9139df68594f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.434782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939b858-0779-4867-9096-9139df68594f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:44.442931 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d939b858-0779-4867-9096-9139df68594f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:44.444361 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 344/688] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:44.450224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e70acf-8984-402f-bf7c-66b0f458d80a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.466162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e70acf-8984-402f-bf7c-66b0f458d80a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.472809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c9975-44f5-4426-9188-ae4595afa485 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.473204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c9975-44f5-4426-9188-ae4595afa485 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.473489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c9975-44f5-4426-9188-ae4595afa485 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.475827 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 345/689] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:44.476692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.477587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.478057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.478517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.479582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:44.480868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c6c5-c31c-40e2-b9dc-57fb01347fb7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.481337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c6c5-c31c-40e2-b9dc-57fb01347fb7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.481824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c6c5-c31c-40e2-b9dc-57fb01347fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.485572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.487345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.499821 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 345/690] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:44.505825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.508493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6844c6c5-c31c-40e2-b9dc-57fb01347fb7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:44.509828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6844c6c5-c31c-40e2-b9dc-57fb01347fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:44.519007 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 346/691] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:44.526569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f9fa4-9b5e-4cae-af82-7404da004145 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.538802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.539597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.540133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.540444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.544893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c6c5-c31c-40e2-b9dc-57fb01347fb7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.555819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c6c5-c31c-40e2-b9dc-57fb01347fb7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.560352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.561399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.562216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.563089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.563579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.563990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.564801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.565940 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:44.565940 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:44.565940 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:44.567119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.582097 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 19 20:35:44.588680 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 347/692] 10.222.0.30 () {56 vars in 1150 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:44.590296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.596460 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:44.597964 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 346/693] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:44.602059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0d22d-5d66-4720-992b-884a4a512dd6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.603015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.606260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.607021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.607305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.607582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.608281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:44.608621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.610732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.615530 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 348/694] 10.222.0.30 () {56 vars in 1145 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:44.624752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad23339-0904-48f8-b1e0-fa0ed19d510a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.626645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.638908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8db8-5232-4888-9540-4ce5db6a1d43 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.641149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.641810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.642089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.642360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.643080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:44.643382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.645032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.658896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.659799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.660162 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 347/695] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:44.660527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.660985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.661870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:44.662356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.664115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.667150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.677221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d2621-9d46-4d9d-955f-f39401c27eec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.679690 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 349/696] 10.222.0.30 () {56 vars in 1145 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:44.682044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d658c2-7dc2-4566-8b0c-e16e86402fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.682837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d658c2-7dc2-4566-8b0c-e16e86402fac admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.683118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d658c2-7dc2-4566-8b0c-e16e86402fac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.683578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d658c2-7dc2-4566-8b0c-e16e86402fac admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.691981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d658c2-7dc2-4566-8b0c-e16e86402fac admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.694204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d658c2-7dc2-4566-8b0c-e16e86402fac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.709726 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-98d658c2-7dc2-4566-8b0c-e16e86402fac admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:35:44.711303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 348/697] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:44.718233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.729975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ffa7a-b36b-4b32-9d25-95f47d818e9a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.730286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ffa7a-b36b-4b32-9d25-95f47d818e9a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.730504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ffa7a-b36b-4b32-9d25-95f47d818e9a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.732745 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 349/698] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:44.737725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dead6b-ad61-46c9-9983-164df0ae1ed1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.738005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dead6b-ad61-46c9-9983-164df0ae1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.738274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dead6b-ad61-46c9-9983-164df0ae1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.744175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fd9e-ebc6-4057-901a-ff14328a75ca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.763398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.764109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.764379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.764640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.765479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:44.766359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.769424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-06dead6b-ad61-46c9-9983-164df0ae1ed1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:44.770657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-06dead6b-ad61-46c9-9983-164df0ae1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:44.770996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.791406 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 350/699] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 19 20:35:44.792615 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 350/700] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:44.797268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dead6b-ad61-46c9-9983-164df0ae1ed1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.815481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dead6b-ad61-46c9-9983-164df0ae1ed1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.817881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.825627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919519e-8851-4dcb-ad97-0791ae2bb9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.826624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919519e-8851-4dcb-ad97-0791ae2bb9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.827048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919519e-8851-4dcb-ad97-0791ae2bb9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.827468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919519e-8851-4dcb-ad97-0791ae2bb9d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.832423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d867-a85b-47f4-885b-0263aa67433f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.833822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac7dc2-5726-40cd-9b5e-8fa244dfc56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.834657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac7dc2-5726-40cd-9b5e-8fa244dfc56a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.834936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac7dc2-5726-40cd-9b5e-8fa244dfc56a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.835263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac7dc2-5726-40cd-9b5e-8fa244dfc56a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.844173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919519e-8851-4dcb-ad97-0791ae2bb9d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.846218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919519e-8851-4dcb-ad97-0791ae2bb9d2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.846954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac7dc2-5726-40cd-9b5e-8fa244dfc56a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:44.854210 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6bac7dc2-5726-40cd-9b5e-8fa244dfc56a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:44.855910 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 351/701] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:44.861684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac7dc2-5726-40cd-9b5e-8fa244dfc56a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.862329 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 351/702] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:44.867863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919519e-8851-4dcb-ad97-0791ae2bb9d2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.872628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac7dc2-5726-40cd-9b5e-8fa244dfc56a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.878122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.879084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.879584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.880002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.880979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:44.881423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.881532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919519e-8851-4dcb-ad97-0791ae2bb9d2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.883534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.896670 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 352/703] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:44.897619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.898642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.899092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.899533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.912029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.913819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.921676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.927117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797920b-35de-44e3-a7d8-142b39ee1fec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.935170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.936138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.938692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.938692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.951024 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:44.952983 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 352/704] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:44.957201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.959377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.960627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.971462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc72c2-f6b2-4f85-8ff2-e57a6f6c9762 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:44.977152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:44.977817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:44.978094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:44.978363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:44.979090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:44.979391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:44.981013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:44.986759 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:44.992473 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 353/705] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:44.994232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:44.996081 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 353/706] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:45.004545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.011381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d62356-8af0-4c70-a24b-8767da669ed4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.018669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.019636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.020203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.020628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.021453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:45.021904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.022664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4ac9-854f-4893-947b-d7f195cf5a8b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.023807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.036772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 354/707] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:45.042104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.045034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.045842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.046134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.046416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.052547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db17f4d-73b3-4a5d-bbc9-b7bba6848979 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.057610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.058443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.058719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.058995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.066424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.068387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.068531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.070485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.086051 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 19 20:35:45.087193 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 355/708] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:45.091868 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:45.095402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.101352 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 354/709] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:45.108241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.110808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7a8f1-72b4-40e0-af95-046f2a06e8d4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.115409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.116075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.116371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.116649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.117750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:45.118056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.119980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.130854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa192-c8b6-4c91-8c7d-76c04d7aaed7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.140407 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 356/710] 10.222.0.30 () {56 vars in 1156 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:45.146589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.153028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.153695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.153978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.154250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.155042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:45.155355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.157356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.158029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa5ab1-b819-446e-af14-a59910c0a1ca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.163476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dbd4f-1092-41f7-8526-ed17169e3a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.165154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dbd4f-1092-41f7-8526-ed17169e3a64 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.165648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dbd4f-1092-41f7-8526-ed17169e3a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.166185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dbd4f-1092-41f7-8526-ed17169e3a64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.176159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dbd4f-1092-41f7-8526-ed17169e3a64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.178285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dbd4f-1092-41f7-8526-ed17169e3a64 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.178808 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 355/711] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:45.186068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.195481 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 357/712] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:35:45.201576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dbd4f-1092-41f7-8526-ed17169e3a64 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.206671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44220390-ad9a-4b91-8977-7f4d8705de0a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.211421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dbd4f-1092-41f7-8526-ed17169e3a64 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.216175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.217200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.217798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.218242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.225017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.225678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.225955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.226253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.227063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=a20eaaff207f4d1b870c6abf0a50f1c8) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:45.227376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.229257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.230898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.233754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.238488 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 356/713] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/role_assignments?user.id=a20eaaff207f4d1b870c6abf0a50f1c8&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:45.261902 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:45.268753 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 358/714] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:45.269708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.288084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfb128-fd7a-4c1e-b299-a2e0f095a1b0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.302293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.302990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.303276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.303553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.304313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:45.304651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.306346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.330144 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 357/715] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:45.335906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.354952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0e4d-d9b7-4301-9e86-48aebae4734f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.367061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.368106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.368583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.369052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.380374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.382640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.399258 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:45.400740 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 359/716] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:45.406536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.423409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9704-f70c-48a0-87ad-016ed7ee548b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.438273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c4622-4442-4e09-b10e-884ec91963b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.438949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4622-4442-4e09-b10e-884ec91963b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.439228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4622-4442-4e09-b10e-884ec91963b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.439498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4622-4442-4e09-b10e-884ec91963b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.440298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c4622-4442-4e09-b10e-884ec91963b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:45.440641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c4622-4442-4e09-b10e-884ec91963b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.442497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c4622-4442-4e09-b10e-884ec91963b3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.466027 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 358/717] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:45.472319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:45.489606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b545c-f49d-47d8-96d6-9300adcf601f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:45.496737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5f531-4676-4c30-b456-391728a26a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:45.497722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f531-4676-4c30-b456-391728a26a76 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:45.498189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f531-4676-4c30-b456-391728a26a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:45.498663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f531-4676-4c30-b456-391728a26a76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:45.499702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5f531-4676-4c30-b456-391728a26a76 admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=4b7a16fa195446e18f5c5982a127b88e) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:45.504786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5f531-4676-4c30-b456-391728a26a76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:45.507125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5f531-4676-4c30-b456-391728a26a76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:45.514264 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 360/718] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:45 2022] GET /identity/v3/role_assignments?user.id=4b7a16fa195446e18f5c5982a127b88e&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:46.520821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8384b-fe00-4cb4-b0a1-d8be11c80ca8 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.521342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8384b-fe00-4cb4-b0a1-d8be11c80ca8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.521417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8384b-fe00-4cb4-b0a1-d8be11c80ca8 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.523395 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 359/719] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:46.528812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022713-51bd-451c-b7e4-81457cb968eb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.529231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022713-51bd-451c-b7e4-81457cb968eb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.529402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022713-51bd-451c-b7e4-81457cb968eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.548295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2d022713-51bd-451c-b7e4-81457cb968eb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:46.549511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2d022713-51bd-451c-b7e4-81457cb968eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:46.558193 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 361/720] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:46.601250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8384b-fe00-4cb4-b0a1-d8be11c80ca8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:46.611027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a592f-031d-4ad2-8bc4-d492eb185f0e None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.611316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a592f-031d-4ad2-8bc4-d492eb185f0e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.611592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a592f-031d-4ad2-8bc4-d492eb185f0e None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.613716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 362/721] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:46.616959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8384b-fe00-4cb4-b0a1-d8be11c80ca8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:46.621477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034a36-eedb-48ea-a7de-29d5d4bfc022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:46.622252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034a36-eedb-48ea-a7de-29d5d4bfc022 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.622532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034a36-eedb-48ea-a7de-29d5d4bfc022 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.622809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034a36-eedb-48ea-a7de-29d5d4bfc022 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.628364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff4c5-45b4-430e-a476-68ae71ba96a0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.628638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff4c5-45b4-430e-a476-68ae71ba96a0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.628921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff4c5-45b4-430e-a476-68ae71ba96a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.635580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33034a36-eedb-48ea-a7de-29d5d4bfc022 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:46.643052 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-33034a36-eedb-48ea-a7de-29d5d4bfc022 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:46.644613 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 360/722] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:46.652467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034a36-eedb-48ea-a7de-29d5d4bfc022 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:46.665614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-016ff4c5-45b4-430e-a476-68ae71ba96a0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:46.666820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-016ff4c5-45b4-430e-a476-68ae71ba96a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:46.667344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034a36-eedb-48ea-a7de-29d5d4bfc022 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:46.675063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:46.676172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.676708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.677180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.678515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:46.679046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:46.682048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:46.682864 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 363/723] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 19 20:35:46.697573 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 361/724] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:46.703258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ff4c5-45b4-430e-a476-68ae71ba96a0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:46.714701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ff4c5-45b4-430e-a476-68ae71ba96a0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:46.721188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:46.722344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.722770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.723185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.733959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:46.752535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79a130-7fbf-4641-a00b-051650a8576e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:46.754849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:46.757556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:46.773132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:46.773733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.774012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.774283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.775022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:46.776026 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:46.776026 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:46.776026 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:46.776921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:46.792238 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:46.793929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 364/725] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:46.799170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:46.811429 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 362/726] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:35:46 2022] POST /identity/v3/services => generated 240 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:35:46.823138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5946e8-d71e-4151-8125-875d18165d96 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:46.841763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:46.842441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.842722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.842995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.844296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:46.847934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:46.847934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:46.863838 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 365/727] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:46.869273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:46.886575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0f42-d2aa-4c7b-85eb-2ff2468b6f90 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:46.894384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:46.895223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.895506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.895784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.908281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:46.910601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:46.931762 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 19 20:35:46.933058 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 363/728] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:35:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:46.940142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:46.954203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584735d4-db61-43ce-ae41-222b368fa750 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:46.963151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:46.963910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:46.964191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:46.964490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:46.965357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:46.965671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:46.967547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:46.988140 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 366/729] 10.222.0.30 () {56 vars in 1170 bytes} [Sat Feb 19 20:35:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:46.993692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:47.007326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ad6c-e903-4a50-ab01-7f5c5069a141 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:47.013442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80aefb3-b4a3-4023-92b8-3455a3009656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:47.014089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aefb3-b4a3-4023-92b8-3455a3009656 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.014369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aefb3-b4a3-4023-92b8-3455a3009656 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.014643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aefb3-b4a3-4023-92b8-3455a3009656 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.023814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80aefb3-b4a3-4023-92b8-3455a3009656 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:47.025516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80aefb3-b4a3-4023-92b8-3455a3009656 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:47.040734 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 364/730] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:46 2022] GET /identity/v3/auth/tokens => generated 1013 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:35:47.044774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:47.060800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c57b58-7917-4d0b-8528-8030cdefe534 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:47.065779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:47.066922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.067330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.067788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.079920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:47.081971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:47.113546 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:47.115900 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 367/731] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:47.123496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80aefb3-b4a3-4023-92b8-3455a3009656 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:47.136315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80aefb3-b4a3-4023-92b8-3455a3009656 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:47.142691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:47.143706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.144126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.144623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.145795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:47.146298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:47.148321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:47.161720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 365/732] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:47.167363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:47.178091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd59db-7316-4543-a6a0-bd97f1c32301 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:47.183224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:47.184121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.184428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.184703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.193965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:47.195932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:47.209674 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:47.211170 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 368/733] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:47.216746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:47.227089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b9a04-680a-48ba-b2db-ab5768a494a9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:47.231845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1c1b2-89f8-4691-a04b-3e86b0542ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:47.232527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1c1b2-89f8-4691-a04b-3e86b0542ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.232814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1c1b2-89f8-4691-a04b-3e86b0542ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.233094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1c1b2-89f8-4691-a04b-3e86b0542ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.233882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1c1b2-89f8-4691-a04b-3e86b0542ec8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:47.234195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1c1b2-89f8-4691-a04b-3e86b0542ec8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:47.237758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1c1b2-89f8-4691-a04b-3e86b0542ec8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:47.258045 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 366/734] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:47.263972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:47.278679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03d82e-3318-481d-9a0d-e216776f64d0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:47.286666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cf9e1-3914-41cb-9140-c934aa7fdc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:47.287313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cf9e1-3914-41cb-9140-c934aa7fdc63 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.287595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cf9e1-3914-41cb-9140-c934aa7fdc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.287870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cf9e1-3914-41cb-9140-c934aa7fdc63 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.288789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cf9e1-3914-41cb-9140-c934aa7fdc63 admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=6793b09e5394441bb1f700e1aca9a7b0) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:47.289157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cf9e1-3914-41cb-9140-c934aa7fdc63 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:47.291249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cf9e1-3914-41cb-9140-c934aa7fdc63 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:47.302208 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 369/735] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:47 2022] GET /identity/v3/role_assignments?user.id=6793b09e5394441bb1f700e1aca9a7b0&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:47.517053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51253-dc3b-4915-a7ff-d199d56a8b98 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.517732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51253-dc3b-4915-a7ff-d199d56a8b98 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.518213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51253-dc3b-4915-a7ff-d199d56a8b98 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.520516 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 367/736] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:47.525386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19657314-f92f-4420-8a2c-61a3fd3642a8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.525895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19657314-f92f-4420-8a2c-61a3fd3642a8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.526364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19657314-f92f-4420-8a2c-61a3fd3642a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.544140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-19657314-f92f-4420-8a2c-61a3fd3642a8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:47.546132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-19657314-f92f-4420-8a2c-61a3fd3642a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:47.554463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 370/737] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:47 2022] POST /identity/v3/auth/tokens => generated 1013 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:35:47.580447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d51253-dc3b-4915-a7ff-d199d56a8b98 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:47.594066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d51253-dc3b-4915-a7ff-d199d56a8b98 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:47.603990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c52ea-348b-453c-92cc-366bb1686f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:47.604965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c52ea-348b-453c-92cc-366bb1686f54 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:47.605441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c52ea-348b-453c-92cc-366bb1686f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:47.605906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c52ea-348b-453c-92cc-366bb1686f54 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:47.606830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c52ea-348b-453c-92cc-366bb1686f54 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:47.608688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c52ea-348b-453c-92cc-366bb1686f54 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:47.670350 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 368/738] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:35:47 2022] POST /identity/v3/services => generated 251 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:48.398234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532c53-ca6d-4736-b46b-ebe1be152f3d None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.398607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532c53-ca6d-4736-b46b-ebe1be152f3d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.398784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd532c53-ca6d-4736-b46b-ebe1be152f3d None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.400687 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 371/739] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:48.409353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9caf9-07d8-439a-b362-84bf26a08234 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.409684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9caf9-07d8-439a-b362-84bf26a08234 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.409989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9caf9-07d8-439a-b362-84bf26a08234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.437318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e6c9caf9-07d8-439a-b362-84bf26a08234 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:48.438584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e6c9caf9-07d8-439a-b362-84bf26a08234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:48.465896 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 369/740] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:48 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:48.503551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd532c53-ca6d-4736-b46b-ebe1be152f3d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:48.522028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd532c53-ca6d-4736-b46b-ebe1be152f3d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:48.532769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a0ae4-2a46-495c-8e59-a79b2db7bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:48.533545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0ae4-2a46-495c-8e59-a79b2db7bd87 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.533818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0ae4-2a46-495c-8e59-a79b2db7bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.534085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0ae4-2a46-495c-8e59-a79b2db7bd87 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.553701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a0ae4-2a46-495c-8e59-a79b2db7bd87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:48.560323 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-be9a0ae4-2a46-495c-8e59-a79b2db7bd87 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:48.561840 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 372/741] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:48.568124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9caf9-07d8-439a-b362-84bf26a08234 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:48.577345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9caf9-07d8-439a-b362-84bf26a08234 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:48.589867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:48.590628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.590836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.591116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.591879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:48.592187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:48.593901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:48.608930 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 370/742] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:48.614698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a0ae4-2a46-495c-8e59-a79b2db7bd87 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:48.631055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a0ae4-2a46-495c-8e59-a79b2db7bd87 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:48.645666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:48.646471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.646745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.647011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.666633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:48.668395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:48.695337 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:48.696882 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 373/743] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:48.705697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:48.724313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029906ec-e0df-4e06-985b-ebf5e4b6915d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:48.745142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:48.746226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.746745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.747218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.748147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:48.748671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:48.751093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:48.769008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 371/744] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:48.775004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:48.789231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6d278-b9b4-4a2e-9781-14272bbcde42 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:48.801868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:48.802653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.802937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.803209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.817435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:48.819443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:48.839612 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:35:48.841129 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 374/745] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:35:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:48.846449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:48.856694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc6bb6-4ee9-4fb0-a933-cbd03229359c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:48.873476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:48.874400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.875401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.876014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.877020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:48.877472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:48.879482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:48.904942 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 372/746] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:35:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:48.910904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:48.925797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c2ee7-4f43-4e2c-9a3a-d6e9d64e064c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:48.941868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:48.942647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:48.942922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:48.943198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:48.963897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:48.965756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:48.994665 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:48.996145 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 375/747] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:49.001940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.013646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6fad-802f-4040-88e4-6448bce923b5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.030424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.031403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.031885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.032397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.033320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.033819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.035635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.049069 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 373/748] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:49.054451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.070417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c2db-6cd9-428b-9fcc-58421207e2d8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.080587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee266c5-5b74-4204-9cb1-f501d5b5285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.081373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee266c5-5b74-4204-9cb1-f501d5b5285e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.081651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee266c5-5b74-4204-9cb1-f501d5b5285e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.081925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee266c5-5b74-4204-9cb1-f501d5b5285e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.101055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee266c5-5b74-4204-9cb1-f501d5b5285e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.103040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee266c5-5b74-4204-9cb1-f501d5b5285e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.128426 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-3ee266c5-5b74-4204-9cb1-f501d5b5285e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:49.129940 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 376/749] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:49.135374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.149552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca5285-8de7-4a3d-9f4a-949315aa85bf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.166644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.167644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.168129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.168639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.169629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.170135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.172807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.173509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fe954-41d9-4cc8-bf59-5defe538979a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.173795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fe954-41d9-4cc8-bf59-5defe538979a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.174071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fe954-41d9-4cc8-bf59-5defe538979a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.175886 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 377/750] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:49.185511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9f02b-a107-4723-b6b7-659c9dac59dc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.185924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9f02b-a107-4723-b6b7-659c9dac59dc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.186223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9f02b-a107-4723-b6b7-659c9dac59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.189465 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 374/751] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:49.197241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.207559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c21ba-f298-4810-a096-77bfb0421533 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.212402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-33f9f02b-a107-4723-b6b7-659c9dac59dc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:49.212522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-33f9f02b-a107-4723-b6b7-659c9dac59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:49.218402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ffe2d-9de0-4c00-b434-9aec60ba84a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.219467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ffe2d-9de0-4c00-b434-9aec60ba84a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.219751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ffe2d-9de0-4c00-b434-9aec60ba84a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.220136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ffe2d-9de0-4c00-b434-9aec60ba84a1 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/a20eaaff207f4d1b870c6abf0a50f1c8/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.222360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ffe2d-9de0-4c00-b434-9aec60ba84a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=a20eaaff207f4d1b870c6abf0a50f1c8, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.222677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 378/752] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:49 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:49.227041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ffe2d-9de0-4c00-b434-9aec60ba84a1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.244237 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 375/753] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:49 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/a20eaaff207f4d1b870c6abf0a50f1c8/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:35:49.263131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9f02b-a107-4723-b6b7-659c9dac59dc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.272895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9f02b-a107-4723-b6b7-659c9dac59dc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.364109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0e606-60ec-405d-abf7-8c3a4c6e35da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.364952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0e606-60ec-405d-abf7-8c3a4c6e35da admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.365231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0e606-60ec-405d-abf7-8c3a4c6e35da admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.365505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0e606-60ec-405d-abf7-8c3a4c6e35da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.380612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0e606-60ec-405d-abf7-8c3a4c6e35da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:49.389213 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-2fa0e606-60ec-405d-abf7-8c3a4c6e35da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:49.390860 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 379/754] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:49.396659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ffe2d-9de0-4c00-b434-9aec60ba84a1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.418255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ffe2d-9de0-4c00-b434-9aec60ba84a1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.430671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.431748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.432255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.432760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.433734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.434250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.436100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.456884 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 376/755] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:49.462001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0e606-60ec-405d-abf7-8c3a4c6e35da admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.474019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0e606-60ec-405d-abf7-8c3a4c6e35da admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.481905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.483211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.483695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.484162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.500556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.502511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.520143 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:49.521696 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 380/756] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:49.527329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.537468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dda2f-77f3-4748-be83-96b31b2eb8c9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.542696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.543609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.544149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.544620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.545561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.546039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.547878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.560794 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 377/757] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:49.568647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.580351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ea71-318d-41f4-988c-454625a14ab8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.585178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.586220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.586695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.587183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.595954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.598301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.615177 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 19 20:35:49.616899 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 381/758] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:49.622960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.637420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84a3b-7d09-4a78-bb5e-09db17c31e6b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.653023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.654023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.654525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.655040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.656107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.656672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.658760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.681393 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 378/759] 10.222.0.30 () {56 vars in 1156 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:49.687369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.705465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d68ec-6cc2-4915-b62c-3aa684a036ad admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.716943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbc1e7-af61-4001-aa73-f1aaf7250bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.717596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbc1e7-af61-4001-aa73-f1aaf7250bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.717874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbc1e7-af61-4001-aa73-f1aaf7250bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.718150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbc1e7-af61-4001-aa73-f1aaf7250bc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.732062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbc1e7-af61-4001-aa73-f1aaf7250bc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.733880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbc1e7-af61-4001-aa73-f1aaf7250bc2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.744260 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 382/760] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:35:49.750607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.759901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bee2a-fbb9-4e83-8d0a-e9402a70a74c None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.760409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bee2a-fbb9-4e83-8d0a-e9402a70a74c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.760882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bee2a-fbb9-4e83-8d0a-e9402a70a74c None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.763598 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 383/761] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:49.770225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9f726-bc7f-437c-8735-273676e55af9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.770794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9f726-bc7f-437c-8735-273676e55af9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.771176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9f726-bc7f-437c-8735-273676e55af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.773107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aedea3-7418-479c-9444-de8869fa998d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.789020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.790312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.790730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-75b9f726-bc7f-437c-8735-273676e55af9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:49.790877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.791271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.792495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-75b9f726-bc7f-437c-8735-273676e55af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:49.804508 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 384/762] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:49 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:49.811353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.814131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.834317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9f726-bc7f-437c-8735-273676e55af9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.845189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9f726-bc7f-437c-8735-273676e55af9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.849444 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:49.850295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.856364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.856364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.856364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] PATH_INFO: `/v3/services/network` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.856364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.856364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.857078 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 379/763] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:49.858030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.866617 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 19 20:35:49.868213 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 385/764] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:49.874896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.878087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137341-3bcb-4f9d-b4cf-d7fb718f44c7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.887023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.887700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.888548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.888832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.889563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.890355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6a1e-1f17-4b29-9521-4c35afff3520 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.891273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.894882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.900969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.901624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.901905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.904816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.905585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] RBAC: Adding query filter params (name=network) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.905948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.911931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.917790 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 380/765] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:49.921279 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 386/766] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:49.926274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.936778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346d097-99b1-47dd-9a81-4a609a7c13e9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.938965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.949380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62811e98-f601-4452-b8fd-a5f5a01a4dce admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.954912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.955042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.955606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.955798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.955893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.956058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.956202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.956381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.957048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.957362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.959059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.965326 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 387/767] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:49.971434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:49.973428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.975405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.981505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076964f-2de1-48d4-a409-1eced433c4f4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:49.986749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:49.987447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:49.987735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:49.988073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:49.989116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] RBAC: Adding query filter params (interface=public, service_id=c8f740c926664cfe8dc5fce57c739239, region_id=RegionOne) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:49.989433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:49.990494 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:49.990494 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:49.990494 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:49.991471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:49.999755 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 388/768] 10.222.0.30 () {56 vars in 1272 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/endpoints?service_id=c8f740c926664cfe8dc5fce57c739239&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:50.003869 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:50.005564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.005762 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 381/769] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:50.011245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.016636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9a7f1-3e63-44ce-9465-7f823de2964d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.022109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1645f6-0278-49d7-a8fa-1d7e446cdd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.022750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1645f6-0278-49d7-a8fa-1d7e446cdd3e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.023214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1645f6-0278-49d7-a8fa-1d7e446cdd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.023493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1645f6-0278-49d7-a8fa-1d7e446cdd3e admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.024215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1645f6-0278-49d7-a8fa-1d7e446cdd3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.025963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1645f6-0278-49d7-a8fa-1d7e446cdd3e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.030663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e588-9216-4f09-88cc-4bf562cc69b5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.031942 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 389/770] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:50.053279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de557683-cc9c-42ef-bd77-78ebb22f775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.053973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557683-cc9c-42ef-bd77-78ebb22f775f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.054254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557683-cc9c-42ef-bd77-78ebb22f775f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.054529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557683-cc9c-42ef-bd77-78ebb22f775f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.055356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de557683-cc9c-42ef-bd77-78ebb22f775f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:50.055666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de557683-cc9c-42ef-bd77-78ebb22f775f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.057614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de557683-cc9c-42ef-bd77-78ebb22f775f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.074135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 382/771] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:50.080817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1645f6-0278-49d7-a8fa-1d7e446cdd3e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.096645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1645f6-0278-49d7-a8fa-1d7e446cdd3e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.103505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086409b1-52fd-40dc-9ae1-bc1b461515fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.104220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086409b1-52fd-40dc-9ae1-bc1b461515fb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.104532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086409b1-52fd-40dc-9ae1-bc1b461515fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.104814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086409b1-52fd-40dc-9ae1-bc1b461515fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.105710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086409b1-52fd-40dc-9ae1-bc1b461515fb admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=4b7a16fa195446e18f5c5982a127b88e) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:50.106025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086409b1-52fd-40dc-9ae1-bc1b461515fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.108053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086409b1-52fd-40dc-9ae1-bc1b461515fb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.118897 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 390/772] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/role_assignments?user.id=4b7a16fa195446e18f5c5982a127b88e&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:50.226384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96907d-5810-46ff-a278-1d2720ee15d3 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.226601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96907d-5810-46ff-a278-1d2720ee15d3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.226857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96907d-5810-46ff-a278-1d2720ee15d3 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.229147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 383/773] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:50.235536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd671f2-f429-4811-9c63-40ae63d1d2d6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.235830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd671f2-f429-4811-9c63-40ae63d1d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.236095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd671f2-f429-4811-9c63-40ae63d1d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.260811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dbd671f2-f429-4811-9c63-40ae63d1d2d6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:50.262094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dbd671f2-f429-4811-9c63-40ae63d1d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:50.276572 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 391/774] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:50 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:50.313243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96907d-5810-46ff-a278-1d2720ee15d3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.328297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96907d-5810-46ff-a278-1d2720ee15d3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.334259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3180cfc-997b-4376-91d2-48f2ff3c428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.335048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3180cfc-997b-4376-91d2-48f2ff3c428f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.335333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3180cfc-997b-4376-91d2-48f2ff3c428f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.335609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3180cfc-997b-4376-91d2-48f2ff3c428f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.347645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3180cfc-997b-4376-91d2-48f2ff3c428f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:50.354780 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-f3180cfc-997b-4376-91d2-48f2ff3c428f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:50.356202 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 384/775] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:50.362681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd671f2-f429-4811-9c63-40ae63d1d2d6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.372196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd671f2-f429-4811-9c63-40ae63d1d2d6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.377958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.378727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.379011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.379289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.380096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:50.380436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.382075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.396319 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 392/776] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:50.397666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3180cfc-997b-4376-91d2-48f2ff3c428f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.407837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3180cfc-997b-4376-91d2-48f2ff3c428f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.412714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.413562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.413847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.414122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.428698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.430690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.449111 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:50.454952 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 385/777] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:50.456976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.467117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fed77c-c508-4b76-9fc1-81497f757ba7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.472287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.472980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.473269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.473547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.474326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:50.474635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.476277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.489971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 393/778] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:50.496211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.507248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5731f59-2c76-4381-a656-061ebd7ca7d3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.512160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.513190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.513550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.513897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.525556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.527683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.544107 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 19 20:35:50.548052 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 386/779] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:50.551330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.561469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc3c32-1db9-4760-9976-bb70bd8c36ba admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.568705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.569422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.569707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.569980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.570884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:50.571201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.573158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.592636 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 394/780] 10.222.0.30 () {56 vars in 1170 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:50.601226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.618182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b00065-7378-4e08-8aad-26926ccc967e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.623947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.625453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.625740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.626024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.641471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.643391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.664896 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:50.666743 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 387/781] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:50.674434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.684539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaff46-da0f-4cfa-9701-2cf38c24aef1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.692683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.693339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.693621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.693900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.694680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:50.694991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.696724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.710035 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 395/782] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:50.715040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.729514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762902b7-84c6-4fef-a58e-b890fa466f88 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.734998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.735783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.736064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.736359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.748830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.751412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.768824 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:50.770236 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 388/783] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:50.775828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.791459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d251e-a1fd-40a9-8581-48f4a7610788 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.799324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf89c7-b7a7-4ae7-bd20-18a57ad8b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.799987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf89c7-b7a7-4ae7-bd20-18a57ad8b950 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.800268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf89c7-b7a7-4ae7-bd20-18a57ad8b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.800570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf89c7-b7a7-4ae7-bd20-18a57ad8b950 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.801363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf89c7-b7a7-4ae7-bd20-18a57ad8b950 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:50.801677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf89c7-b7a7-4ae7-bd20-18a57ad8b950 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.803536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf89c7-b7a7-4ae7-bd20-18a57ad8b950 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.822175 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 396/784] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:50.827575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:50.841293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521ffc-78d2-40d0-9810-54a0f13a6e64 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:50.848858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b213ab6-f833-410c-b1c6-d5622b6a4526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:50.849794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b213ab6-f833-410c-b1c6-d5622b6a4526 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:50.850074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b213ab6-f833-410c-b1c6-d5622b6a4526 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:50.850351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b213ab6-f833-410c-b1c6-d5622b6a4526 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/6793b09e5394441bb1f700e1aca9a7b0/roles/6af0e115d1f04a48893aa10bf6753ced` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:50.871745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b213ab6-f833-410c-b1c6-d5622b6a4526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=6793b09e5394441bb1f700e1aca9a7b0, role_id=6af0e115d1f04a48893aa10bf6753ced)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:50.874556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b213ab6-f833-410c-b1c6-d5622b6a4526 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:50.908305 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 389/785] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:50 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/6793b09e5394441bb1f700e1aca9a7b0/roles/6af0e115d1f04a48893aa10bf6753ced => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:51.195607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336547-9e84-403f-9fdc-6330d3dae508 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:51.195930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336547-9e84-403f-9fdc-6330d3dae508 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:51.196160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336547-9e84-403f-9fdc-6330d3dae508 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:51.198322 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 397/786] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:51.204117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbb867-ab51-471c-a045-ccffbfd991d6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:51.204469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbb867-ab51-471c-a045-ccffbfd991d6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:51.204723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbb867-ab51-471c-a045-ccffbfd991d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:51.224056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-debbb867-ab51-471c-a045-ccffbfd991d6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:51.225294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-debbb867-ab51-471c-a045-ccffbfd991d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:51.289835 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 390/787] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:51 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:51.316758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe336547-9e84-403f-9fdc-6330d3dae508 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:51.342022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe336547-9e84-403f-9fdc-6330d3dae508 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:51.348651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:51.349456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:51.349740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:51.350016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:51.350668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:51.352263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:51.368509 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 19 20:35:51.376241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 398/788] 10.222.0.30 () {56 vars in 1150 bytes} [Sat Feb 19 20:35:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:51.382101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbb867-ab51-471c-a045-ccffbfd991d6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:51.394572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbb867-ab51-471c-a045-ccffbfd991d6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:51.401437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:51.402390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:51.402855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:51.403353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:51.404239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:51.404757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:51.406614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:51.416638 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 391/789] 10.222.0.30 () {56 vars in 1145 bytes} [Sat Feb 19 20:35:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:51.422838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:51.442755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62920-c836-476f-a31d-6ca38fbff872 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:51.452867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:51.453526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:51.453812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:51.454093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:51.454827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:51.455138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:51.456817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:51.462565 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 399/790] 10.222.0.30 () {56 vars in 1145 bytes} [Sat Feb 19 20:35:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:51.470765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:51.485166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed1f17-c554-408d-85d0-2ea650a0b11e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:51.492452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b849868-4f6f-44d6-9750-6cba5bba621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:51.493462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849868-4f6f-44d6-9750-6cba5bba621b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:51.493927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849868-4f6f-44d6-9750-6cba5bba621b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:51.494399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849868-4f6f-44d6-9750-6cba5bba621b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:51.495406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b849868-4f6f-44d6-9750-6cba5bba621b admin admin] RBAC: Adding query filter params (interface=public, service_id=ec5f594570f946d4abe39b3b8978916f, region_id=RegionOne) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:51.496036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b849868-4f6f-44d6-9750-6cba5bba621b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:51.497353 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-7b849868-4f6f-44d6-9750-6cba5bba621b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:51.497353 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:51.497353 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:51.498531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b849868-4f6f-44d6-9750-6cba5bba621b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:51.515182 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 392/791] 10.222.0.30 () {56 vars in 1272 bytes} [Sat Feb 19 20:35:51 2022] GET /identity/v3/endpoints?service_id=ec5f594570f946d4abe39b3b8978916f&interface=public®ion_id=RegionOne => generated 194 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:51.520854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:51.530828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e89473-4a15-403f-90db-3ea1ce9fc7fa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:51.544419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a590a31-9e7a-419d-8911-16c1aeffc9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:51.545080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a590a31-9e7a-419d-8911-16c1aeffc9ae admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:51.545362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a590a31-9e7a-419d-8911-16c1aeffc9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:51.545640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a590a31-9e7a-419d-8911-16c1aeffc9ae admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:51.546328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a590a31-9e7a-419d-8911-16c1aeffc9ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:51.548543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a590a31-9e7a-419d-8911-16c1aeffc9ae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:51.554094 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 400/792] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:35:51 2022] GET /identity/v3/services => generated 772 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:52.313701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54e15-9ee2-42a8-ba99-5586bd15de88 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.314219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54e15-9ee2-42a8-ba99-5586bd15de88 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.314296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54e15-9ee2-42a8-ba99-5586bd15de88 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.316275 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 393/793] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:52.321910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483ec6-c91f-41b9-a8ab-fdb0ba222cf5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.322363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483ec6-c91f-41b9-a8ab-fdb0ba222cf5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.322443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9483ec6-c91f-41b9-a8ab-fdb0ba222cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.346192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a9483ec6-c91f-41b9-a8ab-fdb0ba222cf5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:52.347390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a9483ec6-c91f-41b9-a8ab-fdb0ba222cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:52.360356 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 401/794] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:52 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:35:52.397542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f54e15-9ee2-42a8-ba99-5586bd15de88 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.414700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f54e15-9ee2-42a8-ba99-5586bd15de88 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.423362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2653f-af23-40f6-bdec-24a32facc3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.424149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2653f-af23-40f6-bdec-24a32facc3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.424457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2653f-af23-40f6-bdec-24a32facc3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.424729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2653f-af23-40f6-bdec-24a32facc3a2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.438652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2653f-af23-40f6-bdec-24a32facc3a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:52.445368 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-36a2653f-af23-40f6-bdec-24a32facc3a2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:52.446715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 394/795] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:52.452372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9483ec6-c91f-41b9-a8ab-fdb0ba222cf5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.462910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9483ec6-c91f-41b9-a8ab-fdb0ba222cf5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.473105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.473760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.474040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.474315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.475057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:52.475361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.476979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.492875 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 402/796] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:52.498317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2653f-af23-40f6-bdec-24a32facc3a2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.513309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2653f-af23-40f6-bdec-24a32facc3a2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.521929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.522715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.522997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.523272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.540278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.542142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.562189 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:52.564168 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 395/797] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:52.569456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.585978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcb1dd-57e5-45d4-917d-af6b4913f49c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.594473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.595144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.595426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.595701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.596461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:52.596769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.598366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.611561 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 403/798] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:52.618447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.633316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa037b2a-c092-44a3-8456-ba0a11cf4fec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.640347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.641692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.641973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.642251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.661433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.663460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.688242 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:35:52.689775 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 396/799] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:52.695294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.710505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca2c63-36b9-40b6-88ca-af007ad99df1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.729033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46bad-fcc3-4d25-ba1b-aa6694ca09d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.729716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46bad-fcc3-4d25-ba1b-aa6694ca09d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.730002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46bad-fcc3-4d25-ba1b-aa6694ca09d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.730282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46bad-fcc3-4d25-ba1b-aa6694ca09d4 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.731129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d46bad-fcc3-4d25-ba1b-aa6694ca09d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:52.731442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d46bad-fcc3-4d25-ba1b-aa6694ca09d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.733330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d46bad-fcc3-4d25-ba1b-aa6694ca09d4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.755900 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 404/800] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:52.761336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.775881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58812-8d92-4222-818d-1adf8caad8d7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.784152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad0db-ada1-456b-beb9-3d965cbf1498 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.784480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad0db-ada1-456b-beb9-3d965cbf1498 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.784763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad0db-ada1-456b-beb9-3d965cbf1498 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.786816 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 405/801] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:52.789439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95e81f-39e6-466c-a429-026979303c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.790338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95e81f-39e6-466c-a429-026979303c91 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.790619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95e81f-39e6-466c-a429-026979303c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.790893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95e81f-39e6-466c-a429-026979303c91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.794746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa7952-c2c3-49e0-8b44-11a115e6860c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.794746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa7952-c2c3-49e0-8b44-11a115e6860c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.794746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa7952-c2c3-49e0-8b44-11a115e6860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.805165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95e81f-39e6-466c-a429-026979303c91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.806932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95e81f-39e6-466c-a429-026979303c91 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.813564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-82aa7952-c2c3-49e0-8b44-11a115e6860c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:52.814994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-82aa7952-c2c3-49e0-8b44-11a115e6860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:52.822197 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 397/802] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:35:52.824800 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 406/803] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:52 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:52.828457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95e81f-39e6-466c-a429-026979303c91 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.841375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95e81f-39e6-466c-a429-026979303c91 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.848568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.849343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.849628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.849908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.853690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa7952-c2c3-49e0-8b44-11a115e6860c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.868392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa7952-c2c3-49e0-8b44-11a115e6860c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.872917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.874850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.881473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31c19-30d3-4cae-91c4-fd52fc3a0df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.883637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31c19-30d3-4cae-91c4-fd52fc3a0df6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.883976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31c19-30d3-4cae-91c4-fd52fc3a0df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.884259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31c19-30d3-4cae-91c4-fd52fc3a0df6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.897728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc31c19-30d3-4cae-91c4-fd52fc3a0df6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:52.903844 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:52.904728 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-ffc31c19-30d3-4cae-91c4-fd52fc3a0df6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:52.911228 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 407/804] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:52.911517 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 398/805] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:52.912500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.912607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31c19-30d3-4cae-91c4-fd52fc3a0df6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.923187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31c19-30d3-4cae-91c4-fd52fc3a0df6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.928272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.929028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.929314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.929591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.930418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:52.930728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.932431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.934960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a9f41-6409-4527-a91f-9e81db5e308f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.943220 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 408/806] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:52.947028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.948735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:52.951178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.951483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.953634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.954433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:52.954802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:52.956425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:52.968037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83605377-a0d4-4eb5-add1-9ecc96e5ef02 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:52.977386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:52.979410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:52.979698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:52.979974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:52.986239 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 399/807] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:52.997717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.003966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.007361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.010682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e460e7-596e-449d-b50c-4ad599b186a6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.016867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.018047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.018333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.018665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.026766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.028780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.044095 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:53.044514 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:53.046088 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 400/808] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:53.048475 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 409/809] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:53.053967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.055925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.069488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39e153-8b50-456e-9e2b-71cb0509f954 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.069965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c49b9-ef3a-4cef-8d7f-a448dd72acdd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.076352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.076352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.076352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.076352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.076818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:53.077044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.079192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.086387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.087302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.087779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.088248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.089191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:53.089705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.091486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.092431 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 410/810] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:53.100407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.121136 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 401/811] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:53.128202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964761c-259b-4a13-a602-b93ca3ecbd53 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.130703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.143076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.143731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.144008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.144276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.145140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=a20eaaff207f4d1b870c6abf0a50f1c8) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:53.145449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.147286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.151546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d6a6-664e-4cae-9395-1352bef54e15 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.158659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.159445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.159725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.159994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.168770 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 411/812] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/role_assignments?user.id=a20eaaff207f4d1b870c6abf0a50f1c8&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 608 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:53.175257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.177292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.199033 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 19 20:35:53.205793 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 402/813] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:53.211381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.221384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad48c7-2135-48ed-98de-85d3fe11cd92 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.235236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45834e76-b138-4467-984e-909678713301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.235927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45834e76-b138-4467-984e-909678713301 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.236212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45834e76-b138-4467-984e-909678713301 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.236518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45834e76-b138-4467-984e-909678713301 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.237387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45834e76-b138-4467-984e-909678713301 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:53.237701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45834e76-b138-4467-984e-909678713301 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.239614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45834e76-b138-4467-984e-909678713301 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.272207 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 412/814] 10.222.0.30 () {56 vars in 1156 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:53.277711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.288599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca5fa6-f303-405b-befe-170f67cde8ee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.293387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588adff0-2096-4e7f-ab0b-24494d47fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.294167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588adff0-2096-4e7f-ab0b-24494d47fa2f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.294440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588adff0-2096-4e7f-ab0b-24494d47fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.294716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588adff0-2096-4e7f-ab0b-24494d47fa2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.306834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588adff0-2096-4e7f-ab0b-24494d47fa2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.308734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588adff0-2096-4e7f-ab0b-24494d47fa2f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.327168 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-588adff0-2096-4e7f-ab0b-24494d47fa2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:53.332753 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 403/815] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:53.334587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45834e76-b138-4467-984e-909678713301 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.342407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1871d9-2f81-4f62-b77a-cec2e14a62ad None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.342714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1871d9-2f81-4f62-b77a-cec2e14a62ad None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.343019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1871d9-2f81-4f62-b77a-cec2e14a62ad None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.346680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 404/816] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:53.351135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45834e76-b138-4467-984e-909678713301 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.355447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dfac7-39b2-4a0c-a16f-4b1cf36f2e26 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.355818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dfac7-39b2-4a0c-a16f-4b1cf36f2e26 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.355988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dfac7-39b2-4a0c-a16f-4b1cf36f2e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.360132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.360850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.361132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.361409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.362140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:53.362504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.364153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.376479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8e4dfac7-39b2-4a0c-a16f-4b1cf36f2e26 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:53.377714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8e4dfac7-39b2-4a0c-a16f-4b1cf36f2e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:53.388084 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 413/817] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:53.388867 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 405/818] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:53 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:53.394804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.411179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b05e70-7d9c-4732-9e4e-5afc33cb3347 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.425638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dfac7-39b2-4a0c-a16f-4b1cf36f2e26 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.436233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.437118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dfac7-39b2-4a0c-a16f-4b1cf36f2e26 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.438477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.438963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.439914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.448396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.449547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.450002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.450469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] PATH_INFO: `/v3/services/network` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.451336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.454122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.455810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.457867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.467210 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 19 20:35:53.469546 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 406/819] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:53.476857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.477174 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:53.479147 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 414/820] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:53.488812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26f12d-cbdf-4937-97bf-94619d7e6e86 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.489510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.493846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.494521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.495069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.495527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.496101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] RBAC: Adding query filter params (name=network) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:53.496444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.498903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.502381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c838da-617f-43a9-8485-1859152e7448 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.505600 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 407/821] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:53.512022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.512944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.516368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.516368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.516368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.516368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:53.516368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.517325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.527735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fffe8f-44f6-4d7b-b983-72e8aa25b8eb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.533610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.534321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.534658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.535675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.535675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] RBAC: Adding query filter params (type=network) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:53.535964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.542418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.542935 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 415/822] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:53.544054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.548989 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 408/823] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:35:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:35:53.556318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:53.558837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee51f5-a705-441b-a912-9296a2094693 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.567564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4508b4-91bb-4a1d-afde-0f8234e8f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.568845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4508b4-91bb-4a1d-afde-0f8234e8f57f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.569318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4508b4-91bb-4a1d-afde-0f8234e8f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.569786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4508b4-91bb-4a1d-afde-0f8234e8f57f admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/4b7a16fa195446e18f5c5982a127b88e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.570314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d726824-2b23-4d78-a7e1-05c564a57347 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:53.572433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4508b4-91bb-4a1d-afde-0f8234e8f57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=4b7a16fa195446e18f5c5982a127b88e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.575755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4508b4-91bb-4a1d-afde-0f8234e8f57f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.576292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0949897-cded-406a-be00-9b1624607618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:53.577097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949897-cded-406a-be00-9b1624607618 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.577506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949897-cded-406a-be00-9b1624607618 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.577848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949897-cded-406a-be00-9b1624607618 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.579367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0949897-cded-406a-be00-9b1624607618 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:53.580538 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-f0949897-cded-406a-be00-9b1624607618 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:53.580538 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:35:53.580538 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:35:53.581591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0949897-cded-406a-be00-9b1624607618 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:53.599972 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 416/824] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:35:53 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/4b7a16fa195446e18f5c5982a127b88e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:35:53.612753 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 409/825] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:35:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:35:53.903583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85be2-f6a6-43b3-8a41-7a78dc8b1b76 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.904159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85be2-f6a6-43b3-8a41-7a78dc8b1b76 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.904528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85be2-f6a6-43b3-8a41-7a78dc8b1b76 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.906639 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 417/826] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:53.912204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82d93b-60b0-44b1-b37b-f88a3d27b1d9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:53.912523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82d93b-60b0-44b1-b37b-f88a3d27b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:53.912794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82d93b-60b0-44b1-b37b-f88a3d27b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:53.935580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8a82d93b-60b0-44b1-b37b-f88a3d27b1d9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:53.937062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8a82d93b-60b0-44b1-b37b-f88a3d27b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:54.035909 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 410/827] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:53 2022] POST /identity/v3/auth/tokens => generated 1266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:54.061448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85be2-f6a6-43b3-8a41-7a78dc8b1b76 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.074301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85be2-f6a6-43b3-8a41-7a78dc8b1b76 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.079347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6afa2b-0ad0-4fc8-aebe-c258a3a26269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.080227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6afa2b-0ad0-4fc8-aebe-c258a3a26269 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.080640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6afa2b-0ad0-4fc8-aebe-c258a3a26269 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.081013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6afa2b-0ad0-4fc8-aebe-c258a3a26269 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.093225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6afa2b-0ad0-4fc8-aebe-c258a3a26269 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:54.100753 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-0e6afa2b-0ad0-4fc8-aebe-c258a3a26269 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:35:54.102492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 418/828] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:54.108031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82d93b-60b0-44b1-b37b-f88a3d27b1d9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.117672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82d93b-60b0-44b1-b37b-f88a3d27b1d9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.122231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.122887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.123168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.123444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.124190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:54.124541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.126674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.135140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 411/829] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:54.140304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6afa2b-0ad0-4fc8-aebe-c258a3a26269 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.151124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6afa2b-0ad0-4fc8-aebe-c258a3a26269 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.155739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.156531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.156815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.157089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.167814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.169691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.187953 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:54.193980 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 419/830] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:54.195425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.210234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ed59-00d4-4594-a54b-559b532b0200 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.215982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.216920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.217326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.217703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.218550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:54.219477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.221182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.233336 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 412/831] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:54.240278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.250248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1c91-bc66-4200-bef0-04e695ae8206 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.254930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eb583-2a54-4200-9565-498349938895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.255892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eb583-2a54-4200-9565-498349938895 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.256319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eb583-2a54-4200-9565-498349938895 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.256784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eb583-2a54-4200-9565-498349938895 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.264181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eb583-2a54-4200-9565-498349938895 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.266905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eb583-2a54-4200-9565-498349938895 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.281690 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-788eb583-2a54-4200-9565-498349938895 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 19 20:35:54.287602 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 420/832] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:54.289136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.299439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa842d-bbc9-4778-8bd1-39a0e543d4fc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.304124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.305002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.305433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.305895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.306883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:54.307338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.309362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.332434 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 413/833] 10.222.0.30 () {56 vars in 1170 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:54.335146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eb583-2a54-4200-9565-498349938895 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.345942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eb583-2a54-4200-9565-498349938895 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.350598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c48d98-bdd4-4e6d-b674-a5e89bcfe429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.351412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c48d98-bdd4-4e6d-b674-a5e89bcfe429 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.351842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c48d98-bdd4-4e6d-b674-a5e89bcfe429 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.352281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c48d98-bdd4-4e6d-b674-a5e89bcfe429 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.360421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c48d98-bdd4-4e6d-b674-a5e89bcfe429 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.362323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c48d98-bdd4-4e6d-b674-a5e89bcfe429 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.375870 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 421/834] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/auth/tokens => generated 1266 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:35:54.377375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.387230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f77e4-fd5d-41e3-b17d-16d78d7c0131 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.392448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.393398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.393837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.394274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.404842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.407515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.425440 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:54.431519 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 414/835] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:54.433798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c48d98-bdd4-4e6d-b674-a5e89bcfe429 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.443523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c48d98-bdd4-4e6d-b674-a5e89bcfe429 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.448614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.449544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.452556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.452556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.452556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:54.452556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.453537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.471568 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 422/836] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:54.473838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.483867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d6124-6f97-422b-be2a-1fbf778839bd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.492410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.494032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.494685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.495301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.503927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.506105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.519703 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:54.521375 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 415/837] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:54.529666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.540410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca0508-526c-42d1-bc01-01e18ef6df93 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.545183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7661f72-951c-4f2e-b18b-704253984a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.545840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7661f72-951c-4f2e-b18b-704253984a4c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.546125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7661f72-951c-4f2e-b18b-704253984a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.546404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7661f72-951c-4f2e-b18b-704253984a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.547748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7661f72-951c-4f2e-b18b-704253984a4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:54.548060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7661f72-951c-4f2e-b18b-704253984a4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.549975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7661f72-951c-4f2e-b18b-704253984a4c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.568198 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 423/838] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:54.569539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.580677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25d64-f34e-4d1d-93e9-849437db16c9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.585277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f0e08-4fea-4f6d-b371-3c6a29d56b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.585930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f0e08-4fea-4f6d-b371-3c6a29d56b70 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.586250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f0e08-4fea-4f6d-b371-3c6a29d56b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.586529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f0e08-4fea-4f6d-b371-3c6a29d56b70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.587405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f0e08-4fea-4f6d-b371-3c6a29d56b70 admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=6793b09e5394441bb1f700e1aca9a7b0) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:54.587715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f0e08-4fea-4f6d-b371-3c6a29d56b70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.589639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f0e08-4fea-4f6d-b371-3c6a29d56b70 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.599768 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 416/839] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/role_assignments?user.id=6793b09e5394441bb1f700e1aca9a7b0&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:54.818684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f7fd-69e2-4cb8-b066-ab802d450ac6 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.819041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f7fd-69e2-4cb8-b066-ab802d450ac6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.819240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f7fd-69e2-4cb8-b066-ab802d450ac6 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.821180 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 424/840] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:54.829028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ab7e-84ff-4848-bcc9-e2066a626910 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.829028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ab7e-84ff-4848-bcc9-e2066a626910 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.829028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ab7e-84ff-4848-bcc9-e2066a626910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.846854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2f26ab7e-84ff-4848-bcc9-e2066a626910 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:54.848393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2f26ab7e-84ff-4848-bcc9-e2066a626910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:54.856731 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 417/841] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:54 2022] POST /identity/v3/auth/tokens => generated 1266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:54.881651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5f7fd-69e2-4cb8-b066-ab802d450ac6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.895434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5f7fd-69e2-4cb8-b066-ab802d450ac6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.900209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.901307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.901822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.902298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.903175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.905017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.917522 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 19 20:35:54.919312 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 425/842] 10.222.0.30 () {56 vars in 1150 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:54.925963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26ab7e-84ff-4848-bcc9-e2066a626910 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.935477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26ab7e-84ff-4848-bcc9-e2066a626910 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.941018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.941905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.942419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.942898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.943815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:54.944361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.946240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.951432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 418/843] 10.222.0.30 () {56 vars in 1145 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:54.957120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:54.967323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5bd92-6f7a-434f-89d9-ea66b39a4b2f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:54.972305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9f79-aabe-4c1f-ba46-f8936c352fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:54.973222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9f79-aabe-4c1f-ba46-f8936c352fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:54.973841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9f79-aabe-4c1f-ba46-f8936c352fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:54.974327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9f79-aabe-4c1f-ba46-f8936c352fa6 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:54.975262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e9f79-aabe-4c1f-ba46-f8936c352fa6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:54.975771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e9f79-aabe-4c1f-ba46-f8936c352fa6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:54.977630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e9f79-aabe-4c1f-ba46-f8936c352fa6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:54.983837 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 426/844] 10.222.0.30 () {56 vars in 1145 bytes} [Sat Feb 19 20:35:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:54.993533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:55.004667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765a78c-9b96-4621-9e84-b88e5798e9d0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:55.009766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab49960-9d61-43fc-8c97-e59d2df3d221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:55.010684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab49960-9d61-43fc-8c97-e59d2df3d221 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:55.011183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab49960-9d61-43fc-8c97-e59d2df3d221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:55.011653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab49960-9d61-43fc-8c97-e59d2df3d221 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:55.012650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab49960-9d61-43fc-8c97-e59d2df3d221 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:55.014491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab49960-9d61-43fc-8c97-e59d2df3d221 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:55.036601 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 419/845] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:35:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:56.002876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba220c7-fde8-4ba7-8847-f6559fba03a8 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.003360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba220c7-fde8-4ba7-8847-f6559fba03a8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.003360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba220c7-fde8-4ba7-8847-f6559fba03a8 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.005501 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 427/846] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:56.010856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb836b3-8b02-4f94-b22c-e095e7cc93ef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.011283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb836b3-8b02-4f94-b22c-e095e7cc93ef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.011455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb836b3-8b02-4f94-b22c-e095e7cc93ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.029611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3eb836b3-8b02-4f94-b22c-e095e7cc93ef None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:56.030785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3eb836b3-8b02-4f94-b22c-e095e7cc93ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:56.047820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 420/847] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:56 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:56.071731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba220c7-fde8-4ba7-8847-f6559fba03a8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.084734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba220c7-fde8-4ba7-8847-f6559fba03a8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.089490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.090561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.091058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.091573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.092473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.094838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.106546 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 19 20:35:56.108217 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 428/848] 10.222.0.30 () {56 vars in 1153 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:56.117669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb836b3-8b02-4f94-b22c-e095e7cc93ef None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.126578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb836b3-8b02-4f94-b22c-e095e7cc93ef None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.131147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1777f-0bcf-4dbc-a214-3a1d0cc9e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.131850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1777f-0bcf-4dbc-a214-3a1d0cc9e055 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.132133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1777f-0bcf-4dbc-a214-3a1d0cc9e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.132463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1777f-0bcf-4dbc-a214-3a1d0cc9e055 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.133195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1777f-0bcf-4dbc-a214-3a1d0cc9e055 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:56.133504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1777f-0bcf-4dbc-a214-3a1d0cc9e055 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.135072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1777f-0bcf-4dbc-a214-3a1d0cc9e055 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.139927 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 421/849] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:56.145629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.156671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a2c29-6623-417e-81f1-adeca999b28a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.161355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ba6c9-d060-4999-b032-1b305b58ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.162005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba6c9-d060-4999-b032-1b305b58ae26 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.162286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba6c9-d060-4999-b032-1b305b58ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.162560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba6c9-d060-4999-b032-1b305b58ae26 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.163270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ba6c9-d060-4999-b032-1b305b58ae26 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:56.163576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ba6c9-d060-4999-b032-1b305b58ae26 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.165463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ba6c9-d060-4999-b032-1b305b58ae26 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.170535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 429/850] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:56.204108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14f68-58ad-4814-a8fa-b5ef3cd1a751 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.204460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14f68-58ad-4814-a8fa-b5ef3cd1a751 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.204730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14f68-58ad-4814-a8fa-b5ef3cd1a751 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.206664 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 422/851] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:56.212549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c885-8a58-42bd-8679-9b36f2638e07 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.213191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c885-8a58-42bd-8679-9b36f2638e07 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.213692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c885-8a58-42bd-8679-9b36f2638e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.233316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0508c885-8a58-42bd-8679-9b36f2638e07 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:56.235626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0508c885-8a58-42bd-8679-9b36f2638e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:56.244589 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 430/852] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:56 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:56.270400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b14f68-58ad-4814-a8fa-b5ef3cd1a751 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.287698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b14f68-58ad-4814-a8fa-b5ef3cd1a751 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.292452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a123c-7b5b-4809-a10b-b63eff5dd3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.293430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a123c-7b5b-4809-a10b-b63eff5dd3ca admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.293712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a123c-7b5b-4809-a10b-b63eff5dd3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.293982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a123c-7b5b-4809-a10b-b63eff5dd3ca admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.306332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a123c-7b5b-4809-a10b-b63eff5dd3ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:56.313519 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-ad1a123c-7b5b-4809-a10b-b63eff5dd3ca admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:35:56.315263 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 423/853] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:56.321304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c885-8a58-42bd-8679-9b36f2638e07 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.331312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c885-8a58-42bd-8679-9b36f2638e07 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.336379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.337342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.337833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.338320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.339315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:56.339830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.341719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.352149 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 431/854] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:56.358587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a123c-7b5b-4809-a10b-b63eff5dd3ca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.370687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a123c-7b5b-4809-a10b-b63eff5dd3ca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.374650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.375474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.375752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.376023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.389535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.391978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.410030 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:56.411525 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 424/855] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:56.417225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.427060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478938-9031-42b8-8a50-e3dd83ac4343 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.431684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.432349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.432639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.432916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.433637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:56.433943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.435530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.447782 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 432/856] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:56.454690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.464493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaea12-d48c-443f-836a-f1d971ae1b4c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.469652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.470426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.470699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.471030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.478538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.480608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.494651 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 19 20:35:56.496101 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 425/857] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:56.501655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.512136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adb7b6-2da3-45ff-8795-0ffd4ac5edfb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.517559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.518431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.518918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.519393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.520482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:56.521011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.523022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.542273 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 433/858] 10.222.0.30 () {56 vars in 1156 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:56.548258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.559312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be485b6-0316-4e45-a219-42aba4174d03 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.564436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16038932-7dd4-4962-ac9e-004055903a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.565334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038932-7dd4-4962-ac9e-004055903a3b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.565785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038932-7dd4-4962-ac9e-004055903a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.566296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038932-7dd4-4962-ac9e-004055903a3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.575052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16038932-7dd4-4962-ac9e-004055903a3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.577027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16038932-7dd4-4962-ac9e-004055903a3b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.587775 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 426/859] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:35:56.594645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.605257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb02a-ea84-4e96-b07e-66ffeacfe932 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.610824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.611838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.612368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.612839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.624092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.626819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.644178 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:56.646020 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 434/860] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:56.651705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16038932-7dd4-4962-ac9e-004055903a3b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.661172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16038932-7dd4-4962-ac9e-004055903a3b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.666260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.667148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.667606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.668057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.669058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:56.669540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.671359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.684254 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 427/861] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:56.690605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.706864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71636386-496e-4d2d-b301-83899f09031d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.711795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.712844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.713317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.713903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.721328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.723537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.742997 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:56.744829 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 435/862] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:56.752912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.763808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d3278-f0dc-4252-b212-2f1a3ea0b5ca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.769038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946f410-19ec-4017-8c0f-6ded1fd9a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.770057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946f410-19ec-4017-8c0f-6ded1fd9a0bc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.770580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946f410-19ec-4017-8c0f-6ded1fd9a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.771056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946f410-19ec-4017-8c0f-6ded1fd9a0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.772054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946f410-19ec-4017-8c0f-6ded1fd9a0bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:56.772573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946f410-19ec-4017-8c0f-6ded1fd9a0bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.774666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946f410-19ec-4017-8c0f-6ded1fd9a0bc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.789930 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 428/863] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:56.796469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:56.808116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09d0f-5045-4018-bc1f-d1b40b6922d7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:56.813527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594daaf-2a70-49ad-8aa2-73683a5da0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:56.814385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594daaf-2a70-49ad-8aa2-73683a5da0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:56.814901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594daaf-2a70-49ad-8aa2-73683a5da0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:56.815369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594daaf-2a70-49ad-8aa2-73683a5da0d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:56.816415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594daaf-2a70-49ad-8aa2-73683a5da0d3 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=4b7a16fa195446e18f5c5982a127b88e) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:56.816901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594daaf-2a70-49ad-8aa2-73683a5da0d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:56.818942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594daaf-2a70-49ad-8aa2-73683a5da0d3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:56.825736 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 436/864] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:56 2022] GET /identity/v3/role_assignments?user.id=4b7a16fa195446e18f5c5982a127b88e&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:57.150300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee9a61-0551-4e0a-b5f8-ef2f8bec110a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.150806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee9a61-0551-4e0a-b5f8-ef2f8bec110a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.150806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee9a61-0551-4e0a-b5f8-ef2f8bec110a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.153154 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 429/865] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:57.160427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6052e-bfb2-4baf-8c74-2959034117d8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.160977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6052e-bfb2-4baf-8c74-2959034117d8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.160977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6052e-bfb2-4baf-8c74-2959034117d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.180816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bcb6052e-bfb2-4baf-8c74-2959034117d8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:57.182184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bcb6052e-bfb2-4baf-8c74-2959034117d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:57.191903 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 437/866] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:57 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:57.217082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee9a61-0551-4e0a-b5f8-ef2f8bec110a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.229400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee9a61-0551-4e0a-b5f8-ef2f8bec110a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.233751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a33908-a674-40b2-a75b-f55b4456eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.235204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a33908-a674-40b2-a75b-f55b4456eb05 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.235484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a33908-a674-40b2-a75b-f55b4456eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.235751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a33908-a674-40b2-a75b-f55b4456eb05 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.246098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a33908-a674-40b2-a75b-f55b4456eb05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:35:57.254070 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b6a33908-a674-40b2-a75b-f55b4456eb05 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 19 20:35:57.255544 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 430/867] 10.222.0.30 () {56 vars in 1141 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:57.261263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6052e-bfb2-4baf-8c74-2959034117d8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.270773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6052e-bfb2-4baf-8c74-2959034117d8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.275494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.276138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.276449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.276722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.277521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:57.277822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.279456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.290475 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 438/868] 10.222.0.30 () {56 vars in 1136 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:57.296216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a33908-a674-40b2-a75b-f55b4456eb05 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.307128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a33908-a674-40b2-a75b-f55b4456eb05 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.312397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.313186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.313463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.313734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.325058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.326945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.343321 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:57.345444 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 431/869] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:57.350959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.360847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0d901-d30a-48fb-9449-3c9cf38723b6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.365401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.366052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.366347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.366601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.367317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:57.367679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.369362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.381675 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 439/870] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:57.389783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.400541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e956a-b648-4b6e-abd1-d6fb6b63b616 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.404962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.405758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.406643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.406929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.415609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.417636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.431299 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 19 20:35:57.432803 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 432/871] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:57.438516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.448901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c14c-90c2-484a-8ab3-fdbc25219ee6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.454262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.454935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.455213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.455484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.456322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:57.456702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.458628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.478992 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 440/872] 10.222.0.30 () {56 vars in 1170 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:57.484941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.494872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216af3df-4710-4b18-9262-14a239850abf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.499408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84dffde-4000-4671-b510-e2742b62959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.500630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dffde-4000-4671-b510-e2742b62959e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.500911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dffde-4000-4671-b510-e2742b62959e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.501185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dffde-4000-4671-b510-e2742b62959e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.509030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dffde-4000-4671-b510-e2742b62959e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.510908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dffde-4000-4671-b510-e2742b62959e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.520184 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 433/873] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:35:57.525643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.535894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501eb4-7be7-4adb-92f1-56378d4ca91c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.539391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e9ff-7aac-4f3a-8e50-5a536efca96b None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.539691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e9ff-7aac-4f3a-8e50-5a536efca96b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.539976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e9ff-7aac-4f3a-8e50-5a536efca96b None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.541262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.542361 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 434/874] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:35:57.542548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.542986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.543407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.547874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de093-e4d1-4748-b05d-da50c1ceee87 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.548166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de093-e4d1-4748-b05d-da50c1ceee87 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.548498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de093-e4d1-4748-b05d-da50c1ceee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.555629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.557573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.569495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1b9de093-e4d1-4748-b05d-da50c1ceee87 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:57.571124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1b9de093-e4d1-4748-b05d-da50c1ceee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:57.588522 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 435/875] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:57 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:35:57.606365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9de093-e4d1-4748-b05d-da50c1ceee87 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.617244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9de093-e4d1-4748-b05d-da50c1ceee87 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.622980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.624237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.624863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.625451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.626376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.628402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.641997 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 19 20:35:57.648667 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 436/876] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:35:57.649979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.665717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee42a8-3d97-436d-aed7-4bd64db31acd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.670880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.672532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.673022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.673515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.674569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:57.675085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.676979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.687580 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 437/877] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:57.688967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.702434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae173f7a-42c3-48ba-bcdb-0b828bcb1286 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.707942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.708626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.708907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.709179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.709887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:57.710193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.711782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.714487 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:35:57.716233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 441/878] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:57.719493 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 438/879] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:57.725681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.738296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28c5fb-ee1f-468d-8c4f-3039163a1beb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.743114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.743796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.744078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.744386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.745126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:57.745427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.747057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.760890 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 442/880] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:57.766628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.778115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6807-6951-4f7f-8cce-195465baebb4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.783869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.785062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.785518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.785996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.794697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.798010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.814667 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:35:57.816830 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 439/881] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:57.822801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.834366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f24c3e-8973-49b6-a3af-517dda1200ea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.839364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9492d9a-1cdc-4563-891e-428c673f8791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.840283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9492d9a-1cdc-4563-891e-428c673f8791 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.840796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9492d9a-1cdc-4563-891e-428c673f8791 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.841270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9492d9a-1cdc-4563-891e-428c673f8791 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.842246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9492d9a-1cdc-4563-891e-428c673f8791 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:57.842733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9492d9a-1cdc-4563-891e-428c673f8791 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.844960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9492d9a-1cdc-4563-891e-428c673f8791 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.859177 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 443/882] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:57.865674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:57.876655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4462-9d59-48cc-abd9-a63b238918c0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:57.881754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29878a90-669d-43c8-aa2e-30cae7cc3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:57.882668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878a90-669d-43c8-aa2e-30cae7cc3b89 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:57.883113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878a90-669d-43c8-aa2e-30cae7cc3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:57.883542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878a90-669d-43c8-aa2e-30cae7cc3b89 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:57.884554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29878a90-669d-43c8-aa2e-30cae7cc3b89 admin admin] RBAC: Adding query filter params (role.id=6989b63dc10a4c96adcd2ece970c1ff3, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=6793b09e5394441bb1f700e1aca9a7b0) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:57.885043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29878a90-669d-43c8-aa2e-30cae7cc3b89 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:57.887151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29878a90-669d-43c8-aa2e-30cae7cc3b89 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:57.894708 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 440/883] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:35:57 2022] GET /identity/v3/role_assignments?user.id=6793b09e5394441bb1f700e1aca9a7b0&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6989b63dc10a4c96adcd2ece970c1ff3 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:58.659438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294d83-5b08-4da8-b837-ad74d930d947 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:58.659961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294d83-5b08-4da8-b837-ad74d930d947 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:58.660266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294d83-5b08-4da8-b837-ad74d930d947 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:58.662534 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 444/884] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:58.668265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c7da4-5a28-48d7-8a9b-741499e5c388 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:58.668739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c7da4-5a28-48d7-8a9b-741499e5c388 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:58.669083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c7da4-5a28-48d7-8a9b-741499e5c388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:58.693962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c15c7da4-5a28-48d7-8a9b-741499e5c388 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:58.697954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c15c7da4-5a28-48d7-8a9b-741499e5c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:58.709688 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 441/885] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:58 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:58.742443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69294d83-5b08-4da8-b837-ad74d930d947 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:58.756837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69294d83-5b08-4da8-b837-ad74d930d947 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:58.761756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e82ef-f25a-49ac-b3d1-2fa67cd9ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:58.762556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e82ef-f25a-49ac-b3d1-2fa67cd9ffb9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:58.762851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e82ef-f25a-49ac-b3d1-2fa67cd9ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:58.763129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e82ef-f25a-49ac-b3d1-2fa67cd9ffb9 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:58.763870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e82ef-f25a-49ac-b3d1-2fa67cd9ffb9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:58.764918 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-e48e82ef-f25a-49ac-b3d1-2fa67cd9ffb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:35:58.764918 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:35:58.764918 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:35:58.774367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e82ef-f25a-49ac-b3d1-2fa67cd9ffb9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:58.808783 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 445/886] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:35:58 2022] POST /identity/v3/services => generated 269 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:35:59.420116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2186-9318-499a-960e-b46a20a72e52 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:59.420453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2186-9318-499a-960e-b46a20a72e52 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:59.420713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2186-9318-499a-960e-b46a20a72e52 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:59.422816 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 442/887] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:35:59.427931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d300-ab27-44a8-bc88-9fe83967111b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:59.428230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d300-ab27-44a8-bc88-9fe83967111b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:59.428544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d300-ab27-44a8-bc88-9fe83967111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:59.446662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2584d300-ab27-44a8-bc88-9fe83967111b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:35:59.448123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2584d300-ab27-44a8-bc88-9fe83967111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:35:59.465024 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 446/888] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:35:59 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:35:59.489174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e2186-9318-499a-960e-b46a20a72e52 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:59.502293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e2186-9318-499a-960e-b46a20a72e52 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:59.506753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:59.507531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:59.507811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:59.508086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:59.508763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:59.510398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:59.521508 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 19 20:35:59.522951 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 443/889] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:35:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:35:59.528644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d300-ab27-44a8-bc88-9fe83967111b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:59.537628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d300-ab27-44a8-bc88-9fe83967111b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:59.542505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91ab8e-efeb-4ff4-857f-74ac405ad37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:59.543153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91ab8e-efeb-4ff4-857f-74ac405ad37c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:59.543433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91ab8e-efeb-4ff4-857f-74ac405ad37c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:59.543705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91ab8e-efeb-4ff4-857f-74ac405ad37c admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:59.544436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91ab8e-efeb-4ff4-857f-74ac405ad37c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:59.544747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91ab8e-efeb-4ff4-857f-74ac405ad37c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:59.546327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91ab8e-efeb-4ff4-857f-74ac405ad37c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:59.551738 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 447/890] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:35:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:35:59.557194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:35:59.567699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e058-6e15-419a-bb93-8bb1271e1793 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:35:59.572428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945ce3c-a12e-4d7f-a39d-420f81088fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:35:59.573078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ce3c-a12e-4d7f-a39d-420f81088fec admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:35:59.573356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ce3c-a12e-4d7f-a39d-420f81088fec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:35:59.573629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ce3c-a12e-4d7f-a39d-420f81088fec admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:35:59.574333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945ce3c-a12e-4d7f-a39d-420f81088fec admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:35:59.574635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945ce3c-a12e-4d7f-a39d-420f81088fec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:35:59.576211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945ce3c-a12e-4d7f-a39d-420f81088fec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:35:59.582043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 444/891] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:35:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:00.179456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a848-cfd7-4855-85a2-a8cb585aba84 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.179978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a848-cfd7-4855-85a2-a8cb585aba84 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.180056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a848-cfd7-4855-85a2-a8cb585aba84 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.181996 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 448/892] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:00.188098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7c6f-3ea8-454f-88b9-70c2204ae3f1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.188950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7c6f-3ea8-454f-88b9-70c2204ae3f1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.189469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7c6f-3ea8-454f-88b9-70c2204ae3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.208030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-55cf7c6f-3ea8-454f-88b9-70c2204ae3f1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:00.209544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-55cf7c6f-3ea8-454f-88b9-70c2204ae3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:00.218145 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 445/893] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:00 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:00.243795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473a848-cfd7-4855-85a2-a8cb585aba84 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.256980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473a848-cfd7-4855-85a2-a8cb585aba84 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.261779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88d09-8029-41bb-8a83-2e9ddfb89fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.262666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88d09-8029-41bb-8a83-2e9ddfb89fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.263164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88d09-8029-41bb-8a83-2e9ddfb89fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.263648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88d09-8029-41bb-8a83-2e9ddfb89fe1 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.264612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88d09-8029-41bb-8a83-2e9ddfb89fe1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.266923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88d09-8029-41bb-8a83-2e9ddfb89fe1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.283738 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 449/894] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:36:00 2022] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:00.359122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4bf9-8b58-4cd3-a80a-1376732932ee None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.359475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4bf9-8b58-4cd3-a80a-1376732932ee None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.359686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4bf9-8b58-4cd3-a80a-1376732932ee None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.361916 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 446/895] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:00.367708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b8969-ed18-469f-9e95-30e43a52ce80 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.368009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b8969-ed18-469f-9e95-30e43a52ce80 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.368279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b8969-ed18-469f-9e95-30e43a52ce80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.386978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c06b8969-ed18-469f-9e95-30e43a52ce80 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:00.388218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c06b8969-ed18-469f-9e95-30e43a52ce80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:00.412459 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 450/896] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:00 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:00.432377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c4bf9-8b58-4cd3-a80a-1376732932ee None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.445014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c4bf9-8b58-4cd3-a80a-1376732932ee None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.449571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ba59-3010-411a-8327-602acb1f5271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.450383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ba59-3010-411a-8327-602acb1f5271 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.450668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ba59-3010-411a-8327-602acb1f5271 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.450947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738ba59-3010-411a-8327-602acb1f5271 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.463925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738ba59-3010-411a-8327-602acb1f5271 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:00.472502 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-2738ba59-3010-411a-8327-602acb1f5271 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 19 20:36:00.478172 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 447/897] 10.222.0.30 () {56 vars in 1141 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:00.479549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b8969-ed18-469f-9e95-30e43a52ce80 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.489383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b8969-ed18-469f-9e95-30e43a52ce80 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.493954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.494619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.494921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.495183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.495931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:00.496239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.497864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.508374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 451/898] 10.222.0.30 () {56 vars in 1136 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:00.513185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ba59-3010-411a-8327-602acb1f5271 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.523396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738ba59-3010-411a-8327-602acb1f5271 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.531513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.532680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.533065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.533437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.551271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.553219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.570926 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:00.576459 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 448/899] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:00.578725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.588730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ba5fc-3ec4-47b0-b56b-384b74a53426 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.593462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.594162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.594455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.594735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.595462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:00.595771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.597490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.614105 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 452/900] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:00.615435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.625813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ea81a-519b-4e87-9547-26ac9354b74a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.630324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.631123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.631407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.631689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.639742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.642393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.656782 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 19 20:36:00.662643 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 449/901] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:00.663989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.674814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892579d4-9bc0-4adf-9819-6490097bb24e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.679506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.680238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.680548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.680828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.681670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:00.681984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.683883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.708572 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 453/902] 10.222.0.30 () {56 vars in 1170 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:00.710970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.721459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d782-8bbc-462a-a9a5-9146436c7456 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.726118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.726915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.727201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.727480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.741685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.743515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.760208 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:00.761609 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 450/903] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:00.767355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.777457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52861617-fb22-4084-b70c-fa1dd1a3faf3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.782866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.783522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.783852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.784143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.788463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:00.788463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.788463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.804505 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 454/904] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:00.808395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.821980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3501c-5cdf-4e3d-9c12-47401c18f08c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.826557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.827344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.827630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.827945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.835050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.837050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.851684 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:36:00.858114 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 451/905] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:00.860137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.870219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae459eab-674e-4986-b6ef-ab4519692484 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.874886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cf887-06ab-4dd0-82d1-a1579e3e077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.875538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cf887-06ab-4dd0-82d1-a1579e3e077f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.875824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cf887-06ab-4dd0-82d1-a1579e3e077f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.876103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cf887-06ab-4dd0-82d1-a1579e3e077f admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.876914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cf887-06ab-4dd0-82d1-a1579e3e077f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:00.877226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cf887-06ab-4dd0-82d1-a1579e3e077f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.879137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cf887-06ab-4dd0-82d1-a1579e3e077f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.896615 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 455/906] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:00.902216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:00.913234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2040018-12c8-4462-8812-a9b41489af0c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:00.918314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8876b1-5b10-47b0-af32-be415b0ba671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:00.919278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8876b1-5b10-47b0-af32-be415b0ba671 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:00.919565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8876b1-5b10-47b0-af32-be415b0ba671 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:00.919842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8876b1-5b10-47b0-af32-be415b0ba671 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/6793b09e5394441bb1f700e1aca9a7b0/roles/6989b63dc10a4c96adcd2ece970c1ff3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:00.922285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8876b1-5b10-47b0-af32-be415b0ba671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=6793b09e5394441bb1f700e1aca9a7b0, role_id=6989b63dc10a4c96adcd2ece970c1ff3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:00.925018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8876b1-5b10-47b0-af32-be415b0ba671 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:00.948595 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 452/907] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:36:00 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/6793b09e5394441bb1f700e1aca9a7b0/roles/6989b63dc10a4c96adcd2ece970c1ff3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:36:01.294817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d021d5-0861-4bd1-85c5-c19b4455d26a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:01.295514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d021d5-0861-4bd1-85c5-c19b4455d26a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:01.295514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d021d5-0861-4bd1-85c5-c19b4455d26a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:01.297536 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 456/908] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:01.302904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f576d0-28b8-48df-811a-96fbed7ab582 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:01.303407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f576d0-28b8-48df-811a-96fbed7ab582 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:01.303559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f576d0-28b8-48df-811a-96fbed7ab582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:01.322125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-92f576d0-28b8-48df-811a-96fbed7ab582 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:01.323321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-92f576d0-28b8-48df-811a-96fbed7ab582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:01.382515 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 453/909] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:01 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:01.407033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d021d5-0861-4bd1-85c5-c19b4455d26a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:01.419517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d021d5-0861-4bd1-85c5-c19b4455d26a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:01.424019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:01.424875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:01.425159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:01.425440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:01.426137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:01.427835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:01.439623 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 19 20:36:01.441123 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 457/910] 10.222.0.30 () {56 vars in 1153 bytes} [Sat Feb 19 20:36:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:01.446991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f576d0-28b8-48df-811a-96fbed7ab582 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:01.456580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f576d0-28b8-48df-811a-96fbed7ab582 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:01.461170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:01.461830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:01.462113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:01.462392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:01.463099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:01.463405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:01.465069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:01.470665 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 454/911] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:36:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:01.476316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:01.486849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ced65b-f590-42fe-937b-8ccd77304e03 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:01.491569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:01.492273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:01.492665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:01.492853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:01.493669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:01.493980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:01.495631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:01.501640 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 458/912] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:36:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:01.507306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:01.517828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37924a-3121-43fa-92c7-7df02b2d3400 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:01.522520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a6ab9-5205-4838-8316-f6f6ab684943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:01.523221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a6ab9-5205-4838-8316-f6f6ab684943 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:01.523506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a6ab9-5205-4838-8316-f6f6ab684943 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:01.523784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a6ab9-5205-4838-8316-f6f6ab684943 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:01.524664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a6ab9-5205-4838-8316-f6f6ab684943 admin admin] RBAC: Adding query filter params (interface=public, service_id=b4291b34922a45cab56bc8f86578f7c0, region_id=RegionOne) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:01.525019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a6ab9-5205-4838-8316-f6f6ab684943 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:01.526671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a6ab9-5205-4838-8316-f6f6ab684943 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:01.533000 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 455/913] 10.222.0.30 () {56 vars in 1272 bytes} [Sat Feb 19 20:36:01 2022] GET /identity/v3/endpoints?service_id=b4291b34922a45cab56bc8f86578f7c0&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:01.538422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:01.549457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7513d-8763-4a47-abc2-db377c985b4f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:01.554206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9b317-bd5c-4d3b-9b7b-dab97e08872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:01.554855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b317-bd5c-4d3b-9b7b-dab97e08872e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:01.555191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b317-bd5c-4d3b-9b7b-dab97e08872e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:01.555469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b317-bd5c-4d3b-9b7b-dab97e08872e admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:01.556148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9b317-bd5c-4d3b-9b7b-dab97e08872e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:01.557880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9b317-bd5c-4d3b-9b7b-dab97e08872e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:01.564130 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 459/914] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:36:01 2022] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:36:02.084748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e946-336e-4c7a-99de-edf0dceb2e92 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:02.085119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e946-336e-4c7a-99de-edf0dceb2e92 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:02.085289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e946-336e-4c7a-99de-edf0dceb2e92 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:02.087313 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 456/915] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:02.092637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92934d-d2b2-4aee-8a47-74f4bfd05ee3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:02.092854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92934d-d2b2-4aee-8a47-74f4bfd05ee3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:02.093102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92934d-d2b2-4aee-8a47-74f4bfd05ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:02.112379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8b92934d-d2b2-4aee-8a47-74f4bfd05ee3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:02.113584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8b92934d-d2b2-4aee-8a47-74f4bfd05ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:02.121691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 460/916] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:02 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:02.146906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e946-336e-4c7a-99de-edf0dceb2e92 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:02.159236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e946-336e-4c7a-99de-edf0dceb2e92 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:02.163695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76db73-145a-4dfd-8bda-2c77631e4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:02.164382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76db73-145a-4dfd-8bda-2c77631e4f77 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:02.164671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76db73-145a-4dfd-8bda-2c77631e4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:02.164953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76db73-145a-4dfd-8bda-2c77631e4f77 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:02.165957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76db73-145a-4dfd-8bda-2c77631e4f77 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:02.167570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76db73-145a-4dfd-8bda-2c77631e4f77 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:02.184020 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 457/917] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:36:02 2022] POST /identity/v3/services => generated 241 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:02.867558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92420f9-ac76-435e-86d4-9a0315a83b8e None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:02.867558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92420f9-ac76-435e-86d4-9a0315a83b8e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:02.867558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92420f9-ac76-435e-86d4-9a0315a83b8e None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:02.867558 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 461/918] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:02.875762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cb61-fb77-447d-bb17-7a8131f4453f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:02.875762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cb61-fb77-447d-bb17-7a8131f4453f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:02.875762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cb61-fb77-447d-bb17-7a8131f4453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:02.893496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4352cb61-fb77-447d-bb17-7a8131f4453f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:02.894976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4352cb61-fb77-447d-bb17-7a8131f4453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:02.911940 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 458/919] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:02 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:02.936907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92420f9-ac76-435e-86d4-9a0315a83b8e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:02.949506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92420f9-ac76-435e-86d4-9a0315a83b8e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:02.954333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:02.955324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:02.955833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:02.956299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:02.957169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:02.958926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:02.970546 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 19 20:36:02.972277 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 462/920] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:36:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:02.978195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352cb61-fb77-447d-bb17-7a8131f4453f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:02.988581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352cb61-fb77-447d-bb17-7a8131f4453f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:02.993240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:02.993899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:02.994180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:02.994451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:02.995155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:02.995458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:02.997085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.002292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 459/921] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:36:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:03.013586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.023565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47299c3-ae8b-4bee-b4ad-e35af12c8236 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.028363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.029239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.029734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.030202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.031603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:03.032100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.033885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.039282 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 463/922] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:03.045432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.058112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9a4a7-b11d-46ec-9992-378ffee5ab23 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.063310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790eb9-6b1a-4966-b1f4-83f4272c3ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.064371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790eb9-6b1a-4966-b1f4-83f4272c3ccb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.064895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790eb9-6b1a-4966-b1f4-83f4272c3ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.065366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790eb9-6b1a-4966-b1f4-83f4272c3ccb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.066367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01790eb9-6b1a-4966-b1f4-83f4272c3ccb admin admin] RBAC: Adding query filter params (interface=public, service_id=39c5c96f8e3d45529033aae4151e3867, region_id=RegionOne) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:03.066899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01790eb9-6b1a-4966-b1f4-83f4272c3ccb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.068851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01790eb9-6b1a-4966-b1f4-83f4272c3ccb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.075502 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 460/923] 10.222.0.30 () {56 vars in 1272 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/endpoints?service_id=39c5c96f8e3d45529033aae4151e3867&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:03.081492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.092022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d829-7b74-44a7-911e-61ad5d06666c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.097776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed021f1-4bf2-46ca-94f0-6aec4540eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.098679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed021f1-4bf2-46ca-94f0-6aec4540eed8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.099229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed021f1-4bf2-46ca-94f0-6aec4540eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.099698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed021f1-4bf2-46ca-94f0-6aec4540eed8 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.100593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed021f1-4bf2-46ca-94f0-6aec4540eed8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.102377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed021f1-4bf2-46ca-94f0-6aec4540eed8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.109849 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 464/924] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:36:03.458008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399941-045b-48f0-8c8b-182da2ab0e54 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.458678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399941-045b-48f0-8c8b-182da2ab0e54 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.459165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399941-045b-48f0-8c8b-182da2ab0e54 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.461651 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 461/925] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:03.472205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf507db-15c8-4902-a92c-948988936416 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.472844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf507db-15c8-4902-a92c-948988936416 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.473326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf507db-15c8-4902-a92c-948988936416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.491323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9bf507db-15c8-4902-a92c-948988936416 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:03.492960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9bf507db-15c8-4902-a92c-948988936416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:03.501798 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 465/926] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:03 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:03.527504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18399941-045b-48f0-8c8b-182da2ab0e54 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.540407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18399941-045b-48f0-8c8b-182da2ab0e54 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.545028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e39d3-d1fe-4bb4-b501-edc9b0cc1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.546079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e39d3-d1fe-4bb4-b501-edc9b0cc1957 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.546586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e39d3-d1fe-4bb4-b501-edc9b0cc1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.547072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e39d3-d1fe-4bb4-b501-edc9b0cc1957 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.557544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e39d3-d1fe-4bb4-b501-edc9b0cc1957 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:03.565823 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-9e4e39d3-d1fe-4bb4-b501-edc9b0cc1957 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 19 20:36:03.567513 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 462/927] 10.222.0.30 () {56 vars in 1141 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:03.573528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf507db-15c8-4902-a92c-948988936416 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.583676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf507db-15c8-4902-a92c-948988936416 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.588560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.589476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.589955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.590424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.591370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:03.591894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.593913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.602840 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 466/928] 10.222.0.30 () {56 vars in 1136 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:03.608908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e39d3-d1fe-4bb4-b501-edc9b0cc1957 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.620151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e39d3-d1fe-4bb4-b501-edc9b0cc1957 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.626039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.627263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.627759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.628254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.639879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.642685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.660298 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:03.662094 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 463/929] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:03.668208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.682294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0857dc-6a8f-4626-b8cc-b96d6843a1a1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.687294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.688216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.688732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.689248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.690211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:03.690718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.692516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.707617 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 467/930] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:03.714908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.725564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca49fae-1650-4a11-bf6d-33a70b70b306 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.730328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.731401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.731920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.732432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.740965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.743244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.759215 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 19 20:36:03.760958 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 464/931] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:03.766823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.776787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaef7f-3d25-4345-9dae-283c1d9e1ef6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.782579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.783692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.784186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.784740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.785752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:03.786285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.788360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.807675 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 468/932] 10.222.0.30 () {56 vars in 1170 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:03.814108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.824307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d802e0-6241-4471-aac3-8865317b7579 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.829798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6f4ac-73a1-4776-960c-984d74aac457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.830493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6f4ac-73a1-4776-960c-984d74aac457 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.830773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6f4ac-73a1-4776-960c-984d74aac457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.831046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6f4ac-73a1-4776-960c-984d74aac457 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.839542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6f4ac-73a1-4776-960c-984d74aac457 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.841370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6f4ac-73a1-4776-960c-984d74aac457 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.850959 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 465/933] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/auth/tokens => generated 1765 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:03.856534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.866913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44821-c8d7-42e0-9bc9-94e4f5b5d44d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.872367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.873812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.874289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.875290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.886289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.888366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.907505 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:03.909359 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 469/934] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:03.915080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6f4ac-73a1-4776-960c-984d74aac457 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.925468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6f4ac-73a1-4776-960c-984d74aac457 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.930456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9daa1-c755-4d77-9b44-992ccde7f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.931338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9daa1-c755-4d77-9b44-992ccde7f2cc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.931811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9daa1-c755-4d77-9b44-992ccde7f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.932288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9daa1-c755-4d77-9b44-992ccde7f2cc admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.933229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9daa1-c755-4d77-9b44-992ccde7f2cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:03.933725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9daa1-c755-4d77-9b44-992ccde7f2cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.935515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9daa1-c755-4d77-9b44-992ccde7f2cc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.948219 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 466/935] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:03.954547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:03.964780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa780a-e9fb-4fa1-9b4c-d39e01149bed admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:03.970418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:03.971460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.971934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.972554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.980159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:03.982400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:03.995369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beabe0-9301-4a4c-aace-e26a7cecf8c4 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:03.996068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beabe0-9301-4a4c-aace-e26a7cecf8c4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:03.996596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beabe0-9301-4a4c-aace-e26a7cecf8c4 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:03.997214 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:36:03.998704 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 470/936] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:03.998957 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 467/937] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:36:04.004967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.005702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64475ba9-ee0a-4110-b4ab-e81c6a8af64b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.006206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64475ba9-ee0a-4110-b4ab-e81c6a8af64b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.006692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64475ba9-ee0a-4110-b4ab-e81c6a8af64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.017960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5fe01-5546-4924-9c96-f9cbf3979f1c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.023514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.024164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.024529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.024808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.025680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:04.025989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.027329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-64475ba9-ee0a-4110-b4ab-e81c6a8af64b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:04.027987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.028944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-64475ba9-ee0a-4110-b4ab-e81c6a8af64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:04.037638 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 468/938] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:04 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:04.042492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 471/939] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:04.048401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64475ba9-ee0a-4110-b4ab-e81c6a8af64b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.058210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64475ba9-ee0a-4110-b4ab-e81c6a8af64b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.064064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.064757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.065035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.065304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.066026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.066207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] RBAC: Adding query filter params (role.id=6989b63dc10a4c96adcd2ece970c1ff3, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=6793b09e5394441bb1f700e1aca9a7b0) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:04.066487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.068381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.080387 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 469/940] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/role_assignments?user.id=6793b09e5394441bb1f700e1aca9a7b0&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6989b63dc10a4c96adcd2ece970c1ff3 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:04.080568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48e57b-81c1-4f1c-937a-a8939e1a5640 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.082891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.083959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.084241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.084555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.085272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.087018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.099999 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 19 20:36:04.101679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 472/941] 10.222.0.30 () {56 vars in 1153 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:04.110097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.121248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98a69-3b4a-4695-9bbd-4bffe8a20cab admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.127292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.128356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.128894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.129394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.130371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:04.130881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.132829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.139047 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 470/942] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:04.145413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.156291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de544d39-d138-498a-93ec-afbcc4ebfc00 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.161698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e873420-a806-401c-b9a7-20023dffc51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.162880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e873420-a806-401c-b9a7-20023dffc51e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.163385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e873420-a806-401c-b9a7-20023dffc51e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.163975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e873420-a806-401c-b9a7-20023dffc51e admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.165016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e873420-a806-401c-b9a7-20023dffc51e admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:04.165784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e873420-a806-401c-b9a7-20023dffc51e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.167749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e873420-a806-401c-b9a7-20023dffc51e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.174683 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 473/943] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:04.181465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.193664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df578d-e5d2-4352-8670-16383d63304a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.199203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868cece-b3c5-4855-a46c-dd6c1a267291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.200295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868cece-b3c5-4855-a46c-dd6c1a267291 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.200857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868cece-b3c5-4855-a46c-dd6c1a267291 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.201360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868cece-b3c5-4855-a46c-dd6c1a267291 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.202428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868cece-b3c5-4855-a46c-dd6c1a267291 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.204900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868cece-b3c5-4855-a46c-dd6c1a267291 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.229008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 471/944] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:36:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:04.709736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67ab1-66a4-467b-8978-f68a19f47798 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.710020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67ab1-66a4-467b-8978-f68a19f47798 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.710298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67ab1-66a4-467b-8978-f68a19f47798 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.712322 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 474/945] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:04.717576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa5b42-8a2b-498e-8074-8b5512a042be None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.717865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa5b42-8a2b-498e-8074-8b5512a042be None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.718144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa5b42-8a2b-498e-8074-8b5512a042be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.736427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-35fa5b42-8a2b-498e-8074-8b5512a042be None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:04.737617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-35fa5b42-8a2b-498e-8074-8b5512a042be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:04.755261 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 472/946] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:04 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:04.780489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67ab1-66a4-467b-8978-f68a19f47798 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.793256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67ab1-66a4-467b-8978-f68a19f47798 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.798242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.799018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.799296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.799569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.800215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.801871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.813621 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 19 20:36:04.814768 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 475/947] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:04.820607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa5b42-8a2b-498e-8074-8b5512a042be None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.830190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa5b42-8a2b-498e-8074-8b5512a042be None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.834818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.835469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.835849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.836194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.836945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:04.837299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.838886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.844530 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 473/948] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:04.850135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.863381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef3608-15e4-41f4-bf08-919715f4f33f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.868322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.869004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.869281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.869614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.870328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:04.870687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.872277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.878062 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 476/949] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:04.883728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.894384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56c69-64e8-4d25-843a-207124ce2369 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.899253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8ef2-de58-499c-aaab-e8e2b099a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.899906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8ef2-de58-499c-aaab-e8e2b099a3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.900189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8ef2-de58-499c-aaab-e8e2b099a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.900627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8ef2-de58-499c-aaab-e8e2b099a3a8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.901387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8ef2-de58-499c-aaab-e8e2b099a3a8 admin admin] RBAC: Adding query filter params (interface=public, service_id=ef2bac5b502943f08937b51019e30909, region_id=RegionOne) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:04.901700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8ef2-de58-499c-aaab-e8e2b099a3a8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.903344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8ef2-de58-499c-aaab-e8e2b099a3a8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.909546 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 474/950] 10.222.0.30 () {56 vars in 1272 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/endpoints?service_id=ef2bac5b502943f08937b51019e30909&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:04.914991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:04.925320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8d8e1-7246-42c0-8a8c-1073a7f470c1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:04.930105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf8444-f23c-4e35-a70b-c6ecb9a8ff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:04.930762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf8444-f23c-4e35-a70b-c6ecb9a8ff38 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:04.931090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf8444-f23c-4e35-a70b-c6ecb9a8ff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:04.931364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf8444-f23c-4e35-a70b-c6ecb9a8ff38 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:04.932145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf8444-f23c-4e35-a70b-c6ecb9a8ff38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:04.933845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf8444-f23c-4e35-a70b-c6ecb9a8ff38 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:04.940705 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 477/951] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:36:04 2022] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:36:05.602579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60453-c565-4b85-8766-271c0f9cccc6 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:05.603323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60453-c565-4b85-8766-271c0f9cccc6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:05.603323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60453-c565-4b85-8766-271c0f9cccc6 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:05.605201 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 475/952] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:05.610572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9ba1-6957-4c27-b658-1d45337f9808 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:05.610865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9ba1-6957-4c27-b658-1d45337f9808 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:05.611145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9ba1-6957-4c27-b658-1d45337f9808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:05.628603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5aee9ba1-6957-4c27-b658-1d45337f9808 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:05.629791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5aee9ba1-6957-4c27-b658-1d45337f9808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:05.644436 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 478/953] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:05 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:05.662811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60453-c565-4b85-8766-271c0f9cccc6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:05.675442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60453-c565-4b85-8766-271c0f9cccc6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:05.679847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:05.680667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:05.680952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:05.681231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:05.681885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:05.683463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:05.694648 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 19 20:36:05.700483 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 476/954] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:36:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:05.704628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9ba1-6957-4c27-b658-1d45337f9808 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:05.713974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9ba1-6957-4c27-b658-1d45337f9808 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:05.719149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:05.719801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:05.720085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:05.720361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:05.721082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:05.721389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:05.722978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:05.735329 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 479/955] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:36:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:05.737049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:05.746628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0972-291a-4aa0-92d6-c2411ae75099 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:05.752003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd1925-7258-47f4-afa2-d06bf5075166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:05.752902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1925-7258-47f4-afa2-d06bf5075166 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:05.753390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1925-7258-47f4-afa2-d06bf5075166 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:05.753886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1925-7258-47f4-afa2-d06bf5075166 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:05.754816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd1925-7258-47f4-afa2-d06bf5075166 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:05.755322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd1925-7258-47f4-afa2-d06bf5075166 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:05.757146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd1925-7258-47f4-afa2-d06bf5075166 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:05.762500 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 477/956] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Feb 19 20:36:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:05.769105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:05.778067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eed5c-6999-4259-b325-151ce0df3d37 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:05.782692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb807e0-c446-42fb-82cf-31436cb80e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:05.783332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb807e0-c446-42fb-82cf-31436cb80e98 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:05.783617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb807e0-c446-42fb-82cf-31436cb80e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:05.783893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb807e0-c446-42fb-82cf-31436cb80e98 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:05.784674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb807e0-c446-42fb-82cf-31436cb80e98 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:05.785683 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-1cb807e0-c446-42fb-82cf-31436cb80e98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:36:05.785683 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:36:05.785683 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:36:05.786554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb807e0-c446-42fb-82cf-31436cb80e98 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:05.814960 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 480/957] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:36:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:06.599091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f2d9-9d7d-44a3-a80b-959a7d00ea30 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.599537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f2d9-9d7d-44a3-a80b-959a7d00ea30 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.599750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f2d9-9d7d-44a3-a80b-959a7d00ea30 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.601901 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 478/958] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:06.607603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898e3f-564c-4edf-9577-391a80dfc93a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.608077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898e3f-564c-4edf-9577-391a80dfc93a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.608163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898e3f-564c-4edf-9577-391a80dfc93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.627698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d5898e3f-564c-4edf-9577-391a80dfc93a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:06.628938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d5898e3f-564c-4edf-9577-391a80dfc93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:06.649860 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 481/959] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:06 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:06.670581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0f2d9-9d7d-44a3-a80b-959a7d00ea30 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:06.683666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0f2d9-9d7d-44a3-a80b-959a7d00ea30 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:06.688160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0358845-4657-49e6-a1dc-1c7da9290b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:06.688990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0358845-4657-49e6-a1dc-1c7da9290b31 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.689274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0358845-4657-49e6-a1dc-1c7da9290b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.689559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0358845-4657-49e6-a1dc-1c7da9290b31 admin admin] PATH_INFO: `/v3/services/image` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.690203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0358845-4657-49e6-a1dc-1c7da9290b31 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:06.691786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0358845-4657-49e6-a1dc-1c7da9290b31 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:06.702935 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b0358845-4657-49e6-a1dc-1c7da9290b31 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 19 20:36:06.708437 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 479/960] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Feb 19 20:36:06 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:06.710506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898e3f-564c-4edf-9577-391a80dfc93a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:06.720443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898e3f-564c-4edf-9577-391a80dfc93a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:06.725127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308a515-4284-4a10-b33e-ba2f11d03eab None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.725674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308a515-4284-4a10-b33e-ba2f11d03eab None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.725871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:06.726425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.726566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308a515-4284-4a10-b33e-ba2f11d03eab None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.727060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.728613 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 480/961] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:36:06.730073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.730976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] RBAC: Adding query filter params (name=image) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:06.733032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:06.733032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:06.735508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c19e4-deab-45d4-90e9-ab8cdf50f1ce None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.736107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c19e4-deab-45d4-90e9-ab8cdf50f1ce None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.736624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c19e4-deab-45d4-90e9-ab8cdf50f1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.740412 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 482/962] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:06.745072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:06.755410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba067a7e-d65d-49b0-9167-1da3e3fd4c4c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:06.759630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-053c19e4-deab-45d4-90e9-ab8cdf50f1ce None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:06.760372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:06.761035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.761321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.761602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.761979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-053c19e4-deab-45d4-90e9-ab8cdf50f1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:06.762306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] RBAC: Adding query filter params (type=image) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:06.762615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:06.764307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:06.771821 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 481/964] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:06 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:06.776453 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 483/964] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:06.798362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c19e4-deab-45d4-90e9-ab8cdf50f1ce None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:06.808653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c19e4-deab-45d4-90e9-ab8cdf50f1ce None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:06.813669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:06.814623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.815012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.815394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.816163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:06.817909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:06.829883 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 19 20:36:06.831635 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 482/965] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:06.837916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:06.854108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f715fac-98b5-436d-91ed-ea9d6a7428b9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:06.860009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bb879-8d5a-4a16-be55-39703bb62ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:06.861081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bb879-8d5a-4a16-be55-39703bb62ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.861578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bb879-8d5a-4a16-be55-39703bb62ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.862071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bb879-8d5a-4a16-be55-39703bb62ca6 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.863094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bb879-8d5a-4a16-be55-39703bb62ca6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:06.863629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bb879-8d5a-4a16-be55-39703bb62ca6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:06.865511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bb879-8d5a-4a16-be55-39703bb62ca6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:06.871764 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 484/966] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:36:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:06.878002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:06.888916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28c34e-159a-4cb6-8689-fbea98d05d45 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:06.895058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9fb3d-5ea5-4948-b161-0bdf844fba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:06.896131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9fb3d-5ea5-4948-b161-0bdf844fba20 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:06.896714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9fb3d-5ea5-4948-b161-0bdf844fba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:06.897267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9fb3d-5ea5-4948-b161-0bdf844fba20 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:06.898253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9fb3d-5ea5-4948-b161-0bdf844fba20 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:06.898788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9fb3d-5ea5-4948-b161-0bdf844fba20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:06.900824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9fb3d-5ea5-4948-b161-0bdf844fba20 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:06.907549 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 483/967] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:36:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:07.413365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7bfa9-1bb6-4708-860e-73d3e6a99afd None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:07.414006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7bfa9-1bb6-4708-860e-73d3e6a99afd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:07.414006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7bfa9-1bb6-4708-860e-73d3e6a99afd None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:07.416169 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 485/968] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:07.421323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de2b36-cfdc-4eca-8b7a-173951112498 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:07.422162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de2b36-cfdc-4eca-8b7a-173951112498 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:07.422441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de2b36-cfdc-4eca-8b7a-173951112498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:07.440567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-59de2b36-cfdc-4eca-8b7a-173951112498 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:07.441732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-59de2b36-cfdc-4eca-8b7a-173951112498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:07.449647 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 484/969] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:07 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:07.473948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7bfa9-1bb6-4708-860e-73d3e6a99afd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:07.488773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7bfa9-1bb6-4708-860e-73d3e6a99afd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:07.494076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:07.494855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:07.495136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:07.495407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:07.496048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:07.497687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:07.509479 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 19 20:36:07.510932 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 486/970] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:36:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:07.517690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de2b36-cfdc-4eca-8b7a-173951112498 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:07.526674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de2b36-cfdc-4eca-8b7a-173951112498 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:07.531732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:07.532405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:07.532684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:07.532950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:07.533650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:07.533948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:07.535508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:07.540773 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 485/971] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:36:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:07.546295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:07.556494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557c1bf-2b9f-4ca4-ab41-663749322de7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:07.561042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c816c9c-098a-4291-acd8-e533e5f5c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:07.561683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816c9c-098a-4291-acd8-e533e5f5c93f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:07.561958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816c9c-098a-4291-acd8-e533e5f5c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:07.562745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816c9c-098a-4291-acd8-e533e5f5c93f admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:07.563436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c816c9c-098a-4291-acd8-e533e5f5c93f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:07.563735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c816c9c-098a-4291-acd8-e533e5f5c93f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:07.565335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c816c9c-098a-4291-acd8-e533e5f5c93f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:07.570531 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 487/972] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:36:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:07.576085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:07.586552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4d45c-aaa9-41cb-a81e-6f01910fd583 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:07.591294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad235e7-32eb-44b2-87c3-9d737364502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:07.591986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad235e7-32eb-44b2-87c3-9d737364502d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:07.592268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad235e7-32eb-44b2-87c3-9d737364502d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:07.592568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad235e7-32eb-44b2-87c3-9d737364502d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:07.593427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad235e7-32eb-44b2-87c3-9d737364502d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:07.595102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad235e7-32eb-44b2-87c3-9d737364502d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:07.614914 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 486/973] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:36:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:36:08.290534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831141-c2bb-4a99-98e8-9874d01ef838 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:08.291251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831141-c2bb-4a99-98e8-9874d01ef838 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:08.291251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831141-c2bb-4a99-98e8-9874d01ef838 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:08.293215 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 488/974] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:08.299081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f42af-ba10-45a1-a934-94ba67763a2e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:08.299081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f42af-ba10-45a1-a934-94ba67763a2e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:08.299081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f42af-ba10-45a1-a934-94ba67763a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:08.318231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-379f42af-ba10-45a1-a934-94ba67763a2e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:08.319671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-379f42af-ba10-45a1-a934-94ba67763a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:08.336715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 487/975] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:08 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:08.361283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92831141-c2bb-4a99-98e8-9874d01ef838 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:08.373813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92831141-c2bb-4a99-98e8-9874d01ef838 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:08.378979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:08.379838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:08.380318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:08.380812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:08.381707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:08.383743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:08.385313 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.common [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 19 20:36:08.406367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.sql.core [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 19 20:36:08.406367 ncdv-master-1 devstack@keystone.service[96909]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 19 20:36:08.406367 ncdv-master-1 devstack@keystone.service[96909]: [parameters: {'id': '02c895c6640d46c2bb775e1ee9c0ba3d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 19 20:36:08.406367 ncdv-master-1 devstack@keystone.service[96909]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96909) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 19 20:36:08.423577 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02c895c6640d46c2bb775e1ee9c0ba3d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02c895c6640d46c2bb775e1ee9c0ba3d. Feb 19 20:36:08.425715 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 489/976] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Feb 19 20:36:08 2022] POST /identity/v3/projects => generated 262 bytes in 65 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:08.431916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f42af-ba10-45a1-a934-94ba67763a2e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:08.442017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f42af-ba10-45a1-a934-94ba67763a2e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:08.447026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4fc23-9565-4eca-9e08-7714306e8d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:08.448105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4fc23-9565-4eca-9e08-7714306e8d45 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:08.448644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4fc23-9565-4eca-9e08-7714306e8d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:08.449207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4fc23-9565-4eca-9e08-7714306e8d45 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:08.456724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4fc23-9565-4eca-9e08-7714306e8d45 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:08.458901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4fc23-9565-4eca-9e08-7714306e8d45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:08.472121 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-3bb4fc23-9565-4eca-9e08-7714306e8d45 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:36:08.473878 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 488/977] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:08.481532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:08.492975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d5ffa-d1a0-4b88-a225-46cf28603cbc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:08.497860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5edf4-ec09-4540-90b1-b2243110662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:08.498760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5edf4-ec09-4540-90b1-b2243110662c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:08.499239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5edf4-ec09-4540-90b1-b2243110662c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:08.500278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5edf4-ec09-4540-90b1-b2243110662c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:08.501366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5edf4-ec09-4540-90b1-b2243110662c admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:08.501887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5edf4-ec09-4540-90b1-b2243110662c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:08.504305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5edf4-ec09-4540-90b1-b2243110662c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:08.526859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 490/978] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:36:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:09.246026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b841af-24e7-42a0-b98c-d3bcb8a0c8e9 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:09.246761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b841af-24e7-42a0-b98c-d3bcb8a0c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:09.247266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b841af-24e7-42a0-b98c-d3bcb8a0c8e9 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:09.249561 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 489/979] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:09.256218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252068-431b-4301-9e9c-4067dde0ef81 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:09.256771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252068-431b-4301-9e9c-4067dde0ef81 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:09.257248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252068-431b-4301-9e9c-4067dde0ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:09.276772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c0252068-431b-4301-9e9c-4067dde0ef81 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:09.278649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c0252068-431b-4301-9e9c-4067dde0ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:09.287680 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 491/980] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:09.315094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b841af-24e7-42a0-b98c-d3bcb8a0c8e9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:09.329000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b841af-24e7-42a0-b98c-d3bcb8a0c8e9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:09.333986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8caf-bb07-47fb-b7af-01f5c2c218cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:09.334867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8caf-bb07-47fb-b7af-01f5c2c218cf admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:09.335367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8caf-bb07-47fb-b7af-01f5c2c218cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:09.335843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8caf-bb07-47fb-b7af-01f5c2c218cf admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:09.336797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec8caf-bb07-47fb-b7af-01f5c2c218cf admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:09.338656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec8caf-bb07-47fb-b7af-01f5c2c218cf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:09.354216 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 490/981] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:36:09 2022] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:09.373551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112bbb8-3269-4633-9578-81e581e04f13 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:09.374067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112bbb8-3269-4633-9578-81e581e04f13 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:09.374067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112bbb8-3269-4633-9578-81e581e04f13 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:09.376810 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 492/982] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:09.382539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36334f5-9a9b-4e33-911f-5a19997fc738 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:09.382826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36334f5-9a9b-4e33-911f-5a19997fc738 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:09.383098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36334f5-9a9b-4e33-911f-5a19997fc738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:09.401751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c36334f5-9a9b-4e33-911f-5a19997fc738 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:09.402951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c36334f5-9a9b-4e33-911f-5a19997fc738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:09.423392 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 491/983] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:09.449099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112bbb8-3269-4633-9578-81e581e04f13 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:09.462070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112bbb8-3269-4633-9578-81e581e04f13 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:09.467722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82366022-84b5-4ec3-83cb-af6cb6a3afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:09.468536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82366022-84b5-4ec3-83cb-af6cb6a3afe7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:09.468817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82366022-84b5-4ec3-83cb-af6cb6a3afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:09.469092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82366022-84b5-4ec3-83cb-af6cb6a3afe7 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:09.469881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82366022-84b5-4ec3-83cb-af6cb6a3afe7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:09.471584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82366022-84b5-4ec3-83cb-af6cb6a3afe7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:09.488355 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 493/984] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:36:09 2022] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:10.089951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274760e-59f7-4db8-aa1d-b2bbc2a315cc None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:10.090349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274760e-59f7-4db8-aa1d-b2bbc2a315cc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:10.090524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274760e-59f7-4db8-aa1d-b2bbc2a315cc None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:10.092596 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 492/985] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:10.098571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a564090-b7e6-4226-b468-f1c3014fb2aa None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:10.098869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a564090-b7e6-4226-b468-f1c3014fb2aa None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:10.099150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a564090-b7e6-4226-b468-f1c3014fb2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:10.117436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7a564090-b7e6-4226-b468-f1c3014fb2aa None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:10.118629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a564090-b7e6-4226-b468-f1c3014fb2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:10.136567 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 494/986] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:10 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:10.161204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274760e-59f7-4db8-aa1d-b2bbc2a315cc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:10.174396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274760e-59f7-4db8-aa1d-b2bbc2a315cc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:10.178925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:10.179711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:10.179992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:10.180268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:10.180957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:10.182563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:10.194796 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 19 20:36:10.196251 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 493/987] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:36:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:10.202289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a564090-b7e6-4226-b468-f1c3014fb2aa None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:10.212174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a564090-b7e6-4226-b468-f1c3014fb2aa None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:10.216836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:10.217494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:10.217776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:10.218056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:10.219314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:10.219628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:10.221244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:10.230675 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 495/988] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:36:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:10.236546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:10.246270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f27eab-fe43-40d6-a664-58ff72dea06a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:10.251506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:10.252159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:10.252480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:10.252762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:10.253468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:10.253774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:10.255359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:10.260702 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 494/989] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:36:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:10.266491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:10.276268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3049819-7027-4f70-a807-4aed6c8a00b0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:10.281474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c79102-e0ca-4f50-b43a-c87b31a35975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:10.282121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79102-e0ca-4f50-b43a-c87b31a35975 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:10.282405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79102-e0ca-4f50-b43a-c87b31a35975 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:10.282684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79102-e0ca-4f50-b43a-c87b31a35975 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:10.283461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79102-e0ca-4f50-b43a-c87b31a35975 admin admin] RBAC: Adding query filter params (interface=admin, service_id=ef2bac5b502943f08937b51019e30909, region_id=RegionOne) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:10.283773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79102-e0ca-4f50-b43a-c87b31a35975 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:10.285432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79102-e0ca-4f50-b43a-c87b31a35975 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:10.291153 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 496/990] 10.222.0.30 () {56 vars in 1270 bytes} [Sat Feb 19 20:36:10 2022] GET /identity/v3/endpoints?service_id=ef2bac5b502943f08937b51019e30909&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:10.297197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:10.307129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e8847-3228-44a9-a3b0-3f94b6e8937c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:10.311928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f6cc6-5ee6-4bae-86b5-99754aa54249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:10.312842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f6cc6-5ee6-4bae-86b5-99754aa54249 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:10.313129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f6cc6-5ee6-4bae-86b5-99754aa54249 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:10.313402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f6cc6-5ee6-4bae-86b5-99754aa54249 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:10.314135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f6cc6-5ee6-4bae-86b5-99754aa54249 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:10.315779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f6cc6-5ee6-4bae-86b5-99754aa54249 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:10.322871 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 495/991] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:36:10 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:36:10.997082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187df09-9e32-4c06-9490-90a7afb29a71 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:10.997577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187df09-9e32-4c06-9490-90a7afb29a71 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:10.997577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187df09-9e32-4c06-9490-90a7afb29a71 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.000085 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 497/992] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:11.005403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be61e-9b89-41d2-8042-ee2d1829fb39 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.005689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be61e-9b89-41d2-8042-ee2d1829fb39 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.005964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be61e-9b89-41d2-8042-ee2d1829fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.024400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ea8be61e-9b89-41d2-8042-ee2d1829fb39 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:11.025574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ea8be61e-9b89-41d2-8042-ee2d1829fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:11.040542 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 496/993] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:11 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:11.060504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187df09-9e32-4c06-9490-90a7afb29a71 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:11.073489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187df09-9e32-4c06-9490-90a7afb29a71 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:11.078476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:11.079128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.079448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.079720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.080448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:11.082262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:11.096915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.sql.core [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 19 20:36:11.096915 ncdv-master-1 devstack@keystone.service[96909]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 19 20:36:11.096915 ncdv-master-1 devstack@keystone.service[96909]: [parameters: {'user_id': 'd24115cbd96f40b8b401ed34bf0c9c81', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 19 20:36:11.096915 ncdv-master-1 devstack@keystone.service[96909]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96909) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 19 20:36:11.102752 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 19 20:36:11.108481 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 498/994] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:36:11 2022] POST /identity/v3/users => generated 160 bytes in 44 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:11.111837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be61e-9b89-41d2-8042-ee2d1829fb39 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:11.121979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be61e-9b89-41d2-8042-ee2d1829fb39 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:11.127414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9e01d-ccff-4815-a1ba-7f74ddb982e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:11.128398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e01d-ccff-4815-a1ba-7f74ddb982e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.128681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e01d-ccff-4815-a1ba-7f74ddb982e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.128954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e01d-ccff-4815-a1ba-7f74ddb982e5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.136586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9e01d-ccff-4815-a1ba-7f74ddb982e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:11.138681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9e01d-ccff-4815-a1ba-7f74ddb982e5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:11.153208 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-02d9e01d-ccff-4815-a1ba-7f74ddb982e5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 19 20:36:11.158854 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 497/995] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:36:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:11.161314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:11.173114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3682613-cdd0-4527-93e1-2d5a34d9de0c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:11.177772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cab2fe-daa1-4d91-8efc-b22f08149f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:11.178415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cab2fe-daa1-4d91-8efc-b22f08149f3c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.178749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cab2fe-daa1-4d91-8efc-b22f08149f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.179022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cab2fe-daa1-4d91-8efc-b22f08149f3c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.179867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cab2fe-daa1-4d91-8efc-b22f08149f3c admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:11.180272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cab2fe-daa1-4d91-8efc-b22f08149f3c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:11.182280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cab2fe-daa1-4d91-8efc-b22f08149f3c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:11.228484 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 499/996] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Feb 19 20:36:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:11.836529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ad9c-c200-4ed1-a6c6-d2cb779af998 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.837183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ad9c-c200-4ed1-a6c6-d2cb779af998 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.837183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ad9c-c200-4ed1-a6c6-d2cb779af998 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.838988 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 498/997] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:11.844038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7b90f-4227-4d4b-aa56-1f20f917ea2b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.844345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7b90f-4227-4d4b-aa56-1f20f917ea2b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.844638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7b90f-4227-4d4b-aa56-1f20f917ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.862739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-67f7b90f-4227-4d4b-aa56-1f20f917ea2b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:11.864264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67f7b90f-4227-4d4b-aa56-1f20f917ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:11.872319 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 500/998] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:11 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:11.897409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ad9c-c200-4ed1-a6c6-d2cb779af998 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:11.909633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ad9c-c200-4ed1-a6c6-d2cb779af998 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:11.914093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:11.914843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.915121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.915652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] PATH_INFO: `/v3/services/image` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.916303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:11.917926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:11.928401 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 19 20:36:11.929693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 499/999] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Feb 19 20:36:11 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:11.935202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7b90f-4227-4d4b-aa56-1f20f917ea2b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:11.944701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7b90f-4227-4d4b-aa56-1f20f917ea2b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:11.949146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:11.949841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.950075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.950351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.951049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] RBAC: Adding query filter params (name=image) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:11.951354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:11.953544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:11.958809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 501/1000] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:11.964219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:11.974359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b62eb-0ab7-4287-bb64-3895d887427b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:11.979116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:11.980022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:11.980558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:11.981047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:11.981935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] RBAC: Adding query filter params (type=image) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:11.982451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:11.984231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:11.989489 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 500/1001] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:11.995370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.005404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba134a1-3e1b-44ec-aa31-b63765eabb1d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.009872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964a8bd-74ec-4b85-9c5c-1ba0cbe6642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.010508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964a8bd-74ec-4b85-9c5c-1ba0cbe6642c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.010785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964a8bd-74ec-4b85-9c5c-1ba0cbe6642c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.011056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964a8bd-74ec-4b85-9c5c-1ba0cbe6642c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.011837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964a8bd-74ec-4b85-9c5c-1ba0cbe6642c admin admin] RBAC: Adding query filter params (interface=public, service_id=a987ea39583e4d67bda1857e0b74130f, region_id=RegionOne) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:12.012148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964a8bd-74ec-4b85-9c5c-1ba0cbe6642c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.013772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964a8bd-74ec-4b85-9c5c-1ba0cbe6642c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.019560 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 502/1002] 10.222.0.30 () {56 vars in 1272 bytes} [Sat Feb 19 20:36:11 2022] GET /identity/v3/endpoints?service_id=a987ea39583e4d67bda1857e0b74130f&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:12.024767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.034202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7505e6e-54aa-4ab3-87a0-faf359b57ef5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.038558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f280b2-4cd6-41fa-ae6a-0af8e7976666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.039200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f280b2-4cd6-41fa-ae6a-0af8e7976666 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.039502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f280b2-4cd6-41fa-ae6a-0af8e7976666 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.039747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f280b2-4cd6-41fa-ae6a-0af8e7976666 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.040815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f280b2-4cd6-41fa-ae6a-0af8e7976666 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.042492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f280b2-4cd6-41fa-ae6a-0af8e7976666 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.049373 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 501/1003] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:36:12.126477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332ba0-e246-4bf6-852b-e3391ce132c7 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.126854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332ba0-e246-4bf6-852b-e3391ce132c7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.127208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332ba0-e246-4bf6-852b-e3391ce132c7 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.129172 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 503/1004] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:12.134970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58aed-549c-4bc3-997f-0bc23cf7a011 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.135247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58aed-549c-4bc3-997f-0bc23cf7a011 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.135520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58aed-549c-4bc3-997f-0bc23cf7a011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.154763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-93c58aed-549c-4bc3-997f-0bc23cf7a011 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:12.156012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-93c58aed-549c-4bc3-997f-0bc23cf7a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:12.164368 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 502/1005] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:12 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:12.190311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42332ba0-e246-4bf6-852b-e3391ce132c7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.203832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42332ba0-e246-4bf6-852b-e3391ce132c7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.208451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.209336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.209691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.210035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.210771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.212627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.224150 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 19 20:36:12.227348 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 504/1006] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:12.231729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58aed-549c-4bc3-997f-0bc23cf7a011 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.241502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58aed-549c-4bc3-997f-0bc23cf7a011 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.246373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.247034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.247317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.247593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.248299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:12.248669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.250869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.256019 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 503/1007] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:12.261667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.271439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f839a7f-ebae-40ed-8505-f2e4c81c7749 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.275875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.276550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.276832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.277109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.277802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:12.278108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.279674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.288405 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 505/1008] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:12.291253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.301556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd56e-52c8-45eb-9eea-ae48fbf58019 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.306135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b856cfa-48ba-4744-b2ac-47fc8d39c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.306782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b856cfa-48ba-4744-b2ac-47fc8d39c85e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.307081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b856cfa-48ba-4744-b2ac-47fc8d39c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.307325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b856cfa-48ba-4744-b2ac-47fc8d39c85e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.308107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b856cfa-48ba-4744-b2ac-47fc8d39c85e admin admin] RBAC: Adding query filter params (interface=public, service_id=be91f147eb714cfeb7b0302eea1fb75a, region_id=RegionOne) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:12.308456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b856cfa-48ba-4744-b2ac-47fc8d39c85e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.310032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b856cfa-48ba-4744-b2ac-47fc8d39c85e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.320321 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 504/1009] 10.222.0.30 () {56 vars in 1272 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/endpoints?service_id=be91f147eb714cfeb7b0302eea1fb75a&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:12.321733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.333647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a9c58-66e4-4de0-a2ff-ee23ef7d7279 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.339067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea6c67-2c2f-4a62-a890-55156a4264bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.339846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea6c67-2c2f-4a62-a890-55156a4264bd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.340226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea6c67-2c2f-4a62-a890-55156a4264bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.340626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea6c67-2c2f-4a62-a890-55156a4264bd admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.341396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea6c67-2c2f-4a62-a890-55156a4264bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.343139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea6c67-2c2f-4a62-a890-55156a4264bd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.351508 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 506/1010] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:36:12.744886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26543-1676-4760-b84a-39d6e4b5cdcd None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.745196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26543-1676-4760-b84a-39d6e4b5cdcd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.745449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26543-1676-4760-b84a-39d6e4b5cdcd None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.747364 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 505/1011] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:12.752313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f85c-176d-402e-99eb-49d262eb939d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.752632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f85c-176d-402e-99eb-49d262eb939d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.752912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f85c-176d-402e-99eb-49d262eb939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.772839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9be9f85c-176d-402e-99eb-49d262eb939d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:12.774023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9be9f85c-176d-402e-99eb-49d262eb939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:12.782293 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 507/1012] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:12 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:12.807759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df26543-1676-4760-b84a-39d6e4b5cdcd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.820007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df26543-1676-4760-b84a-39d6e4b5cdcd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.824252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.825061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.825341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.825613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.826258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.827932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.838922 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 19 20:36:12.840275 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 506/1013] 10.222.0.30 () {56 vars in 1147 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:12.846384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f85c-176d-402e-99eb-49d262eb939d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.855732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f85c-176d-402e-99eb-49d262eb939d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.860872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.861519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.861799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.862072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.862767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:12.863069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.864676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.869651 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 508/1014] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:12.874851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.884322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fc8b-e548-4dee-8d7d-790f7cdb3314 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.888719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dafa4-f358-476d-8b49-6d2acca69b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.889357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dafa4-f358-476d-8b49-6d2acca69b22 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.889637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dafa4-f358-476d-8b49-6d2acca69b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.889910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dafa4-f358-476d-8b49-6d2acca69b22 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.891125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dafa4-f358-476d-8b49-6d2acca69b22 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:12.891428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dafa4-f358-476d-8b49-6d2acca69b22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.893018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dafa4-f358-476d-8b49-6d2acca69b22 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.897887 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 507/1015] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Feb 19 20:36:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:12.903232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:12.915705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc95ec5-7325-4a88-bb06-781e9e46fa99 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:12.920305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3fe6-cc75-49f8-9d3e-243398a1878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:12.920971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3fe6-cc75-49f8-9d3e-243398a1878f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:12.921250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3fe6-cc75-49f8-9d3e-243398a1878f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:12.921518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3fe6-cc75-49f8-9d3e-243398a1878f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:12.922245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b3fe6-cc75-49f8-9d3e-243398a1878f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:12.923804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b3fe6-cc75-49f8-9d3e-243398a1878f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:12.939956 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 509/1016] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:36:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:36:14.453290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f2125-2954-4872-9d83-7293637d5364 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.454288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f2125-2954-4872-9d83-7293637d5364 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.454771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f2125-2954-4872-9d83-7293637d5364 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.456791 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 508/1017] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:36:14.462265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245513c4-f164-4b3c-a381-00661906eb58 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.463091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245513c4-f164-4b3c-a381-00661906eb58 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.463570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245513c4-f164-4b3c-a381-00661906eb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.483709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-245513c4-f164-4b3c-a381-00661906eb58 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:14.485746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-245513c4-f164-4b3c-a381-00661906eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:14.503445 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 510/1018] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:14 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:14.527019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f2125-2954-4872-9d83-7293637d5364 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:14.538968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f2125-2954-4872-9d83-7293637d5364 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:14.543460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:14.544446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.544726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.544993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] PATH_INFO: `/v3/services/image` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.545632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:14.547705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:14.558420 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 19 20:36:14.559723 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 509/1019] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Feb 19 20:36:14 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:14.566092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245513c4-f164-4b3c-a381-00661906eb58 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:14.574991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245513c4-f164-4b3c-a381-00661906eb58 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:14.579603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:14.580246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.580557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.580833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.581535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] RBAC: Adding query filter params (name=image) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:14.581834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:14.583405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:14.588311 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 511/1020] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:14.594213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:14.604384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46405f-9113-4d19-ba71-fd55c66accd7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:14.609376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a6f06-2bc1-4e28-b620-f7336ca9c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:14.610022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6f06-2bc1-4e28-b620-f7336ca9c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.610304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6f06-2bc1-4e28-b620-f7336ca9c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.610580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6f06-2bc1-4e28-b620-f7336ca9c0ff admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.611280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a6f06-2bc1-4e28-b620-f7336ca9c0ff admin admin] RBAC: Adding query filter params (type=image) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:14.611588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a6f06-2bc1-4e28-b620-f7336ca9c0ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:14.613207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a6f06-2bc1-4e28-b620-f7336ca9c0ff admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:14.622820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 510/1021] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:14.624191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:14.634300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2ef53-607f-4bc7-9f3a-a05b94709fae admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:14.638781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bdac7-492b-45cd-839b-5d5bba220c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:14.639421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdac7-492b-45cd-839b-5d5bba220c3b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.639702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdac7-492b-45cd-839b-5d5bba220c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.639976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdac7-492b-45cd-839b-5d5bba220c3b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.641263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bdac7-492b-45cd-839b-5d5bba220c3b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:14.642841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bdac7-492b-45cd-839b-5d5bba220c3b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:14.668415 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 512/1022] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:36:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:36:14.725603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c18c-fa39-4406-b115-177b461d279a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.725824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c18c-fa39-4406-b115-177b461d279a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.726077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c18c-fa39-4406-b115-177b461d279a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.728254 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 511/1023] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:14.734107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82243045-b08f-4414-ae1f-da1b3a26a657 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.734408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82243045-b08f-4414-ae1f-da1b3a26a657 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.734659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82243045-b08f-4414-ae1f-da1b3a26a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.753755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-82243045-b08f-4414-ae1f-da1b3a26a657 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:14.754979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-82243045-b08f-4414-ae1f-da1b3a26a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:14.773629 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 513/1024] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:14 2022] POST /identity/v3/auth/tokens => generated 2817 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:14.798427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36c18c-fa39-4406-b115-177b461d279a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:14.811044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36c18c-fa39-4406-b115-177b461d279a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:14.816147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:14.816998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.817282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.817549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.818218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:14.819838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:14.832027 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 19 20:36:14.833492 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 512/1025] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:14.839257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82243045-b08f-4414-ae1f-da1b3a26a657 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:14.848602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82243045-b08f-4414-ae1f-da1b3a26a657 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:14.853426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:14.854086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.854371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.854647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.855355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:14.855663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:14.857297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:14.862709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 514/1026] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:36:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:14.868428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:14.879014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e0a8-dccd-424c-9046-433c8dd11c33 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:14.885645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bb67b-a8ae-4a61-80c0-b2b6286f1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:14.886305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb67b-a8ae-4a61-80c0-b2b6286f1c0c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.886586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb67b-a8ae-4a61-80c0-b2b6286f1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.886868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb67b-a8ae-4a61-80c0-b2b6286f1c0c admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.887574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bb67b-a8ae-4a61-80c0-b2b6286f1c0c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:14.887883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bb67b-a8ae-4a61-80c0-b2b6286f1c0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:14.889496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bb67b-a8ae-4a61-80c0-b2b6286f1c0c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:14.895502 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 513/1027] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Feb 19 20:36:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:14.901377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:14.911858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8d655-df45-4ab1-a845-7b97facd1f56 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:14.916941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a53ef-732d-4274-8b41-7a4ce874af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:14.917584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a53ef-732d-4274-8b41-7a4ce874af62 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:14.917867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a53ef-732d-4274-8b41-7a4ce874af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:14.918145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a53ef-732d-4274-8b41-7a4ce874af62 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:14.918875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a53ef-732d-4274-8b41-7a4ce874af62 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:14.920491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a53ef-732d-4274-8b41-7a4ce874af62 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:14.940214 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 515/1028] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:36:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:36:15.350118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a03d6-9688-4157-b5f8-405bcb7645be None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:15.350527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a03d6-9688-4157-b5f8-405bcb7645be None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:15.350708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a03d6-9688-4157-b5f8-405bcb7645be None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:15.352598 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 514/1029] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:15.357634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe12ee-5921-40c4-84d2-d68f22ba2828 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:15.357925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe12ee-5921-40c4-84d2-d68f22ba2828 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:15.358202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe12ee-5921-40c4-84d2-d68f22ba2828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:15.375614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f8fe12ee-5921-40c4-84d2-d68f22ba2828 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:15.376822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f8fe12ee-5921-40c4-84d2-d68f22ba2828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:15.394556 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 516/1030] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:15.419766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a03d6-9688-4157-b5f8-405bcb7645be None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:15.432077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a03d6-9688-4157-b5f8-405bcb7645be None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:15.436354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802f75f-c817-44e8-b15f-75083e862c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:15.437150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f75f-c817-44e8-b15f-75083e862c74 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:15.437426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f75f-c817-44e8-b15f-75083e862c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:15.437692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f75f-c817-44e8-b15f-75083e862c74 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:15.438840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802f75f-c817-44e8-b15f-75083e862c74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:15.440523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802f75f-c817-44e8-b15f-75083e862c74 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:15.442246 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 515/1031] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:15.447687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe12ee-5921-40c4-84d2-d68f22ba2828 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:15.458526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe12ee-5921-40c4-84d2-d68f22ba2828 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:15.466925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd78e2-e7a3-47b9-a04a-283b603d59b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:15.467575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd78e2-e7a3-47b9-a04a-283b603d59b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:15.467849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd78e2-e7a3-47b9-a04a-283b603d59b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:15.468120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd78e2-e7a3-47b9-a04a-283b603d59b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:15.469407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd78e2-e7a3-47b9-a04a-283b603d59b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:15.471318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd78e2-e7a3-47b9-a04a-283b603d59b7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:15.497365 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 517/1032] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:36:15 2022] POST /identity/v3/projects => generated 311 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:17.094118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d5008-4686-4780-b64c-209c33412397 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.094673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d5008-4686-4780-b64c-209c33412397 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.094673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d5008-4686-4780-b64c-209c33412397 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.096611 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 516/1033] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:17.101708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8785-daff-4ce9-9337-269a94712c48 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.102158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8785-daff-4ce9-9337-269a94712c48 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.102253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8785-daff-4ce9-9337-269a94712c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.120615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ba4f8785-daff-4ce9-9337-269a94712c48 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:17.121967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ba4f8785-daff-4ce9-9337-269a94712c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:17.178575 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 518/1034] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:17.202412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d5008-4686-4780-b64c-209c33412397 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.214595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d5008-4686-4780-b64c-209c33412397 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.219679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf982-d5eb-422e-b481-0bfc2e7443f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.220314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf982-d5eb-422e-b481-0bfc2e7443f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.220624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf982-d5eb-422e-b481-0bfc2e7443f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.220902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf982-d5eb-422e-b481-0bfc2e7443f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.228779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cf982-d5eb-422e-b481-0bfc2e7443f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.230516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cf982-d5eb-422e-b481-0bfc2e7443f7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.240228 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 517/1035] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:17.245879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8785-daff-4ce9-9337-269a94712c48 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.255469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8785-daff-4ce9-9337-269a94712c48 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.260040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f27586-f3f3-4d45-baa9-9c41d62c3485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.260843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27586-f3f3-4d45-baa9-9c41d62c3485 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.261124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27586-f3f3-4d45-baa9-9c41d62c3485 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.261398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27586-f3f3-4d45-baa9-9c41d62c3485 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.262575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f27586-f3f3-4d45-baa9-9c41d62c3485 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.264255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f27586-f3f3-4d45-baa9-9c41d62c3485 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.268536 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 519/1036] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:17.431925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aef92-bcc9-45c3-b693-692b140ae6f1 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.432270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aef92-bcc9-45c3-b693-692b140ae6f1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.432478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aef92-bcc9-45c3-b693-692b140ae6f1 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.434284 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 518/1037] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:17.439860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd760e8-7ed0-4aad-a831-3793bc2bd159 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.440143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd760e8-7ed0-4aad-a831-3793bc2bd159 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.440441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd760e8-7ed0-4aad-a831-3793bc2bd159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.459432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4dd760e8-7ed0-4aad-a831-3793bc2bd159 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:17.460635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4dd760e8-7ed0-4aad-a831-3793bc2bd159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:17.470056 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 520/1038] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:17.495154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aef92-bcc9-45c3-b693-692b140ae6f1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.507843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aef92-bcc9-45c3-b693-692b140ae6f1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.512298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9a6cd-bc1d-4988-9027-638bb2dbe5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.513100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9a6cd-bc1d-4988-9027-638bb2dbe5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.513376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9a6cd-bc1d-4988-9027-638bb2dbe5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.513644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9a6cd-bc1d-4988-9027-638bb2dbe5b7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.525874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9a6cd-bc1d-4988-9027-638bb2dbe5b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:17.533725 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-c1c9a6cd-bc1d-4988-9027-638bb2dbe5b7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 19 20:36:17.535149 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 519/1039] 10.222.0.30 () {56 vars in 1141 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:17.541291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd760e8-7ed0-4aad-a831-3793bc2bd159 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.551528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd760e8-7ed0-4aad-a831-3793bc2bd159 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.557379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.558037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.558313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.558583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.559329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:17.559631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.561259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.569909 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 521/1040] 10.222.0.30 () {56 vars in 1136 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:17.575731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9a6cd-bc1d-4988-9027-638bb2dbe5b7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.589007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9a6cd-bc1d-4988-9027-638bb2dbe5b7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.596176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.597051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.597330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.597592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.609460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.611354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.630098 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:17.631297 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 520/1041] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:17.638513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.648785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae00ad3-bc8a-41fc-b2d3-b7cf209c9f73 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.653294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.654002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.654295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.654576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.655298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:17.655614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.657851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.670028 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 522/1042] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:17.675810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.685360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc5e6-02b4-423a-821e-b7604754fcc9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.689723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.690480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.690756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.691025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.698225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.700211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.714088 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:36:17.715231 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 521/1043] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:17.721467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.731108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccffd0c-5bd0-475b-b57a-e48cf879858d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.735598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.736241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.736556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.736827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.737646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:17.737947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.739760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.756882 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 523/1044] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:17.762496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.772575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1e13d-4230-470e-ab35-b09bf3aaef17 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.776984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef10301-0755-4cc9-b904-d7b6d53f7497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.777606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10301-0755-4cc9-b904-d7b6d53f7497 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.777884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10301-0755-4cc9-b904-d7b6d53f7497 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.778156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10301-0755-4cc9-b904-d7b6d53f7497 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.785569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef10301-0755-4cc9-b904-d7b6d53f7497 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.787280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef10301-0755-4cc9-b904-d7b6d53f7497 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.796082 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 522/1045] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:36:17.801503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.810955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e9a75-c33b-42b9-8f3d-9cf63fe3bf3a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.815876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.816661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.816935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.817199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.833562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.835382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.851540 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:17.852725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 524/1046] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:17.858482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef10301-0755-4cc9-b904-d7b6d53f7497 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.867235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef10301-0755-4cc9-b904-d7b6d53f7497 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.871704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.872358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.872646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.872914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.873616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:17.873915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.875950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.886969 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 523/1047] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:17.893134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.902520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814581-4ff5-4d64-bec2-49975f45f3a0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.907036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.907792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.908068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.908353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.914941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.917144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.929540 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:36:17.930673 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 525/1048] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:17.936706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.946645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88762105-2634-4b5c-8481-560e6edb771e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.951047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939ff0e-098e-45bb-88c1-820e500b98a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.951690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939ff0e-098e-45bb-88c1-820e500b98a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.951968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939ff0e-098e-45bb-88c1-820e500b98a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.952245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939ff0e-098e-45bb-88c1-820e500b98a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.953779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939ff0e-098e-45bb-88c1-820e500b98a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:17.954229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939ff0e-098e-45bb-88c1-820e500b98a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.956551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939ff0e-098e-45bb-88c1-820e500b98a3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:17.969138 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 524/1049] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:17.975266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:17.980799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37996b-fbf6-41bf-ac86-d3fa3f3edd6d None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.981096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37996b-fbf6-41bf-ac86-d3fa3f3edd6d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.981376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37996b-fbf6-41bf-ac86-d3fa3f3edd6d None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.983097 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 525/1050] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:36:17.985985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10daff-92ad-47b3-8eec-521cb584e936 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:17.988037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8668e7-3973-4a16-afe8-d2f7516098e5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.988320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8668e7-3973-4a16-afe8-d2f7516098e5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.988631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8668e7-3973-4a16-afe8-d2f7516098e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.990875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:17.991497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:17.991773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:17.992046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:17.992889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] RBAC: Adding query filter params (role.id=6989b63dc10a4c96adcd2ece970c1ff3, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=a20eaaff207f4d1b870c6abf0a50f1c8) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:17.993197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:17.995010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:18.004366 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 526/1051] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:17 2022] GET /identity/v3/role_assignments?user.id=a20eaaff207f4d1b870c6abf0a50f1c8&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6989b63dc10a4c96adcd2ece970c1ff3 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:18.010646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8b8668e7-3973-4a16-afe8-d2f7516098e5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:18.012178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b8668e7-3973-4a16-afe8-d2f7516098e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:18.021112 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 526/1052] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:18.047734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:18.057922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71201a-fb3e-4179-9a4d-6062afa67358 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:18.063186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc5a0b-4cf6-497d-9045-01eeaf9d5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:18.063994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5a0b-4cf6-497d-9045-01eeaf9d5809 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:18.064271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5a0b-4cf6-497d-9045-01eeaf9d5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:18.064577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5a0b-4cf6-497d-9045-01eeaf9d5809 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:18.065796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc5a0b-4cf6-497d-9045-01eeaf9d5809 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:18.067492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc5a0b-4cf6-497d-9045-01eeaf9d5809 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:18.069169 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 527/1053] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:18.075207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8668e7-3973-4a16-afe8-d2f7516098e5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:18.085272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8668e7-3973-4a16-afe8-d2f7516098e5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:18.089883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5ed9a-310a-4686-9951-4a835fcbb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:18.090559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ed9a-310a-4686-9951-4a835fcbb87e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:18.090843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ed9a-310a-4686-9951-4a835fcbb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:18.091119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ed9a-310a-4686-9951-4a835fcbb87e admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:18.091854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5ed9a-310a-4686-9951-4a835fcbb87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:18.093867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5ed9a-310a-4686-9951-4a835fcbb87e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:18.114820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 527/1054] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:36:18 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:20.372111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0c91-a2e6-44dd-b68b-a6155ec0797e None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.372704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0c91-a2e6-44dd-b68b-a6155ec0797e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.372704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f0c91-a2e6-44dd-b68b-a6155ec0797e None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.374513 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 528/1055] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:20.379838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973d9a-bb22-4c0c-8de8-60804e377f91 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.380264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973d9a-bb22-4c0c-8de8-60804e377f91 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.380426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973d9a-bb22-4c0c-8de8-60804e377f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.399024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e1973d9a-bb22-4c0c-8de8-60804e377f91 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:20.400224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e1973d9a-bb22-4c0c-8de8-60804e377f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:20.408769 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 528/1056] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:20.433236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f0c91-a2e6-44dd-b68b-a6155ec0797e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.445339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f0c91-a2e6-44dd-b68b-a6155ec0797e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.449628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc53ba-383c-4c7c-b96e-38b8d298c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.450410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc53ba-383c-4c7c-b96e-38b8d298c13d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.450688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc53ba-383c-4c7c-b96e-38b8d298c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.450959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc53ba-383c-4c7c-b96e-38b8d298c13d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.461384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc53ba-383c-4c7c-b96e-38b8d298c13d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:20.469087 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-54cc53ba-383c-4c7c-b96e-38b8d298c13d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 19 20:36:20.470241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 529/1057] 10.222.0.30 () {56 vars in 1141 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:20.476049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1973d9a-bb22-4c0c-8de8-60804e377f91 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.485012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1973d9a-bb22-4c0c-8de8-60804e377f91 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.489491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6261c0-c91e-4b55-821b-8b84e499d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.490142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6261c0-c91e-4b55-821b-8b84e499d6ff admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.490424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6261c0-c91e-4b55-821b-8b84e499d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.490701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6261c0-c91e-4b55-821b-8b84e499d6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.491441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6261c0-c91e-4b55-821b-8b84e499d6ff admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:20.491747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6261c0-c91e-4b55-821b-8b84e499d6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.493361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6261c0-c91e-4b55-821b-8b84e499d6ff admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.501432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 529/1058] 10.222.0.30 () {56 vars in 1136 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:20.506883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc53ba-383c-4c7c-b96e-38b8d298c13d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.517915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc53ba-383c-4c7c-b96e-38b8d298c13d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.522678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.523448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.523731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.524009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.531248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdebdc3-2756-45ea-b52b-f8d0dc5603e2 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.531584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdebdc3-2756-45ea-b52b-f8d0dc5603e2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.531864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdebdc3-2756-45ea-b52b-f8d0dc5603e2 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.533654 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 530/1059] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:36:20.535048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.536963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.538708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259348-8e41-4fbe-8e12-10a98e387510 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.538997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259348-8e41-4fbe-8e12-10a98e387510 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.539277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259348-8e41-4fbe-8e12-10a98e387510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.554516 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:20.555677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 530/1060] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:20.556941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bc259348-8e41-4fbe-8e12-10a98e387510 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:20.558130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bc259348-8e41-4fbe-8e12-10a98e387510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:20.561287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.565916 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 531/1061] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:20.570803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea70643-fbb6-46ac-821b-d2cbca970c08 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.575343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.575951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.576233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.576538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.577239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:20.578082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.579630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.590697 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 531/1062] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:20.591592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc259348-8e41-4fbe-8e12-10a98e387510 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.596439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.601378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc259348-8e41-4fbe-8e12-10a98e387510 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.605450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c43d2-f55a-4c8b-8e51-73272da3ce89 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.605880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3d3dc-d996-402b-a6a5-d69f70044378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.606649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d3dc-d996-402b-a6a5-d69f70044378 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.606929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d3dc-d996-402b-a6a5-d69f70044378 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.607202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d3dc-d996-402b-a6a5-d69f70044378 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.610487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.611215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.611495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.611774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.617586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3d3dc-d996-402b-a6a5-d69f70044378 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:20.619403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.621410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.624428 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-26f3d3dc-d996-402b-a6a5-d69f70044378 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:36:20.628357 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 532/1063] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:20.631937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3d3dc-d996-402b-a6a5-d69f70044378 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.634799 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:36:20.640357 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 532/1064] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:20.641231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.641862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3d3dc-d996-402b-a6a5-d69f70044378 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.646193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.646813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.647089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.647359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.648085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:20.648417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.649998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.650563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98c08d-d6a3-4d2d-a17a-bdc0ad1e35c0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.654996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.655607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.655883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.656163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.657003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:20.657307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.662863 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 533/1065] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:20.662986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.663782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.673444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270be60-244f-4db6-a315-58b057b4af50 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.676667 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 533/1066] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:20.677756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ac5cc-41ca-4944-a5d1-dd9b9ad0006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.678564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ac5cc-41ca-4944-a5d1-dd9b9ad0006c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.678837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ac5cc-41ca-4944-a5d1-dd9b9ad0006c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.679105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ac5cc-41ca-4944-a5d1-dd9b9ad0006c admin admin] PATH_INFO: `/v3/users/ab1c9c504cc842bd86728481557640a2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.681958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.691691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43c3a-3624-4579-a62c-f55c4f5902e3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.692907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ac5cc-41ca-4944-a5d1-dd9b9ad0006c admin admin] RBAC: Authorizing `identity:get_user(user_id=ab1c9c504cc842bd86728481557640a2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.695035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ac5cc-41ca-4944-a5d1-dd9b9ad0006c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.696692 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 534/1067] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/users/ab1c9c504cc842bd86728481557640a2 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:20.698772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.699690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.700711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.700992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.703728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ac5cc-41ca-4944-a5d1-dd9b9ad0006c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.711518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.713018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ac5cc-41ca-4944-a5d1-dd9b9ad0006c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.713353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.717450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c1d4b-db18-45ac-998a-117971f24734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.718066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c1d4b-db18-45ac-998a-117971f24734 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.718349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c1d4b-db18-45ac-998a-117971f24734 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.718626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c1d4b-db18-45ac-998a-117971f24734 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.726243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c1d4b-db18-45ac-998a-117971f24734 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.727948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c1d4b-db18-45ac-998a-117971f24734 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.729415 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:20.730587 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 534/1068] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:20.736534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.742180 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 535/1069] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:36:20.743311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c1d4b-db18-45ac-998a-117971f24734 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.745706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871efe04-d7a5-4088-b93b-3c57fcdc70d2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.750759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.751366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.751641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.751906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c1d4b-db18-45ac-998a-117971f24734 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.752002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.752629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:20.752933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.754484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.756306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaf961-1060-4dd3-8e52-c2b2a4f751fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.757135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaf961-1060-4dd3-8e52-c2b2a4f751fd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.757411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaf961-1060-4dd3-8e52-c2b2a4f751fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.757707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaf961-1060-4dd3-8e52-c2b2a4f751fd admin admin] PATH_INFO: `/v3/projects/344f8dfc27144f52aee56c228d8588e1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.758861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaf961-1060-4dd3-8e52-c2b2a4f751fd admin admin] RBAC: Authorizing `identity:get_project(project_id=344f8dfc27144f52aee56c228d8588e1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.760873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaf961-1060-4dd3-8e52-c2b2a4f751fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.762498 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 536/1070] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/projects/344f8dfc27144f52aee56c228d8588e1 => generated 311 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:20.765587 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 535/1071] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:20.768093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaf961-1060-4dd3-8e52-c2b2a4f751fd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.770844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.777455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaf961-1060-4dd3-8e52-c2b2a4f751fd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.779675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d916e-6710-423a-96a0-0a0ee09ebc09 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.782367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.782963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.783243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.783517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.784316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=344f8dfc27144f52aee56c228d8588e1, user.id=ab1c9c504cc842bd86728481557640a2) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:20.784640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.784747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.785359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.785635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.785905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.786419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.791825 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 537/1072] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/role_assignments?user.id=ab1c9c504cc842bd86728481557640a2&scope.project.id=344f8dfc27144f52aee56c228d8588e1&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:20.795951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.798515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.813471 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:36:20.814736 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 536/1073] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:20.820855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.831400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe97044-3dbb-4200-9daf-3b35d5de358b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.836035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef95ec-290a-4cf7-86e4-527b7bbccbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.836735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef95ec-290a-4cf7-86e4-527b7bbccbad admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.837018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef95ec-290a-4cf7-86e4-527b7bbccbad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.837296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef95ec-290a-4cf7-86e4-527b7bbccbad admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.838083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef95ec-290a-4cf7-86e4-527b7bbccbad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:20.838393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef95ec-290a-4cf7-86e4-527b7bbccbad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.840236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef95ec-290a-4cf7-86e4-527b7bbccbad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.857903 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 538/1074] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:20.859391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:20.869411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24962b-96f7-413b-9442-03a45dc330e4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:20.874058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e27b47-4e12-4232-b5d0-4bb18679c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:20.875551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27b47-4e12-4232-b5d0-4bb18679c967 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:20.875772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27b47-4e12-4232-b5d0-4bb18679c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:20.876043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27b47-4e12-4232-b5d0-4bb18679c967 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/a20eaaff207f4d1b870c6abf0a50f1c8/roles/6989b63dc10a4c96adcd2ece970c1ff3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:20.878325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e27b47-4e12-4232-b5d0-4bb18679c967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=a20eaaff207f4d1b870c6abf0a50f1c8, role_id=6989b63dc10a4c96adcd2ece970c1ff3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:20.881029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e27b47-4e12-4232-b5d0-4bb18679c967 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:20.895699 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 537/1075] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:36:20 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/a20eaaff207f4d1b870c6abf0a50f1c8/roles/6989b63dc10a4c96adcd2ece970c1ff3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:36:23.162695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a5c16-67be-4609-a0ba-a013cc78a221 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.163222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a5c16-67be-4609-a0ba-a013cc78a221 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.163222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a5c16-67be-4609-a0ba-a013cc78a221 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.165065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 539/1076] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:23.170594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0932d67-4a5a-4181-a37a-460fe5ed0185 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.170998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0932d67-4a5a-4181-a37a-460fe5ed0185 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.171152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0932d67-4a5a-4181-a37a-460fe5ed0185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.189827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c0932d67-4a5a-4181-a37a-460fe5ed0185 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:23.191024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c0932d67-4a5a-4181-a37a-460fe5ed0185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:23.246576 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 538/1077] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:23.246765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ae5a2-951b-4cc0-8b11-b8ff85a86571 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.246983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ae5a2-951b-4cc0-8b11-b8ff85a86571 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.247264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ae5a2-951b-4cc0-8b11-b8ff85a86571 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.249104 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 540/1078] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:36:23.254664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b5bfc-e81a-4a58-95a6-15a7cf5a308f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.254955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b5bfc-e81a-4a58-95a6-15a7cf5a308f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.255233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b5bfc-e81a-4a58-95a6-15a7cf5a308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.271874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ae5a2-951b-4cc0-8b11-b8ff85a86571 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.272706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-633b5bfc-e81a-4a58-95a6-15a7cf5a308f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:23.273887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-633b5bfc-e81a-4a58-95a6-15a7cf5a308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:23.281633 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 539/1079] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:23.283874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ae5a2-951b-4cc0-8b11-b8ff85a86571 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.288208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45ac81-759b-4074-aca7-6eda87907334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.288996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ac81-759b-4074-aca7-6eda87907334 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.289282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ac81-759b-4074-aca7-6eda87907334 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.289561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ac81-759b-4074-aca7-6eda87907334 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.300141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45ac81-759b-4074-aca7-6eda87907334 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:23.306680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b5bfc-e81a-4a58-95a6-15a7cf5a308f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.306843 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-5f45ac81-759b-4074-aca7-6eda87907334 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:36:23.308125 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 541/1080] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:23.314102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45ac81-759b-4074-aca7-6eda87907334 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.315867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b5bfc-e81a-4a58-95a6-15a7cf5a308f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.320390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc969bf3-98e9-4897-b709-6797e5fd0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.321172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969bf3-98e9-4897-b709-6797e5fd0356 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.321451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969bf3-98e9-4897-b709-6797e5fd0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.321719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969bf3-98e9-4897-b709-6797e5fd0356 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.323432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45ac81-759b-4074-aca7-6eda87907334 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.328355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.328971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.329253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.329539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.330292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:23.330607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.332157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc969bf3-98e9-4897-b709-6797e5fd0356 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:23.332263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.339268 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-fc969bf3-98e9-4897-b709-6797e5fd0356 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 19 20:36:23.340206 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 542/1081] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:23.340430 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 540/1082] 10.222.0.30 () {56 vars in 1141 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:23.346048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.346176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc969bf3-98e9-4897-b709-6797e5fd0356 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.355135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6a467-483c-47ec-8c6d-f4facbeb4d77 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.355564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc969bf3-98e9-4897-b709-6797e5fd0356 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.359751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa72fc-b8dd-4a53-9db7-119c2c69e0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.359937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.360575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.360696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa72fc-b8dd-4a53-9db7-119c2c69e0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.360853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.360948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa72fc-b8dd-4a53-9db7-119c2c69e0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.361121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.361213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa72fc-b8dd-4a53-9db7-119c2c69e0c3 admin admin] PATH_INFO: `/v3/users/ab1c9c504cc842bd86728481557640a2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.361842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:23.362141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.362306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa72fc-b8dd-4a53-9db7-119c2c69e0c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab1c9c504cc842bd86728481557640a2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.363691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.364484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa72fc-b8dd-4a53-9db7-119c2c69e0c3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.370161 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 543/1083] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/users/ab1c9c504cc842bd86728481557640a2 => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:23.371692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa72fc-b8dd-4a53-9db7-119c2c69e0c3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.371912 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 541/1084] 10.222.0.30 () {56 vars in 1136 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:23.377918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.381773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa72fc-b8dd-4a53-9db7-119c2c69e0c3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.386169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df304a6-3cf0-4613-9370-ba8e4f9a2deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.386762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3c91-c62a-4807-9edc-02f92c47f7e4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.386960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df304a6-3cf0-4613-9370-ba8e4f9a2deb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.387242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df304a6-3cf0-4613-9370-ba8e4f9a2deb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.387520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df304a6-3cf0-4613-9370-ba8e4f9a2deb admin admin] PATH_INFO: `/v3/projects/344f8dfc27144f52aee56c228d8588e1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.388711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df304a6-3cf0-4613-9370-ba8e4f9a2deb admin admin] RBAC: Authorizing `identity:get_project(project_id=344f8dfc27144f52aee56c228d8588e1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.391275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df304a6-3cf0-4613-9370-ba8e4f9a2deb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.391907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.392859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.392966 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 544/1085] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/projects/344f8dfc27144f52aee56c228d8588e1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:23.393329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.393583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.399425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df304a6-3cf0-4613-9370-ba8e4f9a2deb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.407402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.407402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.407978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df304a6-3cf0-4613-9370-ba8e4f9a2deb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.412595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e33e9-9df4-4874-8db4-06d26b27087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.413494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e33e9-9df4-4874-8db4-06d26b27087e admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.413728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e33e9-9df4-4874-8db4-06d26b27087e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.414004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e33e9-9df4-4874-8db4-06d26b27087e admin admin] PATH_INFO: `/v3/projects/344f8dfc27144f52aee56c228d8588e1/users/ab1c9c504cc842bd86728481557640a2/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.416223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e33e9-9df4-4874-8db4-06d26b27087e admin admin] RBAC: Authorizing `identity:create_grant(project_id=344f8dfc27144f52aee56c228d8588e1, user_id=ab1c9c504cc842bd86728481557640a2, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.418825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e33e9-9df4-4874-8db4-06d26b27087e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.424309 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:23.425797 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 542/1086] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:36:23.432983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.434463 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 545/1087] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:36:23 2022] PUT /identity/v3/projects/344f8dfc27144f52aee56c228d8588e1/users/ab1c9c504cc842bd86728481557640a2/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:36:23.443513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e6ce-570e-4af1-b561-7fe80385c376 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.501693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.502366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.502649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.502922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.503651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:23.503958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.505601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.522585 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 543/1088] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:23.523930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e33e9-9df4-4874-8db4-06d26b27087e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.534316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e33e9-9df4-4874-8db4-06d26b27087e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.539075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.539945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.540233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.540789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.549786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.551803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.566680 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 19 20:36:23.567960 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 546/1089] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:23.573934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.584156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113b5b-c7e4-4e75-9e65-4df2a9d2db92 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.589130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.589902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.590248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.590587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.591492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:23.591868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.593893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.614762 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 544/1090] 10.222.0.30 () {56 vars in 1154 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:23.620452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.630753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724875e4-826c-48fa-b077-f6aa8adff8f3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.635251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a691b01-76d0-471d-bcb3-5dd259673747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.635878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a691b01-76d0-471d-bcb3-5dd259673747 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.636159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a691b01-76d0-471d-bcb3-5dd259673747 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.636493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a691b01-76d0-471d-bcb3-5dd259673747 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.644372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a691b01-76d0-471d-bcb3-5dd259673747 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.646129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a691b01-76d0-471d-bcb3-5dd259673747 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.654959 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 547/1091] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:23.660835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.670813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2e67-df28-43f1-9abf-67a37a005245 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.675754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.676553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.676836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.677112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.687950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.689824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.707712 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:36:23.708937 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 545/1092] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:23.714572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a691b01-76d0-471d-bcb3-5dd259673747 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.723530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a691b01-76d0-471d-bcb3-5dd259673747 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.728132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.728831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.729117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.729394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.730108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:23.730415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.732063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.744649 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 548/1093] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:23.750665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.760437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06cf7-b250-4f62-82b4-e2b30e8a2875 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.764924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.765687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.765966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.766245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.772906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.774835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.787770 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:36:23.788933 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 546/1094] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:23.794993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.805233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29412e-d94f-4272-b658-fec1a7645a7d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.809850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cedfc-aa0d-42fc-ac4d-6b6c0e570b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.810493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cedfc-aa0d-42fc-ac4d-6b6c0e570b68 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.810778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cedfc-aa0d-42fc-ac4d-6b6c0e570b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.811055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cedfc-aa0d-42fc-ac4d-6b6c0e570b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.811833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cedfc-aa0d-42fc-ac4d-6b6c0e570b68 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:23.812146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cedfc-aa0d-42fc-ac4d-6b6c0e570b68 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.814021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cedfc-aa0d-42fc-ac4d-6b6c0e570b68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.825410 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 549/1095] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:23.831245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:23.841547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90447b8-b25a-4bcc-872f-318519dd0972 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:23.846481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fadd54-35fb-44d9-a59b-32e25ea25bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:23.847105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fadd54-35fb-44d9-a59b-32e25ea25bfa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:23.847388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fadd54-35fb-44d9-a59b-32e25ea25bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:23.847659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fadd54-35fb-44d9-a59b-32e25ea25bfa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:23.848508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fadd54-35fb-44d9-a59b-32e25ea25bfa admin admin] RBAC: Adding query filter params (role.id=6989b63dc10a4c96adcd2ece970c1ff3, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=a20eaaff207f4d1b870c6abf0a50f1c8) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:23.848820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fadd54-35fb-44d9-a59b-32e25ea25bfa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:23.850646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fadd54-35fb-44d9-a59b-32e25ea25bfa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:23.856273 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 547/1096] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:23 2022] GET /identity/v3/role_assignments?user.id=a20eaaff207f4d1b870c6abf0a50f1c8&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6989b63dc10a4c96adcd2ece970c1ff3 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:25.776259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a0ec-e918-4922-9548-80c02bc23f75 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:25.776809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a0ec-e918-4922-9548-80c02bc23f75 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:25.776996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a0ec-e918-4922-9548-80c02bc23f75 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:25.778627 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 550/1097] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:25.784308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de952e5-d6f5-45b1-a27f-0e4e0f8d3d0b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:25.784746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de952e5-d6f5-45b1-a27f-0e4e0f8d3d0b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:25.784875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de952e5-d6f5-45b1-a27f-0e4e0f8d3d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:25.802500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6de952e5-d6f5-45b1-a27f-0e4e0f8d3d0b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:25.803664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6de952e5-d6f5-45b1-a27f-0e4e0f8d3d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:25.811155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 548/1098] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:25.835891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08a0ec-e918-4922-9548-80c02bc23f75 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:25.847898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08a0ec-e918-4922-9548-80c02bc23f75 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:25.852261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e906-7b29-439d-94f5-19d99265070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:25.853050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e906-7b29-439d-94f5-19d99265070d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:25.853335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e906-7b29-439d-94f5-19d99265070d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:25.853613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e906-7b29-439d-94f5-19d99265070d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:25.864046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e906-7b29-439d-94f5-19d99265070d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:25.870731 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4d54e906-7b29-439d-94f5-19d99265070d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:36:25.871860 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 551/1099] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:25.877925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de952e5-d6f5-45b1-a27f-0e4e0f8d3d0b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:25.886476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de952e5-d6f5-45b1-a27f-0e4e0f8d3d0b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:25.891121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:25.891759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:25.892041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:25.892318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:25.893223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:25.893529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:25.895110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:25.903383 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 549/1100] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:25.908848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e906-7b29-439d-94f5-19d99265070d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:25.920222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e906-7b29-439d-94f5-19d99265070d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:25.925375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb740e-6e5c-4d0e-b4c3-fa312faab687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:25.926204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb740e-6e5c-4d0e-b4c3-fa312faab687 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:25.926484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb740e-6e5c-4d0e-b4c3-fa312faab687 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:25.926759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb740e-6e5c-4d0e-b4c3-fa312faab687 admin admin] PATH_INFO: `/v3/users/ab1c9c504cc842bd86728481557640a2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:25.927941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb740e-6e5c-4d0e-b4c3-fa312faab687 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab1c9c504cc842bd86728481557640a2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:25.930085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb740e-6e5c-4d0e-b4c3-fa312faab687 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:25.931650 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 552/1101] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:25 2022] GET /identity/v3/users/ab1c9c504cc842bd86728481557640a2 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:25.938983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:25.948512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4cea6-8700-4bb7-9a04-7181da642ebd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:25.953019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4df2a-3f81-49c2-bc80-4f5c103571d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:25.953580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4df2a-3f81-49c2-bc80-4f5c103571d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:25.953860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4df2a-3f81-49c2-bc80-4f5c103571d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:25.954138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4df2a-3f81-49c2-bc80-4f5c103571d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:25.961636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4df2a-3f81-49c2-bc80-4f5c103571d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:25.963349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4df2a-3f81-49c2-bc80-4f5c103571d9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:25.971951 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 550/1102] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:25 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:25.977293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb740e-6e5c-4d0e-b4c3-fa312faab687 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:25.987208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb740e-6e5c-4d0e-b4c3-fa312faab687 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:25.991699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df095b9-a602-4e91-bec6-148ec5dc0bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:25.992536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df095b9-a602-4e91-bec6-148ec5dc0bcc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:25.992821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df095b9-a602-4e91-bec6-148ec5dc0bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:25.993098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df095b9-a602-4e91-bec6-148ec5dc0bcc admin admin] PATH_INFO: `/v3/projects/344f8dfc27144f52aee56c228d8588e1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:25.994251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df095b9-a602-4e91-bec6-148ec5dc0bcc admin admin] RBAC: Authorizing `identity:get_project(project_id=344f8dfc27144f52aee56c228d8588e1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:25.996248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df095b9-a602-4e91-bec6-148ec5dc0bcc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:25.997886 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 553/1103] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:25 2022] GET /identity/v3/projects/344f8dfc27144f52aee56c228d8588e1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:26.003866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4df2a-3f81-49c2-bc80-4f5c103571d9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:26.012229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4df2a-3f81-49c2-bc80-4f5c103571d9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:26.016754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd3810-c32a-4520-b766-3a426fe56fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:26.017346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3810-c32a-4520-b766-3a426fe56fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:26.017627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3810-c32a-4520-b766-3a426fe56fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:26.017904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3810-c32a-4520-b766-3a426fe56fc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:26.018697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd3810-c32a-4520-b766-3a426fe56fc5 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=344f8dfc27144f52aee56c228d8588e1, user.id=ab1c9c504cc842bd86728481557640a2) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:26.019005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd3810-c32a-4520-b766-3a426fe56fc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:26.020805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd3810-c32a-4520-b766-3a426fe56fc5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:26.026333 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 551/1104] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:26 2022] GET /identity/v3/role_assignments?user.id=ab1c9c504cc842bd86728481557640a2&scope.project.id=344f8dfc27144f52aee56c228d8588e1&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:28.410330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6382a-53ec-4a1d-a945-81d025671437 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:28.410879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6382a-53ec-4a1d-a945-81d025671437 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:28.410879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6382a-53ec-4a1d-a945-81d025671437 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:28.413306 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 554/1105] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:28.419291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb981c-678e-456e-9d3e-65fb3ab9a163 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:28.420065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb981c-678e-456e-9d3e-65fb3ab9a163 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:28.420065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb981c-678e-456e-9d3e-65fb3ab9a163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:28.437720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5edb981c-678e-456e-9d3e-65fb3ab9a163 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:28.438900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5edb981c-678e-456e-9d3e-65fb3ab9a163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:28.446527 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 552/1106] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:28.472981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6382a-53ec-4a1d-a945-81d025671437 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:28.485395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6382a-53ec-4a1d-a945-81d025671437 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:28.489624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0b69d-3905-4b6b-8cf6-7d295a3a3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:28.490384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b69d-3905-4b6b-8cf6-7d295a3a3f40 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:28.490661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b69d-3905-4b6b-8cf6-7d295a3a3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:28.490931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b69d-3905-4b6b-8cf6-7d295a3a3f40 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:28.492059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0b69d-3905-4b6b-8cf6-7d295a3a3f40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:28.493771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0b69d-3905-4b6b-8cf6-7d295a3a3f40 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:28.495315 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 555/1107] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:28.500656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb981c-678e-456e-9d3e-65fb3ab9a163 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:28.509412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb981c-678e-456e-9d3e-65fb3ab9a163 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:28.513807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f40f7-3b36-4543-b9f8-6d61985a6fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:28.514446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f40f7-3b36-4543-b9f8-6d61985a6fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:28.514726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f40f7-3b36-4543-b9f8-6d61985a6fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:28.515000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f40f7-3b36-4543-b9f8-6d61985a6fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:28.515702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f40f7-3b36-4543-b9f8-6d61985a6fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:28.517614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f40f7-3b36-4543-b9f8-6d61985a6fd3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:28.536840 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 553/1108] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:36:28 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:36:30.935359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae9a7a-0dd9-48da-98ce-7a70f70b94de None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:30.935896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae9a7a-0dd9-48da-98ce-7a70f70b94de None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:30.935896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae9a7a-0dd9-48da-98ce-7a70f70b94de None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:30.938264 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 556/1109] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:30.943593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9e4d-4ed3-4650-9c6e-3b0e8f46e151 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:30.944025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9e4d-4ed3-4650-9c6e-3b0e8f46e151 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:30.944151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9e4d-4ed3-4650-9c6e-3b0e8f46e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:30.961559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f87b9e4d-4ed3-4650-9c6e-3b0e8f46e151 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:30.962692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f87b9e4d-4ed3-4650-9c6e-3b0e8f46e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:30.970369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 554/1110] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:30.995150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae9a7a-0dd9-48da-98ce-7a70f70b94de None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:31.007457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae9a7a-0dd9-48da-98ce-7a70f70b94de None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:31.011688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:31.012528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:31.012803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:31.013070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] PATH_INFO: `/v3/roles/f163b9739a604fe9934c537c47ceeae5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:31.014502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] RBAC: Authorizing `identity:get_role(role_id=f163b9739a604fe9934c537c47ceeae5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:31.015488 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:36:31.015488 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:36:31.015488 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:36:31.016352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:31.017659 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 557/1111] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:30 2022] GET /identity/v3/roles/f163b9739a604fe9934c537c47ceeae5 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:31.022850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b9e4d-4ed3-4650-9c6e-3b0e8f46e151 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:31.031619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b9e4d-4ed3-4650-9c6e-3b0e8f46e151 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:31.036193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453705e7-bec0-4fbf-b815-09982d2452d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:31.037061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453705e7-bec0-4fbf-b815-09982d2452d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:31.037345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453705e7-bec0-4fbf-b815-09982d2452d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:31.037619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453705e7-bec0-4fbf-b815-09982d2452d1 admin admin] PATH_INFO: `/v3/users/8115d3ee56544ddc83b1b193f2b78217` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:31.051370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453705e7-bec0-4fbf-b815-09982d2452d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8115d3ee56544ddc83b1b193f2b78217)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:31.053509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453705e7-bec0-4fbf-b815-09982d2452d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:31.055119 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 555/1112] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:31 2022] GET /identity/v3/users/8115d3ee56544ddc83b1b193f2b78217 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:31.060670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:31.070483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dd0d-ad8e-4d36-8470-f081ed95c31e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:31.074957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef341a75-89ea-42d5-a0ab-ee6b03f0cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:31.075564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef341a75-89ea-42d5-a0ab-ee6b03f0cb72 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:31.075841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef341a75-89ea-42d5-a0ab-ee6b03f0cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:31.076113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef341a75-89ea-42d5-a0ab-ee6b03f0cb72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:31.083595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef341a75-89ea-42d5-a0ab-ee6b03f0cb72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:31.085325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef341a75-89ea-42d5-a0ab-ee6b03f0cb72 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:31.093886 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 558/1113] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:31.099113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453705e7-bec0-4fbf-b815-09982d2452d1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:31.108425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453705e7-bec0-4fbf-b815-09982d2452d1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:31.113431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55ea5-5492-4e92-8e69-3674061aef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:31.114236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55ea5-5492-4e92-8e69-3674061aef2b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:31.114519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55ea5-5492-4e92-8e69-3674061aef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:31.114796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55ea5-5492-4e92-8e69-3674061aef2b admin admin] PATH_INFO: `/v3/projects/344f8dfc27144f52aee56c228d8588e1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:31.115957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55ea5-5492-4e92-8e69-3674061aef2b admin admin] RBAC: Authorizing `identity:get_project(project_id=344f8dfc27144f52aee56c228d8588e1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:31.117988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55ea5-5492-4e92-8e69-3674061aef2b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:31.119751 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 556/1114] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:31 2022] GET /identity/v3/projects/344f8dfc27144f52aee56c228d8588e1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:31.125512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef341a75-89ea-42d5-a0ab-ee6b03f0cb72 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:31.133802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef341a75-89ea-42d5-a0ab-ee6b03f0cb72 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:31.138257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c879-2adb-43d5-b8cf-10747602a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:31.138848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c879-2adb-43d5-b8cf-10747602a650 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:31.139125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c879-2adb-43d5-b8cf-10747602a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:31.139403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c879-2adb-43d5-b8cf-10747602a650 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:31.140192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c879-2adb-43d5-b8cf-10747602a650 admin admin] RBAC: Adding query filter params (role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=344f8dfc27144f52aee56c228d8588e1, user.id=8115d3ee56544ddc83b1b193f2b78217) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:31.140536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c879-2adb-43d5-b8cf-10747602a650 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:31.142277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c879-2adb-43d5-b8cf-10747602a650 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:31.147356 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 559/1115] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:31 2022] GET /identity/v3/role_assignments?user.id=8115d3ee56544ddc83b1b193f2b78217&scope.project.id=344f8dfc27144f52aee56c228d8588e1&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:33.469829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393d36-f290-4791-ab7c-8f7dbcd49818 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:33.470379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393d36-f290-4791-ab7c-8f7dbcd49818 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:33.470379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393d36-f290-4791-ab7c-8f7dbcd49818 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:33.472165 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 557/1116] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:33.477487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f82ca-709a-45c5-a624-efe5887e578f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:33.477919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f82ca-709a-45c5-a624-efe5887e578f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:33.478012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f82ca-709a-45c5-a624-efe5887e578f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:33.500019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f24f82ca-709a-45c5-a624-efe5887e578f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:33.501219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f24f82ca-709a-45c5-a624-efe5887e578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:33.508808 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 560/1117] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:33.533168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393d36-f290-4791-ab7c-8f7dbcd49818 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:33.545477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393d36-f290-4791-ab7c-8f7dbcd49818 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:33.550522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:33.551343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:33.551626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:33.551905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] PATH_INFO: `/v3/roles/f163b9739a604fe9934c537c47ceeae5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:33.553388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] RBAC: Authorizing `identity:get_role(role_id=f163b9739a604fe9934c537c47ceeae5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:33.554394 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:36:33.554394 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:36:33.554394 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:36:33.555266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:33.556618 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 558/1118] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:33 2022] GET /identity/v3/roles/f163b9739a604fe9934c537c47ceeae5 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:33.562044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f82ca-709a-45c5-a624-efe5887e578f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:33.570620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f82ca-709a-45c5-a624-efe5887e578f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:33.574986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eaa6d-5e8e-4190-b287-3ba7ef0a3f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:33.575815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eaa6d-5e8e-4190-b287-3ba7ef0a3f24 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:33.576089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eaa6d-5e8e-4190-b287-3ba7ef0a3f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:33.576379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eaa6d-5e8e-4190-b287-3ba7ef0a3f24 admin admin] PATH_INFO: `/v3/users/8115d3ee56544ddc83b1b193f2b78217` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:33.577623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eaa6d-5e8e-4190-b287-3ba7ef0a3f24 admin admin] RBAC: Authorizing `identity:get_user(user_id=8115d3ee56544ddc83b1b193f2b78217)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:33.579684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eaa6d-5e8e-4190-b287-3ba7ef0a3f24 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:33.581255 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 561/1119] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:33 2022] GET /identity/v3/users/8115d3ee56544ddc83b1b193f2b78217 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:33.586490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:33.596137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aa261-f315-4bec-913d-c31c73f20a11 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:33.600568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9439fd5-5b84-4096-b5b0-f26a1797cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:33.601350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9439fd5-5b84-4096-b5b0-f26a1797cf99 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:33.601626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9439fd5-5b84-4096-b5b0-f26a1797cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:33.601894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9439fd5-5b84-4096-b5b0-f26a1797cf99 admin admin] PATH_INFO: `/v3/projects/344f8dfc27144f52aee56c228d8588e1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:33.603026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9439fd5-5b84-4096-b5b0-f26a1797cf99 admin admin] RBAC: Authorizing `identity:get_project(project_id=344f8dfc27144f52aee56c228d8588e1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:33.605029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9439fd5-5b84-4096-b5b0-f26a1797cf99 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:33.606613 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 559/1120] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:33 2022] GET /identity/v3/projects/344f8dfc27144f52aee56c228d8588e1 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:33.612515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eaa6d-5e8e-4190-b287-3ba7ef0a3f24 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:33.621538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eaa6d-5e8e-4190-b287-3ba7ef0a3f24 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:33.625919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e13387-c056-4c94-83c0-019a93117d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:33.626722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13387-c056-4c94-83c0-019a93117d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:33.626996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13387-c056-4c94-83c0-019a93117d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:33.627264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13387-c056-4c94-83c0-019a93117d57 admin admin] PATH_INFO: `/v3/projects/344f8dfc27144f52aee56c228d8588e1/users/8115d3ee56544ddc83b1b193f2b78217/roles/f163b9739a604fe9934c537c47ceeae5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:33.629421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e13387-c056-4c94-83c0-019a93117d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344f8dfc27144f52aee56c228d8588e1, user_id=8115d3ee56544ddc83b1b193f2b78217, role_id=f163b9739a604fe9934c537c47ceeae5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:33.631945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e13387-c056-4c94-83c0-019a93117d57 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:33.644031 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 562/1121] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:36:33 2022] PUT /identity/v3/projects/344f8dfc27144f52aee56c228d8588e1/users/8115d3ee56544ddc83b1b193f2b78217/roles/f163b9739a604fe9934c537c47ceeae5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:36:35.960101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1165e0-1bc3-462a-bdb2-a39391b7056d None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:35.960673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1165e0-1bc3-462a-bdb2-a39391b7056d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:35.960673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1165e0-1bc3-462a-bdb2-a39391b7056d None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:35.962384 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 560/1122] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:35.967751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4ae48-4213-4031-b95b-1a79aa66b850 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:35.968699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4ae48-4213-4031-b95b-1a79aa66b850 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:35.968822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4ae48-4213-4031-b95b-1a79aa66b850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:35.986858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-20c4ae48-4213-4031-b95b-1a79aa66b850 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:35.988048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-20c4ae48-4213-4031-b95b-1a79aa66b850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:36.043169 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 563/1123] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:36.068201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1165e0-1bc3-462a-bdb2-a39391b7056d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:36.080648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1165e0-1bc3-462a-bdb2-a39391b7056d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:36.084881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c7c8f-0344-4b5c-96f7-1a3fcb6d2531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:36.085701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c7c8f-0344-4b5c-96f7-1a3fcb6d2531 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:36.085973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c7c8f-0344-4b5c-96f7-1a3fcb6d2531 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:36.086238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c7c8f-0344-4b5c-96f7-1a3fcb6d2531 admin admin] PATH_INFO: `/v3/roles/f163b9739a604fe9934c537c47ceeae5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:36.087667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c7c8f-0344-4b5c-96f7-1a3fcb6d2531 admin admin] RBAC: Authorizing `identity:get_role(role_id=f163b9739a604fe9934c537c47ceeae5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:36.089264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c7c8f-0344-4b5c-96f7-1a3fcb6d2531 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:36.090572 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 561/1124] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:36 2022] GET /identity/v3/roles/f163b9739a604fe9934c537c47ceeae5 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:36.096360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4ae48-4213-4031-b95b-1a79aa66b850 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:36.104910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4ae48-4213-4031-b95b-1a79aa66b850 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:36.109869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e93989-b3f5-4481-9855-7011c0c476ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:36.110699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e93989-b3f5-4481-9855-7011c0c476ba admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:36.110975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e93989-b3f5-4481-9855-7011c0c476ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:36.111242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e93989-b3f5-4481-9855-7011c0c476ba admin admin] PATH_INFO: `/v3/users/8115d3ee56544ddc83b1b193f2b78217` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:36.112439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e93989-b3f5-4481-9855-7011c0c476ba admin admin] RBAC: Authorizing `identity:get_user(user_id=8115d3ee56544ddc83b1b193f2b78217)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:36.114491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e93989-b3f5-4481-9855-7011c0c476ba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:36.116035 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 564/1125] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:36 2022] GET /identity/v3/users/8115d3ee56544ddc83b1b193f2b78217 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:36.121202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c7c8f-0344-4b5c-96f7-1a3fcb6d2531 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:36.130490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c7c8f-0344-4b5c-96f7-1a3fcb6d2531 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:36.134980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41106e6-933c-4fa9-9d33-634f487069ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:36.135573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41106e6-933c-4fa9-9d33-634f487069ac admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:36.135855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41106e6-933c-4fa9-9d33-634f487069ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:36.136134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41106e6-933c-4fa9-9d33-634f487069ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:36.144196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41106e6-933c-4fa9-9d33-634f487069ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:36.145916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41106e6-933c-4fa9-9d33-634f487069ac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:36.154732 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 562/1126] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:36.161138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e93989-b3f5-4481-9855-7011c0c476ba admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:36.171345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e93989-b3f5-4481-9855-7011c0c476ba admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:36.175859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adbdf6-c521-47d4-af6a-08a2959f930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:36.176736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbdf6-c521-47d4-af6a-08a2959f930f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:36.177018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbdf6-c521-47d4-af6a-08a2959f930f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:36.177291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbdf6-c521-47d4-af6a-08a2959f930f admin admin] PATH_INFO: `/v3/projects/344f8dfc27144f52aee56c228d8588e1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:36.178457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adbdf6-c521-47d4-af6a-08a2959f930f admin admin] RBAC: Authorizing `identity:get_project(project_id=344f8dfc27144f52aee56c228d8588e1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:36.180590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adbdf6-c521-47d4-af6a-08a2959f930f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:36.187420 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 565/1127] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:36 2022] GET /identity/v3/projects/344f8dfc27144f52aee56c228d8588e1 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:36.188384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41106e6-933c-4fa9-9d33-634f487069ac admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:36.197603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41106e6-933c-4fa9-9d33-634f487069ac admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:36.203046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dd928-5f3d-43c8-a0a7-47e5851790ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:36.203680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd928-5f3d-43c8-a0a7-47e5851790ba admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:36.203958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd928-5f3d-43c8-a0a7-47e5851790ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:36.204228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd928-5f3d-43c8-a0a7-47e5851790ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:36.205088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dd928-5f3d-43c8-a0a7-47e5851790ba admin admin] RBAC: Adding query filter params (role.id=f163b9739a604fe9934c537c47ceeae5, scope.project.id=344f8dfc27144f52aee56c228d8588e1, user.id=8115d3ee56544ddc83b1b193f2b78217) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:36.205392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dd928-5f3d-43c8-a0a7-47e5851790ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:36.207216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dd928-5f3d-43c8-a0a7-47e5851790ba admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:36.216540 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 563/1128] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:36 2022] GET /identity/v3/role_assignments?user.id=8115d3ee56544ddc83b1b193f2b78217&scope.project.id=344f8dfc27144f52aee56c228d8588e1&role.id=f163b9739a604fe9934c537c47ceeae5 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:38.606650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec0fef-5b29-4a02-8194-43f7d11f81e5 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:38.607178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec0fef-5b29-4a02-8194-43f7d11f81e5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:38.607178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec0fef-5b29-4a02-8194-43f7d11f81e5 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:38.609472 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 566/1129] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:38.614787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e438-839a-4d7f-be46-2ed17c441432 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:38.615223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e438-839a-4d7f-be46-2ed17c441432 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:38.615343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e438-839a-4d7f-be46-2ed17c441432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:38.633283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2ac0e438-839a-4d7f-be46-2ed17c441432 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:38.634468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2ac0e438-839a-4d7f-be46-2ed17c441432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:38.642248 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 564/1130] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:38.666577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec0fef-5b29-4a02-8194-43f7d11f81e5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:38.678754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec0fef-5b29-4a02-8194-43f7d11f81e5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:38.682977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a8979-1019-4794-a441-7b3f34404b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:38.683720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8979-1019-4794-a441-7b3f34404b76 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:38.684021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8979-1019-4794-a441-7b3f34404b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:38.684294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8979-1019-4794-a441-7b3f34404b76 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:38.685474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a8979-1019-4794-a441-7b3f34404b76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:38.687750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a8979-1019-4794-a441-7b3f34404b76 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:38.689315 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 567/1131] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:38.694415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e438-839a-4d7f-be46-2ed17c441432 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:38.703257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e438-839a-4d7f-be46-2ed17c441432 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:38.707803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e6f32-a388-4ea0-9dff-af4d8b504844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:38.708470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e6f32-a388-4ea0-9dff-af4d8b504844 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:38.708756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e6f32-a388-4ea0-9dff-af4d8b504844 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:38.709035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e6f32-a388-4ea0-9dff-af4d8b504844 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:38.709745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e6f32-a388-4ea0-9dff-af4d8b504844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:38.711609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e6f32-a388-4ea0-9dff-af4d8b504844 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:38.736433 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 565/1132] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:36:38 2022] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:36:41.095206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873189e-5c75-46c8-97dd-d93930e89cf8 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:41.095753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873189e-5c75-46c8-97dd-d93930e89cf8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:41.095753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873189e-5c75-46c8-97dd-d93930e89cf8 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:41.097520 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 568/1133] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:41.102625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb20c-7cd0-4c30-af33-b4941e77ce9b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:41.103047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb20c-7cd0-4c30-af33-b4941e77ce9b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:41.103182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb20c-7cd0-4c30-af33-b4941e77ce9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:41.121182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-045fb20c-7cd0-4c30-af33-b4941e77ce9b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:41.122367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-045fb20c-7cd0-4c30-af33-b4941e77ce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:41.177224 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 566/1134] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:41.204259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873189e-5c75-46c8-97dd-d93930e89cf8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:41.216006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873189e-5c75-46c8-97dd-d93930e89cf8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:41.220270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374163de-0804-44aa-a84c-332429b4ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:41.221054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374163de-0804-44aa-a84c-332429b4ae6d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:41.221331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374163de-0804-44aa-a84c-332429b4ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:41.221601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374163de-0804-44aa-a84c-332429b4ae6d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:41.222741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374163de-0804-44aa-a84c-332429b4ae6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:41.224421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374163de-0804-44aa-a84c-332429b4ae6d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:41.225962 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 569/1135] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:41.231153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fb20c-7cd0-4c30-af33-b4941e77ce9b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:41.239770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fb20c-7cd0-4c30-af33-b4941e77ce9b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:41.244229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a6244-d149-4cbb-a850-1994a6268e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:41.244908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6244-d149-4cbb-a850-1994a6268e4f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:41.245191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6244-d149-4cbb-a850-1994a6268e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:41.245466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6244-d149-4cbb-a850-1994a6268e4f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:41.246178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a6244-d149-4cbb-a850-1994a6268e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:41.248058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a6244-d149-4cbb-a850-1994a6268e4f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:41.267903 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 567/1136] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:36:41 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:36:43.656539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6af95-41a0-447b-bfcc-be2628231907 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:43.657072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6af95-41a0-447b-bfcc-be2628231907 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:43.657072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6af95-41a0-447b-bfcc-be2628231907 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:43.658839 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 570/1137] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:43.663944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f511-78be-4c1b-935d-456eb74721c7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:43.664380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f511-78be-4c1b-935d-456eb74721c7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:43.664530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f511-78be-4c1b-935d-456eb74721c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:43.682928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7587f511-78be-4c1b-935d-456eb74721c7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:43.684140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7587f511-78be-4c1b-935d-456eb74721c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:43.692535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 568/1138] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:43.717955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6af95-41a0-447b-bfcc-be2628231907 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:43.730055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6af95-41a0-447b-bfcc-be2628231907 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:43.734903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad3b74-d7cf-493b-86dd-7f04cac9b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:43.735676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3b74-d7cf-493b-86dd-7f04cac9b78b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:43.735960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3b74-d7cf-493b-86dd-7f04cac9b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:43.736234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3b74-d7cf-493b-86dd-7f04cac9b78b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:43.746258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad3b74-d7cf-493b-86dd-7f04cac9b78b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:43.753683 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-9fad3b74-d7cf-493b-86dd-7f04cac9b78b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:36:43.754859 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 571/1139] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:43.760699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587f511-78be-4c1b-935d-456eb74721c7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:43.769520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587f511-78be-4c1b-935d-456eb74721c7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:43.774194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:43.774837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:43.775114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:43.775387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:43.776120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:43.776454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:43.778043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:43.786146 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 569/1140] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:43.791955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad3b74-d7cf-493b-86dd-7f04cac9b78b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:43.802354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad3b74-d7cf-493b-86dd-7f04cac9b78b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:43.806734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0923b9-d92f-4478-84d7-cdd6782f9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:43.807560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0923b9-d92f-4478-84d7-cdd6782f9949 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:43.807836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0923b9-d92f-4478-84d7-cdd6782f9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:43.808108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0923b9-d92f-4478-84d7-cdd6782f9949 admin admin] PATH_INFO: `/v3/users/aba10dd563f64ceba918ee7b0a362454` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:43.821256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0923b9-d92f-4478-84d7-cdd6782f9949 admin admin] RBAC: Authorizing `identity:get_user(user_id=aba10dd563f64ceba918ee7b0a362454)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:43.823332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0923b9-d92f-4478-84d7-cdd6782f9949 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:43.824954 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 572/1141] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:43 2022] GET /identity/v3/users/aba10dd563f64ceba918ee7b0a362454 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:43.831522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:43.840808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac9b67-ba32-48fc-a6f5-791ed7a27f1f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:43.845245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8388-0712-459d-861b-db8eea308799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:43.845849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8388-0712-459d-861b-db8eea308799 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:43.846127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8388-0712-459d-861b-db8eea308799 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:43.846396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8388-0712-459d-861b-db8eea308799 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:43.853842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab8388-0712-459d-861b-db8eea308799 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:43.855535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab8388-0712-459d-861b-db8eea308799 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:43.864618 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 570/1142] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:43 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:43.869930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0923b9-d92f-4478-84d7-cdd6782f9949 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:43.879962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0923b9-d92f-4478-84d7-cdd6782f9949 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:43.884459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad101b9-438e-4527-bd0c-d9b8388da9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:43.885273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad101b9-438e-4527-bd0c-d9b8388da9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:43.885553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad101b9-438e-4527-bd0c-d9b8388da9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:43.885826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad101b9-438e-4527-bd0c-d9b8388da9e5 admin admin] PATH_INFO: `/v3/projects/21b3d1e1ebe24865ba7da07b43b13694` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:43.886976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad101b9-438e-4527-bd0c-d9b8388da9e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=21b3d1e1ebe24865ba7da07b43b13694)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:43.889016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad101b9-438e-4527-bd0c-d9b8388da9e5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:43.890644 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 573/1143] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:43 2022] GET /identity/v3/projects/21b3d1e1ebe24865ba7da07b43b13694 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:43.896206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8388-0712-459d-861b-db8eea308799 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:43.904585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8388-0712-459d-861b-db8eea308799 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:43.909055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b36d22-f2ed-4bad-881e-5c402d359cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:43.909606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b36d22-f2ed-4bad-881e-5c402d359cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:43.909881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b36d22-f2ed-4bad-881e-5c402d359cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:43.910151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b36d22-f2ed-4bad-881e-5c402d359cf3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:43.910946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b36d22-f2ed-4bad-881e-5c402d359cf3 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=21b3d1e1ebe24865ba7da07b43b13694, user.id=aba10dd563f64ceba918ee7b0a362454) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:43.911253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b36d22-f2ed-4bad-881e-5c402d359cf3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:43.913093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b36d22-f2ed-4bad-881e-5c402d359cf3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:43.918494 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 571/1144] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:43 2022] GET /identity/v3/role_assignments?user.id=aba10dd563f64ceba918ee7b0a362454&scope.project.id=21b3d1e1ebe24865ba7da07b43b13694&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:46.251591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b563ec-d65e-4435-8dce-a002281b947f None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:46.252139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b563ec-d65e-4435-8dce-a002281b947f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:46.252139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b563ec-d65e-4435-8dce-a002281b947f None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:46.253914 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 574/1145] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:46.259021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9775-49bb-4775-ab21-8d7fd602ceb2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:46.259424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9775-49bb-4775-ab21-8d7fd602ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:46.259609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9775-49bb-4775-ab21-8d7fd602ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:46.276725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a32e9775-49bb-4775-ab21-8d7fd602ceb2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:46.277895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a32e9775-49bb-4775-ab21-8d7fd602ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:46.285960 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 572/1146] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:46.309903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b563ec-d65e-4435-8dce-a002281b947f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:46.321663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b563ec-d65e-4435-8dce-a002281b947f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:46.325938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dcb12-1826-4196-910b-19d558c4819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:46.326693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dcb12-1826-4196-910b-19d558c4819e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:46.326972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dcb12-1826-4196-910b-19d558c4819e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:46.327274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dcb12-1826-4196-910b-19d558c4819e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:46.337112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dcb12-1826-4196-910b-19d558c4819e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:46.344287 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-c76dcb12-1826-4196-910b-19d558c4819e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:36:46.345427 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 575/1147] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:46.350922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9775-49bb-4775-ab21-8d7fd602ceb2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:46.360042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9775-49bb-4775-ab21-8d7fd602ceb2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:46.364465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:46.365111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:46.365386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:46.365657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:46.366389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:46.366692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:46.368250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:46.376641 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 573/1148] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:46.381800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dcb12-1826-4196-910b-19d558c4819e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:46.392076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dcb12-1826-4196-910b-19d558c4819e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:46.396504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338cd7b-37a1-4c76-ba84-4bc1330ebd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:46.397308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cd7b-37a1-4c76-ba84-4bc1330ebd96 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:46.397589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cd7b-37a1-4c76-ba84-4bc1330ebd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:46.397862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cd7b-37a1-4c76-ba84-4bc1330ebd96 admin admin] PATH_INFO: `/v3/users/aba10dd563f64ceba918ee7b0a362454` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:46.399024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338cd7b-37a1-4c76-ba84-4bc1330ebd96 admin admin] RBAC: Authorizing `identity:get_user(user_id=aba10dd563f64ceba918ee7b0a362454)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:46.401137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338cd7b-37a1-4c76-ba84-4bc1330ebd96 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:46.402678 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 576/1149] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:46 2022] GET /identity/v3/users/aba10dd563f64ceba918ee7b0a362454 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:46.407792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:46.417280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baf87d-5c01-4bb5-8170-4c8e5fe3f1e1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:46.421742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521fdb-2c73-415c-a85c-52b548f891a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:46.422548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521fdb-2c73-415c-a85c-52b548f891a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:46.422826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521fdb-2c73-415c-a85c-52b548f891a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:46.423097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521fdb-2c73-415c-a85c-52b548f891a9 admin admin] PATH_INFO: `/v3/projects/21b3d1e1ebe24865ba7da07b43b13694` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:46.424246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27521fdb-2c73-415c-a85c-52b548f891a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=21b3d1e1ebe24865ba7da07b43b13694)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:46.426259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27521fdb-2c73-415c-a85c-52b548f891a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:46.427874 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 574/1150] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:46 2022] GET /identity/v3/projects/21b3d1e1ebe24865ba7da07b43b13694 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:46.432928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338cd7b-37a1-4c76-ba84-4bc1330ebd96 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:46.442514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338cd7b-37a1-4c76-ba84-4bc1330ebd96 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:46.446971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02615dd7-9540-4f57-a803-b48d55f7bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:46.447788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615dd7-9540-4f57-a803-b48d55f7bb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:46.448063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615dd7-9540-4f57-a803-b48d55f7bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:46.448355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615dd7-9540-4f57-a803-b48d55f7bb11 admin admin] PATH_INFO: `/v3/projects/21b3d1e1ebe24865ba7da07b43b13694/users/aba10dd563f64ceba918ee7b0a362454/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:46.450290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02615dd7-9540-4f57-a803-b48d55f7bb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b3d1e1ebe24865ba7da07b43b13694, user_id=aba10dd563f64ceba918ee7b0a362454, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:46.453495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02615dd7-9540-4f57-a803-b48d55f7bb11 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:46.465478 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 577/1151] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:36:46 2022] PUT /identity/v3/projects/21b3d1e1ebe24865ba7da07b43b13694/users/aba10dd563f64ceba918ee7b0a362454/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:36:48.785678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786912-2e54-4fa0-a126-d48c936333aa None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:48.786175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786912-2e54-4fa0-a126-d48c936333aa None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:48.786265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786912-2e54-4fa0-a126-d48c936333aa None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:48.787987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 575/1152] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:48.793635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c78a-5ecc-434b-afa6-1564635e70bd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:48.794053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c78a-5ecc-434b-afa6-1564635e70bd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:48.794198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c78a-5ecc-434b-afa6-1564635e70bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:48.812859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d965c78a-5ecc-434b-afa6-1564635e70bd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:48.814063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d965c78a-5ecc-434b-afa6-1564635e70bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:48.872256 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 578/1153] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:48.897706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786912-2e54-4fa0-a126-d48c936333aa None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:48.909768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786912-2e54-4fa0-a126-d48c936333aa None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:48.914323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517bd6a-7f0d-45fb-9916-bf3d30736adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:48.915087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517bd6a-7f0d-45fb-9916-bf3d30736adc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:48.915369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517bd6a-7f0d-45fb-9916-bf3d30736adc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:48.915644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517bd6a-7f0d-45fb-9916-bf3d30736adc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:48.926299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517bd6a-7f0d-45fb-9916-bf3d30736adc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:36:48.933039 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-5517bd6a-7f0d-45fb-9916-bf3d30736adc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:36:48.934185 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 576/1154] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:36:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:48.940259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965c78a-5ecc-434b-afa6-1564635e70bd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:48.948959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965c78a-5ecc-434b-afa6-1564635e70bd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:48.953496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:48.954086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:48.954367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:48.954641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:48.955375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:48.955679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:48.957288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:48.965199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 579/1155] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:36:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:48.970566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517bd6a-7f0d-45fb-9916-bf3d30736adc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:48.980347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517bd6a-7f0d-45fb-9916-bf3d30736adc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:48.985355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a091a6-82ce-4349-a999-9282fdda6d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:48.986160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a091a6-82ce-4349-a999-9282fdda6d26 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:48.986439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a091a6-82ce-4349-a999-9282fdda6d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:48.986714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a091a6-82ce-4349-a999-9282fdda6d26 admin admin] PATH_INFO: `/v3/users/aba10dd563f64ceba918ee7b0a362454` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:48.987890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a091a6-82ce-4349-a999-9282fdda6d26 admin admin] RBAC: Authorizing `identity:get_user(user_id=aba10dd563f64ceba918ee7b0a362454)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:48.990014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a091a6-82ce-4349-a999-9282fdda6d26 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:48.991574 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 577/1156] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:36:48 2022] GET /identity/v3/users/aba10dd563f64ceba918ee7b0a362454 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:48.998010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:49.007660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326a2a-624e-4acb-a359-5251735eefd5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:49.012080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852401-517a-4637-a629-c3c1598bf255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:49.012723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852401-517a-4637-a629-c3c1598bf255 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:49.013006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852401-517a-4637-a629-c3c1598bf255 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:49.013281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852401-517a-4637-a629-c3c1598bf255 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:49.020727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2852401-517a-4637-a629-c3c1598bf255 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:49.022405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2852401-517a-4637-a629-c3c1598bf255 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:49.031132 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 580/1157] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:49.036427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a091a6-82ce-4349-a999-9282fdda6d26 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:49.046495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a091a6-82ce-4349-a999-9282fdda6d26 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:49.051045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a880faa-a46e-42be-a3a3-a9c9b32e3eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:49.051844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a880faa-a46e-42be-a3a3-a9c9b32e3eee admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:49.052123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a880faa-a46e-42be-a3a3-a9c9b32e3eee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:49.052432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a880faa-a46e-42be-a3a3-a9c9b32e3eee admin admin] PATH_INFO: `/v3/projects/21b3d1e1ebe24865ba7da07b43b13694` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:49.053591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a880faa-a46e-42be-a3a3-a9c9b32e3eee admin admin] RBAC: Authorizing `identity:get_project(project_id=21b3d1e1ebe24865ba7da07b43b13694)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:49.055583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a880faa-a46e-42be-a3a3-a9c9b32e3eee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:49.057245 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 578/1158] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:36:49 2022] GET /identity/v3/projects/21b3d1e1ebe24865ba7da07b43b13694 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:49.063080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852401-517a-4637-a629-c3c1598bf255 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:49.071316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852401-517a-4637-a629-c3c1598bf255 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:49.075764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eea12-abc0-463d-9daf-a09b58ec6253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:49.076383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eea12-abc0-463d-9daf-a09b58ec6253 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:49.076667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eea12-abc0-463d-9daf-a09b58ec6253 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:49.076942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eea12-abc0-463d-9daf-a09b58ec6253 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:49.077740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eea12-abc0-463d-9daf-a09b58ec6253 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=21b3d1e1ebe24865ba7da07b43b13694, user.id=aba10dd563f64ceba918ee7b0a362454) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:49.078047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eea12-abc0-463d-9daf-a09b58ec6253 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:49.079794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eea12-abc0-463d-9daf-a09b58ec6253 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:49.085348 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 581/1159] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:36:49 2022] GET /identity/v3/role_assignments?user.id=aba10dd563f64ceba918ee7b0a362454&scope.project.id=21b3d1e1ebe24865ba7da07b43b13694&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:36:51.468739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a67eb-b667-4902-97b9-eeacea74d82c None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:51.469297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a67eb-b667-4902-97b9-eeacea74d82c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:51.469297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a67eb-b667-4902-97b9-eeacea74d82c None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:51.471042 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 579/1160] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:51.476253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74b52-7170-4590-9a4c-3c22a9631ac9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:51.476695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74b52-7170-4590-9a4c-3c22a9631ac9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:51.476839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74b52-7170-4590-9a4c-3c22a9631ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:51.493997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0cd74b52-7170-4590-9a4c-3c22a9631ac9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:51.495158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0cd74b52-7170-4590-9a4c-3c22a9631ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:51.503169 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 582/1161] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:36:51.527530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a67eb-b667-4902-97b9-eeacea74d82c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:51.539401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a67eb-b667-4902-97b9-eeacea74d82c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:51.543930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696f52f-ac79-44db-83a3-9bfb1b1a63da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:51.544579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696f52f-ac79-44db-83a3-9bfb1b1a63da admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:51.544861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696f52f-ac79-44db-83a3-9bfb1b1a63da admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:51.545136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696f52f-ac79-44db-83a3-9bfb1b1a63da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:51.552640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696f52f-ac79-44db-83a3-9bfb1b1a63da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:51.554359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696f52f-ac79-44db-83a3-9bfb1b1a63da admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:51.563468 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 580/1162] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:36:51 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:36:51.569016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd74b52-7170-4590-9a4c-3c22a9631ac9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:51.578608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd74b52-7170-4590-9a4c-3c22a9631ac9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:51.583257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa3611-ee4d-4bb0-b6dc-8fcd6da151f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:51.584039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3611-ee4d-4bb0-b6dc-8fcd6da151f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:51.584320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3611-ee4d-4bb0-b6dc-8fcd6da151f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:51.584615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3611-ee4d-4bb0-b6dc-8fcd6da151f5 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:51.591566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa3611-ee4d-4bb0-b6dc-8fcd6da151f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:51.593966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa3611-ee4d-4bb0-b6dc-8fcd6da151f5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:51.607887 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-35aa3611-ee4d-4bb0-b6dc-8fcd6da151f5 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 19 20:36:51.609692 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 583/1163] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:36:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:36:51.615697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696f52f-ac79-44db-83a3-9bfb1b1a63da admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:51.624549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696f52f-ac79-44db-83a3-9bfb1b1a63da admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:51.629038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b80af-4210-484d-ab2f-aaf7184844a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:51.629669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b80af-4210-484d-ab2f-aaf7184844a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:51.629949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b80af-4210-484d-ab2f-aaf7184844a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:51.630222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b80af-4210-484d-ab2f-aaf7184844a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:51.630922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b80af-4210-484d-ab2f-aaf7184844a2 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:36:51.631227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b80af-4210-484d-ab2f-aaf7184844a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:51.632833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b80af-4210-484d-ab2f-aaf7184844a2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:51.639860 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 581/1164] 10.222.0.30 () {56 vars in 1136 bytes} [Sat Feb 19 20:36:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:53.966715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e711ce4-a4ae-4128-a722-0600a56d3abb None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:53.967223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e711ce4-a4ae-4128-a722-0600a56d3abb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:53.967223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e711ce4-a4ae-4128-a722-0600a56d3abb None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:53.969826 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 584/1165] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:53.975062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aaa12-9c27-40c0-b741-ecccbc3a6fb4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:53.975477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aaa12-9c27-40c0-b741-ecccbc3a6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:53.975627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aaa12-9c27-40c0-b741-ecccbc3a6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:53.993598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7a1aaa12-9c27-40c0-b741-ecccbc3a6fb4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:53.994793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a1aaa12-9c27-40c0-b741-ecccbc3a6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:54.002496 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 582/1166] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:54.026012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e711ce4-a4ae-4128-a722-0600a56d3abb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:54.038372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e711ce4-a4ae-4128-a722-0600a56d3abb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:54.042953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f61356-f822-46bc-b570-e75c2b0c4e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:54.043582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f61356-f822-46bc-b570-e75c2b0c4e77 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:54.043864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f61356-f822-46bc-b570-e75c2b0c4e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:54.044140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f61356-f822-46bc-b570-e75c2b0c4e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:54.044917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f61356-f822-46bc-b570-e75c2b0c4e77 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:54.046728 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-81f61356-f822-46bc-b570-e75c2b0c4e77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:36:54.046728 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:36:54.046728 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:36:54.047641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f61356-f822-46bc-b570-e75c2b0c4e77 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:54.062018 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 585/1167] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Feb 19 20:36:54 2022] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:56.429888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9a1e-d5ae-4ee3-a031-bca56cf22d12 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:56.430471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9a1e-d5ae-4ee3-a031-bca56cf22d12 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:56.430471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f9a1e-d5ae-4ee3-a031-bca56cf22d12 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:56.432187 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 583/1168] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:56.437303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873423-a5a6-48ef-95d5-5ad5052ba765 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:56.437693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873423-a5a6-48ef-95d5-5ad5052ba765 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:56.437857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873423-a5a6-48ef-95d5-5ad5052ba765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:56.455836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-48873423-a5a6-48ef-95d5-5ad5052ba765 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:56.457039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-48873423-a5a6-48ef-95d5-5ad5052ba765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:56.511195 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 586/1169] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:56.537253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f9a1e-d5ae-4ee3-a031-bca56cf22d12 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:56.549966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f9a1e-d5ae-4ee3-a031-bca56cf22d12 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:56.554254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa71784-9467-4d1c-8e00-5a0775b5dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:56.555072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa71784-9467-4d1c-8e00-5a0775b5dab8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:56.555350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa71784-9467-4d1c-8e00-5a0775b5dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:56.555620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa71784-9467-4d1c-8e00-5a0775b5dab8 admin admin] PATH_INFO: `/v3/domains/4f65bcdaf1834018bc80d447911a9d50` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:56.566285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa71784-9467-4d1c-8e00-5a0775b5dab8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4f65bcdaf1834018bc80d447911a9d50)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:56.568221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa71784-9467-4d1c-8e00-5a0775b5dab8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:56.569854 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 584/1170] 10.222.0.30 () {56 vars in 1204 bytes} [Sat Feb 19 20:36:56 2022] GET /identity/v3/domains/4f65bcdaf1834018bc80d447911a9d50 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:56.575194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48873423-a5a6-48ef-95d5-5ad5052ba765 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:56.583905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48873423-a5a6-48ef-95d5-5ad5052ba765 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:56.588361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30071c15-a607-4e7f-83c7-def612b10f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:56.588998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071c15-a607-4e7f-83c7-def612b10f3a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:56.589278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071c15-a607-4e7f-83c7-def612b10f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:56.589550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071c15-a607-4e7f-83c7-def612b10f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:56.590247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30071c15-a607-4e7f-83c7-def612b10f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:56.592120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30071c15-a607-4e7f-83c7-def612b10f3a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:56.617568 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 587/1171] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:36:56 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:36:58.997958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14814-7648-4ead-b5d9-1f71ddaf4e22 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:58.998465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14814-7648-4ead-b5d9-1f71ddaf4e22 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:58.998465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14814-7648-4ead-b5d9-1f71ddaf4e22 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:59.000782 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 585/1172] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:36:59.005871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc46fe-b23a-4f0d-a476-3e3da2a2f401 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:59.006253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc46fe-b23a-4f0d-a476-3e3da2a2f401 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:59.006418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc46fe-b23a-4f0d-a476-3e3da2a2f401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:59.024310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6adc46fe-b23a-4f0d-a476-3e3da2a2f401 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:36:59.025507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6adc46fe-b23a-4f0d-a476-3e3da2a2f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:36:59.080238 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 588/1173] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:36:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:36:59.106299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14814-7648-4ead-b5d9-1f71ddaf4e22 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:59.118763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14814-7648-4ead-b5d9-1f71ddaf4e22 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:59.123022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978c30f-e4a6-4394-802f-675de8fe0d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:59.123861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978c30f-e4a6-4394-802f-675de8fe0d3b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:59.124138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978c30f-e4a6-4394-802f-675de8fe0d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:59.124443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978c30f-e4a6-4394-802f-675de8fe0d3b admin admin] PATH_INFO: `/v3/domains/4f65bcdaf1834018bc80d447911a9d50` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:59.125594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978c30f-e4a6-4394-802f-675de8fe0d3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4f65bcdaf1834018bc80d447911a9d50)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:59.127603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978c30f-e4a6-4394-802f-675de8fe0d3b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:59.129190 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 586/1174] 10.222.0.30 () {56 vars in 1204 bytes} [Sat Feb 19 20:36:59 2022] GET /identity/v3/domains/4f65bcdaf1834018bc80d447911a9d50 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:36:59.134429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc46fe-b23a-4f0d-a476-3e3da2a2f401 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:36:59.143013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc46fe-b23a-4f0d-a476-3e3da2a2f401 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:36:59.147383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83322037-c22b-41d8-86bb-0c9a7f1699ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:36:59.148018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322037-c22b-41d8-86bb-0c9a7f1699ea admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:36:59.148295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322037-c22b-41d8-86bb-0c9a7f1699ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:36:59.148592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322037-c22b-41d8-86bb-0c9a7f1699ea admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:36:59.149281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83322037-c22b-41d8-86bb-0c9a7f1699ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:36:59.151154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83322037-c22b-41d8-86bb-0c9a7f1699ea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:36:59.171181 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 589/1175] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:36:59 2022] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:37:01.546601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237380f-411c-4857-9602-032834f2cfad None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:01.547159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237380f-411c-4857-9602-032834f2cfad None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:01.547275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237380f-411c-4857-9602-032834f2cfad None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:01.549548 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 587/1176] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:37:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:37:01.554985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4da3a-b758-454c-83dc-0915752125a7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:01.555414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4da3a-b758-454c-83dc-0915752125a7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:01.555570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4da3a-b758-454c-83dc-0915752125a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:01.573254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aad4da3a-b758-454c-83dc-0915752125a7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:37:01.574416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aad4da3a-b758-454c-83dc-0915752125a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:37:01.582648 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 590/1177] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:37:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:37:01.606917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237380f-411c-4857-9602-032834f2cfad None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:01.618752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237380f-411c-4857-9602-032834f2cfad None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:01.623019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0dd6-1c18-40be-8301-f3621a7d4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:01.624294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0dd6-1c18-40be-8301-f3621a7d4b60 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:01.624605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0dd6-1c18-40be-8301-f3621a7d4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:01.624912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0dd6-1c18-40be-8301-f3621a7d4b60 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:01.635635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb0dd6-1c18-40be-8301-f3621a7d4b60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:37:01.642793 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6feb0dd6-1c18-40be-8301-f3621a7d4b60 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:37:01.643899 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 588/1178] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:37:01.649381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4da3a-b758-454c-83dc-0915752125a7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:01.658003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4da3a-b758-454c-83dc-0915752125a7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:01.662414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:01.663042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:01.663319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:01.663587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:01.664310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:37:01.664633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:01.666447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:01.677010 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 591/1179] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:01.684554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0dd6-1c18-40be-8301-f3621a7d4b60 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:01.694936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0dd6-1c18-40be-8301-f3621a7d4b60 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:01.699471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efabb30-146e-4acf-8ff7-f683ef791cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:01.700313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efabb30-146e-4acf-8ff7-f683ef791cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:01.700620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efabb30-146e-4acf-8ff7-f683ef791cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:01.700893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efabb30-146e-4acf-8ff7-f683ef791cc3 admin admin] PATH_INFO: `/v3/users/52fea97182a644739d62ad00547551b5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:01.714112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efabb30-146e-4acf-8ff7-f683ef791cc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=52fea97182a644739d62ad00547551b5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:01.716217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efabb30-146e-4acf-8ff7-f683ef791cc3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:01.717865 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 589/1180] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:37:01 2022] GET /identity/v3/users/52fea97182a644739d62ad00547551b5 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:01.724978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:01.734969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5bd60-8ed0-4e53-b6f1-89b1f0f79e0f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:01.739415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5002a2-93ed-434c-886a-1d98368858cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:01.740044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5002a2-93ed-434c-886a-1d98368858cc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:01.740315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5002a2-93ed-434c-886a-1d98368858cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:01.740614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5002a2-93ed-434c-886a-1d98368858cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:01.748021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5002a2-93ed-434c-886a-1d98368858cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:01.750365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5002a2-93ed-434c-886a-1d98368858cc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:01.758877 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 592/1181] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:37:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:37:01.764517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efabb30-146e-4acf-8ff7-f683ef791cc3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:01.773855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efabb30-146e-4acf-8ff7-f683ef791cc3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:01.778259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da284-2602-41e0-9f5d-609fe1afa7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:01.779074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da284-2602-41e0-9f5d-609fe1afa7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:01.779348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da284-2602-41e0-9f5d-609fe1afa7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:01.779620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da284-2602-41e0-9f5d-609fe1afa7f8 admin admin] PATH_INFO: `/v3/projects/7b5f434ae3fe4addbd2bd020b43a3c2c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:01.780800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8da284-2602-41e0-9f5d-609fe1afa7f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=7b5f434ae3fe4addbd2bd020b43a3c2c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:01.782770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8da284-2602-41e0-9f5d-609fe1afa7f8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:01.784394 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 590/1182] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:37:01 2022] GET /identity/v3/projects/7b5f434ae3fe4addbd2bd020b43a3c2c => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:37:01.789797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5002a2-93ed-434c-886a-1d98368858cc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:01.798988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5002a2-93ed-434c-886a-1d98368858cc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:01.803358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8df9a-59b3-40f2-8960-d91228045561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:01.803950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8df9a-59b3-40f2-8960-d91228045561 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:01.804229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8df9a-59b3-40f2-8960-d91228045561 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:01.804536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8df9a-59b3-40f2-8960-d91228045561 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:01.805330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8df9a-59b3-40f2-8960-d91228045561 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=7b5f434ae3fe4addbd2bd020b43a3c2c, user.id=52fea97182a644739d62ad00547551b5) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:37:01.805635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8df9a-59b3-40f2-8960-d91228045561 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:01.807371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8df9a-59b3-40f2-8960-d91228045561 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:01.813092 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 593/1183] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:37:01 2022] GET /identity/v3/role_assignments?user.id=52fea97182a644739d62ad00547551b5&scope.project.id=7b5f434ae3fe4addbd2bd020b43a3c2c&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:04.141243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d61a8-d6a5-469e-89dc-52d69563c12f None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:04.141795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d61a8-d6a5-469e-89dc-52d69563c12f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:04.141795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d61a8-d6a5-469e-89dc-52d69563c12f None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:04.143552 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 591/1184] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:37:04.148659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db489a-8547-450b-9ee6-3630db6c0c75 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:04.149069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db489a-8547-450b-9ee6-3630db6c0c75 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:04.149216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db489a-8547-450b-9ee6-3630db6c0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:04.166716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e5db489a-8547-450b-9ee6-3630db6c0c75 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:37:04.167887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e5db489a-8547-450b-9ee6-3630db6c0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:37:04.175946 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 594/1185] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:37:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:37:04.205782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d61a8-d6a5-469e-89dc-52d69563c12f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:04.218496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d61a8-d6a5-469e-89dc-52d69563c12f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:04.222890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65be05-46de-49f0-8b9a-4b5d4f256ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:04.223647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65be05-46de-49f0-8b9a-4b5d4f256ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:04.223923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65be05-46de-49f0-8b9a-4b5d4f256ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:04.224193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65be05-46de-49f0-8b9a-4b5d4f256ed1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:04.234100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65be05-46de-49f0-8b9a-4b5d4f256ed1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:37:04.240770 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-3b65be05-46de-49f0-8b9a-4b5d4f256ed1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:37:04.242199 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 592/1186] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:37:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:37:04.248234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db489a-8547-450b-9ee6-3630db6c0c75 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:04.257764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db489a-8547-450b-9ee6-3630db6c0c75 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:04.262267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:04.262913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:04.263194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:04.263470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:04.264207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:37:04.265188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:04.266769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:04.274886 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 595/1187] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:04.281461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65be05-46de-49f0-8b9a-4b5d4f256ed1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:04.291179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65be05-46de-49f0-8b9a-4b5d4f256ed1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:04.295649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9bbe4-0ed8-4114-bd9a-73e33cb4fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:04.296509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9bbe4-0ed8-4114-bd9a-73e33cb4fd13 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:04.296784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9bbe4-0ed8-4114-bd9a-73e33cb4fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:04.297054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9bbe4-0ed8-4114-bd9a-73e33cb4fd13 admin admin] PATH_INFO: `/v3/users/52fea97182a644739d62ad00547551b5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:04.298213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9bbe4-0ed8-4114-bd9a-73e33cb4fd13 admin admin] RBAC: Authorizing `identity:get_user(user_id=52fea97182a644739d62ad00547551b5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:04.300289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9bbe4-0ed8-4114-bd9a-73e33cb4fd13 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:04.301885 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 593/1188] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:37:04 2022] GET /identity/v3/users/52fea97182a644739d62ad00547551b5 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:04.307159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:04.317026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530118-f077-4090-b534-92b18b0be218 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:04.321486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee23f88-7733-4eb1-af0d-99a21d790c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:04.322302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23f88-7733-4eb1-af0d-99a21d790c7c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:04.322582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23f88-7733-4eb1-af0d-99a21d790c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:04.322855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23f88-7733-4eb1-af0d-99a21d790c7c admin admin] PATH_INFO: `/v3/projects/7b5f434ae3fe4addbd2bd020b43a3c2c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:04.324003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee23f88-7733-4eb1-af0d-99a21d790c7c admin admin] RBAC: Authorizing `identity:get_project(project_id=7b5f434ae3fe4addbd2bd020b43a3c2c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:04.326050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee23f88-7733-4eb1-af0d-99a21d790c7c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:04.328296 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 596/1189] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:37:04 2022] GET /identity/v3/projects/7b5f434ae3fe4addbd2bd020b43a3c2c => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:04.333595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9bbe4-0ed8-4114-bd9a-73e33cb4fd13 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:04.343287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9bbe4-0ed8-4114-bd9a-73e33cb4fd13 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:04.347667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d41a2f-efda-4f2c-bdca-96981729c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:04.348526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41a2f-efda-4f2c-bdca-96981729c32a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:04.348804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41a2f-efda-4f2c-bdca-96981729c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:04.349074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41a2f-efda-4f2c-bdca-96981729c32a admin admin] PATH_INFO: `/v3/projects/7b5f434ae3fe4addbd2bd020b43a3c2c/users/52fea97182a644739d62ad00547551b5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:04.350991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d41a2f-efda-4f2c-bdca-96981729c32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5f434ae3fe4addbd2bd020b43a3c2c, user_id=52fea97182a644739d62ad00547551b5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:04.353581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d41a2f-efda-4f2c-bdca-96981729c32a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:04.366148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 594/1190] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:37:04 2022] PUT /identity/v3/projects/7b5f434ae3fe4addbd2bd020b43a3c2c/users/52fea97182a644739d62ad00547551b5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:37:06.701476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb54bc-7645-45dd-bbda-0f90bbec3690 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:06.702431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb54bc-7645-45dd-bbda-0f90bbec3690 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:06.702644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb54bc-7645-45dd-bbda-0f90bbec3690 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:06.704522 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 597/1191] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:37:06.709888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024589-e9a1-4292-8cc1-e765ba649393 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:06.710342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024589-e9a1-4292-8cc1-e765ba649393 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:06.710492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024589-e9a1-4292-8cc1-e765ba649393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:06.728649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-79024589-e9a1-4292-8cc1-e765ba649393 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:37:06.729828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-79024589-e9a1-4292-8cc1-e765ba649393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:37:06.784217 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 595/1192] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:37:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:37:06.809282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb54bc-7645-45dd-bbda-0f90bbec3690 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:06.821116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb54bc-7645-45dd-bbda-0f90bbec3690 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:06.825418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100283d0-6c07-4c41-805e-a050ee513c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:06.826174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100283d0-6c07-4c41-805e-a050ee513c83 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:06.826453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100283d0-6c07-4c41-805e-a050ee513c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:06.826725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100283d0-6c07-4c41-805e-a050ee513c83 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:06.836451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100283d0-6c07-4c41-805e-a050ee513c83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:37:06.843543 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-100283d0-6c07-4c41-805e-a050ee513c83 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:37:06.844690 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 598/1193] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:37:06.850079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024589-e9a1-4292-8cc1-e765ba649393 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:06.859262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024589-e9a1-4292-8cc1-e765ba649393 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:06.863688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:06.864319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:06.864622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:06.864893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:06.865620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:37:06.865919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:06.867484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:06.875382 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 596/1194] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:06.880689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100283d0-6c07-4c41-805e-a050ee513c83 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:06.891095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100283d0-6c07-4c41-805e-a050ee513c83 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:06.895501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45570-e38d-4871-bd16-f9818e9bc425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:06.896294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45570-e38d-4871-bd16-f9818e9bc425 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:06.896601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45570-e38d-4871-bd16-f9818e9bc425 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:06.896871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45570-e38d-4871-bd16-f9818e9bc425 admin admin] PATH_INFO: `/v3/users/52fea97182a644739d62ad00547551b5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:06.898028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a45570-e38d-4871-bd16-f9818e9bc425 admin admin] RBAC: Authorizing `identity:get_user(user_id=52fea97182a644739d62ad00547551b5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:06.900095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a45570-e38d-4871-bd16-f9818e9bc425 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:06.901666 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 599/1195] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Feb 19 20:37:06 2022] GET /identity/v3/users/52fea97182a644739d62ad00547551b5 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:06.908832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:06.918459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdc074-4ed7-4453-86da-c6c4a5a298a4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:06.923002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4870e18-af3a-40cd-969c-6b9654f3da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:06.923612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4870e18-af3a-40cd-969c-6b9654f3da11 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:06.923895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4870e18-af3a-40cd-969c-6b9654f3da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:06.924171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4870e18-af3a-40cd-969c-6b9654f3da11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:06.931758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4870e18-af3a-40cd-969c-6b9654f3da11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:06.933493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4870e18-af3a-40cd-969c-6b9654f3da11 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:06.942211 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 597/1196] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:37:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:37:06.947508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45570-e38d-4871-bd16-f9818e9bc425 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:06.957373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45570-e38d-4871-bd16-f9818e9bc425 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:06.961758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff926304-1a24-46c8-9842-883fd16dd22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:06.962554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff926304-1a24-46c8-9842-883fd16dd22c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:06.962834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff926304-1a24-46c8-9842-883fd16dd22c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:06.963108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff926304-1a24-46c8-9842-883fd16dd22c admin admin] PATH_INFO: `/v3/projects/7b5f434ae3fe4addbd2bd020b43a3c2c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:06.964249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff926304-1a24-46c8-9842-883fd16dd22c admin admin] RBAC: Authorizing `identity:get_project(project_id=7b5f434ae3fe4addbd2bd020b43a3c2c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:06.966258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff926304-1a24-46c8-9842-883fd16dd22c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:06.968666 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 600/1197] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Feb 19 20:37:06 2022] GET /identity/v3/projects/7b5f434ae3fe4addbd2bd020b43a3c2c => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:37:06.973728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4870e18-af3a-40cd-969c-6b9654f3da11 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:37:06.982013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4870e18-af3a-40cd-969c-6b9654f3da11 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:37:06.986510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edbec9-e464-4a23-a7dd-7d3fe834cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:37:06.987097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edbec9-e464-4a23-a7dd-7d3fe834cab4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:37:06.987375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edbec9-e464-4a23-a7dd-7d3fe834cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:37:06.987647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edbec9-e464-4a23-a7dd-7d3fe834cab4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:37:06.988475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edbec9-e464-4a23-a7dd-7d3fe834cab4 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=7b5f434ae3fe4addbd2bd020b43a3c2c, user.id=52fea97182a644739d62ad00547551b5) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:37:06.988784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edbec9-e464-4a23-a7dd-7d3fe834cab4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:37:06.990524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edbec9-e464-4a23-a7dd-7d3fe834cab4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:37:06.996052 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 598/1198] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:37:06 2022] GET /identity/v3/role_assignments?user.id=52fea97182a644739d62ad00547551b5&scope.project.id=7b5f434ae3fe4addbd2bd020b43a3c2c&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:10.261513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f83499-ef57-4aa5-941d-2fce1ada3f18 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:10.262086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f83499-ef57-4aa5-941d-2fce1ada3f18 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:10.262645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f83499-ef57-4aa5-941d-2fce1ada3f18 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:10.264829 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 601/1199] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:10.270603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96270-54a3-4a21-919d-bcedb4ddef50 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:10.271474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96270-54a3-4a21-919d-bcedb4ddef50 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:10.271972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96270-54a3-4a21-919d-bcedb4ddef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:10.298671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f9c96270-54a3-4a21-919d-bcedb4ddef50 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:10.300042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f9c96270-54a3-4a21-919d-bcedb4ddef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:10.308799 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 599/1200] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:10.337218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f83499-ef57-4aa5-941d-2fce1ada3f18 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:10.352494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f83499-ef57-4aa5-941d-2fce1ada3f18 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:10.358957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:10.359881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:10.360200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:10.360525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:10.373311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:10.375149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:10.395396 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:10.396702 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 602/1201] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:10.402638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c96270-54a3-4a21-919d-bcedb4ddef50 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:10.411939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c96270-54a3-4a21-919d-bcedb4ddef50 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:10.417453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b99bb-eef8-4280-a22c-61ab9eab3d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:10.418109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b99bb-eef8-4280-a22c-61ab9eab3d2e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:10.418393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b99bb-eef8-4280-a22c-61ab9eab3d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:10.418646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b99bb-eef8-4280-a22c-61ab9eab3d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:10.419370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b99bb-eef8-4280-a22c-61ab9eab3d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:10.419806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b99bb-eef8-4280-a22c-61ab9eab3d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:10.421914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b99bb-eef8-4280-a22c-61ab9eab3d2e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:10.434498 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 600/1202] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:10.442228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:10.453433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f2b7-abab-4276-84ef-aa4425d1b5fc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:10.459081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be52d4-045d-4780-9ca0-548d5a87ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:10.459851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be52d4-045d-4780-9ca0-548d5a87ff62 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:10.460127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be52d4-045d-4780-9ca0-548d5a87ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:10.460433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be52d4-045d-4780-9ca0-548d5a87ff62 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:10.461286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be52d4-045d-4780-9ca0-548d5a87ff62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:10.463448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be52d4-045d-4780-9ca0-548d5a87ff62 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:10.492596 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 603/1203] 10.222.0.30 () {60 vars in 1153 bytes} [Sat Feb 19 20:38:10 2022] POST /identity/v3/users => generated 251 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:38:13.409831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef7b2-7f56-43c9-99c9-8e6d62a61d54 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.410447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef7b2-7f56-43c9-99c9-8e6d62a61d54 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.410536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef7b2-7f56-43c9-99c9-8e6d62a61d54 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.412834 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 601/1204] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:13.419147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74355d1-55f5-4307-9aab-68db13fdd686 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.420184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74355d1-55f5-4307-9aab-68db13fdd686 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.420270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74355d1-55f5-4307-9aab-68db13fdd686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.441281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f74355d1-55f5-4307-9aab-68db13fdd686 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:13.442466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f74355d1-55f5-4307-9aab-68db13fdd686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:13.452399 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 604/1205] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:13.480564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ef7b2-7f56-43c9-99c9-8e6d62a61d54 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.495492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ef7b2-7f56-43c9-99c9-8e6d62a61d54 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.501909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d96f6-82cb-4ebe-b0a2-af9347babafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.502740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d96f6-82cb-4ebe-b0a2-af9347babafa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.502992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d96f6-82cb-4ebe-b0a2-af9347babafa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.503307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d96f6-82cb-4ebe-b0a2-af9347babafa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.514887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d96f6-82cb-4ebe-b0a2-af9347babafa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:38:13.522249 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-1f0d96f6-82cb-4ebe-b0a2-af9347babafa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:38:13.523480 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 602/1206] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:13.531003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74355d1-55f5-4307-9aab-68db13fdd686 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.543291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74355d1-55f5-4307-9aab-68db13fdd686 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.551138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.551138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.551138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.551138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.551686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:13.551686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.552715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.563566 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 605/1207] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:13.569417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d96f6-82cb-4ebe-b0a2-af9347babafa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.582377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d96f6-82cb-4ebe-b0a2-af9347babafa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.587830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.588828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.589172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.589518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.603625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.606051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.626752 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:13.628239 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 603/1208] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:13.637120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.648779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ddcc-c398-4ae7-8a12-78e62c0b74ac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.654515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.655265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.655626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.656000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.656921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:13.657313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.658984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.678655 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 606/1209] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:13.680052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.690652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b05447-0b67-46f2-abc6-1031531ad44b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.695737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.696555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.696872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.697146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.705439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.707585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.722466 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 19 20:38:13.723705 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 604/1210] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:13.731282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.742932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b827ef9-265d-48fb-9850-0c3d95fecf3b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.748981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.749765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.750052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.750328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.751358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:13.751688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.754130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.776420 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 607/1211] 10.222.0.30 () {56 vars in 1164 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:13.782892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.793609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeb3e4-b359-445d-92f2-9a7e3b07f37e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.799313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a9c4-341d-4585-9e09-1de0e736e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.799958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a9c4-341d-4585-9e09-1de0e736e47f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.800241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a9c4-341d-4585-9e09-1de0e736e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.800657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a9c4-341d-4585-9e09-1de0e736e47f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.809221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9a9c4-341d-4585-9e09-1de0e736e47f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.810970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9a9c4-341d-4585-9e09-1de0e736e47f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.820175 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 605/1212] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:38:13.826617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.837036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe526d83-63d9-44ff-a530-c1f4bfb0f5fb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.842704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.843491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.843774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.844047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.854939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.856865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.875077 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:13.876625 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 608/1213] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:13.885412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a9c4-341d-4585-9e09-1de0e736e47f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.896745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a9c4-341d-4585-9e09-1de0e736e47f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.903044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.904571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.904982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.905327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.906350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:13.906730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.908922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.924361 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 606/1214] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:13.929575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.939403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665681-be70-4411-9b84-e5e0a21781b1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.944231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.945090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.945372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.945793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.956689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:13.958789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:13.972511 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:38:13.978346 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 609/1215] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:13.980101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:13.990960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f05ddf-320b-4be4-b66d-d2a45407e615 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:13.995779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce76d10-d6d9-44b6-bf18-1025b244ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:13.996544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce76d10-d6d9-44b6-bf18-1025b244ea70 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:13.996823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce76d10-d6d9-44b6-bf18-1025b244ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:13.997113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce76d10-d6d9-44b6-bf18-1025b244ea70 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:13.998485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce76d10-d6d9-44b6-bf18-1025b244ea70 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:13.998853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce76d10-d6d9-44b6-bf18-1025b244ea70 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:14.000701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce76d10-d6d9-44b6-bf18-1025b244ea70 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:14.014266 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 607/1216] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:14.022225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:14.033611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8155-aa1e-40d9-b8ff-c54483e51594 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:14.038271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9087a18-4d90-435b-a2dc-51854045af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:14.038918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087a18-4d90-435b-a2dc-51854045af3c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:14.039548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087a18-4d90-435b-a2dc-51854045af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:14.039548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087a18-4d90-435b-a2dc-51854045af3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:14.040265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087a18-4d90-435b-a2dc-51854045af3c admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=ca7ebf0dddfe43509871a447460f6e36) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:14.041503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087a18-4d90-435b-a2dc-51854045af3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:14.042692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087a18-4d90-435b-a2dc-51854045af3c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:14.049630 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 610/1217] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:38:14 2022] GET /identity/v3/role_assignments?user.id=ca7ebf0dddfe43509871a447460f6e36&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:16.492263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc6c5-89da-46bd-b4d0-cc65f77b5824 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.492919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc6c5-89da-46bd-b4d0-cc65f77b5824 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.492919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc6c5-89da-46bd-b4d0-cc65f77b5824 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.494850 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 608/1218] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:16.500378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6054c33-e17d-4fa4-86fd-87c59aa1e732 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.500828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6054c33-e17d-4fa4-86fd-87c59aa1e732 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.500970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6054c33-e17d-4fa4-86fd-87c59aa1e732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.519933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e6054c33-e17d-4fa4-86fd-87c59aa1e732 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:16.521283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e6054c33-e17d-4fa4-86fd-87c59aa1e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:16.530264 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 611/1219] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:38:16.555466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebc6c5-89da-46bd-b4d0-cc65f77b5824 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.568564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebc6c5-89da-46bd-b4d0-cc65f77b5824 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.573557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09104b7d-a516-4163-8221-dcb2fbbfe09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.574322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09104b7d-a516-4163-8221-dcb2fbbfe09f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.574603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09104b7d-a516-4163-8221-dcb2fbbfe09f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.574894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09104b7d-a516-4163-8221-dcb2fbbfe09f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.586290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09104b7d-a516-4163-8221-dcb2fbbfe09f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:38:16.594012 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-09104b7d-a516-4163-8221-dcb2fbbfe09f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:38:16.595369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 609/1220] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:16.601130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6054c33-e17d-4fa4-86fd-87c59aa1e732 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.611398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6054c33-e17d-4fa4-86fd-87c59aa1e732 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.616647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.617451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.617841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.618320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.619182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:16.619585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:16.621310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:16.630536 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 612/1221] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:16.636240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09104b7d-a516-4163-8221-dcb2fbbfe09f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.648192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09104b7d-a516-4163-8221-dcb2fbbfe09f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.653154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.653913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.654190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.654460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.664521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:16.666346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:16.684791 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:16.691100 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 610/1222] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:16.692453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.704974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b39ac2-c014-4a4a-8938-9da437d640a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.710331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.711019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.711337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.711735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.712507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:16.712822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:16.714575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:16.737012 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 613/1223] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:16.738243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.749630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92e65c-0c62-44c2-8fec-d277254753ae admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.754839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.755643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.755924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.756191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.765253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:16.767897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:16.783183 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 19 20:38:16.784838 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 611/1224] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:16.790259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.801691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d03dbd-a021-4158-8b28-cafef5310138 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.806668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.807326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.807624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.807981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.808824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:16.809176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:16.811616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:16.831617 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 614/1225] 10.222.0.30 () {56 vars in 1164 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:16.837396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.855802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c96f-f40a-46ed-9266-d666f2246fdd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.860935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.862345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.862345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.862345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.873067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:16.874885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:16.894026 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:16.895216 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 612/1226] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:16.900950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.912688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05d7fe-bd13-487f-816c-d8521d601f78 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.918085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.918739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.919021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.919297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.920038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:16.920400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:16.921955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:16.933170 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 615/1227] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:16.938827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.949591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131341a-e94b-4d3d-87ef-9d6ce91bca83 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:16.955556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:16.956381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:16.956720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:16.956941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:16.964348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:16.967085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:16.980592 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:38:16.982389 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 613/1228] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:16.988459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:16.999174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f120-27c8-4351-92b6-a9cb68f49b69 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:17.003733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec97fb-2828-4ad1-a341-e3b8c2a07bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:17.004341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec97fb-2828-4ad1-a341-e3b8c2a07bce admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:17.004644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec97fb-2828-4ad1-a341-e3b8c2a07bce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:17.004920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec97fb-2828-4ad1-a341-e3b8c2a07bce admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:17.005696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec97fb-2828-4ad1-a341-e3b8c2a07bce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:17.006004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec97fb-2828-4ad1-a341-e3b8c2a07bce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:17.007821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec97fb-2828-4ad1-a341-e3b8c2a07bce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:17.024831 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 616/1229] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:38:17.025977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:17.037151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cfac7-3ad3-49cc-8bf7-6208c018c53b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:17.042608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890d97-aaef-4c33-9668-2100fb599f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:17.043595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890d97-aaef-4c33-9668-2100fb599f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:17.043883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890d97-aaef-4c33-9668-2100fb599f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:17.044148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890d97-aaef-4c33-9668-2100fb599f0c admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/ca7ebf0dddfe43509871a447460f6e36/roles/6af0e115d1f04a48893aa10bf6753ced` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:17.062497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890d97-aaef-4c33-9668-2100fb599f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=ca7ebf0dddfe43509871a447460f6e36, role_id=6af0e115d1f04a48893aa10bf6753ced)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:17.065274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890d97-aaef-4c33-9668-2100fb599f0c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:17.088356 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 614/1230] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:38:17 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/ca7ebf0dddfe43509871a447460f6e36/roles/6af0e115d1f04a48893aa10bf6753ced => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:38:19.520850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a5f68-3ce2-4ff1-9d3a-c81c65b8ee36 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.521380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a5f68-3ce2-4ff1-9d3a-c81c65b8ee36 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.521380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a5f68-3ce2-4ff1-9d3a-c81c65b8ee36 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.523190 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 617/1231] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:19.528516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d353db-e145-4dc3-9dc9-455fe72bde15 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.528976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d353db-e145-4dc3-9dc9-455fe72bde15 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.529113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d353db-e145-4dc3-9dc9-455fe72bde15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.548261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-57d353db-e145-4dc3-9dc9-455fe72bde15 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:19.549723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57d353db-e145-4dc3-9dc9-455fe72bde15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:19.614358 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 615/1232] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:19.645634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a5f68-3ce2-4ff1-9d3a-c81c65b8ee36 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:19.659397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a5f68-3ce2-4ff1-9d3a-c81c65b8ee36 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:19.664388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f04afe-51e1-491f-9484-6fc295dccc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:19.665224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f04afe-51e1-491f-9484-6fc295dccc07 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.665563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f04afe-51e1-491f-9484-6fc295dccc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.665837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f04afe-51e1-491f-9484-6fc295dccc07 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.677746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f04afe-51e1-491f-9484-6fc295dccc07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:38:19.686202 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-33f04afe-51e1-491f-9484-6fc295dccc07 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 19 20:38:19.687462 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 618/1233] 10.222.0.30 () {56 vars in 1123 bytes} [Sat Feb 19 20:38:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:19.694488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d353db-e145-4dc3-9dc9-455fe72bde15 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:19.705657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d353db-e145-4dc3-9dc9-455fe72bde15 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:19.711234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:19.711988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.712317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.712611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.713489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:19.713888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:19.715788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:19.725825 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 616/1234] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Feb 19 20:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:19.732392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f04afe-51e1-491f-9484-6fc295dccc07 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:19.744484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f04afe-51e1-491f-9484-6fc295dccc07 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:19.751311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:19.752241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.752586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.752866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.765153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:19.767543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:19.786029 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:19.787311 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 619/1235] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:19.795435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:19.806315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1777b-2565-4230-b9a2-3dffe9d86c33 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:19.812093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:19.812773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.813053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.813458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.814321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:19.814625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:19.816421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:19.829835 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 617/1236] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:38:19.836167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:19.848355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ff96-5e3d-4039-af10-7a9d754ba135 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:19.854537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:19.855315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.855596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.855867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.865907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:19.868102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:19.885173 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 19 20:38:19.886378 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 620/1237] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:19.893323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:19.904403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fff82d-f0c7-4dfa-9d29-06d2545393e3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:19.909189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:19.909878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.910136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.910456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.911334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:19.911719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:19.913601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:19.932418 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 618/1238] 10.222.0.30 () {56 vars in 1164 bytes} [Sat Feb 19 20:38:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:19.938482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:19.948643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b61ba8-3ed4-422b-863d-70a7996449c2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:19.954744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d593-dbaa-4f47-be3c-214fb188eea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:19.955387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d593-dbaa-4f47-be3c-214fb188eea4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:19.955673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d593-dbaa-4f47-be3c-214fb188eea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:19.955947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d593-dbaa-4f47-be3c-214fb188eea4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:19.967421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906d593-dbaa-4f47-be3c-214fb188eea4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:19.969940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906d593-dbaa-4f47-be3c-214fb188eea4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:19.981235 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 621/1239] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:38:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:38:19.987132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:19.997313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546563-61f9-42da-971d-767e7fb27071 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:20.002620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:20.003389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:20.003670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:20.003944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:20.014857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:20.016813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:20.034738 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:20.036175 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 619/1240] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:20.042458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d593-dbaa-4f47-be3c-214fb188eea4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:20.054131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d593-dbaa-4f47-be3c-214fb188eea4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:20.060008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:20.060686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:20.061267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:20.061600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:20.062436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:20.062742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:20.064430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:20.082845 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 622/1241] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:20.088933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:20.100906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bcd7-b95b-42a7-9bbb-559cabf4559a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:20.106127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:20.107422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:20.107694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:20.107962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:20.114752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:20.116749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:20.129696 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:38:20.130853 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 620/1242] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:20.136986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:20.147823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145380-8224-4467-a655-bb841462ca16 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:20.152347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c23511-09c2-45a5-8d85-a49062ee2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:20.153085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23511-09c2-45a5-8d85-a49062ee2dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:20.153372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23511-09c2-45a5-8d85-a49062ee2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:20.153645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23511-09c2-45a5-8d85-a49062ee2dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:20.154581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c23511-09c2-45a5-8d85-a49062ee2dd1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:20.154889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c23511-09c2-45a5-8d85-a49062ee2dd1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:20.157014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c23511-09c2-45a5-8d85-a49062ee2dd1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:20.171414 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 623/1243] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:20.178055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:20.191963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8575f-1f42-4620-8be2-67e968487274 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:20.198276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822ea35-8227-4f3a-bff6-7b565a79b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:20.198926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822ea35-8227-4f3a-bff6-7b565a79b098 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:20.199239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822ea35-8227-4f3a-bff6-7b565a79b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:20.199626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822ea35-8227-4f3a-bff6-7b565a79b098 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:20.200711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822ea35-8227-4f3a-bff6-7b565a79b098 admin admin] RBAC: Adding query filter params (role.id=6af0e115d1f04a48893aa10bf6753ced, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=ca7ebf0dddfe43509871a447460f6e36) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:20.201559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822ea35-8227-4f3a-bff6-7b565a79b098 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:20.204182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822ea35-8227-4f3a-bff6-7b565a79b098 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:20.212260 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 621/1244] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:38:20 2022] GET /identity/v3/role_assignments?user.id=ca7ebf0dddfe43509871a447460f6e36&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=6af0e115d1f04a48893aa10bf6753ced => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:22.775615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb466b-5e42-4c3e-8cec-0a01dd5386f5 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:22.776168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb466b-5e42-4c3e-8cec-0a01dd5386f5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:22.776168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb466b-5e42-4c3e-8cec-0a01dd5386f5 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:22.778384 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 624/1245] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:22.783912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1885b-b262-4231-9810-75d779e7a656 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:22.784384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1885b-b262-4231-9810-75d779e7a656 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:22.784482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1885b-b262-4231-9810-75d779e7a656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:22.803903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-99c1885b-b262-4231-9810-75d779e7a656 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:22.805216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-99c1885b-b262-4231-9810-75d779e7a656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:22.814222 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 622/1246] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:22.839188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb466b-5e42-4c3e-8cec-0a01dd5386f5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:22.852520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb466b-5e42-4c3e-8cec-0a01dd5386f5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:22.857909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31a46-7685-4f1c-b84d-6f9658f81bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:22.858683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31a46-7685-4f1c-b84d-6f9658f81bdd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:22.858962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31a46-7685-4f1c-b84d-6f9658f81bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:22.859237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31a46-7685-4f1c-b84d-6f9658f81bdd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:22.871905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b31a46-7685-4f1c-b84d-6f9658f81bdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:38:22.883335 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b5b31a46-7685-4f1c-b84d-6f9658f81bdd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:38:22.884882 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 625/1247] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:22.892179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1885b-b262-4231-9810-75d779e7a656 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:22.905380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1885b-b262-4231-9810-75d779e7a656 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:22.910547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:22.911276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:22.911555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:22.911834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:22.912926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:22.913218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:22.915089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:22.925041 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 623/1248] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:22.930699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31a46-7685-4f1c-b84d-6f9658f81bdd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:22.942508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31a46-7685-4f1c-b84d-6f9658f81bdd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:22.947035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:22.947894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:22.948174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:22.948494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:22.962410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:22.964616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:22.983384 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:22.984748 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 626/1249] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:22.992204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.011066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050772b-ce12-42b2-a424-0d510a028698 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.016464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.017118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.017411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.017748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.018474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:23.018780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.020408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.033164 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 624/1250] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:23.039488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.050765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a5b5a-e4d7-4ae7-8876-cf17d8aeae11 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.056286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.057103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.057582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.057867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.066221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.068228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.083582 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 19 20:38:23.084989 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 627/1251] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:23.090920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.102307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b891e8c-ce80-4261-9b8c-ff96882c6b43 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.107631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.108276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.108587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.108864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.109821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:23.110197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.112130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.131514 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 625/1252] 10.222.0.30 () {56 vars in 1164 bytes} [Sat Feb 19 20:38:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:23.137677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.148535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44901b71-4e74-4e0a-8e2d-cbde6b306e37 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.153421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c80ab-ebe9-41a1-8e06-8c43b9011326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.154550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c80ab-ebe9-41a1-8e06-8c43b9011326 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.154893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c80ab-ebe9-41a1-8e06-8c43b9011326 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.155251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c80ab-ebe9-41a1-8e06-8c43b9011326 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.165028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c80ab-ebe9-41a1-8e06-8c43b9011326 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.166895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c80ab-ebe9-41a1-8e06-8c43b9011326 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.177260 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 628/1253] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:38:23 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:38:23.183383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.193977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27095210-6d0c-4355-844c-83bb5b9ee93e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.199987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.200915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.201245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.201596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.214387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.217291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.238847 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:23.240140 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 626/1254] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:23.246987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c80ab-ebe9-41a1-8e06-8c43b9011326 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.256985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c80ab-ebe9-41a1-8e06-8c43b9011326 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.262687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.263080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.263357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.263646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.264481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:23.264785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.266442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.279261 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 629/1255] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:23.285055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.295929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeabc09-5812-4788-b284-7f0d75f25ebd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.300893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.301684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.301974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.302339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.310184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.312150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.325126 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:38:23.326616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 627/1256] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:23.333864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.344317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6041-b598-44fe-89d6-7ae720d38a97 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.348910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f6db9-92f0-4669-87bd-0a348450264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.349574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f6db9-92f0-4669-87bd-0a348450264a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.349861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f6db9-92f0-4669-87bd-0a348450264a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.350139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f6db9-92f0-4669-87bd-0a348450264a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.350925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f6db9-92f0-4669-87bd-0a348450264a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:23.351292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f6db9-92f0-4669-87bd-0a348450264a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.353248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f6db9-92f0-4669-87bd-0a348450264a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.368554 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 630/1257] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:23.375061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:23.387522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc8647-f197-4cb3-b551-8b9c9f787f8c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:23.393956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d032f-f100-404a-b4fb-92e457bf7763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:23.394822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d032f-f100-404a-b4fb-92e457bf7763 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:23.395165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d032f-f100-404a-b4fb-92e457bf7763 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:23.395518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d032f-f100-404a-b4fb-92e457bf7763 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:23.396499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d032f-f100-404a-b4fb-92e457bf7763 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=ca7ebf0dddfe43509871a447460f6e36) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:23.396870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d032f-f100-404a-b4fb-92e457bf7763 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:23.398759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d032f-f100-404a-b4fb-92e457bf7763 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:23.405757 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 628/1258] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:38:23 2022] GET /identity/v3/role_assignments?user.id=ca7ebf0dddfe43509871a447460f6e36&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:26.077810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb2cd0-df28-4179-9e33-6bac6adc3b4f None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.078376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb2cd0-df28-4179-9e33-6bac6adc3b4f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.078474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb2cd0-df28-4179-9e33-6bac6adc3b4f None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.080568 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 631/1259] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:38:26.086544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c357-a418-4dcf-9429-9c546350394a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.087112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c357-a418-4dcf-9429-9c546350394a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.087230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c357-a418-4dcf-9429-9c546350394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.110456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9492c357-a418-4dcf-9429-9c546350394a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:26.111907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9492c357-a418-4dcf-9429-9c546350394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:26.121277 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 629/1260] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:26.151827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb2cd0-df28-4179-9e33-6bac6adc3b4f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.166084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb2cd0-df28-4179-9e33-6bac6adc3b4f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.172052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d864f-7e28-4abc-9472-71ef4eb2fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.173144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d864f-7e28-4abc-9472-71ef4eb2fa2a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.173459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d864f-7e28-4abc-9472-71ef4eb2fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.173821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d864f-7e28-4abc-9472-71ef4eb2fa2a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.186628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d864f-7e28-4abc-9472-71ef4eb2fa2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:38:26.194691 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-1b9d864f-7e28-4abc-9472-71ef4eb2fa2a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:38:26.196218 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 632/1261] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:26.205763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c357-a418-4dcf-9429-9c546350394a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.218033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c357-a418-4dcf-9429-9c546350394a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.224088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.224949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.225350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.225707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.226578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:26.226978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.228993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.238815 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 630/1262] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:26.245275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d864f-7e28-4abc-9472-71ef4eb2fa2a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.257226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d864f-7e28-4abc-9472-71ef4eb2fa2a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.263674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.264679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.264964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.265230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.277335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.279186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.297931 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:26.299279 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 633/1263] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:26.305396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.316355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21397d-23cd-4062-a8c7-b073401fb0eb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.321779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.322542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.322970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.323274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.324113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:26.324581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.326884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.339725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 631/1264] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:38:26.346524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.357526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96c9d-7a7c-4e54-b25d-484a7a0f76fb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.362140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.363011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.363279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.363546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.372239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.374496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.390878 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 19 20:38:26.392063 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 634/1265] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:26.397985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.409004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e934bce-e3ee-4ddf-bc0a-4089df3c08c2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.413718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.414376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.414658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.414929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.415846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:26.416217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.418762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.438883 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 632/1266] 10.222.0.30 () {56 vars in 1164 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:26.444480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.455212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b0a89-7ed3-43cf-bb98-8a85553dcbdf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.460073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.460921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.461197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.461464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.473888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.475876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.493535 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:26.494868 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 635/1267] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:26.500609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.511085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe3235-e7c4-46ff-848c-b82adfe90a8b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.516218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.516907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.517185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.517507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.518208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:26.518509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.520085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.532792 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 633/1268] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:26.538815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.548962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26347acc-d6e3-450a-b510-83eadb5e9462 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.553945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.554728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.555002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.555275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.563325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.565475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.579280 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:38:26.580545 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 636/1269] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:26.586924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.597914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa67531-0810-4af9-b541-33ff0657af02 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.602794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1f232-1e81-4182-b54a-a6ea4e3b6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.603482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f232-1e81-4182-b54a-a6ea4e3b6ccb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.603751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f232-1e81-4182-b54a-a6ea4e3b6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.604024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f232-1e81-4182-b54a-a6ea4e3b6ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.604831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1f232-1e81-4182-b54a-a6ea4e3b6ccb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:26.605133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1f232-1e81-4182-b54a-a6ea4e3b6ccb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.607148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1f232-1e81-4182-b54a-a6ea4e3b6ccb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.620148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 634/1270] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:26.626352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:26.636921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68651f-0013-4c11-a8b6-fc8ea81757d7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:26.642258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a3ddb-74eb-4dd4-b8c7-ebf022d5c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:26.643132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a3ddb-74eb-4dd4-b8c7-ebf022d5c860 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:26.643469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a3ddb-74eb-4dd4-b8c7-ebf022d5c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:26.643684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a3ddb-74eb-4dd4-b8c7-ebf022d5c860 admin admin] PATH_INFO: `/v3/projects/676e84132178466da2cf0c656f99ebd2/users/ca7ebf0dddfe43509871a447460f6e36/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:26.645697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a3ddb-74eb-4dd4-b8c7-ebf022d5c860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e84132178466da2cf0c656f99ebd2, user_id=ca7ebf0dddfe43509871a447460f6e36, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:26.648457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a3ddb-74eb-4dd4-b8c7-ebf022d5c860 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:26.664289 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 637/1271] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 20:38:26 2022] PUT /identity/v3/projects/676e84132178466da2cf0c656f99ebd2/users/ca7ebf0dddfe43509871a447460f6e36/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:38:29.081061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7762-8abd-40e0-9903-a4654cc122ee None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.081633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7762-8abd-40e0-9903-a4654cc122ee None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.081633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7762-8abd-40e0-9903-a4654cc122ee None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.083409 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 635/1272] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:29.088529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342979a-c8d2-44d8-8470-7191f378d249 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.088930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342979a-c8d2-44d8-8470-7191f378d249 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.089084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342979a-c8d2-44d8-8470-7191f378d249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.106482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b342979a-c8d2-44d8-8470-7191f378d249 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:29.108302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b342979a-c8d2-44d8-8470-7191f378d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:29.161805 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 638/1273] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:29.187377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7762-8abd-40e0-9903-a4654cc122ee None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.201253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7762-8abd-40e0-9903-a4654cc122ee None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.207236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d0d5-187e-4998-81d6-c582937eea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.208154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d0d5-187e-4998-81d6-c582937eea12 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.208551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d0d5-187e-4998-81d6-c582937eea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.208907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d0d5-187e-4998-81d6-c582937eea12 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.220823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97d0d5-187e-4998-81d6-c582937eea12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:38:29.227461 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-cb97d0d5-187e-4998-81d6-c582937eea12 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 19 20:38:29.228751 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 636/1274] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:29.235234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342979a-c8d2-44d8-8470-7191f378d249 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.244298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342979a-c8d2-44d8-8470-7191f378d249 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.250587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.251454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.251889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.252204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.253181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:29.253528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.255746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.265732 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 639/1275] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:38:29.271195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d0d5-187e-4998-81d6-c582937eea12 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.281307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d0d5-187e-4998-81d6-c582937eea12 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.285852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.286606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.286885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.287155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.297386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.299206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.315737 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:29.316977 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 637/1276] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:29.323579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.333576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc498e00-1e50-4671-9cfe-73b1288a79d8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.337915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.338523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.338799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.339070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.339767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:29.340067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.341680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.353066 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 640/1277] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:29.358271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.367574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e314d4f-b965-4259-9634-9d2971f269de admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.372029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.373316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.373597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.373872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.380912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.382886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.396876 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 19 20:38:29.397979 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 638/1278] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:29.403437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.412876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e234a-62dc-4273-8a50-e4505b548934 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.417959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.418598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.418881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.419634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.420496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:29.420806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.422600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.439841 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 641/1279] 10.222.0.30 () {56 vars in 1164 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:29.445065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.454345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22758a4b-6cbd-4b5c-a082-89b29bdb5fb5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.458824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2327-c040-422c-afe7-58c6f1bc991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.459430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2327-c040-422c-afe7-58c6f1bc991a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.459706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2327-c040-422c-afe7-58c6f1bc991a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.459977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2327-c040-422c-afe7-58c6f1bc991a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.467405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e2327-c040-422c-afe7-58c6f1bc991a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.469136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e2327-c040-422c-afe7-58c6f1bc991a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.477662 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 639/1280] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:38:29.483410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.492674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52694211-3252-4cb0-a8dc-e4f789c51b1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.497135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.498487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.498768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.499045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.509015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.510795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.527434 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 19 20:38:29.529182 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 642/1281] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:29.534694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2327-c040-422c-afe7-58c6f1bc991a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.543671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2327-c040-422c-afe7-58c6f1bc991a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.548228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.548887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.549162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.549428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.550121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:29.550421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.551974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.563040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 640/1282] 10.222.0.30 () {56 vars in 1130 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:29.568296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.578281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bbcc4-460c-42b4-a7fe-9f47704e3121 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.582897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.583697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.583934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.584209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.590878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.593483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.605996 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 19 20:38:29.607104 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 643/1283] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:29.612629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.621916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e825c-7d78-410d-97d9-5c116e9bbd4e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.626315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb95f9-be69-4e72-af1c-62fd9c3a0baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.626928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb95f9-be69-4e72-af1c-62fd9c3a0baf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.627206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb95f9-be69-4e72-af1c-62fd9c3a0baf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.627478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb95f9-be69-4e72-af1c-62fd9c3a0baf admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.628238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb95f9-be69-4e72-af1c-62fd9c3a0baf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:29.628577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb95f9-be69-4e72-af1c-62fd9c3a0baf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.630347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb95f9-be69-4e72-af1c-62fd9c3a0baf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.642459 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 641/1284] 10.222.0.30 () {56 vars in 1169 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:38:29.647876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:29.658323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41396-ae1e-4e12-9833-9c5c870f78e6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:29.662754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10ec0-299d-4f53-a6e3-68b9a44edf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:29.663360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10ec0-299d-4f53-a6e3-68b9a44edf03 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:29.663640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10ec0-299d-4f53-a6e3-68b9a44edf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:29.663916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10ec0-299d-4f53-a6e3-68b9a44edf03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:29.664761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd10ec0-299d-4f53-a6e3-68b9a44edf03 admin admin] RBAC: Adding query filter params (role.id=bafeb2a265a54d848f2281c61dd3eaec, scope.project.id=676e84132178466da2cf0c656f99ebd2, user.id=ca7ebf0dddfe43509871a447460f6e36) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:29.665072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd10ec0-299d-4f53-a6e3-68b9a44edf03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:29.666842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd10ec0-299d-4f53-a6e3-68b9a44edf03 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:29.672664 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 644/1285] 10.222.0.30 () {56 vars in 1395 bytes} [Sat Feb 19 20:38:29 2022] GET /identity/v3/role_assignments?user.id=ca7ebf0dddfe43509871a447460f6e36&scope.project.id=676e84132178466da2cf0c656f99ebd2&role.id=bafeb2a265a54d848f2281c61dd3eaec => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:32.009855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f969a0-5ee1-4381-81c1-b097107a6281 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:32.010383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f969a0-5ee1-4381-81c1-b097107a6281 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:32.010383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f969a0-5ee1-4381-81c1-b097107a6281 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:32.012176 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 642/1286] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:32.017826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcba25-9065-43a9-9d83-275dafeb153b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:32.018253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcba25-9065-43a9-9d83-275dafeb153b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:32.018358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcba25-9065-43a9-9d83-275dafeb153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:32.035621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-35fcba25-9065-43a9-9d83-275dafeb153b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:32.036827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-35fcba25-9065-43a9-9d83-275dafeb153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:32.045178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 645/1287] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:32.068277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f969a0-5ee1-4381-81c1-b097107a6281 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:32.080122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f969a0-5ee1-4381-81c1-b097107a6281 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:32.084488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:32.085243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:32.085522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:32.085795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:32.086435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:32.088000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:32.099171 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 19 20:38:32.100266 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 643/1288] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:38:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:32.105564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcba25-9065-43a9-9d83-275dafeb153b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:32.114727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcba25-9065-43a9-9d83-275dafeb153b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:32.119049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d153-187e-4131-aca6-008912225298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:32.119670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d153-187e-4131-aca6-008912225298 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:32.119949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d153-187e-4131-aca6-008912225298 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:32.120224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d153-187e-4131-aca6-008912225298 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:32.120939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d153-187e-4131-aca6-008912225298 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:32.121237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d153-187e-4131-aca6-008912225298 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:32.122813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d153-187e-4131-aca6-008912225298 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:32.127382 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 646/1289] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Feb 19 20:38:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:32.132438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:32.141607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680699-f903-4258-b7d8-eb071121d7ee admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:32.146051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62add7b8-bd43-4ced-879c-c3e61c59056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:32.146652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add7b8-bd43-4ced-879c-c3e61c59056f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:32.146932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add7b8-bd43-4ced-879c-c3e61c59056f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:32.147206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add7b8-bd43-4ced-879c-c3e61c59056f admin admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:32.147877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62add7b8-bd43-4ced-879c-c3e61c59056f admin admin] RBAC: Adding query filter params (type=placement) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:32.148179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62add7b8-bd43-4ced-879c-c3e61c59056f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:32.149740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62add7b8-bd43-4ced-879c-c3e61c59056f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:32.154591 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 644/1290] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Feb 19 20:38:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:34.508700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82bdf5-5f5f-420e-a2db-ca60e42cde52 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:34.509249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82bdf5-5f5f-420e-a2db-ca60e42cde52 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:34.509249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82bdf5-5f5f-420e-a2db-ca60e42cde52 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:34.510996 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 647/1291] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:34.516551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59648-a6f9-4504-96c8-aa9349b087a6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:34.516968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59648-a6f9-4504-96c8-aa9349b087a6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:34.517102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59648-a6f9-4504-96c8-aa9349b087a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:34.534873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9df59648-a6f9-4504-96c8-aa9349b087a6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:34.536051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9df59648-a6f9-4504-96c8-aa9349b087a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:34.543906 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 645/1292] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:34.568845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82bdf5-5f5f-420e-a2db-ca60e42cde52 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:34.581989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82bdf5-5f5f-420e-a2db-ca60e42cde52 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:34.586284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cd11a-cbed-493f-b805-7d09ee8f67f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:34.586918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd11a-cbed-493f-b805-7d09ee8f67f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:34.587198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd11a-cbed-493f-b805-7d09ee8f67f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:34.587470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd11a-cbed-493f-b805-7d09ee8f67f1 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:34.588178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cd11a-cbed-493f-b805-7d09ee8f67f1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:34.589773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cd11a-cbed-493f-b805-7d09ee8f67f1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:34.602163 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 648/1293] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Feb 19 20:38:34 2022] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:38:37.042814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8a2c9-2c34-47da-82e8-92e9d4ede739 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:37.043335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8a2c9-2c34-47da-82e8-92e9d4ede739 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:37.043335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8a2c9-2c34-47da-82e8-92e9d4ede739 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:37.045159 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 646/1294] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:37.050323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b76f-0e7d-4bb8-9f46-66d1b8899ab3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:37.050720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b76f-0e7d-4bb8-9f46-66d1b8899ab3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:37.050887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b76f-0e7d-4bb8-9f46-66d1b8899ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:37.069545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7cd0b76f-0e7d-4bb8-9f46-66d1b8899ab3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:37.070762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7cd0b76f-0e7d-4bb8-9f46-66d1b8899ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:37.087599 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 649/1295] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:37 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:37.112699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8a2c9-2c34-47da-82e8-92e9d4ede739 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:37.124636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8a2c9-2c34-47da-82e8-92e9d4ede739 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:37.128995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:37.129759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:37.130035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:37.130303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:37.130964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:37.132555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:37.143584 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 19 20:38:37.144705 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 647/1296] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:38:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 19 20:38:37.150099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b76f-0e7d-4bb8-9f46-66d1b8899ab3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:37.159430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b76f-0e7d-4bb8-9f46-66d1b8899ab3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:37.163888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:37.164557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:37.164842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:37.165118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:37.165820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:37.166124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:37.167948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:37.174000 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 650/1297] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Feb 19 20:38:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:37.179482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:37.188905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5189d-d572-4e94-9a26-e52eecf077b3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:37.193636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a656c-c39c-4aaf-a507-6ab158dff84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:37.194623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a656c-c39c-4aaf-a507-6ab158dff84b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:37.194898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a656c-c39c-4aaf-a507-6ab158dff84b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:37.195532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a656c-c39c-4aaf-a507-6ab158dff84b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:37.196174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a656c-c39c-4aaf-a507-6ab158dff84b admin admin] RBAC: Adding query filter params (interface=public, service_id=6c0cb054e8b1401f9637ad1b0397aabb, region_id=RegionOne) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:37.196666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a656c-c39c-4aaf-a507-6ab158dff84b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:37.198417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a656c-c39c-4aaf-a507-6ab158dff84b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:37.205986 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 648/1298] 10.222.0.30 () {56 vars in 1272 bytes} [Sat Feb 19 20:38:37 2022] GET /identity/v3/endpoints?service_id=6c0cb054e8b1401f9637ad1b0397aabb&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:38:37.214751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:37.226382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484db6a-3e04-43bf-969b-884b48bf9958 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:37.231741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c6a1-e7f9-4fec-ac62-a22abc71a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:37.232438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c6a1-e7f9-4fec-ac62-a22abc71a17e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:37.232808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c6a1-e7f9-4fec-ac62-a22abc71a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:37.233230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c6a1-e7f9-4fec-ac62-a22abc71a17e admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:37.233832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4c6a1-e7f9-4fec-ac62-a22abc71a17e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:37.235725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4c6a1-e7f9-4fec-ac62-a22abc71a17e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:37.242935 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 651/1299] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:38:37 2022] GET /identity/v3/services => generated 2191 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:38:39.594566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ced7-41c7-4e5b-9c78-bfdf1d1763da None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:39.595121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ced7-41c7-4e5b-9c78-bfdf1d1763da None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:39.595237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ced7-41c7-4e5b-9c78-bfdf1d1763da None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:39.597168 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 649/1300] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:38:39.602213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc22e-261f-4bea-abeb-f63707c2376e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:39.602634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc22e-261f-4bea-abeb-f63707c2376e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:39.602764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc22e-261f-4bea-abeb-f63707c2376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:39.621103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-185bc22e-261f-4bea-abeb-f63707c2376e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:38:39.622317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-185bc22e-261f-4bea-abeb-f63707c2376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:38:39.629871 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 652/1301] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:38:39 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:38:39.654634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335ced7-41c7-4e5b-9c78-bfdf1d1763da None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:39.666490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335ced7-41c7-4e5b-9c78-bfdf1d1763da None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:39.671680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:39.672478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:39.672753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:39.673020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:39.673656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:39.675210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:39.686169 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 19 20:38:39.687255 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 650/1302] 10.222.0.30 () {56 vars in 1138 bytes} [Sat Feb 19 20:38:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:38:39.692540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bc22e-261f-4bea-abeb-f63707c2376e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:39.701996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bc22e-261f-4bea-abeb-f63707c2376e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:39.706435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb1f67-9b68-4ce7-9670-a756921358b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:39.707072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb1f67-9b68-4ce7-9670-a756921358b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:39.707350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb1f67-9b68-4ce7-9670-a756921358b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:39.707621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb1f67-9b68-4ce7-9670-a756921358b1 admin admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:39.708310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb1f67-9b68-4ce7-9670-a756921358b1 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:38:39.708638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb1f67-9b68-4ce7-9670-a756921358b1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:39.710192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb1f67-9b68-4ce7-9670-a756921358b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:39.715138 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 653/1303] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Feb 19 20:38:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:38:39.720729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:38:39.730737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a63db-86c4-4f27-82f5-7099468a4a95 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:38:39.735265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ca791-d214-498b-871d-5562eb6dd876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:38:39.735894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ca791-d214-498b-871d-5562eb6dd876 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:38:39.736163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ca791-d214-498b-871d-5562eb6dd876 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:38:39.736469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ca791-d214-498b-871d-5562eb6dd876 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:38:39.737182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ca791-d214-498b-871d-5562eb6dd876 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:38:39.738729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ca791-d214-498b-871d-5562eb6dd876 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:38:39.757235 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 651/1304] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:38:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:39:51.154434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4978c9-3537-48cf-895a-7213af694b2a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:51.155478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4978c9-3537-48cf-895a-7213af694b2a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:51.155979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4978c9-3537-48cf-895a-7213af694b2a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:51.163083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec931e-f8dc-46a6-aca8-573e379bc5b9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:51.163911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec931e-f8dc-46a6-aca8-573e379bc5b9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:51.164435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec931e-f8dc-46a6-aca8-573e379bc5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:51.168040 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 654/1305] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:39:51 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:39:51.244219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-faec931e-f8dc-46a6-aca8-573e379bc5b9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:39:51.245805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-faec931e-f8dc-46a6-aca8-573e379bc5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:51.351190 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 652/1306] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:39:51.375951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4978c9-3537-48cf-895a-7213af694b2a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:39:51.380463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5a4978c9-3537-48cf-895a-7213af694b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:51.653706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4978c9-3537-48cf-895a-7213af694b2a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:39:51.867464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ece521-c8a6-4126-8569-3812fb5d3062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:39:51.868145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece521-c8a6-4126-8569-3812fb5d3062 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:51.868443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece521-c8a6-4126-8569-3812fb5d3062 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:51.868720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece521-c8a6-4126-8569-3812fb5d3062 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:51.869446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ece521-c8a6-4126-8569-3812fb5d3062 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:39:51.871824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ece521-c8a6-4126-8569-3812fb5d3062 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:39:51.891065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 655/1307] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:39:51 2022] GET /identity/v3/projects => generated 2553 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:39:54.312206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eb9c-613a-4003-a23a-701385e2381e None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:54.312782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eb9c-613a-4003-a23a-701385e2381e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:54.312782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eb9c-613a-4003-a23a-701385e2381e None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:54.314601 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 653/1308] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:39:54.320100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed482-4d12-4591-9e82-b54e643b7afd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:54.321247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed482-4d12-4591-9e82-b54e643b7afd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:54.321536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed482-4d12-4591-9e82-b54e643b7afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:54.404668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-23aed482-4d12-4591-9e82-b54e643b7afd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:39:54.406167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-23aed482-4d12-4591-9e82-b54e643b7afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:54.502277 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 656/1309] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:39:54.555230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bbd0b-2262-4098-86d4-cac489be9c26 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:54.555611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bbd0b-2262-4098-86d4-cac489be9c26 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:54.555810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bbd0b-2262-4098-86d4-cac489be9c26 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:54.557613 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 654/1310] 10.222.0.30 () {54 vars in 964 bytes} [Sat Feb 19 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:39:54.563686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc45d-72eb-44cb-98e4-4217c7da7dc4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:54.563994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc45d-72eb-44cb-98e4-4217c7da7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:54.564283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc45d-72eb-44cb-98e4-4217c7da7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:54.641301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ecdfc45d-72eb-44cb-98e4-4217c7da7dc4 None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:39:54.642499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ecdfc45d-72eb-44cb-98e4-4217c7da7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:54.715306 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 657/1311] 10.222.0.30 () {58 vars in 1061 bytes} [Sat Feb 19 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:39:54.724549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bbd0b-2262-4098-86d4-cac489be9c26 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:39:54.726061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-548bbd0b-2262-4098-86d4-cac489be9c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:54.824988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bbd0b-2262-4098-86d4-cac489be9c26 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:39:54.895851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08efde3-9d05-4932-b9cf-9fc33a6cc72b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:39:54.896518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08efde3-9d05-4932-b9cf-9fc33a6cc72b service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:54.896799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08efde3-9d05-4932-b9cf-9fc33a6cc72b service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:54.897070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08efde3-9d05-4932-b9cf-9fc33a6cc72b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:54.898718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b08efde3-9d05-4932-b9cf-9fc33a6cc72b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:55.002539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08efde3-9d05-4932-b9cf-9fc33a6cc72b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:39:55.003966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08efde3-9d05-4932-b9cf-9fc33a6cc72b service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:39:55.021404 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 655/1312] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:39:57.710496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733f23-b7c6-4a59-a74e-c1a15db14445 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:57.711062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733f23-b7c6-4a59-a74e-c1a15db14445 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:57.711062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733f23-b7c6-4a59-a74e-c1a15db14445 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:57.712960 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 658/1313] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:39:57.719333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429584-2e6e-464b-a648-87549a233480 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:57.719872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429584-2e6e-464b-a648-87549a233480 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:57.719872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429584-2e6e-464b-a648-87549a233480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:57.784249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-aa429584-2e6e-464b-a648-87549a233480 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:39:57.785504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aa429584-2e6e-464b-a648-87549a233480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:57.878577 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 656/1314] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:39:57.918832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f733f23-b7c6-4a59-a74e-c1a15db14445 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:39:57.920353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f733f23-b7c6-4a59-a74e-c1a15db14445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:58.022552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f733f23-b7c6-4a59-a74e-c1a15db14445 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:39:58.094158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab1a0c-0aa6-4c54-91df-7d3649e1966f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:39:58.094800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab1a0c-0aa6-4c54-91df-7d3649e1966f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:39:58.095102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab1a0c-0aa6-4c54-91df-7d3649e1966f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:39:58.095368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab1a0c-0aa6-4c54-91df-7d3649e1966f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:39:58.097048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5dab1a0c-0aa6-4c54-91df-7d3649e1966f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:39:58.206417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab1a0c-0aa6-4c54-91df-7d3649e1966f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:39:58.207839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab1a0c-0aa6-4c54-91df-7d3649e1966f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:39:58.225178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 659/1315] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:00.932540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4e69-182c-4b65-8e86-6968f4704e80 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:00.933136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4e69-182c-4b65-8e86-6968f4704e80 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:00.933136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4e69-182c-4b65-8e86-6968f4704e80 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:00.935496 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 657/1316] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:00.940562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a020-1ec7-480f-9387-10afd880c5be None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:00.940966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a020-1ec7-480f-9387-10afd880c5be None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:00.941104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a020-1ec7-480f-9387-10afd880c5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:01.003071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fb21a020-1ec7-480f-9387-10afd880c5be None None] MFA Rules not processed for user `448ba5fdb5894afc8dd742016d40b4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:01.004207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fb21a020-1ec7-480f-9387-10afd880c5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:01.096557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 660/1317] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:40:01.154573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b87d7-ce2c-4f41-9a0e-9512d3c74bcd None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:01.154853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b87d7-ce2c-4f41-9a0e-9512d3c74bcd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:01.155127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b87d7-ce2c-4f41-9a0e-9512d3c74bcd None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:01.156985 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 658/1318] 10.222.0.30 () {54 vars in 964 bytes} [Sat Feb 19 20:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:01.163000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa8e9-8d4a-4ca7-a6db-9716f0f313ab None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:01.163349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa8e9-8d4a-4ca7-a6db-9716f0f313ab None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:01.163627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa8e9-8d4a-4ca7-a6db-9716f0f313ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:01.238712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-545fa8e9-8d4a-4ca7-a6db-9716f0f313ab None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:01.239893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-545fa8e9-8d4a-4ca7-a6db-9716f0f313ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:01.311144 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 661/1319] 10.222.0.30 () {58 vars in 1061 bytes} [Sat Feb 19 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:01.320130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b87d7-ce2c-4f41-9a0e-9512d3c74bcd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:01.321689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f28b87d7-ce2c-4f41-9a0e-9512d3c74bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:01.420833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b87d7-ce2c-4f41-9a0e-9512d3c74bcd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:01.489024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966c063-c4f8-46a8-a1b2-b435205a84ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:01.489651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c063-c4f8-46a8-a1b2-b435205a84ba service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:01.489929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c063-c4f8-46a8-a1b2-b435205a84ba service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:01.490200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c063-c4f8-46a8-a1b2-b435205a84ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:01.491826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3966c063-c4f8-46a8-a1b2-b435205a84ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:01.591932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966c063-c4f8-46a8-a1b2-b435205a84ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:01.593340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966c063-c4f8-46a8-a1b2-b435205a84ba service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:01.611012 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 659/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:04.879146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb368-7a59-42f5-88fd-cfdc4c8a13bf None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:04.879673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb368-7a59-42f5-88fd-cfdc4c8a13bf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:04.879673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb368-7a59-42f5-88fd-cfdc4c8a13bf None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:04.881501 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 662/1321] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:04.886641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec7745-41d7-48d0-b835-44c0ba5bea23 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:04.887062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec7745-41d7-48d0-b835-44c0ba5bea23 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:04.887157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec7745-41d7-48d0-b835-44c0ba5bea23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:04.949961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dcec7745-41d7-48d0-b835-44c0ba5bea23 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:04.951088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dcec7745-41d7-48d0-b835-44c0ba5bea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:05.043516 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 660/1322] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:05.082948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb368-7a59-42f5-88fd-cfdc4c8a13bf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:05.084484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-749cb368-7a59-42f5-88fd-cfdc4c8a13bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:05.182243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb368-7a59-42f5-88fd-cfdc4c8a13bf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:05.254099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba8af9-36b9-4fe4-b9f8-95af06f9bb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:05.254677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba8af9-36b9-4fe4-b9f8-95af06f9bb49 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:05.254979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba8af9-36b9-4fe4-b9f8-95af06f9bb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:05.255247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba8af9-36b9-4fe4-b9f8-95af06f9bb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:05.256879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-04ba8af9-36b9-4fe4-b9f8-95af06f9bb49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:05.359028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba8af9-36b9-4fe4-b9f8-95af06f9bb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:05.360472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba8af9-36b9-4fe4-b9f8-95af06f9bb49 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:05.377572 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 663/1323] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:08.390209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bcdf4-17f8-4781-bd56-fa8cba0fb522 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:08.390772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bcdf4-17f8-4781-bd56-fa8cba0fb522 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:08.390772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bcdf4-17f8-4781-bd56-fa8cba0fb522 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:08.392655 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 661/1324] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:08.398032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aea4-d04c-4a2d-af79-0815444fa401 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:08.398461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aea4-d04c-4a2d-af79-0815444fa401 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:08.398715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aea4-d04c-4a2d-af79-0815444fa401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:08.463865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c840aea4-d04c-4a2d-af79-0815444fa401 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:08.465124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c840aea4-d04c-4a2d-af79-0815444fa401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:08.559577 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 664/1325] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:08.596070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bcdf4-17f8-4781-bd56-fa8cba0fb522 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:08.597673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-103bcdf4-17f8-4781-bd56-fa8cba0fb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:08.698195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bcdf4-17f8-4781-bd56-fa8cba0fb522 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:08.770266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c11090-5e1b-4133-90d1-05e1d023e33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:08.770881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11090-5e1b-4133-90d1-05e1d023e33e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:08.771160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11090-5e1b-4133-90d1-05e1d023e33e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:08.771436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11090-5e1b-4133-90d1-05e1d023e33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:08.773178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d3c11090-5e1b-4133-90d1-05e1d023e33e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:08.878431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c11090-5e1b-4133-90d1-05e1d023e33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:08.879859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c11090-5e1b-4133-90d1-05e1d023e33e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:08.897241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 662/1326] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:11.356010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902d67-b8f5-40ec-a258-bfbf5fdbf8d5 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:11.356535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902d67-b8f5-40ec-a258-bfbf5fdbf8d5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:11.356535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902d67-b8f5-40ec-a258-bfbf5fdbf8d5 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:11.358316 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 665/1327] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:11.363712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f605291-235c-4e2f-b064-dc4d049b54df None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:11.364161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f605291-235c-4e2f-b064-dc4d049b54df None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:11.364411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f605291-235c-4e2f-b064-dc4d049b54df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:11.428616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3f605291-235c-4e2f-b064-dc4d049b54df None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:11.429929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3f605291-235c-4e2f-b064-dc4d049b54df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:11.522903 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 663/1328] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:11.560106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc902d67-b8f5-40ec-a258-bfbf5fdbf8d5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:11.561704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bc902d67-b8f5-40ec-a258-bfbf5fdbf8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:11.659000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc902d67-b8f5-40ec-a258-bfbf5fdbf8d5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:11.732692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426aa7-246f-4b95-9e28-80ad7060f011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:11.733345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426aa7-246f-4b95-9e28-80ad7060f011 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:11.733628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426aa7-246f-4b95-9e28-80ad7060f011 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:11.733905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426aa7-246f-4b95-9e28-80ad7060f011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:11.735537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-61426aa7-246f-4b95-9e28-80ad7060f011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:11.849249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426aa7-246f-4b95-9e28-80ad7060f011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:11.850635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426aa7-246f-4b95-9e28-80ad7060f011 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:11.868828 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 666/1329] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:14.292152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9313b4-eab0-4531-a9d4-1483d93cb815 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:14.292742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9313b4-eab0-4531-a9d4-1483d93cb815 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:14.292742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9313b4-eab0-4531-a9d4-1483d93cb815 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:14.294801 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 664/1330] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:14.299888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19435-44d1-402c-a202-c5761b6bf989 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:14.300294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19435-44d1-402c-a202-c5761b6bf989 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:14.300480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19435-44d1-402c-a202-c5761b6bf989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:14.366897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-00a19435-44d1-402c-a202-c5761b6bf989 None None] MFA Rules not processed for user `448ba5fdb5894afc8dd742016d40b4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:14.368124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00a19435-44d1-402c-a202-c5761b6bf989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:14.464537 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 667/1331] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:14.503597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9313b4-eab0-4531-a9d4-1483d93cb815 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:14.505160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6b9313b4-eab0-4531-a9d4-1483d93cb815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:14.604676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9313b4-eab0-4531-a9d4-1483d93cb815 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:14.674057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15035e-c1cd-428f-b324-e9b683861dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:14.674688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15035e-c1cd-428f-b324-e9b683861dda service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:14.674963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15035e-c1cd-428f-b324-e9b683861dda service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:14.675232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15035e-c1cd-428f-b324-e9b683861dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:14.676891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0c15035e-c1cd-428f-b324-e9b683861dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:14.782565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15035e-c1cd-428f-b324-e9b683861dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:14.783990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15035e-c1cd-428f-b324-e9b683861dda service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:14.801929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 665/1332] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:17.409638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3c86a-da18-410f-9036-9c7a765d55ca None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:17.410111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3c86a-da18-410f-9036-9c7a765d55ca None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:17.410111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3c86a-da18-410f-9036-9c7a765d55ca None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:17.412027 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 668/1333] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:40:17.417231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c9b2-518c-4fbd-904a-3ef192c691d2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:17.418182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c9b2-518c-4fbd-904a-3ef192c691d2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:17.418284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c9b2-518c-4fbd-904a-3ef192c691d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:17.482412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-79d9c9b2-518c-4fbd-904a-3ef192c691d2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:17.483616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-79d9c9b2-518c-4fbd-904a-3ef192c691d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:17.578469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 666/1334] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:17.615329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3c86a-da18-410f-9036-9c7a765d55ca None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:17.616908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-27d3c86a-da18-410f-9036-9c7a765d55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:17.717747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3c86a-da18-410f-9036-9c7a765d55ca None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:17.794472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831af52-3a5e-42e8-a6d3-769ba7c011b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:17.795118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831af52-3a5e-42e8-a6d3-769ba7c011b7 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:17.795395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831af52-3a5e-42e8-a6d3-769ba7c011b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:17.795666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831af52-3a5e-42e8-a6d3-769ba7c011b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:17.797329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a831af52-3a5e-42e8-a6d3-769ba7c011b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:17.908686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831af52-3a5e-42e8-a6d3-769ba7c011b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:17.910124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831af52-3a5e-42e8-a6d3-769ba7c011b7 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:17.929144 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 669/1335] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:20.327965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bff1a-3164-4d1b-8769-76cc811be058 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:20.328489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bff1a-3164-4d1b-8769-76cc811be058 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:20.328598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bff1a-3164-4d1b-8769-76cc811be058 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:20.330379 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 667/1336] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:20.335574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df44ee-50ea-4891-ab5e-9f9869476689 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:20.335997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df44ee-50ea-4891-ab5e-9f9869476689 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:20.336135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df44ee-50ea-4891-ab5e-9f9869476689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:20.399312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b7df44ee-50ea-4891-ab5e-9f9869476689 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:20.400535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b7df44ee-50ea-4891-ab5e-9f9869476689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:20.491719 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 670/1337] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:20.534496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bff1a-3164-4d1b-8769-76cc811be058 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:20.535943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b39bff1a-3164-4d1b-8769-76cc811be058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:20.633637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bff1a-3164-4d1b-8769-76cc811be058 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:20.702980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87c55-960e-4d70-aef7-f083048698e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:20.703615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87c55-960e-4d70-aef7-f083048698e8 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:20.703893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87c55-960e-4d70-aef7-f083048698e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:20.704166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87c55-960e-4d70-aef7-f083048698e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:20.705809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d7d87c55-960e-4d70-aef7-f083048698e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:20.812176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d87c55-960e-4d70-aef7-f083048698e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:20.813572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d87c55-960e-4d70-aef7-f083048698e8 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:20.831407 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 668/1338] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:23.518684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1407-3c12-4c53-85de-813c0d84c3fd None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:23.519223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1407-3c12-4c53-85de-813c0d84c3fd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:23.519223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1407-3c12-4c53-85de-813c0d84c3fd None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:23.521030 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 671/1339] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:23.526174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113a464-59b7-4b42-b3a6-ffded99c5bc1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:23.526575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113a464-59b7-4b42-b3a6-ffded99c5bc1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:23.526716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113a464-59b7-4b42-b3a6-ffded99c5bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:23.602321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a113a464-59b7-4b42-b3a6-ffded99c5bc1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:23.603535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a113a464-59b7-4b42-b3a6-ffded99c5bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:23.703365 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 669/1340] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:23.741508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1407-3c12-4c53-85de-813c0d84c3fd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:23.743810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ae6d1407-3c12-4c53-85de-813c0d84c3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:23.835758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1407-3c12-4c53-85de-813c0d84c3fd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:23.839221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e994a0-2065-442e-9c2d-fd8314d72d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:23.840369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e994a0-2065-442e-9c2d-fd8314d72d8c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:23.840652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e994a0-2065-442e-9c2d-fd8314d72d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:23.840926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e994a0-2065-442e-9c2d-fd8314d72d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:23.849816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e994a0-2065-442e-9c2d-fd8314d72d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:23.851235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e994a0-2065-442e-9c2d-fd8314d72d8c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:23.860953 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 672/1341] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:28.169705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8be25-6938-4206-898c-3ca48af21ba2 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:28.170204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8be25-6938-4206-898c-3ca48af21ba2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:28.170204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8be25-6938-4206-898c-3ca48af21ba2 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:28.171975 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 670/1342] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:28.177053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979e02-4948-4ea6-94b5-644745709f76 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:28.177483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979e02-4948-4ea6-94b5-644745709f76 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:28.177608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979e02-4948-4ea6-94b5-644745709f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:28.206668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-25979e02-4948-4ea6-94b5-644745709f76 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:28.208175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-25979e02-4948-4ea6-94b5-644745709f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:28.282700 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 673/1343] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:28.322824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8be25-6938-4206-898c-3ca48af21ba2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:28.334197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8be25-6938-4206-898c-3ca48af21ba2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:28.337867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e87f1-182d-4942-bca9-233dee20bf78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:28.338490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e87f1-182d-4942-bca9-233dee20bf78 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:28.338769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e87f1-182d-4942-bca9-233dee20bf78 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:28.339040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e87f1-182d-4942-bca9-233dee20bf78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:28.348291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e87f1-182d-4942-bca9-233dee20bf78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:28.349915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e87f1-182d-4942-bca9-233dee20bf78 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:28.359620 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 671/1344] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:40:31.287707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1955af-efa0-4b78-89f0-58799cf173a9 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:31.288287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1955af-efa0-4b78-89f0-58799cf173a9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:31.288287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1955af-efa0-4b78-89f0-58799cf173a9 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:31.290226 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 674/1345] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:31.296861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf510ef-85f5-466e-8e7e-37d6a1b7cdf8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:31.297333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf510ef-85f5-466e-8e7e-37d6a1b7cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:31.297447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf510ef-85f5-466e-8e7e-37d6a1b7cdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:31.314651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7bf510ef-85f5-466e-8e7e-37d6a1b7cdf8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:31.315819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7bf510ef-85f5-466e-8e7e-37d6a1b7cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:31.323511 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 672/1346] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:31.362494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1955af-efa0-4b78-89f0-58799cf173a9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:31.373073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1955af-efa0-4b78-89f0-58799cf173a9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:31.376620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5da5b6-d5fc-406e-92d2-32a8546cce63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:31.377250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da5b6-d5fc-406e-92d2-32a8546cce63 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:31.377531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da5b6-d5fc-406e-92d2-32a8546cce63 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:31.377807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da5b6-d5fc-406e-92d2-32a8546cce63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:31.386585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5da5b6-d5fc-406e-92d2-32a8546cce63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:31.387997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5da5b6-d5fc-406e-92d2-32a8546cce63 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:31.397570 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 675/1347] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:35.835806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687937-96ec-4e8c-ab0f-7f9a0490d330 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:35.836637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687937-96ec-4e8c-ab0f-7f9a0490d330 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:35.836917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687937-96ec-4e8c-ab0f-7f9a0490d330 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:35.838728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 673/1348] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:35.844111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600f62-78e6-4864-babb-b540d2411434 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:35.844590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600f62-78e6-4864-babb-b540d2411434 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:35.844694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600f62-78e6-4864-babb-b540d2411434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:35.862527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-86600f62-78e6-4864-babb-b540d2411434 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:35.863705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-86600f62-78e6-4864-babb-b540d2411434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:35.871946 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 676/1349] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:35.912622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687937-96ec-4e8c-ab0f-7f9a0490d330 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:35.923530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687937-96ec-4e8c-ab0f-7f9a0490d330 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:35.927076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cf14a-90b2-41f4-864c-156775f12e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:35.927700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf14a-90b2-41f4-864c-156775f12e18 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:35.927976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf14a-90b2-41f4-864c-156775f12e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:35.928245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf14a-90b2-41f4-864c-156775f12e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:35.937569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cf14a-90b2-41f4-864c-156775f12e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:35.938978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cf14a-90b2-41f4-864c-156775f12e18 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:35.948241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 674/1350] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:41.357476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c71c39-0908-48fd-b938-4cbd311f48c7 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:41.358327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c71c39-0908-48fd-b938-4cbd311f48c7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:41.358756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c71c39-0908-48fd-b938-4cbd311f48c7 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:41.360791 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 677/1351] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:41.366257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2193-e92b-4597-8e57-a418e6768e35 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:41.367115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2193-e92b-4597-8e57-a418e6768e35 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:41.367539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c2193-e92b-4597-8e57-a418e6768e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:41.503916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-633c2193-e92b-4597-8e57-a418e6768e35 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:41.505363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-633c2193-e92b-4597-8e57-a418e6768e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:41.587676 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 675/1352] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:40:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:45.953022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759f5ef-8a66-4c35-aff8-7bddb0a36c5b None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:45.954277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759f5ef-8a66-4c35-aff8-7bddb0a36c5b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:45.954687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759f5ef-8a66-4c35-aff8-7bddb0a36c5b None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:45.957033 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 678/1353] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:40:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:45.962956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f47aa-607f-4cff-b01c-7e4d26bc3897 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:45.963502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f47aa-607f-4cff-b01c-7e4d26bc3897 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:45.963585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f47aa-607f-4cff-b01c-7e4d26bc3897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:45.983821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4a2f47aa-607f-4cff-b01c-7e4d26bc3897 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:45.985251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4a2f47aa-607f-4cff-b01c-7e4d26bc3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:45.995219 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 676/1354] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:40:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:47.524615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7dc6-bb04-48e6-ba88-dab52f44734a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:47.525176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7dc6-bb04-48e6-ba88-dab52f44734a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:47.525176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7dc6-bb04-48e6-ba88-dab52f44734a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:47.527503 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 679/1355] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:40:47.532524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c05d5-b2a0-4c7b-b0c7-3ba7bdedcf8d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:47.532905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c05d5-b2a0-4c7b-b0c7-3ba7bdedcf8d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:47.533265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c05d5-b2a0-4c7b-b0c7-3ba7bdedcf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:47.551531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cc1c05d5-b2a0-4c7b-b0c7-3ba7bdedcf8d None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:47.552775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc1c05d5-b2a0-4c7b-b0c7-3ba7bdedcf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:47.561631 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 677/1356] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:40:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:40:51.454902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3e7e2-ac64-4a88-9a5d-645a3b5714bc None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:51.455887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3e7e2-ac64-4a88-9a5d-645a3b5714bc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:51.456414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3e7e2-ac64-4a88-9a5d-645a3b5714bc None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:51.462567 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 680/1357] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:51.463950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dba8e-0956-4416-ac0a-fa825d60081f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:51.464942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dba8e-0956-4416-ac0a-fa825d60081f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:51.465154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dba8e-0956-4416-ac0a-fa825d60081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:51.483706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3b5dba8e-0956-4416-ac0a-fa825d60081f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:51.485287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3b5dba8e-0956-4416-ac0a-fa825d60081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:51.496574 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 678/1358] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:40:51.543757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648730-d2ab-4d5c-811c-7abf52146620 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:51.544297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648730-d2ab-4d5c-811c-7abf52146620 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:51.544989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648730-d2ab-4d5c-811c-7abf52146620 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:51.546930 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 681/1359] 10.222.0.30 () {54 vars in 961 bytes} [Sat Feb 19 20:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:51.552739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0b5f-0102-4fe3-9444-12b6b225e26a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:51.553031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0b5f-0102-4fe3-9444-12b6b225e26a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:51.553313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0b5f-0102-4fe3-9444-12b6b225e26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:51.618657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-acdb0b5f-0102-4fe3-9444-12b6b225e26a None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:51.619584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-acdb0b5f-0102-4fe3-9444-12b6b225e26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:51.702951 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 679/1360] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Feb 19 20:40:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:51.710765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e648730-d2ab-4d5c-811c-7abf52146620 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:51.728814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e648730-d2ab-4d5c-811c-7abf52146620 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:51.736823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998fe5c-99ae-4bb6-b2b1-2e840afe4d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:51.737768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fe5c-99ae-4bb6-b2b1-2e840afe4d20 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:51.738279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fe5c-99ae-4bb6-b2b1-2e840afe4d20 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:51.738749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fe5c-99ae-4bb6-b2b1-2e840afe4d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:51.748824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998fe5c-99ae-4bb6-b2b1-2e840afe4d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:51.750583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998fe5c-99ae-4bb6-b2b1-2e840afe4d20 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:51.763611 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 682/1361] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:40:54.378240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b51ce-4ae4-4232-98af-3d8f2f22695e None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:54.378804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b51ce-4ae4-4232-98af-3d8f2f22695e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:54.378804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b51ce-4ae4-4232-98af-3d8f2f22695e None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:54.380774 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 680/1362] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:54.386153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21837-8f17-4fa3-8467-25789691b80f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:54.386780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21837-8f17-4fa3-8467-25789691b80f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:54.387159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21837-8f17-4fa3-8467-25789691b80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:54.408029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f0e21837-8f17-4fa3-8467-25789691b80f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:54.409253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f0e21837-8f17-4fa3-8467-25789691b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:54.417755 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 683/1363] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:54.464168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b51ce-4ae4-4232-98af-3d8f2f22695e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:54.479125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b51ce-4ae4-4232-98af-3d8f2f22695e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:54.485666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9c2de-418e-4fd4-ba46-7b652028ee5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:54.486534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9c2de-418e-4fd4-ba46-7b652028ee5c service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:54.487012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9c2de-418e-4fd4-ba46-7b652028ee5c service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:54.487503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9c2de-418e-4fd4-ba46-7b652028ee5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:54.496760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9c2de-418e-4fd4-ba46-7b652028ee5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:54.498568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9c2de-418e-4fd4-ba46-7b652028ee5c service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:54.509222 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 681/1364] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:57.217837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ee60c-f857-4f06-9282-7edca75eaac4 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:57.218299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ee60c-f857-4f06-9282-7edca75eaac4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:57.218392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ee60c-f857-4f06-9282-7edca75eaac4 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:57.220179 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 684/1365] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:57.225454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36dd6a-95e1-466d-8cc7-c4c00e2b02f8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:57.225892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36dd6a-95e1-466d-8cc7-c4c00e2b02f8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:57.225982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36dd6a-95e1-466d-8cc7-c4c00e2b02f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:57.244313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2a36dd6a-95e1-466d-8cc7-c4c00e2b02f8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:57.246268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a36dd6a-95e1-466d-8cc7-c4c00e2b02f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:57.254115 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 682/1366] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:40:57.301883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964ec2-e0a1-42d0-9903-6d1f989827dd None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:57.302165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964ec2-e0a1-42d0-9903-6d1f989827dd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:57.302440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964ec2-e0a1-42d0-9903-6d1f989827dd None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:57.304268 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 685/1367] 10.222.0.30 () {54 vars in 961 bytes} [Sat Feb 19 20:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:57.310283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9bac-f188-4626-b18f-86b2540cfec6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:57.310564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9bac-f188-4626-b18f-86b2540cfec6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:57.310837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9bac-f188-4626-b18f-86b2540cfec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:57.328739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-676b9bac-f188-4626-b18f-86b2540cfec6 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:57.329922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-676b9bac-f188-4626-b18f-86b2540cfec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:57.339040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 683/1368] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Feb 19 20:40:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:40:57.346535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1964ec2-e0a1-42d0-9903-6d1f989827dd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:40:57.365798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1964ec2-e0a1-42d0-9903-6d1f989827dd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:40:57.375280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1517f-9a86-444c-bd19-5d81801c7d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:40:57.375938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1517f-9a86-444c-bd19-5d81801c7d13 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:57.377355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1517f-9a86-444c-bd19-5d81801c7d13 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:57.378063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1517f-9a86-444c-bd19-5d81801c7d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:57.394780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1517f-9a86-444c-bd19-5d81801c7d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:40:57.396390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1517f-9a86-444c-bd19-5d81801c7d13 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:40:57.406552 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 686/1369] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:40:59.877234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9963-8e20-4dac-9e01-c00d036476b3 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:59.878454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9963-8e20-4dac-9e01-c00d036476b3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:59.878983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9963-8e20-4dac-9e01-c00d036476b3 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:59.882009 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 684/1370] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:40:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:40:59.888317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78db88-5c83-42df-a385-24f39c482017 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:40:59.889307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78db88-5c83-42df-a385-24f39c482017 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:40:59.889794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78db88-5c83-42df-a385-24f39c482017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:40:59.912844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4d78db88-5c83-42df-a385-24f39c482017 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:40:59.914490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4d78db88-5c83-42df-a385-24f39c482017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:40:59.925251 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 687/1371] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:40:59.995411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b9963-8e20-4dac-9e01-c00d036476b3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:00.012130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b9963-8e20-4dac-9e01-c00d036476b3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:00.018894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e6755-f079-4959-8c46-63b040eef058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:00.020120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6755-f079-4959-8c46-63b040eef058 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:00.020659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6755-f079-4959-8c46-63b040eef058 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:00.021149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6755-f079-4959-8c46-63b040eef058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:00.032103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e6755-f079-4959-8c46-63b040eef058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:00.034099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e6755-f079-4959-8c46-63b040eef058 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:00.056694 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 685/1372] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:02.786118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01096ce-6a89-4c27-bfea-50c0d4f54529 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:02.787135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01096ce-6a89-4c27-bfea-50c0d4f54529 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:02.787418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01096ce-6a89-4c27-bfea-50c0d4f54529 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:02.789397 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 688/1373] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:02.795085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c057-e393-4fab-aaa7-448ff737ff3b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:02.796045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c057-e393-4fab-aaa7-448ff737ff3b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:02.796740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c057-e393-4fab-aaa7-448ff737ff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:02.817679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c6c8c057-e393-4fab-aaa7-448ff737ff3b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:02.819504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c6c8c057-e393-4fab-aaa7-448ff737ff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:02.837119 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 686/1374] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:02.888728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01096ce-6a89-4c27-bfea-50c0d4f54529 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:02.906471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01096ce-6a89-4c27-bfea-50c0d4f54529 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:02.915747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f169e-ca6f-484b-98e0-346489f50cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:02.916799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f169e-ca6f-484b-98e0-346489f50cfb service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:02.917175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f169e-ca6f-484b-98e0-346489f50cfb service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:02.917526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f169e-ca6f-484b-98e0-346489f50cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:02.928989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f169e-ca6f-484b-98e0-346489f50cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:02.931099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f169e-ca6f-484b-98e0-346489f50cfb service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:02.944450 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 689/1375] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:03.712012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6051a-ed93-4c5c-8bd4-842b94403643 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:03.712288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6051a-ed93-4c5c-8bd4-842b94403643 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:03.712772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6051a-ed93-4c5c-8bd4-842b94403643 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:03.714597 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 687/1376] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:03.720745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ec56-45b5-4434-b712-bc5742285b27 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:03.721137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ec56-45b5-4434-b712-bc5742285b27 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:03.721808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ec56-45b5-4434-b712-bc5742285b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:03.743511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6ed2ec56-45b5-4434-b712-bc5742285b27 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:03.744740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6ed2ec56-45b5-4434-b712-bc5742285b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:03.753828 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 690/1377] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:41:04.016201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571aad0-8bf5-4d07-a4bf-2288a49d74d9 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:04.016792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571aad0-8bf5-4d07-a4bf-2288a49d74d9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:04.016792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571aad0-8bf5-4d07-a4bf-2288a49d74d9 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:04.018737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 688/1378] 10.222.0.30 () {54 vars in 963 bytes} [Sat Feb 19 20:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:41:04.023760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597442f-f45c-4b98-81f1-57d211f3e2ec None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:04.024154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597442f-f45c-4b98-81f1-57d211f3e2ec None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:04.024404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597442f-f45c-4b98-81f1-57d211f3e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:04.072698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c597442f-f45c-4b98-81f1-57d211f3e2ec None None] MFA Rules not processed for user `9398233d060c43048d49d758695153a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:04.073933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c597442f-f45c-4b98-81f1-57d211f3e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:04.131815 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 691/1379] 10.222.0.30 () {58 vars in 1060 bytes} [Sat Feb 19 20:41:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:04.139557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571aad0-8bf5-4d07-a4bf-2288a49d74d9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:04.149814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571aad0-8bf5-4d07-a4bf-2288a49d74d9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:04.153307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4372949-6dd1-4a47-ab65-d4fa15de7271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:04.153934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372949-6dd1-4a47-ab65-d4fa15de7271 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:04.154207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372949-6dd1-4a47-ab65-d4fa15de7271 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:04.154670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372949-6dd1-4a47-ab65-d4fa15de7271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:04.163596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4372949-6dd1-4a47-ab65-d4fa15de7271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:04.165057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4372949-6dd1-4a47-ab65-d4fa15de7271 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:04.175308 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 689/1380] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:05.513905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170176f-7143-48a1-8a3e-51c6a3bf198f None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:05.514818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170176f-7143-48a1-8a3e-51c6a3bf198f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:05.514818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170176f-7143-48a1-8a3e-51c6a3bf198f None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:05.524077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120cecc-16d7-4145-b2dc-3ac15c4fddab None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:05.524623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120cecc-16d7-4145-b2dc-3ac15c4fddab None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:05.524720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120cecc-16d7-4145-b2dc-3ac15c4fddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:05.527715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 692/1381] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:05.547785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7120cecc-16d7-4145-b2dc-3ac15c4fddab None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:05.550060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7120cecc-16d7-4145-b2dc-3ac15c4fddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:05.562851 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 690/1382] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:05.617111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170176f-7143-48a1-8a3e-51c6a3bf198f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:05.640047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170176f-7143-48a1-8a3e-51c6a3bf198f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:05.650607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f793f66-8aa8-4d1d-b266-dfcbc88ef7fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:05.651536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793f66-8aa8-4d1d-b266-dfcbc88ef7fc service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:05.651989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793f66-8aa8-4d1d-b266-dfcbc88ef7fc service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:05.652277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793f66-8aa8-4d1d-b266-dfcbc88ef7fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:05.665040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f793f66-8aa8-4d1d-b266-dfcbc88ef7fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:05.667406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f793f66-8aa8-4d1d-b266-dfcbc88ef7fc service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:05.681061 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 693/1383] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:08.155171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b621-8a00-42f3-8d78-77bd3757232b None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:08.156546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b621-8a00-42f3-8d78-77bd3757232b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:08.156546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b621-8a00-42f3-8d78-77bd3757232b None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:08.157545 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 691/1384] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:08.162823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268e19-d939-43de-9563-b48f5fa98f82 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:08.163259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268e19-d939-43de-9563-b48f5fa98f82 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:08.163376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268e19-d939-43de-9563-b48f5fa98f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:08.181773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-55268e19-d939-43de-9563-b48f5fa98f82 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:08.183472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-55268e19-d939-43de-9563-b48f5fa98f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:08.191590 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 694/1385] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:08.235209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347b621-8a00-42f3-8d78-77bd3757232b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:08.251244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347b621-8a00-42f3-8d78-77bd3757232b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:08.256984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb3bf3-8ff7-401a-9998-3369fddfc816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:08.258704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3bf3-8ff7-401a-9998-3369fddfc816 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:08.258989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3bf3-8ff7-401a-9998-3369fddfc816 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:08.259355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3bf3-8ff7-401a-9998-3369fddfc816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:08.268714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb3bf3-8ff7-401a-9998-3369fddfc816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:08.271132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb3bf3-8ff7-401a-9998-3369fddfc816 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:08.281985 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 692/1386] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:10.705669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287411-4200-45fe-a67c-af292201f43d None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:10.705669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287411-4200-45fe-a67c-af292201f43d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:10.705669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287411-4200-45fe-a67c-af292201f43d None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:10.705669 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 695/1387] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:10.709877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966fc14-1be3-407c-8ff1-387911a4c713 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:10.710337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966fc14-1be3-407c-8ff1-387911a4c713 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:10.710425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966fc14-1be3-407c-8ff1-387911a4c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:10.728954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6966fc14-1be3-407c-8ff1-387911a4c713 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:10.730557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6966fc14-1be3-407c-8ff1-387911a4c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:10.738758 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 693/1388] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:10.786180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287411-4200-45fe-a67c-af292201f43d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:10.801336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287411-4200-45fe-a67c-af292201f43d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:10.806710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa8944-117f-4b75-a926-bcb4f4a236b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:10.807343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8944-117f-4b75-a926-bcb4f4a236b1 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:10.807653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8944-117f-4b75-a926-bcb4f4a236b1 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:10.807921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8944-117f-4b75-a926-bcb4f4a236b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:10.816534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa8944-117f-4b75-a926-bcb4f4a236b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:10.818079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa8944-117f-4b75-a926-bcb4f4a236b1 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:10.827967 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 696/1389] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:13.846023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93defba3-432b-456d-a6d0-dd437957eb57 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:13.846646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93defba3-432b-456d-a6d0-dd437957eb57 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:13.846792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93defba3-432b-456d-a6d0-dd437957eb57 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:13.849110 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 694/1390] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:13.855347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba378-5bb6-4c35-82af-72a13d9f81d0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:13.855797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba378-5bb6-4c35-82af-72a13d9f81d0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:13.855897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba378-5bb6-4c35-82af-72a13d9f81d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:13.880236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d20ba378-5bb6-4c35-82af-72a13d9f81d0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:13.881461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d20ba378-5bb6-4c35-82af-72a13d9f81d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:13.889909 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 697/1391] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:13.946580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93defba3-432b-456d-a6d0-dd437957eb57 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:13.961798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93defba3-432b-456d-a6d0-dd437957eb57 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:13.968697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa440c4-90ec-4380-bc41-16ba9bd06fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:13.969377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa440c4-90ec-4380-bc41-16ba9bd06fc6 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:13.969661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa440c4-90ec-4380-bc41-16ba9bd06fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:13.969944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa440c4-90ec-4380-bc41-16ba9bd06fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:13.978581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa440c4-90ec-4380-bc41-16ba9bd06fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:13.980127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa440c4-90ec-4380-bc41-16ba9bd06fc6 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:13.989621 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 695/1392] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:16.511554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7805fb5-1a59-479e-8016-bbf91e07b423 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:16.512280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7805fb5-1a59-479e-8016-bbf91e07b423 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:16.512280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7805fb5-1a59-479e-8016-bbf91e07b423 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:16.513931 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 698/1393] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:16.519071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701a93f-2a1a-4318-afe4-2ebd9549dccf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:16.519544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701a93f-2a1a-4318-afe4-2ebd9549dccf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:16.519658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701a93f-2a1a-4318-afe4-2ebd9549dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:16.538330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6701a93f-2a1a-4318-afe4-2ebd9549dccf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:16.539527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6701a93f-2a1a-4318-afe4-2ebd9549dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:16.547973 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 696/1394] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:16.594705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7805fb5-1a59-479e-8016-bbf91e07b423 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:16.611340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7805fb5-1a59-479e-8016-bbf91e07b423 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:16.616819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee50d1-f072-4fad-b379-c788889c6f19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:16.617454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee50d1-f072-4fad-b379-c788889c6f19 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:16.617733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee50d1-f072-4fad-b379-c788889c6f19 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:16.618005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee50d1-f072-4fad-b379-c788889c6f19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:16.626872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee50d1-f072-4fad-b379-c788889c6f19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:16.628497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee50d1-f072-4fad-b379-c788889c6f19 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:16.638482 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 699/1395] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:19.205151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639d6e-6313-4391-b057-3b49a166ea57 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:19.205757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639d6e-6313-4391-b057-3b49a166ea57 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:19.205757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639d6e-6313-4391-b057-3b49a166ea57 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:19.207502 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 697/1396] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:19.212979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bbb7d-be11-4f43-9106-af3c7cc7c047 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:19.213424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bbb7d-be11-4f43-9106-af3c7cc7c047 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:19.214598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bbb7d-be11-4f43-9106-af3c7cc7c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:19.234806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-632bbb7d-be11-4f43-9106-af3c7cc7c047 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:19.241863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-632bbb7d-be11-4f43-9106-af3c7cc7c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:19.250263 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 700/1397] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:19.297268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a639d6e-6313-4391-b057-3b49a166ea57 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:19.311913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a639d6e-6313-4391-b057-3b49a166ea57 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:19.317358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a8cd-5032-4295-b901-9743e99996e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:19.318014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a8cd-5032-4295-b901-9743e99996e5 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:19.318291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a8cd-5032-4295-b901-9743e99996e5 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:19.318563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a8cd-5032-4295-b901-9743e99996e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:19.327235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885a8cd-5032-4295-b901-9743e99996e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:19.328840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885a8cd-5032-4295-b901-9743e99996e5 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:19.338030 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 698/1398] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:20.074012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6456e5-08a9-4f83-ac35-71dbe07741a5 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:20.074295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6456e5-08a9-4f83-ac35-71dbe07741a5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:20.074591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6456e5-08a9-4f83-ac35-71dbe07741a5 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:20.076368 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 701/1399] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:20.081689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013bae-d66f-4933-8736-ac0babf5ff19 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:20.081979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013bae-d66f-4933-8736-ac0babf5ff19 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:20.082258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80013bae-d66f-4933-8736-ac0babf5ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:20.100748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-80013bae-d66f-4933-8736-ac0babf5ff19 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:20.101944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-80013bae-d66f-4933-8736-ac0babf5ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:20.110695 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 699/1400] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:20.169600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec4db-c0be-4c83-9c6c-cf981adb3f38 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:20.169889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec4db-c0be-4c83-9c6c-cf981adb3f38 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:20.170162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec4db-c0be-4c83-9c6c-cf981adb3f38 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:20.171910 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 702/1401] 10.222.0.30 () {54 vars in 962 bytes} [Sat Feb 19 20:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:20.176876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e7868-6290-4132-8868-9d78505b0d36 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:20.177248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e7868-6290-4132-8868-9d78505b0d36 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:20.177592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e7868-6290-4132-8868-9d78505b0d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:20.226305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9e1e7868-6290-4132-8868-9d78505b0d36 None None] MFA Rules not processed for user `f02b510f78c341c29320f011ef4beaca`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:20.227761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e1e7868-6290-4132-8868-9d78505b0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:20.288478 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 700/1402] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Feb 19 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:20.297318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ec4db-c0be-4c83-9c6c-cf981adb3f38 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:20.308737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ec4db-c0be-4c83-9c6c-cf981adb3f38 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:20.312287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658ad9b-846e-4528-86f7-5e4b408197ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:20.312957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ad9b-846e-4528-86f7-5e4b408197ea service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:20.313241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ad9b-846e-4528-86f7-5e4b408197ea service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:20.313515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ad9b-846e-4528-86f7-5e4b408197ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:20.322305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658ad9b-846e-4528-86f7-5e4b408197ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:20.323761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658ad9b-846e-4528-86f7-5e4b408197ea service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:20.333135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 703/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:41:20.747601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e132e-ff6d-4190-aedc-2ab01ad1eb73 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:20.747887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e132e-ff6d-4190-aedc-2ab01ad1eb73 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:20.748191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e132e-ff6d-4190-aedc-2ab01ad1eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:20.796280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-da8e132e-ff6d-4190-aedc-2ab01ad1eb73 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:20.797580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-da8e132e-ff6d-4190-aedc-2ab01ad1eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:20.859616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 701/1404] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:20.900672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91457c04-6cda-4cb9-b555-ea61845e8418 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:20.900965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91457c04-6cda-4cb9-b555-ea61845e8418 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:20.901748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91457c04-6cda-4cb9-b555-ea61845e8418 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:20.903610 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 704/1405] 10.222.0.30 () {54 vars in 942 bytes} [Sat Feb 19 20:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:20.968247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b97f-c79d-4032-bd1c-28822d2e9e57 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:20.968559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b97f-c79d-4032-bd1c-28822d2e9e57 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:20.968833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b97f-c79d-4032-bd1c-28822d2e9e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:21.016125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e6b1b97f-c79d-4032-bd1c-28822d2e9e57 None None] MFA Rules not processed for user `4b7a16fa195446e18f5c5982a127b88e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:21.017489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e6b1b97f-c79d-4032-bd1c-28822d2e9e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:21.093370 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 702/1406] 10.222.0.30 () {58 vars in 1039 bytes} [Sat Feb 19 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:21.101900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91457c04-6cda-4cb9-b555-ea61845e8418 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:21.115149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91457c04-6cda-4cb9-b555-ea61845e8418 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:21.119901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a1c45-cf20-49ca-a526-c38da5b83aad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:21.120557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1c45-cf20-49ca-a526-c38da5b83aad service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:21.120836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1c45-cf20-49ca-a526-c38da5b83aad service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:21.121109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1c45-cf20-49ca-a526-c38da5b83aad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:21.128765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a1c45-cf20-49ca-a526-c38da5b83aad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:21.130312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a1c45-cf20-49ca-a526-c38da5b83aad service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:21.142557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 705/1407] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:41:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:41:21.772549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad551-080d-4d3d-98d8-db73707bf5c9 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:21.773776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad551-080d-4d3d-98d8-db73707bf5c9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:21.774131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad551-080d-4d3d-98d8-db73707bf5c9 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:21.776992 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 703/1408] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:41:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:21.782070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845b81-acb4-4f23-9dc4-5e43dccbe0c4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:21.782884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845b81-acb4-4f23-9dc4-5e43dccbe0c4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:21.783160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845b81-acb4-4f23-9dc4-5e43dccbe0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:21.802324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1a845b81-acb4-4f23-9dc4-5e43dccbe0c4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:21.803754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a845b81-acb4-4f23-9dc4-5e43dccbe0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:21.813335 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 706/1409] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:21.862220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad551-080d-4d3d-98d8-db73707bf5c9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:21.877034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad551-080d-4d3d-98d8-db73707bf5c9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:21.882376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cc44f-368b-48e3-8cbe-976ebd0609e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:21.883006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cc44f-368b-48e3-8cbe-976ebd0609e8 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:21.883467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cc44f-368b-48e3-8cbe-976ebd0609e8 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:21.883914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cc44f-368b-48e3-8cbe-976ebd0609e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:21.892991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cc44f-368b-48e3-8cbe-976ebd0609e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:21.894682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cc44f-368b-48e3-8cbe-976ebd0609e8 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:21.907236 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 704/1410] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:44.633869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23541-120e-4a3f-8a41-b0c74477d79b None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:44.634499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23541-120e-4a3f-8a41-b0c74477d79b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:44.634499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23541-120e-4a3f-8a41-b0c74477d79b None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:44.636719 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 707/1411] 10.222.0.30 () {54 vars in 918 bytes} [Sat Feb 19 20:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:44.641987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd96ea-f2a5-4876-b9fe-19345db04577 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:44.642467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd96ea-f2a5-4876-b9fe-19345db04577 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:44.642565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd96ea-f2a5-4876-b9fe-19345db04577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:44.660793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-88bd96ea-f2a5-4876-b9fe-19345db04577 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:44.662005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-88bd96ea-f2a5-4876-b9fe-19345db04577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:44.670558 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 705/1412] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Feb 19 20:41:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:44.684698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad2d34-2475-4a0d-8027-5229d11a5814 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:44.684981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad2d34-2475-4a0d-8027-5229d11a5814 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:44.685256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad2d34-2475-4a0d-8027-5229d11a5814 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:44.687013 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 708/1413] 10.222.0.30 () {54 vars in 918 bytes} [Sat Feb 19 20:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:44.691610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c514-35f5-473a-bb1b-8fa06361e70f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:44.691889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c514-35f5-473a-bb1b-8fa06361e70f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:44.692165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c514-35f5-473a-bb1b-8fa06361e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:44.710171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b1e8c514-35f5-473a-bb1b-8fa06361e70f None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:44.711354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b1e8c514-35f5-473a-bb1b-8fa06361e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:44.721071 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 706/1414] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Feb 19 20:41:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:47.546496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9b3c-257b-4478-8f89-ad6ff19a78d3 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:47.547057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9b3c-257b-4478-8f89-ad6ff19a78d3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:47.547057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9b3c-257b-4478-8f89-ad6ff19a78d3 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:47.548869 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 709/1415] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:47.554146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37c752-d3ac-4f59-9641-6f86221f76fb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:47.554559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37c752-d3ac-4f59-9641-6f86221f76fb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:47.554670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37c752-d3ac-4f59-9641-6f86221f76fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:47.574651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5d37c752-d3ac-4f59-9641-6f86221f76fb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:47.575896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5d37c752-d3ac-4f59-9641-6f86221f76fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:47.583796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 707/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:47.626713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac9b3c-257b-4478-8f89-ad6ff19a78d3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:47.641307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac9b3c-257b-4478-8f89-ad6ff19a78d3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:47.646652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a776f7-3b21-474a-ab36-ae9ff277dc22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:47.647279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a776f7-3b21-474a-ab36-ae9ff277dc22 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:47.647563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a776f7-3b21-474a-ab36-ae9ff277dc22 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:47.647838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a776f7-3b21-474a-ab36-ae9ff277dc22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:47.656454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a776f7-3b21-474a-ab36-ae9ff277dc22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:47.658060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a776f7-3b21-474a-ab36-ae9ff277dc22 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:47.667170 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 710/1417] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:49.128834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827207f-1a2c-4bb3-8338-15bed31049b1 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:49.129399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827207f-1a2c-4bb3-8338-15bed31049b1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:49.129399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827207f-1a2c-4bb3-8338-15bed31049b1 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:49.131182 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 708/1418] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:49.136531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32259b-7510-4778-9235-3f8e6fe18f4a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:49.136947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32259b-7510-4778-9235-3f8e6fe18f4a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:49.137083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32259b-7510-4778-9235-3f8e6fe18f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:49.155590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5a32259b-7510-4778-9235-3f8e6fe18f4a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:49.156866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5a32259b-7510-4778-9235-3f8e6fe18f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:49.164554 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 711/1419] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:49.374316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827207f-1a2c-4bb3-8338-15bed31049b1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:49.389091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827207f-1a2c-4bb3-8338-15bed31049b1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:49.394342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e992ba-7a8c-4ecc-99a3-baf9d3002595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:49.394965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e992ba-7a8c-4ecc-99a3-baf9d3002595 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:49.395245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e992ba-7a8c-4ecc-99a3-baf9d3002595 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:49.395517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e992ba-7a8c-4ecc-99a3-baf9d3002595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:49.403557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e992ba-7a8c-4ecc-99a3-baf9d3002595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:49.405194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e992ba-7a8c-4ecc-99a3-baf9d3002595 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:49.414586 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 709/1420] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:50.813770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8e2fc-2096-46fc-a407-0b4d1ba4eaba None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:50.814334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8e2fc-2096-46fc-a407-0b4d1ba4eaba None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:50.814334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8e2fc-2096-46fc-a407-0b4d1ba4eaba None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:50.816170 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 712/1421] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:50.821003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39707a2a-a93c-402c-a49c-b1a71976dd8a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:50.821457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39707a2a-a93c-402c-a49c-b1a71976dd8a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:50.821564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39707a2a-a93c-402c-a49c-b1a71976dd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:50.839906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-39707a2a-a93c-402c-a49c-b1a71976dd8a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:50.841127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-39707a2a-a93c-402c-a49c-b1a71976dd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:50.848919 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 710/1422] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:51.006281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8e2fc-2096-46fc-a407-0b4d1ba4eaba None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:51.020258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8e2fc-2096-46fc-a407-0b4d1ba4eaba None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:51.026065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43370e-7bed-44ca-a584-6df536b1b77e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:51.026687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43370e-7bed-44ca-a584-6df536b1b77e service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:51.026967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43370e-7bed-44ca-a584-6df536b1b77e service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:51.027243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43370e-7bed-44ca-a584-6df536b1b77e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:51.035045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43370e-7bed-44ca-a584-6df536b1b77e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:51.036629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43370e-7bed-44ca-a584-6df536b1b77e service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:51.046551 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 713/1423] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:52.409350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e040f-011d-45eb-aeb8-18da2733f28c None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:52.409899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e040f-011d-45eb-aeb8-18da2733f28c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:52.410007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e040f-011d-45eb-aeb8-18da2733f28c None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:52.411725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 711/1424] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:52.417435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d1e1e-fc92-412e-9e9d-3de67e763605 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:52.417874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d1e1e-fc92-412e-9e9d-3de67e763605 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:52.417984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d1e1e-fc92-412e-9e9d-3de67e763605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:52.435726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-489d1e1e-fc92-412e-9e9d-3de67e763605 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:52.436917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-489d1e1e-fc92-412e-9e9d-3de67e763605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:52.444504 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 714/1425] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:52.604393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e040f-011d-45eb-aeb8-18da2733f28c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:52.618417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e040f-011d-45eb-aeb8-18da2733f28c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:52.623778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5b397-d4bf-4db3-9c5d-8e76f04cae02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:52.624436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b397-d4bf-4db3-9c5d-8e76f04cae02 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:52.624718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b397-d4bf-4db3-9c5d-8e76f04cae02 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:52.624991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b397-d4bf-4db3-9c5d-8e76f04cae02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:52.632902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5b397-d4bf-4db3-9c5d-8e76f04cae02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:52.634734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5b397-d4bf-4db3-9c5d-8e76f04cae02 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:52.644493 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 712/1426] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:54.002752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff001b-2cbb-44a5-bee2-3aec5a9a10e3 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:54.003291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff001b-2cbb-44a5-bee2-3aec5a9a10e3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:54.003291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff001b-2cbb-44a5-bee2-3aec5a9a10e3 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:54.005029 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 715/1427] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:54.009816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c04c9-03a0-4842-8298-adf192b89e61 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:54.010239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c04c9-03a0-4842-8298-adf192b89e61 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:54.010432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c04c9-03a0-4842-8298-adf192b89e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:54.028413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-803c04c9-03a0-4842-8298-adf192b89e61 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:54.029586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-803c04c9-03a0-4842-8298-adf192b89e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:54.037193 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 713/1428] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:54.194445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff001b-2cbb-44a5-bee2-3aec5a9a10e3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:54.208725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff001b-2cbb-44a5-bee2-3aec5a9a10e3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:54.214601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e92b-9c60-43a7-9e9f-b210de85fcb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:54.215222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e92b-9c60-43a7-9e9f-b210de85fcb1 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:54.215500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e92b-9c60-43a7-9e9f-b210de85fcb1 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:54.215771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e92b-9c60-43a7-9e9f-b210de85fcb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:54.223834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242e92b-9c60-43a7-9e9f-b210de85fcb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:54.225423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242e92b-9c60-43a7-9e9f-b210de85fcb1 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:54.234531 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 716/1429] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:41:55.563043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a31c4-c90f-423a-a22c-33cb462cbc54 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:55.563621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a31c4-c90f-423a-a22c-33cb462cbc54 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:55.563621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a31c4-c90f-423a-a22c-33cb462cbc54 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:55.565443 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 714/1430] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:55.570468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102d219-440c-4dc6-8a80-a6ff0985bf30 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:55.570867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102d219-440c-4dc6-8a80-a6ff0985bf30 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:55.571018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102d219-440c-4dc6-8a80-a6ff0985bf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:55.589169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e102d219-440c-4dc6-8a80-a6ff0985bf30 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:55.590353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e102d219-440c-4dc6-8a80-a6ff0985bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:55.598102 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 717/1431] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:55.757218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a31c4-c90f-423a-a22c-33cb462cbc54 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:55.772039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a31c4-c90f-423a-a22c-33cb462cbc54 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:55.778066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361e5f5-d873-4df7-992a-4cbbfe72389e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:55.778696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361e5f5-d873-4df7-992a-4cbbfe72389e service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:55.778989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361e5f5-d873-4df7-992a-4cbbfe72389e service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:55.779255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361e5f5-d873-4df7-992a-4cbbfe72389e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:55.787202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361e5f5-d873-4df7-992a-4cbbfe72389e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:55.788783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361e5f5-d873-4df7-992a-4cbbfe72389e service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:55.799638 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 715/1432] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:57.141185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385eabe-0c6c-4341-97bb-85bc42cbb83b None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:57.142089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385eabe-0c6c-4341-97bb-85bc42cbb83b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:57.142089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385eabe-0c6c-4341-97bb-85bc42cbb83b None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:57.143998 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 718/1433] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:57.149172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec5b4-a413-4556-98f7-8d1672a46d3a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:57.149603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec5b4-a413-4556-98f7-8d1672a46d3a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:57.149716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec5b4-a413-4556-98f7-8d1672a46d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:57.168358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-765ec5b4-a413-4556-98f7-8d1672a46d3a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:57.169566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-765ec5b4-a413-4556-98f7-8d1672a46d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:57.177688 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 716/1434] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:57.337050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385eabe-0c6c-4341-97bb-85bc42cbb83b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:57.351711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385eabe-0c6c-4341-97bb-85bc42cbb83b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:57.357205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc52421-f4a5-49e0-8b2d-7152ebecd66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:57.357832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52421-f4a5-49e0-8b2d-7152ebecd66b service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:57.358119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52421-f4a5-49e0-8b2d-7152ebecd66b service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:57.358395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52421-f4a5-49e0-8b2d-7152ebecd66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:57.366417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc52421-f4a5-49e0-8b2d-7152ebecd66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:57.368044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc52421-f4a5-49e0-8b2d-7152ebecd66b service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:57.377235 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 719/1435] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:58.728304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f95ef-9def-4f17-b32b-b308e6129876 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:58.729439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f95ef-9def-4f17-b32b-b308e6129876 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:58.729439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f95ef-9def-4f17-b32b-b308e6129876 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:58.731223 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 717/1436] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:41:58.736287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695dc62-5cbc-435d-81e4-fbdb187e063e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:58.736727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695dc62-5cbc-435d-81e4-fbdb187e063e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:58.736880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695dc62-5cbc-435d-81e4-fbdb187e063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:58.758487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0695dc62-5cbc-435d-81e4-fbdb187e063e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:41:58.759690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0695dc62-5cbc-435d-81e4-fbdb187e063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:41:58.768250 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 720/1437] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:41:58.925384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f95ef-9def-4f17-b32b-b308e6129876 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:41:58.940143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f95ef-9def-4f17-b32b-b308e6129876 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:41:58.945434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb48858-a2a4-4b80-8ef4-809d5034859a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:41:58.946057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb48858-a2a4-4b80-8ef4-809d5034859a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:41:58.946336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb48858-a2a4-4b80-8ef4-809d5034859a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:41:58.946607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb48858-a2a4-4b80-8ef4-809d5034859a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:41:58.954563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb48858-a2a4-4b80-8ef4-809d5034859a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:41:58.956055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb48858-a2a4-4b80-8ef4-809d5034859a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:41:58.965259 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 718/1438] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:00.274157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d390fa-cc08-4cfe-b33f-2d549003cf44 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:00.274745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d390fa-cc08-4cfe-b33f-2d549003cf44 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:00.274745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d390fa-cc08-4cfe-b33f-2d549003cf44 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:00.276560 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 721/1439] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:00.281354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d50a5-a9cc-4f56-b170-944ad6c7edc2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:00.281764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d50a5-a9cc-4f56-b170-944ad6c7edc2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:00.281903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d50a5-a9cc-4f56-b170-944ad6c7edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:00.301051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f29d50a5-a9cc-4f56-b170-944ad6c7edc2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:00.302232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f29d50a5-a9cc-4f56-b170-944ad6c7edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:00.310524 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 719/1440] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:00.466962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d390fa-cc08-4cfe-b33f-2d549003cf44 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:00.481467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d390fa-cc08-4cfe-b33f-2d549003cf44 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:00.486911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94847b-18fb-41e2-aa79-174100c81f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:00.487536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94847b-18fb-41e2-aa79-174100c81f8e service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:00.487814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94847b-18fb-41e2-aa79-174100c81f8e service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:00.488087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94847b-18fb-41e2-aa79-174100c81f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:00.496689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94847b-18fb-41e2-aa79-174100c81f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:00.498239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94847b-18fb-41e2-aa79-174100c81f8e service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:00.507217 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 722/1441] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:02.765167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3b99-9969-410f-8876-d1bd1399263a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:02.765730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3b99-9969-410f-8876-d1bd1399263a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:02.765730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3b99-9969-410f-8876-d1bd1399263a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:02.767502 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 720/1442] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:02.772656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4508-bae4-4a32-b8aa-ed87a824991d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:02.773066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4508-bae4-4a32-b8aa-ed87a824991d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:02.773279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4508-bae4-4a32-b8aa-ed87a824991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:02.790699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e2fe4508-bae4-4a32-b8aa-ed87a824991d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:02.791919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2fe4508-bae4-4a32-b8aa-ed87a824991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:02.799825 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 723/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:02.840112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf3b99-9969-410f-8876-d1bd1399263a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:02.850292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf3b99-9969-410f-8876-d1bd1399263a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:02.853708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bd513-7fb8-4511-b7fb-3380df9202cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:02.854327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bd513-7fb8-4511-b7fb-3380df9202cd service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:02.854600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bd513-7fb8-4511-b7fb-3380df9202cd service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:02.854870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bd513-7fb8-4511-b7fb-3380df9202cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:02.863853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bd513-7fb8-4511-b7fb-3380df9202cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:02.865339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bd513-7fb8-4511-b7fb-3380df9202cd service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:02.875644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 721/1444] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:05.403061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15ccb-2a80-4f98-94c1-df2cb65bf281 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:05.403661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15ccb-2a80-4f98-94c1-df2cb65bf281 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:05.403661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15ccb-2a80-4f98-94c1-df2cb65bf281 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:05.405416 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 724/1445] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:05.410811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ebdc-907e-4920-a940-20bfc41a4fe6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:05.411240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ebdc-907e-4920-a940-20bfc41a4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:05.411365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381ebdc-907e-4920-a940-20bfc41a4fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:05.429053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c381ebdc-907e-4920-a940-20bfc41a4fe6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:05.430172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c381ebdc-907e-4920-a940-20bfc41a4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:05.437927 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 722/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:05.478098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a15ccb-2a80-4f98-94c1-df2cb65bf281 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:05.479735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-96a15ccb-2a80-4f98-94c1-df2cb65bf281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:05.492208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a15ccb-2a80-4f98-94c1-df2cb65bf281 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:05.495714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda0de-b645-4973-a230-e437377dbf93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:05.496351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda0de-b645-4973-a230-e437377dbf93 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:05.496639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda0de-b645-4973-a230-e437377dbf93 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:05.496910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda0de-b645-4973-a230-e437377dbf93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:05.505383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcda0de-b645-4973-a230-e437377dbf93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:05.506778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcda0de-b645-4973-a230-e437377dbf93 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:05.516662 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 725/1447] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:42:08.244572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498294-a6fd-4b70-bfea-20b7d693542a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:08.245149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498294-a6fd-4b70-bfea-20b7d693542a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:08.245149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498294-a6fd-4b70-bfea-20b7d693542a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:08.246943 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 723/1448] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:08.252265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151875-d0dc-4e5a-8b98-abb93db3c471 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:08.252698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151875-d0dc-4e5a-8b98-abb93db3c471 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:08.252849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151875-d0dc-4e5a-8b98-abb93db3c471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:08.271037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fe151875-d0dc-4e5a-8b98-abb93db3c471 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:08.272240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe151875-d0dc-4e5a-8b98-abb93db3c471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:08.280338 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 726/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:08.321351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498294-a6fd-4b70-bfea-20b7d693542a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:08.332172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498294-a6fd-4b70-bfea-20b7d693542a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:08.335699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e02b08-142c-4cd0-9cac-08fb600918db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:08.336347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e02b08-142c-4cd0-9cac-08fb600918db service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:08.336634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e02b08-142c-4cd0-9cac-08fb600918db service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:08.336910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e02b08-142c-4cd0-9cac-08fb600918db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:08.345507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e02b08-142c-4cd0-9cac-08fb600918db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:08.346926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e02b08-142c-4cd0-9cac-08fb600918db service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:08.356051 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 724/1450] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:42:10.853109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36f8c-5bcb-4faf-a1d6-857620351543 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:10.853685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36f8c-5bcb-4faf-a1d6-857620351543 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:10.853685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36f8c-5bcb-4faf-a1d6-857620351543 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:10.855433 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 727/1451] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:10.860695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dde9-219f-4619-ada1-2915b60e3b66 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:10.861137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dde9-219f-4619-ada1-2915b60e3b66 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:10.861234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dde9-219f-4619-ada1-2915b60e3b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:10.878672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3277dde9-219f-4619-ada1-2915b60e3b66 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:10.879863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3277dde9-219f-4619-ada1-2915b60e3b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:10.888194 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 725/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:10.929876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36f8c-5bcb-4faf-a1d6-857620351543 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:10.940310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36f8c-5bcb-4faf-a1d6-857620351543 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:10.943805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bca71-5b67-4496-ae50-f60099d78b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:10.944474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bca71-5b67-4496-ae50-f60099d78b38 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:10.944775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bca71-5b67-4496-ae50-f60099d78b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:10.945031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bca71-5b67-4496-ae50-f60099d78b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:10.954298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bca71-5b67-4496-ae50-f60099d78b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:10.955648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bca71-5b67-4496-ae50-f60099d78b38 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:10.965458 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 728/1453] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:13.465157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc097-debd-484e-bbc0-5d9a7afabc8c None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:13.465683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc097-debd-484e-bbc0-5d9a7afabc8c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:13.465683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc097-debd-484e-bbc0-5d9a7afabc8c None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:13.467371 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 726/1454] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:13.472593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d3576-b250-421c-8e12-a2567d65d7af None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:13.472984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d3576-b250-421c-8e12-a2567d65d7af None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:13.473181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d3576-b250-421c-8e12-a2567d65d7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:13.491080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f55d3576-b250-421c-8e12-a2567d65d7af None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:13.492248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f55d3576-b250-421c-8e12-a2567d65d7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:13.500392 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 729/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:13.539159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc097-debd-484e-bbc0-5d9a7afabc8c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:13.549845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc097-debd-484e-bbc0-5d9a7afabc8c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:13.553341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcd4aa-44d0-4475-a23d-d1bda55608fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:13.553962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcd4aa-44d0-4475-a23d-d1bda55608fa service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:13.554243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcd4aa-44d0-4475-a23d-d1bda55608fa service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:13.554516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcd4aa-44d0-4475-a23d-d1bda55608fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:13.563667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcd4aa-44d0-4475-a23d-d1bda55608fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:13.565124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcd4aa-44d0-4475-a23d-d1bda55608fa service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:13.574837 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 727/1456] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:16.083202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09125bd-da9d-484c-8cdb-87a1989c9a53 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:16.083846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09125bd-da9d-484c-8cdb-87a1989c9a53 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:16.083846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09125bd-da9d-484c-8cdb-87a1989c9a53 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:16.085581 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 730/1457] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:16.091089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f53e2-1cb6-4705-9c97-c4c02575be6e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:16.091525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f53e2-1cb6-4705-9c97-c4c02575be6e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:16.091623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f53e2-1cb6-4705-9c97-c4c02575be6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:16.111429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f45f53e2-1cb6-4705-9c97-c4c02575be6e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:16.112656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f45f53e2-1cb6-4705-9c97-c4c02575be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:16.121136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 728/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:16.159271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09125bd-da9d-484c-8cdb-87a1989c9a53 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:16.171369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09125bd-da9d-484c-8cdb-87a1989c9a53 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:16.174915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62677325-8b1c-4811-9577-1a7c6a2d3b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:16.175542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62677325-8b1c-4811-9577-1a7c6a2d3b2b service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:16.175825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62677325-8b1c-4811-9577-1a7c6a2d3b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:16.176102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62677325-8b1c-4811-9577-1a7c6a2d3b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:16.185445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62677325-8b1c-4811-9577-1a7c6a2d3b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:16.186853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62677325-8b1c-4811-9577-1a7c6a2d3b2b service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:16.196004 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 731/1459] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:18.660670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6051b-a483-4ee2-9765-2be2d2d3d28d None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:18.661275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6051b-a483-4ee2-9765-2be2d2d3d28d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:18.661275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6051b-a483-4ee2-9765-2be2d2d3d28d None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:18.662990 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 729/1460] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:18.668172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb6d8-a223-4b42-9209-11b48210a3e2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:18.668644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb6d8-a223-4b42-9209-11b48210a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:18.668781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb6d8-a223-4b42-9209-11b48210a3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:18.687400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1a1eb6d8-a223-4b42-9209-11b48210a3e2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:18.688605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a1eb6d8-a223-4b42-9209-11b48210a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:18.696239 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 732/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:18.735421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6051b-a483-4ee2-9765-2be2d2d3d28d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:18.746301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6051b-a483-4ee2-9765-2be2d2d3d28d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:18.749731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa0f6f-96ae-4d45-b1e8-5ab31e423ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:18.750357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa0f6f-96ae-4d45-b1e8-5ab31e423ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:18.750630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa0f6f-96ae-4d45-b1e8-5ab31e423ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:18.750899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa0f6f-96ae-4d45-b1e8-5ab31e423ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:18.759387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa0f6f-96ae-4d45-b1e8-5ab31e423ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:18.761413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa0f6f-96ae-4d45-b1e8-5ab31e423ff5 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:18.771348 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 730/1462] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:21.172653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1447c6-c437-4ad2-a801-05d1f84841ad None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:21.173073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1447c6-c437-4ad2-a801-05d1f84841ad None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:21.173205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1447c6-c437-4ad2-a801-05d1f84841ad None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:21.175222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 733/1463] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:21.180265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdcd6d-ce7c-4b2b-ad17-8efb4ff57bc9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:21.180726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdcd6d-ce7c-4b2b-ad17-8efb4ff57bc9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:21.180877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdcd6d-ce7c-4b2b-ad17-8efb4ff57bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:21.198769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bccdcd6d-ce7c-4b2b-ad17-8efb4ff57bc9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:21.199938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bccdcd6d-ce7c-4b2b-ad17-8efb4ff57bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:21.207689 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 731/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:21.248860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1447c6-c437-4ad2-a801-05d1f84841ad None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:21.259392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1447c6-c437-4ad2-a801-05d1f84841ad None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:21.262960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658098e-c704-42c5-ac4a-687711ce766d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:21.263582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658098e-c704-42c5-ac4a-687711ce766d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:21.263863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658098e-c704-42c5-ac4a-687711ce766d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:21.264136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658098e-c704-42c5-ac4a-687711ce766d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:21.272769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658098e-c704-42c5-ac4a-687711ce766d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:21.274172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658098e-c704-42c5-ac4a-687711ce766d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:21.283268 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 734/1465] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:42:23.649554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d22a-3edd-4285-a996-07cec7ca24e8 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:23.650637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d22a-3edd-4285-a996-07cec7ca24e8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:23.650637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d22a-3edd-4285-a996-07cec7ca24e8 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:23.652474 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 732/1466] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:23.657841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93baa2-efc8-45e6-ad68-3848fa7e95d8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:23.658274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93baa2-efc8-45e6-ad68-3848fa7e95d8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:23.658398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93baa2-efc8-45e6-ad68-3848fa7e95d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:23.676786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9a93baa2-efc8-45e6-ad68-3848fa7e95d8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:23.677970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9a93baa2-efc8-45e6-ad68-3848fa7e95d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:23.686375 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 735/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:23.723166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053d22a-3edd-4285-a996-07cec7ca24e8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:23.734115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053d22a-3edd-4285-a996-07cec7ca24e8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:23.737579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7fe7a-5ea9-41ea-a2cd-3013f9dc61e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:23.738197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7fe7a-5ea9-41ea-a2cd-3013f9dc61e5 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:23.738473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7fe7a-5ea9-41ea-a2cd-3013f9dc61e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:23.738743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7fe7a-5ea9-41ea-a2cd-3013f9dc61e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:23.747953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7fe7a-5ea9-41ea-a2cd-3013f9dc61e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:23.749390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7fe7a-5ea9-41ea-a2cd-3013f9dc61e5 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:23.758485 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 733/1468] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:26.159998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4edaf8-2b05-40f0-afde-40c7c8611a61 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:26.160628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4edaf8-2b05-40f0-afde-40c7c8611a61 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:26.160628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4edaf8-2b05-40f0-afde-40c7c8611a61 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:26.162345 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 736/1469] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:42:26.168592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a68ac-392f-4f12-ab1a-e6b73d4fadcd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:26.169024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a68ac-392f-4f12-ab1a-e6b73d4fadcd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:26.169117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a68ac-392f-4f12-ab1a-e6b73d4fadcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:26.187468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-565a68ac-392f-4f12-ab1a-e6b73d4fadcd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:26.188868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-565a68ac-392f-4f12-ab1a-e6b73d4fadcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:26.197737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 734/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:26.239631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4edaf8-2b05-40f0-afde-40c7c8611a61 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:26.251629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4edaf8-2b05-40f0-afde-40c7c8611a61 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:26.255114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12c6c5-40aa-4010-9247-836b400bb582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:26.255734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c6c5-40aa-4010-9247-836b400bb582 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:26.256010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c6c5-40aa-4010-9247-836b400bb582 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:26.256279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c6c5-40aa-4010-9247-836b400bb582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:26.264829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12c6c5-40aa-4010-9247-836b400bb582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:26.266224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12c6c5-40aa-4010-9247-836b400bb582 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:26.275737 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 737/1471] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:47.905481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137c3-4309-4752-a825-813b4a8497e2 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:47.906077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137c3-4309-4752-a825-813b4a8497e2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:47.906077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137c3-4309-4752-a825-813b4a8497e2 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:47.907974 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 735/1472] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:47.917164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8a129-b823-47d4-8ba0-eaf12b5f59a6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:47.917751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8a129-b823-47d4-8ba0-eaf12b5f59a6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:47.917895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8a129-b823-47d4-8ba0-eaf12b5f59a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:47.936263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b3f8a129-b823-47d4-8ba0-eaf12b5f59a6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:47.937493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b3f8a129-b823-47d4-8ba0-eaf12b5f59a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:47.945457 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 738/1473] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:47.993074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60102517-ec08-4b92-a47c-e345c717fa47 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:47.993364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60102517-ec08-4b92-a47c-e345c717fa47 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:47.994150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60102517-ec08-4b92-a47c-e345c717fa47 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:47.996027 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 736/1474] 10.222.0.30 () {54 vars in 962 bytes} [Sat Feb 19 20:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:48.000815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c3b56-28e9-47af-8426-1b97ce33e639 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:48.001097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c3b56-28e9-47af-8426-1b97ce33e639 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:48.001368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c3b56-28e9-47af-8426-1b97ce33e639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:48.020715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-860c3b56-28e9-47af-8426-1b97ce33e639 None None] MFA Rules not processed for user `f02b510f78c341c29320f011ef4beaca`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:48.021900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-860c3b56-28e9-47af-8426-1b97ce33e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:48.028214 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 739/1475] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Feb 19 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:42:48.035249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60102517-ec08-4b92-a47c-e345c717fa47 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:48.045955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60102517-ec08-4b92-a47c-e345c717fa47 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:48.049431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275a364-6a93-4578-b27a-f68a10a965aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:48.050042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275a364-6a93-4578-b27a-f68a10a965aa service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:48.050319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275a364-6a93-4578-b27a-f68a10a965aa service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:48.050588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275a364-6a93-4578-b27a-f68a10a965aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:48.059623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275a364-6a93-4578-b27a-f68a10a965aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:48.061055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275a364-6a93-4578-b27a-f68a10a965aa service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:48.070082 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 737/1476] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:42:50.504454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26525-1f24-44cc-b131-73e3b8bc4ed4 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:50.505006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26525-1f24-44cc-b131-73e3b8bc4ed4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:50.505006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26525-1f24-44cc-b131-73e3b8bc4ed4 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:50.506874 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 740/1477] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:50.512738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ef16-b31b-4667-b7c5-b5af7ac17595 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:50.513152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ef16-b31b-4667-b7c5-b5af7ac17595 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:50.513286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9ef16-b31b-4667-b7c5-b5af7ac17595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:50.531168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-12f9ef16-b31b-4667-b7c5-b5af7ac17595 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:50.532353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-12f9ef16-b31b-4667-b7c5-b5af7ac17595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:50.540030 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 738/1478] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:50.565760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f26525-1f24-44cc-b131-73e3b8bc4ed4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:50.578680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f26525-1f24-44cc-b131-73e3b8bc4ed4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:50.583070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa5b72-00c3-4385-9fe3-8ef93062a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:50.583705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5b72-00c3-4385-9fe3-8ef93062a77e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:50.583986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5b72-00c3-4385-9fe3-8ef93062a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:50.584259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5b72-00c3-4385-9fe3-8ef93062a77e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:50.585014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa5b72-00c3-4385-9fe3-8ef93062a77e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:50.586853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa5b72-00c3-4385-9fe3-8ef93062a77e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:50.600902 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 741/1479] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Feb 19 20:42:50 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:42:52.981969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8539e1b-5b02-4871-913d-0adfaf65eab0 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:52.982442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8539e1b-5b02-4871-913d-0adfaf65eab0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:52.982559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8539e1b-5b02-4871-913d-0adfaf65eab0 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:52.984395 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 739/1480] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:52.989554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3508e4-9379-48c2-8262-7f4dd4a3cf8c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:52.989971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3508e4-9379-48c2-8262-7f4dd4a3cf8c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:52.990090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3508e4-9379-48c2-8262-7f4dd4a3cf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:53.008058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1a3508e4-9379-48c2-8262-7f4dd4a3cf8c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:53.009899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a3508e4-9379-48c2-8262-7f4dd4a3cf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:53.017648 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 742/1481] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:53.061881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8539e1b-5b02-4871-913d-0adfaf65eab0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:53.076458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8539e1b-5b02-4871-913d-0adfaf65eab0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:53.081805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e190d-23ce-453d-becc-23a4b7bda27d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:53.082428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e190d-23ce-453d-becc-23a4b7bda27d service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:53.082709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e190d-23ce-453d-becc-23a4b7bda27d service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:53.082985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e190d-23ce-453d-becc-23a4b7bda27d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:53.090954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e190d-23ce-453d-becc-23a4b7bda27d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:53.092635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e190d-23ce-453d-becc-23a4b7bda27d service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:53.101765 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 740/1482] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:55.622377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd9c62-7dfd-49c0-af95-c6fa1c64dd92 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:55.623001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd9c62-7dfd-49c0-af95-c6fa1c64dd92 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:55.623001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd9c62-7dfd-49c0-af95-c6fa1c64dd92 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:55.624766 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 743/1483] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:55.630020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6819f-5e84-49ec-a442-449af7c74368 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:55.630447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6819f-5e84-49ec-a442-449af7c74368 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:55.630594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6819f-5e84-49ec-a442-449af7c74368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:55.648471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-62e6819f-5e84-49ec-a442-449af7c74368 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:55.649685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-62e6819f-5e84-49ec-a442-449af7c74368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:55.658076 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 741/1484] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:55.695837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd9c62-7dfd-49c0-af95-c6fa1c64dd92 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:55.707252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd9c62-7dfd-49c0-af95-c6fa1c64dd92 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:55.710772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8104d4-946e-4f16-971a-67412d7c55b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:55.711397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8104d4-946e-4f16-971a-67412d7c55b4 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:55.711680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8104d4-946e-4f16-971a-67412d7c55b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:55.711955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8104d4-946e-4f16-971a-67412d7c55b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:55.721680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8104d4-946e-4f16-971a-67412d7c55b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:55.723100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8104d4-946e-4f16-971a-67412d7c55b4 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:55.732680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 744/1485] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:42:58.141877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c937-a80d-41a5-a080-4bdf2dee3f48 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:58.142417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c937-a80d-41a5-a080-4bdf2dee3f48 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:58.142417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c937-a80d-41a5-a080-4bdf2dee3f48 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:58.144202 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 742/1486] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:42:58.149274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efcad1-1c5f-403f-9eb7-b83cdedf7d18 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:58.149669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efcad1-1c5f-403f-9eb7-b83cdedf7d18 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:58.149832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efcad1-1c5f-403f-9eb7-b83cdedf7d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:58.167946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e3efcad1-1c5f-403f-9eb7-b83cdedf7d18 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:42:58.169157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e3efcad1-1c5f-403f-9eb7-b83cdedf7d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:42:58.177017 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 745/1487] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:42:58.216931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c937-a80d-41a5-a080-4bdf2dee3f48 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:42:58.228146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c937-a80d-41a5-a080-4bdf2dee3f48 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:42:58.232582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7a027-e9b6-4b35-8052-feb0cae10414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:42:58.233205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a027-e9b6-4b35-8052-feb0cae10414 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:42:58.233480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a027-e9b6-4b35-8052-feb0cae10414 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:42:58.233749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a027-e9b6-4b35-8052-feb0cae10414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:42:58.242513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7a027-e9b6-4b35-8052-feb0cae10414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:42:58.243923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7a027-e9b6-4b35-8052-feb0cae10414 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:42:58.253278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 743/1488] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:43:00.674852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecd63-ba6a-4965-aeaa-a68f824ae621 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:43:00.675421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecd63-ba6a-4965-aeaa-a68f824ae621 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:43:00.675519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecd63-ba6a-4965-aeaa-a68f824ae621 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:43:00.677368 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 746/1489] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:43:00.682387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf87c-ef98-4acc-9718-d5d5c8b4d9c4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:43:00.682812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf87c-ef98-4acc-9718-d5d5c8b4d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:43:00.682936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf87c-ef98-4acc-9718-d5d5c8b4d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:43:00.701190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-61abf87c-ef98-4acc-9718-d5d5c8b4d9c4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:43:00.701984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-61abf87c-ef98-4acc-9718-d5d5c8b4d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:43:00.710051 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 744/1490] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:43:00.753803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aecd63-ba6a-4965-aeaa-a68f824ae621 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:43:00.764525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aecd63-ba6a-4965-aeaa-a68f824ae621 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:43:00.768347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edc3aa-6362-449b-83ac-7e9d254a510f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:43:00.769052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc3aa-6362-449b-83ac-7e9d254a510f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:43:00.769337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc3aa-6362-449b-83ac-7e9d254a510f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:43:00.769611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc3aa-6362-449b-83ac-7e9d254a510f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:43:00.779297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edc3aa-6362-449b-83ac-7e9d254a510f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:43:00.780782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edc3aa-6362-449b-83ac-7e9d254a510f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:43:00.790272 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 747/1491] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:43:03.329848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e7f8-062e-4453-9ebf-0fa76fac6aa8 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:43:03.330367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e7f8-062e-4453-9ebf-0fa76fac6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:43:03.330462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e7f8-062e-4453-9ebf-0fa76fac6aa8 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:43:03.332245 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 745/1492] 10.222.0.30 () {54 vars in 926 bytes} [Sat Feb 19 20:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:43:03.337246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5431-b55e-400a-af62-ddb2955d429f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:43:03.337650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5431-b55e-400a-af62-ddb2955d429f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:43:03.337824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5431-b55e-400a-af62-ddb2955d429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:43:03.356213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ee8c5431-b55e-400a-af62-ddb2955d429f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:43:03.357418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ee8c5431-b55e-400a-af62-ddb2955d429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:43:03.365107 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 748/1493] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Feb 19 20:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:43:03.406803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e7f8-062e-4453-9ebf-0fa76fac6aa8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:43:03.419551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e7f8-062e-4453-9ebf-0fa76fac6aa8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:43:03.423443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d2136-c810-4d6a-ae4a-0b9acaa445f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:43:03.424083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d2136-c810-4d6a-ae4a-0b9acaa445f4 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:43:03.424396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d2136-c810-4d6a-ae4a-0b9acaa445f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:43:03.424680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d2136-c810-4d6a-ae4a-0b9acaa445f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:43:03.434369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d2136-c810-4d6a-ae4a-0b9acaa445f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:43:03.435829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d2136-c810-4d6a-ae4a-0b9acaa445f4 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:43:03.445139 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 746/1494] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:44:34.059222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361dc8c-8396-48ad-9e33-7cc38b04a9e6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.059810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361dc8c-8396-48ad-9e33-7cc38b04a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.059922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361dc8c-8396-48ad-9e33-7cc38b04a9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.078179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2361dc8c-8396-48ad-9e33-7cc38b04a9e6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:44:34.079359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2361dc8c-8396-48ad-9e33-7cc38b04a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:44:34.087725 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 749/1495] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:44:34.095391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea3468-845b-4a43-b567-7774d620d48c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.095880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea3468-845b-4a43-b567-7774d620d48c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.095985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea3468-845b-4a43-b567-7774d620d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.115916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-90ea3468-845b-4a43-b567-7774d620d48c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:44:34.118052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-90ea3468-845b-4a43-b567-7774d620d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:44:34.129120 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 747/1496] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:44:34.134058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361dc8c-8396-48ad-9e33-7cc38b04a9e6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.143414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361dc8c-8396-48ad-9e33-7cc38b04a9e6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:34.147813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:34.148480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.148759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.149653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.150375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:44:34.150676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:34.152524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:34.163850 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 750/1497] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:44:34.171724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea3468-845b-4a43-b567-7774d620d48c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.180996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea3468-845b-4a43-b567-7774d620d48c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:34.185458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079536bf-ba03-4966-937d-52b58ab1627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:34.186090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079536bf-ba03-4966-937d-52b58ab1627f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.186393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079536bf-ba03-4966-937d-52b58ab1627f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.186670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079536bf-ba03-4966-937d-52b58ab1627f admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.187349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079536bf-ba03-4966-937d-52b58ab1627f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:34.189276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079536bf-ba03-4966-937d-52b58ab1627f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:34.224097 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 748/1498] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:44:34 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:44:34.228139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.237928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa90a-9ddc-480d-8841-69eddbe401ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:34.290569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a79c4-24ba-416a-a3fc-bf8075c9ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:34.291222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a79c4-24ba-416a-a3fc-bf8075c9ca1b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.291499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a79c4-24ba-416a-a3fc-bf8075c9ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.291773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a79c4-24ba-416a-a3fc-bf8075c9ca1b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.292489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a79c4-24ba-416a-a3fc-bf8075c9ca1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:34.294397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a79c4-24ba-416a-a3fc-bf8075c9ca1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:34.314544 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 751/1499] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:44:34 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:44:34.320169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079536bf-ba03-4966-937d-52b58ab1627f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.331028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079536bf-ba03-4966-937d-52b58ab1627f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:34.335518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5568d4b-abbc-4843-8a89-9d29b12ea7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:34.336179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568d4b-abbc-4843-8a89-9d29b12ea7cc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.336507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568d4b-abbc-4843-8a89-9d29b12ea7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.336756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568d4b-abbc-4843-8a89-9d29b12ea7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.337646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5568d4b-abbc-4843-8a89-9d29b12ea7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:34.339240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5568d4b-abbc-4843-8a89-9d29b12ea7cc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:34.352406 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 749/1500] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:44:34.356171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a79c4-24ba-416a-a3fc-bf8075c9ca1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.365849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a79c4-24ba-416a-a3fc-bf8075c9ca1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:34.370963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dde70a-3423-41d4-a9ae-f10d9ddffde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:34.371609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde70a-3423-41d4-a9ae-f10d9ddffde0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.371891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde70a-3423-41d4-a9ae-f10d9ddffde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.372168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde70a-3423-41d4-a9ae-f10d9ddffde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.372934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dde70a-3423-41d4-a9ae-f10d9ddffde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:34.374511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dde70a-3423-41d4-a9ae-f10d9ddffde0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:34.388179 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 752/1501] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:44:34.392297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5568d4b-abbc-4843-8a89-9d29b12ea7cc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.402087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5568d4b-abbc-4843-8a89-9d29b12ea7cc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:34.406555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452154f-7133-4f37-ada7-37650b69c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:34.407414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452154f-7133-4f37-ada7-37650b69c1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.407686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452154f-7133-4f37-ada7-37650b69c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.407954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452154f-7133-4f37-ada7-37650b69c1f0 admin admin] PATH_INFO: `/v3/projects/f53534da1b9040a7a57dbce14c16fd70/users/59569150c6f34500b4005a528bb9fded/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.423114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452154f-7133-4f37-ada7-37650b69c1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53534da1b9040a7a57dbce14c16fd70, user_id=59569150c6f34500b4005a528bb9fded, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:34.425791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452154f-7133-4f37-ada7-37650b69c1f0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:34.438570 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 750/1502] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:44:34 2022] PUT /identity/v3/projects/f53534da1b9040a7a57dbce14c16fd70/users/59569150c6f34500b4005a528bb9fded/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:44:34.450211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a5f25-79af-4d51-9ca6-6d543df425ca None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.450500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a5f25-79af-4d51-9ca6-6d543df425ca None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.450781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a5f25-79af-4d51-9ca6-6d543df425ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.476547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-347a5f25-79af-4d51-9ca6-6d543df425ca None None] MFA Rules not processed for user `59569150c6f34500b4005a528bb9fded`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:44:34.477747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-347a5f25-79af-4d51-9ca6-6d543df425ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:44:34.538070 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 753/1503] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:44:34.549103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452154f-7133-4f37-ada7-37650b69c1f0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.616357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452154f-7133-4f37-ada7-37650b69c1f0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:34.622351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161826b7-ebb3-4962-9167-495ceb36d89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:34.622984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161826b7-ebb3-4962-9167-495ceb36d89c service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.623263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161826b7-ebb3-4962-9167-495ceb36d89c service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.623541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161826b7-ebb3-4962-9167-495ceb36d89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.631179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161826b7-ebb3-4962-9167-495ceb36d89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:34.632783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161826b7-ebb3-4962-9167-495ceb36d89c service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:34.641471 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 751/1504] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:44:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:44:34.709080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1493-8069-4d30-9a2f-369a15b61bff None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.709375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1493-8069-4d30-9a2f-369a15b61bff None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.709658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1493-8069-4d30-9a2f-369a15b61bff None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.711349 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 754/1505] 10.222.0.30 () {52 vars in 829 bytes} [Sat Feb 19 20:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:44:34.714988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161826b7-ebb3-4962-9167-495ceb36d89c service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.773901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161826b7-ebb3-4962-9167-495ceb36d89c service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:34.778807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:34.779652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.779930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.780203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] PATH_INFO: `/v3/users/59569150c6f34500b4005a528bb9fded` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.781400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59569150c6f34500b4005a528bb9fded)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:34.782412 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:44:34.782412 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:44:34.782412 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:44:34.783587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:34.847497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59569150c6f34500b4005a528bb9fded'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:34.848138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59569150c6f34500b4005a528bb9fded'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:34.848897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59569150c6f34500b4005a528bb9fded'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:34.866836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59569150c6f34500b4005a528bb9fded'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:34.876398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59569150c6f34500b4005a528bb9fded'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:34.893549 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 752/1506] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:44:34 2022] DELETE /identity/v3/users/59569150c6f34500b4005a528bb9fded => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:44:34.897935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969619-308e-4e72-8be2-a88d73f77038 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:34.898223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969619-308e-4e72-8be2-a88d73f77038 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:34.898500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969619-308e-4e72-8be2-a88d73f77038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:34.916386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-41969619-308e-4e72-8be2-a88d73f77038 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:44:34.917577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-41969619-308e-4e72-8be2-a88d73f77038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:44:34.975596 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 755/1507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:44:34.985706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:34.987086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:44:35.041787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3661f8-aba4-499f-9bec-4131d23c6f41 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:35.045431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8eb7ec-cd41-4d1a-b857-c90614c49849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:35.046068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb7ec-cd41-4d1a-b857-c90614c49849 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:35.046352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb7ec-cd41-4d1a-b857-c90614c49849 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:35.046628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb7ec-cd41-4d1a-b857-c90614c49849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:35.055584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8eb7ec-cd41-4d1a-b857-c90614c49849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:35.057045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8eb7ec-cd41-4d1a-b857-c90614c49849 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:35.066206 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 753/1508] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:44:35.525392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969619-308e-4e72-8be2-a88d73f77038 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:44:35.527947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-41969619-308e-4e72-8be2-a88d73f77038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:44:35.541305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969619-308e-4e72-8be2-a88d73f77038 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:44:35.548564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:44:35.550216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:44:35.550695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:44:35.551177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] PATH_INFO: `/v3/projects/f53534da1b9040a7a57dbce14c16fd70` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:44:35.553248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53534da1b9040a7a57dbce14c16fd70)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:44:35.555737 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:44:35.555737 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:44:35.555737 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:44:35.556982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:44:35.620593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53534da1b9040a7a57dbce14c16fd70', 'request_id': 'req-33272f26-28c3-40af-a267-10f4acfce999'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:35.626250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53534da1b9040a7a57dbce14c16fd70', 'request_id': 'req-33272f26-28c3-40af-a267-10f4acfce999'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:35.635100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53534da1b9040a7a57dbce14c16fd70', 'request_id': 'req-33272f26-28c3-40af-a267-10f4acfce999'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:35.653059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] The token cache is being invalidate because project f53534da1b9040a7a57dbce14c16fd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:44:35.653347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:35.653977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33272f26-28c3-40af-a267-10f4acfce999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:44:35.655617 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 756/1509] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:44:35 2022] DELETE /identity/v3/projects/f53534da1b9040a7a57dbce14c16fd70 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:47:56.970555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b779f1e-d7c5-4797-a947-9e33f8640517 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:47:56.971256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b779f1e-d7c5-4797-a947-9e33f8640517 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:47:56.971256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b779f1e-d7c5-4797-a947-9e33f8640517 None None] PATH_INFO: `/v3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:47:56.972296 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 754/1510] 10.222.0.10 () {54 vars in 925 bytes} [Sat Feb 19 20:47:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:47:56.982591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140fe86-8c7f-4181-9f0f-27581138ad06 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:47:56.983037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140fe86-8c7f-4181-9f0f-27581138ad06 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:47:56.983139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140fe86-8c7f-4181-9f0f-27581138ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:47:57.000927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5140fe86-8c7f-4181-9f0f-27581138ad06 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:47:57.002133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5140fe86-8c7f-4181-9f0f-27581138ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:47:57.061553 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 757/1511] 10.222.0.10 () {58 vars in 1015 bytes} [Sat Feb 19 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:48:00.776766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b72a1-9ff8-49d3-9adb-079928881cd6 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:00.777340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b72a1-9ff8-49d3-9adb-079928881cd6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:00.777340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b72a1-9ff8-49d3-9adb-079928881cd6 None None] PATH_INFO: `/v3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:00.778598 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 755/1512] 10.222.0.67 () {54 vars in 925 bytes} [Sat Feb 19 20:48:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:48:00.785431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912dbbf-7308-43d1-b26f-427aff34a2a5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:00.785849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912dbbf-7308-43d1-b26f-427aff34a2a5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:00.786001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912dbbf-7308-43d1-b26f-427aff34a2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:00.806182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4912dbbf-7308-43d1-b26f-427aff34a2a5 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:48:00.807399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4912dbbf-7308-43d1-b26f-427aff34a2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:00.816968 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 758/1513] 10.222.0.67 () {58 vars in 1015 bytes} [Sat Feb 19 20:48:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:48:01.112762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a69bf-5a29-46e6-9c7b-175fd38d75fd None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:01.113049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a69bf-5a29-46e6-9c7b-175fd38d75fd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:01.113332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a69bf-5a29-46e6-9c7b-175fd38d75fd None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:01.115151 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 756/1514] 10.222.0.30 () {54 vars in 960 bytes} [Sat Feb 19 20:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:48:01.120046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e3086-ff8f-401d-abec-ce443b0ab109 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:01.120386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e3086-ff8f-401d-abec-ce443b0ab109 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:01.120673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e3086-ff8f-401d-abec-ce443b0ab109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:01.138728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e87e3086-ff8f-401d-abec-ce443b0ab109 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:48:01.139912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e87e3086-ff8f-401d-abec-ce443b0ab109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:01.148998 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 759/1515] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Feb 19 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:48:01.156393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a69bf-5a29-46e6-9c7b-175fd38d75fd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:48:01.169975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a69bf-5a29-46e6-9c7b-175fd38d75fd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:48:01.175327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c6df9-8475-48e9-b26d-877feb6e1e7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:48:01.175976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c6df9-8475-48e9-b26d-877feb6e1e7e service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:01.176251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c6df9-8475-48e9-b26d-877feb6e1e7e service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:01.176549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c6df9-8475-48e9-b26d-877feb6e1e7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:01.184714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c6df9-8475-48e9-b26d-877feb6e1e7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:48:01.186273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c6df9-8475-48e9-b26d-877feb6e1e7e service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:48:01.195759 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 757/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:48:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:48:04.720263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393eeb-0d7c-48f0-8c8f-d7953ef31669 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:04.720729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393eeb-0d7c-48f0-8c8f-d7953ef31669 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:04.720834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393eeb-0d7c-48f0-8c8f-d7953ef31669 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:04.722603 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 760/1517] 10.222.0.30 () {54 vars in 960 bytes} [Sat Feb 19 20:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:48:04.727566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c887e1-c289-48f9-b3c5-e68787f03783 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:04.728031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c887e1-c289-48f9-b3c5-e68787f03783 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:04.728186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c887e1-c289-48f9-b3c5-e68787f03783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:04.746437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-74c887e1-c289-48f9-b3c5-e68787f03783 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:48:04.747659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-74c887e1-c289-48f9-b3c5-e68787f03783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:04.756705 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 758/1518] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Feb 19 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:48:04.764253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9393eeb-0d7c-48f0-8c8f-d7953ef31669 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:48:04.777169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9393eeb-0d7c-48f0-8c8f-d7953ef31669 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:48:04.781987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce14814-a59e-4f3b-bba7-497ae1fdebfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:48:04.782607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce14814-a59e-4f3b-bba7-497ae1fdebfe service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:04.782885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce14814-a59e-4f3b-bba7-497ae1fdebfe service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:04.783158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce14814-a59e-4f3b-bba7-497ae1fdebfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:04.791123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce14814-a59e-4f3b-bba7-497ae1fdebfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:48:04.792730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce14814-a59e-4f3b-bba7-497ae1fdebfe service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:48:04.803157 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 761/1519] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:48:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:48:38.871983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f21e0-f24f-442a-b136-3338e121527c None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:38.872581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f21e0-f24f-442a-b136-3338e121527c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:38.872581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f21e0-f24f-442a-b136-3338e121527c None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:38.874357 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 759/1520] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:48:38.879212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad96c-c2d7-444a-9e32-ce104f7cb8cf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:38.879654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad96c-c2d7-444a-9e32-ce104f7cb8cf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:38.879764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad96c-c2d7-444a-9e32-ce104f7cb8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:38.897456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e28ad96c-c2d7-444a-9e32-ce104f7cb8cf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:48:38.898785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e28ad96c-c2d7-444a-9e32-ce104f7cb8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:38.955047 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 762/1521] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:48:39.116267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f21e0-f24f-442a-b136-3338e121527c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:48:39.118061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a03f21e0-f24f-442a-b136-3338e121527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:39.192932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f21e0-f24f-442a-b136-3338e121527c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:48:39.198503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbda80-2208-4d9f-947a-3be32a1724ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:48:39.199218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbda80-2208-4d9f-947a-3be32a1724ca service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:39.199566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbda80-2208-4d9f-947a-3be32a1724ca service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:39.199907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbda80-2208-4d9f-947a-3be32a1724ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:39.209061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbda80-2208-4d9f-947a-3be32a1724ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:48:39.210634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbda80-2208-4d9f-947a-3be32a1724ca service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:48:39.220455 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 760/1522] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:48:40.576698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de86e4-bdf7-4d15-a61a-1a4dcd988ef9 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:40.577317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de86e4-bdf7-4d15-a61a-1a4dcd988ef9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:40.577317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de86e4-bdf7-4d15-a61a-1a4dcd988ef9 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:40.579099 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 763/1523] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 19 20:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:48:40.584446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388035-4063-4d17-8a14-439ddd9d0275 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:40.584872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388035-4063-4d17-8a14-439ddd9d0275 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:40.584997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388035-4063-4d17-8a14-439ddd9d0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:40.602662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-19388035-4063-4d17-8a14-439ddd9d0275 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:48:40.603848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-19388035-4063-4d17-8a14-439ddd9d0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:40.611492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 761/1524] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 19 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:48:40.770701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de86e4-bdf7-4d15-a61a-1a4dcd988ef9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:48:40.784989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de86e4-bdf7-4d15-a61a-1a4dcd988ef9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:48:40.790306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44145ce-3ae7-44c1-8cd5-0aca94f8a304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:48:40.790930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44145ce-3ae7-44c1-8cd5-0aca94f8a304 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:40.791210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44145ce-3ae7-44c1-8cd5-0aca94f8a304 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:40.791481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44145ce-3ae7-44c1-8cd5-0aca94f8a304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:40.799275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44145ce-3ae7-44c1-8cd5-0aca94f8a304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:48:40.801135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44145ce-3ae7-44c1-8cd5-0aca94f8a304 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:48:40.810623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 764/1525] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:48:44.970579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43857d-3869-4b72-aa42-4cfa22e5d6a7 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:44.971158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43857d-3869-4b72-aa42-4cfa22e5d6a7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:44.971158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43857d-3869-4b72-aa42-4cfa22e5d6a7 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:44.973181 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 762/1526] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:48:44.979123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e096d-5f6c-4a1b-bcf3-6a8cafe8de3f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:44.979571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e096d-5f6c-4a1b-bcf3-6a8cafe8de3f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:44.979677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e096d-5f6c-4a1b-bcf3-6a8cafe8de3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:44.998126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f90e096d-5f6c-4a1b-bcf3-6a8cafe8de3f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:48:44.999325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f90e096d-5f6c-4a1b-bcf3-6a8cafe8de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:45.007234 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 765/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:48:45.048976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43857d-3869-4b72-aa42-4cfa22e5d6a7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:48:45.050913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4b43857d-3869-4b72-aa42-4cfa22e5d6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:45.108855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43857d-3869-4b72-aa42-4cfa22e5d6a7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:48:45.112321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6e35c-8403-42a2-b3cf-30cbe5622f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:48:45.112981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e35c-8403-42a2-b3cf-30cbe5622f32 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:45.113262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e35c-8403-42a2-b3cf-30cbe5622f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:45.113535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e35c-8403-42a2-b3cf-30cbe5622f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:45.122675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6e35c-8403-42a2-b3cf-30cbe5622f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:48:45.124091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6e35c-8403-42a2-b3cf-30cbe5622f32 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:48:45.133215 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 763/1528] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:48:47.475205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11366cd3-9987-4739-9687-27d97f9f821d None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:47.475761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11366cd3-9987-4739-9687-27d97f9f821d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:47.475761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11366cd3-9987-4739-9687-27d97f9f821d None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:47.477626 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 766/1529] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 19 20:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:48:47.483019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada08d-22ea-4b5c-a99e-53875e76816b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:47.483441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada08d-22ea-4b5c-a99e-53875e76816b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:47.483579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada08d-22ea-4b5c-a99e-53875e76816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:47.500825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-69ada08d-22ea-4b5c-a99e-53875e76816b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:48:47.502023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-69ada08d-22ea-4b5c-a99e-53875e76816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:48:47.509813 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 764/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 19 20:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:48:47.548292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11366cd3-9987-4739-9687-27d97f9f821d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:48:47.559021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11366cd3-9987-4739-9687-27d97f9f821d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:48:47.562522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58214ca8-5408-46f5-99ac-3cd787070eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:48:47.563144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58214ca8-5408-46f5-99ac-3cd787070eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:48:47.563425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58214ca8-5408-46f5-99ac-3cd787070eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:48:47.563701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58214ca8-5408-46f5-99ac-3cd787070eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:48:47.572245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58214ca8-5408-46f5-99ac-3cd787070eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:48:47.573697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58214ca8-5408-46f5-99ac-3cd787070eb1 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:48:47.582755 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 767/1531] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:49:40.510511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4de5-24e9-4653-b38c-b0251a184b61 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:49:40.511113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4de5-24e9-4653-b38c-b0251a184b61 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:49:40.511113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e4de5-24e9-4653-b38c-b0251a184b61 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:49:40.512886 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 765/1532] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:49:40.518264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb6a2-012f-4625-bb40-962080531905 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:49:40.519075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb6a2-012f-4625-bb40-962080531905 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:49:40.519379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb6a2-012f-4625-bb40-962080531905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:49:40.537223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8eedb6a2-012f-4625-bb40-962080531905 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:49:40.538395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8eedb6a2-012f-4625-bb40-962080531905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:49:40.547299 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 768/1533] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:49:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:12.902410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5af0c-857d-49cb-9240-6dbfd783433c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:12.903472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5af0c-857d-49cb-9240-6dbfd783433c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:12.903987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5af0c-857d-49cb-9240-6dbfd783433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:12.932976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-25a5af0c-857d-49cb-9240-6dbfd783433c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:12.934485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25a5af0c-857d-49cb-9240-6dbfd783433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:12.945978 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 766/1534] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:12.956386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9098e5a-c573-44d8-bc86-a409e0edf402 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:12.957349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9098e5a-c573-44d8-bc86-a409e0edf402 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:12.957839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9098e5a-c573-44d8-bc86-a409e0edf402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:12.982136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f9098e5a-c573-44d8-bc86-a409e0edf402 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:12.983715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f9098e5a-c573-44d8-bc86-a409e0edf402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:12.993109 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 769/1535] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:12.997520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5af0c-857d-49cb-9240-6dbfd783433c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.010052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5af0c-857d-49cb-9240-6dbfd783433c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.018533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.019209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.019493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.019767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.020679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:13.020988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.023617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.040981 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 767/1536] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:13.043070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d59a-9322-440a-966c-08bf07b62677 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.043603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d59a-9322-440a-966c-08bf07b62677 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.044087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d59a-9322-440a-966c-08bf07b62677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.049323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.067489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fecf1-5119-4468-92dc-f6b88255503a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.074680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c243d59a-9322-440a-966c-08bf07b62677 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.076320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c243d59a-9322-440a-966c-08bf07b62677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.078234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603e32-146c-4d55-8794-3b69079e87fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.084360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603e32-146c-4d55-8794-3b69079e87fe admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.084360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603e32-146c-4d55-8794-3b69079e87fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.084360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603e32-146c-4d55-8794-3b69079e87fe admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.084360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603e32-146c-4d55-8794-3b69079e87fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.084360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603e32-146c-4d55-8794-3b69079e87fe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.095523 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 770/1537] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:13.105822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20f74b-9a65-4df7-b2b7-b3072d0c0d1b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.106497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20f74b-9a65-4df7-b2b7-b3072d0c0d1b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.106987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20f74b-9a65-4df7-b2b7-b3072d0c0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.135892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0d20f74b-9a65-4df7-b2b7-b3072d0c0d1b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.140814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0d20f74b-9a65-4df7-b2b7-b3072d0c0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.159426 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 771/1538] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:13.163286 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 768/1539] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/projects => generated 397 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:50:13.165709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20f74b-9a65-4df7-b2b7-b3072d0c0d1b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.169090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603e32-146c-4d55-8794-3b69079e87fe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.176988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20f74b-9a65-4df7-b2b7-b3072d0c0d1b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.257042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fcd38-770f-43fc-86f6-3939a7c8d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.258765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fcd38-770f-43fc-86f6-3939a7c8d608 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.259414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fcd38-770f-43fc-86f6-3939a7c8d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.260018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fcd38-770f-43fc-86f6-3939a7c8d608 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.261130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fcd38-770f-43fc-86f6-3939a7c8d608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:13.261627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fcd38-770f-43fc-86f6-3939a7c8d608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.263456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fcd38-770f-43fc-86f6-3939a7c8d608 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.270836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603e32-146c-4d55-8794-3b69079e87fe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.282896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aa85a-3ddb-4ec9-ad48-cd10e6a5f5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.283997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa85a-3ddb-4ec9-ad48-cd10e6a5f5dc admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.284279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa85a-3ddb-4ec9-ad48-cd10e6a5f5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.284846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa85a-3ddb-4ec9-ad48-cd10e6a5f5dc admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.285568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aa85a-3ddb-4ec9-ad48-cd10e6a5f5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.287558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aa85a-3ddb-4ec9-ad48-cd10e6a5f5dc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.291350 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 772/1540] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:13.292559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64884099-7c01-4796-b3d6-3f346bcd21fd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.292829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64884099-7c01-4796-b3d6-3f346bcd21fd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.293103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64884099-7c01-4796-b3d6-3f346bcd21fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.333583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-64884099-7c01-4796-b3d6-3f346bcd21fd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.341908 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 769/1541] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:50:13.342802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aa85a-3ddb-4ec9-ad48-cd10e6a5f5dc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.343931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-64884099-7c01-4796-b3d6-3f346bcd21fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.366191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aa85a-3ddb-4ec9-ad48-cd10e6a5f5dc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.368847 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 773/1542] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.369970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64884099-7c01-4796-b3d6-3f346bcd21fd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.384698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09db5cd-4b68-471d-9c87-b840ee09f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.385388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09db5cd-4b68-471d-9c87-b840ee09f391 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.385673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09db5cd-4b68-471d-9c87-b840ee09f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.385949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09db5cd-4b68-471d-9c87-b840ee09f391 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.386661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09db5cd-4b68-471d-9c87-b840ee09f391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.388643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09db5cd-4b68-471d-9c87-b840ee09f391 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.395941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64884099-7c01-4796-b3d6-3f346bcd21fd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.405656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4138ca-1ad4-4111-9aa9-07aec28a0c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.406734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4138ca-1ad4-4111-9aa9-07aec28a0c6e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.407254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4138ca-1ad4-4111-9aa9-07aec28a0c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.407740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4138ca-1ad4-4111-9aa9-07aec28a0c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.408852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4138ca-1ad4-4111-9aa9-07aec28a0c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.410657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4138ca-1ad4-4111-9aa9-07aec28a0c6e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.429115 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 774/1543] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:13.431422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ca931-c913-42aa-9657-4b6d1f6f9916 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.431946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ca931-c913-42aa-9657-4b6d1f6f9916 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.432464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ca931-c913-42aa-9657-4b6d1f6f9916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.463514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b00ca931-c913-42aa-9657-4b6d1f6f9916 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.465149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b00ca931-c913-42aa-9657-4b6d1f6f9916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.474538 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 775/1544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.476318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547fea-101d-42ed-9cae-87484bf6b67d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.476938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547fea-101d-42ed-9cae-87484bf6b67d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.477458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547fea-101d-42ed-9cae-87484bf6b67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.490195 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 770/1545] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:13.494037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e57003-08c1-4bd5-a4de-39ca80467d3a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.495169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e57003-08c1-4bd5-a4de-39ca80467d3a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.496743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e57003-08c1-4bd5-a4de-39ca80467d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.515050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a9547fea-101d-42ed-9cae-87484bf6b67d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.516257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a9547fea-101d-42ed-9cae-87484bf6b67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.518022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-57e57003-08c1-4bd5-a4de-39ca80467d3a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.519883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57e57003-08c1-4bd5-a4de-39ca80467d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.585749 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 776/1546] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.586561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9547fea-101d-42ed-9cae-87484bf6b67d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.594437 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 771/1547] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.595909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1c26-d394-4c64-99af-75cdd772cb0b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.596483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1c26-d394-4c64-99af-75cdd772cb0b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.596824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1c26-d394-4c64-99af-75cdd772cb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.600373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9547fea-101d-42ed-9cae-87484bf6b67d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.606492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8dc88-afb6-4605-bd2e-9d948d0e101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.607249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8dc88-afb6-4605-bd2e-9d948d0e101a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.607538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8dc88-afb6-4605-bd2e-9d948d0e101a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.607856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8dc88-afb6-4605-bd2e-9d948d0e101a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.608759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8dc88-afb6-4605-bd2e-9d948d0e101a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.610343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8dc88-afb6-4605-bd2e-9d948d0e101a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.618494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6ddb1c26-d394-4c64-99af-75cdd772cb0b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.619709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6ddb1c26-d394-4c64-99af-75cdd772cb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.620995 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 777/1548] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:13.621800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8dc88-afb6-4605-bd2e-9d948d0e101a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.628064 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 772/1549] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.629001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb1c26-d394-4c64-99af-75cdd772cb0b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.631520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8dc88-afb6-4605-bd2e-9d948d0e101a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.636762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0481976-a666-4103-bd49-5de9524dc81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.637408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481976-a666-4103-bd49-5de9524dc81f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.637686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481976-a666-4103-bd49-5de9524dc81f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.637967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481976-a666-4103-bd49-5de9524dc81f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.638568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb1c26-d394-4c64-99af-75cdd772cb0b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.638686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0481976-a666-4103-bd49-5de9524dc81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:13.638964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0481976-a666-4103-bd49-5de9524dc81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.640560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0481976-a666-4103-bd49-5de9524dc81f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.644043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8101220-0a56-4c1e-b16c-5e4171a95026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.644775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8101220-0a56-4c1e-b16c-5e4171a95026 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.645112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8101220-0a56-4c1e-b16c-5e4171a95026 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.645396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8101220-0a56-4c1e-b16c-5e4171a95026 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.646115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8101220-0a56-4c1e-b16c-5e4171a95026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.648034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8101220-0a56-4c1e-b16c-5e4171a95026 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.654013 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 778/1550] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:13.655382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de249084-48d4-44d3-ab20-bea4dd44b90e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.655676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de249084-48d4-44d3-ab20-bea4dd44b90e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.655949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de249084-48d4-44d3-ab20-bea4dd44b90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.670287 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 773/1551] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:13.671572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc840b-50c6-45f3-b699-47ace0dae3ac None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.671865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc840b-50c6-45f3-b699-47ace0dae3ac None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.672145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc840b-50c6-45f3-b699-47ace0dae3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.675620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-de249084-48d4-44d3-ab20-bea4dd44b90e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.677099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de249084-48d4-44d3-ab20-bea4dd44b90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.685582 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 779/1552] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.686789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d55b5-1855-4db2-b10e-4cf85fafb4d7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.687076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d55b5-1855-4db2-b10e-4cf85fafb4d7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.687354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d55b5-1855-4db2-b10e-4cf85fafb4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.696594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5cbc840b-50c6-45f3-b699-47ace0dae3ac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.697996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5cbc840b-50c6-45f3-b699-47ace0dae3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.705587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b02d55b5-1855-4db2-b10e-4cf85fafb4d7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.706727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b02d55b5-1855-4db2-b10e-4cf85fafb4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.707990 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 774/1553] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.709263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bcc2b-e3f6-4691-9868-f9beedc8becc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.709551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bcc2b-e3f6-4691-9868-f9beedc8becc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.709828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bcc2b-e3f6-4691-9868-f9beedc8becc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.718934 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 780/1554] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.718934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d55b5-1855-4db2-b10e-4cf85fafb4d7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.725410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d55b5-1855-4db2-b10e-4cf85fafb4d7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.730853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec2f41-c0ae-40ed-9709-07d4ad7d6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.731486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7a3bcc2b-e3f6-4691-9868-f9beedc8becc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.731728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2f41-c0ae-40ed-9709-07d4ad7d6a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.732016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2f41-c0ae-40ed-9709-07d4ad7d6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.732292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2f41-c0ae-40ed-9709-07d4ad7d6a85 admin admin] PATH_INFO: `/v3/projects/171eb8a081f74f8a89218e43e188c9b2/users/cf8b6484328b4ae999dc8ccd44d4129f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.732734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a3bcc2b-e3f6-4691-9868-f9beedc8becc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.740753 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 775/1555] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.741832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d268243-0d55-4e5f-97b0-18ce1adc2d95 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.742730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d268243-0d55-4e5f-97b0-18ce1adc2d95 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.743005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d268243-0d55-4e5f-97b0-18ce1adc2d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.748044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec2f41-c0ae-40ed-9709-07d4ad7d6a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171eb8a081f74f8a89218e43e188c9b2, user_id=cf8b6484328b4ae999dc8ccd44d4129f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.750759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec2f41-c0ae-40ed-9709-07d4ad7d6a85 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.762206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1d268243-0d55-4e5f-97b0-18ce1adc2d95 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.763397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1d268243-0d55-4e5f-97b0-18ce1adc2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.765240 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 781/1556] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:13 2022] PUT /identity/v3/projects/171eb8a081f74f8a89218e43e188c9b2/users/cf8b6484328b4ae999dc8ccd44d4129f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:13.766142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec2f41-c0ae-40ed-9709-07d4ad7d6a85 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.824303 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 776/1557] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.825325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d268243-0d55-4e5f-97b0-18ce1adc2d95 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.836695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d268243-0d55-4e5f-97b0-18ce1adc2d95 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.839897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec2f41-c0ae-40ed-9709-07d4ad7d6a85 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.841312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f9543-0bf1-42fb-aa7f-8be1baa626c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.841907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f9543-0bf1-42fb-aa7f-8be1baa626c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.842189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f9543-0bf1-42fb-aa7f-8be1baa626c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.842464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f9543-0bf1-42fb-aa7f-8be1baa626c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.843181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f9543-0bf1-42fb-aa7f-8be1baa626c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.844591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c668d-292a-4fe4-aea1-11ba1a986555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.844831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f9543-0bf1-42fb-aa7f-8be1baa626c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.845242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c668d-292a-4fe4-aea1-11ba1a986555 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.845524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c668d-292a-4fe4-aea1-11ba1a986555 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.845925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c668d-292a-4fe4-aea1-11ba1a986555 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.846484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c668d-292a-4fe4-aea1-11ba1a986555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.848400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c668d-292a-4fe4-aea1-11ba1a986555 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.854669 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 777/1558] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:13.855860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b12ca-35f8-4637-a601-eddb0e1d7e90 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.856139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b12ca-35f8-4637-a601-eddb0e1d7e90 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.856453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b12ca-35f8-4637-a601-eddb0e1d7e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.876932 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 782/1559] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:13.876932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37292daa-fb2a-45e8-b685-1febf8583937 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.876932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37292daa-fb2a-45e8-b685-1febf8583937 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.877340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a89b12ca-35f8-4637-a601-eddb0e1d7e90 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.877437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37292daa-fb2a-45e8-b685-1febf8583937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.877534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a89b12ca-35f8-4637-a601-eddb0e1d7e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.893545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-37292daa-fb2a-45e8-b685-1febf8583937 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.894780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37292daa-fb2a-45e8-b685-1febf8583937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:13.936144 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 778/1560] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.936926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b12ca-35f8-4637-a601-eddb0e1d7e90 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.946217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b12ca-35f8-4637-a601-eddb0e1d7e90 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.950802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46b13d-b2ad-4995-9766-3f908cb0e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.951430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46b13d-b2ad-4995-9766-3f908cb0e216 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.951710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46b13d-b2ad-4995-9766-3f908cb0e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.951984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46b13d-b2ad-4995-9766-3f908cb0e216 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.952733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46b13d-b2ad-4995-9766-3f908cb0e216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:13.953037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46b13d-b2ad-4995-9766-3f908cb0e216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.954620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46b13d-b2ad-4995-9766-3f908cb0e216 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.956415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 783/1561] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:13.960450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37292daa-fb2a-45e8-b685-1febf8583937 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.966784 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 779/1562] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:13.968020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48432-0f0d-452e-9897-52ea737c2cd5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.968307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48432-0f0d-452e-9897-52ea737c2cd5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.968616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48432-0f0d-452e-9897-52ea737c2cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.968976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37292daa-fb2a-45e8-b685-1febf8583937 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:13.973988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:13.974760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:13.975049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:13.975330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:13.976053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:13.976423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:13.978056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:13.996557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 784/1563] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:13.996557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:13.997394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f8f48432-0f0d-452e-9897-52ea737c2cd5 None None] MFA Rules not processed for user `cf8b6484328b4ae999dc8ccd44d4129f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:13.998621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f8f48432-0f0d-452e-9897-52ea737c2cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:14.006664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1af07-1752-4feb-b4d3-a05fe3dff2f0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.011871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.012548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.012834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.013113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.013822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:14.014130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.015756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.028210 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 785/1564] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:14.029233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.038407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0db624-3f88-44bd-81b0-eb522ed479ff admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.043125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37982e-f0bc-4c1d-9e28-42ddb11ace8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.070248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37982e-f0bc-4c1d-9e28-42ddb11ace8d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.070248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37982e-f0bc-4c1d-9e28-42ddb11ace8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.070248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37982e-f0bc-4c1d-9e28-42ddb11ace8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.070248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37982e-f0bc-4c1d-9e28-42ddb11ace8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.070248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37982e-f0bc-4c1d-9e28-42ddb11ace8d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.070248 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 786/1565] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.071163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37982e-f0bc-4c1d-9e28-42ddb11ace8d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.073556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37982e-f0bc-4c1d-9e28-42ddb11ace8d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.075549 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 780/1566] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:14.076482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f48432-0f0d-452e-9897-52ea737c2cd5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.079123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79d645-3c69-42e0-a697-42881cff5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.080095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d645-3c69-42e0-a697-42881cff5b9f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.080462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d645-3c69-42e0-a697-42881cff5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.080794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79d645-3c69-42e0-a697-42881cff5b9f admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.081491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79d645-3c69-42e0-a697-42881cff5b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.083422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79d645-3c69-42e0-a697-42881cff5b9f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.087403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f48432-0f0d-452e-9897-52ea737c2cd5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.091890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.092616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.092910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.093180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.093884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:14.094252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.095919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.104131 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 787/1567] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/users => generated 291 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.104977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79d645-3c69-42e0-a697-42881cff5b9f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.115118 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 781/1568] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:14.115118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.116620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79d645-3c69-42e0-a697-42881cff5b9f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.122328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.122596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.122887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.123163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.123881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:14.124192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.125805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.125894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de28de8-8e3f-473b-998b-48fbb625d02e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.130458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf82a88-28e3-4761-aa67-f6daf6ec01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.131107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82a88-28e3-4761-aa67-f6daf6ec01ac admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.131386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82a88-28e3-4761-aa67-f6daf6ec01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.131654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82a88-28e3-4761-aa67-f6daf6ec01ac admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.132379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf82a88-28e3-4761-aa67-f6daf6ec01ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.134906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf82a88-28e3-4761-aa67-f6daf6ec01ac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.138361 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 788/1569] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:14.139297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.149039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058467-33ac-4f05-a701-86a0e6d32319 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.154303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab761040-c675-4863-97f5-9767c28f02f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.154942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761040-c675-4863-97f5-9767c28f02f6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.155239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761040-c675-4863-97f5-9767c28f02f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.155502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761040-c675-4863-97f5-9767c28f02f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.156437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab761040-c675-4863-97f5-9767c28f02f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.158418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab761040-c675-4863-97f5-9767c28f02f6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.161879 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 782/1570] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.162638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf82a88-28e3-4761-aa67-f6daf6ec01ac admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.188125 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 789/1571] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.188125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab761040-c675-4863-97f5-9767c28f02f6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.222379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf82a88-28e3-4761-aa67-f6daf6ec01ac admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.248601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab761040-c675-4863-97f5-9767c28f02f6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.253274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2a8a4-d85b-41a2-96ba-e2a2b4754f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.254150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2a8a4-d85b-41a2-96ba-e2a2b4754f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.254433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2a8a4-d85b-41a2-96ba-e2a2b4754f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.254713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2a8a4-d85b-41a2-96ba-e2a2b4754f02 admin admin] PATH_INFO: `/v3/projects/38884f43b2424f239815bc0f2f277c5a/users/563e834800474429ae488dcd94ac9f57/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.269489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2a8a4-d85b-41a2-96ba-e2a2b4754f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38884f43b2424f239815bc0f2f277c5a, user_id=563e834800474429ae488dcd94ac9f57, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.272259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2a8a4-d85b-41a2-96ba-e2a2b4754f02 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.275614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8340a1-6a9b-4472-8363-87d0413112e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.276277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8340a1-6a9b-4472-8363-87d0413112e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.276634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8340a1-6a9b-4472-8363-87d0413112e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.276921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8340a1-6a9b-4472-8363-87d0413112e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.277639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8340a1-6a9b-4472-8363-87d0413112e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.280380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8340a1-6a9b-4472-8363-87d0413112e6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.287184 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 790/1572] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:14 2022] PUT /identity/v3/projects/38884f43b2424f239815bc0f2f277c5a/users/563e834800474429ae488dcd94ac9f57/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:14.296567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2a8a4-d85b-41a2-96ba-e2a2b4754f02 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.309292 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 783/1573] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.313197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8340a1-6a9b-4472-8363-87d0413112e6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.350092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2a8a4-d85b-41a2-96ba-e2a2b4754f02 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.372209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8340a1-6a9b-4472-8363-87d0413112e6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.377366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14963fe6-a85b-4f92-a59d-f6dd45ba6269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.378025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963fe6-a85b-4f92-a59d-f6dd45ba6269 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.378315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963fe6-a85b-4f92-a59d-f6dd45ba6269 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.378593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14963fe6-a85b-4f92-a59d-f6dd45ba6269 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.379311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14963fe6-a85b-4f92-a59d-f6dd45ba6269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.380940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14963fe6-a85b-4f92-a59d-f6dd45ba6269 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.391386 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 784/1574] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.391984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14963fe6-a85b-4f92-a59d-f6dd45ba6269 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.401736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14963fe6-a85b-4f92-a59d-f6dd45ba6269 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.405533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf22c-c2e4-4ba5-b854-5a87a5558fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.406214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf22c-c2e4-4ba5-b854-5a87a5558fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.406328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f7579-96df-4da4-afb9-19849d096dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.406494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf22c-c2e4-4ba5-b854-5a87a5558fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.406765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf22c-c2e4-4ba5-b854-5a87a5558fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.406842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f7579-96df-4da4-afb9-19849d096dbf admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.407115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f7579-96df-4da4-afb9-19849d096dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.407395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f7579-96df-4da4-afb9-19849d096dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.407479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf22c-c2e4-4ba5-b854-5a87a5558fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.408068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f7579-96df-4da4-afb9-19849d096dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.409348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf22c-c2e4-4ba5-b854-5a87a5558fb8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.409973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f7579-96df-4da4-afb9-19849d096dbf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.440571 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 785/1575] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.440739 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 791/1576] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.440821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f7579-96df-4da4-afb9-19849d096dbf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.440897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf22c-c2e4-4ba5-b854-5a87a5558fb8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.499542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf22c-c2e4-4ba5-b854-5a87a5558fb8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.499766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f7579-96df-4da4-afb9-19849d096dbf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.504250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a3ed-ab81-4942-b64c-b5cb161616a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.504425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fafcd5-1739-48a2-8bee-623f0bd10f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.504954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a3ed-ab81-4942-b64c-b5cb161616a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.505052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafcd5-1739-48a2-8bee-623f0bd10f43 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.505218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a3ed-ab81-4942-b64c-b5cb161616a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.505337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafcd5-1739-48a2-8bee-623f0bd10f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.505507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a3ed-ab81-4942-b64c-b5cb161616a6 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.505611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafcd5-1739-48a2-8bee-623f0bd10f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.506172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278a3ed-ab81-4942-b64c-b5cb161616a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.506289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fafcd5-1739-48a2-8bee-623f0bd10f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.508578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278a3ed-ab81-4942-b64c-b5cb161616a6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.508723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fafcd5-1739-48a2-8bee-623f0bd10f43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.529403 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 792/1577] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.530401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a3ed-ab81-4942-b64c-b5cb161616a6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.542054 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 786/1578] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.542229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a3ed-ab81-4942-b64c-b5cb161616a6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.542316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d584-0d07-4a4a-90ef-40ec22f2f159 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.542316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d584-0d07-4a4a-90ef-40ec22f2f159 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.542316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d584-0d07-4a4a-90ef-40ec22f2f159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.566632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f445d584-0d07-4a4a-90ef-40ec22f2f159 None None] MFA Rules not processed for user `563e834800474429ae488dcd94ac9f57`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:14.567764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f445d584-0d07-4a4a-90ef-40ec22f2f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:14.594488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aca4c-da31-4101-8f24-422da56a98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.595158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aca4c-da31-4101-8f24-422da56a98ca admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.595442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aca4c-da31-4101-8f24-422da56a98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.595741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aca4c-da31-4101-8f24-422da56a98ca admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.596465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aca4c-da31-4101-8f24-422da56a98ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.598428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aca4c-da31-4101-8f24-422da56a98ca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.620947 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 793/1579] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.620947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aca4c-da31-4101-8f24-422da56a98ca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.628133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aca4c-da31-4101-8f24-422da56a98ca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.630028 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 787/1580] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:14.630861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445d584-0d07-4a4a-90ef-40ec22f2f159 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.635402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f9cf-a2b7-48e1-b4e4-1746f69cc622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.636048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f9cf-a2b7-48e1-b4e4-1746f69cc622 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.636377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f9cf-a2b7-48e1-b4e4-1746f69cc622 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.636654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f9cf-a2b7-48e1-b4e4-1746f69cc622 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.637330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0f9cf-a2b7-48e1-b4e4-1746f69cc622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.639225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0f9cf-a2b7-48e1-b4e4-1746f69cc622 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.642266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445d584-0d07-4a4a-90ef-40ec22f2f159 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.647020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865bfd4-8263-4acf-99ff-14b20cdf6050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.647689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865bfd4-8263-4acf-99ff-14b20cdf6050 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.647966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865bfd4-8263-4acf-99ff-14b20cdf6050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.648848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865bfd4-8263-4acf-99ff-14b20cdf6050 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.649561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865bfd4-8263-4acf-99ff-14b20cdf6050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.651212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865bfd4-8263-4acf-99ff-14b20cdf6050 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.665399 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 794/1581] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.665399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f9cf-a2b7-48e1-b4e4-1746f69cc622 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.665622 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 788/1582] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.665622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865bfd4-8263-4acf-99ff-14b20cdf6050 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.670877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f9cf-a2b7-48e1-b4e4-1746f69cc622 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.675132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865bfd4-8263-4acf-99ff-14b20cdf6050 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.675518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4c5d-09ca-4d42-a8cd-01dd16821f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.676167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4c5d-09ca-4d42-a8cd-01dd16821f3c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.676846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4c5d-09ca-4d42-a8cd-01dd16821f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.677126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4c5d-09ca-4d42-a8cd-01dd16821f3c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.677826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc4c5d-09ca-4d42-a8cd-01dd16821f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.680414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc4c5d-09ca-4d42-a8cd-01dd16821f3c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.680644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e498-0bbd-44ff-b067-ce2048aa408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.681286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e498-0bbd-44ff-b067-ce2048aa408c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.681566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e498-0bbd-44ff-b067-ce2048aa408c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.681842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e498-0bbd-44ff-b067-ce2048aa408c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.682514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e498-0bbd-44ff-b067-ce2048aa408c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.684441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e498-0bbd-44ff-b067-ce2048aa408c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.701801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 795/1583] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.702749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4c5d-09ca-4d42-a8cd-01dd16821f3c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.708680 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 789/1584] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/users => generated 306 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.709420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e498-0bbd-44ff-b067-ce2048aa408c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.713242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4c5d-09ca-4d42-a8cd-01dd16821f3c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.717796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a327a-3f4b-4d2d-95e2-40f48e23d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.718452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a327a-3f4b-4d2d-95e2-40f48e23d500 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.718731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a327a-3f4b-4d2d-95e2-40f48e23d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.718962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e498-0bbd-44ff-b067-ce2048aa408c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.719069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a327a-3f4b-4d2d-95e2-40f48e23d500 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.719714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a327a-3f4b-4d2d-95e2-40f48e23d500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.721349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a327a-3f4b-4d2d-95e2-40f48e23d500 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.723685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f8f68-b571-458e-b5fa-abf5bf3ee2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.724414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f8f68-b571-458e-b5fa-abf5bf3ee2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.724623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f8f68-b571-458e-b5fa-abf5bf3ee2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.724897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f8f68-b571-458e-b5fa-abf5bf3ee2d6 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.725605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f8f68-b571-458e-b5fa-abf5bf3ee2d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.728009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f8f68-b571-458e-b5fa-abf5bf3ee2d6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.732304 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 796/1585] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.733169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a327a-3f4b-4d2d-95e2-40f48e23d500 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.743786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a327a-3f4b-4d2d-95e2-40f48e23d500 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.748628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae8014-f687-4339-9227-2c43692cde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.749268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae8014-f687-4339-9227-2c43692cde69 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.749576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae8014-f687-4339-9227-2c43692cde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.749857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae8014-f687-4339-9227-2c43692cde69 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.750275 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 790/1586] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/users => generated 291 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.750700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae8014-f687-4339-9227-2c43692cde69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.751131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f8f68-b571-458e-b5fa-abf5bf3ee2d6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.752280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae8014-f687-4339-9227-2c43692cde69 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.760720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f8f68-b571-458e-b5fa-abf5bf3ee2d6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.765597 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 797/1587] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.765597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae8014-f687-4339-9227-2c43692cde69 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.766025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6118f-ac8e-49ed-a46c-bbf0be30e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.766660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6118f-ac8e-49ed-a46c-bbf0be30e2ab admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.766939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6118f-ac8e-49ed-a46c-bbf0be30e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.767212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6118f-ac8e-49ed-a46c-bbf0be30e2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.767910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6118f-ac8e-49ed-a46c-bbf0be30e2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.769843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6118f-ac8e-49ed-a46c-bbf0be30e2ab admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.772824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae8014-f687-4339-9227-2c43692cde69 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.777329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224c48-6054-4a97-8ace-0e17a52d1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.778174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224c48-6054-4a97-8ace-0e17a52d1992 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.778794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224c48-6054-4a97-8ace-0e17a52d1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.778794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224c48-6054-4a97-8ace-0e17a52d1992 admin admin] PATH_INFO: `/v3/projects/6ce978d1edb7495f8cd3a785438db7cb/users/c303f360668549d59b1ddc4ff675a67c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.795036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224c48-6054-4a97-8ace-0e17a52d1992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce978d1edb7495f8cd3a785438db7cb, user_id=c303f360668549d59b1ddc4ff675a67c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.796576 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 791/1588] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:14.797532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6118f-ac8e-49ed-a46c-bbf0be30e2ab admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.797707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224c48-6054-4a97-8ace-0e17a52d1992 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.813001 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 798/1589] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:14 2022] PUT /identity/v3/projects/6ce978d1edb7495f8cd3a785438db7cb/users/c303f360668549d59b1ddc4ff675a67c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:14.813813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224c48-6054-4a97-8ace-0e17a52d1992 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.862865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6118f-ac8e-49ed-a46c-bbf0be30e2ab admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.878826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224c48-6054-4a97-8ace-0e17a52d1992 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.883963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2b25-c0b9-419a-9ea4-d175de5b642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.884730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2b25-c0b9-419a-9ea4-d175de5b642e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.885121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2b25-c0b9-419a-9ea4-d175de5b642e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.885428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2b25-c0b9-419a-9ea4-d175de5b642e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.886138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b2b25-c0b9-419a-9ea4-d175de5b642e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.887737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b2b25-c0b9-419a-9ea4-d175de5b642e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.897681 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 799/1590] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.899024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2b25-c0b9-419a-9ea4-d175de5b642e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.908723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2b25-c0b9-419a-9ea4-d175de5b642e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.913314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2ec8-119e-484c-8afc-33c02659704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.913997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2ec8-119e-484c-8afc-33c02659704f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.914278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2ec8-119e-484c-8afc-33c02659704f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.914550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2ec8-119e-484c-8afc-33c02659704f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.915258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2ec8-119e-484c-8afc-33c02659704f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.916957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2ec8-119e-484c-8afc-33c02659704f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.927127 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 800/1591] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.927980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2ec8-119e-484c-8afc-33c02659704f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.928835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18529b8c-1b06-4ac3-91e5-79bdaee5ce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.929545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18529b8c-1b06-4ac3-91e5-79bdaee5ce95 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.929826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18529b8c-1b06-4ac3-91e5-79bdaee5ce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.930115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18529b8c-1b06-4ac3-91e5-79bdaee5ce95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.930815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18529b8c-1b06-4ac3-91e5-79bdaee5ce95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.932449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18529b8c-1b06-4ac3-91e5-79bdaee5ce95 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.937908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2ec8-119e-484c-8afc-33c02659704f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.942226 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 792/1592] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.942681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73e7d1-e29c-491c-8620-3d9ab4d97407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.943003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18529b8c-1b06-4ac3-91e5-79bdaee5ce95 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.943466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e7d1-e29c-491c-8620-3d9ab4d97407 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.943893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e7d1-e29c-491c-8620-3d9ab4d97407 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.944176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e7d1-e29c-491c-8620-3d9ab4d97407 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.945779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73e7d1-e29c-491c-8620-3d9ab4d97407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.947254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73e7d1-e29c-491c-8620-3d9ab4d97407 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.952613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18529b8c-1b06-4ac3-91e5-79bdaee5ce95 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.957304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1bc4-8f4b-4ca6-94db-fc9c61dcaa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.957671 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 801/1593] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.958061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1bc4-8f4b-4ca6-94db-fc9c61dcaa27 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.958234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1bc4-8f4b-4ca6-94db-fc9c61dcaa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.958459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1bc4-8f4b-4ca6-94db-fc9c61dcaa27 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.958546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73e7d1-e29c-491c-8620-3d9ab4d97407 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.959155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd1bc4-8f4b-4ca6-94db-fc9c61dcaa27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.960800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd1bc4-8f4b-4ca6-94db-fc9c61dcaa27 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.970585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73e7d1-e29c-491c-8620-3d9ab4d97407 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.971223 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 793/1594] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.974895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1bc4-8f4b-4ca6-94db-fc9c61dcaa27 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:14.975436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b97790-9a98-4110-87a8-53bf9d4c916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.976081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b97790-9a98-4110-87a8-53bf9d4c916d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.976434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b97790-9a98-4110-87a8-53bf9d4c916d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.976712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b97790-9a98-4110-87a8-53bf9d4c916d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.977458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b97790-9a98-4110-87a8-53bf9d4c916d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.979052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b97790-9a98-4110-87a8-53bf9d4c916d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:14.984115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1bc4-8f4b-4ca6-94db-fc9c61dcaa27 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:14.989159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461d7be-7af8-4acf-85c6-f7620718bfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:14.989539 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 802/1595] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:14.989788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461d7be-7af8-4acf-85c6-f7620718bfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.990068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461d7be-7af8-4acf-85c6-f7620718bfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.990341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461d7be-7af8-4acf-85c6-f7620718bfe4 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.990957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53e40-716e-4b86-8a29-77a45cd22039 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:14.991056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461d7be-7af8-4acf-85c6-f7620718bfe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:14.991249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53e40-716e-4b86-8a29-77a45cd22039 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:14.991526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53e40-716e-4b86-8a29-77a45cd22039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:14.992943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461d7be-7af8-4acf-85c6-f7620718bfe4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.013822 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 794/1596] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/users => generated 303 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:15.014660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461d7be-7af8-4acf-85c6-f7620718bfe4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.019270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-90d53e40-716e-4b86-8a29-77a45cd22039 None None] MFA Rules not processed for user `c303f360668549d59b1ddc4ff675a67c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:15.020492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-90d53e40-716e-4b86-8a29-77a45cd22039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:15.025113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461d7be-7af8-4acf-85c6-f7620718bfe4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.029670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572bacc-850f-481a-a3a5-2ee3f4450694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.030307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bacc-850f-481a-a3a5-2ee3f4450694 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.030586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bacc-850f-481a-a3a5-2ee3f4450694 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.030869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bacc-850f-481a-a3a5-2ee3f4450694 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.031702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572bacc-850f-481a-a3a5-2ee3f4450694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.033339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572bacc-850f-481a-a3a5-2ee3f4450694 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.043604 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 795/1597] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:15.044371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572bacc-850f-481a-a3a5-2ee3f4450694 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.053641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572bacc-850f-481a-a3a5-2ee3f4450694 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.058462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5dc21-2cdb-4aa6-a843-e81ff4b93fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.059304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dc21-2cdb-4aa6-a843-e81ff4b93fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.059583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dc21-2cdb-4aa6-a843-e81ff4b93fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.059858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dc21-2cdb-4aa6-a843-e81ff4b93fcc admin admin] PATH_INFO: `/v3/projects/f79db8fc8f254f56ba402add28cffdb8/users/ee3a1bd2873b4cab9d8c1c285cb85e3a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.074361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5dc21-2cdb-4aa6-a843-e81ff4b93fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79db8fc8f254f56ba402add28cffdb8, user_id=ee3a1bd2873b4cab9d8c1c285cb85e3a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.077062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5dc21-2cdb-4aa6-a843-e81ff4b93fcc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.084618 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 803/1598] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:15.089548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53e40-716e-4b86-8a29-77a45cd22039 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.091082 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 796/1599] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:15 2022] PUT /identity/v3/projects/f79db8fc8f254f56ba402add28cffdb8/users/ee3a1bd2873b4cab9d8c1c285cb85e3a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:15.091963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5dc21-2cdb-4aa6-a843-e81ff4b93fcc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.099900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53e40-716e-4b86-8a29-77a45cd22039 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.151971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5dc21-2cdb-4aa6-a843-e81ff4b93fcc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.154103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eac3b-f42a-4d1a-9b74-31a58c473b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.154764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eac3b-f42a-4d1a-9b74-31a58c473b81 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.155047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eac3b-f42a-4d1a-9b74-31a58c473b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.155320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eac3b-f42a-4d1a-9b74-31a58c473b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.156022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03eac3b-f42a-4d1a-9b74-31a58c473b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.156667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea614b6a-c0a9-4693-adc8-a821865ed3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.157675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03eac3b-f42a-4d1a-9b74-31a58c473b81 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.157763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614b6a-c0a9-4693-adc8-a821865ed3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.157976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614b6a-c0a9-4693-adc8-a821865ed3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.158249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614b6a-c0a9-4693-adc8-a821865ed3fc admin admin] PATH_INFO: `/v3/projects/2dc25faea6464e2c833c8dc5059c36ea/users/3801404a24664f2ea16b09080638fdbe/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.168309 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 804/1600] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:15.169221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eac3b-f42a-4d1a-9b74-31a58c473b81 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.178374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea614b6a-c0a9-4693-adc8-a821865ed3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc25faea6464e2c833c8dc5059c36ea, user_id=3801404a24664f2ea16b09080638fdbe, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.179053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eac3b-f42a-4d1a-9b74-31a58c473b81 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.181057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea614b6a-c0a9-4693-adc8-a821865ed3fc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.183612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aefbc2-9cb0-4c2a-9093-924af7661793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.184247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aefbc2-9cb0-4c2a-9093-924af7661793 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.184555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aefbc2-9cb0-4c2a-9093-924af7661793 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.184831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aefbc2-9cb0-4c2a-9093-924af7661793 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.185649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aefbc2-9cb0-4c2a-9093-924af7661793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.187690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aefbc2-9cb0-4c2a-9093-924af7661793 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.194388 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 797/1601] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:15 2022] PUT /identity/v3/projects/2dc25faea6464e2c833c8dc5059c36ea/users/3801404a24664f2ea16b09080638fdbe/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:15.201534 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 805/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:15.201534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aefbc2-9cb0-4c2a-9093-924af7661793 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.201742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea614b6a-c0a9-4693-adc8-a821865ed3fc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.209871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aefbc2-9cb0-4c2a-9093-924af7661793 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.261802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea614b6a-c0a9-4693-adc8-a821865ed3fc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.265095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7a51-121b-4ecd-8715-e61cbf745b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.265758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7a51-121b-4ecd-8715-e61cbf745b7f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.266041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7a51-121b-4ecd-8715-e61cbf745b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.266313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7a51-121b-4ecd-8715-e61cbf745b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.266487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73c636-ddcc-44ac-884b-7398d187f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.267052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf7a51-121b-4ecd-8715-e61cbf745b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.267364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73c636-ddcc-44ac-884b-7398d187f763 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.267646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73c636-ddcc-44ac-884b-7398d187f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.267921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73c636-ddcc-44ac-884b-7398d187f763 admin admin] PATH_INFO: `/v3/projects/d1efa252dbb54b0388ea585b35ff2adc/users/a28c8d4a0cd0463ab812873436d87826/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.268728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf7a51-121b-4ecd-8715-e61cbf745b7f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.282109 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 806/1603] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:15.282109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7a51-121b-4ecd-8715-e61cbf745b7f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.283242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73c636-ddcc-44ac-884b-7398d187f763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1efa252dbb54b0388ea585b35ff2adc, user_id=a28c8d4a0cd0463ab812873436d87826, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.285919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73c636-ddcc-44ac-884b-7398d187f763 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.291749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7a51-121b-4ecd-8715-e61cbf745b7f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.296733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b42c0d-a4b6-4efe-89ba-9092e9fac02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.297587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42c0d-a4b6-4efe-89ba-9092e9fac02c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.297869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42c0d-a4b6-4efe-89ba-9092e9fac02c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.298131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42c0d-a4b6-4efe-89ba-9092e9fac02c admin admin] PATH_INFO: `/v3/projects/cc1d70d01ab44d8d8ef6124c77f91f3d/users/daf6561aecd44eb99b9eeb611d97cc9e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.299092 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 798/1604] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:15 2022] PUT /identity/v3/projects/d1efa252dbb54b0388ea585b35ff2adc/users/a28c8d4a0cd0463ab812873436d87826/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:15.299830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73c636-ddcc-44ac-884b-7398d187f763 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.313052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b42c0d-a4b6-4efe-89ba-9092e9fac02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1d70d01ab44d8d8ef6124c77f91f3d, user_id=daf6561aecd44eb99b9eeb611d97cc9e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.315908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b42c0d-a4b6-4efe-89ba-9092e9fac02c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.328774 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 807/1605] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:15 2022] PUT /identity/v3/projects/cc1d70d01ab44d8d8ef6124c77f91f3d/users/daf6561aecd44eb99b9eeb611d97cc9e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:15.337198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b42c0d-a4b6-4efe-89ba-9092e9fac02c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.371382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73c636-ddcc-44ac-884b-7398d187f763 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.396052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b42c0d-a4b6-4efe-89ba-9092e9fac02c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.401314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78239a33-d6b7-4c1f-81ff-1a656773b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.402029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239a33-d6b7-4c1f-81ff-1a656773b24e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.402264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239a33-d6b7-4c1f-81ff-1a656773b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.402539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239a33-d6b7-4c1f-81ff-1a656773b24e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.403292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78239a33-d6b7-4c1f-81ff-1a656773b24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.404914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78239a33-d6b7-4c1f-81ff-1a656773b24e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.415689 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 808/1606] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:15.416585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78239a33-d6b7-4c1f-81ff-1a656773b24e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.426133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78239a33-d6b7-4c1f-81ff-1a656773b24e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.427450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be212a1-750f-4ca1-b0cb-3bf4b7b75221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.428107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be212a1-750f-4ca1-b0cb-3bf4b7b75221 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.428430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be212a1-750f-4ca1-b0cb-3bf4b7b75221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.428692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be212a1-750f-4ca1-b0cb-3bf4b7b75221 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.429371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be212a1-750f-4ca1-b0cb-3bf4b7b75221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.431557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef34d6-b7e5-4802-914e-b0d6303709ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.431768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be212a1-750f-4ca1-b0cb-3bf4b7b75221 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.432595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef34d6-b7e5-4802-914e-b0d6303709ed admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.432903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef34d6-b7e5-4802-914e-b0d6303709ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.433185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef34d6-b7e5-4802-914e-b0d6303709ed admin admin] PATH_INFO: `/v3/projects/7b81c39f80304833be79ce951e0fb8c1/users/1bfe72a07e624ab095ce38f7cecb22cb/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.448285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef34d6-b7e5-4802-914e-b0d6303709ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b81c39f80304833be79ce951e0fb8c1, user_id=1bfe72a07e624ab095ce38f7cecb22cb, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.451658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef34d6-b7e5-4802-914e-b0d6303709ed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.459535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 799/1607] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:15.460559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be212a1-750f-4ca1-b0cb-3bf4b7b75221 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.467209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 809/1608] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:15 2022] PUT /identity/v3/projects/7b81c39f80304833be79ce951e0fb8c1/users/1bfe72a07e624ab095ce38f7cecb22cb/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:15.478902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1219-96b0-4aba-b495-85213a963b14 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.478902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1219-96b0-4aba-b495-85213a963b14 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.478902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1219-96b0-4aba-b495-85213a963b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.503778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a5af1219-96b0-4aba-b495-85213a963b14 None None] MFA Rules not processed for user `3801404a24664f2ea16b09080638fdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:15.505165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a5af1219-96b0-4aba-b495-85213a963b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:15.520484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be212a1-750f-4ca1-b0cb-3bf4b7b75221 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.525302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fbb86-3bec-4e52-b075-4bbf64fa912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.526211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbb86-3bec-4e52-b075-4bbf64fa912d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.526494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbb86-3bec-4e52-b075-4bbf64fa912d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.526773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbb86-3bec-4e52-b075-4bbf64fa912d admin admin] PATH_INFO: `/v3/projects/228f5017f5f74fbaa0f3b36b89acf4ee/users/a3685521a15b40c3a032b34a430be90f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.542725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fbb86-3bec-4e52-b075-4bbf64fa912d admin admin] RBAC: Authorizing `identity:create_grant(project_id=228f5017f5f74fbaa0f3b36b89acf4ee, user_id=a3685521a15b40c3a032b34a430be90f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.545456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fbb86-3bec-4e52-b075-4bbf64fa912d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.559059 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 800/1609] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:15 2022] PUT /identity/v3/projects/228f5017f5f74fbaa0f3b36b89acf4ee/users/a3685521a15b40c3a032b34a430be90f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:15.559851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fbb86-3bec-4e52-b075-4bbf64fa912d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.572370 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 810/1610] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:15.573882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c47c55-5b54-47da-85e2-0d949f5f0651 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.574176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c47c55-5b54-47da-85e2-0d949f5f0651 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.574452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c47c55-5b54-47da-85e2-0d949f5f0651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.600694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a3c47c55-5b54-47da-85e2-0d949f5f0651 None None] MFA Rules not processed for user `a28c8d4a0cd0463ab812873436d87826`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:15.602411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a3c47c55-5b54-47da-85e2-0d949f5f0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:15.631812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fbb86-3bec-4e52-b075-4bbf64fa912d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.636585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51590-3b68-4832-8724-99f40edfa886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.637460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51590-3b68-4832-8724-99f40edfa886 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.637742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51590-3b68-4832-8724-99f40edfa886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.638020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51590-3b68-4832-8724-99f40edfa886 admin admin] PATH_INFO: `/v3/projects/fd62f9b7316e459db4cbf9aa0670a386/users/9259ca72e41f474896b47c3c95bec856/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.651587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51590-3b68-4832-8724-99f40edfa886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd62f9b7316e459db4cbf9aa0670a386, user_id=9259ca72e41f474896b47c3c95bec856, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.654400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51590-3b68-4832-8724-99f40edfa886 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.665657 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 811/1611] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:15.666942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da769-c763-440f-baf0-082856a04265 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.667227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da769-c763-440f-baf0-082856a04265 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.667504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da769-c763-440f-baf0-082856a04265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.669236 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 801/1612] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:15 2022] PUT /identity/v3/projects/fd62f9b7316e459db4cbf9aa0670a386/users/9259ca72e41f474896b47c3c95bec856/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:15.670027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51590-3b68-4832-8724-99f40edfa886 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.693769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-720da769-c763-440f-baf0-082856a04265 None None] MFA Rules not processed for user `daf6561aecd44eb99b9eeb611d97cc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:15.694950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-720da769-c763-440f-baf0-082856a04265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:15.732040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51590-3b68-4832-8724-99f40edfa886 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.737170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464ca3-8385-4bd6-b144-ca4613ff666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.738047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464ca3-8385-4bd6-b144-ca4613ff666e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.738327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464ca3-8385-4bd6-b144-ca4613ff666e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.738605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464ca3-8385-4bd6-b144-ca4613ff666e admin admin] PATH_INFO: `/v3/projects/f79db8fc8f254f56ba402add28cffdb8/users/ee3a1bd2873b4cab9d8c1c285cb85e3a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.740592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d464ca3-8385-4bd6-b144-ca4613ff666e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79db8fc8f254f56ba402add28cffdb8, user_id=ee3a1bd2873b4cab9d8c1c285cb85e3a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.743825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d464ca3-8385-4bd6-b144-ca4613ff666e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.753929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 802/1613] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:15 2022] PUT /identity/v3/projects/f79db8fc8f254f56ba402add28cffdb8/users/ee3a1bd2873b4cab9d8c1c285cb85e3a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:15.754765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464ca3-8385-4bd6-b144-ca4613ff666e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.759198 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 812/1614] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:15.761676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5549bb-6d4f-4464-ba35-a79f605943a2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.761983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5549bb-6d4f-4464-ba35-a79f605943a2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.762342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5549bb-6d4f-4464-ba35-a79f605943a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.789111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9c5549bb-6d4f-4464-ba35-a79f605943a2 None None] MFA Rules not processed for user `1bfe72a07e624ab095ce38f7cecb22cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:15.790319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9c5549bb-6d4f-4464-ba35-a79f605943a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:15.818183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464ca3-8385-4bd6-b144-ca4613ff666e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.823764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387cd25-ddee-4f63-8729-d264dc7a88a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.824456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387cd25-ddee-4f63-8729-d264dc7a88a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.824888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387cd25-ddee-4f63-8729-d264dc7a88a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.825167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387cd25-ddee-4f63-8729-d264dc7a88a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.825856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387cd25-ddee-4f63-8729-d264dc7a88a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.827766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387cd25-ddee-4f63-8729-d264dc7a88a3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.849947 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 803/1615] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:15.853707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0d553-b81a-4cf7-ac74-7e86bb05d644 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.853992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0d553-b81a-4cf7-ac74-7e86bb05d644 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.854325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0d553-b81a-4cf7-ac74-7e86bb05d644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.856933 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 813/1616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:15.857790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5549bb-6d4f-4464-ba35-a79f605943a2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.868323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5549bb-6d4f-4464-ba35-a79f605943a2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.872857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b25b1-568f-4543-83c4-0e1efbd0ef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.873471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b25b1-568f-4543-83c4-0e1efbd0ef45 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.873755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b25b1-568f-4543-83c4-0e1efbd0ef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.874028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b25b1-568f-4543-83c4-0e1efbd0ef45 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.874704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b25b1-568f-4543-83c4-0e1efbd0ef45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.876626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b25b1-568f-4543-83c4-0e1efbd0ef45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:15.879683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-67e0d553-b81a-4cf7-ac74-7e86bb05d644 None None] MFA Rules not processed for user `a3685521a15b40c3a032b34a430be90f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:15.880905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67e0d553-b81a-4cf7-ac74-7e86bb05d644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:15.902732 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 814/1617] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:15.906936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b25b1-568f-4543-83c4-0e1efbd0ef45 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.944788 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 804/1618] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:15.946802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0d553-b81a-4cf7-ac74-7e86bb05d644 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:15.957621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0d553-b81a-4cf7-ac74-7e86bb05d644 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.968509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b25b1-568f-4543-83c4-0e1efbd0ef45 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:15.973099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a85418-0819-421d-b0fb-5ee99bd9fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:15.973751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85418-0819-421d-b0fb-5ee99bd9fb88 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:15.974030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85418-0819-421d-b0fb-5ee99bd9fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:15.974303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85418-0819-421d-b0fb-5ee99bd9fb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:15.974996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a85418-0819-421d-b0fb-5ee99bd9fb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:15.976940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a85418-0819-421d-b0fb-5ee99bd9fb88 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.008811 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 815/1619] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:15 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.009587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a85418-0819-421d-b0fb-5ee99bd9fb88 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.014338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c98260-f71f-43d1-b37b-926ee0d5a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.015015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98260-f71f-43d1-b37b-926ee0d5a2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.015292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98260-f71f-43d1-b37b-926ee0d5a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.015569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98260-f71f-43d1-b37b-926ee0d5a2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.016295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98260-f71f-43d1-b37b-926ee0d5a2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.017923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98260-f71f-43d1-b37b-926ee0d5a2c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.027998 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 805/1620] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:16.029278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94651-97f4-4323-aaee-29aedf447395 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.029569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94651-97f4-4323-aaee-29aedf447395 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.029849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e94651-97f4-4323-aaee-29aedf447395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.056036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-01e94651-97f4-4323-aaee-29aedf447395 None None] MFA Rules not processed for user `ee3a1bd2873b4cab9d8c1c285cb85e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:16.057266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-01e94651-97f4-4323-aaee-29aedf447395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:16.071546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a85418-0819-421d-b0fb-5ee99bd9fb88 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.076205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2306-e036-408d-bb01-d97a5decaaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.076898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2306-e036-408d-bb01-d97a5decaaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.077179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2306-e036-408d-bb01-d97a5decaaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.077483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2306-e036-408d-bb01-d97a5decaaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.078171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2306-e036-408d-bb01-d97a5decaaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.080047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2306-e036-408d-bb01-d97a5decaaa5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.105607 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 816/1621] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.106504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2306-e036-408d-bb01-d97a5decaaa5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.124502 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 806/1622] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:16.125642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e94651-97f4-4323-aaee-29aedf447395 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.136133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e94651-97f4-4323-aaee-29aedf447395 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.168470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2306-e036-408d-bb01-d97a5decaaa5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.172995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98e068-4545-4a62-af73-18d4985d9097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.173647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e068-4545-4a62-af73-18d4985d9097 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.173928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e068-4545-4a62-af73-18d4985d9097 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.174201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e068-4545-4a62-af73-18d4985d9097 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.174914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98e068-4545-4a62-af73-18d4985d9097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.176778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98e068-4545-4a62-af73-18d4985d9097 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.186425 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 817/1623] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:16.189222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98e068-4545-4a62-af73-18d4985d9097 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.191019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2f5f-b786-4a1f-b9a8-0b3ced500d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.191680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2f5f-b786-4a1f-b9a8-0b3ced500d09 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.191958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2f5f-b786-4a1f-b9a8-0b3ced500d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.192232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2f5f-b786-4a1f-b9a8-0b3ced500d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.192966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2f5f-b786-4a1f-b9a8-0b3ced500d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.194866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2f5f-b786-4a1f-b9a8-0b3ced500d09 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.198839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98e068-4545-4a62-af73-18d4985d9097 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.203363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ae932-ef2b-4ef9-8ec0-0569843daccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.203991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ae932-ef2b-4ef9-8ec0-0569843daccc admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.204271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ae932-ef2b-4ef9-8ec0-0569843daccc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.204582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ae932-ef2b-4ef9-8ec0-0569843daccc admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.205252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ae932-ef2b-4ef9-8ec0-0569843daccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.207114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ae932-ef2b-4ef9-8ec0-0569843daccc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.220292 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 807/1624] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.221429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2f5f-b786-4a1f-b9a8-0b3ced500d09 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.229928 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 818/1625] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/users => generated 301 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.229928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ae932-ef2b-4ef9-8ec0-0569843daccc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.237119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ae932-ef2b-4ef9-8ec0-0569843daccc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.281796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2f5f-b786-4a1f-b9a8-0b3ced500d09 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.286490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781df1-db37-4707-97ef-2e05a8cfe050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.287142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781df1-db37-4707-97ef-2e05a8cfe050 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.287524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781df1-db37-4707-97ef-2e05a8cfe050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.287803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781df1-db37-4707-97ef-2e05a8cfe050 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.288514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781df1-db37-4707-97ef-2e05a8cfe050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.291019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781df1-db37-4707-97ef-2e05a8cfe050 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.291959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f98eb-0939-48ae-8ca4-65479596c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.292652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f98eb-0939-48ae-8ca4-65479596c668 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.292933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f98eb-0939-48ae-8ca4-65479596c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.293206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f98eb-0939-48ae-8ca4-65479596c668 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.293880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f98eb-0939-48ae-8ca4-65479596c668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.295746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f98eb-0939-48ae-8ca4-65479596c668 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.316611 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 808/1626] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.320121 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 819/1627] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.320235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781df1-db37-4707-97ef-2e05a8cfe050 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.320375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f98eb-0939-48ae-8ca4-65479596c668 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.327618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f98eb-0939-48ae-8ca4-65479596c668 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.378491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781df1-db37-4707-97ef-2e05a8cfe050 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.383141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2817a4-a8e7-455d-a724-4715054ff581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.383395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b18dc1-55a8-4b46-b354-98315d18124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.384021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2817a4-a8e7-455d-a724-4715054ff581 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.384278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b18dc1-55a8-4b46-b354-98315d18124f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.384406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2817a4-a8e7-455d-a724-4715054ff581 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.384589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2817a4-a8e7-455d-a724-4715054ff581 admin admin] PATH_INFO: `/v3/projects/fd62f9b7316e459db4cbf9aa0670a386/users/9259ca72e41f474896b47c3c95bec856/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.384677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b18dc1-55a8-4b46-b354-98315d18124f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.384867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b18dc1-55a8-4b46-b354-98315d18124f admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.385562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b18dc1-55a8-4b46-b354-98315d18124f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.386785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2817a4-a8e7-455d-a724-4715054ff581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd62f9b7316e459db4cbf9aa0670a386, user_id=9259ca72e41f474896b47c3c95bec856, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.387481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b18dc1-55a8-4b46-b354-98315d18124f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.389705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2817a4-a8e7-455d-a724-4715054ff581 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.401475 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 809/1628] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:16 2022] PUT /identity/v3/projects/fd62f9b7316e459db4cbf9aa0670a386/users/9259ca72e41f474896b47c3c95bec856/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:16.402859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959763-fe0f-4f96-8199-c261971e3e0a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.403146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959763-fe0f-4f96-8199-c261971e3e0a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.403430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959763-fe0f-4f96-8199-c261971e3e0a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.405319 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 810/1629] 10.222.0.30 () {54 vars in 961 bytes} [Sat Feb 19 20:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:16.405812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959763-fe0f-4f96-8199-c261971e3e0a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.409044 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 820/1630] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.409954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b18dc1-55a8-4b46-b354-98315d18124f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.422353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b18dc1-55a8-4b46-b354-98315d18124f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.477101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959763-fe0f-4f96-8199-c261971e3e0a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.477290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762948b4-2ff1-4f13-9dd3-d9faf1696ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.477929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762948b4-2ff1-4f13-9dd3-d9faf1696ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.478215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762948b4-2ff1-4f13-9dd3-d9faf1696ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.478479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762948b4-2ff1-4f13-9dd3-d9faf1696ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.479154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762948b4-2ff1-4f13-9dd3-d9faf1696ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.481079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762948b4-2ff1-4f13-9dd3-d9faf1696ef3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.481886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e831066-6add-4212-ae85-642213026c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.482761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831066-6add-4212-ae85-642213026c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.483041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831066-6add-4212-ae85-642213026c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.483315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831066-6add-4212-ae85-642213026c1e admin admin] PATH_INFO: `/v3/projects/790c1e2b25a64688b2ebe5dcad497078/users/fce86d6285a14df09885a6ceb2bac284/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.497813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e831066-6add-4212-ae85-642213026c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=790c1e2b25a64688b2ebe5dcad497078, user_id=fce86d6285a14df09885a6ceb2bac284, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.500448 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 821/1631] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.500566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e831066-6add-4212-ae85-642213026c1e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.501257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762948b4-2ff1-4f13-9dd3-d9faf1696ef3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.510914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762948b4-2ff1-4f13-9dd3-d9faf1696ef3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.513617 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 811/1632] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:16 2022] PUT /identity/v3/projects/790c1e2b25a64688b2ebe5dcad497078/users/fce86d6285a14df09885a6ceb2bac284/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:16.514711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e831066-6add-4212-ae85-642213026c1e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.566661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1187e6-f3c9-41c9-9be6-09dac6cf262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.567452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1187e6-f3c9-41c9-9be6-09dac6cf262f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.567739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1187e6-f3c9-41c9-9be6-09dac6cf262f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.568088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1187e6-f3c9-41c9-9be6-09dac6cf262f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.568828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1187e6-f3c9-41c9-9be6-09dac6cf262f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.571015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1187e6-f3c9-41c9-9be6-09dac6cf262f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.574958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e831066-6add-4212-ae85-642213026c1e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.579716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c0f7d-c52b-49ad-9dc3-54fc0c94e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.580398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0f7d-c52b-49ad-9dc3-54fc0c94e0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.580669 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 822/1633] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:16.580753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0f7d-c52b-49ad-9dc3-54fc0c94e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.580942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0f7d-c52b-49ad-9dc3-54fc0c94e0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.581457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1187e6-f3c9-41c9-9be6-09dac6cf262f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.581704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c0f7d-c52b-49ad-9dc3-54fc0c94e0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.583994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c0f7d-c52b-49ad-9dc3-54fc0c94e0f5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.590756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1187e6-f3c9-41c9-9be6-09dac6cf262f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.595631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee1f11-bb7d-45e9-8897-54c2cb4edb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.596293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1f11-bb7d-45e9-8897-54c2cb4edb64 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.596645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1f11-bb7d-45e9-8897-54c2cb4edb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.596923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1f11-bb7d-45e9-8897-54c2cb4edb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.597699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee1f11-bb7d-45e9-8897-54c2cb4edb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.599334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee1f11-bb7d-45e9-8897-54c2cb4edb64 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.603791 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 812/1634] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:16.605092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3042c-6bc9-40b0-80aa-0b54b6b119c0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.605376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3042c-6bc9-40b0-80aa-0b54b6b119c0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.605783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3042c-6bc9-40b0-80aa-0b54b6b119c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.609689 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 823/1635] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:16.610535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee1f11-bb7d-45e9-8897-54c2cb4edb64 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.620482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee1f11-bb7d-45e9-8897-54c2cb4edb64 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.625156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42467b-85d1-42ed-b117-55fa6fb30830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.625807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42467b-85d1-42ed-b117-55fa6fb30830 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.626080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42467b-85d1-42ed-b117-55fa6fb30830 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.626387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42467b-85d1-42ed-b117-55fa6fb30830 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.627094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42467b-85d1-42ed-b117-55fa6fb30830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.627878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dde3042c-6bc9-40b0-80aa-0b54b6b119c0 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:16.628715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42467b-85d1-42ed-b117-55fa6fb30830 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.629112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dde3042c-6bc9-40b0-80aa-0b54b6b119c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:16.639737 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 824/1636] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:16.640995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475be23-c914-4283-bac3-2d93cb3a1918 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.641274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475be23-c914-4283-bac3-2d93cb3a1918 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.641554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475be23-c914-4283-bac3-2d93cb3a1918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.668288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6475be23-c914-4283-bac3-2d93cb3a1918 None None] MFA Rules not processed for user `9259ca72e41f474896b47c3c95bec856`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:16.669646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6475be23-c914-4283-bac3-2d93cb3a1918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:16.698360 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 813/1637] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:16.699176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3042c-6bc9-40b0-80aa-0b54b6b119c0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.710005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3042c-6bc9-40b0-80aa-0b54b6b119c0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.714723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470eadd-0cc8-4414-ac91-ff82bb1c6e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.715457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470eadd-0cc8-4414-ac91-ff82bb1c6e2d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.715811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470eadd-0cc8-4414-ac91-ff82bb1c6e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.716153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470eadd-0cc8-4414-ac91-ff82bb1c6e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.716900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470eadd-0cc8-4414-ac91-ff82bb1c6e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.718483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470eadd-0cc8-4414-ac91-ff82bb1c6e2d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.729285 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 814/1638] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:16.729925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470eadd-0cc8-4414-ac91-ff82bb1c6e2d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.739278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470eadd-0cc8-4414-ac91-ff82bb1c6e2d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.742809 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 825/1639] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:16.743649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475be23-c914-4283-bac3-2d93cb3a1918 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.746333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f71a3-56f1-4324-a550-ba7a04483914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.746986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f71a3-56f1-4324-a550-ba7a04483914 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.747264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f71a3-56f1-4324-a550-ba7a04483914 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.747539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f71a3-56f1-4324-a550-ba7a04483914 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.749049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f71a3-56f1-4324-a550-ba7a04483914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.749960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f71a3-56f1-4324-a550-ba7a04483914 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.753764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475be23-c914-4283-bac3-2d93cb3a1918 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.759315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893eece-0a13-450c-b68c-120361034c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.760193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893eece-0a13-450c-b68c-120361034c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.760510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893eece-0a13-450c-b68c-120361034c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.760790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893eece-0a13-450c-b68c-120361034c95 admin admin] PATH_INFO: `/v3/projects/bd2bcc5422a34317a0fb2ff41640de11/users/232cca5493764f53af264109b568c05b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.764621 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 815/1640] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:16.764621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f71a3-56f1-4324-a550-ba7a04483914 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.774008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f71a3-56f1-4324-a550-ba7a04483914 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.778615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893eece-0a13-450c-b68c-120361034c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2bcc5422a34317a0fb2ff41640de11, user_id=232cca5493764f53af264109b568c05b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.778746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830633ab-a56e-4856-a18b-5d3eee4827dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.779365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830633ab-a56e-4856-a18b-5d3eee4827dd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.779656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830633ab-a56e-4856-a18b-5d3eee4827dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.779935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830633ab-a56e-4856-a18b-5d3eee4827dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.780669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830633ab-a56e-4856-a18b-5d3eee4827dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.781320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893eece-0a13-450c-b68c-120361034c95 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.782223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830633ab-a56e-4856-a18b-5d3eee4827dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.792728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 816/1641] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:16.797727 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 826/1642] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:16 2022] PUT /identity/v3/projects/bd2bcc5422a34317a0fb2ff41640de11/users/232cca5493764f53af264109b568c05b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:16.797861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830633ab-a56e-4856-a18b-5d3eee4827dd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.797970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893eece-0a13-450c-b68c-120361034c95 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.807799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830633ab-a56e-4856-a18b-5d3eee4827dd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.858210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893eece-0a13-450c-b68c-120361034c95 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.862461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee8a01-8248-4a59-9c88-c6e708692031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.862891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa21d9-e2fa-494f-88c3-aea07ed4a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.863332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee8a01-8248-4a59-9c88-c6e708692031 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.863612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee8a01-8248-4a59-9c88-c6e708692031 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.863765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa21d9-e2fa-494f-88c3-aea07ed4a848 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.863885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee8a01-8248-4a59-9c88-c6e708692031 admin admin] PATH_INFO: `/v3/projects/763f11eb0f934755ae2e08a2f7b1d368/users/7604c5d28ebf45ba897c63a832c777ab/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.864049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa21d9-e2fa-494f-88c3-aea07ed4a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.864349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa21d9-e2fa-494f-88c3-aea07ed4a848 admin admin] PATH_INFO: `/v3/projects/9fb24ec981a74b7aa0b4b8bafb167f0f/users/bacd9663dbde4ef5b20e476122d70a81/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.877579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee8a01-8248-4a59-9c88-c6e708692031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763f11eb0f934755ae2e08a2f7b1d368, user_id=7604c5d28ebf45ba897c63a832c777ab, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.878156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa21d9-e2fa-494f-88c3-aea07ed4a848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb24ec981a74b7aa0b4b8bafb167f0f, user_id=bacd9663dbde4ef5b20e476122d70a81, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.880203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee8a01-8248-4a59-9c88-c6e708692031 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.880812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa21d9-e2fa-494f-88c3-aea07ed4a848 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.894219 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 817/1643] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:16 2022] PUT /identity/v3/projects/763f11eb0f934755ae2e08a2f7b1d368/users/7604c5d28ebf45ba897c63a832c777ab/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:16.895004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee8a01-8248-4a59-9c88-c6e708692031 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.895305 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 827/1644] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:16 2022] PUT /identity/v3/projects/9fb24ec981a74b7aa0b4b8bafb167f0f/users/bacd9663dbde4ef5b20e476122d70a81/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:16.896171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa21d9-e2fa-494f-88c3-aea07ed4a848 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:16.956418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa21d9-e2fa-494f-88c3-aea07ed4a848 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.961736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056619ee-74ff-4c10-80fa-0f2cc0553b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:16.962611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056619ee-74ff-4c10-80fa-0f2cc0553b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:16.962897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056619ee-74ff-4c10-80fa-0f2cc0553b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:16.963171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056619ee-74ff-4c10-80fa-0f2cc0553b3e admin admin] PATH_INFO: `/v3/projects/1e80e95835624c239d13e2a884507496/users/ff007271269d4562914cc082aeea6fea/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:16.964405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee8a01-8248-4a59-9c88-c6e708692031 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:16.977532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056619ee-74ff-4c10-80fa-0f2cc0553b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e80e95835624c239d13e2a884507496, user_id=ff007271269d4562914cc082aeea6fea, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:16.980180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056619ee-74ff-4c10-80fa-0f2cc0553b3e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:16.992925 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 828/1645] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:16 2022] PUT /identity/v3/projects/1e80e95835624c239d13e2a884507496/users/ff007271269d4562914cc082aeea6fea/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:16.993717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056619ee-74ff-4c10-80fa-0f2cc0553b3e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.026583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5faf32-64af-4e83-8b66-b5c17d31211b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.027325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5faf32-64af-4e83-8b66-b5c17d31211b service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.027606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5faf32-64af-4e83-8b66-b5c17d31211b service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.027879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5faf32-64af-4e83-8b66-b5c17d31211b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.054049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056619ee-74ff-4c10-80fa-0f2cc0553b3e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.059751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.060733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.061041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.061357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] PATH_INFO: `/v3/users/563e834800474429ae488dcd94ac9f57` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.062989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563e834800474429ae488dcd94ac9f57)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.064379 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:17.064379 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:50:17.064379 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:50:17.065590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.086904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5faf32-64af-4e83-8b66-b5c17d31211b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.088611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5faf32-64af-4e83-8b66-b5c17d31211b service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.097978 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 818/1646] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:17.098742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5faf32-64af-4e83-8b66-b5c17d31211b service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.109811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5faf32-64af-4e83-8b66-b5c17d31211b service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.114812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e3083-5857-43c3-b7f0-55bc4cec995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.115751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3083-5857-43c3-b7f0-55bc4cec995f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.116047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3083-5857-43c3-b7f0-55bc4cec995f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.116311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3083-5857-43c3-b7f0-55bc4cec995f admin admin] PATH_INFO: `/v3/projects/790c1e2b25a64688b2ebe5dcad497078/users/fce86d6285a14df09885a6ceb2bac284/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.118355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e3083-5857-43c3-b7f0-55bc4cec995f admin admin] RBAC: Authorizing `identity:create_grant(project_id=790c1e2b25a64688b2ebe5dcad497078, user_id=fce86d6285a14df09885a6ceb2bac284, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.121008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e3083-5857-43c3-b7f0-55bc4cec995f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.129393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563e834800474429ae488dcd94ac9f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:17.131969 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 819/1647] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:17 2022] PUT /identity/v3/projects/790c1e2b25a64688b2ebe5dcad497078/users/fce86d6285a14df09885a6ceb2bac284/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:17.135238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e3083-5857-43c3-b7f0-55bc4cec995f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.152404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563e834800474429ae488dcd94ac9f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:17.161026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563e834800474429ae488dcd94ac9f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:17.161684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563e834800474429ae488dcd94ac9f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:17.162312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563e834800474429ae488dcd94ac9f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:17.182502 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 829/1648] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:16 2022] DELETE /identity/v3/users/563e834800474429ae488dcd94ac9f57 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:17.182502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.182502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.201140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e3083-5857-43c3-b7f0-55bc4cec995f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.247063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be756d8-4baf-40c6-8e43-73018ed85609 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.251728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.252413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.252725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.253019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.253741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.255326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.259057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.260091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.260450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.260691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] PATH_INFO: `/v3/projects/72323667f1d34f32bbbd2d029de40a05/users/005603b8db46466fa1d03266ba805226/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.266007 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 830/1649] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:17.266699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.268314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.278627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72323667f1d34f32bbbd2d029de40a05, user_id=005603b8db46466fa1d03266ba805226, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.281363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.281954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c36f36-3839-4890-aaf3-ef5369347084 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.287895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.288584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.289547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.289854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.290582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.292142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.295481 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 820/1650] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:17 2022] PUT /identity/v3/projects/72323667f1d34f32bbbd2d029de40a05/users/005603b8db46466fa1d03266ba805226/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:17.296058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.297742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.305932 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 831/1651] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:17.305932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.308775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.321578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4717b1e-261b-4612-93b8-1bf42c46baae admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.361763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d9b7f-c5af-4760-bb67-a36d87629878 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.377073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd51b-8acf-4a01-86e0-903ce8e6e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.377755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd51b-8acf-4a01-86e0-903ce8e6e047 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.378037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd51b-8acf-4a01-86e0-903ce8e6e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.378317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd51b-8acf-4a01-86e0-903ce8e6e047 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.379822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cd51b-8acf-4a01-86e0-903ce8e6e047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.381533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cd51b-8acf-4a01-86e0-903ce8e6e047 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.385758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff45d8f-c684-41b1-a160-90e0d8582bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.386431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff45d8f-c684-41b1-a160-90e0d8582bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.386711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff45d8f-c684-41b1-a160-90e0d8582bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.386985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff45d8f-c684-41b1-a160-90e0d8582bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.387701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff45d8f-c684-41b1-a160-90e0d8582bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.389330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff45d8f-c684-41b1-a160-90e0d8582bd6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.395867 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 821/1652] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:17.395867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae433f5-656f-428e-968d-a2f5619c2309 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.395867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae433f5-656f-428e-968d-a2f5619c2309 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.395867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae433f5-656f-428e-968d-a2f5619c2309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.403220 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 832/1653] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:17.403220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afbdd3-384b-4cb3-9835-38f700f3d8e2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.403220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afbdd3-384b-4cb3-9835-38f700f3d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.403220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afbdd3-384b-4cb3-9835-38f700f3d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.420103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c4afbdd3-384b-4cb3-9835-38f700f3d8e2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:17.421564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c4afbdd3-384b-4cb3-9835-38f700f3d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.422642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9ae433f5-656f-428e-968d-a2f5619c2309 None None] MFA Rules not processed for user `fce86d6285a14df09885a6ceb2bac284`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:17.423901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9ae433f5-656f-428e-968d-a2f5619c2309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.430662 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 833/1654] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:17.431538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afbdd3-384b-4cb3-9835-38f700f3d8e2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.447114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afbdd3-384b-4cb3-9835-38f700f3d8e2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.452112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.453082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.453423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.453761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] PATH_INFO: `/v3/projects/bd2bcc5422a34317a0fb2ff41640de11/users/232cca5493764f53af264109b568c05b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.456190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2bcc5422a34317a0fb2ff41640de11, user_id=232cca5493764f53af264109b568c05b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.458902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.469367 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 834/1655] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:17 2022] PUT /identity/v3/projects/bd2bcc5422a34317a0fb2ff41640de11/users/232cca5493764f53af264109b568c05b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:17.470043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.471671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.504554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 822/1656] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:17.505405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae433f5-656f-428e-968d-a2f5619c2309 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.518004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae433f5-656f-428e-968d-a2f5619c2309 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.539721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1275-0a7f-41cd-8c35-9f512f540afe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.544618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b002-f905-4f84-b98a-bf5a2e563fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.545473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b002-f905-4f84-b98a-bf5a2e563fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.545912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b002-f905-4f84-b98a-bf5a2e563fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.546092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b002-f905-4f84-b98a-bf5a2e563fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.546817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2b002-f905-4f84-b98a-bf5a2e563fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.548783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2b002-f905-4f84-b98a-bf5a2e563fc3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.560251 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 835/1657] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:17.561244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b002-f905-4f84-b98a-bf5a2e563fc3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.572019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b002-f905-4f84-b98a-bf5a2e563fc3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.576675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3c184-078f-42eb-b83b-0679aa276511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.576902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.577561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c184-078f-42eb-b83b-0679aa276511 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.577744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.577834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c184-078f-42eb-b83b-0679aa276511 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.578061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.578169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c184-078f-42eb-b83b-0679aa276511 admin admin] PATH_INFO: `/v3/projects/763f11eb0f934755ae2e08a2f7b1d368/users/7604c5d28ebf45ba897c63a832c777ab/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.578349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] PATH_INFO: `/v3/projects/9fb24ec981a74b7aa0b4b8bafb167f0f/users/bacd9663dbde4ef5b20e476122d70a81/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.580389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3c184-078f-42eb-b83b-0679aa276511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763f11eb0f934755ae2e08a2f7b1d368, user_id=7604c5d28ebf45ba897c63a832c777ab, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.580620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb24ec981a74b7aa0b4b8bafb167f0f, user_id=bacd9663dbde4ef5b20e476122d70a81, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.583012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3c184-078f-42eb-b83b-0679aa276511 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.583396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.604434 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 823/1658] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:17 2022] PUT /identity/v3/projects/763f11eb0f934755ae2e08a2f7b1d368/users/7604c5d28ebf45ba897c63a832c777ab/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:17.604434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3c184-078f-42eb-b83b-0679aa276511 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.604927 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 836/1659] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:17 2022] PUT /identity/v3/projects/9fb24ec981a74b7aa0b4b8bafb167f0f/users/bacd9663dbde4ef5b20e476122d70a81/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:17.604927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.606778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.686261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e3daf-a74b-4feb-9961-6cb645777658 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.689680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3c184-078f-42eb-b83b-0679aa276511 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.690884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.691768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.692193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.692648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.759031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7a051-0fc0-4b7d-9ae8-8f7648bd5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.760130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a051-0fc0-4b7d-9ae8-8f7648bd5361 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.760536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a051-0fc0-4b7d-9ae8-8f7648bd5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.760907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a051-0fc0-4b7d-9ae8-8f7648bd5361 admin admin] PATH_INFO: `/v3/projects/1e80e95835624c239d13e2a884507496/users/ff007271269d4562914cc082aeea6fea/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.763155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7a051-0fc0-4b7d-9ae8-8f7648bd5361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e80e95835624c239d13e2a884507496, user_id=ff007271269d4562914cc082aeea6fea, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.766049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7a051-0fc0-4b7d-9ae8-8f7648bd5361 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.766950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.768408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.778172 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 824/1660] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:17 2022] PUT /identity/v3/projects/1e80e95835624c239d13e2a884507496/users/ff007271269d4562914cc082aeea6fea/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:17.779273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd9c8-4e58-4b6e-9e8d-40907f001954 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.779563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd9c8-4e58-4b6e-9e8d-40907f001954 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.779843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd9c8-4e58-4b6e-9e8d-40907f001954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.788611 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 837/1661] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:17.789728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.791345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.813466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b2acd9c8-4e58-4b6e-9e8d-40907f001954 None None] MFA Rules not processed for user `232cca5493764f53af264109b568c05b`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:17.814664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b2acd9c8-4e58-4b6e-9e8d-40907f001954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.872092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d825-8c7c-41a8-94b7-3c6415d0fc7a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.889270 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 825/1662] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:17.895435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd9c8-4e58-4b6e-9e8d-40907f001954 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:17.942013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6445910-de9b-4f66-a75a-3bfaffe6d90d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.942751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445910-de9b-4f66-a75a-3bfaffe6d90d service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.943104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445910-de9b-4f66-a75a-3bfaffe6d90d service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.943449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445910-de9b-4f66-a75a-3bfaffe6d90d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.945584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f6445910-de9b-4f66-a75a-3bfaffe6d90d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:17.958727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd9c8-4e58-4b6e-9e8d-40907f001954 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:17.965249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ffad4-7f8f-48da-8839-6b680556a603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:17.967087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ffad4-7f8f-48da-8839-6b680556a603 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.967495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ffad4-7f8f-48da-8839-6b680556a603 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.970215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ffad4-7f8f-48da-8839-6b680556a603 admin admin] PATH_INFO: `/v3/projects/72323667f1d34f32bbbd2d029de40a05/users/005603b8db46466fa1d03266ba805226/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:17.975480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ffad4-7f8f-48da-8839-6b680556a603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72323667f1d34f32bbbd2d029de40a05, user_id=005603b8db46466fa1d03266ba805226, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:17.979255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ffad4-7f8f-48da-8839-6b680556a603 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:17.990468 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 826/1663] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:17 2022] PUT /identity/v3/projects/72323667f1d34f32bbbd2d029de40a05/users/005603b8db46466fa1d03266ba805226/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:17.992062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240311-4b1c-431d-aab4-a64413f45bae None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:17.992390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240311-4b1c-431d-aab4-a64413f45bae None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:17.992679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240311-4b1c-431d-aab4-a64413f45bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.020678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-89240311-4b1c-431d-aab4-a64413f45bae None None] MFA Rules not processed for user `bacd9663dbde4ef5b20e476122d70a81`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:18.021820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-89240311-4b1c-431d-aab4-a64413f45bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.029842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6445910-de9b-4f66-a75a-3bfaffe6d90d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:18.031461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6445910-de9b-4f66-a75a-3bfaffe6d90d service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:18.042192 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 838/1664] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:18.043389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255201d9-b6a3-4abc-bd6f-ec560348dc5a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.044001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255201d9-b6a3-4abc-bd6f-ec560348dc5a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.044288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255201d9-b6a3-4abc-bd6f-ec560348dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.078416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-255201d9-b6a3-4abc-bd6f-ec560348dc5a None None] MFA Rules not processed for user `7604c5d28ebf45ba897c63a832c777ab`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:18.079676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-255201d9-b6a3-4abc-bd6f-ec560348dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.111416 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 827/1665] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:18.111416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5544-d2cc-4021-b064-7f98c8566015 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.111416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5544-d2cc-4021-b064-7f98c8566015 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.111416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5544-d2cc-4021-b064-7f98c8566015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.145569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4cbf5544-d2cc-4021-b064-7f98c8566015 None None] MFA Rules not processed for user `ff007271269d4562914cc082aeea6fea`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:18.146805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4cbf5544-d2cc-4021-b064-7f98c8566015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.158487 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 839/1666] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:18.161767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9802-fec5-486f-8001-fc48ffeb4f8e None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.162085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9802-fec5-486f-8001-fc48ffeb4f8e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.162398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9802-fec5-486f-8001-fc48ffeb4f8e None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.164227 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 840/1667] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:18.165314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a78fdc-bc42-48db-9c46-e8da0cff34b0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.165608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a78fdc-bc42-48db-9c46-e8da0cff34b0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.165899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a78fdc-bc42-48db-9c46-e8da0cff34b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.192870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-15a78fdc-bc42-48db-9c46-e8da0cff34b0 None None] MFA Rules not processed for user `005603b8db46466fa1d03266ba805226`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:18.194111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-15a78fdc-bc42-48db-9c46-e8da0cff34b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.220320 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 828/1668] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:18.225596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5544-d2cc-4021-b064-7f98c8566015 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:18.227440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4cbf5544-d2cc-4021-b064-7f98c8566015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.265296 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 841/1669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:18.266134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a78fdc-bc42-48db-9c46-e8da0cff34b0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:18.294128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5544-d2cc-4021-b064-7f98c8566015 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:18.299504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:18.300389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.300672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.300945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] PATH_INFO: `/v3/users/c303f360668549d59b1ddc4ff675a67c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.302430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c303f360668549d59b1ddc4ff675a67c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:18.304316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:18.336176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a78fdc-bc42-48db-9c46-e8da0cff34b0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:18.342430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637d4cb-260e-4b47-b974-ab7fc08c19ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:18.343089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d4cb-260e-4b47-b974-ab7fc08c19ad service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.343373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d4cb-260e-4b47-b974-ab7fc08c19ad service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.343649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d4cb-260e-4b47-b974-ab7fc08c19ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.351771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c303f360668549d59b1ddc4ff675a67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.352513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c303f360668549d59b1ddc4ff675a67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.353128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c303f360668549d59b1ddc4ff675a67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.364843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c303f360668549d59b1ddc4ff675a67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.373253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c303f360668549d59b1ddc4ff675a67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.385247 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 829/1670] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:18 2022] DELETE /identity/v3/users/c303f360668549d59b1ddc4ff675a67c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:18.386043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:18.387364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.402746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637d4cb-260e-4b47-b974-ab7fc08c19ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:18.404450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637d4cb-260e-4b47-b974-ab7fc08c19ad service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:18.414257 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 842/1671] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:18.417694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76c0f-d9c9-4558-83c4-9a061d18b590 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.417985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76c0f-d9c9-4558-83c4-9a061d18b590 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.418264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76c0f-d9c9-4558-83c4-9a061d18b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.439140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cce76c0f-d9c9-4558-83c4-9a061d18b590 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:18.440491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cce76c0f-d9c9-4558-83c4-9a061d18b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.457131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a9830-e553-4ff6-8aee-c24ce127a827 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:18.465566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:18.467237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.467872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.468579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] PATH_INFO: `/v3/projects/38884f43b2424f239815bc0f2f277c5a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.470197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38884f43b2424f239815bc0f2f277c5a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:18.471365 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:18.471365 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:50:18.471365 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:50:18.472843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:18.510100 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 843/1672] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:18.513842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e478ef-48fb-4f39-abe9-66074a590488 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.514275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e478ef-48fb-4f39-abe9-66074a590488 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.514951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e478ef-48fb-4f39-abe9-66074a590488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.532417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38884f43b2424f239815bc0f2f277c5a', 'request_id': 'req-7d5c0181-282c-47b3-989b-70730d7b6877'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.540243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38884f43b2424f239815bc0f2f277c5a', 'request_id': 'req-7d5c0181-282c-47b3-989b-70730d7b6877'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.545541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-92e478ef-48fb-4f39-abe9-66074a590488 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:18.547161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-92e478ef-48fb-4f39-abe9-66074a590488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.550311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38884f43b2424f239815bc0f2f277c5a', 'request_id': 'req-7d5c0181-282c-47b3-989b-70730d7b6877'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.569686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] The token cache is being invalidate because project 38884f43b2424f239815bc0f2f277c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:18.570746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.571457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.573071 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 830/1673] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:18 2022] DELETE /identity/v3/projects/38884f43b2424f239815bc0f2f277c5a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:18.576737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:18.578109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.605614 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 844/1674] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:18.606457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e478ef-48fb-4f39-abe9-66074a590488 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:18.607759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-92e478ef-48fb-4f39-abe9-66074a590488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.645541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c0181-282c-47b3-989b-70730d7b6877 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:18.650676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:18.651326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.651610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.651886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.653701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.664705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:18.666285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:18.676058 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 831/1675] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:18.677172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:18.678374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e478ef-48fb-4f39-abe9-66074a590488 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:18.678480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.684493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:18.685144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.685430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.685707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.687461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.691514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705495f-418b-4cd7-a1eb-bd8c3aa78110 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:18.701675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:18.702763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.703067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.703410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] PATH_INFO: `/v3/users/9259ca72e41f474896b47c3c95bec856` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.704802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9259ca72e41f474896b47c3c95bec856)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:18.706806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:18.756122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:18.758411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:18.764252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9259ca72e41f474896b47c3c95bec856'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.764909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9259ca72e41f474896b47c3c95bec856'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.765537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9259ca72e41f474896b47c3c95bec856'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.770258 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 845/1676] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:18.771172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:18.772752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.777937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9259ca72e41f474896b47c3c95bec856'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.787223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f239ef5-29ee-4e5d-b413-6836aa6666b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9259ca72e41f474896b47c3c95bec856'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:18.801724 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 832/1677] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:18 2022] DELETE /identity/v3/users/9259ca72e41f474896b47c3c95bec856 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:18.806775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b873ab6-caa2-435b-99b3-ffb4f0fd7df7 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.807073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b873ab6-caa2-435b-99b3-ffb4f0fd7df7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.807353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b873ab6-caa2-435b-99b3-ffb4f0fd7df7 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.809332 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 833/1678] 10.222.0.30 () {54 vars in 961 bytes} [Sat Feb 19 20:50:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:18.814751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d310-f232-4bef-b382-b4b3d5637384 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.815033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d310-f232-4bef-b382-b4b3d5637384 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.815322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d310-f232-4bef-b382-b4b3d5637384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.835161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e7c5d310-f232-4bef-b382-b4b3d5637384 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:18.836433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e7c5d310-f232-4bef-b382-b4b3d5637384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.847633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e66d7-9522-4884-a3ad-f814dcbccef6 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:18.899921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:18.900824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.901098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.901411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.903443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.919810 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 834/1679] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Feb 19 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:18.920838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d310-f232-4bef-b382-b4b3d5637384 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:18.922770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e7c5d310-f232-4bef-b382-b4b3d5637384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.941338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d310-f232-4bef-b382-b4b3d5637384 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:18.949602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:18.950346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:18.950738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:18.951080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:18.953063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:18.978552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:18.980165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:18.990022 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 846/1680] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:18.990772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.003348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6755c0-c1e1-4e8a-b827-c4875b30619a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.011319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.011981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.012266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.012595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.014772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.021239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.022856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.033719 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 835/1681] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:19.092583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.094443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.111724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.113872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.121547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b91ce8-02a9-4af1-ab68-4dd010a5878a service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.127491 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 847/1682] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:19.127909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.128561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.128830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.129114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.129397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] PATH_INFO: `/v3/projects/fd62f9b7316e459db4cbf9aa0670a386` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.130670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd62f9b7316e459db4cbf9aa0670a386)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.132665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.142708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1afaac-2791-469a-bb6d-31c3275b1b5c service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.151057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.152132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.152523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.153242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.156010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.191427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd62f9b7316e459db4cbf9aa0670a386', 'request_id': 'req-962c0aa4-f582-4647-bee9-30ba13a6dc24'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.201585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd62f9b7316e459db4cbf9aa0670a386', 'request_id': 'req-962c0aa4-f582-4647-bee9-30ba13a6dc24'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.222877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd62f9b7316e459db4cbf9aa0670a386', 'request_id': 'req-962c0aa4-f582-4647-bee9-30ba13a6dc24'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.235681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] The token cache is being invalidate because project fd62f9b7316e459db4cbf9aa0670a386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:19.235967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.236644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-962c0aa4-f582-4647-bee9-30ba13a6dc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.238210 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 836/1683] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:19 2022] DELETE /identity/v3/projects/fd62f9b7316e459db4cbf9aa0670a386 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:50:19.245282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a745-6ade-46d1-87a9-c502e6d2c85f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.245672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a745-6ade-46d1-87a9-c502e6d2c85f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.246051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a745-6ade-46d1-87a9-c502e6d2c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.256559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.258389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.265520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5737a745-6ade-46d1-87a9-c502e6d2c85f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:19.266844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5737a745-6ade-46d1-87a9-c502e6d2c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.283279 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 848/1684] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:19.338187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.339652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.362855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc883f-7217-49f0-9b0b-983801fa9210 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.372727 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 837/1685] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:19.381065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3581e-0c1f-4876-8b38-c0055edfb888 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.381280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3581e-0c1f-4876-8b38-c0055edfb888 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.381569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3581e-0c1f-4876-8b38-c0055edfb888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.381727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.386678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.387227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.388195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] PATH_INFO: `/v3/projects/6ce978d1edb7495f8cd3a785438db7cb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.389709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce978d1edb7495f8cd3a785438db7cb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.391814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.420220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b0f3581e-0c1f-4876-8b38-c0055edfb888 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:19.421516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0f3581e-0c1f-4876-8b38-c0055edfb888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.432848 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 838/1686] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:19.437162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3581e-0c1f-4876-8b38-c0055edfb888 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.452569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3581e-0c1f-4876-8b38-c0055edfb888 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.470130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce978d1edb7495f8cd3a785438db7cb', 'request_id': 'req-9b2aa909-bc68-4a38-8e9b-f51c278f2702'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.480276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce978d1edb7495f8cd3a785438db7cb', 'request_id': 'req-9b2aa909-bc68-4a38-8e9b-f51c278f2702'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.490508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce978d1edb7495f8cd3a785438db7cb', 'request_id': 'req-9b2aa909-bc68-4a38-8e9b-f51c278f2702'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.506997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] The token cache is being invalidate because project 6ce978d1edb7495f8cd3a785438db7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:19.507277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.508157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.512391 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 849/1687] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:19 2022] DELETE /identity/v3/projects/6ce978d1edb7495f8cd3a785438db7cb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:19.512391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.517417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.542196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.543409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.543693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.543971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.544739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:19.545111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.546716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.562523 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 839/1688] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:19.562523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.562523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.582867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bed7c-8ae5-4392-81cc-f5b8bdbef058 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.587814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.588795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.589139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.589481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] PATH_INFO: `/v3/users/a28c8d4a0cd0463ab812873436d87826` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.590866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28c8d4a0cd0463ab812873436d87826)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.592865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.594903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa909-bc68-4a38-8e9b-f51c278f2702 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.603576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.604526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.604842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.605180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] PATH_INFO: `/v3/users/3801404a24664f2ea16b09080638fdbe` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.606625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3801404a24664f2ea16b09080638fdbe)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.608902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.653426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28c8d4a0cd0463ab812873436d87826'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.654279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28c8d4a0cd0463ab812873436d87826'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.655046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28c8d4a0cd0463ab812873436d87826'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.662235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3801404a24664f2ea16b09080638fdbe'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.670437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28c8d4a0cd0463ab812873436d87826'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.676598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3801404a24664f2ea16b09080638fdbe'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.681761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28c8d4a0cd0463ab812873436d87826'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.685624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3801404a24664f2ea16b09080638fdbe'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.686370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3801404a24664f2ea16b09080638fdbe'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.687120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd001b28-3c7a-44db-ade8-8be6b256c0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3801404a24664f2ea16b09080638fdbe'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.696824 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 840/1689] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:19 2022] DELETE /identity/v3/users/a28c8d4a0cd0463ab812873436d87826 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:19.697480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.701065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.705203 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 850/1690] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:19 2022] DELETE /identity/v3/users/3801404a24664f2ea16b09080638fdbe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:19.709617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364344-07c0-4f6c-8a83-151d25d757f2 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.709996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364344-07c0-4f6c-8a83-151d25d757f2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.710703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364344-07c0-4f6c-8a83-151d25d757f2 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.715458 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 851/1691] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:19.717745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94364344-07c0-4f6c-8a83-151d25d757f2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:19.719748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-94364344-07c0-4f6c-8a83-151d25d757f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.775263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588b2d1-fded-4045-821c-30ce52ecb748 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.796273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94364344-07c0-4f6c-8a83-151d25d757f2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:19.801195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b472e5-3326-4b27-b4a3-e1c79205c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.802113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b472e5-3326-4b27-b4a3-e1c79205c825 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.802657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b472e5-3326-4b27-b4a3-e1c79205c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.802657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b472e5-3326-4b27-b4a3-e1c79205c825 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.803418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b472e5-3326-4b27-b4a3-e1c79205c825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.806249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b472e5-3326-4b27-b4a3-e1c79205c825 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.833776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:19.834739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.835100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.835462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] PATH_INFO: `/v3/users/fce86d6285a14df09885a6ceb2bac284` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.836756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce86d6285a14df09885a6ceb2bac284)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:19.838923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:19.840724 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 852/1692] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:19 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:19.842174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ff89-e3bd-445e-a487-5a50dcc7bf85 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.842472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ff89-e3bd-445e-a487-5a50dcc7bf85 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.842750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640ff89-e3bd-445e-a487-5a50dcc7bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.866073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0640ff89-e3bd-445e-a487-5a50dcc7bf85 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:19.868498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0640ff89-e3bd-445e-a487-5a50dcc7bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.887584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce86d6285a14df09885a6ceb2bac284'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.888256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce86d6285a14df09885a6ceb2bac284'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.888921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce86d6285a14df09885a6ceb2bac284'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.902877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce86d6285a14df09885a6ceb2bac284'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.909565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39192bc6-39df-49b1-ab27-e785376f4a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce86d6285a14df09885a6ceb2bac284'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:19.925904 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 841/1693] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:19 2022] DELETE /identity/v3/users/fce86d6285a14df09885a6ceb2bac284 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:19.927842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fba5-4d4a-46e0-af63-c4f6a04cad90 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.928179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fba5-4d4a-46e0-af63-c4f6a04cad90 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.928552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fba5-4d4a-46e0-af63-c4f6a04cad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.946007 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 853/1694] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:19.946007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc869-bb2d-41e9-8087-92a66e1485e8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:19.946007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc869-bb2d-41e9-8087-92a66e1485e8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:19.946007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc869-bb2d-41e9-8087-92a66e1485e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:19.947604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cae5fba5-4d4a-46e0-af63-c4f6a04cad90 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:19.948980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cae5fba5-4d4a-46e0-af63-c4f6a04cad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:19.969820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d02cc869-bb2d-41e9-8087-92a66e1485e8 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:19.971786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d02cc869-bb2d-41e9-8087-92a66e1485e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.015175 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 842/1695] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:20.015175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5fba5-4d4a-46e0-af63-c4f6a04cad90 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.019703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cae5fba5-4d4a-46e0-af63-c4f6a04cad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.033144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5fba5-4d4a-46e0-af63-c4f6a04cad90 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.038534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.039236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.039523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.039829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.040559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.042514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.057047 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 854/1696] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:20.058229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc869-bb2d-41e9-8087-92a66e1485e8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.059423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d02cc869-bb2d-41e9-8087-92a66e1485e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.067809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 843/1697] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:20 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:20.067809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.069775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.135783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc869-bb2d-41e9-8087-92a66e1485e8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.139253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac749f5-0d20-4f72-88cc-fed1469b008d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.139906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac749f5-0d20-4f72-88cc-fed1469b008d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.140240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac749f5-0d20-4f72-88cc-fed1469b008d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.140520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac749f5-0d20-4f72-88cc-fed1469b008d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.150184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac749f5-0d20-4f72-88cc-fed1469b008d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.151623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac749f5-0d20-4f72-88cc-fed1469b008d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.156732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810a75-fe03-4179-99ab-2d2f38d8ebbe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.161322 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 855/1698] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:20.162126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac749f5-0d20-4f72-88cc-fed1469b008d service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.164622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.165293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.165574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.165875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.167745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.170553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac749f5-0d20-4f72-88cc-fed1469b008d service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.174682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1f77e-5fb2-4bde-951e-d1e9312be246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.174891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1f77e-5fb2-4bde-951e-d1e9312be246 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.175745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1f77e-5fb2-4bde-951e-d1e9312be246 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.175997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1f77e-5fb2-4bde-951e-d1e9312be246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.185594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1f77e-5fb2-4bde-951e-d1e9312be246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.187154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1f77e-5fb2-4bde-951e-d1e9312be246 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.197752 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 856/1699] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:20.198640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1f77e-5fb2-4bde-951e-d1e9312be246 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.207764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1f77e-5fb2-4bde-951e-d1e9312be246 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.213079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.213728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.214011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.214280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.215535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.216736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.230631 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 857/1700] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:20.230631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.230869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.231700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.232700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.241556 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 844/1701] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:20.242220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.248412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803fad8-759a-470c-a080-b181ff28cd88 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.253045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51dc58-e8cc-4248-af1c-7e743ccfb6d8 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.253886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.254599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.254880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.255157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.259468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf8ab-0664-4cd3-a8b7-f62a7eb7f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.260595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf8ab-0664-4cd3-a8b7-f62a7eb7f5fd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.261076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf8ab-0664-4cd3-a8b7-f62a7eb7f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.261616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf8ab-0664-4cd3-a8b7-f62a7eb7f5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.262575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaf8ab-0664-4cd3-a8b7-f62a7eb7f5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.264232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.264588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaf8ab-0664-4cd3-a8b7-f62a7eb7f5fd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.266087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.277975 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 845/1702] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:20.280320 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 858/1703] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:20.282640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf8ab-0664-4cd3-a8b7-f62a7eb7f5fd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.301953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf8ab-0664-4cd3-a8b7-f62a7eb7f5fd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.308983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.310392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.314626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e3449-493f-4e0a-80c7-074c1bc1b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.323657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e3449-493f-4e0a-80c7-074c1bc1b6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.323952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e3449-493f-4e0a-80c7-074c1bc1b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.324234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e3449-493f-4e0a-80c7-074c1bc1b6ab admin admin] PATH_INFO: `/v3/projects/24084fe3ae3342fb98decf8e698ef38e/users/885b2316ba4c4753b4b40c764140ea67/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.338369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351fbe6-fafc-4679-ae01-207aaba5f569 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.354740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.355803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.356152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.356534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] PATH_INFO: `/v3/projects/790c1e2b25a64688b2ebe5dcad497078` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.357869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790c1e2b25a64688b2ebe5dcad497078)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.373036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.396240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e3449-493f-4e0a-80c7-074c1bc1b6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=24084fe3ae3342fb98decf8e698ef38e, user_id=885b2316ba4c4753b4b40c764140ea67, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.406934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e3449-493f-4e0a-80c7-074c1bc1b6ab admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.453512 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 846/1704] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:20 2022] PUT /identity/v3/projects/24084fe3ae3342fb98decf8e698ef38e/users/885b2316ba4c4753b4b40c764140ea67/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:50:20.459330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdf315-cc87-4774-88c2-924d883a8182 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.460144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdf315-cc87-4774-88c2-924d883a8182 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.461700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdf315-cc87-4774-88c2-924d883a8182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.504847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790c1e2b25a64688b2ebe5dcad497078', 'request_id': 'req-d6cb62ec-6237-45f7-982a-80fcffc131d0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:20.510064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0dfdf315-cc87-4774-88c2-924d883a8182 None None] MFA Rules not processed for user `885b2316ba4c4753b4b40c764140ea67`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:20.513029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0dfdf315-cc87-4774-88c2-924d883a8182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.520688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790c1e2b25a64688b2ebe5dcad497078', 'request_id': 'req-d6cb62ec-6237-45f7-982a-80fcffc131d0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:20.565244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790c1e2b25a64688b2ebe5dcad497078', 'request_id': 'req-d6cb62ec-6237-45f7-982a-80fcffc131d0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:20.593549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] The token cache is being invalidate because project 790c1e2b25a64688b2ebe5dcad497078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:20.593850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:20.595744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6cb62ec-6237-45f7-982a-80fcffc131d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:20.603807 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 859/1705] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:20 2022] DELETE /identity/v3/projects/790c1e2b25a64688b2ebe5dcad497078 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:50:20.605521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90745-940a-4973-b3fb-d8d2ec4081c6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.605824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90745-940a-4973-b3fb-d8d2ec4081c6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.606124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90745-940a-4973-b3fb-d8d2ec4081c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.670593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-34e90745-940a-4973-b3fb-d8d2ec4081c6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:20.674874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-34e90745-940a-4973-b3fb-d8d2ec4081c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.739744 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 847/1706] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:20.741258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdf315-cc87-4774-88c2-924d883a8182 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.758990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0dfdf315-cc87-4774-88c2-924d883a8182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.802717 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 860/1707] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:20.803549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90745-940a-4973-b3fb-d8d2ec4081c6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.805439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-34e90745-940a-4973-b3fb-d8d2ec4081c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.817563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90745-940a-4973-b3fb-d8d2ec4081c6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.828760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.829581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.829882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.830229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.831040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.833110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.861393 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 861/1708] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:20 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:20.862422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:20.864856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:20.899230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdf315-cc87-4774-88c2-924d883a8182 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.948412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6854bb-97d0-4463-8178-a454ef2e6d61 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:20.953400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.954262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.954539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.954813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] PATH_INFO: `/v3/projects/2dc25faea6464e2c833c8dc5059c36ea` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.956343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc25faea6464e2c833c8dc5059c36ea)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:20.958391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:20.992794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:20.993695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:20.993975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:20.994250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:20.996845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.020402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc25faea6464e2c833c8dc5059c36ea', 'request_id': 'req-aa9f44b3-1aa9-4e93-9824-e285d72ae613'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.026900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc25faea6464e2c833c8dc5059c36ea', 'request_id': 'req-aa9f44b3-1aa9-4e93-9824-e285d72ae613'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.035033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc25faea6464e2c833c8dc5059c36ea', 'request_id': 'req-aa9f44b3-1aa9-4e93-9824-e285d72ae613'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.047781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] The token cache is being invalidate because project 2dc25faea6464e2c833c8dc5059c36ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:21.048094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.048795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa9f44b3-1aa9-4e93-9824-e285d72ae613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.050779 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 862/1709] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:20 2022] DELETE /identity/v3/projects/2dc25faea6464e2c833c8dc5059c36ea => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:21.052083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2c783-a0fc-4795-b00e-08f4f216de52 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:21.052397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2c783-a0fc-4795-b00e-08f4f216de52 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:21.052677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2c783-a0fc-4795-b00e-08f4f216de52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:21.071954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-29c2c783-a0fc-4795-b00e-08f4f216de52 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:21.073179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-29c2c783-a0fc-4795-b00e-08f4f216de52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.075280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:21.077692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:21.090278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 848/1710] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:21.090880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.092230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.107965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6783-afce-4e9e-ab5e-69f8aeec88d0 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:21.169231 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 863/1711] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:21.169231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2c783-a0fc-4795-b00e-08f4f216de52 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.170368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-29c2c783-a0fc-4795-b00e-08f4f216de52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.187754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2c783-a0fc-4795-b00e-08f4f216de52 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:21.189287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:21.190152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:21.190432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:21.190706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] PATH_INFO: `/v3/projects/d1efa252dbb54b0388ea585b35ff2adc` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:21.191888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1efa252dbb54b0388ea585b35ff2adc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:21.193887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:21.194013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:21.194865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:21.195768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:21.196063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:21.196803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:21.199630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:21.231854 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 864/1712] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:21 2022] POST /identity/v3/users => generated 301 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:21.231854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.232187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.249199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10a86e-8a93-4d3a-867b-d4825dd71c5d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:21.261662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1efa252dbb54b0388ea585b35ff2adc', 'request_id': 'req-fbf83444-fb77-4fc2-8a5e-7e6545311a73'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.270061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1efa252dbb54b0388ea585b35ff2adc', 'request_id': 'req-fbf83444-fb77-4fc2-8a5e-7e6545311a73'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.279878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1efa252dbb54b0388ea585b35ff2adc', 'request_id': 'req-fbf83444-fb77-4fc2-8a5e-7e6545311a73'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.294399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] The token cache is being invalidate because project d1efa252dbb54b0388ea585b35ff2adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:21.294748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.295677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.297721 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 849/1713] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:21 2022] DELETE /identity/v3/projects/d1efa252dbb54b0388ea585b35ff2adc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:21.298382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.299760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.343060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:21.344898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:21.345391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:21.345877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] PATH_INFO: `/v3/users/232cca5493764f53af264109b568c05b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:21.347750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=232cca5493764f53af264109b568c05b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:21.350673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:21.412520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf83444-fb77-4fc2-8a5e-7e6545311a73 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:21.419418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:21.420203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:21.420604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:21.420991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:21.421938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:21.422407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:21.424496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:21.429116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232cca5493764f53af264109b568c05b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.445411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232cca5493764f53af264109b568c05b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.446565 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 850/1714] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:21.448668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.451406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.455354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232cca5493764f53af264109b568c05b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.456954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232cca5493764f53af264109b568c05b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.457899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232cca5493764f53af264109b568c05b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.473003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127a234-f7c7-49e0-9d28-6156d7d5beac admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:21.481784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:21.482659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:21.483473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:21.483841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:21.484769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:21.486516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:21.503167 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 865/1715] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:21 2022] DELETE /identity/v3/users/232cca5493764f53af264109b568c05b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:21.506576 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 851/1716] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:21.506576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.506767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.506861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.506934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.527452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d972-32c5-4449-b301-641cd668bba1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:21.638242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3c678-4bc3-4bb6-a9cb-4ba969dd80ba admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:21.645676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:21.647152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:21.647519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:21.649522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] PATH_INFO: `/v3/users/7604c5d28ebf45ba897c63a832c777ab` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:21.650953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7604c5d28ebf45ba897c63a832c777ab)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:21.671243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:21.707781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:21.709582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:21.710303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:21.711161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] PATH_INFO: `/v3/users/daf6561aecd44eb99b9eeb611d97cc9e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:21.712871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf6561aecd44eb99b9eeb611d97cc9e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:21.715301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:21.808973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7604c5d28ebf45ba897c63a832c777ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.824822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7604c5d28ebf45ba897c63a832c777ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.825045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf6561aecd44eb99b9eeb611d97cc9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.826500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf6561aecd44eb99b9eeb611d97cc9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.829071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf6561aecd44eb99b9eeb611d97cc9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.841812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7604c5d28ebf45ba897c63a832c777ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.842748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7604c5d28ebf45ba897c63a832c777ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.843662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7604c5d28ebf45ba897c63a832c777ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.867528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf6561aecd44eb99b9eeb611d97cc9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.877664 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 866/1717] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:21 2022] DELETE /identity/v3/users/7604c5d28ebf45ba897c63a832c777ab => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:21.881783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf6561aecd44eb99b9eeb611d97cc9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:21.881904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.883881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:21.914731 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 852/1718] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:21 2022] DELETE /identity/v3/users/daf6561aecd44eb99b9eeb611d97cc9e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:21.920449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:21.925640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.000304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147d4d2-383a-4f65-9079-a49070d18420 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.019015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0dcce-edd1-480f-8de6-c178d3e69a15 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.025229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318e113-155a-484a-af23-79691f364e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.026183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e113-155a-484a-af23-79691f364e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.026518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e113-155a-484a-af23-79691f364e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.027151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318e113-155a-484a-af23-79691f364e17 admin admin] PATH_INFO: `/v3/projects/e2a3725f1eb447c991ecbbfd45f64b28/users/9dd52c2d188c43008c996dc8ee0b6834/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.044279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318e113-155a-484a-af23-79691f364e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a3725f1eb447c991ecbbfd45f64b28, user_id=9dd52c2d188c43008c996dc8ee0b6834, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.047628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318e113-155a-484a-af23-79691f364e17 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.075900 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 853/1719] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:21 2022] PUT /identity/v3/projects/e2a3725f1eb447c991ecbbfd45f64b28/users/9dd52c2d188c43008c996dc8ee0b6834/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:22.077585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e290-8ec5-4c1a-a685-46e9293a386b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.077875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e290-8ec5-4c1a-a685-46e9293a386b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.078382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e290-8ec5-4c1a-a685-46e9293a386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.110026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4973e290-8ec5-4c1a-a685-46e9293a386b None None] MFA Rules not processed for user `a3685521a15b40c3a032b34a430be90f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:22.111166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4973e290-8ec5-4c1a-a685-46e9293a386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.145714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78226-9a6a-4bee-a266-2919e16ae263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.146910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78226-9a6a-4bee-a266-2919e16ae263 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.147357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78226-9a6a-4bee-a266-2919e16ae263 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.151658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78226-9a6a-4bee-a266-2919e16ae263 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.152444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee78226-9a6a-4bee-a266-2919e16ae263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.155439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee78226-9a6a-4bee-a266-2919e16ae263 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.205804 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 867/1720] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:21 2022] POST /identity/v3/projects => generated 401 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:22.207484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b2bbe-5aa0-465c-ba60-3ae4f9c9ef97 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.208192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b2bbe-5aa0-465c-ba60-3ae4f9c9ef97 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.208530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b2bbe-5aa0-465c-ba60-3ae4f9c9ef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.226120 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 854/1721] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:22.228440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c39b2bbe-5aa0-465c-ba60-3ae4f9c9ef97 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:22.229668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c39b2bbe-5aa0-465c-ba60-3ae4f9c9ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.231756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973e290-8ec5-4c1a-a685-46e9293a386b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.233090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4973e290-8ec5-4c1a-a685-46e9293a386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.302287 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 868/1722] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:22.303188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b2bbe-5aa0-465c-ba60-3ae4f9c9ef97 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.304611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c39b2bbe-5aa0-465c-ba60-3ae4f9c9ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.309017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973e290-8ec5-4c1a-a685-46e9293a386b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.314353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.315360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.315645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.315920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] PATH_INFO: `/v3/projects/bd2bcc5422a34317a0fb2ff41640de11` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.317374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2bcc5422a34317a0fb2ff41640de11)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.317525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b2bbe-5aa0-465c-ba60-3ae4f9c9ef97 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.319435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.328053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.328881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.329035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.329310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.330165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.331834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.345875 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 869/1723] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:22.345875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.345875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.358700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63b1c6-3fe6-4d69-a62f-43a04c2d08fa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.369612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2bcc5422a34317a0fb2ff41640de11', 'request_id': 'req-6f0a76e2-dccf-408e-a876-d415804d618e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.374769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2bcc5422a34317a0fb2ff41640de11', 'request_id': 'req-6f0a76e2-dccf-408e-a876-d415804d618e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.383481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2bcc5422a34317a0fb2ff41640de11', 'request_id': 'req-6f0a76e2-dccf-408e-a876-d415804d618e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.395435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] The token cache is being invalidate because project bd2bcc5422a34317a0fb2ff41640de11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:22.395932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.396744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.399328 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 855/1724] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:22 2022] DELETE /identity/v3/projects/bd2bcc5422a34317a0fb2ff41640de11 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:22.399893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.401209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.417737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.418605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.418885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.419156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] PATH_INFO: `/v3/users/1bfe72a07e624ab095ce38f7cecb22cb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.420361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bfe72a07e624ab095ce38f7cecb22cb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.422609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.465135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a76e2-dccf-408e-a876-d415804d618e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.467961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bfe72a07e624ab095ce38f7cecb22cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.469783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.470443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.470723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.470998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.471682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.473606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.479770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bfe72a07e624ab095ce38f7cecb22cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.486729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bfe72a07e624ab095ce38f7cecb22cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.487587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bfe72a07e624ab095ce38f7cecb22cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.488319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bfe72a07e624ab095ce38f7cecb22cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.493737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 856/1725] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:22 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:22.494538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.496097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.501769 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 870/1726] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:22 2022] DELETE /identity/v3/users/1bfe72a07e624ab095ce38f7cecb22cb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:22.502700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.504102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.566740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85577c9-d99e-496a-b3a7-80a0d38925bc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.568240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58cf4-54f1-47a8-8ae5-edb484ec002c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.572239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.573128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.573412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.573693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] PATH_INFO: `/v3/projects/763f11eb0f934755ae2e08a2f7b1d368` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.574880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] RBAC: Authorizing `identity:delete_project(project_id=763f11eb0f934755ae2e08a2f7b1d368)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.576815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.621902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763f11eb0f934755ae2e08a2f7b1d368', 'request_id': 'req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.627088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763f11eb0f934755ae2e08a2f7b1d368', 'request_id': 'req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.630819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.631783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.632078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.633098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.634835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763f11eb0f934755ae2e08a2f7b1d368', 'request_id': 'req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.635319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.645853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] The token cache is being invalidate because project 763f11eb0f934755ae2e08a2f7b1d368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:22.646192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.646856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:22.648641 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 871/1727] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:22 2022] DELETE /identity/v3/projects/763f11eb0f934755ae2e08a2f7b1d368 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:22.649545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.650965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.698474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.700080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.709517 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 857/1728] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:22.710283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.710801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7f2b0-92ff-4e07-8568-cbf70c07145a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.711703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.714553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd177161-bb7b-47da-b809-a5bb1af6ebf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.715270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd177161-bb7b-47da-b809-a5bb1af6ebf2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.715667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd177161-bb7b-47da-b809-a5bb1af6ebf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.716046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd177161-bb7b-47da-b809-a5bb1af6ebf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.717833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd177161-bb7b-47da-b809-a5bb1af6ebf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.731031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c647427-a810-400f-9ae5-ce8ccd153e38 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.789839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd177161-bb7b-47da-b809-a5bb1af6ebf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.791252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd177161-bb7b-47da-b809-a5bb1af6ebf2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.791675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.792640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.792945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.793222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] PATH_INFO: `/v3/projects/e2a3725f1eb447c991ecbbfd45f64b28/users/9dd52c2d188c43008c996dc8ee0b6834/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.795245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a3725f1eb447c991ecbbfd45f64b28, user_id=9dd52c2d188c43008c996dc8ee0b6834, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.797900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.800792 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 872/1729] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:22.802604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65cf0-3bfe-4bae-8378-5497ac817e33 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.802898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65cf0-3bfe-4bae-8378-5497ac817e33 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.803196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65cf0-3bfe-4bae-8378-5497ac817e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.809799 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 858/1730] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:22 2022] PUT /identity/v3/projects/e2a3725f1eb447c991ecbbfd45f64b28/users/9dd52c2d188c43008c996dc8ee0b6834/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:22.810678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:22.812383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.830531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5ee65cf0-3bfe-4bae-8378-5497ac817e33 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:22.831741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5ee65cf0-3bfe-4bae-8378-5497ac817e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.883875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a9b39-7a62-4380-8c6b-d8cd6d169b83 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:22.889175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37b5c-9fab-453f-8fc5-0d49461a3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:22.889848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37b5c-9fab-453f-8fc5-0d49461a3517 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.890132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37b5c-9fab-453f-8fc5-0d49461a3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.890537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37b5c-9fab-453f-8fc5-0d49461a3517 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.891266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37b5c-9fab-453f-8fc5-0d49461a3517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:22.892977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37b5c-9fab-453f-8fc5-0d49461a3517 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:22.899444 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 873/1731] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:22.901165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7868e5b-6ddf-4ad6-bb29-1866d7616b63 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.901565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7868e5b-6ddf-4ad6-bb29-1866d7616b63 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.901947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7868e5b-6ddf-4ad6-bb29-1866d7616b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.910159 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 859/1732] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:22.911648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c831d81-dd03-4a35-94c3-8fa5f0108a65 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.911933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c831d81-dd03-4a35-94c3-8fa5f0108a65 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.912203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c831d81-dd03-4a35-94c3-8fa5f0108a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.922429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e7868e5b-6ddf-4ad6-bb29-1866d7616b63 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:22.923811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e7868e5b-6ddf-4ad6-bb29-1866d7616b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.933334 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 874/1733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:22.937655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca26-6543-404f-92e4-29e7b72892a0 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.938018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca26-6543-404f-92e4-29e7b72892a0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.938368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca26-6543-404f-92e4-29e7b72892a0 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.940341 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 875/1734] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:22.946242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8c831d81-dd03-4a35-94c3-8fa5f0108a65 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:22.946484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eeead-703b-406a-a2c6-b515d91a0982 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.946850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eeead-703b-406a-a2c6-b515d91a0982 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.947205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eeead-703b-406a-a2c6-b515d91a0982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.947898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8c831d81-dd03-4a35-94c3-8fa5f0108a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.957076 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 860/1735] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:22.958531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b7bb-3e22-4982-aa81-2b224fbc647e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:22.958893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b7bb-3e22-4982-aa81-2b224fbc647e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:22.959276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b7bb-3e22-4982-aa81-2b224fbc647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:22.979101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8c1eeead-703b-406a-a2c6-b515d91a0982 None None] MFA Rules not processed for user `9dd52c2d188c43008c996dc8ee0b6834`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:22.980395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c1eeead-703b-406a-a2c6-b515d91a0982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.984068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-78e9b7bb-3e22-4982-aa81-2b224fbc647e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:22.986063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-78e9b7bb-3e22-4982-aa81-2b224fbc647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:22.998068 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 861/1736] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:22.998926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9b7bb-3e22-4982-aa81-2b224fbc647e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.012888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9b7bb-3e22-4982-aa81-2b224fbc647e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.018927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.019916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.020105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.020418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.021398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.022828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.036837 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 862/1737] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:23.036837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.038279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.063301 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 876/1738] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:23.064496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72554-4d6e-4a41-9e79-e28eb704e0eb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.064856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72554-4d6e-4a41-9e79-e28eb704e0eb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.065207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72554-4d6e-4a41-9e79-e28eb704e0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.087234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b1a72554-4d6e-4a41-9e79-e28eb704e0eb None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:23.088474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b1a72554-4d6e-4a41-9e79-e28eb704e0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.112415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a067b-3ec0-4119-b34c-6c2b5eddbdb8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.116225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dce2a-d80f-4068-bced-87c393e22703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.117296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dce2a-d80f-4068-bced-87c393e22703 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.117585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dce2a-d80f-4068-bced-87c393e22703 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.117864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dce2a-d80f-4068-bced-87c393e22703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.128832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dce2a-d80f-4068-bced-87c393e22703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.130404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dce2a-d80f-4068-bced-87c393e22703 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.140787 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 863/1739] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:23.142411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739db2-c115-4928-b6d4-29a71ef74bd3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.142695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739db2-c115-4928-b6d4-29a71ef74bd3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.142968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739db2-c115-4928-b6d4-29a71ef74bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.162648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e2739db2-c115-4928-b6d4-29a71ef74bd3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:23.164630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e2739db2-c115-4928-b6d4-29a71ef74bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.169043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 877/1740] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:50:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:23.169864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a72554-4d6e-4a41-9e79-e28eb704e0eb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.173212 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 864/1741] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:23.174601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2739db2-c115-4928-b6d4-29a71ef74bd3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.185406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2739db2-c115-4928-b6d4-29a71ef74bd3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.185571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a72554-4d6e-4a41-9e79-e28eb704e0eb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.190514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.190743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.191506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.191607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.191793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.191900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.192071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.192163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] PATH_INFO: `/v3/projects/04d2b5b9a01e4133b1f4f7f351cf0c0a/users/1fc7244fbf3b4298b92daf9e442fe669/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.193097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:23.193203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.194717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.208620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 878/1742] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:23.209531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.212508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.214262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d2b5b9a01e4133b1f4f7f351cf0c0a, user_id=1fc7244fbf3b4298b92daf9e442fe669, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.217465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.230999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0baa0-07e6-476e-bd8e-c4d58f1d6c79 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.234590 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 865/1743] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:23 2022] PUT /identity/v3/projects/04d2b5b9a01e4133b1f4f7f351cf0c0a/users/1fc7244fbf3b4298b92daf9e442fe669/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:23.235508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.237456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.306744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91a334-fd46-4bfc-a113-678f622cf1f4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.310075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ca429-7843-4900-822e-52d90217a45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.311550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca429-7843-4900-822e-52d90217a45b service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.311550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca429-7843-4900-822e-52d90217a45b service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.311708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca429-7843-4900-822e-52d90217a45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.311933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.312895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.313239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.313633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] PATH_INFO: `/v3/projects/cc1d70d01ab44d8d8ef6124c77f91f3d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.315014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1d70d01ab44d8d8ef6124c77f91f3d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.317733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.372166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1d70d01ab44d8d8ef6124c77f91f3d', 'request_id': 'req-a097c434-621f-434e-91b0-f7a4f8bf32d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.377901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ca429-7843-4900-822e-52d90217a45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.379505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ca429-7843-4900-822e-52d90217a45b service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.379617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1d70d01ab44d8d8ef6124c77f91f3d', 'request_id': 'req-a097c434-621f-434e-91b0-f7a4f8bf32d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.389525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1d70d01ab44d8d8ef6124c77f91f3d', 'request_id': 'req-a097c434-621f-434e-91b0-f7a4f8bf32d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.391020 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 879/1744] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:23.391884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ca429-7843-4900-822e-52d90217a45b service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.404526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ca429-7843-4900-822e-52d90217a45b service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.421330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] The token cache is being invalidate because project cc1d70d01ab44d8d8ef6124c77f91f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:23.421617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.422680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.424623 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 866/1745] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:23 2022] DELETE /identity/v3/projects/cc1d70d01ab44d8d8ef6124c77f91f3d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:23.428067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.428067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.493763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.494426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.494703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.494979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.495714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:23.496017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.497397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c434-621f-434e-91b0-f7a4f8bf32d7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.497633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.501406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.502088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.502377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.502648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.504435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.509254 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 880/1746] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:23.510019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.511593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.524077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434d506-a29f-4c70-97fd-aa82e91f8b6b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.529272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca12e65-687a-473e-bab8-6943732fe63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.529926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12e65-687a-473e-bab8-6943732fe63f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.530212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12e65-687a-473e-bab8-6943732fe63f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.530491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca12e65-687a-473e-bab8-6943732fe63f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.531240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca12e65-687a-473e-bab8-6943732fe63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.533200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca12e65-687a-473e-bab8-6943732fe63f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.558935 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 881/1747] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:23 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:23.560286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e5090-62a5-4937-9def-5d99aca8effd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.560620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e5090-62a5-4937-9def-5d99aca8effd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.560898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e5090-62a5-4937-9def-5d99aca8effd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.580861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.582318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.593987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 867/1748] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:23.594886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.596318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.599343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-904e5090-62a5-4937-9def-5d99aca8effd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:23.600613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-904e5090-62a5-4937-9def-5d99aca8effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.618416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b035238-ac2f-42e8-a43d-c32cd2193dd1 service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.667033 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 882/1749] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:23.669245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e5090-62a5-4937-9def-5d99aca8effd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.674105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-904e5090-62a5-4937-9def-5d99aca8effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.700261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.701357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.701652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.701936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] PATH_INFO: `/v3/users/bacd9663dbde4ef5b20e476122d70a81` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.703266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bacd9663dbde4ef5b20e476122d70a81)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.705367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.719616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e5090-62a5-4937-9def-5d99aca8effd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.730117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.731079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.731357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.731632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] PATH_INFO: `/v3/projects/7b81c39f80304833be79ce951e0fb8c1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.733068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b81c39f80304833be79ce951e0fb8c1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.735106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:23.760927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bacd9663dbde4ef5b20e476122d70a81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.761864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bacd9663dbde4ef5b20e476122d70a81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.762627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bacd9663dbde4ef5b20e476122d70a81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.777833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bacd9663dbde4ef5b20e476122d70a81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.787312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bacd9663dbde4ef5b20e476122d70a81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.789441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b81c39f80304833be79ce951e0fb8c1', 'request_id': 'req-4342c51f-15d4-4545-ae67-20ec6a1218f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.794985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b81c39f80304833be79ce951e0fb8c1', 'request_id': 'req-4342c51f-15d4-4545-ae67-20ec6a1218f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.803026 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 868/1750] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:23 2022] DELETE /identity/v3/users/bacd9663dbde4ef5b20e476122d70a81 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:23.803171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b81c39f80304833be79ce951e0fb8c1', 'request_id': 'req-4342c51f-15d4-4545-ae67-20ec6a1218f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.804109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.806322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.819559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] The token cache is being invalidate because project 7b81c39f80304833be79ce951e0fb8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:23.819848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.821135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:23.826251 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 883/1751] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:23 2022] DELETE /identity/v3/projects/7b81c39f80304833be79ce951e0fb8c1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:23.827149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:23.828570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.902688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342c51f-15d4-4545-ae67-20ec6a1218f9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.930304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169f2bb-95bf-4368-9512-c945a81c18c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:23.937795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.938682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.939047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.939573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.941889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:23.974453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:23.975465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:23.975926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:23.976985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:23.977866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:23.980101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.014110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.015665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.023995 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 884/1752] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:23 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:24.023995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.026516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.027618 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 869/1753] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:24.028546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.030289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.188536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83539c-eded-4e10-92c4-b5acbc88e8c3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.203530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.204171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf329c-c731-49b0-9e33-fa2152203040 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.204673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.204673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.204830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.205464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.210691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.254173 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 885/1754] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:24 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:24.255255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.257032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.273001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb21fc9-f5ab-419b-ad19-df6ed3fb4bb1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.280016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.280884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.281272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.281653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] PATH_INFO: `/v3/users/ff007271269d4562914cc082aeea6fea` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.283000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff007271269d4562914cc082aeea6fea)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.285259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.285481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.286144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.286427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.286990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.290413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.306946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.308838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.320688 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 870/1755] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:24.322446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.346698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e981b-3eee-4f4f-a3c3-9676a3a40051 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.354746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.356940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.357440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.357893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.358845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.362917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.368703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff007271269d4562914cc082aeea6fea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.383855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff007271269d4562914cc082aeea6fea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.392021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff007271269d4562914cc082aeea6fea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.392980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff007271269d4562914cc082aeea6fea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.393737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff007271269d4562914cc082aeea6fea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.396127 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 871/1756] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:24 2022] POST /identity/v3/users => generated 281 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:24.397141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.399049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.411351 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 886/1757] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:24 2022] DELETE /identity/v3/users/ff007271269d4562914cc082aeea6fea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:24.412116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.416276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca40dc-00d6-4e21-95c1-be72f977db6e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.419180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.499389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed29f4a-c2fb-4a7a-98ee-02b8325b649e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.506256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.507143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.507264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.507518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.507830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.508292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.508685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.508827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.508925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] PATH_INFO: `/v3/projects/9fb24ec981a74b7aa0b4b8bafb167f0f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.510330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb24ec981a74b7aa0b4b8bafb167f0f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.510884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.513052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.531582 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 887/1758] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:24.531582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.533432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.586961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb24ec981a74b7aa0b4b8bafb167f0f', 'request_id': 'req-9635aafa-9537-4e91-9100-f229b69a2b30'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.595600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb24ec981a74b7aa0b4b8bafb167f0f', 'request_id': 'req-9635aafa-9537-4e91-9100-f229b69a2b30'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.608893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb24ec981a74b7aa0b4b8bafb167f0f', 'request_id': 'req-9635aafa-9537-4e91-9100-f229b69a2b30'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.625743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] The token cache is being invalidate because project 9fb24ec981a74b7aa0b4b8bafb167f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:24.625985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.626755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.629083 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 872/1759] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:24 2022] DELETE /identity/v3/projects/9fb24ec981a74b7aa0b4b8bafb167f0f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:24.634329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.636417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.643848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288722d-171a-4dfe-9a5f-9602b97ee23d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.728780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635aafa-9537-4e91-9100-f229b69a2b30 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.737268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.738278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.739400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.740006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] PATH_INFO: `/v3/users/885b2316ba4c4753b4b40c764140ea67` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.741575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885b2316ba4c4753b4b40c764140ea67)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.744499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.746252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.747662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.748145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.748701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.756289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.777113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.778868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.789984 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 888/1760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:24.790822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.792721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.817639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd54b4-ed7a-4c69-a362-638116500541 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.826232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.826901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.827178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.827594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.828704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.831384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.837760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885b2316ba4c4753b4b40c764140ea67'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.840016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885b2316ba4c4753b4b40c764140ea67'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.841561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885b2316ba4c4753b4b40c764140ea67'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.847658 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 889/1761] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:24.848610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.850609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.867545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885b2316ba4c4753b4b40c764140ea67'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.879888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f46d2bf-e5b9-4087-bed9-9aa456b90808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885b2316ba4c4753b4b40c764140ea67'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:24.880686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4aabc-e2f3-43c6-88ed-a7a9eea2faaa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.888748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:24.889652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.889983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.890260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.891087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:24.892900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:24.903648 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 873/1762] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:24 2022] DELETE /identity/v3/users/885b2316ba4c4753b4b40c764140ea67 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:24.906343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22073c7-9f99-4082-bcee-990e14b16420 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:24.906766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22073c7-9f99-4082-bcee-990e14b16420 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:24.907255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22073c7-9f99-4082-bcee-990e14b16420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:24.909820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 890/1763] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:24.910725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:24.915083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:24.929218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a2a4e-2c7d-4e54-8325-ca3440ebda0c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:24.958241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f22073c7-9f99-4082-bcee-990e14b16420 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:24.959575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f22073c7-9f99-4082-bcee-990e14b16420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.020952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e31b42-707c-4380-8542-045fe4e8f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:25.021840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e31b42-707c-4380-8542-045fe4e8f16f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.022462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e31b42-707c-4380-8542-045fe4e8f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.022847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e31b42-707c-4380-8542-045fe4e8f16f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.023781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e31b42-707c-4380-8542-045fe4e8f16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:25.025813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e31b42-707c-4380-8542-045fe4e8f16f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:25.031191 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 874/1764] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:25.032893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff7ee-90c5-4649-922b-5597527e0552 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.033178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff7ee-90c5-4649-922b-5597527e0552 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.033457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff7ee-90c5-4649-922b-5597527e0552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.040232 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 891/1765] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:25.041165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e31b42-707c-4380-8542-045fe4e8f16f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:25.051994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e31b42-707c-4380-8542-045fe4e8f16f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:25.052740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-170ff7ee-90c5-4649-922b-5597527e0552 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:25.053946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-170ff7ee-90c5-4649-922b-5597527e0552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.058580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f174b-c4d5-4fc1-9b91-aeb3621cfd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:25.059718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f174b-c4d5-4fc1-9b91-aeb3621cfd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.060188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f174b-c4d5-4fc1-9b91-aeb3621cfd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.060785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f174b-c4d5-4fc1-9b91-aeb3621cfd0a admin admin] PATH_INFO: `/v3/projects/6d03cb4d49884b5394c1ca3536be6a1d/users/e449358683a04c7992dba1e4a0fda1d4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.063259 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 875/1766] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:25.064079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ff7ee-90c5-4649-922b-5597527e0552 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:25.065388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-170ff7ee-90c5-4649-922b-5597527e0552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.081271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f174b-c4d5-4fc1-9b91-aeb3621cfd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d03cb4d49884b5394c1ca3536be6a1d, user_id=e449358683a04c7992dba1e4a0fda1d4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:25.085593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f174b-c4d5-4fc1-9b91-aeb3621cfd0a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:25.086190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ff7ee-90c5-4649-922b-5597527e0552 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:25.091620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:25.092756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.093196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.093474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] PATH_INFO: `/v3/projects/1e80e95835624c239d13e2a884507496` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.094906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e80e95835624c239d13e2a884507496)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:25.096922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:25.114505 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 892/1767] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:25 2022] PUT /identity/v3/projects/6d03cb4d49884b5394c1ca3536be6a1d/users/e449358683a04c7992dba1e4a0fda1d4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:25.115045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc10c91-dbdf-4426-8732-ba3bbdd3af25 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.115300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc10c91-dbdf-4426-8732-ba3bbdd3af25 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.115813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc10c91-dbdf-4426-8732-ba3bbdd3af25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.140578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7dc10c91-dbdf-4426-8732-ba3bbdd3af25 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:25.142247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7dc10c91-dbdf-4426-8732-ba3bbdd3af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.153452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e80e95835624c239d13e2a884507496', 'request_id': 'req-782e1ca8-eac8-4352-894e-5513a6bd629b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:25.160149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e80e95835624c239d13e2a884507496', 'request_id': 'req-782e1ca8-eac8-4352-894e-5513a6bd629b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:25.173138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e80e95835624c239d13e2a884507496', 'request_id': 'req-782e1ca8-eac8-4352-894e-5513a6bd629b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:25.191058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] The token cache is being invalidate because project 1e80e95835624c239d13e2a884507496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:25.191334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:25.193298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:25.196928 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 876/1768] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:25 2022] DELETE /identity/v3/projects/1e80e95835624c239d13e2a884507496 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:25.197720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:25.199479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.251853 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 893/1769] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:25.253535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc10c91-dbdf-4426-8732-ba3bbdd3af25 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:25.255331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7dc10c91-dbdf-4426-8732-ba3bbdd3af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.283217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1ca8-eac8-4352-894e-5513a6bd629b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:25.298417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab434e-0596-4fb9-9be6-e010d4cce3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:25.299339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab434e-0596-4fb9-9be6-e010d4cce3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.299762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab434e-0596-4fb9-9be6-e010d4cce3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.300244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab434e-0596-4fb9-9be6-e010d4cce3ff admin admin] PATH_INFO: `/v3/projects/450122b7dbbc42b7a10f4b61c985e138/users/70b6ed4ef07f4e5bbde3300e064fd103/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.316323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab434e-0596-4fb9-9be6-e010d4cce3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=450122b7dbbc42b7a10f4b61c985e138, user_id=70b6ed4ef07f4e5bbde3300e064fd103, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:25.319710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab434e-0596-4fb9-9be6-e010d4cce3ff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:25.346635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc10c91-dbdf-4426-8732-ba3bbdd3af25 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:25.357132 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 877/1770] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:25 2022] PUT /identity/v3/projects/450122b7dbbc42b7a10f4b61c985e138/users/70b6ed4ef07f4e5bbde3300e064fd103/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:25.369014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95e328-02fa-4110-b474-d0a3277a334b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.369347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95e328-02fa-4110-b474-d0a3277a334b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.369622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95e328-02fa-4110-b474-d0a3277a334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.438963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bd95e328-02fa-4110-b474-d0a3277a334b None None] MFA Rules not processed for user `e449358683a04c7992dba1e4a0fda1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:25.441141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bd95e328-02fa-4110-b474-d0a3277a334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.485248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:25.485964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.486246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.486520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.490005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.544039 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 878/1771] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:25.549092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18383aa-8e4a-490d-9129-42a7154d396d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.549415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18383aa-8e4a-490d-9129-42a7154d396d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.549874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18383aa-8e4a-490d-9129-42a7154d396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.571394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:25.572893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:25.585124 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 894/1772] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:25.586297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:25.594204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a18383aa-8e4a-490d-9129-42a7154d396d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:25.596838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a18383aa-8e4a-490d-9129-42a7154d396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.597944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b47a-b889-456e-beb9-63112c7b354a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:25.605168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f57c13-7654-4cc4-bc03-b52f5d6e3ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:25.606874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f57c13-7654-4cc4-bc03-b52f5d6e3ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.607161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f57c13-7654-4cc4-bc03-b52f5d6e3ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.607511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f57c13-7654-4cc4-bc03-b52f5d6e3ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.608276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f57c13-7654-4cc4-bc03-b52f5d6e3ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:25.608707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f57c13-7654-4cc4-bc03-b52f5d6e3ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:25.610526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f57c13-7654-4cc4-bc03-b52f5d6e3ab9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:25.624096 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 879/1773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:25.629460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ba22-9ac5-4f3f-b71c-b7a83064bb32 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.631105 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 895/1774] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:25.631217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ba22-9ac5-4f3f-b71c-b7a83064bb32 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.631436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ba22-9ac5-4f3f-b71c-b7a83064bb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.633450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de606-fa08-4b93-866d-419c2391b863 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.633748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de606-fa08-4b93-866d-419c2391b863 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.634028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de606-fa08-4b93-866d-419c2391b863 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.636719 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 896/1775] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:25.637298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de606-fa08-4b93-866d-419c2391b863 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:25.639157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-369de606-fa08-4b93-866d-419c2391b863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.661616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de606-fa08-4b93-866d-419c2391b863 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:25.667588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf19e39-fdfe-41a0-9308-2867963c8732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:25.668662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19e39-fdfe-41a0-9308-2867963c8732 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.668945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19e39-fdfe-41a0-9308-2867963c8732 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.669222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19e39-fdfe-41a0-9308-2867963c8732 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.670469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf19e39-fdfe-41a0-9308-2867963c8732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:25.673110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf19e39-fdfe-41a0-9308-2867963c8732 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:25.700142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cc98ba22-9ac5-4f3f-b71c-b7a83064bb32 None None] MFA Rules not processed for user `70b6ed4ef07f4e5bbde3300e064fd103`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:25.700142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc98ba22-9ac5-4f3f-b71c-b7a83064bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.723952 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 897/1776] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:25.727590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257580-8032-4227-83eb-47a47c47f70c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.728284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257580-8032-4227-83eb-47a47c47f70c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.728600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257580-8032-4227-83eb-47a47c47f70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.771444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b7257580-8032-4227-83eb-47a47c47f70c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:25.774142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b7257580-8032-4227-83eb-47a47c47f70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.829352 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 880/1777] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:25.831602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98ba22-9ac5-4f3f-b71c-b7a83064bb32 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:25.869940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98ba22-9ac5-4f3f-b71c-b7a83064bb32 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:25.909176 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 898/1778] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:25.910797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52996692-2e3f-410c-ade0-21e7b0411b93 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.911097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52996692-2e3f-410c-ade0-21e7b0411b93 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.911376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52996692-2e3f-410c-ade0-21e7b0411b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.954139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-52996692-2e3f-410c-ade0-21e7b0411b93 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:25.958219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-52996692-2e3f-410c-ade0-21e7b0411b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:25.958583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c830789-47bd-4673-b510-554c4fcb3a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:25.959326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830789-47bd-4673-b510-554c4fcb3a0c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:25.959612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830789-47bd-4673-b510-554c4fcb3a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:25.959893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830789-47bd-4673-b510-554c4fcb3a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:25.960915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c830789-47bd-4673-b510-554c4fcb3a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:25.963245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c830789-47bd-4673-b510-554c4fcb3a0c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.028969 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 881/1779] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:26.034153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c830789-47bd-4673-b510-554c4fcb3a0c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.140486 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 899/1780] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:26.141655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52996692-2e3f-410c-ade0-21e7b0411b93 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.152308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52996692-2e3f-410c-ade0-21e7b0411b93 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.204119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c830789-47bd-4673-b510-554c4fcb3a0c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.209342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9099f2-9114-4cc7-87a4-844e1c942e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.210251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9099f2-9114-4cc7-87a4-844e1c942e20 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.210374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9099f2-9114-4cc7-87a4-844e1c942e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.211019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9099f2-9114-4cc7-87a4-844e1c942e20 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.212085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9099f2-9114-4cc7-87a4-844e1c942e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.214577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9099f2-9114-4cc7-87a4-844e1c942e20 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.220736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f9e5-0b45-4abe-8d51-035e1e7eec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.221687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f9e5-0b45-4abe-8d51-035e1e7eec2c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.222141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f9e5-0b45-4abe-8d51-035e1e7eec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.222588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f9e5-0b45-4abe-8d51-035e1e7eec2c admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.223452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14f9e5-0b45-4abe-8d51-035e1e7eec2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.225733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14f9e5-0b45-4abe-8d51-035e1e7eec2c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.256232 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 882/1781] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:26 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:26.257099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9099f2-9114-4cc7-87a4-844e1c942e20 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.272877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9099f2-9114-4cc7-87a4-844e1c942e20 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.273089 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 900/1782] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:26 2022] POST /identity/v3/projects => generated 361 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:26.273089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f9e5-0b45-4abe-8d51-035e1e7eec2c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.401357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f9e5-0b45-4abe-8d51-035e1e7eec2c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.406803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.408630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.408630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.408630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.409139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.412073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.443160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.445729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.446164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.446635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.447968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:26.448669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.450596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.450801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 901/1783] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:26 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:26.451733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.455119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:26.472463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 883/1784] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:26.473625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.485201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6919ec-c9b1-4131-bb0b-25a53a8188eb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.490262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4d4f7-299f-47c4-9723-12ae6c46b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.490944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d4f7-299f-47c4-9723-12ae6c46b4ec admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.492266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d4f7-299f-47c4-9723-12ae6c46b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.492266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d4f7-299f-47c4-9723-12ae6c46b4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.493251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4d4f7-299f-47c4-9723-12ae6c46b4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.495107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4d4f7-299f-47c4-9723-12ae6c46b4ec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.508122 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 884/1785] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:26.509182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4d4f7-299f-47c4-9723-12ae6c46b4ec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.520440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4d4f7-299f-47c4-9723-12ae6c46b4ec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.524960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80593-f639-4ed8-bf43-6fee11b81770 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.527849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.528727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.529185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.529600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.530071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff54e0-93af-4597-a1e1-f75bd72b2e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.530604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.530739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff54e0-93af-4597-a1e1-f75bd72b2e93 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.531033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff54e0-93af-4597-a1e1-f75bd72b2e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.531454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff54e0-93af-4597-a1e1-f75bd72b2e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.533201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.579986 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 885/1786] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:26 2022] POST /identity/v3/users => generated 287 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:26.594534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.601516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:26.622089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42d7b-9670-468c-b366-c4470d65d7eb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.627450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.628315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.628624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.629008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] PATH_INFO: `/v3/projects/24084fe3ae3342fb98decf8e698ef38e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.630279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24084fe3ae3342fb98decf8e698ef38e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.633073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.647845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff54e0-93af-4597-a1e1-f75bd72b2e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.649357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff54e0-93af-4597-a1e1-f75bd72b2e93 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.663645 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 902/1787] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:26.665090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff54e0-93af-4597-a1e1-f75bd72b2e93 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.694073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff54e0-93af-4597-a1e1-f75bd72b2e93 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.703418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322a09c-1f50-4bb5-8af3-d40cda29ff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.703531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a09c-1f50-4bb5-8af3-d40cda29ff68 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.703822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a09c-1f50-4bb5-8af3-d40cda29ff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.704104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a09c-1f50-4bb5-8af3-d40cda29ff68 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.704938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322a09c-1f50-4bb5-8af3-d40cda29ff68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.707100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322a09c-1f50-4bb5-8af3-d40cda29ff68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.719492 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 903/1788] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:26.723044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322a09c-1f50-4bb5-8af3-d40cda29ff68 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.749223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322a09c-1f50-4bb5-8af3-d40cda29ff68 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:26.749495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24084fe3ae3342fb98decf8e698ef38e', 'request_id': 'req-79d3d57b-508d-4327-9eb9-28e8e406cad7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:26.766015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24084fe3ae3342fb98decf8e698ef38e', 'request_id': 'req-79d3d57b-508d-4327-9eb9-28e8e406cad7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:26.784757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24084fe3ae3342fb98decf8e698ef38e', 'request_id': 'req-79d3d57b-508d-4327-9eb9-28e8e406cad7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:26.802123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] The token cache is being invalidate because project 24084fe3ae3342fb98decf8e698ef38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:26.802504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:26.803271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:26.805423 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 886/1789] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:26 2022] DELETE /identity/v3/projects/24084fe3ae3342fb98decf8e698ef38e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:26.809023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.810648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:26.845472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:26.846327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:26.846710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:26.847085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:26.848016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:26.851214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:26.908085 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 904/1790] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:26 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:26.908085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:26.911329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:26.930703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3d57b-508d-4327-9eb9-28e8e406cad7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.010868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b96ef-f01d-4990-a939-537ca3003e43 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.017382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.018198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.018581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.019751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.020802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.022734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.035215 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 905/1791] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:27.037320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.039651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.055531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.057226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.057226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.057420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b676d8-9fef-4c47-96b6-78e285a61e63 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.057528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] PATH_INFO: `/v3/projects/480a8add43c44a759b3eae8d6828c8cd/users/d434d471c75b4151a1604e92a53147e5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.062985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.064059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.064496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.066029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.066029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.067449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.075650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] RBAC: Authorizing `identity:create_grant(project_id=480a8add43c44a759b3eae8d6828c8cd, user_id=d434d471c75b4151a1604e92a53147e5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.077967 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 906/1792] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:27.078971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.081785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.083456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.093786 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 887/1793] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:26 2022] PUT /identity/v3/projects/480a8add43c44a759b3eae8d6828c8cd/users/d434d471c75b4151a1604e92a53147e5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:27.094874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.097714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01158e-4e08-40e5-87bc-db1db2e715bb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.099130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.180550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.181445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.181731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.182009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] PATH_INFO: `/v3/users/9dd52c2d188c43008c996dc8ee0b6834` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.185224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd52c2d188c43008c996dc8ee0b6834)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.187205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.211368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed68f4-da02-4eeb-b08b-dbf600dd816a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.216533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ede25-800a-4164-9d86-847841230222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.217209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ede25-800a-4164-9d86-847841230222 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.217488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ede25-800a-4164-9d86-847841230222 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.217763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ede25-800a-4164-9d86-847841230222 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.218461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ede25-800a-4164-9d86-847841230222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.220672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ede25-800a-4164-9d86-847841230222 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.255290 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 888/1794] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:27 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:27.255290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ede25-800a-4164-9d86-847841230222 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.277473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd52c2d188c43008c996dc8ee0b6834'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:27.280787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ede25-800a-4164-9d86-847841230222 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.292523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.294405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.295535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.295887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] PATH_INFO: `/v3/projects/daf4e12e2ba245db923e1a2b18150a87/users/1fa6e5d9b2ac42bdbb33eb9ea12c877c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.304721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd52c2d188c43008c996dc8ee0b6834'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:27.321855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf4e12e2ba245db923e1a2b18150a87, user_id=1fa6e5d9b2ac42bdbb33eb9ea12c877c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.324604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd52c2d188c43008c996dc8ee0b6834'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:27.325296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd52c2d188c43008c996dc8ee0b6834'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:27.326375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd52c2d188c43008c996dc8ee0b6834'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:27.329219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.345415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 907/1795] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:27 2022] DELETE /identity/v3/users/9dd52c2d188c43008c996dc8ee0b6834 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:27.346643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.347908 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 889/1796] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:27 2022] PUT /identity/v3/projects/daf4e12e2ba245db923e1a2b18150a87/users/1fa6e5d9b2ac42bdbb33eb9ea12c877c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:27.348783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.352533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.354427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.450363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc2f0-5773-4adc-ad9f-56631f176003 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.518543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e488-eb5f-4046-91e5-4a4df1bf0ccf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.530945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bc230-3bed-4f80-a9e3-8e74104a7149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.532574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc230-3bed-4f80-a9e3-8e74104a7149 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.532862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc230-3bed-4f80-a9e3-8e74104a7149 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.535728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc230-3bed-4f80-a9e3-8e74104a7149 admin admin] PATH_INFO: `/v3/projects/c5a9be6f3f924eff970b29e1e6ecc9fc/users/1457162ac3ce44ca8de42173780f973b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.560559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.561495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.561495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.561796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.562537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.564820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.570664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bc230-3bed-4f80-a9e3-8e74104a7149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a9be6f3f924eff970b29e1e6ecc9fc, user_id=1457162ac3ce44ca8de42173780f973b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.577468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bc230-3bed-4f80-a9e3-8e74104a7149 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.577835 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 890/1797] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:27.579491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.581851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.597678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd148e-a753-42c3-9216-20b9183bfb42 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.605275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.606188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.606668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.607104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.608043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.609914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.612760 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 908/1798] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:27 2022] PUT /identity/v3/projects/c5a9be6f3f924eff970b29e1e6ecc9fc/users/1457162ac3ce44ca8de42173780f973b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:27.616873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94626d6-16bf-45bc-94ae-e210895fc3fb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.618184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94626d6-16bf-45bc-94ae-e210895fc3fb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.619449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94626d6-16bf-45bc-94ae-e210895fc3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.631630 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 891/1799] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:27.631630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.639043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.649241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c94626d6-16bf-45bc-94ae-e210895fc3fb None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:27.650970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c94626d6-16bf-45bc-94ae-e210895fc3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.677357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b80c3-aa5e-442b-8c8d-2e0631f084d1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.775607 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 909/1800] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:50:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:27.786167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94626d6-16bf-45bc-94ae-e210895fc3fb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:27.863196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c31a-c5b5-44f5-8903-1ccbdac72f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.863888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c31a-c5b5-44f5-8903-1ccbdac72f0a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.864170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c31a-c5b5-44f5-8903-1ccbdac72f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.864472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c31a-c5b5-44f5-8903-1ccbdac72f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.865206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7c31a-c5b5-44f5-8903-1ccbdac72f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.869855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7c31a-c5b5-44f5-8903-1ccbdac72f0a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.904099 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 892/1801] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:27.908377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b7fd-3384-42ad-a909-b7e90f111ea2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.908679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b7fd-3384-42ad-a909-b7e90f111ea2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.908958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b7fd-3384-42ad-a909-b7e90f111ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.936196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94626d6-16bf-45bc-94ae-e210895fc3fb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:27.943410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ba21b-6d37-49c2-930c-4d53ddda1745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:27.944787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ba21b-6d37-49c2-930c-4d53ddda1745 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:27.945888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ba21b-6d37-49c2-930c-4d53ddda1745 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:27.946268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ba21b-6d37-49c2-930c-4d53ddda1745 admin admin] PATH_INFO: `/v3/projects/480a8add43c44a759b3eae8d6828c8cd/users/d434d471c75b4151a1604e92a53147e5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:27.949173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ba21b-6d37-49c2-930c-4d53ddda1745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480a8add43c44a759b3eae8d6828c8cd, user_id=d434d471c75b4151a1604e92a53147e5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:27.953788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ba21b-6d37-49c2-930c-4d53ddda1745 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:27.958183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2dc8b7fd-3384-42ad-a909-b7e90f111ea2 None None] MFA Rules not processed for user `1457162ac3ce44ca8de42173780f973b`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:27.959427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2dc8b7fd-3384-42ad-a909-b7e90f111ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:27.968915 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 910/1802] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:27 2022] PUT /identity/v3/projects/480a8add43c44a759b3eae8d6828c8cd/users/d434d471c75b4151a1604e92a53147e5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:27.969970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ba21b-6d37-49c2-930c-4d53ddda1745 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:28.034053 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 893/1803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:28.036641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8b7fd-3384-42ad-a909-b7e90f111ea2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:28.055744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ba21b-6d37-49c2-930c-4d53ddda1745 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:28.062848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5805b-7656-46b9-a8f3-670a5ee31e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:28.065077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5805b-7656-46b9-a8f3-670a5ee31e0b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:28.065077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5805b-7656-46b9-a8f3-670a5ee31e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:28.065609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5805b-7656-46b9-a8f3-670a5ee31e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:28.067773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5805b-7656-46b9-a8f3-670a5ee31e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:28.069451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5805b-7656-46b9-a8f3-670a5ee31e0b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:28.089859 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 911/1804] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:28.098962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4eca-b1e1-4ae6-bce3-2a83aade352a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:28.098962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4eca-b1e1-4ae6-bce3-2a83aade352a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:28.098962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4eca-b1e1-4ae6-bce3-2a83aade352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:28.138003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ffab4eca-b1e1-4ae6-bce3-2a83aade352a None None] MFA Rules not processed for user `d434d471c75b4151a1604e92a53147e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:28.139624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ffab4eca-b1e1-4ae6-bce3-2a83aade352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:28.191238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8b7fd-3384-42ad-a909-b7e90f111ea2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:28.198367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b44b5-3a6a-470e-8eb9-ae9d6d251f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:28.199572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b44b5-3a6a-470e-8eb9-ae9d6d251f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:28.200030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b44b5-3a6a-470e-8eb9-ae9d6d251f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:28.200555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b44b5-3a6a-470e-8eb9-ae9d6d251f2a admin admin] PATH_INFO: `/v3/projects/daf4e12e2ba245db923e1a2b18150a87/users/1fa6e5d9b2ac42bdbb33eb9ea12c877c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:28.203533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b44b5-3a6a-470e-8eb9-ae9d6d251f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf4e12e2ba245db923e1a2b18150a87, user_id=1fa6e5d9b2ac42bdbb33eb9ea12c877c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:28.207384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b44b5-3a6a-470e-8eb9-ae9d6d251f2a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:28.221366 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 894/1805] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:28 2022] PUT /identity/v3/projects/daf4e12e2ba245db923e1a2b18150a87/users/1fa6e5d9b2ac42bdbb33eb9ea12c877c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:28.222566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b44b5-3a6a-470e-8eb9-ae9d6d251f2a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:28.275786 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 912/1806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:28.280738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4eca-b1e1-4ae6-bce3-2a83aade352a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:28.355730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4eca-b1e1-4ae6-bce3-2a83aade352a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:28.432319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b44b5-3a6a-470e-8eb9-ae9d6d251f2a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:28.446834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:28.447526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:28.447810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:28.448086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:28.451675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:28.458248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:28.485136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:28.486215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:28.486507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:28.486789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] PATH_INFO: `/v3/projects/e0c8f961f47342b79a6b6f02eb378581/users/2bf252f141f14e90aa400ebfd9729996/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:28.509448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c8f961f47342b79a6b6f02eb378581, user_id=2bf252f141f14e90aa400ebfd9729996, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:28.512661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:28.519030 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 895/1807] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:28 2022] POST /identity/v3/projects => generated 371 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:28.519907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:28.522939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:28.537708 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 913/1808] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:28 2022] PUT /identity/v3/projects/e0c8f961f47342b79a6b6f02eb378581/users/2bf252f141f14e90aa400ebfd9729996/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:28.539035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:28.560233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:28.688966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e0bd5-185b-46ad-aeb3-b6127f6439e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:28.703246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8112c-8f0c-4d07-adc3-0bfdb3649888 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:28.708963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:28.713051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:28.713363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:28.713652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] PATH_INFO: `/v3/projects/e2a3725f1eb447c991ecbbfd45f64b28` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:28.715605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a3725f1eb447c991ecbbfd45f64b28)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:28.717807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:28.810328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a3725f1eb447c991ecbbfd45f64b28', 'request_id': 'req-d6421e4c-a0d0-4f59-91d3-61952d968118'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:28.817648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a3725f1eb447c991ecbbfd45f64b28', 'request_id': 'req-d6421e4c-a0d0-4f59-91d3-61952d968118'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:28.819589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b773-63cc-4937-8a01-f522cf1992b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:28.820920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b773-63cc-4937-8a01-f522cf1992b6 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:28.821199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b773-63cc-4937-8a01-f522cf1992b6 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:28.821473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b773-63cc-4937-8a01-f522cf1992b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:28.840678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a3725f1eb447c991ecbbfd45f64b28', 'request_id': 'req-d6421e4c-a0d0-4f59-91d3-61952d968118'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:28.859891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] The token cache is being invalidate because project e2a3725f1eb447c991ecbbfd45f64b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:28.860651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:28.861499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d6421e4c-a0d0-4f59-91d3-61952d968118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:28.867921 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 914/1809] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:28 2022] DELETE /identity/v3/projects/e2a3725f1eb447c991ecbbfd45f64b28 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:28.870023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81580c-2f1e-4693-a7a3-5e18ff7d9efd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:28.870768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81580c-2f1e-4693-a7a3-5e18ff7d9efd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:28.871197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81580c-2f1e-4693-a7a3-5e18ff7d9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:28.913525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cf81580c-2f1e-4693-a7a3-5e18ff7d9efd None None] MFA Rules not processed for user `1fa6e5d9b2ac42bdbb33eb9ea12c877c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:28.915770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cf81580c-2f1e-4693-a7a3-5e18ff7d9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:28.943514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b773-63cc-4937-8a01-f522cf1992b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:28.949012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b773-63cc-4937-8a01-f522cf1992b6 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:28.970831 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 896/1810] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:50:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:28.971801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b773-63cc-4937-8a01-f522cf1992b6 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:29.067135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 915/1811] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:29.067135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81580c-2f1e-4693-a7a3-5e18ff7d9efd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:29.074920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cf81580c-2f1e-4693-a7a3-5e18ff7d9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:29.134761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b773-63cc-4937-8a01-f522cf1992b6 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:29.230071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a247bb6-01cc-4736-84d1-0b3bb0016382 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:29.230889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247bb6-01cc-4736-84d1-0b3bb0016382 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:29.231342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247bb6-01cc-4736-84d1-0b3bb0016382 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:29.231623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247bb6-01cc-4736-84d1-0b3bb0016382 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:29.232477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247bb6-01cc-4736-84d1-0b3bb0016382 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:29.232798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247bb6-01cc-4736-84d1-0b3bb0016382 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:29.235101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247bb6-01cc-4736-84d1-0b3bb0016382 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:29.251111 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 897/1812] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:29.252714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f826-faba-4a8c-abc7-4432ea5f72e9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:29.253177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f826-faba-4a8c-abc7-4432ea5f72e9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:29.253475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f826-faba-4a8c-abc7-4432ea5f72e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:29.258714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81580c-2f1e-4693-a7a3-5e18ff7d9efd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:29.282697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfb740-e484-4262-bf28-f03876d45e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:29.291180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0cb1f826-faba-4a8c-abc7-4432ea5f72e9 None None] MFA Rules not processed for user `2bf252f141f14e90aa400ebfd9729996`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:29.291953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb740-e484-4262-bf28-f03876d45e5e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:29.293113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0cb1f826-faba-4a8c-abc7-4432ea5f72e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:29.293650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb740-e484-4262-bf28-f03876d45e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:29.294129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb740-e484-4262-bf28-f03876d45e5e admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:29.295631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfb740-e484-4262-bf28-f03876d45e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:29.304740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfb740-e484-4262-bf28-f03876d45e5e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:29.360639 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 916/1813] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:29 2022] POST /identity/v3/users => generated 292 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:29.363021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84f42-d4a7-49ce-b45d-cd75cb5d55af None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:29.363523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84f42-d4a7-49ce-b45d-cd75cb5d55af None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:29.364002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84f42-d4a7-49ce-b45d-cd75cb5d55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:29.477945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-adb84f42-d4a7-49ce-b45d-cd75cb5d55af None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:29.480749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-adb84f42-d4a7-49ce-b45d-cd75cb5d55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:29.498496 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 898/1814] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:29.499432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1f826-faba-4a8c-abc7-4432ea5f72e9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:29.508184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0cb1f826-faba-4a8c-abc7-4432ea5f72e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:29.517720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 917/1815] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:29.525956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b78b8-1d9d-47e5-846e-53bda55251a8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:29.529904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b78b8-1d9d-47e5-846e-53bda55251a8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:29.531689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b78b8-1d9d-47e5-846e-53bda55251a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:29.639382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2d8b78b8-1d9d-47e5-846e-53bda55251a8 None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:29.640929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2d8b78b8-1d9d-47e5-846e-53bda55251a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:29.745085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1f826-faba-4a8c-abc7-4432ea5f72e9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:29.761625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:29.762321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:29.762586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:29.762864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:29.786018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:29.788454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:29.817593 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 899/1816] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:29 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:29.819264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:29.825632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:29.831380 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 918/1817] 10.222.0.10 () {58 vars in 1015 bytes} [Sat Feb 19 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:29.834847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b78b8-1d9d-47e5-846e-53bda55251a8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:29.842268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ff8f-78c2-41ae-81ea-b03101ca8839 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:29.848250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:29.849128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:29.849679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:29.850215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:29.851806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:29.853849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:29.886685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b78b8-1d9d-47e5-846e-53bda55251a8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:29.899576 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 900/1818] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:29 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:29.901683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:29.906188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:29.917780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398185d-c0e3-40f5-95ce-be78b5861164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:29.918479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398185d-c0e3-40f5-95ce-be78b5861164 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:29.918779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398185d-c0e3-40f5-95ce-be78b5861164 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:29.924421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398185d-c0e3-40f5-95ce-be78b5861164 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:29.936213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398185d-c0e3-40f5-95ce-be78b5861164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:29.938037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398185d-c0e3-40f5-95ce-be78b5861164 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:30.002354 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 919/1819] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:30.006823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055741b-9059-40cd-a181-8b33b5a4fdb3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.007138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055741b-9059-40cd-a181-8b33b5a4fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.008993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055741b-9059-40cd-a181-8b33b5a4fdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.083526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5055741b-9059-40cd-a181-8b33b5a4fdb3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:30.084583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5055741b-9059-40cd-a181-8b33b5a4fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:30.090805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb42d1-8bf7-4ae4-a3e3-db4860a632a8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:30.102344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b047b6-089b-4a87-ae62-ed6cf81a5b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:30.103183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b047b6-089b-4a87-ae62-ed6cf81a5b43 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.103581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b047b6-089b-4a87-ae62-ed6cf81a5b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.103962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b047b6-089b-4a87-ae62-ed6cf81a5b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.104809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b047b6-089b-4a87-ae62-ed6cf81a5b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:30.114725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b047b6-089b-4a87-ae62-ed6cf81a5b43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:30.115811 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 920/1820] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:30.117263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055741b-9059-40cd-a181-8b33b5a4fdb3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:30.119713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5055741b-9059-40cd-a181-8b33b5a4fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:30.176715 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 901/1821] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:29 2022] POST /identity/v3/projects => generated 393 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:30.178120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b047b6-089b-4a87-ae62-ed6cf81a5b43 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:30.279578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055741b-9059-40cd-a181-8b33b5a4fdb3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:30.320947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b047b6-089b-4a87-ae62-ed6cf81a5b43 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:30.336188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:30.337376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.337743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.338133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.340754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:30.341676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:30.361002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:30.361992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21187924-ad19-42bd-b7f2-09ae0bbdc980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:30.362875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187924-ad19-42bd-b7f2-09ae0bbdc980 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.363405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187924-ad19-42bd-b7f2-09ae0bbdc980 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.363517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187924-ad19-42bd-b7f2-09ae0bbdc980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.375229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21187924-ad19-42bd-b7f2-09ae0bbdc980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:30.377142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21187924-ad19-42bd-b7f2-09ae0bbdc980 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:30.388982 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 921/1822] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:30.389877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21187924-ad19-42bd-b7f2-09ae0bbdc980 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:30.399830 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 902/1823] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:30.401041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:30.514627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21187924-ad19-42bd-b7f2-09ae0bbdc980 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:30.521591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b25c0-fb58-47ac-9844-2ed787c5800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:30.522654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b25c0-fb58-47ac-9844-2ed787c5800b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.522959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b25c0-fb58-47ac-9844-2ed787c5800b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.523578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b25c0-fb58-47ac-9844-2ed787c5800b admin admin] PATH_INFO: `/v3/projects/94082268e30d4ae4b7ac507727001f22/users/17897e0c38b145cdbb3d878bad01a373/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.545839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b25c0-fb58-47ac-9844-2ed787c5800b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94082268e30d4ae4b7ac507727001f22, user_id=17897e0c38b145cdbb3d878bad01a373, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:30.549495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b25c0-fb58-47ac-9844-2ed787c5800b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:30.587944 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 922/1824] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:30 2022] PUT /identity/v3/projects/94082268e30d4ae4b7ac507727001f22/users/17897e0c38b145cdbb3d878bad01a373/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:30.591434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b25c0-fb58-47ac-9844-2ed787c5800b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:30.597445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10ba6a-2e36-4fa3-a40a-9a280fb58124 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:30.756692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b25c0-fb58-47ac-9844-2ed787c5800b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:30.765513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:30.766537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.766823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.767102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.769238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1314929-1700-4c04-a23b-88863b8fb96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:30.770346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:30.770667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:30.771272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1314929-1700-4c04-a23b-88863b8fb96b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.771566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1314929-1700-4c04-a23b-88863b8fb96b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.771888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1314929-1700-4c04-a23b-88863b8fb96b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.774315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:30.775618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1314929-1700-4c04-a23b-88863b8fb96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:30.777598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1314929-1700-4c04-a23b-88863b8fb96b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:30.809778 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 903/1825] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:30.811908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:30.839616 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 923/1826] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:30 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:30.840696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1314929-1700-4c04-a23b-88863b8fb96b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:30.857352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1314929-1700-4c04-a23b-88863b8fb96b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:30.868755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1a794-5c58-4213-8295-549fce111d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:30.870322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1a794-5c58-4213-8295-549fce111d7c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.872314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1a794-5c58-4213-8295-549fce111d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.872729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1a794-5c58-4213-8295-549fce111d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.875034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1a794-5c58-4213-8295-549fce111d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:30.878978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1a794-5c58-4213-8295-549fce111d7c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:30.909533 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 924/1827] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:30.910588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1a794-5c58-4213-8295-549fce111d7c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:30.948822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1a794-5c58-4213-8295-549fce111d7c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:30.970664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a6876-decb-4da8-af3f-1a8739c2e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:30.974711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a6876-decb-4da8-af3f-1a8739c2e4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:30.975108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a6876-decb-4da8-af3f-1a8739c2e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:30.975389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a6876-decb-4da8-af3f-1a8739c2e4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:30.976202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a6876-decb-4da8-af3f-1a8739c2e4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:30.978143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a6876-decb-4da8-af3f-1a8739c2e4d4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:31.069225 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 925/1828] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:30 2022] POST /identity/v3/projects => generated 397 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:31.070715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a6876-decb-4da8-af3f-1a8739c2e4d4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:31.107262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389944de-b4ac-4ad7-b296-97502e7f9568 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:31.241799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a6876-decb-4da8-af3f-1a8739c2e4d4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:31.267730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ec774-12f1-42e3-b729-71d05512d467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:31.268556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ec774-12f1-42e3-b729-71d05512d467 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:31.268781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ec774-12f1-42e3-b729-71d05512d467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:31.269094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ec774-12f1-42e3-b729-71d05512d467 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:31.269826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ec774-12f1-42e3-b729-71d05512d467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:31.278835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ec774-12f1-42e3-b729-71d05512d467 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:31.318227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bb705-09ab-4ef7-be06-470cc36bbe8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:31.320249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb705-09ab-4ef7-be06-470cc36bbe8d service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:31.322510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb705-09ab-4ef7-be06-470cc36bbe8d service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:31.322981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb705-09ab-4ef7-be06-470cc36bbe8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:31.334668 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 926/1829] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:31.344844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ec774-12f1-42e3-b729-71d05512d467 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:31.365945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ec774-12f1-42e3-b729-71d05512d467 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:31.403411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac019c-962a-41ea-b791-27707877e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:31.404375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac019c-962a-41ea-b791-27707877e6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:31.404659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac019c-962a-41ea-b791-27707877e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:31.404956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac019c-962a-41ea-b791-27707877e6d0 admin admin] PATH_INFO: `/v3/projects/94082268e30d4ae4b7ac507727001f22/users/17897e0c38b145cdbb3d878bad01a373/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:31.416508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac019c-962a-41ea-b791-27707877e6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94082268e30d4ae4b7ac507727001f22, user_id=17897e0c38b145cdbb3d878bad01a373, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:31.419446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac019c-962a-41ea-b791-27707877e6d0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:31.465645 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 927/1830] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:31 2022] PUT /identity/v3/projects/94082268e30d4ae4b7ac507727001f22/users/17897e0c38b145cdbb3d878bad01a373/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:31.465645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac019c-962a-41ea-b791-27707877e6d0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:31.531422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bb705-09ab-4ef7-be06-470cc36bbe8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:31.537307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bb705-09ab-4ef7-be06-470cc36bbe8d service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:31.577095 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 904/1831] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:31.601302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bb705-09ab-4ef7-be06-470cc36bbe8d service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:31.626402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bb705-09ab-4ef7-be06-470cc36bbe8d service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:31.659503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac019c-962a-41ea-b791-27707877e6d0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:31.674987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aabbc-064d-4569-a957-fb168c34d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:31.675755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aabbc-064d-4569-a957-fb168c34d3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:31.676035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aabbc-064d-4569-a957-fb168c34d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:31.676306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aabbc-064d-4569-a957-fb168c34d3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:31.677475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aabbc-064d-4569-a957-fb168c34d3d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:31.679962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aabbc-064d-4569-a957-fb168c34d3d1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:31.735185 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 928/1832] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:31 2022] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:31.736899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d011-c8cb-4802-b5a0-0234a62c8a0d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:31.737222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d011-c8cb-4802-b5a0-0234a62c8a0d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:31.737562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d011-c8cb-4802-b5a0-0234a62c8a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:31.783692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72d5b-2d2f-41e0-b4d3-72513121839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:31.784857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72d5b-2d2f-41e0-b4d3-72513121839c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:31.785211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72d5b-2d2f-41e0-b4d3-72513121839c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:31.786461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72d5b-2d2f-41e0-b4d3-72513121839c admin admin] PATH_INFO: `/v3/projects/969938e741134a33af033cc9017c5690/users/4699ea2d465d4dff8ac89656939da95a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:31.806146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9885d011-c8cb-4802-b5a0-0234a62c8a0d None None] MFA Rules not processed for user `17897e0c38b145cdbb3d878bad01a373`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:31.807431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9885d011-c8cb-4802-b5a0-0234a62c8a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:31.825724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72d5b-2d2f-41e0-b4d3-72513121839c admin admin] RBAC: Authorizing `identity:create_grant(project_id=969938e741134a33af033cc9017c5690, user_id=4699ea2d465d4dff8ac89656939da95a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:31.832624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72d5b-2d2f-41e0-b4d3-72513121839c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:31.874950 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 905/1833] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:31 2022] PUT /identity/v3/projects/969938e741134a33af033cc9017c5690/users/4699ea2d465d4dff8ac89656939da95a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:31.875963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b9734-6947-48b5-8efd-4e62d3d398db None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:31.875963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b9734-6947-48b5-8efd-4e62d3d398db None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:31.877247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b9734-6947-48b5-8efd-4e62d3d398db None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:31.881469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 906/1834] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:31.886320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b9734-6947-48b5-8efd-4e62d3d398db None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:32.013556 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 929/1835] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:32.013556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d011-c8cb-4802-b5a0-0234a62c8a0d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:32.013556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9885d011-c8cb-4802-b5a0-0234a62c8a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:32.052204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d011-c8cb-4802-b5a0-0234a62c8a0d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:32.114355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b9734-6947-48b5-8efd-4e62d3d398db None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:32.149151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026b58c-6100-4d5d-897a-1aa0e52ca123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:32.150096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026b58c-6100-4d5d-897a-1aa0e52ca123 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:32.150096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026b58c-6100-4d5d-897a-1aa0e52ca123 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:32.150338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026b58c-6100-4d5d-897a-1aa0e52ca123 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:32.151091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026b58c-6100-4d5d-897a-1aa0e52ca123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:32.155240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026b58c-6100-4d5d-897a-1aa0e52ca123 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:32.193827 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 907/1836] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:32.195028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026b58c-6100-4d5d-897a-1aa0e52ca123 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:32.227006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026b58c-6100-4d5d-897a-1aa0e52ca123 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:32.234200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:32.234885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:32.235168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:32.235445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:32.236179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:32.237845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:32.258375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:32.259391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:32.259766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:32.260042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] PATH_INFO: `/v3/users/70b6ed4ef07f4e5bbde3300e064fd103` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:32.262993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b6ed4ef07f4e5bbde3300e064fd103)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:32.266809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:32.275304 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 908/1837] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:32.275304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:32.436520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b6ed4ef07f4e5bbde3300e064fd103'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:32.443133 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Feb 19 20:50:32.443959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:32.480127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b6ed4ef07f4e5bbde3300e064fd103'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:32.509375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b6ed4ef07f4e5bbde3300e064fd103'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:32.510028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b6ed4ef07f4e5bbde3300e064fd103'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:32.511574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b6ed4ef07f4e5bbde3300e064fd103'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:32.548145 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 930/1838] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:32 2022] DELETE /identity/v3/users/70b6ed4ef07f4e5bbde3300e064fd103 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:32.551852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:32.558995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:32.564970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b91856-b8f3-43e3-a36a-49eb524fecab admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:32.655365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:32.656461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:32.656878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:32.657231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/projects/1cda7aae8ee24953acb9549d72facb3a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:32.659264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:get_project(project_id=1cda7aae8ee24953acb9549d72facb3a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:32.661978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:32.664996 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 909/1839] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:32 2022] GET /identity/v3/projects/1cda7aae8ee24953acb9549d72facb3a => generated 371 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:32.665920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:32.667796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:32.800757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab01b86-8018-4a2f-9600-10c84187612d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:32.809603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:32.810298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:32.810625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:32.810973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:32.811621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:32.813637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:32.821092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f8ce-1f82-4209-95a8-513ab81415b2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:32.832132 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 910/1840] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:32.834513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:32.836938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:32.848645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f33d-b98e-4c76-bdc3-336ca20b10a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:32.849402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f33d-b98e-4c76-bdc3-336ca20b10a2 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:32.849751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f33d-b98e-4c76-bdc3-336ca20b10a2 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:32.850330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f33d-b98e-4c76-bdc3-336ca20b10a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:32.859636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ab0f33d-b98e-4c76-bdc3-336ca20b10a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:32.873634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d9469-3080-4dad-acf7-b8a38f597f56 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:32.895329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621fbb-3ae5-42b2-b895-599de1f85b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:32.896380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621fbb-3ae5-42b2-b895-599de1f85b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:32.896840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621fbb-3ae5-42b2-b895-599de1f85b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:32.897310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621fbb-3ae5-42b2-b895-599de1f85b60 admin admin] PATH_INFO: `/v3/projects/969938e741134a33af033cc9017c5690/users/4699ea2d465d4dff8ac89656939da95a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:32.902317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69621fbb-3ae5-42b2-b895-599de1f85b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969938e741134a33af033cc9017c5690, user_id=4699ea2d465d4dff8ac89656939da95a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:32.905481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69621fbb-3ae5-42b2-b895-599de1f85b60 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:32.949992 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 911/1841] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:32 2022] PUT /identity/v3/projects/969938e741134a33af033cc9017c5690/users/4699ea2d465d4dff8ac89656939da95a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:32.955084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87994-2e08-4763-af5f-c7013daa41a1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:32.955382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87994-2e08-4763-af5f-c7013daa41a1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:32.957500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87994-2e08-4763-af5f-c7013daa41a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.053024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fcb87994-2e08-4763-af5f-c7013daa41a1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:33.057089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fcb87994-2e08-4763-af5f-c7013daa41a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:33.064623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f33d-b98e-4c76-bdc3-336ca20b10a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:33.066246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f33d-b98e-4c76-bdc3-336ca20b10a2 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:33.111341 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 931/1842] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:33.114519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd2317-cbee-4b41-b546-a7ce11feac33 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:33.116965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd2317-cbee-4b41-b546-a7ce11feac33 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:33.118791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd2317-cbee-4b41-b546-a7ce11feac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.198134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c7dd2317-cbee-4b41-b546-a7ce11feac33 None None] MFA Rules not processed for user `1fc7244fbf3b4298b92daf9e442fe669`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:33.199401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c7dd2317-cbee-4b41-b546-a7ce11feac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:33.356669 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 912/1843] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:33.369861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87994-2e08-4763-af5f-c7013daa41a1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:33.388109 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 932/1844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:33.389602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658029d-7b93-479c-a296-0b7c0f5569f3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:33.389927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658029d-7b93-479c-a296-0b7c0f5569f3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:33.390176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658029d-7b93-479c-a296-0b7c0f5569f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.434883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9658029d-7b93-479c-a296-0b7c0f5569f3 None None] MFA Rules not processed for user `4699ea2d465d4dff8ac89656939da95a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:33.436126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9658029d-7b93-479c-a296-0b7c0f5569f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:33.439583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87994-2e08-4763-af5f-c7013daa41a1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:33.463936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f979d-8a19-4009-ab64-dea811d8f6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:33.465256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f979d-8a19-4009-ab64-dea811d8f6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:33.467151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f979d-8a19-4009-ab64-dea811d8f6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:33.468783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f979d-8a19-4009-ab64-dea811d8f6e4 admin admin] PATH_INFO: `/v3/projects/3ad8c0a30d35416c8fc1e32a09e4e334/users/4c8910f44217477cacf67f872ffeca8d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.523454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f979d-8a19-4009-ab64-dea811d8f6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad8c0a30d35416c8fc1e32a09e4e334, user_id=4c8910f44217477cacf67f872ffeca8d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:33.541022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f979d-8a19-4009-ab64-dea811d8f6e4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:33.574512 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 913/1845] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:33 2022] PUT /identity/v3/projects/3ad8c0a30d35416c8fc1e32a09e4e334/users/4c8910f44217477cacf67f872ffeca8d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:33.579781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45981d6-b25a-4b5f-beeb-0bc496e7597d None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:33.580147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45981d6-b25a-4b5f-beeb-0bc496e7597d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:33.580456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45981d6-b25a-4b5f-beeb-0bc496e7597d None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.588750 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 914/1846] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:50:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:33.591255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa329-7daa-49e2-8eee-ccc22f9a2f1c None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:33.591693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa329-7daa-49e2-8eee-ccc22f9a2f1c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:33.592115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa329-7daa-49e2-8eee-ccc22f9a2f1c None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.608570 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 915/1847] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:33 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:33.609751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa329-7daa-49e2-8eee-ccc22f9a2f1c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:33.614981 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 933/1848] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:33.614981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658029d-7b93-479c-a296-0b7c0f5569f3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:33.616508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9bdaa329-7daa-49e2-8eee-ccc22f9a2f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:33.619353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9658029d-7b93-479c-a296-0b7c0f5569f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:33.656628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658029d-7b93-479c-a296-0b7c0f5569f3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:33.762224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa329-7daa-49e2-8eee-ccc22f9a2f1c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:33.770380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:33.771175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:33.771487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:33.771832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.807651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db95d39-0cff-4d4e-b481-dd6aca1660f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:33.808361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95d39-0cff-4d4e-b481-dd6aca1660f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:33.808637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95d39-0cff-4d4e-b481-dd6aca1660f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:33.808915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95d39-0cff-4d4e-b481-dd6aca1660f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.809621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db95d39-0cff-4d4e-b481-dd6aca1660f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:33.811519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db95d39-0cff-4d4e-b481-dd6aca1660f5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:33.879179 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 934/1849] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:33 2022] POST /identity/v3/projects => generated 403 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:33.881320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427b37-5bbb-466d-b7b2-82dd33bfd699 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:33.881528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427b37-5bbb-466d-b7b2-82dd33bfd699 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:33.882159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427b37-5bbb-466d-b7b2-82dd33bfd699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:33.934709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-91427b37-5bbb-466d-b7b2-82dd33bfd699 None None] MFA Rules not processed for user `4c8910f44217477cacf67f872ffeca8d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:33.934709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-91427b37-5bbb-466d-b7b2-82dd33bfd699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:33.953509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:33.955092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:33.980547 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 916/1850] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:33.981685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:34.106693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 935/1851] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:34.109919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5a25-2d96-4441-ae71-1d152613f1b9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:34.110243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5a25-2d96-4441-ae71-1d152613f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:34.110652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5a25-2d96-4441-ae71-1d152613f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:34.113078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:34.115131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:34.161538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0d7a5a25-2d96-4441-ae71-1d152613f1b9 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:34.162987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0d7a5a25-2d96-4441-ae71-1d152613f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:34.251421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3d9c0-5633-4ba1-9127-8d158315d380 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:34.308306 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 936/1852] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:34.309302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a5a25-2d96-4441-ae71-1d152613f1b9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:34.311879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0d7a5a25-2d96-4441-ae71-1d152613f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:34.401199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:34.401994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:34.402273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:34.402607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/projects/1cda7aae8ee24953acb9549d72facb3a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:34.403856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:get_project(project_id=1cda7aae8ee24953acb9549d72facb3a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:34.406604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:34.409165 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 917/1853] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:33 2022] GET /identity/v3/projects/1cda7aae8ee24953acb9549d72facb3a => generated 371 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:34.410185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:34.414979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:34.441509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547703e3-27b8-4281-9847-7e9622ffe4e8 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:34.456655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8da8b-07b8-486f-acb0-09aa289dda5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:34.457319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8da8b-07b8-486f-acb0-09aa289dda5f service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:34.457603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8da8b-07b8-486f-acb0-09aa289dda5f service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:34.457872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8da8b-07b8-486f-acb0-09aa289dda5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:34.504084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a5a25-2d96-4441-ae71-1d152613f1b9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:34.515380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:34.516168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:34.516510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:34.516863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] PATH_INFO: `/v3/users/1457162ac3ce44ca8de42173780f973b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:34.521547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1457162ac3ce44ca8de42173780f973b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:34.521667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:34.609149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8da8b-07b8-486f-acb0-09aa289dda5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:34.610916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1457162ac3ce44ca8de42173780f973b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:34.614262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8da8b-07b8-486f-acb0-09aa289dda5f service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:34.662307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1457162ac3ce44ca8de42173780f973b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:34.685851 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 918/1854] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:34.687767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8da8b-07b8-486f-acb0-09aa289dda5f service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:34.721094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8da8b-07b8-486f-acb0-09aa289dda5f service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:34.732995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1457162ac3ce44ca8de42173780f973b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:34.734273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1457162ac3ce44ca8de42173780f973b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:34.735217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:34.735543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1457162ac3ce44ca8de42173780f973b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:34.735970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:34.736258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:34.736563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:34.737275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:34.746714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:34.764743 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 937/1855] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:34 2022] DELETE /identity/v3/users/1457162ac3ce44ca8de42173780f973b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:34.766025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:34.768591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:34.789997 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 919/1856] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:34 2022] POST /identity/v3/users => generated 308 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:34.792140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:34.794357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:34.815709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6809-6a53-4f45-a6f5-f402b58365c2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:34.931562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2aff4-097b-4a72-81aa-e5525c9232cd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:34.953937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:34.955366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:34.955977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:34.956537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:34.957681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:34.962772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:34.964092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192e332-7963-400f-97a1-5ee6ef8d7d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:34.967843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192e332-7963-400f-97a1-5ee6ef8d7d2d service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:34.968130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192e332-7963-400f-97a1-5ee6ef8d7d2d service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:34.968439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192e332-7963-400f-97a1-5ee6ef8d7d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:34.974134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d192e332-7963-400f-97a1-5ee6ef8d7d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.013167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192e332-7963-400f-97a1-5ee6ef8d7d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.017062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192e332-7963-400f-97a1-5ee6ef8d7d2d service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.030249 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 938/1857] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:34 2022] POST /identity/v3/projects => generated 399 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:35.032161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.037385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.053118 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 920/1858] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:35.055423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0777e-e314-4a89-9d90-9074c19da599 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.059113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0777e-e314-4a89-9d90-9074c19da599 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.059630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0777e-e314-4a89-9d90-9074c19da599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.098550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-47a0777e-e314-4a89-9d90-9074c19da599 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:35.108305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-47a0777e-e314-4a89-9d90-9074c19da599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.137849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef8214-ee60-46d1-aa1a-733f260a6c45 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:35.143876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:35.144755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.145891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.145891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.146206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:35.146517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.150453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.166466 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 939/1859] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:35.167374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.170430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.225375 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 921/1860] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:35.225375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0777e-e314-4a89-9d90-9074c19da599 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.225375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-47a0777e-e314-4a89-9d90-9074c19da599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.247646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0777e-e314-4a89-9d90-9074c19da599 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:35.255425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:35.258127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.258943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032c32f-d84f-452a-9503-05d3a550cba3 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:35.260484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.260906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] PATH_INFO: `/v3/users/2bf252f141f14e90aa400ebfd9729996` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.263411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf252f141f14e90aa400ebfd9729996)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.266123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.266810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:35.268681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.269467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.269932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.271166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.274661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.290739 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 940/1861] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:35.291901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.294035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.312770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcb4bd-3e89-4e8a-89b4-1acd8c11768e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:35.318733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:35.319876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.320360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.320480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] PATH_INFO: `/v3/projects/450122b7dbbc42b7a10f4b61c985e138` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.322016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=450122b7dbbc42b7a10f4b61c985e138)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.324201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.356977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf252f141f14e90aa400ebfd9729996'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.362383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf252f141f14e90aa400ebfd9729996'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.363665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf252f141f14e90aa400ebfd9729996'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.395500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf252f141f14e90aa400ebfd9729996'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.409359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf252f141f14e90aa400ebfd9729996'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.430236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450122b7dbbc42b7a10f4b61c985e138', 'request_id': 'req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.433362 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 922/1862] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:35 2022] DELETE /identity/v3/users/2bf252f141f14e90aa400ebfd9729996 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:35.434500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.436237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.446958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450122b7dbbc42b7a10f4b61c985e138', 'request_id': 'req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.462693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450122b7dbbc42b7a10f4b61c985e138', 'request_id': 'req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.489195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] The token cache is being invalidate because project 450122b7dbbc42b7a10f4b61c985e138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:35.489807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.490706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:35.493542 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 941/1863] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:35 2022] DELETE /identity/v3/projects/450122b7dbbc42b7a10f4b61c985e138 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:35.494799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.496984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.544754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b3e3b-d026-4fa0-ba37-dd46d6aac481 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:35.553558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:35.554844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.555343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.555767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.557314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.561558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.601501 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 923/1864] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:35 2022] POST /identity/v3/users => generated 306 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:35.601501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.606655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.610645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d85dc-6d98-4b1d-af79-0e4157a1ce4a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:35.740486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0842b05-c54b-4d48-a694-66fb3047e893 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:35.751510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:35.752494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.753185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.753678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.755854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.789030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.790839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.832796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 924/1865] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:35.837053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.842862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:35.866020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac7b2-4889-4d1e-abfe-51e02a39f519 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:35.866846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac7b2-4889-4d1e-abfe-51e02a39f519 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.867054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac7b2-4889-4d1e-abfe-51e02a39f519 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.867330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac7b2-4889-4d1e-abfe-51e02a39f519 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.871975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09070-f648-4c3c-a138-61819e0dbbf1 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:35.877723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac7b2-4889-4d1e-abfe-51e02a39f519 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.882863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac7b2-4889-4d1e-abfe-51e02a39f519 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.885321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:35.886504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.887013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.887883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] PATH_INFO: `/v3/projects/468c5e5a1f98468ba44fa46e65bdbede/users/65d81e6c7c1640eca1aa9fd51510f6ce/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.923496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468c5e5a1f98468ba44fa46e65bdbede, user_id=65d81e6c7c1640eca1aa9fd51510f6ce, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:35.932370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:35.941810 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 942/1866] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:35 2022] POST /identity/v3/users => generated 383 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:35.947200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9320-2fd3-410c-8093-c6583f79dba6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:35.947614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9320-2fd3-410c-8093-c6583f79dba6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:35.948459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9320-2fd3-410c-8093-c6583f79dba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:35.972242 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 925/1867] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:35 2022] PUT /identity/v3/projects/468c5e5a1f98468ba44fa46e65bdbede/users/65d81e6c7c1640eca1aa9fd51510f6ce/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:35.973584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:35.980600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:36.001639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-519e9320-2fd3-410c-8093-c6583f79dba6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:36.002883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-519e9320-2fd3-410c-8093-c6583f79dba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:36.168462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9d74f-1719-4ea4-8be2-ab845f4251a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:36.176412 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 943/1868] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:36.177637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9320-2fd3-410c-8093-c6583f79dba6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:36.181822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-519e9320-2fd3-410c-8093-c6583f79dba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:36.190105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:36.191073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:36.191478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:36.191782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] PATH_INFO: `/v3/users/1fa6e5d9b2ac42bdbb33eb9ea12c877c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:36.196696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa6e5d9b2ac42bdbb33eb9ea12c877c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:36.202682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:36.213381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9320-2fd3-410c-8093-c6583f79dba6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:36.232173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63895b-7d91-4654-ac9c-0b993bd440cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:36.233122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63895b-7d91-4654-ac9c-0b993bd440cb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:36.233741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63895b-7d91-4654-ac9c-0b993bd440cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:36.236678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63895b-7d91-4654-ac9c-0b993bd440cb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:36.238306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63895b-7d91-4654-ac9c-0b993bd440cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:36.244283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63895b-7d91-4654-ac9c-0b993bd440cb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:36.283449 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 944/1869] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:36.283449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63895b-7d91-4654-ac9c-0b993bd440cb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:36.327839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa6e5d9b2ac42bdbb33eb9ea12c877c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:36.331844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa6e5d9b2ac42bdbb33eb9ea12c877c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:36.332756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa6e5d9b2ac42bdbb33eb9ea12c877c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:36.378332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa6e5d9b2ac42bdbb33eb9ea12c877c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:36.391617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa6e5d9b2ac42bdbb33eb9ea12c877c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:36.416617 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 926/1870] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:35 2022] DELETE /identity/v3/users/1fa6e5d9b2ac42bdbb33eb9ea12c877c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:36.418093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:36.420569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:36.420701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63895b-7d91-4654-ac9c-0b993bd440cb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:36.593384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:36.595449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:36.595762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:36.596086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:36.597065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:36.597390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:36.599606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:36.622017 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 945/1871] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:36.623374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:36.625757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:36.659457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3f3d-d494-45f2-b998-cd94751f274b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:36.686520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:36.687223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:36.687512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:36.688066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:36.688845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:36.690504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:36.738422 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 927/1872] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:36.749463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:36.754487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:36.789576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd926a-fa2c-4c8c-a0de-cee4e984ff1a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:36.793645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a295-8275-497b-9377-cf3712bce6ce tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:36.797752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83b170-966d-419c-b406-82ed0a31adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:36.798665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b170-966d-419c-b406-82ed0a31adc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:36.798969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b170-966d-419c-b406-82ed0a31adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:36.799235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83b170-966d-419c-b406-82ed0a31adc0 admin admin] PATH_INFO: `/v3/projects/7fa2c918226844d4b6496d44151aed43/users/7b347a0d40a4416d8ae843f5b8b0c8ec/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:36.805085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:36.807279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:36.809268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:36.810390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:36.819392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:36.839773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83b170-966d-419c-b406-82ed0a31adc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa2c918226844d4b6496d44151aed43, user_id=7b347a0d40a4416d8ae843f5b8b0c8ec, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:36.843913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83b170-966d-419c-b406-82ed0a31adc0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:36.851635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:36.853362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:36.868311 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 928/1873] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:36 2022] PUT /identity/v3/projects/7fa2c918226844d4b6496d44151aed43/users/7b347a0d40a4416d8ae843f5b8b0c8ec/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:36.871315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95db138-6b95-492e-bdd5-801883085976 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:36.872508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95db138-6b95-492e-bdd5-801883085976 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:36.873173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95db138-6b95-492e-bdd5-801883085976 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:36.876699 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 929/1874] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:36.877772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95db138-6b95-492e-bdd5-801883085976 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:36.878591 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 946/1875] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:36.879447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:36.907400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22dc6c-ed7d-4e88-bedc-5a389144850e service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:36.978533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95db138-6b95-492e-bdd5-801883085976 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:36.985999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7720-a7de-43f4-99ea-810321c41b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:36.987251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7720-a7de-43f4-99ea-810321c41b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:36.987583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7720-a7de-43f4-99ea-810321c41b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:36.987872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7720-a7de-43f4-99ea-810321c41b8b admin admin] PATH_INFO: `/v3/projects/468c5e5a1f98468ba44fa46e65bdbede/users/65d81e6c7c1640eca1aa9fd51510f6ce/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:36.990674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7720-a7de-43f4-99ea-810321c41b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=468c5e5a1f98468ba44fa46e65bdbede, user_id=65d81e6c7c1640eca1aa9fd51510f6ce, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:36.997782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7720-a7de-43f4-99ea-810321c41b8b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:37.009050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:37.010648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:37.011157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:37.011662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:37.012798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:37.014674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:37.035032 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 947/1877] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:37.036855 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 930/1877] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:36 2022] PUT /identity/v3/projects/468c5e5a1f98468ba44fa46e65bdbede/users/65d81e6c7c1640eca1aa9fd51510f6ce/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:37.037363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:37.039949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:37.044103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7720-a7de-43f4-99ea-810321c41b8b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:37.184281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7720-a7de-43f4-99ea-810321c41b8b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:37.208620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698555c6-e0ae-4f28-9973-c703b509426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:37.209826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698555c6-e0ae-4f28-9973-c703b509426f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:37.210216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698555c6-e0ae-4f28-9973-c703b509426f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:37.211357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698555c6-e0ae-4f28-9973-c703b509426f admin admin] PATH_INFO: `/v3/projects/7fa2c918226844d4b6496d44151aed43/users/7b347a0d40a4416d8ae843f5b8b0c8ec/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:37.215959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698555c6-e0ae-4f28-9973-c703b509426f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa2c918226844d4b6496d44151aed43, user_id=7b347a0d40a4416d8ae843f5b8b0c8ec, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:37.220874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698555c6-e0ae-4f28-9973-c703b509426f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:37.236413 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Feb 19 20:50:37.237039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:37.238746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:37.321905 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 931/1878] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:37 2022] PUT /identity/v3/projects/7fa2c918226844d4b6496d44151aed43/users/7b347a0d40a4416d8ae843f5b8b0c8ec/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:37.328571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216287-ccec-4ee9-a123-ebcd1fcaf62a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:37.328945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216287-ccec-4ee9-a123-ebcd1fcaf62a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:37.329231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216287-ccec-4ee9-a123-ebcd1fcaf62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:37.379054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee7ada-e7f7-4297-9050-b168480dbda7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:37.468808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3f216287-ccec-4ee9-a123-ebcd1fcaf62a None None] MFA Rules not processed for user `7b347a0d40a4416d8ae843f5b8b0c8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:37.470120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3f216287-ccec-4ee9-a123-ebcd1fcaf62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:37.568276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:37.575279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:37.575572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:37.576522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/projects/1cda7aae8ee24953acb9549d72facb3a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:37.580397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:get_project(project_id=1cda7aae8ee24953acb9549d72facb3a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:37.584145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:37.592016 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 948/1879] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:37 2022] GET /identity/v3/projects/1cda7aae8ee24953acb9549d72facb3a => generated 371 bytes in 556 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:37.595523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:37.606711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:37.791902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13f27-b9c2-41ef-b68f-a0573d0447ec tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:37.803665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:37.804662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:37.804893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:37.805170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] PATH_INFO: `/v3/projects/c5a9be6f3f924eff970b29e1e6ecc9fc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:37.807103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a9be6f3f924eff970b29e1e6ecc9fc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:37.809055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:37.896378 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 932/1880] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:37.899756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f216287-ccec-4ee9-a123-ebcd1fcaf62a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:37.903309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3f216287-ccec-4ee9-a123-ebcd1fcaf62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:37.918104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a9be6f3f924eff970b29e1e6ecc9fc', 'request_id': 'req-6fae032a-4547-4ccc-b6f9-2591ca279a69'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:37.931123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f216287-ccec-4ee9-a123-ebcd1fcaf62a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:37.931445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a9be6f3f924eff970b29e1e6ecc9fc', 'request_id': 'req-6fae032a-4547-4ccc-b6f9-2591ca279a69'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:37.950449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a9be6f3f924eff970b29e1e6ecc9fc', 'request_id': 'req-6fae032a-4547-4ccc-b6f9-2591ca279a69'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:37.968116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] The token cache is being invalidate because project c5a9be6f3f924eff970b29e1e6ecc9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:37.968439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:37.970422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:37.977885 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 949/1881] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:37 2022] DELETE /identity/v3/projects/c5a9be6f3f924eff970b29e1e6ecc9fc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:37.978864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:37.982674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:38.104128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:38.106597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:38.107504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:38.110779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] PATH_INFO: `/v3/projects/daf4e12e2ba245db923e1a2b18150a87` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:38.112486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf4e12e2ba245db923e1a2b18150a87)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:38.122270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:38.154167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae032a-4547-4ccc-b6f9-2591ca279a69 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:38.168162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:38.168989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:38.169272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:38.169600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:38.173271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:38.255993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:38.258229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:38.269836 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 950/1882] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:38.270832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:38.272209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:38.289684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf4e12e2ba245db923e1a2b18150a87', 'request_id': 'req-a06bf92b-a00b-4c9f-9978-5f0a98201271'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.293032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79352b-b8b1-4faf-aa75-61a05d5c164d service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:38.303772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf4e12e2ba245db923e1a2b18150a87', 'request_id': 'req-a06bf92b-a00b-4c9f-9978-5f0a98201271'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.311646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf4e12e2ba245db923e1a2b18150a87', 'request_id': 'req-a06bf92b-a00b-4c9f-9978-5f0a98201271'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.360294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] The token cache is being invalidate because project daf4e12e2ba245db923e1a2b18150a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:38.360635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.362436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a06bf92b-a00b-4c9f-9978-5f0a98201271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.369992 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 933/1883] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:37 2022] DELETE /identity/v3/projects/daf4e12e2ba245db923e1a2b18150a87 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:38.377965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fa5a-be2d-47d3-b6a3-1b89ad345028 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:38.378260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fa5a-be2d-47d3-b6a3-1b89ad345028 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:38.378541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fa5a-be2d-47d3-b6a3-1b89ad345028 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:38.389118 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 934/1884] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:38 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:38.390418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fa5a-be2d-47d3-b6a3-1b89ad345028 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:38.399967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-27d9fa5a-be2d-47d3-b6a3-1b89ad345028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:38.428598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:38.431063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:38.431364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:38.431980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] PATH_INFO: `/v3/users/17897e0c38b145cdbb3d878bad01a373` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:38.435368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17897e0c38b145cdbb3d878bad01a373)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:38.437053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:38.532847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fa5a-be2d-47d3-b6a3-1b89ad345028 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:38.540978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:38.542308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:38.542745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:38.543184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] PATH_INFO: `/v3/projects/e0c8f961f47342b79a6b6f02eb378581` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:38.545487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c8f961f47342b79a6b6f02eb378581)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:38.549457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:38.599959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17897e0c38b145cdbb3d878bad01a373'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.621331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17897e0c38b145cdbb3d878bad01a373'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.625794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c8f961f47342b79a6b6f02eb378581', 'request_id': 'req-694732ef-3c62-4114-8c05-a0c43ba591f2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.634944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c8f961f47342b79a6b6f02eb378581', 'request_id': 'req-694732ef-3c62-4114-8c05-a0c43ba591f2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.649715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17897e0c38b145cdbb3d878bad01a373'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.650686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17897e0c38b145cdbb3d878bad01a373'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.651378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59baaf80-cb0b-4dab-912b-fb2afb7ee021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17897e0c38b145cdbb3d878bad01a373'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.656861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c8f961f47342b79a6b6f02eb378581', 'request_id': 'req-694732ef-3c62-4114-8c05-a0c43ba591f2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.674424 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 951/1885] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:38 2022] DELETE /identity/v3/users/17897e0c38b145cdbb3d878bad01a373 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:38.676835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647733fc-7df4-49e5-8326-6368847fcdf6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:38.677134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647733fc-7df4-49e5-8326-6368847fcdf6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:38.677415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647733fc-7df4-49e5-8326-6368847fcdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:38.701301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] The token cache is being invalidate because project e0c8f961f47342b79a6b6f02eb378581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:38.701644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.702364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:38.704715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-647733fc-7df4-49e5-8326-6368847fcdf6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:38.704951 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 935/1886] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:38 2022] DELETE /identity/v3/projects/e0c8f961f47342b79a6b6f02eb378581 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:38.705872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:38.709774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-647733fc-7df4-49e5-8326-6368847fcdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:38.710116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:38.827282 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 952/1887] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:38.839161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:38.840519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:38.843023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647733fc-7df4-49e5-8326-6368847fcdf6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:38.846239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-647733fc-7df4-49e5-8326-6368847fcdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:38.929817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694732ef-3c62-4114-8c05-a0c43ba591f2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:38.996983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647733fc-7df4-49e5-8326-6368847fcdf6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:39.005475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:39.006556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:39.006796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:39.007005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/projects/1cda7aae8ee24953acb9549d72facb3a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:39.009518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:get_project(project_id=1cda7aae8ee24953acb9549d72facb3a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:39.012900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:39.013699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7d058-0c5d-46b8-bf22-53231bc85208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:39.019275 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 936/1888] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:38 2022] GET /identity/v3/projects/1cda7aae8ee24953acb9549d72facb3a => generated 371 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:39.020299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:39.029391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:39.033986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d058-0c5d-46b8-bf22-53231bc85208 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:39.034341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d058-0c5d-46b8-bf22-53231bc85208 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:39.034560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d058-0c5d-46b8-bf22-53231bc85208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:39.050505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b4a7d058-0c5d-46b8-bf22-53231bc85208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:39.060828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8602-e13c-4f6f-b645-4d1f973828e5 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:39.073921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:39.074909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:39.075076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:39.075354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] PATH_INFO: `/v3/users/4699ea2d465d4dff8ac89656939da95a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:39.081908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4699ea2d465d4dff8ac89656939da95a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:39.084017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:39.242778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4699ea2d465d4dff8ac89656939da95a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.246119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4699ea2d465d4dff8ac89656939da95a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.246119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4699ea2d465d4dff8ac89656939da95a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.266780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7d058-0c5d-46b8-bf22-53231bc85208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:39.275698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7d058-0c5d-46b8-bf22-53231bc85208 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:39.276496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4699ea2d465d4dff8ac89656939da95a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.291591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4699ea2d465d4dff8ac89656939da95a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.313855 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 953/1889] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:39.315713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6707f9-603c-4826-ac46-5fcf1034b0b9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:39.316364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6707f9-603c-4826-ac46-5fcf1034b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:39.316725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6707f9-603c-4826-ac46-5fcf1034b0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:39.333272 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 937/1890] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:39 2022] DELETE /identity/v3/users/4699ea2d465d4dff8ac89656939da95a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:39.339276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:39.342143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:39.372239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bf6707f9-603c-4826-ac46-5fcf1034b0b9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:39.374442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bf6707f9-603c-4826-ac46-5fcf1034b0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:39.494096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730779a-1696-4c95-8a36-5f70dd272b95 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:39.514678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:39.515646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:39.516010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:39.516287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/users/d6658468b7a3437d96dfcd63a0a56f31` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:39.547199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d6658468b7a3437d96dfcd63a0a56f31)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:39.549419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:39.577777 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 954/1891] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:39.599800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6707f9-603c-4826-ac46-5fcf1034b0b9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:39.641481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6707f9-603c-4826-ac46-5fcf1034b0b9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:39.654015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:39.654888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:39.655904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:39.656218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:39.657012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:39.657514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:39.694224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:39.760660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6658468b7a3437d96dfcd63a0a56f31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.762974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6658468b7a3437d96dfcd63a0a56f31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.770902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6658468b7a3437d96dfcd63a0a56f31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.772088 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 955/1892] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:39.776241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:39.780323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:39.809610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33b6fe-f5a5-453e-98e9-aea53e07b41d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:39.824671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6658468b7a3437d96dfcd63a0a56f31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.837809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:39.845297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:39.846452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6658468b7a3437d96dfcd63a0a56f31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:39.847878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:39.848191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] PATH_INFO: `/v3/users/4c8910f44217477cacf67f872ffeca8d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:39.851680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8910f44217477cacf67f872ffeca8d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:39.854320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:39.872479 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 938/1893] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:39 2022] DELETE /identity/v3/users/d6658468b7a3437d96dfcd63a0a56f31 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:39.873572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:39.878816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:39.996274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8910f44217477cacf67f872ffeca8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.063417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8910f44217477cacf67f872ffeca8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.070997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c83a6c-2359-4c67-8763-e342a0f42f28 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:40.085904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8910f44217477cacf67f872ffeca8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.088048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8910f44217477cacf67f872ffeca8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.090202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec6b4b-e4c7-44cc-9ba2-24f0b4f29dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:40.090893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec6b4b-e4c7-44cc-9ba2-24f0b4f29dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:40.091176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec6b4b-e4c7-44cc-9ba2-24f0b4f29dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:40.091455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec6b4b-e4c7-44cc-9ba2-24f0b4f29dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:40.098507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec6b4b-e4c7-44cc-9ba2-24f0b4f29dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:40.098921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8910f44217477cacf67f872ffeca8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.104776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec6b4b-e4c7-44cc-9ba2-24f0b4f29dd8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:40.141274 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 956/1894] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:39 2022] DELETE /identity/v3/users/4c8910f44217477cacf67f872ffeca8d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:40.142817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:40.144544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:40.202369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 939/1895] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:39 2022] POST /identity/v3/projects => generated 373 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:40.204278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ed756-1ca5-4a5c-aa85-e06a45c05c75 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:40.204703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ed756-1ca5-4a5c-aa85-e06a45c05c75 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:40.205086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ed756-1ca5-4a5c-aa85-e06a45c05c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:40.229451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1a2ed756-1ca5-4a5c-aa85-e06a45c05c75 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:40.231056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1a2ed756-1ca5-4a5c-aa85-e06a45c05c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:40.311459 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 940/1896] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:40.312543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ed756-1ca5-4a5c-aa85-e06a45c05c75 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:40.314132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1a2ed756-1ca5-4a5c-aa85-e06a45c05c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:40.318035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be4ae1-b608-4e4c-92df-70773ce5f033 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:40.330977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ed756-1ca5-4a5c-aa85-e06a45c05c75 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:40.337625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:40.345879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:40.345879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:40.345879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:40.345879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:40.347668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:40.422348 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 941/1897] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:40 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:40.426182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:40.431494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:40.483772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd434d471c75b4151a1604e92a53147e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '480a8add43c44a759b3eae8d6828c8cd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:40.485245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:40.489342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:40.489643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] PATH_INFO: `/v3/projects/1cda7aae8ee24953acb9549d72facb3a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:40.499065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1cda7aae8ee24953acb9549d72facb3a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:40.507187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:40.616173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4951-77c8-4e64-82ea-570e890a0cff admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:40.655183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cda7aae8ee24953acb9549d72facb3a', 'request_id': 'req-ef4782e8-5be9-4be6-a459-128ba10b5d8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.670724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cda7aae8ee24953acb9549d72facb3a', 'request_id': 'req-ef4782e8-5be9-4be6-a459-128ba10b5d8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.690188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cda7aae8ee24953acb9549d72facb3a', 'request_id': 'req-ef4782e8-5be9-4be6-a459-128ba10b5d8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.721818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] The token cache is being invalidate because project 1cda7aae8ee24953acb9549d72facb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:40.722405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.726080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:40.732501 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 957/1898] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:40 2022] DELETE /identity/v3/projects/1cda7aae8ee24953acb9549d72facb3a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:40.733983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:40.736993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:40.764987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:40.765662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:40.767508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:40.767508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:40.775208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:40.929615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4782e8-5be9-4be6-a459-128ba10b5d8d tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:40.948515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:40.950097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:40.950592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:40.951086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] PATH_INFO: `/v3/projects/94082268e30d4ae4b7ac507727001f22` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:40.954340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=94082268e30d4ae4b7ac507727001f22)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:40.957429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:40.958897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:40.959049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:41.006035 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 942/1899] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:41.007072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:41.015995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.063957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6045d7-91b9-4d9a-ac12-f6718f898000 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:41.086288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94082268e30d4ae4b7ac507727001f22', 'request_id': 'req-acda6943-c2cb-41ae-866f-11daaad8b58b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.106250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94082268e30d4ae4b7ac507727001f22', 'request_id': 'req-acda6943-c2cb-41ae-866f-11daaad8b58b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.128762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94082268e30d4ae4b7ac507727001f22', 'request_id': 'req-acda6943-c2cb-41ae-866f-11daaad8b58b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.174045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] The token cache is being invalidate because project 94082268e30d4ae4b7ac507727001f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:41.174635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.176074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.184704 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 958/1900] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:40 2022] DELETE /identity/v3/projects/94082268e30d4ae4b7ac507727001f22 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:41.190902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:41.198911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.256242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:41.257264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.259588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.261032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.262513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:41.267589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:41.295382 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 943/1901] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:41.296859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:41.299645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.356282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5934d-1445-4e0a-a280-53b332be9e30 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:41.360821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6943-c2cb-41ae-866f-11daaad8b58b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:41.373241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:41.374467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.375727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:41.376420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.376974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] PATH_INFO: `/v3/users/e449358683a04c7992dba1e4a0fda1d4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.377582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.378088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.378575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] PATH_INFO: `/v3/projects/969938e741134a33af033cc9017c5690` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.382309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=969938e741134a33af033cc9017c5690)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:41.383776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e449358683a04c7992dba1e4a0fda1d4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:41.387188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:41.389623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:41.500736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969938e741134a33af033cc9017c5690', 'request_id': 'req-190be997-e28a-41e9-b02c-a156b19ed30f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.502206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e449358683a04c7992dba1e4a0fda1d4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.513291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969938e741134a33af033cc9017c5690', 'request_id': 'req-190be997-e28a-41e9-b02c-a156b19ed30f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.526458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e449358683a04c7992dba1e4a0fda1d4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.533937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969938e741134a33af033cc9017c5690', 'request_id': 'req-190be997-e28a-41e9-b02c-a156b19ed30f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.550355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e449358683a04c7992dba1e4a0fda1d4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.552727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e449358683a04c7992dba1e4a0fda1d4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.555099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e449358683a04c7992dba1e4a0fda1d4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.573640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] The token cache is being invalidate because project 969938e741134a33af033cc9017c5690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:41.573640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.575061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-190be997-e28a-41e9-b02c-a156b19ed30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.580201 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 944/1902] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:41 2022] DELETE /identity/v3/projects/969938e741134a33af033cc9017c5690 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:41.581951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb46db-e786-4875-8168-2e664fcf128a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.582160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb46db-e786-4875-8168-2e664fcf128a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.582863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb46db-e786-4875-8168-2e664fcf128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.593507 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 959/1903] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:41 2022] DELETE /identity/v3/users/e449358683a04c7992dba1e4a0fda1d4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:41.594732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:41.596835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.634948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-90cb46db-e786-4875-8168-2e664fcf128a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:41.636096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-90cb46db-e786-4875-8168-2e664fcf128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.728141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d1187-a42d-4dee-a0bf-8be5b065ef96 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:41.734134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b4b6d-f705-43c7-838d-f0fb1f5614aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:41.734800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b4b6d-f705-43c7-838d-f0fb1f5614aa admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.735082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b4b6d-f705-43c7-838d-f0fb1f5614aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.735360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b4b6d-f705-43c7-838d-f0fb1f5614aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.736089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b4b6d-f705-43c7-838d-f0fb1f5614aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:41.737716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b4b6d-f705-43c7-838d-f0fb1f5614aa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:41.754696 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 960/1904] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:41.756151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309161da-505d-4fec-bf0e-d641ff10d114 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.756467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309161da-505d-4fec-bf0e-d641ff10d114 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.756749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309161da-505d-4fec-bf0e-d641ff10d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.765939 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 945/1905] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:41.768664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989989f-ea9e-4f9b-8974-7ecf21cc67bb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.769095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989989f-ea9e-4f9b-8974-7ecf21cc67bb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.769213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989989f-ea9e-4f9b-8974-7ecf21cc67bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.789747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-309161da-505d-4fec-bf0e-d641ff10d114 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:41.791212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-309161da-505d-4fec-bf0e-d641ff10d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.794801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4989989f-ea9e-4f9b-8974-7ecf21cc67bb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:41.796097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4989989f-ea9e-4f9b-8974-7ecf21cc67bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.808279 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 961/1906] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:41.809260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309161da-505d-4fec-bf0e-d641ff10d114 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:41.810169 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 946/1907] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:41.811512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989989f-ea9e-4f9b-8974-7ecf21cc67bb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:41.813727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-309161da-505d-4fec-bf0e-d641ff10d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.814080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4989989f-ea9e-4f9b-8974-7ecf21cc67bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.826663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309161da-505d-4fec-bf0e-d641ff10d114 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:41.836069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989989f-ea9e-4f9b-8974-7ecf21cc67bb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:41.836652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:41.837818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.838175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.838660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] PATH_INFO: `/v3/projects/3ad8c0a30d35416c8fc1e32a09e4e334` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.839943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad8c0a30d35416c8fc1e32a09e4e334)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:41.843331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:41.851667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23a955-8e31-4885-a18b-bc480a04975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:41.852765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a955-8e31-4885-a18b-bc480a04975e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.853150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a955-8e31-4885-a18b-bc480a04975e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.853523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a955-8e31-4885-a18b-bc480a04975e admin admin] PATH_INFO: `/v3/projects/fe4bbfdec74e4a09949381e5f539671d/users/ce8abcfd66f74a38a364fa80ee9970a6/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.871772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23a955-8e31-4885-a18b-bc480a04975e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4bbfdec74e4a09949381e5f539671d, user_id=ce8abcfd66f74a38a364fa80ee9970a6, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:41.874763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23a955-8e31-4885-a18b-bc480a04975e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:41.896418 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 947/1908] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:41 2022] PUT /identity/v3/projects/fe4bbfdec74e4a09949381e5f539671d/users/ce8abcfd66f74a38a364fa80ee9970a6/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:41.898467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416aa52-8ffa-4216-87a5-d729dd304291 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.898926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416aa52-8ffa-4216-87a5-d729dd304291 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.899345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416aa52-8ffa-4216-87a5-d729dd304291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.926474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad8c0a30d35416c8fc1e32a09e4e334', 'request_id': 'req-75be8af1-90e3-4793-a3b4-db159bebfc74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.930851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c416aa52-8ffa-4216-87a5-d729dd304291 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:41.932278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c416aa52-8ffa-4216-87a5-d729dd304291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:41.933773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad8c0a30d35416c8fc1e32a09e4e334', 'request_id': 'req-75be8af1-90e3-4793-a3b4-db159bebfc74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.944877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad8c0a30d35416c8fc1e32a09e4e334', 'request_id': 'req-75be8af1-90e3-4793-a3b4-db159bebfc74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.960400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] The token cache is being invalidate because project 3ad8c0a30d35416c8fc1e32a09e4e334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:41.960760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.961567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75be8af1-90e3-4793-a3b4-db159bebfc74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:41.966361 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 962/1909] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:41 2022] DELETE /identity/v3/projects/3ad8c0a30d35416c8fc1e32a09e4e334 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:41.967748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c714b-699a-4202-8668-28422b33eb51 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:41.968192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c714b-699a-4202-8668-28422b33eb51 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:41.968505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c714b-699a-4202-8668-28422b33eb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:41.996507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f70c714b-699a-4202-8668-28422b33eb51 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:41.998524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f70c714b-699a-4202-8668-28422b33eb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.005320 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 948/1910] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:42.006157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416aa52-8ffa-4216-87a5-d729dd304291 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.008499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c416aa52-8ffa-4216-87a5-d729dd304291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.012474 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 963/1911] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:42.014015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78229ed-aea2-4a97-8c1c-9975b9220ca9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.014401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78229ed-aea2-4a97-8c1c-9975b9220ca9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.014592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78229ed-aea2-4a97-8c1c-9975b9220ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.045705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c78229ed-aea2-4a97-8c1c-9975b9220ca9 None None] MFA Rules not processed for user `ce8abcfd66f74a38a364fa80ee9970a6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:42.046935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c78229ed-aea2-4a97-8c1c-9975b9220ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.113855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416aa52-8ffa-4216-87a5-d729dd304291 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.118777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.119437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.119721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.119997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.121917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.138142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.139808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.146299 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 964/1912] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:42.146299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78229ed-aea2-4a97-8c1c-9975b9220ca9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.149453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c78229ed-aea2-4a97-8c1c-9975b9220ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.168056 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 949/1913] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:42.169472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.174575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78229ed-aea2-4a97-8c1c-9975b9220ca9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.183941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.184891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.185964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.186259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] PATH_INFO: `/v3/users/7b347a0d40a4416d8ae843f5b8b0c8ec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.186418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae644-7ee9-4284-bb26-8240cbf10f73 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.188290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b347a0d40a4416d8ae843f5b8b0c8ec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.193995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.195743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.197013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.197447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.199786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.200863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:42.201590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.203516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.217565 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 950/1914] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:42.218890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.232895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ba6b-5720-440b-8652-84c2f1275736 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.239345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.240203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.240585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.241014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.242084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:42.242646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.245504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.265456 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 951/1915] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:42.266268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.268519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.277401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b347a0d40a4416d8ae843f5b8b0c8ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:42.292355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b0b2-1f2f-469a-8a75-16087134c5b4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.296603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b347a0d40a4416d8ae843f5b8b0c8ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:42.298244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.299032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.299391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.299747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.300681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.303062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.308657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b347a0d40a4416d8ae843f5b8b0c8ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:42.310303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b347a0d40a4416d8ae843f5b8b0c8ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:42.311923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b347a0d40a4416d8ae843f5b8b0c8ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:42.334238 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 965/1916] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:42 2022] DELETE /identity/v3/users/7b347a0d40a4416d8ae843f5b8b0c8ec => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:42.334238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.334724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.344116 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 952/1917] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:42 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:42.345774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.348273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.431331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224eb8c-e16d-46a9-b565-81b1bae4b7ee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.473315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccacdf-b3dd-4c13-98bd-972a5fab866b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.482665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.485188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.485985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.486478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.487746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.494477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.528436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000212e2-0872-4555-a6a1-181db86296be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.529034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000212e2-0872-4555-a6a1-181db86296be admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.529458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000212e2-0872-4555-a6a1-181db86296be admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.530567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000212e2-0872-4555-a6a1-181db86296be admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.531640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000212e2-0872-4555-a6a1-181db86296be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.533739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000212e2-0872-4555-a6a1-181db86296be admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.544640 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 953/1918] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:42 2022] POST /identity/v3/projects => generated 411 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:42.545822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.547869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.575325 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 966/1919] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:42 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:42.576597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000212e2-0872-4555-a6a1-181db86296be admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.635983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8bd08-8866-4360-a32c-92b5da800a66 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.668900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000212e2-0872-4555-a6a1-181db86296be admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.678507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef11e3-e6f1-4384-8c3d-f329ac54e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.679971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef11e3-e6f1-4384-8c3d-f329ac54e96a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.680258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef11e3-e6f1-4384-8c3d-f329ac54e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.680582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef11e3-e6f1-4384-8c3d-f329ac54e96a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.681348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef11e3-e6f1-4384-8c3d-f329ac54e96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.687618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef11e3-e6f1-4384-8c3d-f329ac54e96a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.738193 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 967/1920] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:42 2022] POST /identity/v3/users => generated 306 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:42.739339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef11e3-e6f1-4384-8c3d-f329ac54e96a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.765559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef11e3-e6f1-4384-8c3d-f329ac54e96a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.779090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.779768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.780213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.780530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.781741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.787978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.818100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613b3f-577a-4ace-9e93-92fba7010ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.818788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613b3f-577a-4ace-9e93-92fba7010ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.819071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613b3f-577a-4ace-9e93-92fba7010ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.819986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613b3f-577a-4ace-9e93-92fba7010ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.820746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613b3f-577a-4ace-9e93-92fba7010ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.823004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613b3f-577a-4ace-9e93-92fba7010ce9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.839535 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 968/1921] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:42 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:42.843703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.845942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:42.852556 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 954/1922] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:42 2022] POST /identity/v3/users => generated 294 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:42.853837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613b3f-577a-4ace-9e93-92fba7010ce9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.866134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613b3f-577a-4ace-9e93-92fba7010ce9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.869159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f68f-083a-4f86-9ceb-6799674a7e1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.875001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80fbb-4262-4f30-94ec-9fa95a5afc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.876280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80fbb-4262-4f30-94ec-9fa95a5afc7f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.876656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80fbb-4262-4f30-94ec-9fa95a5afc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.876945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80fbb-4262-4f30-94ec-9fa95a5afc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.877691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece80fbb-4262-4f30-94ec-9fa95a5afc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.880042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece80fbb-4262-4f30-94ec-9fa95a5afc7f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.881145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.882058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.882943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.883278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] PATH_INFO: `/v3/projects/6d03cb4d49884b5394c1ca3536be6a1d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.887436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d03cb4d49884b5394c1ca3536be6a1d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.889996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.892266 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 955/1923] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:42.893394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80fbb-4262-4f30-94ec-9fa95a5afc7f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.909584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80fbb-4262-4f30-94ec-9fa95a5afc7f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.919420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2435d-9abf-4e72-a09f-6593444854ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:42.920172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2435d-9abf-4e72-a09f-6593444854ce admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:42.920905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2435d-9abf-4e72-a09f-6593444854ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:42.921521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2435d-9abf-4e72-a09f-6593444854ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:42.922312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2435d-9abf-4e72-a09f-6593444854ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:42.924009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2435d-9abf-4e72-a09f-6593444854ce admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:42.947208 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 956/1924] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:42.947208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2435d-9abf-4e72-a09f-6593444854ce admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:42.991882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2435d-9abf-4e72-a09f-6593444854ce admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:42.992068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d03cb4d49884b5394c1ca3536be6a1d', 'request_id': 'req-71ee36c6-a810-4f72-a541-431d50643412'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:42.998508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d03cb4d49884b5394c1ca3536be6a1d', 'request_id': 'req-71ee36c6-a810-4f72-a541-431d50643412'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.014312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d03cb4d49884b5394c1ca3536be6a1d', 'request_id': 'req-71ee36c6-a810-4f72-a541-431d50643412'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.043923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] The token cache is being invalidate because project 6d03cb4d49884b5394c1ca3536be6a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:43.043923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.044782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.048024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 969/1925] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:42 2022] DELETE /identity/v3/projects/6d03cb4d49884b5394c1ca3536be6a1d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:43.048888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:43.053116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.077620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:43.078929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:43.078929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:43.079246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:43.080223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:43.082504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:43.097134 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 957/1926] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:43.098003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:43.102111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.116081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea736b-fc6b-4d47-9785-1724e69d5e1a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:43.122325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:43.123561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:43.124053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:43.124731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] PATH_INFO: `/v3/projects/7fa2c918226844d4b6496d44151aed43` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:43.126268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa2c918226844d4b6496d44151aed43)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:43.128500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:43.181180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee36c6-a810-4f72-a541-431d50643412 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:43.191718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:43.192432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:43.193052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:43.193330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:43.194072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:43.195768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:43.209752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa2c918226844d4b6496d44151aed43', 'request_id': 'req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.216131 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 970/1927] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:43.218313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:43.220713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa2c918226844d4b6496d44151aed43', 'request_id': 'req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.223862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.241591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa2c918226844d4b6496d44151aed43', 'request_id': 'req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.242188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26204e2-cee6-487c-9646-2676a0b96f24 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:43.261908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] The token cache is being invalidate because project 7fa2c918226844d4b6496d44151aed43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:43.262615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.277932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.284059 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 958/1928] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:43 2022] DELETE /identity/v3/projects/7fa2c918226844d4b6496d44151aed43 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:43.285188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:43.287022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.341956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:43.345472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:43.347733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:43.348216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:43.352765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:43.354797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:43.371128 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 971/1929] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:43.372600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:43.377917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.396388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f529-8116-42ec-9809-24a673cd3837 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:43.396663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371c6a8-04f5-48be-b739-0f6a5e08e4f9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:43.402902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:43.403976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:43.404263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:43.404600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] PATH_INFO: `/v3/users/d434d471c75b4151a1604e92a53147e5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:43.405128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:43.405894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d434d471c75b4151a1604e92a53147e5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:43.406482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:43.406968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:43.407447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] PATH_INFO: `/v3/projects/2fd1bcde9cde48cb98ca11712c2e3a42/users/108b74c7b48645958e9ed0b7c08d1ea6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:43.407982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:43.425723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd1bcde9cde48cb98ca11712c2e3a42, user_id=108b74c7b48645958e9ed0b7c08d1ea6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:43.429071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:43.468181 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 972/1930] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:43 2022] PUT /identity/v3/projects/2fd1bcde9cde48cb98ca11712c2e3a42/users/108b74c7b48645958e9ed0b7c08d1ea6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:43.471588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:43.475434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.511955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd434d471c75b4151a1604e92a53147e5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.515834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd434d471c75b4151a1604e92a53147e5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.519836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd434d471c75b4151a1604e92a53147e5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.556755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd434d471c75b4151a1604e92a53147e5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.571101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-970fe076-a189-479e-baad-8e92e6b40e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd434d471c75b4151a1604e92a53147e5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:43.623564 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 959/1931] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:43 2022] DELETE /identity/v3/users/d434d471c75b4151a1604e92a53147e5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:43.623766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59943a23-056f-4d69-b10b-b00b0d1c74c4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:43.624645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b17c9-96d6-4350-bbea-1dd322c33912 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:43.625168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b17c9-96d6-4350-bbea-1dd322c33912 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:43.626599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b17c9-96d6-4350-bbea-1dd322c33912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:43.674421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bd0b17c9-96d6-4350-bbea-1dd322c33912 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:43.676525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bd0b17c9-96d6-4350-bbea-1dd322c33912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.790722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:43.791804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:43.792092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:43.792394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] PATH_INFO: `/v3/projects/2b3d5a3b5d89480c90dd6e00ab650e2f/users/f9c78cd5ae934fd1aeff3011fc187cdd/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:43.826096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3d5a3b5d89480c90dd6e00ab650e2f, user_id=f9c78cd5ae934fd1aeff3011fc187cdd, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:43.829063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:43.834724 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 960/1932] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:43.836234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b17c9-96d6-4350-bbea-1dd322c33912 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:43.839971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bd0b17c9-96d6-4350-bbea-1dd322c33912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.875877 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 973/1933] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:43 2022] PUT /identity/v3/projects/2b3d5a3b5d89480c90dd6e00ab650e2f/users/f9c78cd5ae934fd1aeff3011fc187cdd/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:43.875877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:43.877141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:43.879672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b17c9-96d6-4350-bbea-1dd322c33912 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.003737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c253-202d-4c5f-9f7e-644ba5059de2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.021883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95450d32-4b2a-4b7e-bf03-779648bd9e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.022264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfbf75-f67f-4a3e-b9dd-2a2e4f1d2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.023489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfbf75-f67f-4a3e-b9dd-2a2e4f1d2bfa admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.023778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfbf75-f67f-4a3e-b9dd-2a2e4f1d2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.024058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfbf75-f67f-4a3e-b9dd-2a2e4f1d2bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.024433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450d32-4b2a-4b7e-bf03-779648bd9e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.024827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfbf75-f67f-4a3e-b9dd-2a2e4f1d2bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.025080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450d32-4b2a-4b7e-bf03-779648bd9e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.025610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450d32-4b2a-4b7e-bf03-779648bd9e66 admin admin] PATH_INFO: `/v3/projects/b50489cd0f73467db1f8a88a07eb9166/users/d1babae367ec46f5853734ac2747515e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.026443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfbf75-f67f-4a3e-b9dd-2a2e4f1d2bfa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.057989 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 974/1934] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:44.058598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad35f-5f6e-4ee7-8762-3362ea3522a2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.058985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad35f-5f6e-4ee7-8762-3362ea3522a2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.061399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad35f-5f6e-4ee7-8762-3362ea3522a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.081106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95450d32-4b2a-4b7e-bf03-779648bd9e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50489cd0f73467db1f8a88a07eb9166, user_id=d1babae367ec46f5853734ac2747515e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.084269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95450d32-4b2a-4b7e-bf03-779648bd9e66 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.099199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-478ad35f-5f6e-4ee7-8762-3362ea3522a2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:44.103047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-478ad35f-5f6e-4ee7-8762-3362ea3522a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.113422 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 961/1935] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:43 2022] PUT /identity/v3/projects/b50489cd0f73467db1f8a88a07eb9166/users/d1babae367ec46f5853734ac2747515e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:44.124774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4a0-6fe0-425c-98c0-013be7273a5c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.125134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4a0-6fe0-425c-98c0-013be7273a5c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.125490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4a0-6fe0-425c-98c0-013be7273a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.157953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5e57a4a0-6fe0-425c-98c0-013be7273a5c None None] MFA Rules not processed for user `f9c78cd5ae934fd1aeff3011fc187cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:44.159635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e57a4a0-6fe0-425c-98c0-013be7273a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.235367 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 962/1936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:44.236369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57a4a0-6fe0-425c-98c0-013be7273a5c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.242736 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 975/1937] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:44.242736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155b734-dfa6-4e71-aa54-dbd18f120bf5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.242736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155b734-dfa6-4e71-aa54-dbd18f120bf5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.242736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155b734-dfa6-4e71-aa54-dbd18f120bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.250770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57a4a0-6fe0-425c-98c0-013be7273a5c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.255717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.256750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.257298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.257805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] PATH_INFO: `/v3/projects/2fd1bcde9cde48cb98ca11712c2e3a42/users/108b74c7b48645958e9ed0b7c08d1ea6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.259946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd1bcde9cde48cb98ca11712c2e3a42, user_id=108b74c7b48645958e9ed0b7c08d1ea6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.263070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.276300 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 963/1938] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:44 2022] PUT /identity/v3/projects/2fd1bcde9cde48cb98ca11712c2e3a42/users/108b74c7b48645958e9ed0b7c08d1ea6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:44.277382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.287087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.307830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8155b734-dfa6-4e71-aa54-dbd18f120bf5 None None] MFA Rules not processed for user `d1babae367ec46f5853734ac2747515e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:44.309313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8155b734-dfa6-4e71-aa54-dbd18f120bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.381921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd014f-0215-465d-a6d2-2f78b3b6e4c5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.389701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2895d-087a-4bc4-9618-42ae6c50713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.390384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2895d-087a-4bc4-9618-42ae6c50713e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.390672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2895d-087a-4bc4-9618-42ae6c50713e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.390951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2895d-087a-4bc4-9618-42ae6c50713e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.391668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2895d-087a-4bc4-9618-42ae6c50713e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.394110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2895d-087a-4bc4-9618-42ae6c50713e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.438805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 964/1939] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:44.438805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2895d-087a-4bc4-9618-42ae6c50713e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.445319 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 976/1940] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:44.446730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af22c1-1dd6-4d81-a87a-a111e4190e39 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.447025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af22c1-1dd6-4d81-a87a-a111e4190e39 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.447302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af22c1-1dd6-4d81-a87a-a111e4190e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.482685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a1af22c1-1dd6-4d81-a87a-a111e4190e39 None None] MFA Rules not processed for user `108b74c7b48645958e9ed0b7c08d1ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:44.483700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a1af22c1-1dd6-4d81-a87a-a111e4190e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.543265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2895d-087a-4bc4-9618-42ae6c50713e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.551404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.552419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.552765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.553090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.553827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:44.554655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.557545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.576160 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 977/1941] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:44.576160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af22c1-1dd6-4d81-a87a-a111e4190e39 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.576160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a1af22c1-1dd6-4d81-a87a-a111e4190e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.581143 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 965/1942] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:44.582236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.594425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af22c1-1dd6-4d81-a87a-a111e4190e39 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.594715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4761fc-2583-4026-bf72-186a81514aa0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.600899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a0254-9895-4872-b52b-84b92a7ec9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.601262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.601625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a0254-9895-4872-b52b-84b92a7ec9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.602153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a0254-9895-4872-b52b-84b92a7ec9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.602153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a0254-9895-4872-b52b-84b92a7ec9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.602759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.603037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a0254-9895-4872-b52b-84b92a7ec9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.603154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.603445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] PATH_INFO: `/v3/projects/480a8add43c44a759b3eae8d6828c8cd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.605097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480a8add43c44a759b3eae8d6828c8cd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.605208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a0254-9895-4872-b52b-84b92a7ec9b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.608520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.640885 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 966/1943] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/users => generated 310 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:44.642193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a0254-9895-4872-b52b-84b92a7ec9b3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.655196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a0254-9895-4872-b52b-84b92a7ec9b3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.662964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4a66d-0707-438a-a2b6-c61d044381c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.664396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a66d-0707-438a-a2b6-c61d044381c6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.664799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a66d-0707-438a-a2b6-c61d044381c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.665043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a66d-0707-438a-a2b6-c61d044381c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.665760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4a66d-0707-438a-a2b6-c61d044381c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.667864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4a66d-0707-438a-a2b6-c61d044381c6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.692412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480a8add43c44a759b3eae8d6828c8cd', 'request_id': 'req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:44.701327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480a8add43c44a759b3eae8d6828c8cd', 'request_id': 'req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:44.710037 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 967/1944] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:44.720489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480a8add43c44a759b3eae8d6828c8cd', 'request_id': 'req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:44.723086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4a66d-0707-438a-a2b6-c61d044381c6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.754833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] The token cache is being invalidate because project 480a8add43c44a759b3eae8d6828c8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:44.755629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:44.756967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:44.760913 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 978/1945] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:44 2022] DELETE /identity/v3/projects/480a8add43c44a759b3eae8d6828c8cd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:44.763393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.767791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.825652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4a66d-0707-438a-a2b6-c61d044381c6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.833266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.833919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.834210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.834497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.835547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:44.836778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.838547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.847451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ce38-e37f-40e7-ac5b-1675d376fb59 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:44.859049 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 968/1946] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:44.860001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.866285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.911382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:44.912210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:44.912852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:44.913159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:44.914119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:44.916259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:44.959094 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 979/1947] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/projects => generated 403 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:44.960066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:44.964989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:44.978991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adce96-0c61-4a93-bca1-832294510f56 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.053158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e9ae0-42e5-4dd0-8589-13ad2330d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.054772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e9ae0-42e5-4dd0-8589-13ad2330d84d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.055198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e9ae0-42e5-4dd0-8589-13ad2330d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.056399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e9ae0-42e5-4dd0-8589-13ad2330d84d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.057295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e9ae0-42e5-4dd0-8589-13ad2330d84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.060435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e9ae0-42e5-4dd0-8589-13ad2330d84d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.077250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0edce5-c915-49bf-8c88-7cb711b7d48c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.077947 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 969/1948] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:45.079474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee445a0-d903-43e1-af27-3ed70d5dca08 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.079935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee445a0-d903-43e1-af27-3ed70d5dca08 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.080527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee445a0-d903-43e1-af27-3ed70d5dca08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.088432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b72eb-670c-4ccd-9b4a-09cc5ab25846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.089624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b72eb-670c-4ccd-9b4a-09cc5ab25846 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.089624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b72eb-670c-4ccd-9b4a-09cc5ab25846 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.089855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b72eb-670c-4ccd-9b4a-09cc5ab25846 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.090372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b72eb-670c-4ccd-9b4a-09cc5ab25846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.093315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b72eb-670c-4ccd-9b4a-09cc5ab25846 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.103077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4ee445a0-d903-43e1-af27-3ed70d5dca08 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:45.105335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4ee445a0-d903-43e1-af27-3ed70d5dca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:45.118550 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 970/1949] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:45.120641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee445a0-d903-43e1-af27-3ed70d5dca08 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.128409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4ee445a0-d903-43e1-af27-3ed70d5dca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:45.134432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 980/1950] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:44 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:45.135280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b72eb-670c-4ccd-9b4a-09cc5ab25846 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.154577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b72eb-670c-4ccd-9b4a-09cc5ab25846 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.160883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31fc2-2c3d-4693-b02c-c0f89d44f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.162921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31fc2-2c3d-4693-b02c-c0f89d44f1fa admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.164030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31fc2-2c3d-4693-b02c-c0f89d44f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.165152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31fc2-2c3d-4693-b02c-c0f89d44f1fa admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.166023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31fc2-2c3d-4693-b02c-c0f89d44f1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.169663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31fc2-2c3d-4693-b02c-c0f89d44f1fa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.198570 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 981/1951] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:45 2022] POST /identity/v3/users => generated 302 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:45.199740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31fc2-2c3d-4693-b02c-c0f89d44f1fa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.211773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31fc2-2c3d-4693-b02c-c0f89d44f1fa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.220070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff17dd-11db-4b09-be86-f46093d8c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.221884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff17dd-11db-4b09-be86-f46093d8c6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.222918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff17dd-11db-4b09-be86-f46093d8c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.224116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee445a0-d903-43e1-af27-3ed70d5dca08 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.224528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff17dd-11db-4b09-be86-f46093d8c6b1 admin admin] PATH_INFO: `/v3/projects/0c9fc09fc5954c599e5eda3a4c5620a3/users/94676f027e30461fb129f856ca77a330/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.246567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380990e0-269b-455a-b1c5-b866399288e7 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.248397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380990e0-269b-455a-b1c5-b866399288e7 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.248826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380990e0-269b-455a-b1c5-b866399288e7 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.249330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380990e0-269b-455a-b1c5-b866399288e7 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.250550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380990e0-269b-455a-b1c5-b866399288e7 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.253313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380990e0-269b-455a-b1c5-b866399288e7 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.265577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff17dd-11db-4b09-be86-f46093d8c6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9fc09fc5954c599e5eda3a4c5620a3, user_id=94676f027e30461fb129f856ca77a330, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.271453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff17dd-11db-4b09-be86-f46093d8c6b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.299195 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 982/1952] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:45 2022] PUT /identity/v3/projects/0c9fc09fc5954c599e5eda3a4c5620a3/users/94676f027e30461fb129f856ca77a330/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:45.302280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8117d-0de7-4d52-b2fb-22473926fdd4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.302587 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 971/1953] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:45 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:45.304036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8117d-0de7-4d52-b2fb-22473926fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.304500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380990e0-269b-455a-b1c5-b866399288e7 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.304615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8117d-0de7-4d52-b2fb-22473926fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.336344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b8a8117d-0de7-4d52-b2fb-22473926fdd4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:45.337997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b8a8117d-0de7-4d52-b2fb-22473926fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:45.418401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380990e0-269b-455a-b1c5-b866399288e7 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.424621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9de33-2c2e-463b-9533-5aa538ec58c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.425466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9de33-2c2e-463b-9533-5aa538ec58c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.426013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9de33-2c2e-463b-9533-5aa538ec58c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.426364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9de33-2c2e-463b-9533-5aa538ec58c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.427423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9de33-2c2e-463b-9533-5aa538ec58c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.429421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9de33-2c2e-463b-9533-5aa538ec58c2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.436769 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 983/1954] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:45.438175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8117d-0de7-4d52-b2fb-22473926fdd4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.442412 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 972/1955] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:45.443655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9de33-2c2e-463b-9533-5aa538ec58c2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.459983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8117d-0de7-4d52-b2fb-22473926fdd4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.461436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9de33-2c2e-463b-9533-5aa538ec58c2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.468077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e439f-7a0c-4685-8da0-5300be139ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.469130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e439f-7a0c-4685-8da0-5300be139ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.469628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e439f-7a0c-4685-8da0-5300be139ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.470103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e439f-7a0c-4685-8da0-5300be139ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.471306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e439f-7a0c-4685-8da0-5300be139ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.471412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb459a-281d-4572-a573-e7999f2cf9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.472102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb459a-281d-4572-a573-e7999f2cf9ea admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.472515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb459a-281d-4572-a573-e7999f2cf9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.472802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb459a-281d-4572-a573-e7999f2cf9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.473702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e439f-7a0c-4685-8da0-5300be139ea6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.473823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb459a-281d-4572-a573-e7999f2cf9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.475486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb459a-281d-4572-a573-e7999f2cf9ea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.492255 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 973/1956] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:45.492255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e439f-7a0c-4685-8da0-5300be139ea6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.498514 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 984/1957] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:45.503112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb459a-281d-4572-a573-e7999f2cf9ea admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.516454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb459a-281d-4572-a573-e7999f2cf9ea admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.540253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.540986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.541256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.541539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.542271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:45.542589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.544244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.575253 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 985/1958] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:45.576427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.588047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f730689-5e86-41e8-93da-0d1b96019fa5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.595860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e439f-7a0c-4685-8da0-5300be139ea6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.596595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ee20-de0a-40a6-bece-37abd3649a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.597930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ee20-de0a-40a6-bece-37abd3649a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.598220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ee20-de0a-40a6-bece-37abd3649a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.598519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ee20-de0a-40a6-bece-37abd3649a9b admin admin] PATH_INFO: `/v3/projects/f3bccd2f0cea4be2aac1d95f2696702d/users/6783946d9d5d4897b835c6a75cced6a0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.601761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.602799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.603080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.603355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.604078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:45.604427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.606156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.633008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3ee20-de0a-40a6-bece-37abd3649a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bccd2f0cea4be2aac1d95f2696702d, user_id=6783946d9d5d4897b835c6a75cced6a0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.639931 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 974/1959] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:45.641604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.656654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3ee20-de0a-40a6-bece-37abd3649a9b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.665699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03cb25-651c-4ba4-8483-90a8f8e10131 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.677071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a77ce6-c918-4764-b67d-b795adfda430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.678113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77ce6-c918-4764-b67d-b795adfda430 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.678222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 986/1960] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:45 2022] PUT /identity/v3/projects/f3bccd2f0cea4be2aac1d95f2696702d/users/6783946d9d5d4897b835c6a75cced6a0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:45.678390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77ce6-c918-4764-b67d-b795adfda430 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.679127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77ce6-c918-4764-b67d-b795adfda430 admin admin] PATH_INFO: `/v3/projects/0c9fc09fc5954c599e5eda3a4c5620a3/users/94676f027e30461fb129f856ca77a330/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.679234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ee20-de0a-40a6-bece-37abd3649a9b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.681559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77ce6-c918-4764-b67d-b795adfda430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9fc09fc5954c599e5eda3a4c5620a3, user_id=94676f027e30461fb129f856ca77a330, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.684001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77ce6-c918-4764-b67d-b795adfda430 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.712532 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 975/1961] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:45 2022] PUT /identity/v3/projects/0c9fc09fc5954c599e5eda3a4c5620a3/users/94676f027e30461fb129f856ca77a330/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:45.712532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c63d-7a8d-4d1c-95b3-be4ea23d65f4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.712532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c63d-7a8d-4d1c-95b3-be4ea23d65f4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.712532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c63d-7a8d-4d1c-95b3-be4ea23d65f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.751412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9618c63d-7a8d-4d1c-95b3-be4ea23d65f4 None None] MFA Rules not processed for user `65d81e6c7c1640eca1aa9fd51510f6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:45.752845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9618c63d-7a8d-4d1c-95b3-be4ea23d65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:45.788541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ee20-de0a-40a6-bece-37abd3649a9b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.876440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 976/1962] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:45.877156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618c63d-7a8d-4d1c-95b3-be4ea23d65f4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.891232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.892197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.892639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.893001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.893809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.895473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:45.919790 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 987/1963] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:45.919790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:45.921763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:45.959714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618c63d-7a8d-4d1c-95b3-be4ea23d65f4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:45.964729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c582-a4b1-4c0a-8979-46344d653c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:45.965612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c582-a4b1-4c0a-8979-46344d653c32 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:45.966064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c582-a4b1-4c0a-8979-46344d653c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:45.966490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c582-a4b1-4c0a-8979-46344d653c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:45.967192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9c582-a4b1-4c0a-8979-46344d653c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:45.969159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9c582-a4b1-4c0a-8979-46344d653c32 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.012721 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 977/1964] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:45 2022] POST /identity/v3/projects => generated 395 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:46.012721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c582-a4b1-4c0a-8979-46344d653c32 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.013016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e585-1d17-4e84-8156-b9c6025e1dba admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.082412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c582-a4b1-4c0a-8979-46344d653c32 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.087856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.088053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45905198-f0a2-4651-b7be-64a3ac5cacce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.088557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.088758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905198-f0a2-4651-b7be-64a3ac5cacce admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.088855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.089266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.089749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905198-f0a2-4651-b7be-64a3ac5cacce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.090042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905198-f0a2-4651-b7be-64a3ac5cacce admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.090776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45905198-f0a2-4651-b7be-64a3ac5cacce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.092470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45905198-f0a2-4651-b7be-64a3ac5cacce admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.107571 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 978/1965] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:46.109063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64aa3c-9f8f-4a60-9975-9a75b650cef4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.109358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64aa3c-9f8f-4a60-9975-9a75b650cef4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.109641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64aa3c-9f8f-4a60-9975-9a75b650cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.140095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cc64aa3c-9f8f-4a60-9975-9a75b650cef4 None None] MFA Rules not processed for user `94676f027e30461fb129f856ca77a330`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:46.141397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc64aa3c-9f8f-4a60-9975-9a75b650cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:46.153389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.164840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.179759 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 988/1966] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:46.180658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.182024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:46.198172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91908ef-1185-4601-868d-47bffac6c113 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.203876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.204727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.205020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.205304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.207310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:46.228609 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 979/1967] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:46 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:46.229343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64aa3c-9f8f-4a60-9975-9a75b650cef4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.247537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64aa3c-9f8f-4a60-9975-9a75b650cef4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.259542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44733af-1ac2-4e54-8da0-1c1dbd44c0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.260523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44733af-1ac2-4e54-8da0-1c1dbd44c0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.260807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44733af-1ac2-4e54-8da0-1c1dbd44c0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.261093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44733af-1ac2-4e54-8da0-1c1dbd44c0a4 admin admin] PATH_INFO: `/v3/projects/1d498b88d29548a48047c23af2a9ed5d/users/ed64ca428d37447fa93ede55d55ea094/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.280111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44733af-1ac2-4e54-8da0-1c1dbd44c0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d498b88d29548a48047c23af2a9ed5d, user_id=ed64ca428d37447fa93ede55d55ea094, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.282345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44733af-1ac2-4e54-8da0-1c1dbd44c0a4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.282462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.284280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.295166 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 989/1968] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:46.297314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.309723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 980/1969] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:46 2022] PUT /identity/v3/projects/1d498b88d29548a48047c23af2a9ed5d/users/ed64ca428d37447fa93ede55d55ea094/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:46.309723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44733af-1ac2-4e54-8da0-1c1dbd44c0a4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.318731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e06f7-16ce-4fde-ad95-83cc02e82bf3 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.383648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44733af-1ac2-4e54-8da0-1c1dbd44c0a4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.384864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30c3e7-8420-4106-9c03-d1b60263aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.385697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c3e7-8420-4106-9c03-d1b60263aabf admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.385984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c3e7-8420-4106-9c03-d1b60263aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.386259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c3e7-8420-4106-9c03-d1b60263aabf admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.386963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30c3e7-8420-4106-9c03-d1b60263aabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.389023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30c3e7-8420-4106-9c03-d1b60263aabf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.389536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4166fde-0a74-40e8-9367-4c393021357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.390593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4166fde-0a74-40e8-9367-4c393021357f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.391018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4166fde-0a74-40e8-9367-4c393021357f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.391850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4166fde-0a74-40e8-9367-4c393021357f admin admin] PATH_INFO: `/v3/projects/f3bccd2f0cea4be2aac1d95f2696702d/users/6783946d9d5d4897b835c6a75cced6a0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.394287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4166fde-0a74-40e8-9367-4c393021357f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bccd2f0cea4be2aac1d95f2696702d, user_id=6783946d9d5d4897b835c6a75cced6a0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.397401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4166fde-0a74-40e8-9367-4c393021357f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.414577 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 990/1970] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:46 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:46.416131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064595d-829b-4f94-9d71-66b1129c3947 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.416444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064595d-829b-4f94-9d71-66b1129c3947 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.416720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064595d-829b-4f94-9d71-66b1129c3947 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.423652 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 991/1972] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:46.425083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f0798-fbf8-43c4-931f-c437b51d92fc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.425470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f0798-fbf8-43c4-931f-c437b51d92fc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.425751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f0798-fbf8-43c4-931f-c437b51d92fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.428830 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 981/1972] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:46 2022] PUT /identity/v3/projects/f3bccd2f0cea4be2aac1d95f2696702d/users/6783946d9d5d4897b835c6a75cced6a0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:46.430518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4166fde-0a74-40e8-9367-4c393021357f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.450308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-918f0798-fbf8-43c4-931f-c437b51d92fc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:46.451528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-918f0798-fbf8-43c4-931f-c437b51d92fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:46.533582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4166fde-0a74-40e8-9367-4c393021357f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.540816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d5fa4-0c6b-42fa-afd7-d50288c122f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.541836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d5fa4-0c6b-42fa-afd7-d50288c122f7 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.542176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d5fa4-0c6b-42fa-afd7-d50288c122f7 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.542553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d5fa4-0c6b-42fa-afd7-d50288c122f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.544468 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 992/1973] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:46.546022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f0798-fbf8-43c4-931f-c437b51d92fc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.558600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f0798-fbf8-43c4-931f-c437b51d92fc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.567355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.568739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.569168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.570369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.571683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.574436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.590541 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 993/1974] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:46.591574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:46.609534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.631740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d5fa4-0c6b-42fa-afd7-d50288c122f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.633839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d5fa4-0c6b-42fa-afd7-d50288c122f7 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.648364 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 982/1975] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:46.650681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a264-d3ca-45ee-8366-bc2e2142bff1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.650976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a264-d3ca-45ee-8366-bc2e2142bff1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.651257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a264-d3ca-45ee-8366-bc2e2142bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.684912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1e87a264-d3ca-45ee-8366-bc2e2142bff1 None None] MFA Rules not processed for user `6783946d9d5d4897b835c6a75cced6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:46.686341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1e87a264-d3ca-45ee-8366-bc2e2142bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:46.689843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1107-2853-4d2f-b722-9ad3cc2bd47b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.695267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.696147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.696469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.696747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/96cdbb4fc2394031a91a13c9a670d2f7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.698001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=96cdbb4fc2394031a91a13c9a670d2f7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.700078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.701928 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 994/1976] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/projects/96cdbb4fc2394031a91a13c9a670d2f7 => generated 371 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:46.706513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.708188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:46.776953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57e19f-624f-4a8d-9665-908147ae7385 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.780685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d9ff-e3bd-4ec9-b8e7-af6ce7b58f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.780874 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 983/1977] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:46.781339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d9ff-e3bd-4ec9-b8e7-af6ce7b58f7a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.781627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d9ff-e3bd-4ec9-b8e7-af6ce7b58f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.781851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a264-d3ca-45ee-8366-bc2e2142bff1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.781949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d9ff-e3bd-4ec9-b8e7-af6ce7b58f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.795321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a264-d3ca-45ee-8366-bc2e2142bff1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.795778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19d9ff-e3bd-4ec9-b8e7-af6ce7b58f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.797314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19d9ff-e3bd-4ec9-b8e7-af6ce7b58f7a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.800224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395b51c-c18b-4139-8296-8d144e99d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.800960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b51c-c18b-4139-8296-8d144e99d41d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.801347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b51c-c18b-4139-8296-8d144e99d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.801511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395b51c-c18b-4139-8296-8d144e99d41d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.803063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395b51c-c18b-4139-8296-8d144e99d41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.804212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395b51c-c18b-4139-8296-8d144e99d41d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.809137 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 995/1978] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:46.818447 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 984/1979] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:46.819333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395b51c-c18b-4139-8296-8d144e99d41d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.819862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d9ff-e3bd-4ec9-b8e7-af6ce7b58f7a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.838652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395b51c-c18b-4139-8296-8d144e99d41d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.845510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d9ff-e3bd-4ec9-b8e7-af6ce7b58f7a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.848810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.849584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.849963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.850369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.853104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:46.853584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efe903-7159-4b3f-81ca-080f9e4a8f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.854355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe903-7159-4b3f-81ca-080f9e4a8f97 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.854809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe903-7159-4b3f-81ca-080f9e4a8f97 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.855180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe903-7159-4b3f-81ca-080f9e4a8f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.928092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.930291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.939837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efe903-7159-4b3f-81ca-080f9e4a8f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:46.941859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efe903-7159-4b3f-81ca-080f9e4a8f97 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:46.943114 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 985/1980] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:46.944253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:46.954671 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 996/1981] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:46.966547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f753-eafc-4c68-bb06-0bae1ab9e9b0 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:46.977245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce5f7f-7f72-4549-b0d5-7915246846c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:46.978490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce5f7f-7f72-4549-b0d5-7915246846c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.981437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce5f7f-7f72-4549-b0d5-7915246846c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.982852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce5f7f-7f72-4549-b0d5-7915246846c5 admin admin] PATH_INFO: `/v3/projects/12afb53ac3a94c5696b1f0bc7955cf96/users/5df681c4fec04b8cac9cc15e5cdb60e7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.984172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841465d-1177-4de8-aaf6-3f3bd630ed22 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:46.984506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841465d-1177-4de8-aaf6-3f3bd630ed22 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:46.984785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841465d-1177-4de8-aaf6-3f3bd630ed22 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:46.986731 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 997/1982] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:46.992895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841465d-1177-4de8-aaf6-3f3bd630ed22 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:47.013940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce5f7f-7f72-4549-b0d5-7915246846c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12afb53ac3a94c5696b1f0bc7955cf96, user_id=5df681c4fec04b8cac9cc15e5cdb60e7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:47.018877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce5f7f-7f72-4549-b0d5-7915246846c5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:47.030627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841465d-1177-4de8-aaf6-3f3bd630ed22 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:47.047305 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 986/1983] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:46 2022] PUT /identity/v3/projects/12afb53ac3a94c5696b1f0bc7955cf96/users/5df681c4fec04b8cac9cc15e5cdb60e7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:47.047520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841465d-1177-4de8-aaf6-3f3bd630ed22 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:47.050756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce5f7f-7f72-4549-b0d5-7915246846c5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:47.157518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce5f7f-7f72-4549-b0d5-7915246846c5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:47.162043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaa7c6-f004-4e7b-b941-d469031a5a9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:47.163062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa7c6-f004-4e7b-b941-d469031a5a9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.163939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa7c6-f004-4e7b-b941-d469031a5a9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.164959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa7c6-f004-4e7b-b941-d469031a5a9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/96cdbb4fc2394031a91a13c9a670d2f7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.166542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaa7c6-f004-4e7b-b941-d469031a5a9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=96cdbb4fc2394031a91a13c9a670d2f7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:47.168849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaa7c6-f004-4e7b-b941-d469031a5a9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:47.170499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2ca5-6b03-4c5c-9895-97cab6bf39b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:47.171360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2ca5-6b03-4c5c-9895-97cab6bf39b4 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.171468 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 998/1984] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:46 2022] GET /identity/v3/projects/96cdbb4fc2394031a91a13c9a670d2f7 => generated 371 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:50:47.172450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2ca5-6b03-4c5c-9895-97cab6bf39b4 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.173056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b204-e529-4fc9-9234-50b9a67f504b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.173310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2ca5-6b03-4c5c-9895-97cab6bf39b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.173429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b204-e529-4fc9-9234-50b9a67f504b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.175330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b204-e529-4fc9-9234-50b9a67f504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.214839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4c73b204-e529-4fc9-9234-50b9a67f504b None None] MFA Rules not processed for user `5df681c4fec04b8cac9cc15e5cdb60e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:47.216212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4c73b204-e529-4fc9-9234-50b9a67f504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:47.244632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd2ca5-6b03-4c5c-9895-97cab6bf39b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:47.246737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd2ca5-6b03-4c5c-9895-97cab6bf39b4 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:47.269074 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 987/1985] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:47.336130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2ca5-6b03-4c5c-9895-97cab6bf39b4 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:47.378978 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 999/1986] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:47.381156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f310-341e-40d3-83a1-718ad329a20c None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.381660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f310-341e-40d3-83a1-718ad329a20c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.382182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25f310-341e-40d3-83a1-718ad329a20c None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.384466 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1000/1987] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:47.385493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25f310-341e-40d3-83a1-718ad329a20c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:47.435489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2ca5-6b03-4c5c-9895-97cab6bf39b4 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:47.442336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:47.443204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.443680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.443933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] PATH_INFO: `/v3/users/f9c78cd5ae934fd1aeff3011fc187cdd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.445510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c78cd5ae934fd1aeff3011fc187cdd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:47.447491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:47.465457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25f310-341e-40d3-83a1-718ad329a20c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:47.470777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:47.471755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.472261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.472542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.473502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:47.475620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:47.525796 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1001/1988] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:47 2022] POST /identity/v3/projects => generated 395 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:47.527184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:47.543243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c78cd5ae934fd1aeff3011fc187cdd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:47.544700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c78cd5ae934fd1aeff3011fc187cdd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:47.545769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c78cd5ae934fd1aeff3011fc187cdd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:47.572740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c78cd5ae934fd1aeff3011fc187cdd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:47.596921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c78cd5ae934fd1aeff3011fc187cdd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:47.617986 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 988/1989] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:47 2022] DELETE /identity/v3/users/f9c78cd5ae934fd1aeff3011fc187cdd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:50:47.617986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:47.620460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:47.668823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:47.772257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068ab3-38ca-4581-8c53-131c01620c97 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:47.777991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94cdce-df24-421c-8c58-aee85f2ddcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:47.778701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94cdce-df24-421c-8c58-aee85f2ddcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.779035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94cdce-df24-421c-8c58-aee85f2ddcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.779314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94cdce-df24-421c-8c58-aee85f2ddcf4 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.780133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94cdce-df24-421c-8c58-aee85f2ddcf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:47.784396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94cdce-df24-421c-8c58-aee85f2ddcf4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:47.789506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ea9ed-9ba0-42ef-acf7-1dd281f3c290 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:47.814196 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 989/1990] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:47 2022] POST /identity/v3/users => generated 304 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:47.816176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270f04-44f0-4d69-9a46-6f7bfd9453e7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.816619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270f04-44f0-4d69-9a46-6f7bfd9453e7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.817532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270f04-44f0-4d69-9a46-6f7bfd9453e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.836692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-30270f04-44f0-4d69-9a46-6f7bfd9453e7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:47.837887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-30270f04-44f0-4d69-9a46-6f7bfd9453e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:47.845888 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 990/1991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:47.847828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039a8e-c30a-4025-ab93-94f8a1aea14f None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.848113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039a8e-c30a-4025-ab93-94f8a1aea14f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.848439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039a8e-c30a-4025-ab93-94f8a1aea14f None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.851546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 991/1992] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:47.852126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5039a8e-c30a-4025-ab93-94f8a1aea14f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:47.865493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5039a8e-c30a-4025-ab93-94f8a1aea14f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:47.872716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30041c-3e40-4e3a-9bf3-534b0c4cbee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:47.873410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30041c-3e40-4e3a-9bf3-534b0c4cbee2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.873825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30041c-3e40-4e3a-9bf3-534b0c4cbee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.874150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30041c-3e40-4e3a-9bf3-534b0c4cbee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.875442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30041c-3e40-4e3a-9bf3-534b0c4cbee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:47.877443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30041c-3e40-4e3a-9bf3-534b0c4cbee2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:47.891682 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 992/1993] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:47.891682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93521e-9d26-4eaa-9051-7c18d81eda4f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.891682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93521e-9d26-4eaa-9051-7c18d81eda4f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.891682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93521e-9d26-4eaa-9051-7c18d81eda4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.902700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6783946d9d5d4897b835c6a75cced6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bccd2f0cea4be2aac1d95f2696702d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:47.905042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:47.905435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:47.905837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] PATH_INFO: `/v3/projects/b50489cd0f73467db1f8a88a07eb9166` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:47.908492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] RBAC: Authorizing `identity:get_project(project_id=b50489cd0f73467db1f8a88a07eb9166)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:47.919963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:47.923444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2d93521e-9d26-4eaa-9051-7c18d81eda4f None None] MFA Rules not processed for user `ed64ca428d37447fa93ede55d55ea094`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:47.924721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2d93521e-9d26-4eaa-9051-7c18d81eda4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:47.927852 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1002/1994] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:47 2022] GET /identity/v3/projects/b50489cd0f73467db1f8a88a07eb9166 => generated 379 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:47.928922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:47.931297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.033561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.037552 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 993/1995] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:48.037687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.037781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93521e-9d26-4eaa-9051-7c18d81eda4f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.037781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2d93521e-9d26-4eaa-9051-7c18d81eda4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.105340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93521e-9d26-4eaa-9051-7c18d81eda4f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.108382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868451b2-1679-441e-a3ab-ff17f6b64c42 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.109555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.110278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.110640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.111023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.112935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffac06-1795-4aca-8145-ff68235aab08 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.113728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffac06-1795-4aca-8145-ff68235aab08 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.114048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffac06-1795-4aca-8145-ff68235aab08 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.114278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffac06-1795-4aca-8145-ff68235aab08 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/96cdbb4fc2394031a91a13c9a670d2f7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.117601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffac06-1795-4aca-8145-ff68235aab08 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=96cdbb4fc2394031a91a13c9a670d2f7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.118087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffac06-1795-4aca-8145-ff68235aab08 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.120169 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1003/1996] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:47 2022] GET /identity/v3/projects/96cdbb4fc2394031a91a13c9a670d2f7 => generated 371 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:48.120829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffac06-1795-4aca-8145-ff68235aab08 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.123429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.125193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.132759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffac06-1795-4aca-8145-ff68235aab08 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.137622 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 994/1997] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:48.139018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.140854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.144043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.145445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.145730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.145998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] PATH_INFO: `/v3/projects/25373dd2e9474b04aa01a062b0ed0505/users/d571221d26404402a3d806d730b866e3/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.160895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87621540-a995-49b6-9c46-68bfa00c944e service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.167097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25373dd2e9474b04aa01a062b0ed0505, user_id=d571221d26404402a3d806d730b866e3, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.170630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.174218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.175967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.176475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.178091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.186458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.190592 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1004/1998] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:48 2022] PUT /identity/v3/projects/25373dd2e9474b04aa01a062b0ed0505/users/d571221d26404402a3d806d730b866e3/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:48.191565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.196309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.306319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96492a3-b844-49e7-96fd-017b02075296 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.312514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68bd82-0bd4-4f64-9247-2062c50a1e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.313419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68bd82-0bd4-4f64-9247-2062c50a1e02 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.314297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68bd82-0bd4-4f64-9247-2062c50a1e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.314767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68bd82-0bd4-4f64-9247-2062c50a1e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.315646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68bd82-0bd4-4f64-9247-2062c50a1e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.318034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68bd82-0bd4-4f64-9247-2062c50a1e02 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.319370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.321645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.339211 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 995/1999] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:48.340611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.354918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039cac2-5683-4d8a-a9a9-2b9aaa63fbde service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.364795 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1005/2000] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:48 2022] POST /identity/v3/projects => generated 403 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:48.365704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68bd82-0bd4-4f64-9247-2062c50a1e02 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.451119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.453104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.453651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.454264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/96cdbb4fc2394031a91a13c9a670d2f7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.456048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96cdbb4fc2394031a91a13c9a670d2f7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.459037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.490203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68bd82-0bd4-4f64-9247-2062c50a1e02 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.496980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8b1cf-f851-4623-98b6-35f1ae4f26ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.497824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b1cf-f851-4623-98b6-35f1ae4f26ce admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.498163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b1cf-f851-4623-98b6-35f1ae4f26ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.498530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b1cf-f851-4623-98b6-35f1ae4f26ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.499826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8b1cf-f851-4623-98b6-35f1ae4f26ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.502587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8b1cf-f851-4623-98b6-35f1ae4f26ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.515225 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1006/2001] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:48.519897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8b1cf-f851-4623-98b6-35f1ae4f26ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.539120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8b1cf-f851-4623-98b6-35f1ae4f26ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.541945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cdbb4fc2394031a91a13c9a670d2f7', 'request_id': 'req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:48.553973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cdbb4fc2394031a91a13c9a670d2f7', 'request_id': 'req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:48.569140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cdbb4fc2394031a91a13c9a670d2f7', 'request_id': 'req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:48.591276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] The token cache is being invalidate because project 96cdbb4fc2394031a91a13c9a670d2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:48.591858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:48.597094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1ee71ba-3dce-4af2-a83e-cefeb9a39eb5 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:48.607373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 996/2002] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:48 2022] DELETE /identity/v3/projects/96cdbb4fc2394031a91a13c9a670d2f7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:48.608970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292845a7-f92e-4036-b3ae-769f07b78e7a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.611851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292845a7-f92e-4036-b3ae-769f07b78e7a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.612177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292845a7-f92e-4036-b3ae-769f07b78e7a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.614146 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 997/2003] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:48.614865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292845a7-f92e-4036-b3ae-769f07b78e7a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.618975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-292845a7-f92e-4036-b3ae-769f07b78e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.647549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.649689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.651239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.651609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.653602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.658042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.688861 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1007/2004] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:48 2022] POST /identity/v3/users => generated 308 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:48.691169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:48.696313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.763066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292845a7-f92e-4036-b3ae-769f07b78e7a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.770564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8dd1a-518f-4fad-b9e4-cc75b2a75d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.771759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dd1a-518f-4fad-b9e4-cc75b2a75d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.772227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dd1a-518f-4fad-b9e4-cc75b2a75d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.772540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dd1a-518f-4fad-b9e4-cc75b2a75d80 admin admin] PATH_INFO: `/v3/projects/25373dd2e9474b04aa01a062b0ed0505/users/d571221d26404402a3d806d730b866e3/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.775246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8dd1a-518f-4fad-b9e4-cc75b2a75d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25373dd2e9474b04aa01a062b0ed0505, user_id=d571221d26404402a3d806d730b866e3, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.778710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8dd1a-518f-4fad-b9e4-cc75b2a75d80 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.796434 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 998/2005] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:48 2022] PUT /identity/v3/projects/25373dd2e9474b04aa01a062b0ed0505/users/d571221d26404402a3d806d730b866e3/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:48.798601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b09da-5c42-449e-a098-c9f277243f75 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.798857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b09da-5c42-449e-a098-c9f277243f75 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.799363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b09da-5c42-449e-a098-c9f277243f75 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.802040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 999/2006] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:48.802885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b09da-5c42-449e-a098-c9f277243f75 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.813626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5b8b09da-5c42-449e-a098-c9f277243f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.823979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.827156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.908906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b09da-5c42-449e-a098-c9f277243f75 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.916206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.916440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2db332-9438-4902-b3ba-0de327513900 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.917688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.918223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.918721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.920324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.922791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:48.938113 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1000/2007] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:48.939235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:48.942374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:48.962208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579259e-eeee-4fef-a88c-0889b62db217 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:48.970655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:48.971563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:48.971921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:48.972210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] PATH_INFO: `/v3/projects/2b3d5a3b5d89480c90dd6e00ab650e2f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:48.973536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3d5a3b5d89480c90dd6e00ab650e2f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:48.975464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:49.015547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8aa6c-435c-4fc6-a9f8-4465b6a281dd tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6783946d9d5d4897b835c6a75cced6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bccd2f0cea4be2aac1d95f2696702d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:49.016470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8aa6c-435c-4fc6-a9f8-4465b6a281dd tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.016836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8aa6c-435c-4fc6-a9f8-4465b6a281dd tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.017130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8aa6c-435c-4fc6-a9f8-4465b6a281dd tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] PATH_INFO: `/v3/projects/b50489cd0f73467db1f8a88a07eb9166` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.018359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8aa6c-435c-4fc6-a9f8-4465b6a281dd tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] RBAC: Authorizing `identity:get_project(project_id=b50489cd0f73467db1f8a88a07eb9166)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:49.021638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8aa6c-435c-4fc6-a9f8-4465b6a281dd tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:49.023991 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1008/2008] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:48 2022] GET /identity/v3/projects/b50489cd0f73467db1f8a88a07eb9166 => generated 379 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:49.025572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8e3b2-a670-4bf7-83e5-e225e3f8d8e0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.025965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8e3b2-a670-4bf7-83e5-e225e3f8d8e0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.026260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8e3b2-a670-4bf7-83e5-e225e3f8d8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.059497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f6a8e3b2-a670-4bf7-83e5-e225e3f8d8e0 None None] MFA Rules not processed for user `d571221d26404402a3d806d730b866e3`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:49.061037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f6a8e3b2-a670-4bf7-83e5-e225e3f8d8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.064250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3d5a3b5d89480c90dd6e00ab650e2f', 'request_id': 'req-cac85e96-5638-4762-b69e-7de293a36cf1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.080846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3d5a3b5d89480c90dd6e00ab650e2f', 'request_id': 'req-cac85e96-5638-4762-b69e-7de293a36cf1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.103171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3d5a3b5d89480c90dd6e00ab650e2f', 'request_id': 'req-cac85e96-5638-4762-b69e-7de293a36cf1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.120768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] The token cache is being invalidate because project 2b3d5a3b5d89480c90dd6e00ab650e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:49.121025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.122967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.129359 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1001/2009] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:48 2022] DELETE /identity/v3/projects/2b3d5a3b5d89480c90dd6e00ab650e2f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:49.129359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:49.134126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.178012 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1009/2010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:49.179830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8e3b2-a670-4bf7-83e5-e225e3f8d8e0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:49.182423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f6a8e3b2-a670-4bf7-83e5-e225e3f8d8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.262538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:49.264158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.339045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8e3b2-a670-4bf7-83e5-e225e3f8d8e0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:49.339431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac85e96-5638-4762-b69e-7de293a36cf1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:49.345613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26bc62-0c23-44a0-9d9c-341121713113 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:49.346481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26bc62-0c23-44a0-9d9c-341121713113 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.346769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26bc62-0c23-44a0-9d9c-341121713113 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.347085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26bc62-0c23-44a0-9d9c-341121713113 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/fe4bbfdec74e4a09949381e5f539671d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.348828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26bc62-0c23-44a0-9d9c-341121713113 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe4bbfdec74e4a09949381e5f539671d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:49.350252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c3606-1ccc-461c-9cf6-b8b1f3bb3d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:49.351824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c3606-1ccc-461c-9cf6-b8b1f3bb3d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.352120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c3606-1ccc-461c-9cf6-b8b1f3bb3d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.352431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c3606-1ccc-461c-9cf6-b8b1f3bb3d53 admin admin] PATH_INFO: `/v3/projects/1ce1440967fc44069d5b342c0891a2c0/users/53b0e2ecdb424e918f78907c0cffad43/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.353251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26bc62-0c23-44a0-9d9c-341121713113 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:49.374858 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1002/2011] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:49 2022] GET /identity/v3/projects/fe4bbfdec74e4a09949381e5f539671d => generated 373 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:49.377144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c35d-385b-4fda-8cf5-6ff7fe55b808 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.377591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c3606-1ccc-461c-9cf6-b8b1f3bb3d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce1440967fc44069d5b342c0891a2c0, user_id=53b0e2ecdb424e918f78907c0cffad43, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:49.377844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c35d-385b-4fda-8cf5-6ff7fe55b808 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.379134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c35d-385b-4fda-8cf5-6ff7fe55b808 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.380530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c3606-1ccc-461c-9cf6-b8b1f3bb3d53 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:49.382298 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1003/2012] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:50:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:49.387973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c35d-385b-4fda-8cf5-6ff7fe55b808 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:49.400692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bf05c35d-385b-4fda-8cf5-6ff7fe55b808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.405644 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1010/2013] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:49 2022] PUT /identity/v3/projects/1ce1440967fc44069d5b342c0891a2c0/users/53b0e2ecdb424e918f78907c0cffad43/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:49.407154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23154e45-5407-44f6-8db1-f9bca8e98b40 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.407564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23154e45-5407-44f6-8db1-f9bca8e98b40 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.407919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23154e45-5407-44f6-8db1-f9bca8e98b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.431545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-23154e45-5407-44f6-8db1-f9bca8e98b40 None None] MFA Rules not processed for user `5df681c4fec04b8cac9cc15e5cdb60e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:49.433060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-23154e45-5407-44f6-8db1-f9bca8e98b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.545492 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1011/2014] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:49.546507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23154e45-5407-44f6-8db1-f9bca8e98b40 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:49.554927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c35d-385b-4fda-8cf5-6ff7fe55b808 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:49.559783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:49.560715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.561106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.561234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] PATH_INFO: `/v3/users/94676f027e30461fb129f856ca77a330` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.563304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94676f027e30461fb129f856ca77a330)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:49.564532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:49.634087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94676f027e30461fb129f856ca77a330'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.635566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94676f027e30461fb129f856ca77a330'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.636806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94676f027e30461fb129f856ca77a330'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.667293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94676f027e30461fb129f856ca77a330'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.683256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94676f027e30461fb129f856ca77a330'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:49.685451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23154e45-5407-44f6-8db1-f9bca8e98b40 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:49.690863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec2e2e-90bd-45dd-81de-cc27447e466d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:49.691500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2e2e-90bd-45dd-81de-cc27447e466d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.691777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2e2e-90bd-45dd-81de-cc27447e466d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.692077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2e2e-90bd-45dd-81de-cc27447e466d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.692885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec2e2e-90bd-45dd-81de-cc27447e466d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:49.693194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec2e2e-90bd-45dd-81de-cc27447e466d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:49.695474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec2e2e-90bd-45dd-81de-cc27447e466d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:49.714357 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1012/2015] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:49.715707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63ef3-0420-4ed7-9f2f-23c0b7c12a56 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.716001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63ef3-0420-4ed7-9f2f-23c0b7c12a56 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.716279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63ef3-0420-4ed7-9f2f-23c0b7c12a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.726242 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1004/2016] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:49 2022] DELETE /identity/v3/users/94676f027e30461fb129f856ca77a330 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:49.728092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:49.731341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.757053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-12a63ef3-0420-4ed7-9f2f-23c0b7c12a56 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:49.758772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-12a63ef3-0420-4ed7-9f2f-23c0b7c12a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.880355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5d00-d1f6-4856-a395-954ed2687fa8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:49.899205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:49.900375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.901513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.902202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.903554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:49.905663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:49.916029 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1013/2017] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:50:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:49.917030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63ef3-0420-4ed7-9f2f-23c0b7c12a56 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:49.918373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-12a63ef3-0420-4ed7-9f2f-23c0b7c12a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.929962 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1005/2018] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:49.932518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:49.935697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:49.944864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63ef3-0420-4ed7-9f2f-23c0b7c12a56 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:49.963503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:49.964721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:49.965715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:49.968638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:49.975724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.087635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747beeae-f231-4c3d-9f9b-804704bcc3b7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:50.092844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:50.094516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:50.103662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edf742-cfb6-40fd-81d1-5d5a8dba0775 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:50.104365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edf742-cfb6-40fd-81d1-5d5a8dba0775 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.104656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edf742-cfb6-40fd-81d1-5d5a8dba0775 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.104926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edf742-cfb6-40fd-81d1-5d5a8dba0775 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.105639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edf742-cfb6-40fd-81d1-5d5a8dba0775 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:50.108787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edf742-cfb6-40fd-81d1-5d5a8dba0775 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:50.118204 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1014/2019] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:50.119164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:50.128219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.152935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4db77-88c6-4f4d-90f6-feabc23b550d service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:50.156472 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1006/2020] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:49 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:50.157572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edf742-cfb6-40fd-81d1-5d5a8dba0775 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:50.157923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:50.158807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.159398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.160661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] PATH_INFO: `/v3/users/d1babae367ec46f5853734ac2747515e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.165857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1babae367ec46f5853734ac2747515e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:50.168006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:50.259012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1babae367ec46f5853734ac2747515e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.281947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1babae367ec46f5853734ac2747515e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.289892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edf742-cfb6-40fd-81d1-5d5a8dba0775 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:50.296114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:50.297682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.298168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.298623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] PATH_INFO: `/v3/projects/1ce1440967fc44069d5b342c0891a2c0/users/53b0e2ecdb424e918f78907c0cffad43/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.301359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce1440967fc44069d5b342c0891a2c0, user_id=53b0e2ecdb424e918f78907c0cffad43, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:50.305474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:50.314553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1babae367ec46f5853734ac2747515e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.315489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1babae367ec46f5853734ac2747515e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.316198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1babae367ec46f5853734ac2747515e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.320044 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1007/2021] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:50 2022] PUT /identity/v3/projects/1ce1440967fc44069d5b342c0891a2c0/users/53b0e2ecdb424e918f78907c0cffad43/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:50.321360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:50.324517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.346099 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1015/2022] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:50 2022] DELETE /identity/v3/users/d1babae367ec46f5853734ac2747515e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:50.347692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:50.350257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.421931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126856-b7ba-41a3-96a9-c31713c45d08 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:50.487372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81654c-1d46-4ede-8106-490f688e2013 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:50.494383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b3ef5-6c73-4e0d-b278-b1e5f817c10f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:50.495309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3ef5-6c73-4e0d-b278-b1e5f817c10f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.495768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3ef5-6c73-4e0d-b278-b1e5f817c10f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.496218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3ef5-6c73-4e0d-b278-b1e5f817c10f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.497173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b3ef5-6c73-4e0d-b278-b1e5f817c10f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:50.497676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b3ef5-6c73-4e0d-b278-b1e5f817c10f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:50.499610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b3ef5-6c73-4e0d-b278-b1e5f817c10f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:50.519515 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1016/2023] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:50.521425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c589c-4575-42d2-8cde-e25dd7abf9d8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.521425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c589c-4575-42d2-8cde-e25dd7abf9d8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.521629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c589c-4575-42d2-8cde-e25dd7abf9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.545461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f35c589c-4575-42d2-8cde-e25dd7abf9d8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:50.546969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f35c589c-4575-42d2-8cde-e25dd7abf9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.552067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:50.553569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.553569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.553569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.556158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.588433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:50.590415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:50.624710 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1008/2024] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:50.626281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:50.633516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.678418 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1017/2025] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:50.701747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c589c-4575-42d2-8cde-e25dd7abf9d8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:50.703159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f35c589c-4575-42d2-8cde-e25dd7abf9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.795869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dedd9-77f3-4f1d-8b49-14a594c35611 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:50.801669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:50.803228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.803844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.804947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] PATH_INFO: `/v3/projects/0c9fc09fc5954c599e5eda3a4c5620a3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.806601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9fc09fc5954c599e5eda3a4c5620a3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:50.809167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:50.856077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c589c-4575-42d2-8cde-e25dd7abf9d8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:50.869194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9f079-03ed-411d-b6f8-5e89d15c77b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:50.870040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f079-03ed-411d-b6f8-5e89d15c77b2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.870151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f079-03ed-411d-b6f8-5e89d15c77b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.870839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f079-03ed-411d-b6f8-5e89d15c77b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.893159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9f079-03ed-411d-b6f8-5e89d15c77b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:50.894626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9f079-03ed-411d-b6f8-5e89d15c77b2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:50.901180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9fc09fc5954c599e5eda3a4c5620a3', 'request_id': 'req-1db06d03-f4e0-4141-abb8-817d2efbebd4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.909736 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1018/2026] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:50.914245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9fc09fc5954c599e5eda3a4c5620a3', 'request_id': 'req-1db06d03-f4e0-4141-abb8-817d2efbebd4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.928931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9fc09fc5954c599e5eda3a4c5620a3', 'request_id': 'req-1db06d03-f4e0-4141-abb8-817d2efbebd4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.951855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] The token cache is being invalidate because project 0c9fc09fc5954c599e5eda3a4c5620a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:50.952162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.952989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db06d03-f4e0-4141-abb8-817d2efbebd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:50.961578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8bc07-e1d2-451a-8454-662e7a00ba0e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.961885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8bc07-e1d2-451a-8454-662e7a00ba0e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.962227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8bc07-e1d2-451a-8454-662e7a00ba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.966566 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1009/2027] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:50 2022] DELETE /identity/v3/projects/0c9fc09fc5954c599e5eda3a4c5620a3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:50.975133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde29fd3-7e06-4af9-b79e-a8a12e662650 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:50.977169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde29fd3-7e06-4af9-b79e-a8a12e662650 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:50.978035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde29fd3-7e06-4af9-b79e-a8a12e662650 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:50.990090 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1010/2028] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:50 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:50.991088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ecc8bc07-e1d2-451a-8454-662e7a00ba0e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:50.992531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ecc8bc07-e1d2-451a-8454-662e7a00ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:50.993270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde29fd3-7e06-4af9-b79e-a8a12e662650 None None] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:51.061395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dde29fd3-7e06-4af9-b79e-a8a12e662650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:51.119310 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1019/2029] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:51.121150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f604-1dbc-471c-a38b-57502e5250a4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.121449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f604-1dbc-471c-a38b-57502e5250a4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.121794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f604-1dbc-471c-a38b-57502e5250a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.162687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7ee7f604-1dbc-471c-a38b-57502e5250a4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:51.168841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7ee7f604-1dbc-471c-a38b-57502e5250a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:51.188675 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1020/2030] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:51.193044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7f604-1dbc-471c-a38b-57502e5250a4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:51.208475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7f604-1dbc-471c-a38b-57502e5250a4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:51.218539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde29fd3-7e06-4af9-b79e-a8a12e662650 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:51.220091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dde29fd3-7e06-4af9-b79e-a8a12e662650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:51.221974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:51.222652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.222932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.223209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.224145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:51.224490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:51.226700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:51.255280 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1021/2031] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:51.256214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:51.285603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22c433-2a29-4022-8114-172976d407c3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:51.302277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991b8c7-07ff-45ef-a1a5-a2eee1ebf4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:51.303051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991b8c7-07ff-45ef-a1a5-a2eee1ebf4bd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.303233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991b8c7-07ff-45ef-a1a5-a2eee1ebf4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.303503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991b8c7-07ff-45ef-a1a5-a2eee1ebf4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.304244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991b8c7-07ff-45ef-a1a5-a2eee1ebf4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:51.306188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991b8c7-07ff-45ef-a1a5-a2eee1ebf4bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:51.310947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde29fd3-7e06-4af9-b79e-a8a12e662650 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:51.327888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47e54c-fcaf-4b6b-b3fc-4976e1d56c57 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:51.329760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47e54c-fcaf-4b6b-b3fc-4976e1d56c57 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.330104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47e54c-fcaf-4b6b-b3fc-4976e1d56c57 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.330466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47e54c-fcaf-4b6b-b3fc-4976e1d56c57 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/a7e8f56d948e4cb58be8c81f044fe519` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.336060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47e54c-fcaf-4b6b-b3fc-4976e1d56c57 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=a7e8f56d948e4cb58be8c81f044fe519)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:51.339663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47e54c-fcaf-4b6b-b3fc-4976e1d56c57 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:51.344131 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1011/2032] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:50 2022] GET /identity/v3/projects/a7e8f56d948e4cb58be8c81f044fe519 => generated 371 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:51.362834 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1022/2033] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:51 2022] POST /identity/v3/projects => generated 397 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:51.366805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47e54c-fcaf-4b6b-b3fc-4976e1d56c57 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:51.394046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af1404-c949-434b-a8e7-1011ff22d10c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.394231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af1404-c949-434b-a8e7-1011ff22d10c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.394485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af1404-c949-434b-a8e7-1011ff22d10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.395507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47e54c-fcaf-4b6b-b3fc-4976e1d56c57 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:51.443203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a7af1404-c949-434b-a8e7-1011ff22d10c None None] MFA Rules not processed for user `1fc7244fbf3b4298b92daf9e442fe669`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:51.444506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a7af1404-c949-434b-a8e7-1011ff22d10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:51.549082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3da0d-26dc-4e24-a619-7f67f1e1de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:51.552242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3da0d-26dc-4e24-a619-7f67f1e1de76 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.553470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3da0d-26dc-4e24-a619-7f67f1e1de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.554248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3da0d-26dc-4e24-a619-7f67f1e1de76 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.555528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3da0d-26dc-4e24-a619-7f67f1e1de76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:51.558761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3da0d-26dc-4e24-a619-7f67f1e1de76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:51.594462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1012/2034] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:51 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:51.598493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3da0d-26dc-4e24-a619-7f67f1e1de76 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:51.616269 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1023/2035] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:51.634846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3da0d-26dc-4e24-a619-7f67f1e1de76 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:51.640916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0d8ee-ca7c-4f94-9ddd-060eb2baec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:51.641604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0d8ee-ca7c-4f94-9ddd-060eb2baec1c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.641947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0d8ee-ca7c-4f94-9ddd-060eb2baec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.642370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0d8ee-ca7c-4f94-9ddd-060eb2baec1c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.643164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0d8ee-ca7c-4f94-9ddd-060eb2baec1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:51.648580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0d8ee-ca7c-4f94-9ddd-060eb2baec1c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:51.669400 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1013/2036] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:51.673707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af1404-c949-434b-a8e7-1011ff22d10c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:51.694844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af1404-c949-434b-a8e7-1011ff22d10c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:51.705256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:51.712405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.712405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.712405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.712405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:51.712405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:51.734105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cbb40-12a4-4478-920b-f392327fa2a5 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.734458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cbb40-12a4-4478-920b-f392327fa2a5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.734810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cbb40-12a4-4478-920b-f392327fa2a5 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.737001 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1014/2037] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:50:51.746476 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1024/2038] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:51.748276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cbb40-12a4-4478-920b-f392327fa2a5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:51.749734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:51.793758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cbb40-12a4-4478-920b-f392327fa2a5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:51.816473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a354-4bd1-422c-aaea-5e8a679fc8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:51.817309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a354-4bd1-422c-aaea-5e8a679fc8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.817600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a354-4bd1-422c-aaea-5e8a679fc8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.817858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a354-4bd1-422c-aaea-5e8a679fc8d2 admin admin] PATH_INFO: `/v3/projects/a6f02f88286b49babe665db9d00787a2/users/ec1a2a2db19c41cca4342aa082770a96/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.855800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488a354-4bd1-422c-aaea-5e8a679fc8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f02f88286b49babe665db9d00787a2, user_id=ec1a2a2db19c41cca4342aa082770a96, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:51.858651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488a354-4bd1-422c-aaea-5e8a679fc8d2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:51.884932 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1015/2039] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:51 2022] PUT /identity/v3/projects/a6f02f88286b49babe665db9d00787a2/users/ec1a2a2db19c41cca4342aa082770a96/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:51.890120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e47c29-488c-4d56-ab9b-acbdc6a3bd48 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:51.892465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e47c29-488c-4d56-ab9b-acbdc6a3bd48 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:51.892963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e47c29-488c-4d56-ab9b-acbdc6a3bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:51.906650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:51.951424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-53e47c29-488c-4d56-ab9b-acbdc6a3bd48 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:51.952841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-53e47c29-488c-4d56-ab9b-acbdc6a3bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:52.039383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9e94e-b878-4694-8da6-989827d117e3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:52.091546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1016/2040] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:52.103177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e47c29-488c-4d56-ab9b-acbdc6a3bd48 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:52.104793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-53e47c29-488c-4d56-ab9b-acbdc6a3bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:52.148939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0eacd7-6fb4-4f2d-a525-3c0ea26f3831 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:52.150157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eacd7-6fb4-4f2d-a525-3c0ea26f3831 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.150884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eacd7-6fb4-4f2d-a525-3c0ea26f3831 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.151511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eacd7-6fb4-4f2d-a525-3c0ea26f3831 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/a7e8f56d948e4cb58be8c81f044fe519` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.153197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0eacd7-6fb4-4f2d-a525-3c0ea26f3831 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=a7e8f56d948e4cb58be8c81f044fe519)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:52.156112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0eacd7-6fb4-4f2d-a525-3c0ea26f3831 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:52.158122 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1025/2041] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:51 2022] GET /identity/v3/projects/a7e8f56d948e4cb58be8c81f044fe519 => generated 371 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:52.219737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e47c29-488c-4d56-ab9b-acbdc6a3bd48 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:52.224292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911cbe5-065b-4490-ad86-0994aff32316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:52.225454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911cbe5-065b-4490-ad86-0994aff32316 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.225964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911cbe5-065b-4490-ad86-0994aff32316 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.226322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911cbe5-065b-4490-ad86-0994aff32316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.241186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911cbe5-065b-4490-ad86-0994aff32316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:52.245532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911cbe5-065b-4490-ad86-0994aff32316 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:52.261790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0eacd7-6fb4-4f2d-a525-3c0ea26f3831 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:52.270992 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1017/2042] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:52.300632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0eacd7-6fb4-4f2d-a525-3c0ea26f3831 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:52.317083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:52.317885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.322942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.323564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.324690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:52.325227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:52.327122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:52.353520 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1026/2043] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:52.359231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911cbe5-065b-4490-ad86-0994aff32316 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:52.388152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911cbe5-065b-4490-ad86-0994aff32316 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:52.397008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:52.399818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.400119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.400621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.401759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:52.407966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:52.443716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1018/2044] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:52 2022] POST /identity/v3/users => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:52.449124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:52.469789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa831-b01d-4c98-9147-c136a928809b tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:52.476911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2597-a00d-4bbd-b1a0-1db564a90797 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:52.477594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2597-a00d-4bbd-b1a0-1db564a90797 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.478605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2597-a00d-4bbd-b1a0-1db564a90797 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.478924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2597-a00d-4bbd-b1a0-1db564a90797 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.479727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2597-a00d-4bbd-b1a0-1db564a90797 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:52.480052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2597-a00d-4bbd-b1a0-1db564a90797 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:52.481737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2597-a00d-4bbd-b1a0-1db564a90797 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:52.488766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:52.492786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:52.501776 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1027/2045] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:52.521190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fec4f-7822-4188-b9ad-ad103b473405 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:52.525700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08365c-5000-43e0-b3a0-ff3ac42a4f02 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.526058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08365c-5000-43e0-b3a0-ff3ac42a4f02 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.526488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08365c-5000-43e0-b3a0-ff3ac42a4f02 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.530493 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1028/2046] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:52.534919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:52.535274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08365c-5000-43e0-b3a0-ff3ac42a4f02 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:52.535990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.536767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.537056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] PATH_INFO: `/v3/projects/b50489cd0f73467db1f8a88a07eb9166` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.539492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50489cd0f73467db1f8a88a07eb9166)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:52.546391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:52.618469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50489cd0f73467db1f8a88a07eb9166', 'request_id': 'req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:52.626835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50489cd0f73467db1f8a88a07eb9166', 'request_id': 'req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:52.659355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50489cd0f73467db1f8a88a07eb9166', 'request_id': 'req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:52.681454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] The token cache is being invalidate because project b50489cd0f73467db1f8a88a07eb9166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:52.681660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:52.682272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:52.684161 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1019/2047] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:52 2022] DELETE /identity/v3/projects/b50489cd0f73467db1f8a88a07eb9166 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:50:52.687871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:52.690855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:52.705731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08365c-5000-43e0-b3a0-ff3ac42a4f02 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:52.722562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08365c-5000-43e0-b3a0-ff3ac42a4f02 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:52.800197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b87a4-f03f-4b44-a9e6-6637fd30293e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:52.802381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b87a4-f03f-4b44-a9e6-6637fd30293e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.803156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b87a4-f03f-4b44-a9e6-6637fd30293e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.804308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b87a4-f03f-4b44-a9e6-6637fd30293e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/a7e8f56d948e4cb58be8c81f044fe519` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.806784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b87a4-f03f-4b44-a9e6-6637fd30293e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=a7e8f56d948e4cb58be8c81f044fe519)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:52.810614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b87a4-f03f-4b44-a9e6-6637fd30293e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:52.828523 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1029/2048] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:52 2022] GET /identity/v3/projects/a7e8f56d948e4cb58be8c81f044fe519 => generated 371 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:52.839895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c8929-d392-4b4a-b397-d1bd99b5bfc0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:52.857290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:52.861320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:52.862090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:52.862438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] PATH_INFO: `/v3/users/6783946d9d5d4897b835c6a75cced6a0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:52.864297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6783946d9d5d4897b835c6a75cced6a0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:52.866890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:52.990109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6783946d9d5d4897b835c6a75cced6a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:52.990958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6783946d9d5d4897b835c6a75cced6a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:52.991867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6783946d9d5d4897b835c6a75cced6a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:53.009832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6783946d9d5d4897b835c6a75cced6a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:53.029819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7b505df-49e8-4f30-ab8b-0c0178e48aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6783946d9d5d4897b835c6a75cced6a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:53.051056 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1020/2049] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:52 2022] DELETE /identity/v3/users/6783946d9d5d4897b835c6a75cced6a0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:50:53.120587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca1e8-d66d-40fb-8727-0d9a3d929268 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:53.121002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca1e8-d66d-40fb-8727-0d9a3d929268 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:53.121844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ca1e8-d66d-40fb-8727-0d9a3d929268 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:53.124735 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1030/2050] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:53.131765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ef691-759a-4292-87af-2c2a7cc6b5fd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:53.132276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ef691-759a-4292-87af-2c2a7cc6b5fd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:53.132724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ef691-759a-4292-87af-2c2a7cc6b5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:53.186449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c50ef691-759a-4292-87af-2c2a7cc6b5fd None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:53.187892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c50ef691-759a-4292-87af-2c2a7cc6b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:53.212610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:53.213238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:53.213676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:53.266604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] MFA Rules not processed for user `53b0e2ecdb424e918f78907c0cffad43`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:53.268217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:53.290790 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1021/2051] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:50:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:53.356636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ef691-759a-4292-87af-2c2a7cc6b5fd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:53.358377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c50ef691-759a-4292-87af-2c2a7cc6b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:53.376544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ef691-759a-4292-87af-2c2a7cc6b5fd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:53.386983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67648e-3365-4ebe-aa5a-91a4ce4cfe13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:53.387678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67648e-3365-4ebe-aa5a-91a4ce4cfe13 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:53.387797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67648e-3365-4ebe-aa5a-91a4ce4cfe13 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:53.387985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67648e-3365-4ebe-aa5a-91a4ce4cfe13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:53.406283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67648e-3365-4ebe-aa5a-91a4ce4cfe13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:53.407761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67648e-3365-4ebe-aa5a-91a4ce4cfe13 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:53.417283 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1022/2052] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:53.450230 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1031/2053] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:53.722138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1692b-59f1-45e8-a26d-1f1768d0c632 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:53.723287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1692b-59f1-45e8-a26d-1f1768d0c632 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:53.723718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1692b-59f1-45e8-a26d-1f1768d0c632 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:53.726657 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1023/2054] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:53.731874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:53.733928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:53.802089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8fcf5-1a6c-45b0-b0e4-f9e9d273d425 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:53.802707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8fcf5-1a6c-45b0-b0e4-f9e9d273d425 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:53.803134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8fcf5-1a6c-45b0-b0e4-f9e9d273d425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:53.870425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e1f8fcf5-1a6c-45b0-b0e4-f9e9d273d425 None None] MFA Rules not processed for user `ec1a2a2db19c41cca4342aa082770a96`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:53.872973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e1f8fcf5-1a6c-45b0-b0e4-f9e9d273d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:53.934947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:53.936458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:54.030373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1024/2055] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:54.031535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8fcf5-1a6c-45b0-b0e4-f9e9d273d425 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:54.036967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e1f8fcf5-1a6c-45b0-b0e4-f9e9d273d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:54.094395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2750-9cf4-40e2-b29a-5fa103feca4f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:54.100121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:54.101462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.101944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.102492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/a7e8f56d948e4cb58be8c81f044fe519` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.110116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=a7e8f56d948e4cb58be8c81f044fe519)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:54.117097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:54.123292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1032/2056] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:53 2022] GET /identity/v3/projects/a7e8f56d948e4cb58be8c81f044fe519 => generated 371 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:54.138292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:54.144852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:54.155140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8fcf5-1a6c-45b0-b0e4-f9e9d273d425 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:54.161132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:54.162390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.164278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.165121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] PATH_INFO: `/v3/projects/f3bccd2f0cea4be2aac1d95f2696702d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.166877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bccd2f0cea4be2aac1d95f2696702d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:54.168305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f3862-a35f-47a4-9e81-ed8a389bfc44 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:54.169650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:54.174472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107641b-0da6-4408-96f1-e2fe72c14cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:54.175131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107641b-0da6-4408-96f1-e2fe72c14cac admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.175412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107641b-0da6-4408-96f1-e2fe72c14cac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.175687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107641b-0da6-4408-96f1-e2fe72c14cac admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.176408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107641b-0da6-4408-96f1-e2fe72c14cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:54.178717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107641b-0da6-4408-96f1-e2fe72c14cac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:54.237247 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1033/2057] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:54 2022] POST /identity/v3/projects => generated 395 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:54.240597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107641b-0da6-4408-96f1-e2fe72c14cac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:54.273585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bccd2f0cea4be2aac1d95f2696702d', 'request_id': 'req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.287029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bccd2f0cea4be2aac1d95f2696702d', 'request_id': 'req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.299503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bccd2f0cea4be2aac1d95f2696702d', 'request_id': 'req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.316590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] The token cache is being invalidate because project f3bccd2f0cea4be2aac1d95f2696702d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:54.316590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.317323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.319774 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1025/2058] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:54 2022] DELETE /identity/v3/projects/f3bccd2f0cea4be2aac1d95f2696702d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:54.323541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:54.323541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:54.370026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107641b-0da6-4408-96f1-e2fe72c14cac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:54.448322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6c56-dab6-44c6-9500-ee8fb2ef68c9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:54.454789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e9070-4c09-49c5-8afc-0bf70b8e7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:54.456406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e9070-4c09-49c5-8afc-0bf70b8e7600 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.456666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e9070-4c09-49c5-8afc-0bf70b8e7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.460735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e9070-4c09-49c5-8afc-0bf70b8e7600 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.461590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e9070-4c09-49c5-8afc-0bf70b8e7600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:54.466705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e9070-4c09-49c5-8afc-0bf70b8e7600 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:54.472246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:54.473183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.473484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.473755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/users/be933a6b17414921b6b712dff647247b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.498192 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1026/2059] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:54 2022] POST /identity/v3/users => generated 304 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:54.500034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c2ec-47b1-4622-8a0d-e7b2d0db1c8b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.500370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c2ec-47b1-4622-8a0d-e7b2d0db1c8b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.501063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c2ec-47b1-4622-8a0d-e7b2d0db1c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.502679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:delete_user(user_id=be933a6b17414921b6b712dff647247b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:54.506717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:54.524696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-89f8c2ec-47b1-4622-8a0d-e7b2d0db1c8b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:54.525989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-89f8c2ec-47b1-4622-8a0d-e7b2d0db1c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:54.549076 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1027/2060] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:54.550940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c2ec-47b1-4622-8a0d-e7b2d0db1c8b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:54.576448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c2ec-47b1-4622-8a0d-e7b2d0db1c8b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:54.597745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be933a6b17414921b6b712dff647247b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.602992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b44c9d-8ad1-4772-ab64-5b255a3a54e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:54.604352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44c9d-8ad1-4772-ab64-5b255a3a54e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.605523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44c9d-8ad1-4772-ab64-5b255a3a54e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.606015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44c9d-8ad1-4772-ab64-5b255a3a54e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.610739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b44c9d-8ad1-4772-ab64-5b255a3a54e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:54.614890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b44c9d-8ad1-4772-ab64-5b255a3a54e6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:54.616620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be933a6b17414921b6b712dff647247b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.631651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be933a6b17414921b6b712dff647247b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.633482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be933a6b17414921b6b712dff647247b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.634439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be933a6b17414921b6b712dff647247b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:54.638584 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1028/2061] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:54.640395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023d72-8c50-4df1-9fcb-914f7459ee9c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.640793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023d72-8c50-4df1-9fcb-914f7459ee9c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.641154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023d72-8c50-4df1-9fcb-914f7459ee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.665290 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1034/2062] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:54 2022] DELETE /identity/v3/users/be933a6b17414921b6b712dff647247b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:54.667511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:54.673245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:54.677156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-55023d72-8c50-4df1-9fcb-914f7459ee9c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:54.678848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55023d72-8c50-4df1-9fcb-914f7459ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:54.802051 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1029/2063] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:54.802864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55023d72-8c50-4df1-9fcb-914f7459ee9c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:54.804432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55023d72-8c50-4df1-9fcb-914f7459ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:54.805827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317139cb-b246-4075-9108-9c54bcc94f03 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:54.826752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eac72-1236-4884-b381-7bc3106ad672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:54.827704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eac72-1236-4884-b381-7bc3106ad672 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:54.827997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eac72-1236-4884-b381-7bc3106ad672 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:54.828278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eac72-1236-4884-b381-7bc3106ad672 admin admin] PATH_INFO: `/v3/projects/49cea17e4a9b45f388e8d8b4bf2b42f4/users/f5aab6790464416b85cee1a9996d6a31/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:54.861144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3eac72-1236-4884-b381-7bc3106ad672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cea17e4a9b45f388e8d8b4bf2b42f4, user_id=f5aab6790464416b85cee1a9996d6a31, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:54.864415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3eac72-1236-4884-b381-7bc3106ad672 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:54.888982 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1035/2064] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:54 2022] PUT /identity/v3/projects/49cea17e4a9b45f388e8d8b4bf2b42f4/users/f5aab6790464416b85cee1a9996d6a31/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:54.889913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eac72-1236-4884-b381-7bc3106ad672 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:54.935381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55023d72-8c50-4df1-9fcb-914f7459ee9c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.005222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eac72-1236-4884-b381-7bc3106ad672 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.013763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.014661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.015040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.015390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.016205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:55.016629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.018780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.038494 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1036/2065] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:55.039854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.044998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.046005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.046365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.046757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/a7e8f56d948e4cb58be8c81f044fe519` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.048288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a7e8f56d948e4cb58be8c81f044fe519)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.053457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fa31-4ca5-4c9d-aa5a-8648a5084603 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.054671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.059326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b2f67-b8f1-49c8-aae5-7d4784b3ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.060106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b2f67-b8f1-49c8-aae5-7d4784b3ec45 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.060496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b2f67-b8f1-49c8-aae5-7d4784b3ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.060843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b2f67-b8f1-49c8-aae5-7d4784b3ec45 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.061636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b2f67-b8f1-49c8-aae5-7d4784b3ec45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.063633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b2f67-b8f1-49c8-aae5-7d4784b3ec45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.077292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1037/2066] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:55.078295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b2f67-b8f1-49c8-aae5-7d4784b3ec45 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.091950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b2f67-b8f1-49c8-aae5-7d4784b3ec45 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.097529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1704-a3c9-4fc9-9562-5f9238a00dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.098324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1704-a3c9-4fc9-9562-5f9238a00dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.098692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1704-a3c9-4fc9-9562-5f9238a00dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.099064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1704-a3c9-4fc9-9562-5f9238a00dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.099882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d1704-a3c9-4fc9-9562-5f9238a00dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.102624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d1704-a3c9-4fc9-9562-5f9238a00dc8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.134309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e8f56d948e4cb58be8c81f044fe519', 'request_id': 'req-08bf4ee2-52b2-49a0-97c2-04bd040ec408'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:55.141245 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1038/2067] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:55 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:55.141245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1704-a3c9-4fc9-9562-5f9238a00dc8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.144500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e8f56d948e4cb58be8c81f044fe519', 'request_id': 'req-08bf4ee2-52b2-49a0-97c2-04bd040ec408'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:55.159709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e8f56d948e4cb58be8c81f044fe519', 'request_id': 'req-08bf4ee2-52b2-49a0-97c2-04bd040ec408'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:55.183420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] The token cache is being invalidate because project a7e8f56d948e4cb58be8c81f044fe519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:55.183717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:55.184561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:55.187233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1030/2068] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:54 2022] DELETE /identity/v3/projects/a7e8f56d948e4cb58be8c81f044fe519 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:55.194292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.198228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:55.231972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1704-a3c9-4fc9-9562-5f9238a00dc8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.240983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43cf0-4da5-4352-88ee-80718d55c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.241917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43cf0-4da5-4352-88ee-80718d55c930 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.242205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43cf0-4da5-4352-88ee-80718d55c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.242479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43cf0-4da5-4352-88ee-80718d55c930 admin admin] PATH_INFO: `/v3/projects/49cea17e4a9b45f388e8d8b4bf2b42f4/users/f5aab6790464416b85cee1a9996d6a31/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.244561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e43cf0-4da5-4352-88ee-80718d55c930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cea17e4a9b45f388e8d8b4bf2b42f4, user_id=f5aab6790464416b85cee1a9996d6a31, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.249163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e43cf0-4da5-4352-88ee-80718d55c930 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.266559 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1039/2069] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:55 2022] PUT /identity/v3/projects/49cea17e4a9b45f388e8d8b4bf2b42f4/users/f5aab6790464416b85cee1a9996d6a31/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:55.268773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146a67-8d64-4329-87f1-c5f79b179a7a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.269209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146a67-8d64-4329-87f1-c5f79b179a7a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.269631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146a67-8d64-4329-87f1-c5f79b179a7a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.277356 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1040/2070] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:55.278567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe146a67-8d64-4329-87f1-c5f79b179a7a None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:55.280517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe146a67-8d64-4329-87f1-c5f79b179a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:55.282990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf4ee2-52b2-49a0-97c2-04bd040ec408 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.363637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eacb66-9533-495d-be8b-62f7aa6e1381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.364594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eacb66-9533-495d-be8b-62f7aa6e1381 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.364879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eacb66-9533-495d-be8b-62f7aa6e1381 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.365212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eacb66-9533-495d-be8b-62f7aa6e1381 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.365917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eacb66-9533-495d-be8b-62f7aa6e1381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.368097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eacb66-9533-495d-be8b-62f7aa6e1381 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.384644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe146a67-8d64-4329-87f1-c5f79b179a7a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.386274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe146a67-8d64-4329-87f1-c5f79b179a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:55.406378 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1031/2071] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:55 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:55.410820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eacb66-9533-495d-be8b-62f7aa6e1381 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.434664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eacb66-9533-495d-be8b-62f7aa6e1381 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.449242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b3148-152e-483a-8d1f-e8ecfd4276ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.449786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3148-152e-483a-8d1f-e8ecfd4276ce admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.450072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3148-152e-483a-8d1f-e8ecfd4276ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.450410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b3148-152e-483a-8d1f-e8ecfd4276ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.451153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b3148-152e-483a-8d1f-e8ecfd4276ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.452842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b3148-152e-483a-8d1f-e8ecfd4276ce admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.470691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1032/2072] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:50:55.474499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b3148-152e-483a-8d1f-e8ecfd4276ce admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.489208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe146a67-8d64-4329-87f1-c5f79b179a7a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.491236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b3148-152e-483a-8d1f-e8ecfd4276ce admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.494275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302c1a4-f95c-49b3-abf0-b0a1fdce7475 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.496925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302c1a4-f95c-49b3-abf0-b0a1fdce7475 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.497272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302c1a4-f95c-49b3-abf0-b0a1fdce7475 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.497805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302c1a4-f95c-49b3-abf0-b0a1fdce7475 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/fe4bbfdec74e4a09949381e5f539671d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.499186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302c1a4-f95c-49b3-abf0-b0a1fdce7475 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe4bbfdec74e4a09949381e5f539671d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.499634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a95ea-549b-4615-a2a0-aa7a92b2917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.500785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a95ea-549b-4615-a2a0-aa7a92b2917a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.501304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a95ea-549b-4615-a2a0-aa7a92b2917a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.501933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a95ea-549b-4615-a2a0-aa7a92b2917a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.502274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302c1a4-f95c-49b3-abf0-b0a1fdce7475 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.502830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a95ea-549b-4615-a2a0-aa7a92b2917a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.504265 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1041/2073] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:55 2022] GET /identity/v3/projects/fe4bbfdec74e4a09949381e5f539671d => generated 373 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:55.504681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a95ea-549b-4615-a2a0-aa7a92b2917a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.518447 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1033/2074] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:55.522850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302c1a4-f95c-49b3-abf0-b0a1fdce7475 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.534972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302c1a4-f95c-49b3-abf0-b0a1fdce7475 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.540400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499231e-e3f8-49d7-a6a6-bf7f4815f082 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.540975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499231e-e3f8-49d7-a6a6-bf7f4815f082 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.541452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499231e-e3f8-49d7-a6a6-bf7f4815f082 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.542261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51047bfb-1a20-4827-9f9e-871a6903590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.543284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51047bfb-1a20-4827-9f9e-871a6903590b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.543668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51047bfb-1a20-4827-9f9e-871a6903590b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.544090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51047bfb-1a20-4827-9f9e-871a6903590b admin admin] PATH_INFO: `/v3/projects/6056b16f9080426a98c58c750caa403b/users/3181f4ca7155437a903292c6b3c3a40b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.544460 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1034/2075] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:50:55.550115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499231e-e3f8-49d7-a6a6-bf7f4815f082 None None] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:55.568748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51047bfb-1a20-4827-9f9e-871a6903590b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6056b16f9080426a98c58c750caa403b, user_id=3181f4ca7155437a903292c6b3c3a40b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.572906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51047bfb-1a20-4827-9f9e-871a6903590b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.586492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499231e-e3f8-49d7-a6a6-bf7f4815f082 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.594087 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1042/2076] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:55 2022] PUT /identity/v3/projects/6056b16f9080426a98c58c750caa403b/users/3181f4ca7155437a903292c6b3c3a40b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:55.607150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314666-2a00-41b6-9ad8-7bd3fed15117 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.607819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314666-2a00-41b6-9ad8-7bd3fed15117 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.608313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314666-2a00-41b6-9ad8-7bd3fed15117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.610764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499231e-e3f8-49d7-a6a6-bf7f4815f082 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.650411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-54314666-2a00-41b6-9ad8-7bd3fed15117 None None] MFA Rules not processed for user `3181f4ca7155437a903292c6b3c3a40b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:55.652380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-54314666-2a00-41b6-9ad8-7bd3fed15117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:55.759642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c39ddb-8fd3-4c56-87a7-5dd1a7989c3e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.760911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39ddb-8fd3-4c56-87a7-5dd1a7989c3e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.761284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39ddb-8fd3-4c56-87a7-5dd1a7989c3e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.761792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39ddb-8fd3-4c56-87a7-5dd1a7989c3e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/fe4bbfdec74e4a09949381e5f539671d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.763625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c39ddb-8fd3-4c56-87a7-5dd1a7989c3e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe4bbfdec74e4a09949381e5f539671d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.767182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c39ddb-8fd3-4c56-87a7-5dd1a7989c3e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.772786 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1043/2077] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:55.772786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54314666-2a00-41b6-9ad8-7bd3fed15117 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.774165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-54314666-2a00-41b6-9ad8-7bd3fed15117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:55.788570 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1035/2078] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:55 2022] GET /identity/v3/projects/fe4bbfdec74e4a09949381e5f539671d => generated 373 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:55.791510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c39ddb-8fd3-4c56-87a7-5dd1a7989c3e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:55.924479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54314666-2a00-41b6-9ad8-7bd3fed15117 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:55.934728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:55.936532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:55.936700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:55.936902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] PATH_INFO: `/v3/users/ed64ca428d37447fa93ede55d55ea094` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:55.938761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed64ca428d37447fa93ede55d55ea094)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:55.940921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:55.995561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c39ddb-8fd3-4c56-87a7-5dd1a7989c3e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:56.034568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:56.035483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.035767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.036041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.037134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:56.041928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:56.073295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed64ca428d37447fa93ede55d55ea094'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:56.093399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed64ca428d37447fa93ede55d55ea094'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:56.110510 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1036/2079] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:55 2022] POST /identity/v3/projects => generated 375 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:56.110710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed64ca428d37447fa93ede55d55ea094'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:56.110710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed64ca428d37447fa93ede55d55ea094'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:56.111534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c37fd757-064d-44f4-a24c-65c03efe6976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed64ca428d37447fa93ede55d55ea094'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:56.114279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:56.122505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:56.152194 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1044/2080] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:55 2022] DELETE /identity/v3/users/ed64ca428d37447fa93ede55d55ea094 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:56.266547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509cca4-c995-4f15-b48d-4c93dc42ae6e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:56.269159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3dbda-f3a9-4e4d-83bc-18fd6b9eea04 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.269418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3dbda-f3a9-4e4d-83bc-18fd6b9eea04 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.269803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3dbda-f3a9-4e4d-83bc-18fd6b9eea04 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.274297 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1045/2081] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:50:56.280057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3dbda-f3a9-4e4d-83bc-18fd6b9eea04 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:50:56.284837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-16e3dbda-f3a9-4e4d-83bc-18fd6b9eea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:56.359327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d7069-6af0-47ae-b719-964c4ce19466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:56.360223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d7069-6af0-47ae-b719-964c4ce19466 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.360641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d7069-6af0-47ae-b719-964c4ce19466 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.361022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d7069-6af0-47ae-b719-964c4ce19466 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.361835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d7069-6af0-47ae-b719-964c4ce19466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:56.363897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d7069-6af0-47ae-b719-964c4ce19466 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:56.397834 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1037/2082] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:56 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:56.401507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d7069-6af0-47ae-b719-964c4ce19466 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:56.413992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d7069-6af0-47ae-b719-964c4ce19466 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:56.419103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9681d7a-00ca-439d-bdc4-95727f7dcad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:56.419774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9681d7a-00ca-439d-bdc4-95727f7dcad3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.420053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9681d7a-00ca-439d-bdc4-95727f7dcad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.420374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9681d7a-00ca-439d-bdc4-95727f7dcad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.421108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9681d7a-00ca-439d-bdc4-95727f7dcad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:56.421363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3dbda-f3a9-4e4d-83bc-18fd6b9eea04 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:56.422665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-16e3dbda-f3a9-4e4d-83bc-18fd6b9eea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:56.422801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9681d7a-00ca-439d-bdc4-95727f7dcad3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:56.438136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1038/2083] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:56.439210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9681d7a-00ca-439d-bdc4-95727f7dcad3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:56.451120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9681d7a-00ca-439d-bdc4-95727f7dcad3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:56.456753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefa897-3e5a-4429-a579-187d74312c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:56.457696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa897-3e5a-4429-a579-187d74312c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.457975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa897-3e5a-4429-a579-187d74312c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.458252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa897-3e5a-4429-a579-187d74312c05 admin admin] PATH_INFO: `/v3/projects/19a2f94e6c584bc19a65d5d0cb95f6e3/users/95898493aa124dc4abe75a3965da2aac/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.477595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefa897-3e5a-4429-a579-187d74312c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a2f94e6c584bc19a65d5d0cb95f6e3, user_id=95898493aa124dc4abe75a3965da2aac, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:56.480570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefa897-3e5a-4429-a579-187d74312c05 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:56.498694 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1039/2084] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:56 2022] PUT /identity/v3/projects/19a2f94e6c584bc19a65d5d0cb95f6e3/users/95898493aa124dc4abe75a3965da2aac/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:56.502683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefa897-3e5a-4429-a579-187d74312c05 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:56.526503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3dbda-f3a9-4e4d-83bc-18fd6b9eea04 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:56.622302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefa897-3e5a-4429-a579-187d74312c05 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:56.623781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980bf2a-37e2-41e6-a0f2-3ae551a7537f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108b74c7b48645958e9ed0b7c08d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fd1bcde9cde48cb98ca11712c2e3a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:56.624976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980bf2a-37e2-41e6-a0f2-3ae551a7537f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.625510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980bf2a-37e2-41e6-a0f2-3ae551a7537f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.625937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980bf2a-37e2-41e6-a0f2-3ae551a7537f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] PATH_INFO: `/v3/projects/fe4bbfdec74e4a09949381e5f539671d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.631848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5485f-8f3e-4ec2-b2d4-66890e2b827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:56.632625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980bf2a-37e2-41e6-a0f2-3ae551a7537f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe4bbfdec74e4a09949381e5f539671d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:56.633460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5485f-8f3e-4ec2-b2d4-66890e2b827b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.633856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5485f-8f3e-4ec2-b2d4-66890e2b827b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.634235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5485f-8f3e-4ec2-b2d4-66890e2b827b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.634697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980bf2a-37e2-41e6-a0f2-3ae551a7537f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:56.635155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5485f-8f3e-4ec2-b2d4-66890e2b827b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:56.636751 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1046/2085] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:50:56 2022] GET /identity/v3/projects/fe4bbfdec74e4a09949381e5f539671d => generated 373 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:50:56.636981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5485f-8f3e-4ec2-b2d4-66890e2b827b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:56.652229 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1040/2086] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:56.654013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980bf2a-37e2-41e6-a0f2-3ae551a7537f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:56.672182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980bf2a-37e2-41e6-a0f2-3ae551a7537f tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:56.678578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1d269-d83e-4688-aa66-c9ac79f38ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:56.680297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d269-d83e-4688-aa66-c9ac79f38ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.680758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d269-d83e-4688-aa66-c9ac79f38ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.681131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d269-d83e-4688-aa66-c9ac79f38ef3 admin admin] PATH_INFO: `/v3/projects/19a2f94e6c584bc19a65d5d0cb95f6e3/users/95898493aa124dc4abe75a3965da2aac/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.683852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1d269-d83e-4688-aa66-c9ac79f38ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a2f94e6c584bc19a65d5d0cb95f6e3, user_id=95898493aa124dc4abe75a3965da2aac, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:56.687551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1d269-d83e-4688-aa66-c9ac79f38ef3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:56.712076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a3c9-a96a-41e6-870d-145bacc15d18 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.712504 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1047/2087] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:56 2022] PUT /identity/v3/projects/19a2f94e6c584bc19a65d5d0cb95f6e3/users/95898493aa124dc4abe75a3965da2aac/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:56.712854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a3c9-a96a-41e6-870d-145bacc15d18 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.713227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a3c9-a96a-41e6-870d-145bacc15d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.717012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82914-d4a3-4ae9-aafa-073969f9eb84 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.717405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82914-d4a3-4ae9-aafa-073969f9eb84 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.717689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82914-d4a3-4ae9-aafa-073969f9eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:56.779125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0ef6a3c9-a96a-41e6-870d-145bacc15d18 None None] MFA Rules not processed for user `95898493aa124dc4abe75a3965da2aac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:56.780514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0ef6a3c9-a96a-41e6-870d-145bacc15d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:56.786523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-67c82914-d4a3-4ae9-aafa-073969f9eb84 None None] MFA Rules not processed for user `f5aab6790464416b85cee1a9996d6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:56.790466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-67c82914-d4a3-4ae9-aafa-073969f9eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:56.911572 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1048/2088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:56.912697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c82914-d4a3-4ae9-aafa-073969f9eb84 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:56.914379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-67c82914-d4a3-4ae9-aafa-073969f9eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:56.989107 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1041/2089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:56.990405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d81a4-c100-4079-b72b-74c255474271 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:56.990724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d81a4-c100-4079-b72b-74c255474271 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:56.991013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d81a4-c100-4079-b72b-74c255474271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.016661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c82914-d4a3-4ae9-aafa-073969f9eb84 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:57.021280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ae8d81a4-c100-4079-b72b-74c255474271 None None] MFA Rules not processed for user `ec1a2a2db19c41cca4342aa082770a96`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:57.024126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae8d81a4-c100-4079-b72b-74c255474271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.024859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:57.026305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.026667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.027215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] PATH_INFO: `/v3/projects/1d498b88d29548a48047c23af2a9ed5d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.028708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d498b88d29548a48047c23af2a9ed5d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:57.031019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:57.117081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d498b88d29548a48047c23af2a9ed5d', 'request_id': 'req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.126878 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1042/2090] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:57.127533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d81a4-c100-4079-b72b-74c255474271 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:57.131136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d498b88d29548a48047c23af2a9ed5d', 'request_id': 'req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.132942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae8d81a4-c100-4079-b72b-74c255474271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.147529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d498b88d29548a48047c23af2a9ed5d', 'request_id': 'req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.160852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] The token cache is being invalidate because project 1d498b88d29548a48047c23af2a9ed5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:57.161203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.161900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.165240 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1049/2091] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:56 2022] DELETE /identity/v3/projects/1d498b88d29548a48047c23af2a9ed5d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:57.174709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:57.176599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.230053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d81a4-c100-4079-b72b-74c255474271 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:57.249456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2338bc-7c2e-4d31-ba6c-08584412c6bd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:57.254252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:57.255147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.255429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.255710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] PATH_INFO: `/v3/users/53b0e2ecdb424e918f78907c0cffad43` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.256997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b0e2ecdb424e918f78907c0cffad43)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:57.258932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:57.305050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:57.305624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.305906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.306181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.308040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.313688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b0e2ecdb424e918f78907c0cffad43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.325956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b0e2ecdb424e918f78907c0cffad43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.336703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b0e2ecdb424e918f78907c0cffad43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.337425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b0e2ecdb424e918f78907c0cffad43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.338353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b0e2ecdb424e918f78907c0cffad43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.351839 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1050/2092] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:57 2022] DELETE /identity/v3/users/53b0e2ecdb424e918f78907c0cffad43 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:57.352703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:57.354034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.381032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:57.382742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:57.393092 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1043/2093] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:57.393936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:57.395429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.412409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ee919-f3c4-42cb-bf85-7f214bee7dcd service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:57.451339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1638a09-78ba-4378-aa01-bd26259a7188 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:57.456762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:57.457715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.458078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.462418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] PATH_INFO: `/v3/users/ce8abcfd66f74a38a364fa80ee9970a6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.462418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8abcfd66f74a38a364fa80ee9970a6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:57.464289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:57.497120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e975-289c-4453-a6b3-be6fe24818ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:57.497818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e975-289c-4453-a6b3-be6fe24818ea service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.498108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e975-289c-4453-a6b3-be6fe24818ea service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.498433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e975-289c-4453-a6b3-be6fe24818ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.501001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b5c2e975-289c-4453-a6b3-be6fe24818ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.519435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8abcfd66f74a38a364fa80ee9970a6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.534435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8abcfd66f74a38a364fa80ee9970a6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.545859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8abcfd66f74a38a364fa80ee9970a6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.546665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8abcfd66f74a38a364fa80ee9970a6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.547326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8abcfd66f74a38a364fa80ee9970a6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.564961 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1051/2094] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:57 2022] DELETE /identity/v3/users/ce8abcfd66f74a38a364fa80ee9970a6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:57.565792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:57.567187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.574045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e975-289c-4453-a6b3-be6fe24818ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:57.575539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e975-289c-4453-a6b3-be6fe24818ea service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:57.586039 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1044/2095] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:57.587402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3325-eba0-4301-ab58-c6eaddefc4ca None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.587781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3325-eba0-4301-ab58-c6eaddefc4ca None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.588179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3325-eba0-4301-ab58-c6eaddefc4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.609306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f4bd3325-eba0-4301-ab58-c6eaddefc4ca None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:57.612451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f4bd3325-eba0-4301-ab58-c6eaddefc4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.672715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dc5f3-e565-4583-a0b5-36640fac4681 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:57.680834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:57.681632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.681892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.682171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.686267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.724444 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1045/2096] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:57.724444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd3325-eba0-4301-ab58-c6eaddefc4ca None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:57.724444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f4bd3325-eba0-4301-ab58-c6eaddefc4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.747603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd3325-eba0-4301-ab58-c6eaddefc4ca None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:57.761122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:57.762544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.762544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.764853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] PATH_INFO: `/v3/projects/1ce1440967fc44069d5b342c0891a2c0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.766360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce1440967fc44069d5b342c0891a2c0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:57.768875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:57.778885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:57.780710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:57.791563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1052/2097] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:57.795107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:57.797267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.836424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce1440967fc44069d5b342c0891a2c0', 'request_id': 'req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.843726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce1440967fc44069d5b342c0891a2c0', 'request_id': 'req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.857323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce1440967fc44069d5b342c0891a2c0', 'request_id': 'req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.873908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] The token cache is being invalidate because project 1ce1440967fc44069d5b342c0891a2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:57.874133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.874850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2106ccaa-aba4-4b2f-822e-d9e7c6bae7de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:57.880197 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1046/2098] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:57 2022] DELETE /identity/v3/projects/1ce1440967fc44069d5b342c0891a2c0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:57.883079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3c83-edbc-4e65-a62c-c21e0e512cfc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.883489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3c83-edbc-4e65-a62c-c21e0e512cfc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.883779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3c83-edbc-4e65-a62c-c21e0e512cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.900643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c6f81-d98c-46fc-902d-5b7a49331f3a service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:57.916274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0f4d3c83-edbc-4e65-a62c-c21e0e512cfc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:57.917588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0f4d3c83-edbc-4e65-a62c-c21e0e512cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:57.974796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fc114-bc8a-4339-8a47-7d649cb3cabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:57.975448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fc114-bc8a-4339-8a47-7d649cb3cabc service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:57.975791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fc114-bc8a-4339-8a47-7d649cb3cabc service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:57.976067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fc114-bc8a-4339-8a47-7d649cb3cabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:57.977909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd0fc114-bc8a-4339-8a47-7d649cb3cabc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.003651 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1047/2099] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:58.013206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00876573-c6a1-44b4-813c-f3f796562ff4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.013504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00876573-c6a1-44b4-813c-f3f796562ff4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.013779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00876573-c6a1-44b4-813c-f3f796562ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.038937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-00876573-c6a1-44b4-813c-f3f796562ff4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:58.040253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-00876573-c6a1-44b4-813c-f3f796562ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.056954 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1048/2100] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:58.058070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00876573-c6a1-44b4-813c-f3f796562ff4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.067315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00876573-c6a1-44b4-813c-f3f796562ff4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.076282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.077002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.077285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.077455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fc114-bc8a-4339-8a47-7d649cb3cabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.077886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.078287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:58.078600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.078922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fc114-bc8a-4339-8a47-7d649cb3cabc service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.080203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.093338 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1053/2101] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:58.093338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef6908-787f-4ebd-921b-df24c0b7e779 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.093338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef6908-787f-4ebd-921b-df24c0b7e779 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.093338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef6908-787f-4ebd-921b-df24c0b7e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.098618 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1049/2102] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:58.107637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.117727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d504fb-88d7-40b7-9f6c-8bff403021a5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.126711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.127397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.127678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.127955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.128688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.131470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.139599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b8ef6908-787f-4ebd-921b-df24c0b7e779 None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:58.141139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b8ef6908-787f-4ebd-921b-df24c0b7e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.151835 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1054/2103] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:50:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:58.185561 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1050/2104] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:58 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:58.187172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef6908-787f-4ebd-921b-df24c0b7e779 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.203126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef6908-787f-4ebd-921b-df24c0b7e779 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.207635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.210949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.297607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bcb6f-7f1e-4be2-8668-513f8eea6d9c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.302692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616abf9a-a9c7-4c08-99ce-e0acfd3edf8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.303341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616abf9a-a9c7-4c08-99ce-e0acfd3edf8e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.303836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616abf9a-a9c7-4c08-99ce-e0acfd3edf8e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.304238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616abf9a-a9c7-4c08-99ce-e0acfd3edf8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.313289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616abf9a-a9c7-4c08-99ce-e0acfd3edf8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.314937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616abf9a-a9c7-4c08-99ce-e0acfd3edf8e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.324986 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1051/2105] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:58.342214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c407-ff4a-42be-8232-0fc7caa05237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.343004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c407-ff4a-42be-8232-0fc7caa05237 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.343386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c407-ff4a-42be-8232-0fc7caa05237 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.343824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c407-ff4a-42be-8232-0fc7caa05237 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.344754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77c407-ff4a-42be-8232-0fc7caa05237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.346827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77c407-ff4a-42be-8232-0fc7caa05237 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.375793 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1055/2106] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:58 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:58.377388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616abf9a-a9c7-4c08-99ce-e0acfd3edf8e service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.390030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616abf9a-a9c7-4c08-99ce-e0acfd3edf8e service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.395237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.396551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.396911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.397259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.398680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.400383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.417321 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1052/2107] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:58.418985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c407-ff4a-42be-8232-0fc7caa05237 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.432570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c407-ff4a-42be-8232-0fc7caa05237 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.438445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b240d-43a9-4c2d-af3b-1eb174e3092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.439395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b240d-43a9-4c2d-af3b-1eb174e3092f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.440305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b240d-43a9-4c2d-af3b-1eb174e3092f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.440305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b240d-43a9-4c2d-af3b-1eb174e3092f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.441282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b240d-43a9-4c2d-af3b-1eb174e3092f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.446169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b240d-43a9-4c2d-af3b-1eb174e3092f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.463110 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1056/2108] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:58.463753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.465341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b240d-43a9-4c2d-af3b-1eb174e3092f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.465615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.478331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b240d-43a9-4c2d-af3b-1eb174e3092f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.485443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c9ebc-92e5-4d2c-ad94-9a6882d840b3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.491012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.491961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcac90-4a98-46ff-b288-336e7142f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.492113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.492241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.492566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] PATH_INFO: `/v3/projects/fe4bbfdec74e4a09949381e5f539671d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.493692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcac90-4a98-46ff-b288-336e7142f17a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.494147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcac90-4a98-46ff-b288-336e7142f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.494304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4bbfdec74e4a09949381e5f539671d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.494717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcac90-4a98-46ff-b288-336e7142f17a admin admin] PATH_INFO: `/v3/projects/e2599a1bea39406f9b1e548ab3f1cd22/users/c26bc5048c9849218cadd12475cd5fbe/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.496816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.518025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcac90-4a98-46ff-b288-336e7142f17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2599a1bea39406f9b1e548ab3f1cd22, user_id=c26bc5048c9849218cadd12475cd5fbe, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.520870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcac90-4a98-46ff-b288-336e7142f17a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.536541 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1057/2109] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:58 2022] PUT /identity/v3/projects/e2599a1bea39406f9b1e548ab3f1cd22/users/c26bc5048c9849218cadd12475cd5fbe/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:58.548433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7c11-0d4a-4e4f-b6d7-9540f1647e13 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.548731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7c11-0d4a-4e4f-b6d7-9540f1647e13 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.549013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7c11-0d4a-4e4f-b6d7-9540f1647e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.552441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4bbfdec74e4a09949381e5f539671d', 'request_id': 'req-5c48eaae-de81-4261-a308-6288fdf6ef75'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.559742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4bbfdec74e4a09949381e5f539671d', 'request_id': 'req-5c48eaae-de81-4261-a308-6288fdf6ef75'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.568413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4bbfdec74e4a09949381e5f539671d', 'request_id': 'req-5c48eaae-de81-4261-a308-6288fdf6ef75'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.581074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e30b7c11-0d4a-4e4f-b6d7-9540f1647e13 None None] MFA Rules not processed for user `c26bc5048c9849218cadd12475cd5fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:58.581754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] The token cache is being invalidate because project fe4bbfdec74e4a09949381e5f539671d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:58.581894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e30b7c11-0d4a-4e4f-b6d7-9540f1647e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.582081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.582731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.584519 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1053/2110] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:58 2022] DELETE /identity/v3/projects/fe4bbfdec74e4a09949381e5f539671d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:58.588639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.590058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.651976 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1058/2111] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:58.657452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7c11-0d4a-4e4f-b6d7-9540f1647e13 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.658987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e30b7c11-0d4a-4e4f-b6d7-9540f1647e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.685589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48eaae-de81-4261-a308-6288fdf6ef75 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.690945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.692193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.692408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.692666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] PATH_INFO: `/v3/users/108b74c7b48645958e9ed0b7c08d1ea6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.705266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108b74c7b48645958e9ed0b7c08d1ea6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.707519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.756102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7c11-0d4a-4e4f-b6d7-9540f1647e13 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:58.764377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:58.764772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:58.765062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:58.765396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:58.766039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:58.769275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:58.792343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108b74c7b48645958e9ed0b7c08d1ea6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.792991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108b74c7b48645958e9ed0b7c08d1ea6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.793630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108b74c7b48645958e9ed0b7c08d1ea6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.814522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108b74c7b48645958e9ed0b7c08d1ea6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.829121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108b74c7b48645958e9ed0b7c08d1ea6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:58.835956 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1059/2112] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:58 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:58.837074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.841477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:58.863076 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1054/2113] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:58 2022] DELETE /identity/v3/users/108b74c7b48645958e9ed0b7c08d1ea6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:50:58.864015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:58.865514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.050988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bc5a3-3640-43c7-9443-77eb5179634c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.062697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.064569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.064966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.065402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] PATH_INFO: `/v3/users/3181f4ca7155437a903292c6b3c3a40b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.067673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3181f4ca7155437a903292c6b3c3a40b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.071007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.078187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d259e-1f41-4f11-9d84-4fcc1f19a101 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.094395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbce89-e1d5-4268-b04f-ca52d11daac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.095089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbce89-e1d5-4268-b04f-ca52d11daac0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.095379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbce89-e1d5-4268-b04f-ca52d11daac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.095656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbce89-e1d5-4268-b04f-ca52d11daac0 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.096445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbce89-e1d5-4268-b04f-ca52d11daac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.098391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbce89-e1d5-4268-b04f-ca52d11daac0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.151544 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1055/2114] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:50:58 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:50:59.157043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3181f4ca7155437a903292c6b3c3a40b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.165399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbce89-e1d5-4268-b04f-ca52d11daac0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.184147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbce89-e1d5-4268-b04f-ca52d11daac0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.192146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.193181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.193618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.194061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.196001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.197933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.233238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3181f4ca7155437a903292c6b3c3a40b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.243503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3181f4ca7155437a903292c6b3c3a40b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.246710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3181f4ca7155437a903292c6b3c3a40b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.247840 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1056/2115] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:50:59.252044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e228a1b-5e0d-4ce4-b516-cdbd0f5a45c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3181f4ca7155437a903292c6b3c3a40b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.253170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.255944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.277022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d28dee-79ee-4162-9cc4-dd6148ddf5ef admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.286351 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1060/2116] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:58 2022] DELETE /identity/v3/users/3181f4ca7155437a903292c6b3c3a40b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:59.291260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6c49-acbc-479e-8ce5-efc584fa9323 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.291503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6c49-acbc-479e-8ce5-efc584fa9323 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.291784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6c49-acbc-479e-8ce5-efc584fa9323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.293903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfc0b-85c2-4f01-ba0e-d67a94c44d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.294803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfc0b-85c2-4f01-ba0e-d67a94c44d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.295094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfc0b-85c2-4f01-ba0e-d67a94c44d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.295362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfc0b-85c2-4f01-ba0e-d67a94c44d6d admin admin] PATH_INFO: `/v3/projects/407c70643b364ed8a2371acba506a19f/users/168c8aa254304f4097c3a3c75e3e423a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.311742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9e2a6c49-acbc-479e-8ce5-efc584fa9323 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:59.313008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e2a6c49-acbc-479e-8ce5-efc584fa9323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.334102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecfc0b-85c2-4f01-ba0e-d67a94c44d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=407c70643b364ed8a2371acba506a19f, user_id=168c8aa254304f4097c3a3c75e3e423a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.337555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecfc0b-85c2-4f01-ba0e-d67a94c44d6d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.358985 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1057/2117] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:59 2022] PUT /identity/v3/projects/407c70643b364ed8a2371acba506a19f/users/168c8aa254304f4097c3a3c75e3e423a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:59.362831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfc0b-85c2-4f01-ba0e-d67a94c44d6d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.396405 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1061/2118] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:59.404569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6c49-acbc-479e-8ce5-efc584fa9323 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.407889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e2a6c49-acbc-479e-8ce5-efc584fa9323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.493961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6c49-acbc-479e-8ce5-efc584fa9323 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.503193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfc0b-85c2-4f01-ba0e-d67a94c44d6d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.516276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.517038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.517307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.517636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.518436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.520078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.534282 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1058/2119] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:50:59.535945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.540484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.563566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6271d-2d7c-4bb5-bf53-48ce9811fa52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.565045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6271d-2d7c-4bb5-bf53-48ce9811fa52 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.565389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6271d-2d7c-4bb5-bf53-48ce9811fa52 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.565932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6271d-2d7c-4bb5-bf53-48ce9811fa52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.578347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6271d-2d7c-4bb5-bf53-48ce9811fa52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.580541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6271d-2d7c-4bb5-bf53-48ce9811fa52 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.585031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d826790-9d7c-48f7-beb8-ab177ebeb73e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.593749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.594809 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1062/2120] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:50:59.595889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6271d-2d7c-4bb5-bf53-48ce9811fa52 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.596584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.596967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.597435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] PATH_INFO: `/v3/projects/2fd1bcde9cde48cb98ca11712c2e3a42` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.599697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd1bcde9cde48cb98ca11712c2e3a42)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.602833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.622695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6271d-2d7c-4bb5-bf53-48ce9811fa52 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.634101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8304547-9bee-4fb8-95bb-f12de8e273de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.635403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304547-9bee-4fb8-95bb-f12de8e273de admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.635814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304547-9bee-4fb8-95bb-f12de8e273de admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.636103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304547-9bee-4fb8-95bb-f12de8e273de admin admin] PATH_INFO: `/v3/projects/407c70643b364ed8a2371acba506a19f/users/168c8aa254304f4097c3a3c75e3e423a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.638177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8304547-9bee-4fb8-95bb-f12de8e273de admin admin] RBAC: Authorizing `identity:create_grant(project_id=407c70643b364ed8a2371acba506a19f, user_id=168c8aa254304f4097c3a3c75e3e423a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.641263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8304547-9bee-4fb8-95bb-f12de8e273de admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.664094 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1063/2121] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:50:59 2022] PUT /identity/v3/projects/407c70643b364ed8a2371acba506a19f/users/168c8aa254304f4097c3a3c75e3e423a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:59.676428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ab98-c281-4927-81d5-db81fb50e693 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.676763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ab98-c281-4927-81d5-db81fb50e693 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.678105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ab98-c281-4927-81d5-db81fb50e693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.706649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd1bcde9cde48cb98ca11712c2e3a42', 'request_id': 'req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.714049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd1bcde9cde48cb98ca11712c2e3a42', 'request_id': 'req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.723579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd1bcde9cde48cb98ca11712c2e3a42', 'request_id': 'req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.745486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3328ab98-c281-4927-81d5-db81fb50e693 None None] MFA Rules not processed for user `168c8aa254304f4097c3a3c75e3e423a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:59.746055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] The token cache is being invalidate because project 2fd1bcde9cde48cb98ca11712c2e3a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:50:59.746452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.746886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3328ab98-c281-4927-81d5-db81fb50e693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.747158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25668084-ef33-4b9a-bf2a-9c6ad0bcfb95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:50:59.748880 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1059/2122] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:50:59 2022] DELETE /identity/v3/projects/2fd1bcde9cde48cb98ca11712c2e3a42 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:50:59.754906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf83621-dbf0-4890-9a17-23e0c6e4b6a0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.755190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf83621-dbf0-4890-9a17-23e0c6e4b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.755467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf83621-dbf0-4890-9a17-23e0c6e4b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.774533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-acf83621-dbf0-4890-9a17-23e0c6e4b6a0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:59.775745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-acf83621-dbf0-4890-9a17-23e0c6e4b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.840691 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1064/2123] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:59.851262 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1060/2124] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:59.852222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c32ae-6783-4db9-840f-1ecfce4c955a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.852554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c32ae-6783-4db9-840f-1ecfce4c955a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.852834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c32ae-6783-4db9-840f-1ecfce4c955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.853622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bebd9-1a1c-43ba-b48b-681af56818d5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.854086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bebd9-1a1c-43ba-b48b-681af56818d5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.854521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bebd9-1a1c-43ba-b48b-681af56818d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.871331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-540c32ae-6783-4db9-840f-1ecfce4c955a None None] MFA Rules not processed for user `c26bc5048c9849218cadd12475cd5fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:59.872577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-540c32ae-6783-4db9-840f-1ecfce4c955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.875035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-840bebd9-1a1c-43ba-b48b-681af56818d5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:50:59.876207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-840bebd9-1a1c-43ba-b48b-681af56818d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:50:59.887205 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1061/2125] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:50:59.891311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bebd9-1a1c-43ba-b48b-681af56818d5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.902612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bebd9-1a1c-43ba-b48b-681af56818d5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.907675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.908352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.908642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.908916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.909639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:50:59.909945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.911727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.928309 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1062/2126] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:50:59.930644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.937720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1065/2127] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:50:59.942377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cae5dc-0848-4e7a-ae39-2fc408ff0258 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:50:59.950128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:50:59.950851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:50:59.951089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c32ae-6783-4db9-840f-1ecfce4c955a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:50:59.951202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:50:59.951403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:50:59.952615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:50:59.954778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:50:59.959894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-540c32ae-6783-4db9-840f-1ecfce4c955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:00.003605 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1063/2128] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:50:59 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:00.005226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:00.008824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:00.046452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c32ae-6783-4db9-840f-1ecfce4c955a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:00.103388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f3f1-4eec-405c-a732-f19cbbcce14e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:00.109883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:00.110741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.111017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.111307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] PATH_INFO: `/v3/projects/6056b16f9080426a98c58c750caa403b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.112658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6056b16f9080426a98c58c750caa403b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:00.114885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:00.130547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:00.131218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.131479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.131747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.133556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:00.159602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6056b16f9080426a98c58c750caa403b', 'request_id': 'req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.165616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6056b16f9080426a98c58c750caa403b', 'request_id': 'req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.174456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6056b16f9080426a98c58c750caa403b', 'request_id': 'req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.188420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] The token cache is being invalidate because project 6056b16f9080426a98c58c750caa403b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:00.188896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.189550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.192716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1064/2129] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:00 2022] DELETE /identity/v3/projects/6056b16f9080426a98c58c750caa403b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:00.193447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:00.194914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:00.196615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:00.198207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:00.207517 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1066/2130] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:50:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:51:00.208149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:00.224926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92a03-9e5b-4574-9792-650a612b9bc3 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:00.276352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a2473-71f7-4dd3-ae56-f8fec7c388ac admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:00.281481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e955-8fc8-40c0-8367-c1cadb0b53a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:00.282778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e955-8fc8-40c0-8367-c1cadb0b53a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.283070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e955-8fc8-40c0-8367-c1cadb0b53a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.283351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e955-8fc8-40c0-8367-c1cadb0b53a0 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.284047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608e955-8fc8-40c0-8367-c1cadb0b53a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:00.286130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608e955-8fc8-40c0-8367-c1cadb0b53a0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:00.306433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:00.307496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.307780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.308058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] PATH_INFO: `/v3/users/95898493aa124dc4abe75a3965da2aac` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.309282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=95898493aa124dc4abe75a3965da2aac)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:00.310336 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1065/2131] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:00 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:00.311375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:00.313987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e955-8fc8-40c0-8367-c1cadb0b53a0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:00.324486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e955-8fc8-40c0-8367-c1cadb0b53a0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:00.329439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fd9fe-ed6a-422a-8773-195f0e73c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:00.330096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fd9fe-ed6a-422a-8773-195f0e73c7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.330380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fd9fe-ed6a-422a-8773-195f0e73c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.330712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fd9fe-ed6a-422a-8773-195f0e73c7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.331444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fd9fe-ed6a-422a-8773-195f0e73c7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:00.333306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fd9fe-ed6a-422a-8773-195f0e73c7e5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:00.346388 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1066/2132] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:00.353480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fd9fe-ed6a-422a-8773-195f0e73c7e5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:00.363226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95898493aa124dc4abe75a3965da2aac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.363392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fd9fe-ed6a-422a-8773-195f0e73c7e5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:00.368273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fdce7-c63b-4993-a4a7-de533d9e7514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:00.368964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fdce7-c63b-4993-a4a7-de533d9e7514 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.369249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fdce7-c63b-4993-a4a7-de533d9e7514 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.369526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fdce7-c63b-4993-a4a7-de533d9e7514 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.370256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fdce7-c63b-4993-a4a7-de533d9e7514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:00.371855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fdce7-c63b-4993-a4a7-de533d9e7514 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:00.375686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95898493aa124dc4abe75a3965da2aac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.382129 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1067/2133] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:00.386297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fdce7-c63b-4993-a4a7-de533d9e7514 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:00.386422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95898493aa124dc4abe75a3965da2aac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.387355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95898493aa124dc4abe75a3965da2aac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.387940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a33c0ef-8f38-45d4-91e8-2a554948d5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95898493aa124dc4abe75a3965da2aac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:00.396860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fdce7-c63b-4993-a4a7-de533d9e7514 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:00.401797 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1067/2134] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:00 2022] DELETE /identity/v3/users/95898493aa124dc4abe75a3965da2aac => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:00.401922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:00.402534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.402818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.403257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] PATH_INFO: `/v3/projects/2aca5c599959431ea7c78faa2f7abab2/users/bfad2c65daed40e38992dfc781535f97/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.419805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aca5c599959431ea7c78faa2f7abab2, user_id=bfad2c65daed40e38992dfc781535f97, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:00.422512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:00.436589 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1068/2135] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:00 2022] PUT /identity/v3/projects/2aca5c599959431ea7c78faa2f7abab2/users/bfad2c65daed40e38992dfc781535f97/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:00.448122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559082e-f3a7-4bf9-98b8-9ffc73e4ddb5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.448881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559082e-f3a7-4bf9-98b8-9ffc73e4ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.449229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559082e-f3a7-4bf9-98b8-9ffc73e4ddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.484215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b559082e-f3a7-4bf9-98b8-9ffc73e4ddb5 None None] MFA Rules not processed for user `bfad2c65daed40e38992dfc781535f97`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:00.485527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b559082e-f3a7-4bf9-98b8-9ffc73e4ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:00.572245 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1068/2136] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:00.586565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:00.590318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:00.683983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd85ddb-8101-4ecc-abda-e5c9617eeffa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:00.693796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0f872-2f9d-4895-88a1-728dd372e049 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:00.693796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0f872-2f9d-4895-88a1-728dd372e049 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.693796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0f872-2f9d-4895-88a1-728dd372e049 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.693796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0f872-2f9d-4895-88a1-728dd372e049 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.706592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0f872-2f9d-4895-88a1-728dd372e049 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:00.708258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0f872-2f9d-4895-88a1-728dd372e049 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:00.732988 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1069/2137] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:00.863443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559082e-f3a7-4bf9-98b8-9ffc73e4ddb5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:00.866942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b559082e-f3a7-4bf9-98b8-9ffc73e4ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:00.950941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73192c4-e503-417c-8450-9e4f337fd3d1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:00.951241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73192c4-e503-417c-8450-9e4f337fd3d1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:00.951585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73192c4-e503-417c-8450-9e4f337fd3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:00.983610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f73192c4-e503-417c-8450-9e4f337fd3d1 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:00.985225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f73192c4-e503-417c-8450-9e4f337fd3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:00.998947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559082e-f3a7-4bf9-98b8-9ffc73e4ddb5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:01.017734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:01.019820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.020120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.021373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] PATH_INFO: `/v3/projects/19a2f94e6c584bc19a65d5d0cb95f6e3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.023474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a2f94e6c584bc19a65d5d0cb95f6e3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:01.030326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:01.094220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a2f94e6c584bc19a65d5d0cb95f6e3', 'request_id': 'req-42e6d144-8ba9-4a4b-a791-78bbf721f283'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:01.102962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a2f94e6c584bc19a65d5d0cb95f6e3', 'request_id': 'req-42e6d144-8ba9-4a4b-a791-78bbf721f283'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:01.104526 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1070/2138] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:01.115644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a2f94e6c584bc19a65d5d0cb95f6e3', 'request_id': 'req-42e6d144-8ba9-4a4b-a791-78bbf721f283'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:01.123693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73192c4-e503-417c-8450-9e4f337fd3d1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:01.126199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f73192c4-e503-417c-8450-9e4f337fd3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:01.136142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] The token cache is being invalidate because project 19a2f94e6c584bc19a65d5d0cb95f6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:01.136629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:01.137589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-42e6d144-8ba9-4a4b-a791-78bbf721f283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:01.140230 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1069/2139] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:00 2022] DELETE /identity/v3/projects/19a2f94e6c584bc19a65d5d0cb95f6e3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:01.145781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bb8dc-9564-4b32-a28a-590fa9f3860c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.146178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bb8dc-9564-4b32-a28a-590fa9f3860c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.146527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bb8dc-9564-4b32-a28a-590fa9f3860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.172357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-376bb8dc-9564-4b32-a28a-590fa9f3860c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:01.174080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-376bb8dc-9564-4b32-a28a-590fa9f3860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:01.224241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73192c4-e503-417c-8450-9e4f337fd3d1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:01.247720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1070/2140] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:01.256767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaa2f-83c4-4882-8188-d4161f2296c5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.257764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaa2f-83c4-4882-8188-d4161f2296c5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.258189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaa2f-83c4-4882-8188-d4161f2296c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.285163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-529eaa2f-83c4-4882-8188-d4161f2296c5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:01.286541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-529eaa2f-83c4-4882-8188-d4161f2296c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:01.302132 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1071/2141] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:01.308196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eaa2f-83c4-4882-8188-d4161f2296c5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:01.324092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eaa2f-83c4-4882-8188-d4161f2296c5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:01.329961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:01.330887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.331273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.331699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.332730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:01.333142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:01.335990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:01.341951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:01.342646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.342997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.343271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.351398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:01.352897 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1072/2142] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:01.357310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:01.387891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae08f1-e3c3-4665-811d-09316c5babd4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:01.394036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e4598-1a80-41aa-964b-d3e3be0e83d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:01.394747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e4598-1a80-41aa-964b-d3e3be0e83d2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.395250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e4598-1a80-41aa-964b-d3e3be0e83d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.395886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e4598-1a80-41aa-964b-d3e3be0e83d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.397084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e4598-1a80-41aa-964b-d3e3be0e83d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:01.400295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e4598-1a80-41aa-964b-d3e3be0e83d2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:01.437905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:01.439561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:01.447002 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1073/2143] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:01 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:01.458009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e4598-1a80-41aa-964b-d3e3be0e83d2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:01.484548 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1071/2144] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:51:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 20:51:01.598308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e4598-1a80-41aa-964b-d3e3be0e83d2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:01.608370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18960079-9c10-40cc-92da-660ef73ef7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:01.608370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18960079-9c10-40cc-92da-660ef73ef7ef admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.608370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18960079-9c10-40cc-92da-660ef73ef7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.608370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18960079-9c10-40cc-92da-660ef73ef7ef admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.608724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18960079-9c10-40cc-92da-660ef73ef7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:01.610529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18960079-9c10-40cc-92da-660ef73ef7ef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:01.643973 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1074/2145] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:01 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:01.649618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:01.671485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abb30b-d41b-44da-bbd1-300cf61f62f1 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:01.683541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5de5db-14ad-47ec-b35e-7f51679aa910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:01.684380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5de5db-14ad-47ec-b35e-7f51679aa910 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.684734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5de5db-14ad-47ec-b35e-7f51679aa910 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.686533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5de5db-14ad-47ec-b35e-7f51679aa910 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.687427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5de5db-14ad-47ec-b35e-7f51679aa910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:01.689119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5de5db-14ad-47ec-b35e-7f51679aa910 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:01.719249 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1072/2146] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:01.723419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18960079-9c10-40cc-92da-660ef73ef7ef admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:01.739956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18960079-9c10-40cc-92da-660ef73ef7ef admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:01.746485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a98e4-122f-4807-bd71-bd6c655359c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:01.747427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a98e4-122f-4807-bd71-bd6c655359c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.748165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a98e4-122f-4807-bd71-bd6c655359c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.748661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a98e4-122f-4807-bd71-bd6c655359c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.749636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a98e4-122f-4807-bd71-bd6c655359c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:01.751523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a98e4-122f-4807-bd71-bd6c655359c1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:01.771227 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1075/2147] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:01.771987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5de5db-14ad-47ec-b35e-7f51679aa910 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:01.782969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5de5db-14ad-47ec-b35e-7f51679aa910 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:01.805018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bc673-0848-47f4-a6bb-cafd4e6e726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:01.805988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc673-0848-47f4-a6bb-cafd4e6e726c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.806612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc673-0848-47f4-a6bb-cafd4e6e726c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.806905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc673-0848-47f4-a6bb-cafd4e6e726c admin admin] PATH_INFO: `/v3/projects/e98c9c5247b943a895bd53603a38d851/users/4feed6ce10b0486ba36ab6ba6ca0ad5e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.830715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bc673-0848-47f4-a6bb-cafd4e6e726c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98c9c5247b943a895bd53603a38d851, user_id=4feed6ce10b0486ba36ab6ba6ca0ad5e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:01.844317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bc673-0848-47f4-a6bb-cafd4e6e726c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:01.888754 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1073/2148] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:01 2022] PUT /identity/v3/projects/e98c9c5247b943a895bd53603a38d851/users/4feed6ce10b0486ba36ab6ba6ca0ad5e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:01.890675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e847d7-8f32-4b81-8fa4-165f00f9b496 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:01.891505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e847d7-8f32-4b81-8fa4-165f00f9b496 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:01.892237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e847d7-8f32-4b81-8fa4-165f00f9b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:01.951479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c3e847d7-8f32-4b81-8fa4-165f00f9b496 None None] MFA Rules not processed for user `4feed6ce10b0486ba36ab6ba6ca0ad5e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:01.952719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c3e847d7-8f32-4b81-8fa4-165f00f9b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:02.082643 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1076/2149] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:02.087872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bc673-0848-47f4-a6bb-cafd4e6e726c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:02.160312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bc673-0848-47f4-a6bb-cafd4e6e726c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:02.166202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734f320-6eec-445d-b9e5-85515ab67c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:02.166938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734f320-6eec-445d-b9e5-85515ab67c22 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:02.167290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734f320-6eec-445d-b9e5-85515ab67c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:02.167636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734f320-6eec-445d-b9e5-85515ab67c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:02.168452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734f320-6eec-445d-b9e5-85515ab67c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:02.170438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734f320-6eec-445d-b9e5-85515ab67c22 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:02.207343 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1074/2150] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:02 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:02.213141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e847d7-8f32-4b81-8fa4-165f00f9b496 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:02.237323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e847d7-8f32-4b81-8fa4-165f00f9b496 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:02.350963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47975c-e458-49d0-96ba-72d46d9c1205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:02.351702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47975c-e458-49d0-96ba-72d46d9c1205 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:02.351936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47975c-e458-49d0-96ba-72d46d9c1205 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:02.352211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47975c-e458-49d0-96ba-72d46d9c1205 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:02.353026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47975c-e458-49d0-96ba-72d46d9c1205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:02.354977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47975c-e458-49d0-96ba-72d46d9c1205 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:02.384435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734f320-6eec-445d-b9e5-85515ab67c22 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:02.384661 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1077/2151] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:02 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:51:02.396157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734f320-6eec-445d-b9e5-85515ab67c22 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:02.402992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c3a2c-af2e-4278-878f-9eba4c4a55c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:02.403907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c3a2c-af2e-4278-878f-9eba4c4a55c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:02.404264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c3a2c-af2e-4278-878f-9eba4c4a55c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:02.404662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c3a2c-af2e-4278-878f-9eba4c4a55c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:02.405600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c3a2c-af2e-4278-878f-9eba4c4a55c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:02.408574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c3a2c-af2e-4278-878f-9eba4c4a55c6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:02.427494 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1075/2152] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:02.431360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47975c-e458-49d0-96ba-72d46d9c1205 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:02.464316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47975c-e458-49d0-96ba-72d46d9c1205 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:02.472624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c33831-7768-49a9-8df2-7c5ccb2c91fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:02.473607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33831-7768-49a9-8df2-7c5ccb2c91fe admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:02.473900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33831-7768-49a9-8df2-7c5ccb2c91fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:02.474179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33831-7768-49a9-8df2-7c5ccb2c91fe admin admin] PATH_INFO: `/v3/projects/f0a7fd8f8d0f4463b2f1cc439aafbbf8/users/7a91a8f460ee4289b30c92cd2562c6d6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:02.496562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c33831-7768-49a9-8df2-7c5ccb2c91fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a7fd8f8d0f4463b2f1cc439aafbbf8, user_id=7a91a8f460ee4289b30c92cd2562c6d6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:02.499157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c33831-7768-49a9-8df2-7c5ccb2c91fe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:02.521855 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1078/2153] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:02 2022] PUT /identity/v3/projects/f0a7fd8f8d0f4463b2f1cc439aafbbf8/users/7a91a8f460ee4289b30c92cd2562c6d6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:02.525781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c3a2c-af2e-4278-878f-9eba4c4a55c6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:02.537899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c3a2c-af2e-4278-878f-9eba4c4a55c6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:02.670210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3bf9-5c72-48c6-8983-71c3195586d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:02.670960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3bf9-5c72-48c6-8983-71c3195586d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:02.671895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3bf9-5c72-48c6-8983-71c3195586d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:02.671895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3bf9-5c72-48c6-8983-71c3195586d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:02.672250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3bf9-5c72-48c6-8983-71c3195586d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:02.678136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3bf9-5c72-48c6-8983-71c3195586d0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:02.722088 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1076/2154] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:51:02.723289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c33831-7768-49a9-8df2-7c5ccb2c91fe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:02.737992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c33831-7768-49a9-8df2-7c5ccb2c91fe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:02.752544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:02.757588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:02.758320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:02.758635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] PATH_INFO: `/v3/projects/f0a7fd8f8d0f4463b2f1cc439aafbbf8/users/7a91a8f460ee4289b30c92cd2562c6d6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:02.762678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a7fd8f8d0f4463b2f1cc439aafbbf8, user_id=7a91a8f460ee4289b30c92cd2562c6d6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:02.769063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:02.794486 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1079/2155] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:02 2022] PUT /identity/v3/projects/f0a7fd8f8d0f4463b2f1cc439aafbbf8/users/7a91a8f460ee4289b30c92cd2562c6d6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:02.808886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce7b6-9998-4586-82e6-ebd40b373491 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:02.809200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce7b6-9998-4586-82e6-ebd40b373491 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:02.809485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce7b6-9998-4586-82e6-ebd40b373491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:02.865055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c83ce7b6-9998-4586-82e6-ebd40b373491 None None] MFA Rules not processed for user `7a91a8f460ee4289b30c92cd2562c6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:02.867005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c83ce7b6-9998-4586-82e6-ebd40b373491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:03.059390 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1077/2156] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:03.163693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:03.168840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:03.290125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c7d5-5331-4da7-a69d-94a702cf4d72 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:03.296147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:03.296960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:03.297570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:03.298013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:03.367017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:03.369858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:03.398892 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1080/2157] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:04.040319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0b537-77fc-4bdf-9b6a-70f7637395a3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:04.040814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0b537-77fc-4bdf-9b6a-70f7637395a3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:04.041138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0b537-77fc-4bdf-9b6a-70f7637395a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:04.073501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-61d0b537-77fc-4bdf-9b6a-70f7637395a3 None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:04.074823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-61d0b537-77fc-4bdf-9b6a-70f7637395a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:04.165948 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1078/2158] 10.222.0.67 () {58 vars in 1015 bytes} [Sat Feb 19 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:04.186891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:04.188408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:04.206342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f82e-f80d-4fdb-bf89-d1279d3718ed service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:04.211317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e02a7-bb12-4a7b-a39b-a905589e978c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:04.211967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e02a7-bb12-4a7b-a39b-a905589e978c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:04.212253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e02a7-bb12-4a7b-a39b-a905589e978c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:04.212568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e02a7-bb12-4a7b-a39b-a905589e978c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:04.221696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e02a7-bb12-4a7b-a39b-a905589e978c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:04.223255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e02a7-bb12-4a7b-a39b-a905589e978c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:04.232262 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1081/2159] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:04.236825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0b537-77fc-4bdf-9b6a-70f7637395a3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:04.238625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-61d0b537-77fc-4bdf-9b6a-70f7637395a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:04.252051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0b537-77fc-4bdf-9b6a-70f7637395a3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:04.256290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f46b11-6326-45c8-9f06-f5be3a5fdf0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:04.257346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f46b11-6326-45c8-9f06-f5be3a5fdf0c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:04.257843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f46b11-6326-45c8-9f06-f5be3a5fdf0c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:04.258203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f46b11-6326-45c8-9f06-f5be3a5fdf0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:04.270906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f46b11-6326-45c8-9f06-f5be3a5fdf0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:04.273263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f46b11-6326-45c8-9f06-f5be3a5fdf0c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:04.283166 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1079/2160] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:05.395728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1f24-ebb7-470f-bc0a-c60854937a11 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:05.396221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1f24-ebb7-470f-bc0a-c60854937a11 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:05.396730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1f24-ebb7-470f-bc0a-c60854937a11 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:05.398713 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1082/2161] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:51:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:05.453599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aaec3-3d1c-4978-b30f-78e6f30507e7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:05.458204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aaec3-3d1c-4978-b30f-78e6f30507e7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:05.458204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aaec3-3d1c-4978-b30f-78e6f30507e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:05.526946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0e9aaec3-3d1c-4978-b30f-78e6f30507e7 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:05.528584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0e9aaec3-3d1c-4978-b30f-78e6f30507e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:05.545359 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1080/2162] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:06.570121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e1f24-ebb7-470f-bc0a-c60854937a11 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:06.574178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-768e1f24-ebb7-470f-bc0a-c60854937a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:06.604266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e1f24-ebb7-470f-bc0a-c60854937a11 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:06.612537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:06.613632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:06.614394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:06.614882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:06.624989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:06.626826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:06.637598 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1083/2163] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:06.746625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aaec3-3d1c-4978-b30f-78e6f30507e7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:06.759883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aaec3-3d1c-4978-b30f-78e6f30507e7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:06.765937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f69561-e784-41b5-a8d0-deb9904896e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:06.766811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f69561-e784-41b5-a8d0-deb9904896e8 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:06.767293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f69561-e784-41b5-a8d0-deb9904896e8 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:06.768068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f69561-e784-41b5-a8d0-deb9904896e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:06.779354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f69561-e784-41b5-a8d0-deb9904896e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:06.781479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f69561-e784-41b5-a8d0-deb9904896e8 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:06.794316 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1081/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:10.410174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:10.411948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:10.490007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ff74a-e5cf-40f4-9d99-1bc44b352806 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:10.497599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:10.498534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:10.498888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:10.499185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] PATH_INFO: `/v3/users/cf8b6484328b4ae999dc8ccd44d4129f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:10.500632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8b6484328b4ae999dc8ccd44d4129f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:10.503636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:10.561524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8b6484328b4ae999dc8ccd44d4129f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:10.577118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8b6484328b4ae999dc8ccd44d4129f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:10.587956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8b6484328b4ae999dc8ccd44d4129f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:10.588913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8b6484328b4ae999dc8ccd44d4129f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:10.589714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8b6484328b4ae999dc8ccd44d4129f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:10.604010 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1084/2165] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:10 2022] DELETE /identity/v3/users/cf8b6484328b4ae999dc8ccd44d4129f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:10.610463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd300b-2f81-4840-9164-33c7580cf819 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:10.611595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd300b-2f81-4840-9164-33c7580cf819 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:10.612071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd300b-2f81-4840-9164-33c7580cf819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:10.633016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f2fd300b-2f81-4840-9164-33c7580cf819 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:10.634217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f2fd300b-2f81-4840-9164-33c7580cf819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:10.710071 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1082/2166] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:10.722029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:10.723996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:10.816842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d70fb-b973-480b-a346-a1fcb8f01b63 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:10.822247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40d5d-1a6a-463e-a0c2-c486f0cdb4e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:10.823086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40d5d-1a6a-463e-a0c2-c486f0cdb4e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:10.823472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40d5d-1a6a-463e-a0c2-c486f0cdb4e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:10.824014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40d5d-1a6a-463e-a0c2-c486f0cdb4e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:10.836316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b40d5d-1a6a-463e-a0c2-c486f0cdb4e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:10.838063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b40d5d-1a6a-463e-a0c2-c486f0cdb4e9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:10.849527 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1085/2167] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:11.165986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd300b-2f81-4840-9164-33c7580cf819 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:11.167469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f2fd300b-2f81-4840-9164-33c7580cf819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:11.184489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd300b-2f81-4840-9164-33c7580cf819 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:11.189833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:11.190716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:11.190996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:11.191374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] PATH_INFO: `/v3/projects/171eb8a081f74f8a89218e43e188c9b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:11.193186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171eb8a081f74f8a89218e43e188c9b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:11.195602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:11.243470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171eb8a081f74f8a89218e43e188c9b2', 'request_id': 'req-77aa5b68-df59-4fef-aca2-3c60ea733ee5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.249029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171eb8a081f74f8a89218e43e188c9b2', 'request_id': 'req-77aa5b68-df59-4fef-aca2-3c60ea733ee5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.257230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171eb8a081f74f8a89218e43e188c9b2', 'request_id': 'req-77aa5b68-df59-4fef-aca2-3c60ea733ee5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.271058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] The token cache is being invalidate because project 171eb8a081f74f8a89218e43e188c9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:11.271413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.272231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.275025 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1083/2168] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:11 2022] DELETE /identity/v3/projects/171eb8a081f74f8a89218e43e188c9b2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:11.279873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40d5d-1a6a-463e-a0c2-c486f0cdb4e9 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:11.290164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40d5d-1a6a-463e-a0c2-c486f0cdb4e9 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:11.359114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:11.360458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:11.360814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:11.361099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] PATH_INFO: `/v3/users/ee3a1bd2873b4cab9d8c1c285cb85e3a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:11.362355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3a1bd2873b4cab9d8c1c285cb85e3a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:11.364361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:11.413736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3a1bd2873b4cab9d8c1c285cb85e3a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.425950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3a1bd2873b4cab9d8c1c285cb85e3a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.434705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3a1bd2873b4cab9d8c1c285cb85e3a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.435470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3a1bd2873b4cab9d8c1c285cb85e3a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.436081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0e9e10a6-636e-4ea5-a679-5e8d5c3cf3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3a1bd2873b4cab9d8c1c285cb85e3a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.449462 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1086/2169] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:11 2022] DELETE /identity/v3/users/ee3a1bd2873b4cab9d8c1c285cb85e3a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:11.725408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:11.727850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:11.747708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa5b68-df59-4fef-aca2-3c60ea733ee5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:11.808580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:11.809440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:11.809720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:11.809993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] PATH_INFO: `/v3/projects/f79db8fc8f254f56ba402add28cffdb8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:11.811264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79db8fc8f254f56ba402add28cffdb8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:11.813171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:11.858931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79db8fc8f254f56ba402add28cffdb8', 'request_id': 'req-1d20f56f-fdda-441e-89d9-6c56b26dfc74'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.864587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79db8fc8f254f56ba402add28cffdb8', 'request_id': 'req-1d20f56f-fdda-441e-89d9-6c56b26dfc74'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.874026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79db8fc8f254f56ba402add28cffdb8', 'request_id': 'req-1d20f56f-fdda-441e-89d9-6c56b26dfc74'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.885846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] The token cache is being invalidate because project f79db8fc8f254f56ba402add28cffdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:11.886155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.886828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1d20f56f-fdda-441e-89d9-6c56b26dfc74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:11.888401 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1084/2170] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:11 2022] DELETE /identity/v3/projects/f79db8fc8f254f56ba402add28cffdb8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:11.893476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1d54-7549-4a3d-bead-e4f662cafc8c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:11.893970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1d54-7549-4a3d-bead-e4f662cafc8c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:11.894415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1d54-7549-4a3d-bead-e4f662cafc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:11.912570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8b3a1d54-7549-4a3d-bead-e4f662cafc8c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:11.913778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b3a1d54-7549-4a3d-bead-e4f662cafc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:12.002763 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1087/2171] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:12.012694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84052c4-3f4a-4146-a6a9-2b1f1f126348 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.013189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84052c4-3f4a-4146-a6a9-2b1f1f126348 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.013641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84052c4-3f4a-4146-a6a9-2b1f1f126348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.040651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f84052c4-3f4a-4146-a6a9-2b1f1f126348 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:12.042387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f84052c4-3f4a-4146-a6a9-2b1f1f126348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:12.059513 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1085/2172] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:12.060205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1d54-7549-4a3d-bead-e4f662cafc8c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.071783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1d54-7549-4a3d-bead-e4f662cafc8c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.076892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.077554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.077837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.078113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.078848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:12.079155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.081019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.095143 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1088/2173] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:51:12.099619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84052c4-3f4a-4146-a6a9-2b1f1f126348 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.110891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84052c4-3f4a-4146-a6a9-2b1f1f126348 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.116749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c279-db7b-4f07-96b7-32de49b75e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.117540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c279-db7b-4f07-96b7-32de49b75e83 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.117929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c279-db7b-4f07-96b7-32de49b75e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.118300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c279-db7b-4f07-96b7-32de49b75e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.119105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c279-db7b-4f07-96b7-32de49b75e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.121791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c279-db7b-4f07-96b7-32de49b75e83 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.151361 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1086/2174] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:12 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:12.155918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.168884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32540f9-370a-4595-8092-01987855eb96 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.237391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca398e-0310-48dd-83ff-f359e72a69ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.238163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca398e-0310-48dd-83ff-f359e72a69ee admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.238544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca398e-0310-48dd-83ff-f359e72a69ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.238894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca398e-0310-48dd-83ff-f359e72a69ee admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.239664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca398e-0310-48dd-83ff-f359e72a69ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.241720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca398e-0310-48dd-83ff-f359e72a69ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.264146 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1089/2175] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:12 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:51:12.269036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c279-db7b-4f07-96b7-32de49b75e83 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.282377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c279-db7b-4f07-96b7-32de49b75e83 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.287394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9b09-661e-4822-a4d0-029f2a28df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.288805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9b09-661e-4822-a4d0-029f2a28df3a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.289163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9b09-661e-4822-a4d0-029f2a28df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.289504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9b09-661e-4822-a4d0-029f2a28df3a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.290306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff9b09-661e-4822-a4d0-029f2a28df3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.291986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff9b09-661e-4822-a4d0-029f2a28df3a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.305078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1087/2176] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:12.309003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca398e-0310-48dd-83ff-f359e72a69ee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.327296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca398e-0310-48dd-83ff-f359e72a69ee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.332172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b10f4d-dbdd-4082-85fd-8b780b496476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.332880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10f4d-dbdd-4082-85fd-8b780b496476 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.333266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10f4d-dbdd-4082-85fd-8b780b496476 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.333462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10f4d-dbdd-4082-85fd-8b780b496476 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.334218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b10f4d-dbdd-4082-85fd-8b780b496476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.336422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b10f4d-dbdd-4082-85fd-8b780b496476 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.347351 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1090/2177] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:51:12.351754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9b09-661e-4822-a4d0-029f2a28df3a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.362013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9b09-661e-4822-a4d0-029f2a28df3a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.366762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e62de2-55d6-4b10-b8f5-a827742fec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.367874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e62de2-55d6-4b10-b8f5-a827742fec71 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.367983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e62de2-55d6-4b10-b8f5-a827742fec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.368173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e62de2-55d6-4b10-b8f5-a827742fec71 admin admin] PATH_INFO: `/v3/projects/0d8cbd690acb4a33ab73d43b201600b3/users/a42a4b77b78746e38a063ded0982eea8/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.383065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e62de2-55d6-4b10-b8f5-a827742fec71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8cbd690acb4a33ab73d43b201600b3, user_id=a42a4b77b78746e38a063ded0982eea8, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.385772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e62de2-55d6-4b10-b8f5-a827742fec71 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.400801 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1088/2178] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:12 2022] PUT /identity/v3/projects/0d8cbd690acb4a33ab73d43b201600b3/users/a42a4b77b78746e38a063ded0982eea8/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:12.411537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f3e8-fa5f-46b3-93b7-41a5165152e3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.412003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f3e8-fa5f-46b3-93b7-41a5165152e3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.413655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f3e8-fa5f-46b3-93b7-41a5165152e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.444230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a1b0f3e8-fa5f-46b3-93b7-41a5165152e3 None None] MFA Rules not processed for user `a42a4b77b78746e38a063ded0982eea8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:12.445482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a1b0f3e8-fa5f-46b3-93b7-41a5165152e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:12.520438 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1091/2179] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:12.525337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e62de2-55d6-4b10-b8f5-a827742fec71 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.622938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e62de2-55d6-4b10-b8f5-a827742fec71 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.628575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f95e4-b6b9-4b91-b978-8ca062ee5683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.629293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f95e4-b6b9-4b91-b978-8ca062ee5683 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.629625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f95e4-b6b9-4b91-b978-8ca062ee5683 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.629856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f95e4-b6b9-4b91-b978-8ca062ee5683 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.630558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f95e4-b6b9-4b91-b978-8ca062ee5683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.633122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f95e4-b6b9-4b91-b978-8ca062ee5683 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.671170 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1089/2180] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:12 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:12.675590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0f3e8-fa5f-46b3-93b7-41a5165152e3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.700919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0f3e8-fa5f-46b3-93b7-41a5165152e3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.795713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e474-66b5-4a4e-ad21-0b03a9621d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.796418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e474-66b5-4a4e-ad21-0b03a9621d12 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.796707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e474-66b5-4a4e-ad21-0b03a9621d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.797080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e474-66b5-4a4e-ad21-0b03a9621d12 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.797780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e474-66b5-4a4e-ad21-0b03a9621d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.799671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e474-66b5-4a4e-ad21-0b03a9621d12 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.823346 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1092/2181] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:12 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:12.827623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f95e4-b6b9-4b91-b978-8ca062ee5683 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.839597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f95e4-b6b9-4b91-b978-8ca062ee5683 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.849137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2fd2-5587-4095-8b4b-3559c602fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.850032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2fd2-5587-4095-8b4b-3559c602fd9a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.850330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2fd2-5587-4095-8b4b-3559c602fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.850619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2fd2-5587-4095-8b4b-3559c602fd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.851352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e2fd2-5587-4095-8b4b-3559c602fd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.852967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e2fd2-5587-4095-8b4b-3559c602fd9a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.864262 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1090/2182] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:12.868562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e474-66b5-4a4e-ad21-0b03a9621d12 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.884718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e474-66b5-4a4e-ad21-0b03a9621d12 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:12.890469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58141-2934-4be0-91a6-4a022b32b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:12.891553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58141-2934-4be0-91a6-4a022b32b17d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:12.891911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58141-2934-4be0-91a6-4a022b32b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:12.892369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58141-2934-4be0-91a6-4a022b32b17d admin admin] PATH_INFO: `/v3/projects/f4ffc4c10ab64eabb1654e3e90ca8059/users/d7ea27881e904fa59ce1c83f5c25d541/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:12.915585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a58141-2934-4be0-91a6-4a022b32b17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ffc4c10ab64eabb1654e3e90ca8059, user_id=d7ea27881e904fa59ce1c83f5c25d541, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:12.920253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a58141-2934-4be0-91a6-4a022b32b17d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:12.940838 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1093/2183] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:12 2022] PUT /identity/v3/projects/f4ffc4c10ab64eabb1654e3e90ca8059/users/d7ea27881e904fa59ce1c83f5c25d541/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:12.949936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2fd2-5587-4095-8b4b-3559c602fd9a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:12.962075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2fd2-5587-4095-8b4b-3559c602fd9a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:13.051927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461955e1-24ad-43c6-bd49-8cc93ff1340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:13.052994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461955e1-24ad-43c6-bd49-8cc93ff1340b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:13.053380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461955e1-24ad-43c6-bd49-8cc93ff1340b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:13.054472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461955e1-24ad-43c6-bd49-8cc93ff1340b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:13.055323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461955e1-24ad-43c6-bd49-8cc93ff1340b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:13.057403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461955e1-24ad-43c6-bd49-8cc93ff1340b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:13.069240 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1091/2184] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:13.073353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58141-2934-4be0-91a6-4a022b32b17d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:13.085554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58141-2934-4be0-91a6-4a022b32b17d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:13.090742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:13.092124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:13.092124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:13.092631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] PATH_INFO: `/v3/projects/f4ffc4c10ab64eabb1654e3e90ca8059/users/d7ea27881e904fa59ce1c83f5c25d541/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:13.094716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ffc4c10ab64eabb1654e3e90ca8059, user_id=d7ea27881e904fa59ce1c83f5c25d541, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:13.098071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:13.110369 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1094/2185] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:13 2022] PUT /identity/v3/projects/f4ffc4c10ab64eabb1654e3e90ca8059/users/d7ea27881e904fa59ce1c83f5c25d541/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:13.121969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb32f-0c32-4ccf-9b3d-18ea479892ad None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:13.122260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb32f-0c32-4ccf-9b3d-18ea479892ad None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:13.122545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb32f-0c32-4ccf-9b3d-18ea479892ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:13.159981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-55cfb32f-0c32-4ccf-9b3d-18ea479892ad None None] MFA Rules not processed for user `d7ea27881e904fa59ce1c83f5c25d541`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:13.161280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55cfb32f-0c32-4ccf-9b3d-18ea479892ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:13.230586 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1092/2186] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:13.513114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:13.514985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:13.591072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3763f95-1a42-4fc5-8407-4b60a285c90b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:13.596676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:13.597318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:13.597601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:13.597878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:13.605869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:13.607423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:13.616690 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1095/2187] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:14.158730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0282-eedc-4381-adf1-4ed1ca0ffa8e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:14.159522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0282-eedc-4381-adf1-4ed1ca0ffa8e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:14.159952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0282-eedc-4381-adf1-4ed1ca0ffa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:14.181218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f43a0282-eedc-4381-adf1-4ed1ca0ffa8e None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:14.182407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f43a0282-eedc-4381-adf1-4ed1ca0ffa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:14.260141 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1093/2188] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 20:51:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:14.270409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:14.273021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:14.385381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be858-50b6-47db-9a0a-14aef8a8126b service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:14.392866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:14.393774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:14.394260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:14.394729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:14.405094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:14.407033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:14.435588 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1096/2189] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:51:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:14.514655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0282-eedc-4381-adf1-4ed1ca0ffa8e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:14.625613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0282-eedc-4381-adf1-4ed1ca0ffa8e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:14.640163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:14.641242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:14.641532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:14.641884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] PATH_INFO: `/v3/users/a42a4b77b78746e38a063ded0982eea8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:14.643539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42a4b77b78746e38a063ded0982eea8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:14.646356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:14.699498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:14.701587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:14.724999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd498703-2124-4eb5-b7d0-6d1f3a1fb16e service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:14.731766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:14.734003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:14.734569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:14.735043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] PATH_INFO: `/v3/users/bfad2c65daed40e38992dfc781535f97` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:14.736700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfad2c65daed40e38992dfc781535f97)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:14.737415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42a4b77b78746e38a063ded0982eea8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.738652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42a4b77b78746e38a063ded0982eea8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.738991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:14.739284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42a4b77b78746e38a063ded0982eea8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.759566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42a4b77b78746e38a063ded0982eea8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.775231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1c7713c-8dcd-4a12-afc9-5c3e67c4694d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42a4b77b78746e38a063ded0982eea8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.799635 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1094/2190] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:14 2022] DELETE /identity/v3/users/a42a4b77b78746e38a063ded0982eea8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:14.805713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb7d5-e3a6-498f-abd1-6399b7111b06 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:14.806010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb7d5-e3a6-498f-abd1-6399b7111b06 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:14.806290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb7d5-e3a6-498f-abd1-6399b7111b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:14.813871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfad2c65daed40e38992dfc781535f97'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.829713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfad2c65daed40e38992dfc781535f97'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.835532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4a4bb7d5-e3a6-498f-abd1-6399b7111b06 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:14.837355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4a4bb7d5-e3a6-498f-abd1-6399b7111b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:14.840281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfad2c65daed40e38992dfc781535f97'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.841739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfad2c65daed40e38992dfc781535f97'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.843895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6823108a-da07-40e2-808b-a60b74bfb497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfad2c65daed40e38992dfc781535f97'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:14.866239 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1097/2191] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:14 2022] DELETE /identity/v3/users/bfad2c65daed40e38992dfc781535f97 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:14.871476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7c41-3eb3-4895-b000-c9504267710b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:14.871777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7c41-3eb3-4895-b000-c9504267710b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:14.872742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7c41-3eb3-4895-b000-c9504267710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:14.932127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0adf7c41-3eb3-4895-b000-c9504267710b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:14.936234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0adf7c41-3eb3-4895-b000-c9504267710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:14.949762 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1095/2192] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:14.966706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb7d5-e3a6-498f-abd1-6399b7111b06 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:14.968942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4a4bb7d5-e3a6-498f-abd1-6399b7111b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:15.055325 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1098/2193] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:15.061747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf7c41-3eb3-4895-b000-c9504267710b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:15.066280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0adf7c41-3eb3-4895-b000-c9504267710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:15.079150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb7d5-e3a6-498f-abd1-6399b7111b06 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:15.151295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:15.152732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:15.153079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:15.153421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:15.159381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf7c41-3eb3-4895-b000-c9504267710b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:15.163822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:15.164529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:15.164816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:15.165095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:15.168091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:15.170257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:15.176862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:15.179229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:15.183790 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1096/2194] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:51:15.190576 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1099/2195] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:15.388972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:15.390417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:15.411953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058df8-a9e6-4241-9758-1a9052cf929a service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:15.419019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:15.422698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:15.423227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:15.424699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] PATH_INFO: `/v3/users/4feed6ce10b0486ba36ab6ba6ca0ad5e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:15.427534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4feed6ce10b0486ba36ab6ba6ca0ad5e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:15.432820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:15.529513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4feed6ce10b0486ba36ab6ba6ca0ad5e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.530421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4feed6ce10b0486ba36ab6ba6ca0ad5e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.531236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4feed6ce10b0486ba36ab6ba6ca0ad5e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.552969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4feed6ce10b0486ba36ab6ba6ca0ad5e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.561401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:15.563206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:15.564480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c43de3cd-b8b1-4e6b-b622-47812305ff18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4feed6ce10b0486ba36ab6ba6ca0ad5e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.578402 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1097/2196] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:15 2022] DELETE /identity/v3/users/4feed6ce10b0486ba36ab6ba6ca0ad5e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:15.583028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755f84-828f-420e-bc45-85804361960c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:15.583505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755f84-828f-420e-bc45-85804361960c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:15.583787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755f84-828f-420e-bc45-85804361960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:15.589143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9efa3-5307-4b44-8482-ba9a7ad49221 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:15.603765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6d755f84-828f-420e-bc45-85804361960c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:15.605297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6d755f84-828f-420e-bc45-85804361960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:15.696927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:15.697926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:15.698220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:15.698574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] PATH_INFO: `/v3/users/a3685521a15b40c3a032b34a430be90f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:15.700053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3685521a15b40c3a032b34a430be90f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:15.702202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:15.742244 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1098/2197] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:15.744432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755f84-828f-420e-bc45-85804361960c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:15.750410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6d755f84-828f-420e-bc45-85804361960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:15.769531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755f84-828f-420e-bc45-85804361960c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:15.776932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:15.776932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:15.776932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:15.777307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] PATH_INFO: `/v3/projects/0d8cbd690acb4a33ab73d43b201600b3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:15.778558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8cbd690acb4a33ab73d43b201600b3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:15.780708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:15.841206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8cbd690acb4a33ab73d43b201600b3', 'request_id': 'req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.845777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3685521a15b40c3a032b34a430be90f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.849602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8cbd690acb4a33ab73d43b201600b3', 'request_id': 'req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.860928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8cbd690acb4a33ab73d43b201600b3', 'request_id': 'req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.865368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3685521a15b40c3a032b34a430be90f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.874142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3685521a15b40c3a032b34a430be90f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.874758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3685521a15b40c3a032b34a430be90f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.875376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3685521a15b40c3a032b34a430be90f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.875519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] The token cache is being invalidate because project 0d8cbd690acb4a33ab73d43b201600b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:15.875810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.876990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:15.878632 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1099/2198] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:15 2022] DELETE /identity/v3/projects/0d8cbd690acb4a33ab73d43b201600b3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:15.879373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:15.880696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:15.901647 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1100/2199] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:15 2022] DELETE /identity/v3/users/a3685521a15b40c3a032b34a430be90f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:15.902356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:15.903648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:15.956608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd00c80-9e3a-44e3-ab9a-5612147d5eec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:15.968899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8225d-ea3f-4e9e-a670-eece76ba47ad admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:15.972817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:15.973459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:15.973741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:15.974143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:15.977043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.020300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.021201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.021482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.021756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] PATH_INFO: `/v3/projects/2aca5c599959431ea7c78faa2f7abab2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.023011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aca5c599959431ea7c78faa2f7abab2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.024968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.058173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.059645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.071623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1101/2200] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:16.072841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.074646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.091059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aca5c599959431ea7c78faa2f7abab2', 'request_id': 'req-39a1494c-06d6-402c-853c-f7668d69b3c7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.093605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5875d69-3938-444a-9f9c-05cb0cd79a8a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.101847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aca5c599959431ea7c78faa2f7abab2', 'request_id': 'req-39a1494c-06d6-402c-853c-f7668d69b3c7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.114038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aca5c599959431ea7c78faa2f7abab2', 'request_id': 'req-39a1494c-06d6-402c-853c-f7668d69b3c7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.131800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] The token cache is being invalidate because project 2aca5c599959431ea7c78faa2f7abab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:16.132503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.133244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39a1494c-06d6-402c-853c-f7668d69b3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.135538 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1100/2201] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:15 2022] DELETE /identity/v3/projects/2aca5c599959431ea7c78faa2f7abab2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:16.138319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea21f1-1eee-42e4-a66d-bea62982b74d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.139283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea21f1-1eee-42e4-a66d-bea62982b74d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.139642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea21f1-1eee-42e4-a66d-bea62982b74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.158321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c6ea21f1-1eee-42e4-a66d-bea62982b74d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:16.159644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c6ea21f1-1eee-42e4-a66d-bea62982b74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.165863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.166866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.167158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.167477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] PATH_INFO: `/v3/users/d7ea27881e904fa59ce1c83f5c25d541` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.168761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ea27881e904fa59ce1c83f5c25d541)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.170783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.222703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ea27881e904fa59ce1c83f5c25d541'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.236582 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1101/2202] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:16.237162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ea27881e904fa59ce1c83f5c25d541'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.242451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c777-16ef-4ecf-bf63-d4c5ae0c377f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.242909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c777-16ef-4ecf-bf63-d4c5ae0c377f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.243378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c777-16ef-4ecf-bf63-d4c5ae0c377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.248301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ea27881e904fa59ce1c83f5c25d541'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.252806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ea27881e904fa59ce1c83f5c25d541'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.254112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ea27881e904fa59ce1c83f5c25d541'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.267915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8b83c777-16ef-4ecf-bf63-d4c5ae0c377f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:16.272537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8b83c777-16ef-4ecf-bf63-d4c5ae0c377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.277711 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1102/2203] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:16 2022] DELETE /identity/v3/users/d7ea27881e904fa59ce1c83f5c25d541 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:16.281272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.283322 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1102/2204] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:16.283886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c777-16ef-4ecf-bf63-d4c5ae0c377f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.285805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.287444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8b83c777-16ef-4ecf-bf63-d4c5ae0c377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.300870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c777-16ef-4ecf-bf63-d4c5ae0c377f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.367079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.368069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3764c5-d62d-4e28-ab01-03510879e90c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.368208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.368502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.368777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] PATH_INFO: `/v3/projects/e98c9c5247b943a895bd53603a38d851` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.369973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98c9c5247b943a895bd53603a38d851)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.371917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.373453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61665d37-6a45-401f-9cff-5b94817590c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.374091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61665d37-6a45-401f-9cff-5b94817590c0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.374429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61665d37-6a45-401f-9cff-5b94817590c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.374948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61665d37-6a45-401f-9cff-5b94817590c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.377224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-61665d37-6a45-401f-9cff-5b94817590c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.393768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61665d37-6a45-401f-9cff-5b94817590c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.395411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61665d37-6a45-401f-9cff-5b94817590c0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.407541 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1103/2205] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:16.408935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59008923-6e01-4171-9e99-25d029663766 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.409226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59008923-6e01-4171-9e99-25d029663766 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.409548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59008923-6e01-4171-9e99-25d029663766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.438139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-59008923-6e01-4171-9e99-25d029663766 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:16.439701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-59008923-6e01-4171-9e99-25d029663766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.450438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98c9c5247b943a895bd53603a38d851', 'request_id': 'req-4f257802-767d-4fbd-8e2d-d9643bedef8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.460560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98c9c5247b943a895bd53603a38d851', 'request_id': 'req-4f257802-767d-4fbd-8e2d-d9643bedef8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.477937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98c9c5247b943a895bd53603a38d851', 'request_id': 'req-4f257802-767d-4fbd-8e2d-d9643bedef8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.494961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] The token cache is being invalidate because project e98c9c5247b943a895bd53603a38d851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:16.495463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.496184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.498286 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1103/2206] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:16 2022] DELETE /identity/v3/projects/e98c9c5247b943a895bd53603a38d851 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:16.502332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.504147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.521557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1104/2207] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:16.526778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59008923-6e01-4171-9e99-25d029663766 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.542929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59008923-6e01-4171-9e99-25d029663766 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.550235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.550862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.551722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.552408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.554056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:16.555019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.570895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.604693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1105/2208] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:16.605689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.608586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257802-767d-4fbd-8e2d-d9643bedef8c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.618018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.620151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.621301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.621684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] PATH_INFO: `/v3/users/7a91a8f460ee4289b30c92cd2562c6d6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.623103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a91a8f460ee4289b30c92cd2562c6d6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.624200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1b24-b81c-471e-929c-9d36a256bfa1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.626199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.630605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10526a-7e27-4cd2-8f61-1286dceee0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.632696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10526a-7e27-4cd2-8f61-1286dceee0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.633829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10526a-7e27-4cd2-8f61-1286dceee0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.633829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10526a-7e27-4cd2-8f61-1286dceee0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.634535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10526a-7e27-4cd2-8f61-1286dceee0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.636641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10526a-7e27-4cd2-8f61-1286dceee0e2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.692674 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1106/2209] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:16 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:16.698881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10526a-7e27-4cd2-8f61-1286dceee0e2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.708303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a91a8f460ee4289b30c92cd2562c6d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.709232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a91a8f460ee4289b30c92cd2562c6d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.709815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a91a8f460ee4289b30c92cd2562c6d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.729547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a91a8f460ee4289b30c92cd2562c6d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.743997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a91a8f460ee4289b30c92cd2562c6d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.769819 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1104/2210] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:16 2022] DELETE /identity/v3/users/7a91a8f460ee4289b30c92cd2562c6d6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:16.772509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.776261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.804307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10526a-7e27-4cd2-8f61-1286dceee0e2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.876259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07512a32-605c-4cca-a608-8492ac4dbe2c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.876998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.877887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.878250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.878606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.879376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.881358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.883494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.884590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.884937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.885278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] PATH_INFO: `/v3/projects/228f5017f5f74fbaa0f3b36b89acf4ee` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.886542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=228f5017f5f74fbaa0f3b36b89acf4ee)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.888631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.914606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1107/2211] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:16 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:16.920444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:16.926828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:16.951231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73fc8-ba2a-4b6a-ac7e-1181bb488e71 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:16.961070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:16.965942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:16.966232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:16.966512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] PATH_INFO: `/v3/projects/f4ffc4c10ab64eabb1654e3e90ca8059` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:16.970322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ffc4c10ab64eabb1654e3e90ca8059)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:16.972281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:16.987839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228f5017f5f74fbaa0f3b36b89acf4ee', 'request_id': 'req-14b2963b-9590-41fe-8912-cfafb8482ebd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:16.994750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228f5017f5f74fbaa0f3b36b89acf4ee', 'request_id': 'req-14b2963b-9590-41fe-8912-cfafb8482ebd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.025005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228f5017f5f74fbaa0f3b36b89acf4ee', 'request_id': 'req-14b2963b-9590-41fe-8912-cfafb8482ebd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.037477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] The token cache is being invalidate because project 228f5017f5f74fbaa0f3b36b89acf4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:17.037813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.038783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.040580 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1105/2212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:16 2022] DELETE /identity/v3/projects/228f5017f5f74fbaa0f3b36b89acf4ee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:17.043531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.043531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.062548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ffc4c10ab64eabb1654e3e90ca8059', 'request_id': 'req-8dd8d412-4a16-4244-bd76-54728984567e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.082912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ffc4c10ab64eabb1654e3e90ca8059', 'request_id': 'req-8dd8d412-4a16-4244-bd76-54728984567e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.115625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ffc4c10ab64eabb1654e3e90ca8059', 'request_id': 'req-8dd8d412-4a16-4244-bd76-54728984567e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.139771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] The token cache is being invalidate because project f4ffc4c10ab64eabb1654e3e90ca8059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:17.140777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.141782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.144888 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1108/2213] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:16 2022] DELETE /identity/v3/projects/f4ffc4c10ab64eabb1654e3e90ca8059 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:17.146173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.154902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.197128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2963b-9590-41fe-8912-cfafb8482ebd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.291369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d412-4a16-4244-bd76-54728984567e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.294513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fea82-9b24-4ebc-be06-4b03678c3b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.295285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fea82-9b24-4ebc-be06-4b03678c3b6b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.295645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fea82-9b24-4ebc-be06-4b03678c3b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.295996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fea82-9b24-4ebc-be06-4b03678c3b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.297071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fea82-9b24-4ebc-be06-4b03678c3b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.299363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fea82-9b24-4ebc-be06-4b03678c3b6b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.303132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.304246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.304706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.305498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] PATH_INFO: `/v3/users/005603b8db46466fa1d03266ba805226` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.306415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=005603b8db46466fa1d03266ba805226)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.308782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.310756 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1106/2214] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:17.311914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918515-8111-4929-a969-56470a7e41bf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.312205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918515-8111-4929-a969-56470a7e41bf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.312510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918515-8111-4929-a969-56470a7e41bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.334119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-01918515-8111-4929-a969-56470a7e41bf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:17.335821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-01918515-8111-4929-a969-56470a7e41bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.345880 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1107/2215] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:17.354627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918515-8111-4929-a969-56470a7e41bf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.354627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-01918515-8111-4929-a969-56470a7e41bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.364149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918515-8111-4929-a969-56470a7e41bf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.370811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.371208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005603b8db46466fa1d03266ba805226'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.371663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.371941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.372211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] PATH_INFO: `/v3/projects/f0a7fd8f8d0f4463b2f1cc439aafbbf8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.373526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a7fd8f8d0f4463b2f1cc439aafbbf8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.375323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.385150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005603b8db46466fa1d03266ba805226'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.403293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005603b8db46466fa1d03266ba805226'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.404794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005603b8db46466fa1d03266ba805226'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.405848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005603b8db46466fa1d03266ba805226'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.421258 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1109/2216] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:17 2022] DELETE /identity/v3/users/005603b8db46466fa1d03266ba805226 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:17.425038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.426104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.432991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a7fd8f8d0f4463b2f1cc439aafbbf8', 'request_id': 'req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.441467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a7fd8f8d0f4463b2f1cc439aafbbf8', 'request_id': 'req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.454614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a7fd8f8d0f4463b2f1cc439aafbbf8', 'request_id': 'req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.469289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] The token cache is being invalidate because project f0a7fd8f8d0f4463b2f1cc439aafbbf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:17.469793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.470309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f97cfc60-30e3-4472-b8eb-dbfaf5ff4ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.471977 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1108/2217] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:17 2022] DELETE /identity/v3/projects/f0a7fd8f8d0f4463b2f1cc439aafbbf8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:17.473457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d780a-1199-4592-a9c5-c1edb0045857 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.473746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d780a-1199-4592-a9c5-c1edb0045857 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.474021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d780a-1199-4592-a9c5-c1edb0045857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.494805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-374d780a-1199-4592-a9c5-c1edb0045857 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:17.495955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-374d780a-1199-4592-a9c5-c1edb0045857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.540663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a5568-df05-4283-9e9d-aefa9242ea49 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.547817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029bade-6873-4257-858c-90c6ffcebb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.548192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029bade-6873-4257-858c-90c6ffcebb38 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.548537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029bade-6873-4257-858c-90c6ffcebb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.549110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029bade-6873-4257-858c-90c6ffcebb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.550457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029bade-6873-4257-858c-90c6ffcebb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.552853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029bade-6873-4257-858c-90c6ffcebb38 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.566407 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1109/2218] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:17.566407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d780a-1199-4592-a9c5-c1edb0045857 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.566880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-374d780a-1199-4592-a9c5-c1edb0045857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.569700 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1110/2219] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:17.571223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4847-227f-49cb-a9fb-512cd363c4e6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.571516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4847-227f-49cb-a9fb-512cd363c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.571800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4847-227f-49cb-a9fb-512cd363c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.594461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fefc4847-227f-49cb-a9fb-512cd363c4e6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:17.595774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fefc4847-227f-49cb-a9fb-512cd363c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.606170 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1111/2220] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:17.607066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc4847-227f-49cb-a9fb-512cd363c4e6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.625807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc4847-227f-49cb-a9fb-512cd363c4e6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.633285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.634371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.634873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.635167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.636045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:17.636407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.639091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.662378 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1112/2221] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:17.662378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.662647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d780a-1199-4592-a9c5-c1edb0045857 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.662752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.669970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.670629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.670912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.671198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.674105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.679704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f8ed8-b227-46af-9835-618ab897c962 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.689931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fe336-da3e-4d21-bff5-a8749996cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.691391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fe336-da3e-4d21-bff5-a8749996cda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.692034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fe336-da3e-4d21-bff5-a8749996cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.692659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fe336-da3e-4d21-bff5-a8749996cda9 admin admin] PATH_INFO: `/v3/projects/9809b88a7cf44fba908be3c1736b1f71/users/450a0144db174551aabee6fba0f5aa8d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.721194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fe336-da3e-4d21-bff5-a8749996cda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9809b88a7cf44fba908be3c1736b1f71, user_id=450a0144db174551aabee6fba0f5aa8d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.723905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fe336-da3e-4d21-bff5-a8749996cda9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.739619 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1113/2222] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:17 2022] PUT /identity/v3/projects/9809b88a7cf44fba908be3c1736b1f71/users/450a0144db174551aabee6fba0f5aa8d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:17.741055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250177-4395-4202-acd7-427376dcf67e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.741836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250177-4395-4202-acd7-427376dcf67e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.742116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250177-4395-4202-acd7-427376dcf67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.759945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.760134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a9250177-4395-4202-acd7-427376dcf67e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:17.761328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a9250177-4395-4202-acd7-427376dcf67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.761809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.771688 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1110/2223] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:17.772642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.783279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7f1f5-09c9-4a4c-ae9a-cf8ed696eecc service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.822968 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1114/2224] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:17.823672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250177-4395-4202-acd7-427376dcf67e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.825205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a9250177-4395-4202-acd7-427376dcf67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.839375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250177-4395-4202-acd7-427376dcf67e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:17.844562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.845412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.845888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.846172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] PATH_INFO: `/v3/projects/72323667f1d34f32bbbd2d029de40a05` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.848029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f368b-cc63-4b7c-a2ca-dbb9d4129253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:17.848159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72323667f1d34f32bbbd2d029de40a05)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.848793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f368b-cc63-4b7c-a2ca-dbb9d4129253 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.849225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f368b-cc63-4b7c-a2ca-dbb9d4129253 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.849458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f368b-cc63-4b7c-a2ca-dbb9d4129253 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.851278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f368b-cc63-4b7c-a2ca-dbb9d4129253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:17.851406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.852810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f368b-cc63-4b7c-a2ca-dbb9d4129253 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:17.879112 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1111/2225] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:17 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:17.880751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a761-a0c2-4554-a80f-4f0657bbf88d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:17.881261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a761-a0c2-4554-a80f-4f0657bbf88d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:17.881611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a761-a0c2-4554-a80f-4f0657bbf88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:17.906748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72323667f1d34f32bbbd2d029de40a05', 'request_id': 'req-47fb1bb6-484d-4bda-8c4c-15c686d00319'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.909638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3d87a761-a0c2-4554-a80f-4f0657bbf88d None None] MFA Rules not processed for user `450a0144db174551aabee6fba0f5aa8d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:17.910858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3d87a761-a0c2-4554-a80f-4f0657bbf88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.913843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72323667f1d34f32bbbd2d029de40a05', 'request_id': 'req-47fb1bb6-484d-4bda-8c4c-15c686d00319'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.921881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72323667f1d34f32bbbd2d029de40a05', 'request_id': 'req-47fb1bb6-484d-4bda-8c4c-15c686d00319'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.936675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] The token cache is being invalidate because project 72323667f1d34f32bbbd2d029de40a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:17.937367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.938125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:17.939858 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1115/2226] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:17 2022] DELETE /identity/v3/projects/72323667f1d34f32bbbd2d029de40a05 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:17.940671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.941970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:17.993317 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1112/2227] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:17.994162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87a761-a0c2-4554-a80f-4f0657bbf88d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:17.996008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3d87a761-a0c2-4554-a80f-4f0657bbf88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:18.018090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1bb6-484d-4bda-8c4c-15c686d00319 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.029903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7a5e0-26b7-4cd4-a882-85273711b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.031206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7a5e0-26b7-4cd4-a882-85273711b81c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.031493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7a5e0-26b7-4cd4-a882-85273711b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.031767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7a5e0-26b7-4cd4-a882-85273711b81c admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.032978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7a5e0-26b7-4cd4-a882-85273711b81c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:18.033292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7a5e0-26b7-4cd4-a882-85273711b81c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.035227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7a5e0-26b7-4cd4-a882-85273711b81c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.078748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87a761-a0c2-4554-a80f-4f0657bbf88d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.082640 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1116/2228] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:18.084495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20c31d-0b1f-467c-b5e2-3e2f2a9864e7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.085528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20c31d-0b1f-467c-b5e2-3e2f2a9864e7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.085993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20c31d-0b1f-467c-b5e2-3e2f2a9864e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.088858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a697-5ce7-4b6c-8ef9-06cd41bf8af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.089620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a697-5ce7-4b6c-8ef9-06cd41bf8af5 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.089930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a697-5ce7-4b6c-8ef9-06cd41bf8af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.090393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a697-5ce7-4b6c-8ef9-06cd41bf8af5 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.091159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952a697-5ce7-4b6c-8ef9-06cd41bf8af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.093303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952a697-5ce7-4b6c-8ef9-06cd41bf8af5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.110887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8d20c31d-0b1f-467c-b5e2-3e2f2a9864e7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:18.112193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8d20c31d-0b1f-467c-b5e2-3e2f2a9864e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:18.120430 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1117/2229] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:18.121732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79870f0-b8a9-4f68-8844-5788fd6f23f4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.122291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79870f0-b8a9-4f68-8844-5788fd6f23f4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.122400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79870f0-b8a9-4f68-8844-5788fd6f23f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.127419 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1113/2230] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:17 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:18.127419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a697-5ce7-4b6c-8ef9-06cd41bf8af5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.138737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a697-5ce7-4b6c-8ef9-06cd41bf8af5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.149399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f79870f0-b8a9-4f68-8844-5788fd6f23f4 None None] MFA Rules not processed for user `450a0144db174551aabee6fba0f5aa8d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:18.149875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.150723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f79870f0-b8a9-4f68-8844-5788fd6f23f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:18.151356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.152093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.153192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.154077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.157359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.158380 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1118/2231] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:18.159821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed0f9c-098b-4fd1-bf7a-82143ce6833d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.160217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed0f9c-098b-4fd1-bf7a-82143ce6833d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.160591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed0f9c-098b-4fd1-bf7a-82143ce6833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.187477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-94ed0f9c-098b-4fd1-bf7a-82143ce6833d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:18.188888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-94ed0f9c-098b-4fd1-bf7a-82143ce6833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:18.204383 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1119/2232] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:18.206388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed0f9c-098b-4fd1-bf7a-82143ce6833d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.210914 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1114/2233] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/projects => generated 393 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:18.211749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.214026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:18.217253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed0f9c-098b-4fd1-bf7a-82143ce6833d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.286041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ff349-e21b-425b-9c38-ac5c0279846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.286712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff349-e21b-425b-9c38-ac5c0279846b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.286999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff349-e21b-425b-9c38-ac5c0279846b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.287268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff349-e21b-425b-9c38-ac5c0279846b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.288648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ff349-e21b-425b-9c38-ac5c0279846b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.290227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ff349-e21b-425b-9c38-ac5c0279846b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.298571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00ab17-dc1c-48ad-a529-32d7cd9f417b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.300780 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1120/2234] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:18.302723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c539-8886-4ab2-8d1c-19462b94becd None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.302723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c539-8886-4ab2-8d1c-19462b94becd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.303006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c539-8886-4ab2-8d1c-19462b94becd None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.305326 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1121/2235] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:18.311020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c539-8886-4ab2-8d1c-19462b94becd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.312463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b4c9-b504-4930-9cfe-d7a8c5f4abcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.313321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b4c9-b504-4930-9cfe-d7a8c5f4abcb service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.313759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b4c9-b504-4930-9cfe-d7a8c5f4abcb service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.314042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b4c9-b504-4930-9cfe-d7a8c5f4abcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.325054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c539-8886-4ab2-8d1c-19462b94becd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.330808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.331682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.332078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.332385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.332995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:18.333303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.335054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.356850 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1122/2236] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:18.357677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.368115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100d7ab-3f3f-44b6-9905-486037342c48 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.373092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249d49b-cae6-4cb2-8708-80e37d95729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.373747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249d49b-cae6-4cb2-8708-80e37d95729b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.374031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249d49b-cae6-4cb2-8708-80e37d95729b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.374304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249d49b-cae6-4cb2-8708-80e37d95729b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.374993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249d49b-cae6-4cb2-8708-80e37d95729b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.376995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249d49b-cae6-4cb2-8708-80e37d95729b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.378576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32b4c9-b504-4930-9cfe-d7a8c5f4abcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.380740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32b4c9-b504-4930-9cfe-d7a8c5f4abcb service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.391082 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1115/2237] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:18.392071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b4c9-b504-4930-9cfe-d7a8c5f4abcb service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.402591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b4c9-b504-4930-9cfe-d7a8c5f4abcb service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.407036 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1123/2238] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:18.407036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42208a2-6b2a-47a2-890b-1dcd744bf4c4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.407036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42208a2-6b2a-47a2-890b-1dcd744bf4c4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.407036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42208a2-6b2a-47a2-890b-1dcd744bf4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.407952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215b502-606a-4f83-a011-9dfdc73a492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.408749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215b502-606a-4f83-a011-9dfdc73a492c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.409137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215b502-606a-4f83-a011-9dfdc73a492c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.409513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215b502-606a-4f83-a011-9dfdc73a492c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.410991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215b502-606a-4f83-a011-9dfdc73a492c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.412050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215b502-606a-4f83-a011-9dfdc73a492c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.429131 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1116/2239] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:18.431173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215b502-606a-4f83-a011-9dfdc73a492c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.443500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215b502-606a-4f83-a011-9dfdc73a492c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.450532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341140e-4372-4394-aa15-f5171e92ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.451210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341140e-4372-4394-aa15-f5171e92ea47 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.451497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341140e-4372-4394-aa15-f5171e92ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.451773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341140e-4372-4394-aa15-f5171e92ea47 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.452507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341140e-4372-4394-aa15-f5171e92ea47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.461543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341140e-4372-4394-aa15-f5171e92ea47 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.483267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e42208a2-6b2a-47a2-890b-1dcd744bf4c4 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:18.484642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e42208a2-6b2a-47a2-890b-1dcd744bf4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:18.502272 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1117/2240] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:18.503697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341140e-4372-4394-aa15-f5171e92ea47 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.584833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341140e-4372-4394-aa15-f5171e92ea47 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.590296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051b99c-d6c1-407c-908d-e04155241754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.591110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051b99c-d6c1-407c-908d-e04155241754 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.591494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051b99c-d6c1-407c-908d-e04155241754 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.591868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051b99c-d6c1-407c-908d-e04155241754 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.592745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051b99c-d6c1-407c-908d-e04155241754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.594846 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1124/2241] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:18.594976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051b99c-d6c1-407c-908d-e04155241754 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.595750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42208a2-6b2a-47a2-890b-1dcd744bf4c4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.608291 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1118/2242] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:18.609255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42208a2-6b2a-47a2-890b-1dcd744bf4c4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.609537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051b99c-d6c1-407c-908d-e04155241754 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.614764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296ba11-6e16-4f60-96bb-7a13a17a9f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.616641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296ba11-6e16-4f60-96bb-7a13a17a9f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.616914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296ba11-6e16-4f60-96bb-7a13a17a9f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.617183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296ba11-6e16-4f60-96bb-7a13a17a9f09 admin admin] PATH_INFO: `/v3/projects/4c5ed6b00f824da68e0c90aca52baab0/users/d74baac0e77a47bd989e1b89a5c589f6/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.622730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051b99c-d6c1-407c-908d-e04155241754 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.627099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.628071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.628492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.628874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.629763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.632516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.637181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296ba11-6e16-4f60-96bb-7a13a17a9f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5ed6b00f824da68e0c90aca52baab0, user_id=d74baac0e77a47bd989e1b89a5c589f6, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.639912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296ba11-6e16-4f60-96bb-7a13a17a9f09 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.656263 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1125/2243] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:18 2022] PUT /identity/v3/projects/4c5ed6b00f824da68e0c90aca52baab0/users/d74baac0e77a47bd989e1b89a5c589f6/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:18.657041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296ba11-6e16-4f60-96bb-7a13a17a9f09 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.665504 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1119/2244] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/users => generated 291 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:18.667846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.670553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:18.724698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296ba11-6e16-4f60-96bb-7a13a17a9f09 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.730011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0f31e-522f-45cd-baab-185f4e4f44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.730577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f31e-522f-45cd-baab-185f4e4f44fd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.730859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f31e-522f-45cd-baab-185f4e4f44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.731135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f31e-522f-45cd-baab-185f4e4f44fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.731870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0f31e-522f-45cd-baab-185f4e4f44fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.733507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0f31e-522f-45cd-baab-185f4e4f44fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.746579 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1126/2245] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:18.748698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068680-ac37-4d85-80aa-06c2453baa12 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.748985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068680-ac37-4d85-80aa-06c2453baa12 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.749411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068680-ac37-4d85-80aa-06c2453baa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.759711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89c6e0-c872-46cb-b107-7b95e0e054f8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.778642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d8068680-ac37-4d85-80aa-06c2453baa12 None None] MFA Rules not processed for user `d74baac0e77a47bd989e1b89a5c589f6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:18.779980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d8068680-ac37-4d85-80aa-06c2453baa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:18.823880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7f2d-09f6-465b-9d64-4d76d0e194b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.824592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7f2d-09f6-465b-9d64-4d76d0e194b0 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.824870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7f2d-09f6-465b-9d64-4d76d0e194b0 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.825142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7f2d-09f6-465b-9d64-4d76d0e194b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.834299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf7f2d-09f6-465b-9d64-4d76d0e194b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.837224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf7f2d-09f6-465b-9d64-4d76d0e194b0 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.847845 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1120/2246] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:18.848778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7f2d-09f6-465b-9d64-4d76d0e194b0 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.860850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7f2d-09f6-465b-9d64-4d76d0e194b0 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.866610 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1127/2247] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:18.867072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb17d0-9088-47db-a76e-cef3ec6ee1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.867499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb17d0-9088-47db-a76e-cef3ec6ee1dd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.867875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb17d0-9088-47db-a76e-cef3ec6ee1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.868154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb17d0-9088-47db-a76e-cef3ec6ee1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.868843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068680-ac37-4d85-80aa-06c2453baa12 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.868953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb17d0-9088-47db-a76e-cef3ec6ee1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.870651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb17d0-9088-47db-a76e-cef3ec6ee1dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.879882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068680-ac37-4d85-80aa-06c2453baa12 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.885732 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1121/2248] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:18.885732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb17d0-9088-47db-a76e-cef3ec6ee1dd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.895559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb17d0-9088-47db-a76e-cef3ec6ee1dd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:18.899813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57c8a-7a61-470e-9833-a14c98ae3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.900886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57c8a-7a61-470e-9833-a14c98ae3ace admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.901179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57c8a-7a61-470e-9833-a14c98ae3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.901355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2a72-fe2e-4094-b228-c5da23c50f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:18.901486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d57c8a-7a61-470e-9833-a14c98ae3ace admin admin] PATH_INFO: `/v3/projects/c0499eef3d6b4022a79cbf5f97f13a1a/users/8721e88313a9416cb755fa1e964c1559/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.901985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2a72-fe2e-4094-b228-c5da23c50f19 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:18.902266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2a72-fe2e-4094-b228-c5da23c50f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:18.902670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2a72-fe2e-4094-b228-c5da23c50f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:18.903364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e2a72-fe2e-4094-b228-c5da23c50f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.905319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e2a72-fe2e-4094-b228-c5da23c50f19 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.931211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d57c8a-7a61-470e-9833-a14c98ae3ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0499eef3d6b4022a79cbf5f97f13a1a, user_id=8721e88313a9416cb755fa1e964c1559, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:18.934655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d57c8a-7a61-470e-9833-a14c98ae3ace admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:18.943041 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1122/2249] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:18.944741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2a72-fe2e-4094-b228-c5da23c50f19 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:18.957576 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1128/2250] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:18 2022] PUT /identity/v3/projects/c0499eef3d6b4022a79cbf5f97f13a1a/users/8721e88313a9416cb755fa1e964c1559/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:18.958183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57c8a-7a61-470e-9833-a14c98ae3ace admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.013935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2a72-fe2e-4094-b228-c5da23c50f19 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.081891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1615ad-9fd6-44f7-a06e-e02096a54417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.082885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1615ad-9fd6-44f7-a06e-e02096a54417 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.083406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1615ad-9fd6-44f7-a06e-e02096a54417 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.083887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1615ad-9fd6-44f7-a06e-e02096a54417 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.085461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1615ad-9fd6-44f7-a06e-e02096a54417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.087628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1615ad-9fd6-44f7-a06e-e02096a54417 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.098187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d57c8a-7a61-470e-9833-a14c98ae3ace admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.105643 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1123/2251] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:19.105882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93b355-c27f-4251-9d86-d43d69e31b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.105882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b355-c27f-4251-9d86-d43d69e31b57 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.105882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b355-c27f-4251-9d86-d43d69e31b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.105882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b355-c27f-4251-9d86-d43d69e31b57 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.106224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93b355-c27f-4251-9d86-d43d69e31b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.108090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93b355-c27f-4251-9d86-d43d69e31b57 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.120361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fae3c-d9c6-486a-9542-cf83971c559e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.122273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fae3c-d9c6-486a-9542-cf83971c559e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.122273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fae3c-d9c6-486a-9542-cf83971c559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.146950 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1129/2252] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:18 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:19.148786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93b355-c27f-4251-9d86-d43d69e31b57 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.170842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93b355-c27f-4251-9d86-d43d69e31b57 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.184471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb125428-288e-48fb-9279-ca474fa5682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.185679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125428-288e-48fb-9279-ca474fa5682f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.186034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125428-288e-48fb-9279-ca474fa5682f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.186399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125428-288e-48fb-9279-ca474fa5682f admin admin] PATH_INFO: `/v3/projects/4da0ab764b964ecaaa21aedc12cec072/users/036491af05b34651a70c9090d2fecd72/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.220228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-861fae3c-d9c6-486a-9542-cf83971c559e None None] MFA Rules not processed for user `8721e88313a9416cb755fa1e964c1559`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:19.222853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-861fae3c-d9c6-486a-9542-cf83971c559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:19.244258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb125428-288e-48fb-9279-ca474fa5682f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da0ab764b964ecaaa21aedc12cec072, user_id=036491af05b34651a70c9090d2fecd72, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.248109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb125428-288e-48fb-9279-ca474fa5682f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.276135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1130/2253] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:19 2022] PUT /identity/v3/projects/4da0ab764b964ecaaa21aedc12cec072/users/036491af05b34651a70c9090d2fecd72/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:19.276135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb125428-288e-48fb-9279-ca474fa5682f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.344463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1124/2254] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:19.344463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c8fea-9f32-4800-aa0f-bd23f76ff3a5 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.344463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c8fea-9f32-4800-aa0f-bd23f76ff3a5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.345102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c8fea-9f32-4800-aa0f-bd23f76ff3a5 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.347767 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1125/2255] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:51:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:19.351932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf436f-d853-4d88-8189-2f8edd5417a8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.352230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf436f-d853-4d88-8189-2f8edd5417a8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.352532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf436f-d853-4d88-8189-2f8edd5417a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.360181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb125428-288e-48fb-9279-ca474fa5682f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.366381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c611f-24c6-4af6-b375-07f3763b235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.367123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c611f-24c6-4af6-b375-07f3763b235c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.367480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c611f-24c6-4af6-b375-07f3763b235c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.367827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c611f-24c6-4af6-b375-07f3763b235c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.368851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c611f-24c6-4af6-b375-07f3763b235c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.380813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c611f-24c6-4af6-b375-07f3763b235c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.393724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bcbf436f-d853-4d88-8189-2f8edd5417a8 None None] MFA Rules not processed for user `036491af05b34651a70c9090d2fecd72`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:19.394844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bcbf436f-d853-4d88-8189-2f8edd5417a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:19.396293 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1131/2256] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:19.398037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c611f-24c6-4af6-b375-07f3763b235c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.408459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c611f-24c6-4af6-b375-07f3763b235c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.415079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a518e1f-6a17-472c-b266-798e429cf27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.415852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518e1f-6a17-472c-b266-798e429cf27d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.416203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518e1f-6a17-472c-b266-798e429cf27d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.416724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518e1f-6a17-472c-b266-798e429cf27d admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.417601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a518e1f-6a17-472c-b266-798e429cf27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.419768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a518e1f-6a17-472c-b266-798e429cf27d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.454791 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1132/2257] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:19 2022] POST /identity/v3/projects => generated 395 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:19.456200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfdff4-8908-43fa-9086-d24953a55b2d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.456585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfdff4-8908-43fa-9086-d24953a55b2d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.456992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfdff4-8908-43fa-9086-d24953a55b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.498504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-11cfdff4-8908-43fa-9086-d24953a55b2d None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:19.500052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-11cfdff4-8908-43fa-9086-d24953a55b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:19.504751 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1126/2258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:19.505642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf436f-d853-4d88-8189-2f8edd5417a8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.522657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf436f-d853-4d88-8189-2f8edd5417a8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.581748 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1133/2259] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:51:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:19.582790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfdff4-8908-43fa-9086-d24953a55b2d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.644494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.654871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.654871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.654871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] PATH_INFO: `/v3/projects/1f241ce9ca55475f95b3180d4ce15130/users/194b60d2f87948c593bb4f33e57844ce/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.677714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfdff4-8908-43fa-9086-d24953a55b2d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.684871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.685736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.686026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.686353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.687491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.690323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.700409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f241ce9ca55475f95b3180d4ce15130, user_id=194b60d2f87948c593bb4f33e57844ce, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.701984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.743952 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1127/2261] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:19 2022] PUT /identity/v3/projects/1f241ce9ca55475f95b3180d4ce15130/users/194b60d2f87948c593bb4f33e57844ce/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:19.744042 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1134/2261] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:19 2022] POST /identity/v3/users => generated 304 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:19.744118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.744189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.746626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:19.747689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:19.772750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fbf83-f2e2-4610-bf0b-621bd3908eda admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.859018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51166b-def5-4b1b-9bec-bb41d614db2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.859738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51166b-def5-4b1b-9bec-bb41d614db2d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.860025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51166b-def5-4b1b-9bec-bb41d614db2d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.860603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51166b-def5-4b1b-9bec-bb41d614db2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.870027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51166b-def5-4b1b-9bec-bb41d614db2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.872130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51166b-def5-4b1b-9bec-bb41d614db2d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.883724 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1135/2262] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:19.884978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51166b-def5-4b1b-9bec-bb41d614db2d service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:19.899953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998006b-1c54-4c88-bdfb-56f9e576081e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.905674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bd252-5220-44ef-9da3-3ede89b8f599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.907165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd252-5220-44ef-9da3-3ede89b8f599 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.907572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd252-5220-44ef-9da3-3ede89b8f599 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.908032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd252-5220-44ef-9da3-3ede89b8f599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.968158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51166b-def5-4b1b-9bec-bb41d614db2d service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:19.973954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd76e28-9298-4ba1-9da1-c210e002dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:19.974635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76e28-9298-4ba1-9da1-c210e002dfbe admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:19.974915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76e28-9298-4ba1-9da1-c210e002dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:19.975193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76e28-9298-4ba1-9da1-c210e002dfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:19.975948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd76e28-9298-4ba1-9da1-c210e002dfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:19.977588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd76e28-9298-4ba1-9da1-c210e002dfbe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:19.989319 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1136/2263] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:19.990474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd76e28-9298-4ba1-9da1-c210e002dfbe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.001060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd76e28-9298-4ba1-9da1-c210e002dfbe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.007442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad2a8a-fdf9-4ad8-bd4a-88680a91eb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.008296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad2a8a-fdf9-4ad8-bd4a-88680a91eb67 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.008612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad2a8a-fdf9-4ad8-bd4a-88680a91eb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.008889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad2a8a-fdf9-4ad8-bd4a-88680a91eb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.009768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad2a8a-fdf9-4ad8-bd4a-88680a91eb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.011615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad2a8a-fdf9-4ad8-bd4a-88680a91eb67 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.025342 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1137/2264] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:20.028566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad2a8a-fdf9-4ad8-bd4a-88680a91eb67 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.037919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad2a8a-fdf9-4ad8-bd4a-88680a91eb67 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.045205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec1797-6291-4b19-897d-40780088fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.046261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1797-6291-4b19-897d-40780088fed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.046803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1797-6291-4b19-897d-40780088fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.046803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1797-6291-4b19-897d-40780088fed5 admin admin] PATH_INFO: `/v3/projects/2fc6059ecbd84a9f94ea2aaf1eb8f8d6/users/18f94ea07771442bafb9619f6d6c6462/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.066231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec1797-6291-4b19-897d-40780088fed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc6059ecbd84a9f94ea2aaf1eb8f8d6, user_id=18f94ea07771442bafb9619f6d6c6462, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.069618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec1797-6291-4b19-897d-40780088fed5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.093765 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1138/2265] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:20 2022] PUT /identity/v3/projects/2fc6059ecbd84a9f94ea2aaf1eb8f8d6/users/18f94ea07771442bafb9619f6d6c6462/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:20.094741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec1797-6291-4b19-897d-40780088fed5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.171181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bd252-5220-44ef-9da3-3ede89b8f599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.172876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bd252-5220-44ef-9da3-3ede89b8f599 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.193682 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1128/2266] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:20.196439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bd252-5220-44ef-9da3-3ede89b8f599 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.209339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bd252-5220-44ef-9da3-3ede89b8f599 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.215429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447e41-c8c9-41fe-997f-da1c1fa123cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.216113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447e41-c8c9-41fe-997f-da1c1fa123cc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.216427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447e41-c8c9-41fe-997f-da1c1fa123cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.216708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447e41-c8c9-41fe-997f-da1c1fa123cc admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.217521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447e41-c8c9-41fe-997f-da1c1fa123cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.217792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec1797-6291-4b19-897d-40780088fed5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.219205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447e41-c8c9-41fe-997f-da1c1fa123cc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.224042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b40254-baae-4d1a-9848-70c76c3f9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.224972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40254-baae-4d1a-9848-70c76c3f9b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.225280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40254-baae-4d1a-9848-70c76c3f9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.226211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40254-baae-4d1a-9848-70c76c3f9b96 admin admin] PATH_INFO: `/v3/projects/1f241ce9ca55475f95b3180d4ce15130/users/194b60d2f87948c593bb4f33e57844ce/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.228745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b40254-baae-4d1a-9848-70c76c3f9b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f241ce9ca55475f95b3180d4ce15130, user_id=194b60d2f87948c593bb4f33e57844ce, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.232078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b40254-baae-4d1a-9848-70c76c3f9b96 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.237859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1129/2267] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:20.238719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447e41-c8c9-41fe-997f-da1c1fa123cc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.244994 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1139/2268] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:20 2022] PUT /identity/v3/projects/1f241ce9ca55475f95b3180d4ce15130/users/194b60d2f87948c593bb4f33e57844ce/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:20.251608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447e41-c8c9-41fe-997f-da1c1fa123cc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.263476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347aaa6-021a-4d4e-9dad-2eceee03ba81 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.265153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347aaa6-021a-4d4e-9dad-2eceee03ba81 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.265672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347aaa6-021a-4d4e-9dad-2eceee03ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.353490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7347aaa6-021a-4d4e-9dad-2eceee03ba81 None None] MFA Rules not processed for user `194b60d2f87948c593bb4f33e57844ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:20.354717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7347aaa6-021a-4d4e-9dad-2eceee03ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:20.377790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3e811-633e-4969-95ce-9492703e816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.378710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3e811-633e-4969-95ce-9492703e816f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.378968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3e811-633e-4969-95ce-9492703e816f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.379242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3e811-633e-4969-95ce-9492703e816f admin admin] PATH_INFO: `/v3/projects/2fc6059ecbd84a9f94ea2aaf1eb8f8d6/users/18f94ea07771442bafb9619f6d6c6462/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.381327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3e811-633e-4969-95ce-9492703e816f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc6059ecbd84a9f94ea2aaf1eb8f8d6, user_id=18f94ea07771442bafb9619f6d6c6462, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.384170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3e811-633e-4969-95ce-9492703e816f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.400452 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1130/2269] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:20 2022] PUT /identity/v3/projects/2fc6059ecbd84a9f94ea2aaf1eb8f8d6/users/18f94ea07771442bafb9619f6d6c6462/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:20.400452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74c5b-9438-4228-8dbf-076e82185081 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.400452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74c5b-9438-4228-8dbf-076e82185081 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.400452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74c5b-9438-4228-8dbf-076e82185081 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.400452 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1131/2270] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:20.407835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2058e4-0c2a-4abc-9bd8-7c7ade0cab40 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.408114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2058e4-0c2a-4abc-9bd8-7c7ade0cab40 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.408425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2058e4-0c2a-4abc-9bd8-7c7ade0cab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.440145 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1140/2271] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:20.442990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4e2058e4-0c2a-4abc-9bd8-7c7ade0cab40 None None] MFA Rules not processed for user `18f94ea07771442bafb9619f6d6c6462`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:20.445180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4e2058e4-0c2a-4abc-9bd8-7c7ade0cab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:20.451000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19ed5-ff47-49b4-a2ab-f9236dc90659 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.451149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19ed5-ff47-49b4-a2ab-f9236dc90659 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.451334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19ed5-ff47-49b4-a2ab-f9236dc90659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.472008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-edf19ed5-ff47-49b4-a2ab-f9236dc90659 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:20.473396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-edf19ed5-ff47-49b4-a2ab-f9236dc90659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:20.560744 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1132/2272] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:20.561925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2058e4-0c2a-4abc-9bd8-7c7ade0cab40 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.575546 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1141/2273] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:51:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:20.581443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf19ed5-ff47-49b4-a2ab-f9236dc90659 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.591636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-edf19ed5-ff47-49b4-a2ab-f9236dc90659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:20.657768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2058e4-0c2a-4abc-9bd8-7c7ade0cab40 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.674414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.675246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.675559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.675793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.695107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf19ed5-ff47-49b4-a2ab-f9236dc90659 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.701602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.702531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.703192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.703668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.713327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.715165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.726695 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1142/2274] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:20.727825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.729396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:20.748679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff99b5-5420-4ee5-9fdf-28ebc8059423 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.756093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ea70-5d26-4f0c-a673-ad6e94423a06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.757671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ea70-5d26-4f0c-a673-ad6e94423a06 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.758010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ea70-5d26-4f0c-a673-ad6e94423a06 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.758289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ea70-5d26-4f0c-a673-ad6e94423a06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.769017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5ea70-5d26-4f0c-a673-ad6e94423a06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.771015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5ea70-5d26-4f0c-a673-ad6e94423a06 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.771451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.774332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.783484 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1143/2275] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:20.784373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ea70-5d26-4f0c-a673-ad6e94423a06 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.806624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1133/2276] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:20.893557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ea70-5d26-4f0c-a673-ad6e94423a06 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.902912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.902912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.902912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.902912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] PATH_INFO: `/v3/users/036491af05b34651a70c9090d2fecd72` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.903332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] RBAC: Authorizing `identity:delete_user(user_id=036491af05b34651a70c9090d2fecd72)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.904585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.904860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:20.906435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:20.948964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329bb7-f577-4557-8fc6-dd11f3185f3e service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:20.968455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:20.969669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:20.970220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:20.970473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] PATH_INFO: `/v3/users/5df681c4fec04b8cac9cc15e5cdb60e7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:20.972265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df681c4fec04b8cac9cc15e5cdb60e7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:20.974631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:20.983380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036491af05b34651a70c9090d2fecd72'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.000623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036491af05b34651a70c9090d2fecd72'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.030315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036491af05b34651a70c9090d2fecd72'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.031479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036491af05b34651a70c9090d2fecd72'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.032421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aff1a9f6-fc1a-4911-b907-f1f980a1029b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036491af05b34651a70c9090d2fecd72'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.063189 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1144/2277] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:20 2022] DELETE /identity/v3/users/036491af05b34651a70c9090d2fecd72 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:21.072017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce58b-146e-4e9f-803b-cb3f25128338 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:21.072805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce58b-146e-4e9f-803b-cb3f25128338 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:21.075296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce58b-146e-4e9f-803b-cb3f25128338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:21.097888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df681c4fec04b8cac9cc15e5cdb60e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.113189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df681c4fec04b8cac9cc15e5cdb60e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.115216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df681c4fec04b8cac9cc15e5cdb60e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.137339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df681c4fec04b8cac9cc15e5cdb60e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.141268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-09dce58b-146e-4e9f-803b-cb3f25128338 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:21.142323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-09dce58b-146e-4e9f-803b-cb3f25128338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:21.151558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df681c4fec04b8cac9cc15e5cdb60e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:21.168605 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1134/2278] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:20 2022] DELETE /identity/v3/users/5df681c4fec04b8cac9cc15e5cdb60e7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:21.168605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:21.171664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:21.233342 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1145/2279] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:21.235011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db1721-b133-4ed2-969a-91d115f98928 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:21.235489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db1721-b133-4ed2-969a-91d115f98928 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:21.235869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db1721-b133-4ed2-969a-91d115f98928 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:21.249729 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1146/2280] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:51:21 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:21.252128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefacf-ffec-43f7-8c3f-0c6456bd9a5a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:21.252247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefacf-ffec-43f7-8c3f-0c6456bd9a5a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:21.252693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefacf-ffec-43f7-8c3f-0c6456bd9a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:21.272645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-addefacf-ffec-43f7-8c3f-0c6456bd9a5a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:21.274134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-addefacf-ffec-43f7-8c3f-0c6456bd9a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:21.287267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d97b6-4463-4961-aee6-1a85a9f0a904 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:21.294034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2b6bc-e7dd-4f0b-a684-7cad61ec1b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:21.294688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2b6bc-e7dd-4f0b-a684-7cad61ec1b57 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:21.294972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2b6bc-e7dd-4f0b-a684-7cad61ec1b57 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:21.295248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2b6bc-e7dd-4f0b-a684-7cad61ec1b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:21.297526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c1d2b6bc-e7dd-4f0b-a684-7cad61ec1b57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:21.346387 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1147/2281] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:21.346387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addefacf-ffec-43f7-8c3f-0c6456bd9a5a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:21.346387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-addefacf-ffec-43f7-8c3f-0c6456bd9a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:21.364257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2b6bc-e7dd-4f0b-a684-7cad61ec1b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:21.366652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2b6bc-e7dd-4f0b-a684-7cad61ec1b57 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:21.377108 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1135/2282] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:21.382635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651c366-d55a-4efe-8d04-0ba5ad127947 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:21.383268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651c366-d55a-4efe-8d04-0ba5ad127947 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:21.383723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651c366-d55a-4efe-8d04-0ba5ad127947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:21.409271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5651c366-d55a-4efe-8d04-0ba5ad127947 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:21.410496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5651c366-d55a-4efe-8d04-0ba5ad127947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:21.421020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addefacf-ffec-43f7-8c3f-0c6456bd9a5a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:21.425277 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1136/2283] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:21.426077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651c366-d55a-4efe-8d04-0ba5ad127947 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:21.432500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8d88-cc6e-4d40-831b-64f61b0bccb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:21.433581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8d88-cc6e-4d40-831b-64f61b0bccb8 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:21.433806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8d88-cc6e-4d40-831b-64f61b0bccb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:21.434066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8d88-cc6e-4d40-831b-64f61b0bccb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:21.436906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651c366-d55a-4efe-8d04-0ba5ad127947 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:21.440637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c7e1d-a978-4e8c-bf01-b2bb7349f137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:21.441278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7e1d-a978-4e8c-bf01-b2bb7349f137 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:21.441562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7e1d-a978-4e8c-bf01-b2bb7349f137 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:21.441837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7e1d-a978-4e8c-bf01-b2bb7349f137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:21.455437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c7e1d-a978-4e8c-bf01-b2bb7349f137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:21.456849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8d88-cc6e-4d40-831b-64f61b0bccb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:21.456962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c7e1d-a978-4e8c-bf01-b2bb7349f137 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:21.458734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8d88-cc6e-4d40-831b-64f61b0bccb8 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:21.467156 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1137/2284] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:21.467978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c7e1d-a978-4e8c-bf01-b2bb7349f137 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:21.469558 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1148/2285] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:21.482260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c7e1d-a978-4e8c-bf01-b2bb7349f137 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:21.486837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:21.487522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:21.487912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:21.488288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:21.500970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:21.502498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:21.515074 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1138/2286] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:21.996769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:21.997218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8d88-cc6e-4d40-831b-64f61b0bccb8 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:22.000284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:22.027684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8d88-cc6e-4d40-831b-64f61b0bccb8 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:22.038403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c1e7a-8210-4588-af03-aff4d614f512 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:22.049710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:22.050924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:22.051226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:22.051513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:22.058734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:22.061116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:22.061234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:22.061522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] PATH_INFO: `/v3/projects/12afb53ac3a94c5696b1f0bc7955cf96` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:22.062136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:22.064420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12afb53ac3a94c5696b1f0bc7955cf96)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:22.069977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:22.164754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12afb53ac3a94c5696b1f0bc7955cf96', 'request_id': 'req-3e8de1af-93b2-4403-9eae-c6512afa20a3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.174033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12afb53ac3a94c5696b1f0bc7955cf96', 'request_id': 'req-3e8de1af-93b2-4403-9eae-c6512afa20a3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.185422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12afb53ac3a94c5696b1f0bc7955cf96', 'request_id': 'req-3e8de1af-93b2-4403-9eae-c6512afa20a3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.186018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:22.187804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:22.203203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] The token cache is being invalidate because project 12afb53ac3a94c5696b1f0bc7955cf96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:22.203560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.204699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.207465 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1139/2287] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:21 2022] DELETE /identity/v3/projects/12afb53ac3a94c5696b1f0bc7955cf96 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:22.210939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:22.213055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:22.228973 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1149/2288] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:22.236814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:22.240487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:22.263671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47ae1d-4014-4304-b10d-e5e7987a90f3 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:22.366751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de1af-93b2-4403-9eae-c6512afa20a3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:22.372760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:22.373916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:22.374234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:22.374568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] PATH_INFO: `/v3/users/8721e88313a9416cb755fa1e964c1559` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:22.376217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8721e88313a9416cb755fa1e964c1559)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:22.380036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:22.392511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:22.396636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:22.396921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:22.397282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] PATH_INFO: `/v3/users/d571221d26404402a3d806d730b866e3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:22.399482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d571221d26404402a3d806d730b866e3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:22.408968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:22.486414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8721e88313a9416cb755fa1e964c1559'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.507759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd571221d26404402a3d806d730b866e3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.509004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8721e88313a9416cb755fa1e964c1559'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.509436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd571221d26404402a3d806d730b866e3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.510152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd571221d26404402a3d806d730b866e3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.532699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8721e88313a9416cb755fa1e964c1559'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.533428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8721e88313a9416cb755fa1e964c1559'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.536146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8721e88313a9416cb755fa1e964c1559'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.546014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd571221d26404402a3d806d730b866e3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.570040 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1150/2289] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:22 2022] DELETE /identity/v3/users/8721e88313a9416cb755fa1e964c1559 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:22.570266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:22.570410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd571221d26404402a3d806d730b866e3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.574609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:22.622482 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1140/2290] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:22 2022] DELETE /identity/v3/users/d571221d26404402a3d806d730b866e3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:22.624444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:22.628225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:22.693764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc072f-f5a7-4ee2-b746-710a7f511106 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:22.753774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296bec9-db54-47b6-a44f-892acbb16edf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:22.769026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:22.771085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:22.771373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:22.771655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] PATH_INFO: `/v3/users/d74baac0e77a47bd989e1b89a5c589f6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:22.777026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74baac0e77a47bd989e1b89a5c589f6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:22.779664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:22.788682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:22.789764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:22.790292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:22.790400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] PATH_INFO: `/v3/projects/4da0ab764b964ecaaa21aedc12cec072` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:22.791776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da0ab764b964ecaaa21aedc12cec072)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:22.794306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:22.862770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74baac0e77a47bd989e1b89a5c589f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.863482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74baac0e77a47bd989e1b89a5c589f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.864134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74baac0e77a47bd989e1b89a5c589f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.867919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da0ab764b964ecaaa21aedc12cec072', 'request_id': 'req-74cbd2fd-e698-419c-981c-0107200e3e87'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.879196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74baac0e77a47bd989e1b89a5c589f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.887464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da0ab764b964ecaaa21aedc12cec072', 'request_id': 'req-74cbd2fd-e698-419c-981c-0107200e3e87'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.891752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7238039-3de6-4f5e-acbb-853f03a1d6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74baac0e77a47bd989e1b89a5c589f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.899844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da0ab764b964ecaaa21aedc12cec072', 'request_id': 'req-74cbd2fd-e698-419c-981c-0107200e3e87'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.911978 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1141/2291] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:22 2022] DELETE /identity/v3/users/d74baac0e77a47bd989e1b89a5c589f6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:22.913846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaac8-d7f6-4db6-99b9-5f669267515e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:22.914140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaac8-d7f6-4db6-99b9-5f669267515e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:22.914413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaac8-d7f6-4db6-99b9-5f669267515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:22.931130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] The token cache is being invalidate because project 4da0ab764b964ecaaa21aedc12cec072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:22.931916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.932523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-74cbd2fd-e698-419c-981c-0107200e3e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:22.934133 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1151/2292] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:22 2022] DELETE /identity/v3/projects/4da0ab764b964ecaaa21aedc12cec072 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:22.937955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7756f-09c9-453d-895c-c6de634bd027 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:22.937955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7756f-09c9-453d-895c-c6de634bd027 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:22.937955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7756f-09c9-453d-895c-c6de634bd027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:22.957343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-287aaac8-d7f6-4db6-99b9-5f669267515e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:22.958661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-abc7756f-09c9-453d-895c-c6de634bd027 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:22.960254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-287aaac8-d7f6-4db6-99b9-5f669267515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:22.960707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-abc7756f-09c9-453d-895c-c6de634bd027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.052616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1142/2293] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:23.056363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa870-9305-472b-892c-904ace220048 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.056608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa870-9305-472b-892c-904ace220048 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.056888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa870-9305-472b-892c-904ace220048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.062650 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1152/2294] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:23.071424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7756f-09c9-453d-895c-c6de634bd027 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.073104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-abc7756f-09c9-453d-895c-c6de634bd027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.083357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a57fa870-9305-472b-892c-904ace220048 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:23.092758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a57fa870-9305-472b-892c-904ace220048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.108879 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1143/2295] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:23.108879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fa870-9305-472b-892c-904ace220048 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.108879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a57fa870-9305-472b-892c-904ace220048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.120794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fa870-9305-472b-892c-904ace220048 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.127623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.128960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.129238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.130051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] PATH_INFO: `/v3/projects/25373dd2e9474b04aa01a062b0ed0505` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.133093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25373dd2e9474b04aa01a062b0ed0505)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.134970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.154021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7756f-09c9-453d-895c-c6de634bd027 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.157823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8565c2-03bc-42b2-b03e-4161e7a8a61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.158631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8565c2-03bc-42b2-b03e-4161e7a8a61f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.159495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8565c2-03bc-42b2-b03e-4161e7a8a61f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.159495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8565c2-03bc-42b2-b03e-4161e7a8a61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.173424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8565c2-03bc-42b2-b03e-4161e7a8a61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.176354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8565c2-03bc-42b2-b03e-4161e7a8a61f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.187235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25373dd2e9474b04aa01a062b0ed0505', 'request_id': 'req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.189293 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1153/2296] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:23.192205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e37a-41e2-4b3e-aa9e-b800872f6224 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.192784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e37a-41e2-4b3e-aa9e-b800872f6224 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.193171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e37a-41e2-4b3e-aa9e-b800872f6224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.195085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25373dd2e9474b04aa01a062b0ed0505', 'request_id': 'req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.217626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c527e37a-41e2-4b3e-aa9e-b800872f6224 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:23.219448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c527e37a-41e2-4b3e-aa9e-b800872f6224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.221965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25373dd2e9474b04aa01a062b0ed0505', 'request_id': 'req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.252930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] The token cache is being invalidate because project 25373dd2e9474b04aa01a062b0ed0505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:23.253579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.259067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.262740 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1144/2297] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:23 2022] DELETE /identity/v3/projects/25373dd2e9474b04aa01a062b0ed0505 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:23.263713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.271406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.381367 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1154/2298] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:23.386798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25be1-2ba8-4b42-96e6-6a14af9b2cef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.387380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25be1-2ba8-4b42-96e6-6a14af9b2cef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.387792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a25be1-2ba8-4b42-96e6-6a14af9b2cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.493970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-44a25be1-2ba8-4b42-96e6-6a14af9b2cef None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:23.497490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-44a25be1-2ba8-4b42-96e6-6a14af9b2cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.500859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f9d75-4ff0-4a1a-9f12-f9209c92824a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.512536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d26044-78ce-434e-8a82-ae185244c0f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.513256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26044-78ce-434e-8a82-ae185244c0f5 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.513531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26044-78ce-434e-8a82-ae185244c0f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.513813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26044-78ce-434e-8a82-ae185244c0f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.521060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f9d26044-78ce-434e-8a82-ae185244c0f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.522851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1155/2299] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:23.523334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a25be1-2ba8-4b42-96e6-6a14af9b2cef None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.543483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a25be1-2ba8-4b42-96e6-6a14af9b2cef None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.544543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d26044-78ce-434e-8a82-ae185244c0f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.547044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d26044-78ce-434e-8a82-ae185244c0f5 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.549959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.551200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.552438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.554534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.556926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:23.557481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.559609 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1145/2300] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:23.559991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.560796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf38311-8d66-47a3-8ee4-1209d614a52f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.561078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf38311-8d66-47a3-8ee4-1209d614a52f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.561764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf38311-8d66-47a3-8ee4-1209d614a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.580047 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1156/2301] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:23.585279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.585505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fdf38311-8d66-47a3-8ee4-1209d614a52f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:23.587097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fdf38311-8d66-47a3-8ee4-1209d614a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.596809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1146/2302] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:23.599925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c093-0009-4743-9de7-b89705eed623 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.601340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf38311-8d66-47a3-8ee4-1209d614a52f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.607856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8ae97-775f-41d5-bab3-2c9fde69b438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.609098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8ae97-775f-41d5-bab3-2c9fde69b438 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.609385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8ae97-775f-41d5-bab3-2c9fde69b438 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.609664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8ae97-775f-41d5-bab3-2c9fde69b438 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.610364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8ae97-775f-41d5-bab3-2c9fde69b438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.612281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8ae97-775f-41d5-bab3-2c9fde69b438 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.619810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf38311-8d66-47a3-8ee4-1209d614a52f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.629256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.629928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.630223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.630526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.631352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:23.631806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.633873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.659962 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1147/2303] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:51:23.661026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.665914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.671986 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1157/2304] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:23 2022] POST /identity/v3/projects => generated 393 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:51:23.671986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8ae97-775f-41d5-bab3-2c9fde69b438 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.682374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07122a0f-5945-4649-87c4-e786b018bce7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.777347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.778227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.778512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.778792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] PATH_INFO: `/v3/projects/c0499eef3d6b4022a79cbf5f97f13a1a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.780010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0499eef3d6b4022a79cbf5f97f13a1a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.782164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.787289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8ae97-775f-41d5-bab3-2c9fde69b438 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.797314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2d089-9518-464e-889a-ac270902245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.798003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2d089-9518-464e-889a-ac270902245b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.798288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2d089-9518-464e-889a-ac270902245b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.798581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2d089-9518-464e-889a-ac270902245b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.799679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2d089-9518-464e-889a-ac270902245b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.803266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2d089-9518-464e-889a-ac270902245b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.843024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1158/2305] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:23 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:23.843024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2d089-9518-464e-889a-ac270902245b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.845018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0499eef3d6b4022a79cbf5f97f13a1a', 'request_id': 'req-fec0df31-4ea5-4bc3-acec-f83be9f377c0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.852186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0499eef3d6b4022a79cbf5f97f13a1a', 'request_id': 'req-fec0df31-4ea5-4bc3-acec-f83be9f377c0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.861850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0499eef3d6b4022a79cbf5f97f13a1a', 'request_id': 'req-fec0df31-4ea5-4bc3-acec-f83be9f377c0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.876079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] The token cache is being invalidate because project c0499eef3d6b4022a79cbf5f97f13a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:23.876546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.877233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:23.878945 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1148/2306] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:23 2022] DELETE /identity/v3/projects/c0499eef3d6b4022a79cbf5f97f13a1a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:23.879813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.881181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.922387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2d089-9518-464e-889a-ac270902245b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.927738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.928697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.929188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.929645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.930522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.932525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.954619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0df31-4ea5-4bc3-acec-f83be9f377c0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.957902 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1159/2307] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:23 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:23.959420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.960685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.960950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.961232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.961928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.962461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.963911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.964791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:23.980386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ed477-9c01-430f-a9db-c0fb74279db9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:23.985558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:23.986633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:23.986921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:23.987197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] PATH_INFO: `/v3/users/18f94ea07771442bafb9619f6d6c6462` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:23.988439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f94ea07771442bafb9619f6d6c6462)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:23.992040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1149/2308] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:23 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:23.992040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:23.992263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:23.994253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.008995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ee51-0119-4451-9b2b-bb859bcb109c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.015354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584efac4-57be-439f-9de3-1f2c741793e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.016076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584efac4-57be-439f-9de3-1f2c741793e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.016375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584efac4-57be-439f-9de3-1f2c741793e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.016656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584efac4-57be-439f-9de3-1f2c741793e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.017549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584efac4-57be-439f-9de3-1f2c741793e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.019346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584efac4-57be-439f-9de3-1f2c741793e0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.035351 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1150/2309] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:24.040455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584efac4-57be-439f-9de3-1f2c741793e0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.055863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584efac4-57be-439f-9de3-1f2c741793e0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.057104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f94ea07771442bafb9619f6d6c6462'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.062854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.063834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.064295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.065244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.066449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.068314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.074102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f94ea07771442bafb9619f6d6c6462'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.085710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f94ea07771442bafb9619f6d6c6462'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.087065 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1151/2310] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:24.087839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f94ea07771442bafb9619f6d6c6462'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.088524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.090421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f94ea07771442bafb9619f6d6c6462'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.090662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.115531 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1160/2311] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:23 2022] DELETE /identity/v3/users/18f94ea07771442bafb9619f6d6c6462 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:24.115531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.118401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872b31b-8bf9-43dd-a835-e1b9db086690 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.131361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.206590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e867c50-4234-495a-bd10-9734887992bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.207553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e867c50-4234-495a-bd10-9734887992bd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.208018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e867c50-4234-495a-bd10-9734887992bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.208729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e867c50-4234-495a-bd10-9734887992bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.211912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e867c50-4234-495a-bd10-9734887992bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.213596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e867c50-4234-495a-bd10-9734887992bd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.230843 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1152/2312] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:24.236194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e867c50-4234-495a-bd10-9734887992bd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.249580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e867c50-4234-495a-bd10-9734887992bd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.255677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab921-99f1-44df-967b-1f705ef88d67 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.262477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da219f-36a9-4c74-b940-a182bd276b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.263231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da219f-36a9-4c74-b940-a182bd276b63 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.263629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da219f-36a9-4c74-b940-a182bd276b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.264073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da219f-36a9-4c74-b940-a182bd276b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.266631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b557b9-deee-40ef-821f-9517c2766e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.267652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b557b9-deee-40ef-821f-9517c2766e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.267958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b557b9-deee-40ef-821f-9517c2766e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.268245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b557b9-deee-40ef-821f-9517c2766e0b admin admin] PATH_INFO: `/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d/users/5fdc6f4482de487b825316c486cd3cae/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.270739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da219f-36a9-4c74-b940-a182bd276b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.273788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da219f-36a9-4c74-b940-a182bd276b63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.301923 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1161/2313] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:24.303265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da219f-36a9-4c74-b940-a182bd276b63 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.312214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b557b9-deee-40ef-821f-9517c2766e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8a9d38db7e4dd9ae36791c4ad7508d, user_id=5fdc6f4482de487b825316c486cd3cae, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.317072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b557b9-deee-40ef-821f-9517c2766e0b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.323229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da219f-36a9-4c74-b940-a182bd276b63 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.337443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1566314-36ff-482e-a5d9-80848fc22629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.338735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566314-36ff-482e-a5d9-80848fc22629 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.341416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566314-36ff-482e-a5d9-80848fc22629 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.341883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566314-36ff-482e-a5d9-80848fc22629 admin admin] PATH_INFO: `/v3/projects/6d9ffdaf1d654c9bbbda43ed9214c964/users/caca1da9a52c4a2080682b2458fa1e4f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.354074 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1153/2314] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:24 2022] PUT /identity/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d/users/5fdc6f4482de487b825316c486cd3cae/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:24.360996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74e5a-d287-438e-aee5-613008ea46f8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.362633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74e5a-d287-438e-aee5-613008ea46f8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.371291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74e5a-d287-438e-aee5-613008ea46f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.393692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1566314-36ff-482e-a5d9-80848fc22629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9ffdaf1d654c9bbbda43ed9214c964, user_id=caca1da9a52c4a2080682b2458fa1e4f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.398494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1566314-36ff-482e-a5d9-80848fc22629 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.413606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dec74e5a-d287-438e-aee5-613008ea46f8 None None] MFA Rules not processed for user `5fdc6f4482de487b825316c486cd3cae`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:24.415004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dec74e5a-d287-438e-aee5-613008ea46f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.437480 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1162/2315] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:24 2022] PUT /identity/v3/projects/6d9ffdaf1d654c9bbbda43ed9214c964/users/caca1da9a52c4a2080682b2458fa1e4f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:24.442782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b969-8a0b-476a-bd40-766b84d4aa08 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.449158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b969-8a0b-476a-bd40-766b84d4aa08 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.449428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b969-8a0b-476a-bd40-766b84d4aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.495895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-62b0b969-8a0b-476a-bd40-766b84d4aa08 None None] MFA Rules not processed for user `caca1da9a52c4a2080682b2458fa1e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:24.497295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-62b0b969-8a0b-476a-bd40-766b84d4aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.521125 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1154/2316] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:24.523587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74e5a-d287-438e-aee5-613008ea46f8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.619914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74e5a-d287-438e-aee5-613008ea46f8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.624905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f06e0-d943-47cd-9d8a-a03e1e367840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.625567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f06e0-d943-47cd-9d8a-a03e1e367840 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.625850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f06e0-d943-47cd-9d8a-a03e1e367840 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.626124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f06e0-d943-47cd-9d8a-a03e1e367840 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.626819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f06e0-d943-47cd-9d8a-a03e1e367840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.628766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f06e0-d943-47cd-9d8a-a03e1e367840 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.640725 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1163/2317] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:24.643516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b969-8a0b-476a-bd40-766b84d4aa08 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.645792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-62b0b969-8a0b-476a-bd40-766b84d4aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.660087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b969-8a0b-476a-bd40-766b84d4aa08 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.668009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.669013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.669349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.669636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] PATH_INFO: `/v3/projects/2fc6059ecbd84a9f94ea2aaf1eb8f8d6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.670895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc6059ecbd84a9f94ea2aaf1eb8f8d6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.672855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.680461 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1155/2318] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:24 2022] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:24.680461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f06e0-d943-47cd-9d8a-a03e1e367840 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.737868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc6059ecbd84a9f94ea2aaf1eb8f8d6', 'request_id': 'req-0f8d5593-dddf-4421-a463-5c00811ebcc3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.747841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc6059ecbd84a9f94ea2aaf1eb8f8d6', 'request_id': 'req-0f8d5593-dddf-4421-a463-5c00811ebcc3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.756205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc6059ecbd84a9f94ea2aaf1eb8f8d6', 'request_id': 'req-0f8d5593-dddf-4421-a463-5c00811ebcc3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.762957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f06e0-d943-47cd-9d8a-a03e1e367840 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.768300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] The token cache is being invalidate because project 2fc6059ecbd84a9f94ea2aaf1eb8f8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:24.768623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.769330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:24.771155 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1164/2319] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:24 2022] DELETE /identity/v3/projects/2fc6059ecbd84a9f94ea2aaf1eb8f8d6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:24.776469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.785849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.830775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f511fd-6787-427d-92a8-e6618ed30bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.831258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f511fd-6787-427d-92a8-e6618ed30bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.831549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f511fd-6787-427d-92a8-e6618ed30bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.831829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f511fd-6787-427d-92a8-e6618ed30bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.832562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f511fd-6787-427d-92a8-e6618ed30bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.834627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f511fd-6787-427d-92a8-e6618ed30bf1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.865075 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1156/2320] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:24 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:24.865075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8befe-988f-4965-a79b-3414f17c4b6a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.865075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8befe-988f-4965-a79b-3414f17c4b6a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.865075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8befe-988f-4965-a79b-3414f17c4b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.884028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4dd8befe-988f-4965-a79b-3414f17c4b6a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:24.885298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4dd8befe-988f-4965-a79b-3414f17c4b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.888630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d5593-dddf-4421-a463-5c00811ebcc3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.953211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d5513-8224-4268-846f-af3d7e638a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.953906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d5513-8224-4268-846f-af3d7e638a42 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.954191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d5513-8224-4268-846f-af3d7e638a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.954523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d5513-8224-4268-846f-af3d7e638a42 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.958468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d5513-8224-4268-846f-af3d7e638a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.959947 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1157/2321] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:24.960896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8befe-988f-4965-a79b-3414f17c4b6a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:24.962283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4dd8befe-988f-4965-a79b-3414f17c4b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:24.966186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d5513-8224-4268-846f-af3d7e638a42 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:24.975813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8befe-988f-4965-a79b-3414f17c4b6a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:24.981918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a93c9-d536-4535-b576-f3a79718eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:24.982596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a93c9-d536-4535-b576-f3a79718eb00 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:24.983050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a93c9-d536-4535-b576-f3a79718eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:24.983337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a93c9-d536-4535-b576-f3a79718eb00 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:24.984119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a93c9-d536-4535-b576-f3a79718eb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:24.987362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a93c9-d536-4535-b576-f3a79718eb00 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.002445 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1165/2322] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:24 2022] POST /identity/v3/users => generated 303 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:25.004053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa891bea-e729-4151-b943-f5d9cecde37a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.004363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa891bea-e729-4151-b943-f5d9cecde37a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.004647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa891bea-e729-4151-b943-f5d9cecde37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.024936 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1158/2323] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:24 2022] POST /identity/v3/users => generated 295 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:25.024936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a93c9-d536-4535-b576-f3a79718eb00 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.026321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fa891bea-e729-4151-b943-f5d9cecde37a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:25.028013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fa891bea-e729-4151-b943-f5d9cecde37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.040236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a93c9-d536-4535-b576-f3a79718eb00 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.046090 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1166/2324] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:25.047137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa891bea-e729-4151-b943-f5d9cecde37a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.056606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1a2d9-8d14-430f-bfb2-84be00298191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.057293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1a2d9-8d14-430f-bfb2-84be00298191 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.057602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1a2d9-8d14-430f-bfb2-84be00298191 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.057876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1a2d9-8d14-430f-bfb2-84be00298191 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.058216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa891bea-e729-4151-b943-f5d9cecde37a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.058612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1a2d9-8d14-430f-bfb2-84be00298191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.060254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1a2d9-8d14-430f-bfb2-84be00298191 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.063698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644824ae-ad20-4b8d-8e0d-9474d6d2076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.064388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644824ae-ad20-4b8d-8e0d-9474d6d2076c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.064678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644824ae-ad20-4b8d-8e0d-9474d6d2076c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.064957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644824ae-ad20-4b8d-8e0d-9474d6d2076c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.065685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644824ae-ad20-4b8d-8e0d-9474d6d2076c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.067264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644824ae-ad20-4b8d-8e0d-9474d6d2076c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.078310 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1167/2325] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:25.079174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644824ae-ad20-4b8d-8e0d-9474d6d2076c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.079975 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1159/2326] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:25.083320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1a2d9-8d14-430f-bfb2-84be00298191 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.093670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644824ae-ad20-4b8d-8e0d-9474d6d2076c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.098872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.099534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.099867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.100742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.101490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:25.101854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.102047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1a2d9-8d14-430f-bfb2-84be00298191 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.103456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.111756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.113202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.113551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.113835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] PATH_INFO: `/v3/projects/85fb7ac785b04495b0aebd17fa4efb4a/users/2ac1049b15c340a7935a20e794d075c6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.117649 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1168/2327] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:25.118353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.128116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f3bd-3def-470f-8ba5-8ba06c93ff90 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.133785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d654-215d-4243-b0c6-5d50c179da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.134737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d654-215d-4243-b0c6-5d50c179da6a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.135018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d654-215d-4243-b0c6-5d50c179da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.135318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d654-215d-4243-b0c6-5d50c179da6a admin admin] PATH_INFO: `/v3/projects/6662171a08b64330a873a2ba1d14dedd/users/421cd4b0f20549f28318ae5277473f1a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.153299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607d654-215d-4243-b0c6-5d50c179da6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6662171a08b64330a873a2ba1d14dedd, user_id=421cd4b0f20549f28318ae5277473f1a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.154402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fb7ac785b04495b0aebd17fa4efb4a, user_id=2ac1049b15c340a7935a20e794d075c6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.156131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607d654-215d-4243-b0c6-5d50c179da6a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.161941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.177871 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1169/2328] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:25 2022] PUT /identity/v3/projects/6662171a08b64330a873a2ba1d14dedd/users/421cd4b0f20549f28318ae5277473f1a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:25.181534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d654-215d-4243-b0c6-5d50c179da6a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.208048 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1160/2329] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:25 2022] PUT /identity/v3/projects/85fb7ac785b04495b0aebd17fa4efb4a/users/2ac1049b15c340a7935a20e794d075c6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:25.208678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.210944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.256939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d654-215d-4243-b0c6-5d50c179da6a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.282759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af902ad2-0b03-4a61-8e4d-7c2d7eb8614f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.289373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.290245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.290525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.290802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] PATH_INFO: `/v3/projects/4c5ed6b00f824da68e0c90aca52baab0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.292037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5ed6b00f824da68e0c90aca52baab0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.294079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.332741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8717a-4ed9-418f-b53b-640d1099d174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.333446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8717a-4ed9-418f-b53b-640d1099d174 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.333731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8717a-4ed9-418f-b53b-640d1099d174 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.334007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8717a-4ed9-418f-b53b-640d1099d174 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.335248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8717a-4ed9-418f-b53b-640d1099d174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.342788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8717a-4ed9-418f-b53b-640d1099d174 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.357749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5ed6b00f824da68e0c90aca52baab0', 'request_id': 'req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.365093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5ed6b00f824da68e0c90aca52baab0', 'request_id': 'req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.374365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5ed6b00f824da68e0c90aca52baab0', 'request_id': 'req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.376370 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1170/2330] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:25 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:25.377115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8717a-4ed9-418f-b53b-640d1099d174 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.388703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] The token cache is being invalidate because project 4c5ed6b00f824da68e0c90aca52baab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:25.388985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.389702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.391859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1161/2331] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:25 2022] DELETE /identity/v3/projects/4c5ed6b00f824da68e0c90aca52baab0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:25.392669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.393978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.452010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8717a-4ed9-418f-b53b-640d1099d174 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.460873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.461842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.462585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.462970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.463764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.466204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.482716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d0cc6-8ea6-432b-a267-bad6e8cdfa0d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.483069 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1171/2332] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:25.483069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.485450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.489142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.489838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.490118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.490659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.491884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.493753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.508360 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1162/2333] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:25.509166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.512151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.512419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc30f6-5e8a-4d92-8ce2-e17e36b6b773 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.516603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.517373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.517746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.518144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.518964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.521231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.523564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65b1e6-1f6b-447f-81c0-5148c227a3ec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.528087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.528964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.529624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.529624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] PATH_INFO: `/v3/users/194b60d2f87948c593bb4f33e57844ce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.530730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194b60d2f87948c593bb4f33e57844ce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.532714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.549168 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1172/2334] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:25 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:25.549931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.554620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.620235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194b60d2f87948c593bb4f33e57844ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.621034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194b60d2f87948c593bb4f33e57844ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.621825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194b60d2f87948c593bb4f33e57844ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.644083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754738-1487-4293-b2fc-002c6b40f0cd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.651250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.652102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.652536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.652960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.655185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.659299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194b60d2f87948c593bb4f33e57844ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.668163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194b60d2f87948c593bb4f33e57844ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:25.688620 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1163/2335] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:25 2022] DELETE /identity/v3/users/194b60d2f87948c593bb4f33e57844ce => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:25.688620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.702797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.817178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.822441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.868093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdf46f-0a6e-4895-91a8-46abba19d2c1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.884566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:25.887074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:25.891556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:25.891836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] PATH_INFO: `/v3/projects/6662171a08b64330a873a2ba1d14dedd/users/421cd4b0f20549f28318ae5277473f1a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:25.893098 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1173/2336] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:25.894557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.895716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6662171a08b64330a873a2ba1d14dedd, user_id=421cd4b0f20549f28318ae5277473f1a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:25.897807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:25.901746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:25.936500 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1164/2337] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:25 2022] PUT /identity/v3/projects/6662171a08b64330a873a2ba1d14dedd/users/421cd4b0f20549f28318ae5277473f1a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:25.936500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:25.936783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3c6d-f77c-4cf0-adbc-243d9a6f3107 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:25.943485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.071926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07660f5-b383-4b20-bf95-65b2369d5b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.073098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07660f5-b383-4b20-bf95-65b2369d5b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.073588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07660f5-b383-4b20-bf95-65b2369d5b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.074079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07660f5-b383-4b20-bf95-65b2369d5b91 admin admin] PATH_INFO: `/v3/projects/85fb7ac785b04495b0aebd17fa4efb4a/users/2ac1049b15c340a7935a20e794d075c6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.077399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07660f5-b383-4b20-bf95-65b2369d5b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fb7ac785b04495b0aebd17fa4efb4a, user_id=2ac1049b15c340a7935a20e794d075c6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.087878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07660f5-b383-4b20-bf95-65b2369d5b91 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.102138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59062d31-8524-4e4f-baaa-e9b3bf7d0c6b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.112726 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1174/2338] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:25 2022] PUT /identity/v3/projects/85fb7ac785b04495b0aebd17fa4efb4a/users/2ac1049b15c340a7935a20e794d075c6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:26.117950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff99811-ce2f-4b93-b62b-342290a23d07 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.118402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff99811-ce2f-4b93-b62b-342290a23d07 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.120434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff99811-ce2f-4b93-b62b-342290a23d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.155079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7ff99811-ce2f-4b93-b62b-342290a23d07 None None] MFA Rules not processed for user `421cd4b0f20549f28318ae5277473f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:26.156195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7ff99811-ce2f-4b93-b62b-342290a23d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.193916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f7cb1-27e7-45a6-97e7-2d3b4fcabafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.194621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f7cb1-27e7-45a6-97e7-2d3b4fcabafc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.195365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f7cb1-27e7-45a6-97e7-2d3b4fcabafc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.195365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f7cb1-27e7-45a6-97e7-2d3b4fcabafc admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.195911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f7cb1-27e7-45a6-97e7-2d3b4fcabafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.204358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f7cb1-27e7-45a6-97e7-2d3b4fcabafc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.222947 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1165/2339] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:26.222947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07981-be3b-4275-b8fc-e1ca8008ff09 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.222947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07981-be3b-4275-b8fc-e1ca8008ff09 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.222947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07981-be3b-4275-b8fc-e1ca8008ff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.251303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1175/2340] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:26.252397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff99811-ce2f-4b93-b62b-342290a23d07 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.263458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff99811-ce2f-4b93-b62b-342290a23d07 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.270726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9bd07981-be3b-4275-b8fc-e1ca8008ff09 None None] MFA Rules not processed for user `2ac1049b15c340a7935a20e794d075c6`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:26.271587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.272679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9bd07981-be3b-4275-b8fc-e1ca8008ff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.273115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.273502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.273846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.274756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.277166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.290425 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1176/2341] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:26.293319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.296704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.312270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f083b7f-9338-47ee-85df-a4d2d0e61e65 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.318632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.319532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.319877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.320164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] PATH_INFO: `/v3/projects/1f241ce9ca55475f95b3180d4ce15130` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.321401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f241ce9ca55475f95b3180d4ce15130)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.323305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.357526 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1166/2342] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:26.357526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd07981-be3b-4275-b8fc-e1ca8008ff09 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.362130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd07981-be3b-4275-b8fc-e1ca8008ff09 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.368743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648cec8-7f78-4c65-bb31-f43a8f2d4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.369740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648cec8-7f78-4c65-bb31-f43a8f2d4cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.370118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648cec8-7f78-4c65-bb31-f43a8f2d4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.370430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648cec8-7f78-4c65-bb31-f43a8f2d4cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.371266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648cec8-7f78-4c65-bb31-f43a8f2d4cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.373338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648cec8-7f78-4c65-bb31-f43a8f2d4cd6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.389621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f241ce9ca55475f95b3180d4ce15130', 'request_id': 'req-ddbe5bcc-7e83-4f75-94df-e71897344a6b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:26.399242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f241ce9ca55475f95b3180d4ce15130', 'request_id': 'req-ddbe5bcc-7e83-4f75-94df-e71897344a6b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:26.405969 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1167/2343] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/projects => generated 395 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:26.407122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648cec8-7f78-4c65-bb31-f43a8f2d4cd6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.411193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f241ce9ca55475f95b3180d4ce15130', 'request_id': 'req-ddbe5bcc-7e83-4f75-94df-e71897344a6b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:26.426070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] The token cache is being invalidate because project 1f241ce9ca55475f95b3180d4ce15130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:26.426359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:26.427110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ddbe5bcc-7e83-4f75-94df-e71897344a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:26.429674 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1177/2344] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:26 2022] DELETE /identity/v3/projects/1f241ce9ca55475f95b3180d4ce15130 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:26.431217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb89b7-d602-4e3a-9ce5-38d2f76cc50c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.431507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb89b7-d602-4e3a-9ce5-38d2f76cc50c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.431783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb89b7-d602-4e3a-9ce5-38d2f76cc50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.452007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-38fb89b7-d602-4e3a-9ce5-38d2f76cc50c None None] MFA Rules not processed for user `caca1da9a52c4a2080682b2458fa1e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:26.453656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38fb89b7-d602-4e3a-9ce5-38d2f76cc50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.482381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648cec8-7f78-4c65-bb31-f43a8f2d4cd6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.487766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf2ef4-e472-4d91-94b9-abddb6bd8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.488959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf2ef4-e472-4d91-94b9-abddb6bd8963 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.489385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf2ef4-e472-4d91-94b9-abddb6bd8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.489836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf2ef4-e472-4d91-94b9-abddb6bd8963 admin admin] PATH_INFO: `/v3/projects/76afd67dfef14c3db64ccbd812036427/users/08781c2dd21c4011b5eebde0436042c2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.507147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf2ef4-e472-4d91-94b9-abddb6bd8963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76afd67dfef14c3db64ccbd812036427, user_id=08781c2dd21c4011b5eebde0436042c2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.510655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf2ef4-e472-4d91-94b9-abddb6bd8963 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.512634 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1178/2345] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:26.514247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb89b7-d602-4e3a-9ce5-38d2f76cc50c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.515643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38fb89b7-d602-4e3a-9ce5-38d2f76cc50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.531315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb89b7-d602-4e3a-9ce5-38d2f76cc50c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.537207 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1168/2346] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:26 2022] PUT /identity/v3/projects/76afd67dfef14c3db64ccbd812036427/users/08781c2dd21c4011b5eebde0436042c2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:26.539299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918247f7-816b-48ca-b50e-951731d29a43 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.539656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918247f7-816b-48ca-b50e-951731d29a43 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.540025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918247f7-816b-48ca-b50e-951731d29a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.562679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-918247f7-816b-48ca-b50e-951731d29a43 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:26.564044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-918247f7-816b-48ca-b50e-951731d29a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.636052 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1169/2347] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:26.637671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0091b-e97c-49a3-aac9-ca830c8239ca None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.637965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0091b-e97c-49a3-aac9-ca830c8239ca None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.638238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0091b-e97c-49a3-aac9-ca830c8239ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.651871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a187604-5ea8-443b-9218-31419c91e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.652701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a187604-5ea8-443b-9218-31419c91e2ab admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.653877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a187604-5ea8-443b-9218-31419c91e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.654241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a187604-5ea8-443b-9218-31419c91e2ab admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.656369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a187604-5ea8-443b-9218-31419c91e2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.658834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a187604-5ea8-443b-9218-31419c91e2ab admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.662268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e4a0091b-e97c-49a3-aac9-ca830c8239ca None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:26.664226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e4a0091b-e97c-49a3-aac9-ca830c8239ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.672885 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1170/2348] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:26.673842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0091b-e97c-49a3-aac9-ca830c8239ca None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.677438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e4a0091b-e97c-49a3-aac9-ca830c8239ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.688540 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1179/2349] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:26.688771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbacc3-e413-4c95-a48c-95e696f31ee5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.689210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbacc3-e413-4c95-a48c-95e696f31ee5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.689314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbacc3-e413-4c95-a48c-95e696f31ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.710924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bfbbacc3-e413-4c95-a48c-95e696f31ee5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:26.712172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bfbbacc3-e413-4c95-a48c-95e696f31ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.721154 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1180/2350] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:26.728107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbacc3-e413-4c95-a48c-95e696f31ee5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.728107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bfbbacc3-e413-4c95-a48c-95e696f31ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.775593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0091b-e97c-49a3-aac9-ca830c8239ca None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.783128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.783825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.784099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.784416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.786215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:26.797206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbacc3-e413-4c95-a48c-95e696f31ee5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.803004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd90aac-039e-4aa2-863f-1aed648ddbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.804532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90aac-039e-4aa2-863f-1aed648ddbcf service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.805006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90aac-039e-4aa2-863f-1aed648ddbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.805621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90aac-039e-4aa2-863f-1aed648ddbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.818428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd90aac-039e-4aa2-863f-1aed648ddbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.820174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd90aac-039e-4aa2-863f-1aed648ddbcf service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.831297 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1181/2351] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:26.832135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd90aac-039e-4aa2-863f-1aed648ddbcf service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.842406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd90aac-039e-4aa2-863f-1aed648ddbcf service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.847600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423bb2-9b47-47df-aca1-94d33b7dece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.848259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423bb2-9b47-47df-aca1-94d33b7dece9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.848592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423bb2-9b47-47df-aca1-94d33b7dece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.848871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423bb2-9b47-47df-aca1-94d33b7dece9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.849842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423bb2-9b47-47df-aca1-94d33b7dece9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.851988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423bb2-9b47-47df-aca1-94d33b7dece9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.857735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.859560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.863514 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1182/2352] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:26.864642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423bb2-9b47-47df-aca1-94d33b7dece9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.875170 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1171/2353] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:26.876646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.877576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423bb2-9b47-47df-aca1-94d33b7dece9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.895102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.895448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66d2a-b3d1-4c29-b8ab-d7cca5c54b9b service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.895777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.898625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.899026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.899701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:26.901475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.903577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b7c0-3d61-4054-911d-e9f244a2a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.904353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b7c0-3d61-4054-911d-e9f244a2a16f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.904639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b7c0-3d61-4054-911d-e9f244a2a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.904922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b7c0-3d61-4054-911d-e9f244a2a16f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.905684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b7c0-3d61-4054-911d-e9f244a2a16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.907746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.908296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b7c0-3d61-4054-911d-e9f244a2a16f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.923698 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1172/2354] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:26.928227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b7c0-3d61-4054-911d-e9f244a2a16f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.959413 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1183/2355] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:26.962051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:26.963745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b7c0-3d61-4054-911d-e9f244a2a16f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.969089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dafdd5-c00e-401f-b2a1-a1b731590fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.969987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dafdd5-c00e-401f-b2a1-a1b731590fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.970272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dafdd5-c00e-401f-b2a1-a1b731590fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.970556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dafdd5-c00e-401f-b2a1-a1b731590fd4 admin admin] PATH_INFO: `/v3/projects/3ac3d148f3e14ea9a52e492597f8f54d/users/db5e468ff18c44389e084b73f4f5daf7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.977409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93778f2-2547-4b44-80ea-e71f6798cc40 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:26.987100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969489d2-8ca3-403a-8398-4eb04c766ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:26.988225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969489d2-8ca3-403a-8398-4eb04c766ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:26.988878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969489d2-8ca3-403a-8398-4eb04c766ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:26.989321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969489d2-8ca3-403a-8398-4eb04c766ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:26.990282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969489d2-8ca3-403a-8398-4eb04c766ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.990857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dafdd5-c00e-401f-b2a1-a1b731590fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac3d148f3e14ea9a52e492597f8f54d, user_id=db5e468ff18c44389e084b73f4f5daf7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:26.993947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969489d2-8ca3-403a-8398-4eb04c766ff1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:26.994344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dafdd5-c00e-401f-b2a1-a1b731590fd4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:27.023591 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1173/2356] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:26 2022] PUT /identity/v3/projects/3ac3d148f3e14ea9a52e492597f8f54d/users/db5e468ff18c44389e084b73f4f5daf7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:27.027370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae042b8d-e867-4b0a-9676-5ef07159f296 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:27.028771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae042b8d-e867-4b0a-9676-5ef07159f296 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:27.029272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae042b8d-e867-4b0a-9676-5ef07159f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:27.053515 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1184/2357] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:26 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:27.055564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969489d2-8ca3-403a-8398-4eb04c766ff1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:27.091127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ae042b8d-e867-4b0a-9676-5ef07159f296 None None] MFA Rules not processed for user `db5e468ff18c44389e084b73f4f5daf7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:27.094142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae042b8d-e867-4b0a-9676-5ef07159f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:27.217143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969489d2-8ca3-403a-8398-4eb04c766ff1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:27.226895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba8e1-6857-4001-9486-b3b43e237559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:27.228157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba8e1-6857-4001-9486-b3b43e237559 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:27.228477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba8e1-6857-4001-9486-b3b43e237559 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:27.228759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba8e1-6857-4001-9486-b3b43e237559 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:27.229634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bba8e1-6857-4001-9486-b3b43e237559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:27.231958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bba8e1-6857-4001-9486-b3b43e237559 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:27.250407 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1174/2358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:27.293865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae042b8d-e867-4b0a-9676-5ef07159f296 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:27.297925 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1185/2359] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:27 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:51:27.316931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae042b8d-e867-4b0a-9676-5ef07159f296 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:27.336129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43172907-23d0-4343-b06a-6f9842ea2a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:27.337261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43172907-23d0-4343-b06a-6f9842ea2a6e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:27.337744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43172907-23d0-4343-b06a-6f9842ea2a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:27.338216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43172907-23d0-4343-b06a-6f9842ea2a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:27.339175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43172907-23d0-4343-b06a-6f9842ea2a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:27.341598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43172907-23d0-4343-b06a-6f9842ea2a6e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:27.365189 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1175/2360] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:27.370700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba8e1-6857-4001-9486-b3b43e237559 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:27.384037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba8e1-6857-4001-9486-b3b43e237559 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:27.403969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12470fa-d74b-4579-b372-ef681a9b187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:27.404689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12470fa-d74b-4579-b372-ef681a9b187d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:27.407171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12470fa-d74b-4579-b372-ef681a9b187d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:27.407171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12470fa-d74b-4579-b372-ef681a9b187d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:27.407171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12470fa-d74b-4579-b372-ef681a9b187d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:27.407623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12470fa-d74b-4579-b372-ef681a9b187d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:27.420531 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1186/2361] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:27.425178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43172907-23d0-4343-b06a-6f9842ea2a6e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:27.437678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43172907-23d0-4343-b06a-6f9842ea2a6e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:27.443274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112e0bc-e890-4f91-8e48-3b63fdda8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:27.444476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e0bc-e890-4f91-8e48-3b63fdda8bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:27.444768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e0bc-e890-4f91-8e48-3b63fdda8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:27.445100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e0bc-e890-4f91-8e48-3b63fdda8bcc admin admin] PATH_INFO: `/v3/projects/072ae18574974918b1d1bb5babdb7277/users/15d6257719804e1282ddd890e4a93711/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:27.463785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112e0bc-e890-4f91-8e48-3b63fdda8bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=072ae18574974918b1d1bb5babdb7277, user_id=15d6257719804e1282ddd890e4a93711, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:27.467428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112e0bc-e890-4f91-8e48-3b63fdda8bcc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:27.499574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23d0f-52e1-401f-b334-0b431ecb1e8c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:27.500665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23d0f-52e1-401f-b334-0b431ecb1e8c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:27.500665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23d0f-52e1-401f-b334-0b431ecb1e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:27.516321 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1176/2362] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:27 2022] PUT /identity/v3/projects/072ae18574974918b1d1bb5babdb7277/users/15d6257719804e1282ddd890e4a93711/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:27.544222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-73f23d0f-52e1-401f-b334-0b431ecb1e8c None None] MFA Rules not processed for user `15d6257719804e1282ddd890e4a93711`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:27.547185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-73f23d0f-52e1-401f-b334-0b431ecb1e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:27.661752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dbcf0-cd3b-46b5-9cc9-a263c0ea5c0d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:27.663365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dbcf0-cd3b-46b5-9cc9-a263c0ea5c0d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:27.663365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dbcf0-cd3b-46b5-9cc9-a263c0ea5c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:27.718644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-410dbcf0-cd3b-46b5-9cc9-a263c0ea5c0d None None] MFA Rules not processed for user `caca1da9a52c4a2080682b2458fa1e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:27.721363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-410dbcf0-cd3b-46b5-9cc9-a263c0ea5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:27.754185 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1187/2363] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:27.756063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f23d0f-52e1-401f-b334-0b431ecb1e8c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:27.870268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f23d0f-52e1-401f-b334-0b431ecb1e8c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:27.875179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:27.875956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:27.876393 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1177/2364] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:27.876569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:27.877026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:27.877999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:27.880809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:27.915465 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1188/2365] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:27 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:27.919358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dbcf0-cd3b-46b5-9cc9-a263c0ea5c0d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:27.951555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dbcf0-cd3b-46b5-9cc9-a263c0ea5c0d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:28.019878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f794c2-2862-4122-9043-b1b1a47f8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:28.020683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f794c2-2862-4122-9043-b1b1a47f8f6a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:28.020948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f794c2-2862-4122-9043-b1b1a47f8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:28.021224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f794c2-2862-4122-9043-b1b1a47f8f6a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:28.022999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f794c2-2862-4122-9043-b1b1a47f8f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:28.025795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f794c2-2862-4122-9043-b1b1a47f8f6a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:28.034788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:28.036658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:28.059536 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1178/2366] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:27 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:28.063066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f794c2-2862-4122-9043-b1b1a47f8f6a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:28.097357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f794c2-2862-4122-9043-b1b1a47f8f6a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:28.114572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1c40-0572-4543-a175-410adc247e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:28.115703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1c40-0572-4543-a175-410adc247e37 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:28.116858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1c40-0572-4543-a175-410adc247e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:28.117423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1c40-0572-4543-a175-410adc247e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:28.119112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a1c40-0572-4543-a175-410adc247e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:28.123051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a1c40-0572-4543-a175-410adc247e37 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:28.130800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6ac3-a8f3-4e05-9296-69e468121fff admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:28.143395 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1179/2367] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:28.145109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:28.145934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:28.146287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:28.146634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:28.149124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1c40-0572-4543-a175-410adc247e37 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:28.151080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:28.171680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1c40-0572-4543-a175-410adc247e37 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:28.188875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff86ee-b97b-40d5-879f-3e6c4be9f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:28.189782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff86ee-b97b-40d5-879f-3e6c4be9f1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:28.190063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff86ee-b97b-40d5-879f-3e6c4be9f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:28.190335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff86ee-b97b-40d5-879f-3e6c4be9f1e2 admin admin] PATH_INFO: `/v3/projects/4587fd3337384c4b88b14143eefc576d/users/d75d285e8f2e46aa9efb2107326ba0fe/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:28.217857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff86ee-b97b-40d5-879f-3e6c4be9f1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4587fd3337384c4b88b14143eefc576d, user_id=d75d285e8f2e46aa9efb2107326ba0fe, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:28.221223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff86ee-b97b-40d5-879f-3e6c4be9f1e2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:28.247485 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1180/2368] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:28 2022] PUT /identity/v3/projects/4587fd3337384c4b88b14143eefc576d/users/d75d285e8f2e46aa9efb2107326ba0fe/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:28.261088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff86ee-b97b-40d5-879f-3e6c4be9f1e2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:28.315303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:28.321894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:28.346801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1189/2369] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:28.460568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff86ee-b97b-40d5-879f-3e6c4be9f1e2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:28.466383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce35c0f-6ba7-4151-9d90-9c3345c0aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:28.466902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35c0f-6ba7-4151-9d90-9c3345c0aef4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:28.467179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35c0f-6ba7-4151-9d90-9c3345c0aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:28.467456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35c0f-6ba7-4151-9d90-9c3345c0aef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:28.468439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce35c0f-6ba7-4151-9d90-9c3345c0aef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:28.470078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce35c0f-6ba7-4151-9d90-9c3345c0aef4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:28.490538 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1181/2370] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:28.491580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:28.507231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab3c8a-d568-4fd0-aa1b-04fcafa58c40 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:28.526869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40254ef2-6c97-4701-acd5-0cbf479f5ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:28.528214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254ef2-6c97-4701-acd5-0cbf479f5ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:28.528410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254ef2-6c97-4701-acd5-0cbf479f5ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:28.528814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254ef2-6c97-4701-acd5-0cbf479f5ddd admin admin] PATH_INFO: `/v3/projects/4587fd3337384c4b88b14143eefc576d/users/d75d285e8f2e46aa9efb2107326ba0fe/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:28.533307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40254ef2-6c97-4701-acd5-0cbf479f5ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4587fd3337384c4b88b14143eefc576d, user_id=d75d285e8f2e46aa9efb2107326ba0fe, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:28.539623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40254ef2-6c97-4701-acd5-0cbf479f5ddd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:28.554621 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1190/2371] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:28 2022] PUT /identity/v3/projects/4587fd3337384c4b88b14143eefc576d/users/d75d285e8f2e46aa9efb2107326ba0fe/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:28.565387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55af0e-52ba-49ee-83cc-96e254bed0b2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:28.566016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55af0e-52ba-49ee-83cc-96e254bed0b2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:28.566442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55af0e-52ba-49ee-83cc-96e254bed0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:28.621002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bb55af0e-52ba-49ee-83cc-96e254bed0b2 None None] MFA Rules not processed for user `d75d285e8f2e46aa9efb2107326ba0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:28.622271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bb55af0e-52ba-49ee-83cc-96e254bed0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:28.770073 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1182/2372] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:29.210355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b144-ffd6-4b32-9c79-380be227f9af None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:29.210980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b144-ffd6-4b32-9c79-380be227f9af None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:29.211459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955b144-ffd6-4b32-9c79-380be227f9af None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:29.213989 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1191/2373] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:51:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:29.220993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55af0e-52ba-49ee-83cc-96e254bed0b2 None None] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:51:29.429508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55af0e-52ba-49ee-83cc-96e254bed0b2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:29.597817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c78f73-32dd-4e1c-aeec-40b30f11397a None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:29.602097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c78f73-32dd-4e1c-aeec-40b30f11397a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:29.602564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c78f73-32dd-4e1c-aeec-40b30f11397a None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:29.605077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55af0e-52ba-49ee-83cc-96e254bed0b2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:29.608410 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1192/2374] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:51:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:29.611056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012ca4-4676-491b-a492-c117142d0058 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421cd4b0f20549f28318ae5277473f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6662171a08b64330a873a2ba1d14dedd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:29.612037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012ca4-4676-491b-a492-c117142d0058 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:29.612514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012ca4-4676-491b-a492-c117142d0058 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:29.612918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012ca4-4676-491b-a492-c117142d0058 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] PATH_INFO: `/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:29.614864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012ca4-4676-491b-a492-c117142d0058 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f8a9d38db7e4dd9ae36791c4ad7508d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:29.618097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012ca4-4676-491b-a492-c117142d0058 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:29.620600 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1183/2375] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:51:29 2022] GET /identity/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d => generated 393 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:29.627685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd08d-6a12-4941-95ea-01387e13b7d6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:29.627981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd08d-6a12-4941-95ea-01387e13b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:29.628263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd08d-6a12-4941-95ea-01387e13b7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:29.653210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4d2fd08d-6a12-4941-95ea-01387e13b7d6 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:29.655008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4d2fd08d-6a12-4941-95ea-01387e13b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:29.674104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012ca4-4676-491b-a492-c117142d0058 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:29.702010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012ca4-4676-491b-a492-c117142d0058 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:29.724623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:29.725718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:29.725999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:29.726438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:29.750618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:29.752235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:29.780397 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1184/2376] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:51:29.817160 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1193/2377] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:29.839564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:29.841056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:29.873931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fcf59-ec8f-4898-a293-eda45979c8f0 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:29.888619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa7ea8-8779-4b67-83fe-2b1eeb38e3f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:29.889440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7ea8-8779-4b67-83fe-2b1eeb38e3f5 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:29.889730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7ea8-8779-4b67-83fe-2b1eeb38e3f5 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:29.890010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7ea8-8779-4b67-83fe-2b1eeb38e3f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:29.935248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa7ea8-8779-4b67-83fe-2b1eeb38e3f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:29.939243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa7ea8-8779-4b67-83fe-2b1eeb38e3f5 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:29.972966 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1185/2378] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:30.339288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fd08d-6a12-4941-95ea-01387e13b7d6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:30.351924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fd08d-6a12-4941-95ea-01387e13b7d6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:30.363042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c76d84-ae2c-4de7-bf50-549d5656a570 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:30.364044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c76d84-ae2c-4de7-bf50-549d5656a570 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:30.364362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c76d84-ae2c-4de7-bf50-549d5656a570 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:30.364847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c76d84-ae2c-4de7-bf50-549d5656a570 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:30.366859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c3c76d84-ae2c-4de7-bf50-549d5656a570 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:30.380010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c76d84-ae2c-4de7-bf50-549d5656a570 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:30.381875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c76d84-ae2c-4de7-bf50-549d5656a570 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:30.393264 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1194/2379] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:30.908572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633a23e-0716-4ec9-8a6b-db179ff58b6d None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:30.909359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633a23e-0716-4ec9-8a6b-db179ff58b6d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:30.910094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633a23e-0716-4ec9-8a6b-db179ff58b6d None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:30.912124 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1186/2380] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:51:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:30.916580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddcc60-f6d7-4b49-b510-e89264689b33 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:30.917386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddcc60-f6d7-4b49-b510-e89264689b33 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:30.917798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddcc60-f6d7-4b49-b510-e89264689b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:30.920804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633a23e-0716-4ec9-8a6b-db179ff58b6d None None] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:51:30.947382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633a23e-0716-4ec9-8a6b-db179ff58b6d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:30.965194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fbddcc60-f6d7-4b49-b510-e89264689b33 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:30.966681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633a23e-0716-4ec9-8a6b-db179ff58b6d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:30.968708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fbddcc60-f6d7-4b49-b510-e89264689b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:30.973632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ed2d2-9eff-4b2f-8454-3496eebb798f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421cd4b0f20549f28318ae5277473f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6662171a08b64330a873a2ba1d14dedd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:30.974732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed2d2-9eff-4b2f-8454-3496eebb798f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:30.975195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed2d2-9eff-4b2f-8454-3496eebb798f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:30.975648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed2d2-9eff-4b2f-8454-3496eebb798f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] PATH_INFO: `/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:30.978093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ed2d2-9eff-4b2f-8454-3496eebb798f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f8a9d38db7e4dd9ae36791c4ad7508d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:30.981785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ed2d2-9eff-4b2f-8454-3496eebb798f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:30.983705 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1187/2381] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:51:30 2022] GET /identity/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d => generated 393 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:31.003185 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1195/2382] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:31.016865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ed2d2-9eff-4b2f-8454-3496eebb798f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:31.170780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ed2d2-9eff-4b2f-8454-3496eebb798f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:31.179615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:31.180498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:31.182525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:31.182931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:31.207714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:31.209523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:31.247054 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1188/2383] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:31.903309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e701f-5324-4513-9d96-e695a92c1dfa None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:31.903847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e701f-5324-4513-9d96-e695a92c1dfa None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:31.904361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e701f-5324-4513-9d96-e695a92c1dfa None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:31.906636 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1196/2384] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:31.918809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:51:31.950861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:31.984877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a76e-adb2-4088-867f-9049defc1439 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:31.999650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421cd4b0f20549f28318ae5277473f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6662171a08b64330a873a2ba1d14dedd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:32.000627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:32.000916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:32.001199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] PATH_INFO: `/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:32.002529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f8a9d38db7e4dd9ae36791c4ad7508d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:32.004711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:32.006524 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1189/2385] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:51:31 2022] GET /identity/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d => generated 393 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:34.121780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168f821-6873-4b0a-9908-797be5ea1db6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:34.122340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168f821-6873-4b0a-9908-797be5ea1db6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:34.122340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168f821-6873-4b0a-9908-797be5ea1db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:34.154531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c168f821-6873-4b0a-9908-797be5ea1db6 None None] MFA Rules not processed for user `08781c2dd21c4011b5eebde0436042c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:34.155762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c168f821-6873-4b0a-9908-797be5ea1db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:34.231572 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1197/2386] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:34.237099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:34.240949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:34.317237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ee27-f029-4b5c-8a5c-cdceec70b9f2 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:34.323301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68c39-3219-4f00-87f5-7de8dd95e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:34.324300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68c39-3219-4f00-87f5-7de8dd95e922 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:34.324841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68c39-3219-4f00-87f5-7de8dd95e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:34.325186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68c39-3219-4f00-87f5-7de8dd95e922 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:34.325956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa68c39-3219-4f00-87f5-7de8dd95e922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:34.328102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa68c39-3219-4f00-87f5-7de8dd95e922 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:34.373120 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1190/2387] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:34 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:34.377462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168f821-6873-4b0a-9908-797be5ea1db6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:34.399544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168f821-6873-4b0a-9908-797be5ea1db6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:34.508557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863c0a4-fece-4945-a134-0a1d2f0caa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:34.509853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863c0a4-fece-4945-a134-0a1d2f0caa02 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:34.510389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863c0a4-fece-4945-a134-0a1d2f0caa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:34.510910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863c0a4-fece-4945-a134-0a1d2f0caa02 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:34.513065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863c0a4-fece-4945-a134-0a1d2f0caa02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:34.516733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863c0a4-fece-4945-a134-0a1d2f0caa02 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:34.547855 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1198/2388] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:34 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:34.554609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68c39-3219-4f00-87f5-7de8dd95e922 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:34.571060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68c39-3219-4f00-87f5-7de8dd95e922 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:34.577770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e424ef-f9db-4753-be92-27c5dd100f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:34.579264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e424ef-f9db-4753-be92-27c5dd100f19 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:34.579799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e424ef-f9db-4753-be92-27c5dd100f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:34.580293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e424ef-f9db-4753-be92-27c5dd100f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:34.581408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e424ef-f9db-4753-be92-27c5dd100f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:34.583565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e424ef-f9db-4753-be92-27c5dd100f19 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:34.604529 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1191/2389] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:34.605329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863c0a4-fece-4945-a134-0a1d2f0caa02 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:34.616793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863c0a4-fece-4945-a134-0a1d2f0caa02 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:34.623077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4739bd8-39ac-478e-8295-b09b4cbe053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:34.623982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4739bd8-39ac-478e-8295-b09b4cbe053c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:34.624264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4739bd8-39ac-478e-8295-b09b4cbe053c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:34.624584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4739bd8-39ac-478e-8295-b09b4cbe053c admin admin] PATH_INFO: `/v3/projects/9f4dce37deef48de9f0dbae35d08257e/users/600eccefce944161ae08c77f40c7d31d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:34.643419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4739bd8-39ac-478e-8295-b09b4cbe053c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4dce37deef48de9f0dbae35d08257e, user_id=600eccefce944161ae08c77f40c7d31d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:34.646252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4739bd8-39ac-478e-8295-b09b4cbe053c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:34.661252 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1199/2390] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:34 2022] PUT /identity/v3/projects/9f4dce37deef48de9f0dbae35d08257e/users/600eccefce944161ae08c77f40c7d31d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:34.666108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e424ef-f9db-4753-be92-27c5dd100f19 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:34.677973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e424ef-f9db-4753-be92-27c5dd100f19 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:34.824142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77217be-4548-42ed-80a5-115df3a4a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:34.824858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77217be-4548-42ed-80a5-115df3a4a821 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:34.825167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77217be-4548-42ed-80a5-115df3a4a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:34.825549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77217be-4548-42ed-80a5-115df3a4a821 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:34.826224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77217be-4548-42ed-80a5-115df3a4a821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:34.831269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77217be-4548-42ed-80a5-115df3a4a821 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:34.852372 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1192/2391] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:51:34.856625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4739bd8-39ac-478e-8295-b09b4cbe053c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:34.868740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4739bd8-39ac-478e-8295-b09b4cbe053c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:34.874276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f4ee-05d3-409b-9be8-9719808da3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:34.875449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f4ee-05d3-409b-9be8-9719808da3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:34.875864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f4ee-05d3-409b-9be8-9719808da3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:34.876182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f4ee-05d3-409b-9be8-9719808da3bd admin admin] PATH_INFO: `/v3/projects/9f4dce37deef48de9f0dbae35d08257e/users/600eccefce944161ae08c77f40c7d31d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:34.878621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f4ee-05d3-409b-9be8-9719808da3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4dce37deef48de9f0dbae35d08257e, user_id=600eccefce944161ae08c77f40c7d31d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:34.881491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f4ee-05d3-409b-9be8-9719808da3bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:34.893284 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1200/2392] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:34 2022] PUT /identity/v3/projects/9f4dce37deef48de9f0dbae35d08257e/users/600eccefce944161ae08c77f40c7d31d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:35.206324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77217be-4548-42ed-80a5-115df3a4a821 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:35.222133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77217be-4548-42ed-80a5-115df3a4a821 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:35.270785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f4ee-05d3-409b-9be8-9719808da3bd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:35.331402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:35.332467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:35.332799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:35.333082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] PATH_INFO: `/v3/users/15d6257719804e1282ddd890e4a93711` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:35.334588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d6257719804e1282ddd890e4a93711)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:35.337698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:35.388782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f4ee-05d3-409b-9be8-9719808da3bd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:35.402251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:35.403842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:35.404151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d6257719804e1282ddd890e4a93711'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:35.404264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:35.404920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d6257719804e1282ddd890e4a93711'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:35.405603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d6257719804e1282ddd890e4a93711'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:35.407016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:35.409492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:35.427876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d6257719804e1282ddd890e4a93711'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:35.441488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-21e9610b-b605-469a-98a1-d25f00cd3d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d6257719804e1282ddd890e4a93711'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:35.461233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1193/2393] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:35 2022] DELETE /identity/v3/users/15d6257719804e1282ddd890e4a93711 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:35.465476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf82fc-a7f4-4aad-ad53-e1598839edbb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:35.465765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf82fc-a7f4-4aad-ad53-e1598839edbb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:35.466069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf82fc-a7f4-4aad-ad53-e1598839edbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:35.484817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9eaf82fc-a7f4-4aad-ad53-e1598839edbb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:35.486041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9eaf82fc-a7f4-4aad-ad53-e1598839edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:35.504168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:35.506057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:35.531071 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1201/2394] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:51:35.583546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1194/2395] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:35.616981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:35.619902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:35.788023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1af0c-2436-4186-9384-ed4fa9469089 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:35.828128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179616a-85bf-456c-acfb-53e178556879 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:35.828572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179616a-85bf-456c-acfb-53e178556879 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:35.829457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179616a-85bf-456c-acfb-53e178556879 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:35.831638 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1195/2396] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:35.850777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179616a-85bf-456c-acfb-53e178556879 None None] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:51:35.852967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1179616a-85bf-456c-acfb-53e178556879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:35.894726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:35.895643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:35.896191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:35.896501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:35.908385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:35.911461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:35.925717 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1202/2397] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:35.991883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179616a-85bf-456c-acfb-53e178556879 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:35.994588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1179616a-85bf-456c-acfb-53e178556879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:36.118855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179616a-85bf-456c-acfb-53e178556879 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:36.127004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421cd4b0f20549f28318ae5277473f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6662171a08b64330a873a2ba1d14dedd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:36.136519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:36.136930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:36.137355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] PATH_INFO: `/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:36.150347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f8a9d38db7e4dd9ae36791c4ad7508d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:36.152930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:36.155666 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1196/2398] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:51:35 2022] GET /identity/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d => generated 393 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:36.349014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:36.353086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:36.370145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308d5ef-162c-4d54-b352-4ffa2a7bb5c4 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:36.376045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:36.376981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:36.377281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:36.377542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] PATH_INFO: `/v3/projects/072ae18574974918b1d1bb5babdb7277` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:36.379430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072ae18574974918b1d1bb5babdb7277)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:36.382030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:36.441614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072ae18574974918b1d1bb5babdb7277', 'request_id': 'req-133be845-9ad7-4305-8788-9ff4f44db651'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.449344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072ae18574974918b1d1bb5babdb7277', 'request_id': 'req-133be845-9ad7-4305-8788-9ff4f44db651'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.461150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072ae18574974918b1d1bb5babdb7277', 'request_id': 'req-133be845-9ad7-4305-8788-9ff4f44db651'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.473459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] The token cache is being invalidate because project 072ae18574974918b1d1bb5babdb7277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:36.473745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.474594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.476841 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1203/2399] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:36 2022] DELETE /identity/v3/projects/072ae18574974918b1d1bb5babdb7277 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:36.480833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:36.483714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:36.499506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ada6af-31cb-4092-b3fe-767ae3bfeafc tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:36.559977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:36.562078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:36.562528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:36.562816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] PATH_INFO: `/v3/users/d75d285e8f2e46aa9efb2107326ba0fe` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:36.564265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75d285e8f2e46aa9efb2107326ba0fe)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:36.567400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:36.621593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75d285e8f2e46aa9efb2107326ba0fe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.622279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75d285e8f2e46aa9efb2107326ba0fe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.623445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75d285e8f2e46aa9efb2107326ba0fe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.636133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75d285e8f2e46aa9efb2107326ba0fe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.644815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb2693f2-0732-4be8-9df0-ac9f4cb9fed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75d285e8f2e46aa9efb2107326ba0fe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:36.658665 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1197/2400] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:36 2022] DELETE /identity/v3/users/d75d285e8f2e46aa9efb2107326ba0fe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:36.994944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:37.008291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be845-9ad7-4305-8788-9ff4f44db651 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:37.124787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:37.125899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.126230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.126556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] PATH_INFO: `/v3/projects/4587fd3337384c4b88b14143eefc576d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.127881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4587fd3337384c4b88b14143eefc576d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:37.130120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:37.210827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4587fd3337384c4b88b14143eefc576d', 'request_id': 'req-624e9bff-c1b7-4c30-95de-02acd6611a40'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:37.217152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4587fd3337384c4b88b14143eefc576d', 'request_id': 'req-624e9bff-c1b7-4c30-95de-02acd6611a40'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:37.227597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4587fd3337384c4b88b14143eefc576d', 'request_id': 'req-624e9bff-c1b7-4c30-95de-02acd6611a40'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:37.241765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] The token cache is being invalidate because project 4587fd3337384c4b88b14143eefc576d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:37.242062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:37.243025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-624e9bff-c1b7-4c30-95de-02acd6611a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:37.248529 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1204/2401] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:36 2022] DELETE /identity/v3/projects/4587fd3337384c4b88b14143eefc576d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:37.250157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69987-10c2-4b9a-8496-4382c6a1264e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.250451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69987-10c2-4b9a-8496-4382c6a1264e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.250768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69987-10c2-4b9a-8496-4382c6a1264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.273511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-41d69987-10c2-4b9a-8496-4382c6a1264e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:37.276081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41d69987-10c2-4b9a-8496-4382c6a1264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:37.378478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfefbd3-1e47-4ee9-a2f3-065f683574e6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.379072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfefbd3-1e47-4ee9-a2f3-065f683574e6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.379338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfefbd3-1e47-4ee9-a2f3-065f683574e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.382833 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1198/2402] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:37.406191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-adfefbd3-1e47-4ee9-a2f3-065f683574e6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:37.407979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-adfefbd3-1e47-4ee9-a2f3-065f683574e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:37.428098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69987-10c2-4b9a-8496-4382c6a1264e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:37.435420 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1205/2403] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:37.441966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69987-10c2-4b9a-8496-4382c6a1264e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:37.448805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:37.449851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.450496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.450957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.452209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:37.452701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:37.456251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:37.494627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfefbd3-1e47-4ee9-a2f3-065f683574e6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:37.504472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfefbd3-1e47-4ee9-a2f3-065f683574e6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:37.505324 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1199/2404] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:37.512614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516237f-4187-4e50-a820-01e44a836eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:37.513494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516237f-4187-4e50-a820-01e44a836eaf admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.514198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516237f-4187-4e50-a820-01e44a836eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.514611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516237f-4187-4e50-a820-01e44a836eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.515452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516237f-4187-4e50-a820-01e44a836eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:37.518209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516237f-4187-4e50-a820-01e44a836eaf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:37.576735 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1206/2405] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:37 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:37.580705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:37.606486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238297d7-c5cb-481f-b6b1-78825c66cb80 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:37.768430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23db3fb-88ae-4958-b157-785cb416cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:37.769110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23db3fb-88ae-4958-b157-785cb416cbcc admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.769598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23db3fb-88ae-4958-b157-785cb416cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.770026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23db3fb-88ae-4958-b157-785cb416cbcc admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.770884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23db3fb-88ae-4958-b157-785cb416cbcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:37.777317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23db3fb-88ae-4958-b157-785cb416cbcc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:37.818563 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1200/2406] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:37 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:37.825809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516237f-4187-4e50-a820-01e44a836eaf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:37.843448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516237f-4187-4e50-a820-01e44a836eaf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:37.851141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742e22-662d-4182-bd87-cc4c198d1228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:37.852131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742e22-662d-4182-bd87-cc4c198d1228 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.852810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742e22-662d-4182-bd87-cc4c198d1228 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.853927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742e22-662d-4182-bd87-cc4c198d1228 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.855055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742e22-662d-4182-bd87-cc4c198d1228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:37.857337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742e22-662d-4182-bd87-cc4c198d1228 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:37.882507 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1207/2407] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:37.886481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23db3fb-88ae-4958-b157-785cb416cbcc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:37.904344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23db3fb-88ae-4958-b157-785cb416cbcc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:37.913123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb324db-979e-4df0-821c-462ce4ca09d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:37.915153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb324db-979e-4df0-821c-462ce4ca09d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.915796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb324db-979e-4df0-821c-462ce4ca09d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.916278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb324db-979e-4df0-821c-462ce4ca09d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.918247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb324db-979e-4df0-821c-462ce4ca09d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:37.922199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb324db-979e-4df0-821c-462ce4ca09d9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:37.940436 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1201/2408] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:51:37.945258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742e22-662d-4182-bd87-cc4c198d1228 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:37.957797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742e22-662d-4182-bd87-cc4c198d1228 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:37.964494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd7bb-cb9e-4da0-8b42-31fc24512c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:37.966531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd7bb-cb9e-4da0-8b42-31fc24512c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:37.967176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd7bb-cb9e-4da0-8b42-31fc24512c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:37.967795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd7bb-cb9e-4da0-8b42-31fc24512c79 admin admin] PATH_INFO: `/v3/projects/d5d99fab3d9146caa7a7345c2a4f8c2d/users/babe088fdb624f6bb2a988121f95dc71/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:37.989227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd7bb-cb9e-4da0-8b42-31fc24512c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d99fab3d9146caa7a7345c2a4f8c2d, user_id=babe088fdb624f6bb2a988121f95dc71, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:37.996015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd7bb-cb9e-4da0-8b42-31fc24512c79 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:38.018614 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1208/2409] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:37 2022] PUT /identity/v3/projects/d5d99fab3d9146caa7a7345c2a4f8c2d/users/babe088fdb624f6bb2a988121f95dc71/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:38.028694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9dd7c-f2c6-4b29-97db-8faf83252461 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:38.028983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9dd7c-f2c6-4b29-97db-8faf83252461 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:38.029264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9dd7c-f2c6-4b29-97db-8faf83252461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:38.067105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-29c9dd7c-f2c6-4b29-97db-8faf83252461 None None] MFA Rules not processed for user `babe088fdb624f6bb2a988121f95dc71`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:38.068396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-29c9dd7c-f2c6-4b29-97db-8faf83252461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:38.169772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1202/2410] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:38.174122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd7bb-cb9e-4da0-8b42-31fc24512c79 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:38.301861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd7bb-cb9e-4da0-8b42-31fc24512c79 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:38.316573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52568774-0461-455a-8c12-29f114bf1b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:38.317537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52568774-0461-455a-8c12-29f114bf1b49 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:38.319061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52568774-0461-455a-8c12-29f114bf1b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:38.319061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52568774-0461-455a-8c12-29f114bf1b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:38.323537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52568774-0461-455a-8c12-29f114bf1b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:38.329933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52568774-0461-455a-8c12-29f114bf1b49 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:38.387641 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1209/2411] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:38 2022] POST /identity/v3/projects => generated 391 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:38.393097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9dd7c-f2c6-4b29-97db-8faf83252461 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:38.409309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f7eef-5cf6-4f95-956c-b2516be2f9a7 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:38.410397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f7eef-5cf6-4f95-956c-b2516be2f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:38.410709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f7eef-5cf6-4f95-956c-b2516be2f9a7 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:38.414396 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1210/2412] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:51:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:38.422174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9dd7c-f2c6-4b29-97db-8faf83252461 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:38.425436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f7eef-5cf6-4f95-956c-b2516be2f9a7 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:51:38.427907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-335f7eef-5cf6-4f95-956c-b2516be2f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:38.565464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65b8ea-a137-4dca-8618-c2999b468566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:38.567073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65b8ea-a137-4dca-8618-c2999b468566 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:38.567546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65b8ea-a137-4dca-8618-c2999b468566 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:38.568041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65b8ea-a137-4dca-8618-c2999b468566 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:38.569760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65b8ea-a137-4dca-8618-c2999b468566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:38.578708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65b8ea-a137-4dca-8618-c2999b468566 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:38.615213 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1203/2413] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:38 2022] POST /identity/v3/users => generated 302 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:51:38.619927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65b8ea-a137-4dca-8618-c2999b468566 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:38.646443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65b8ea-a137-4dca-8618-c2999b468566 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:38.658164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb15b71-1c20-4a8a-b082-86a61f3c3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:38.658853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb15b71-1c20-4a8a-b082-86a61f3c3423 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:38.659135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb15b71-1c20-4a8a-b082-86a61f3c3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:38.659412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb15b71-1c20-4a8a-b082-86a61f3c3423 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:38.660152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb15b71-1c20-4a8a-b082-86a61f3c3423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:38.662056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb15b71-1c20-4a8a-b082-86a61f3c3423 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:38.685832 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1204/2414] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:51:38.690444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb15b71-1c20-4a8a-b082-86a61f3c3423 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:38.696439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f7eef-5cf6-4f95-956c-b2516be2f9a7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:38.705506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-335f7eef-5cf6-4f95-956c-b2516be2f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:38.712558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb15b71-1c20-4a8a-b082-86a61f3c3423 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:38.734022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01eae-c2f1-4838-8730-844201858443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:38.734929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01eae-c2f1-4838-8730-844201858443 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:38.735208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01eae-c2f1-4838-8730-844201858443 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:38.735487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01eae-c2f1-4838-8730-844201858443 admin admin] PATH_INFO: `/v3/projects/674474eab77d4ebea9b500d64bdf9454/users/7d72584d13ff4a3989454bf3ad3bfddb/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:38.770715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01eae-c2f1-4838-8730-844201858443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674474eab77d4ebea9b500d64bdf9454, user_id=7d72584d13ff4a3989454bf3ad3bfddb, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:38.774153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01eae-c2f1-4838-8730-844201858443 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:38.805137 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1205/2415] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:38 2022] PUT /identity/v3/projects/674474eab77d4ebea9b500d64bdf9454/users/7d72584d13ff4a3989454bf3ad3bfddb/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:38.808735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01eae-c2f1-4838-8730-844201858443 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:38.870043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f7eef-5cf6-4f95-956c-b2516be2f9a7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:38.960083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01eae-c2f1-4838-8730-844201858443 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:38.966739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e243a-d53f-4208-83b8-984c8bc24049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:38.967768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e243a-d53f-4208-83b8-984c8bc24049 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:38.968069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e243a-d53f-4208-83b8-984c8bc24049 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:38.968437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e243a-d53f-4208-83b8-984c8bc24049 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:38.969186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e243a-d53f-4208-83b8-984c8bc24049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:38.971593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e243a-d53f-4208-83b8-984c8bc24049 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:38.986440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1206/2416] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:38.990246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e243a-d53f-4208-83b8-984c8bc24049 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:39.006119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e243a-d53f-4208-83b8-984c8bc24049 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:39.007988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206eb1a-670c-4150-b374-1d4aa838a53c tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421cd4b0f20549f28318ae5277473f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6662171a08b64330a873a2ba1d14dedd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:39.009083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206eb1a-670c-4150-b374-1d4aa838a53c tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:39.009479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206eb1a-670c-4150-b374-1d4aa838a53c tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:39.009820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206eb1a-670c-4150-b374-1d4aa838a53c tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] PATH_INFO: `/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:39.012493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206eb1a-670c-4150-b374-1d4aa838a53c tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f8a9d38db7e4dd9ae36791c4ad7508d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:39.012855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3094fd-4b65-4829-b3a0-81c8563a3ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:39.013765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3094fd-4b65-4829-b3a0-81c8563a3ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:39.014049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3094fd-4b65-4829-b3a0-81c8563a3ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:39.014328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3094fd-4b65-4829-b3a0-81c8563a3ea5 admin admin] PATH_INFO: `/v3/projects/674474eab77d4ebea9b500d64bdf9454/users/7d72584d13ff4a3989454bf3ad3bfddb/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:39.014587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206eb1a-670c-4150-b374-1d4aa838a53c tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:39.016753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3094fd-4b65-4829-b3a0-81c8563a3ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674474eab77d4ebea9b500d64bdf9454, user_id=7d72584d13ff4a3989454bf3ad3bfddb, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:39.020229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3094fd-4b65-4829-b3a0-81c8563a3ea5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:39.021480 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1211/2417] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:51:38 2022] GET /identity/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d => generated 393 bytes in 597 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:51:39.049838 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1207/2418] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:38 2022] PUT /identity/v3/projects/674474eab77d4ebea9b500d64bdf9454/users/7d72584d13ff4a3989454bf3ad3bfddb/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:39.062660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48d4d5-6bdb-44d9-8c8e-632fe5133c77 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:39.062957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48d4d5-6bdb-44d9-8c8e-632fe5133c77 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:39.063239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48d4d5-6bdb-44d9-8c8e-632fe5133c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:39.109821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4a48d4d5-6bdb-44d9-8c8e-632fe5133c77 None None] MFA Rules not processed for user `7d72584d13ff4a3989454bf3ad3bfddb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:39.111643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4a48d4d5-6bdb-44d9-8c8e-632fe5133c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:39.231589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1212/2419] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:39.847708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3094fd-4b65-4829-b3a0-81c8563a3ea5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:40.005108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3094fd-4b65-4829-b3a0-81c8563a3ea5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:40.015433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:40.016109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:40.016452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:40.016734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:40.034473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:40.036116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:40.060579 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1208/2420] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:41.088888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548bd5-8b65-4f3d-8e7a-067cc58519a1 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:41.089875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548bd5-8b65-4f3d-8e7a-067cc58519a1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:41.090318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548bd5-8b65-4f3d-8e7a-067cc58519a1 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:41.092705 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1213/2421] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:51:41.097993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:51:41.115688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:41.244123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fd937-834c-42a8-b52b-123ada14d234 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:41.250669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09909266-ca86-4774-96a0-f438a7fa43b3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421cd4b0f20549f28318ae5277473f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6662171a08b64330a873a2ba1d14dedd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:41.252276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909266-ca86-4774-96a0-f438a7fa43b3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:41.252863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909266-ca86-4774-96a0-f438a7fa43b3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:41.253398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909266-ca86-4774-96a0-f438a7fa43b3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] PATH_INFO: `/v3/projects/3ac3d148f3e14ea9a52e492597f8f54d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:41.255039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09909266-ca86-4774-96a0-f438a7fa43b3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorizing `identity:get_project(project_id=3ac3d148f3e14ea9a52e492597f8f54d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:41.258679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09909266-ca86-4774-96a0-f438a7fa43b3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:41.276040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1209/2422] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:51:41 2022] GET /identity/v3/projects/3ac3d148f3e14ea9a52e492597f8f54d => generated 395 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:41.818436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42548bd5-8b65-4f3d-8e7a-067cc58519a1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:41.963113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42548bd5-8b65-4f3d-8e7a-067cc58519a1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:41.968652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:41.969635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:41.970041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:41.970577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] PATH_INFO: `/v3/users/babe088fdb624f6bb2a988121f95dc71` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:41.971870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=babe088fdb624f6bb2a988121f95dc71)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:41.974200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:42.081097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babe088fdb624f6bb2a988121f95dc71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.110715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babe088fdb624f6bb2a988121f95dc71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.124610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babe088fdb624f6bb2a988121f95dc71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.125644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babe088fdb624f6bb2a988121f95dc71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.126691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babe088fdb624f6bb2a988121f95dc71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.156024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1214/2423] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:41 2022] DELETE /identity/v3/users/babe088fdb624f6bb2a988121f95dc71 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:42.160583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef10855-0aad-49a0-940b-b452b15da8d1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:42.161116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef10855-0aad-49a0-940b-b452b15da8d1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:42.161116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef10855-0aad-49a0-940b-b452b15da8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:42.196929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0ef10855-0aad-49a0-940b-b452b15da8d1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:42.205639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0ef10855-0aad-49a0-940b-b452b15da8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:42.323468 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1210/2424] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:42.341632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:42.343171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:42.431438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bd634-7f5d-471c-abaa-ba00322fe748 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:42.435574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe0d9a-b1dc-49a9-ae06-d69589a73e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:42.436240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe0d9a-b1dc-49a9-ae06-d69589a73e59 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:42.436625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe0d9a-b1dc-49a9-ae06-d69589a73e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:42.437048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe0d9a-b1dc-49a9-ae06-d69589a73e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:42.448147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe0d9a-b1dc-49a9-ae06-d69589a73e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:42.449797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe0d9a-b1dc-49a9-ae06-d69589a73e59 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:42.461480 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1215/2425] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:42.610822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef10855-0aad-49a0-940b-b452b15da8d1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:42.612283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0ef10855-0aad-49a0-940b-b452b15da8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:42.633734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef10855-0aad-49a0-940b-b452b15da8d1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:42.654340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:42.655236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:42.655520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:42.655797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] PATH_INFO: `/v3/users/5fdc6f4482de487b825316c486cd3cae` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:42.661394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fdc6f4482de487b825316c486cd3cae)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:42.664284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:42.857842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fdc6f4482de487b825316c486cd3cae'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.859144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fdc6f4482de487b825316c486cd3cae'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.860566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fdc6f4482de487b825316c486cd3cae'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.891462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fdc6f4482de487b825316c486cd3cae'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.915804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fdc6f4482de487b825316c486cd3cae'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:42.939733 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1211/2426] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:42 2022] DELETE /identity/v3/users/5fdc6f4482de487b825316c486cd3cae => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:42.944668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462de51-b931-4258-b5e2-4484d33ec92d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:42.945083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462de51-b931-4258-b5e2-4484d33ec92d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:42.945488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462de51-b931-4258-b5e2-4484d33ec92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:42.980883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4462de51-b931-4258-b5e2-4484d33ec92d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:42.982378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4462de51-b931-4258-b5e2-4484d33ec92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:43.078620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1216/2427] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:43.141425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:43.144524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:43.245565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925be22-9f60-4c7f-b9b8-6f3a06a8413b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:43.260819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:43.261496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:43.261782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:43.262380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:43.280177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:43.281869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:43.305155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1212/2428] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:43.895057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611a148-eea1-4e01-b285-8f30146efc59 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:43.895519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611a148-eea1-4e01-b285-8f30146efc59 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:43.897555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611a148-eea1-4e01-b285-8f30146efc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:43.911422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:43.915372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:43.950607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3466c3b-3d8d-409a-bbb8-113558996eb3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:43.970666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:43.972865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:43.974334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:43.976549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] PATH_INFO: `/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:43.978919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1611a148-eea1-4e01-b285-8f30146efc59 None None] MFA Rules not processed for user `600eccefce944161ae08c77f40c7d31d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:43.980270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8a9d38db7e4dd9ae36791c4ad7508d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:43.980618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1611a148-eea1-4e01-b285-8f30146efc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:43.982296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:44.068904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8a9d38db7e4dd9ae36791c4ad7508d', 'request_id': 'req-efd349aa-ceda-4592-ac57-a2c3d64b1809'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.081623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8a9d38db7e4dd9ae36791c4ad7508d', 'request_id': 'req-efd349aa-ceda-4592-ac57-a2c3d64b1809'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.095002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8a9d38db7e4dd9ae36791c4ad7508d', 'request_id': 'req-efd349aa-ceda-4592-ac57-a2c3d64b1809'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.099426 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1217/2429] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:44.102132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611a148-eea1-4e01-b285-8f30146efc59 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:44.103700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1611a148-eea1-4e01-b285-8f30146efc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:44.111896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] The token cache is being invalidate because project 7f8a9d38db7e4dd9ae36791c4ad7508d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:44.112197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.113194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.116370 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1213/2430] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:43 2022] DELETE /identity/v3/projects/7f8a9d38db7e4dd9ae36791c4ad7508d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:44.116370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:44.118069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:44.130450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611a148-eea1-4e01-b285-8f30146efc59 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:44.217828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd349aa-ceda-4592-ac57-a2c3d64b1809 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:44.223881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:44.225683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:44.226176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:44.226646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] PATH_INFO: `/v3/projects/d5d99fab3d9146caa7a7345c2a4f8c2d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:44.227572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:44.228660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:44.228951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:44.229227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] PATH_INFO: `/v3/users/450a0144db174551aabee6fba0f5aa8d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:44.230756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] RBAC: Authorizing `identity:delete_user(user_id=450a0144db174551aabee6fba0f5aa8d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:44.231105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d99fab3d9146caa7a7345c2a4f8c2d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:44.232515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:44.233594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:44.310368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d99fab3d9146caa7a7345c2a4f8c2d', 'request_id': 'req-86c3b588-b6c8-481e-8419-f74bcf79fe88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.320582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450a0144db174551aabee6fba0f5aa8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.321939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d99fab3d9146caa7a7345c2a4f8c2d', 'request_id': 'req-86c3b588-b6c8-481e-8419-f74bcf79fe88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.339655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450a0144db174551aabee6fba0f5aa8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.346870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d99fab3d9146caa7a7345c2a4f8c2d', 'request_id': 'req-86c3b588-b6c8-481e-8419-f74bcf79fe88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.353643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450a0144db174551aabee6fba0f5aa8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.354297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450a0144db174551aabee6fba0f5aa8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.355004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450a0144db174551aabee6fba0f5aa8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.382615 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1218/2431] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:44 2022] DELETE /identity/v3/users/450a0144db174551aabee6fba0f5aa8d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:44.387539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:44.389565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:44.405162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] The token cache is being invalidate because project d5d99fab3d9146caa7a7345c2a4f8c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:44.406451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.408956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.413460 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1214/2432] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:44 2022] DELETE /identity/v3/projects/d5d99fab3d9146caa7a7345c2a4f8c2d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:44.416719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:44.421162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:44.551942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe618-90f0-4b2f-afad-a2f78521488e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:44.558660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d28e21-231a-46f1-b1e3-2da6b3c02874 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:44.559247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d28e21-231a-46f1-b1e3-2da6b3c02874 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:44.559628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d28e21-231a-46f1-b1e3-2da6b3c02874 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:44.560023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d28e21-231a-46f1-b1e3-2da6b3c02874 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:44.562173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-29d28e21-231a-46f1-b1e3-2da6b3c02874 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:44.575624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b588-b6c8-481e-8419-f74bcf79fe88 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:44.661207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d28e21-231a-46f1-b1e3-2da6b3c02874 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:44.663529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d28e21-231a-46f1-b1e3-2da6b3c02874 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:44.691996 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1219/2433] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:44.694622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13dd58-4858-40cd-94bd-8615ff156dd9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:44.694963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13dd58-4858-40cd-94bd-8615ff156dd9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:44.695216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13dd58-4858-40cd-94bd-8615ff156dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:44.708068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:44.709840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:44.711243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:44.711609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] PATH_INFO: `/v3/users/421cd4b0f20549f28318ae5277473f1a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:44.713642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421cd4b0f20549f28318ae5277473f1a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:44.714731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5c13dd58-4858-40cd-94bd-8615ff156dd9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:44.719120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5c13dd58-4858-40cd-94bd-8615ff156dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:44.719209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:44.736933 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1220/2434] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:44.739113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13dd58-4858-40cd-94bd-8615ff156dd9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:44.741083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5c13dd58-4858-40cd-94bd-8615ff156dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:44.753649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13dd58-4858-40cd-94bd-8615ff156dd9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:44.764979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:44.766167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:44.766674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:44.767133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] PATH_INFO: `/v3/users/7d72584d13ff4a3989454bf3ad3bfddb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:44.771541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d72584d13ff4a3989454bf3ad3bfddb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:44.773879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:44.833002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421cd4b0f20549f28318ae5277473f1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.836113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421cd4b0f20549f28318ae5277473f1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.839312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421cd4b0f20549f28318ae5277473f1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.856666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421cd4b0f20549f28318ae5277473f1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.879583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421cd4b0f20549f28318ae5277473f1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.911436 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1215/2435] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:44 2022] DELETE /identity/v3/users/421cd4b0f20549f28318ae5277473f1a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:44.912098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d72584d13ff4a3989454bf3ad3bfddb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:44.912596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:44.914964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:44.976786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d72584d13ff4a3989454bf3ad3bfddb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.009754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d72584d13ff4a3989454bf3ad3bfddb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.010542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d72584d13ff4a3989454bf3ad3bfddb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.011164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d72584d13ff4a3989454bf3ad3bfddb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.013365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ae8b-7be9-4fc4-9615-995040223a05 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:45.018327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d5ea9-39e8-4154-abf7-bbe032f13e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:45.019192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d5ea9-39e8-4154-abf7-bbe032f13e19 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:45.019525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d5ea9-39e8-4154-abf7-bbe032f13e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:45.019850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d5ea9-39e8-4154-abf7-bbe032f13e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:45.023718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7b4d5ea9-39e8-4154-abf7-bbe032f13e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:45.053802 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1221/2436] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:44 2022] DELETE /identity/v3/users/7d72584d13ff4a3989454bf3ad3bfddb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:45.140935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d5ea9-39e8-4154-abf7-bbe032f13e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:45.143094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d5ea9-39e8-4154-abf7-bbe032f13e19 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:45.156892 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1216/2437] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:45.692375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:45.694456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:45.848015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da5f10-65d5-4d3a-a9be-ad261e98102e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:45.853866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:45.855038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:45.855456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:45.855948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] PATH_INFO: `/v3/projects/9809b88a7cf44fba908be3c1736b1f71` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:45.857199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9809b88a7cf44fba908be3c1736b1f71)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:45.859419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:45.919815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9809b88a7cf44fba908be3c1736b1f71', 'request_id': 'req-7cac2ea0-8081-4879-843c-a591642fbd40'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.926113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9809b88a7cf44fba908be3c1736b1f71', 'request_id': 'req-7cac2ea0-8081-4879-843c-a591642fbd40'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.940547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9809b88a7cf44fba908be3c1736b1f71', 'request_id': 'req-7cac2ea0-8081-4879-843c-a591642fbd40'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.960593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] The token cache is being invalidate because project 9809b88a7cf44fba908be3c1736b1f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:45.960896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.962385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cac2ea0-8081-4879-843c-a591642fbd40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:45.968886 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1222/2438] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:45 2022] DELETE /identity/v3/projects/9809b88a7cf44fba908be3c1736b1f71 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:45.970012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab773a08-63de-4286-9d0f-e72de3b990b8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:45.970511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab773a08-63de-4286-9d0f-e72de3b990b8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:45.970801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab773a08-63de-4286-9d0f-e72de3b990b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:46.007604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ab773a08-63de-4286-9d0f-e72de3b990b8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:46.009877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ab773a08-63de-4286-9d0f-e72de3b990b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:46.127677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1217/2439] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:46.130259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915bca-202f-40e9-9d15-c127d23b2059 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:46.130545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915bca-202f-40e9-9d15-c127d23b2059 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:46.130827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915bca-202f-40e9-9d15-c127d23b2059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:46.161701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-25915bca-202f-40e9-9d15-c127d23b2059 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:46.163809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-25915bca-202f-40e9-9d15-c127d23b2059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:46.181120 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1223/2440] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:46.181888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab773a08-63de-4286-9d0f-e72de3b990b8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:46.196061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab773a08-63de-4286-9d0f-e72de3b990b8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:46.213052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:46.213743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:46.214029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:46.214444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:46.215190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:46.215504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:46.217274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:46.259802 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1218/2441] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:46.263116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25915bca-202f-40e9-9d15-c127d23b2059 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:46.278753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25915bca-202f-40e9-9d15-c127d23b2059 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:46.292089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:46.294865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:46.295284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:46.298714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:46.299780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:46.311966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:46.403071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:46.407510 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1224/2442] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:46 2022] POST /identity/v3/projects => generated 405 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:46.419741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d47856-c3bd-4ba9-aca6-cb145934d5d1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:46.467441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:46.470595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:46.510586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:46.512677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:46.513249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:46.513748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:46.514659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:46.518190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:46.564617 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1219/2443] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:46 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:51:46.565628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:46.567886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:46.583595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27607-1199-4bd6-8784-01f1267a4d72 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:46.590336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:46.592479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:46.592479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:46.593073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] PATH_INFO: `/v3/projects/6662171a08b64330a873a2ba1d14dedd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:46.595458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6662171a08b64330a873a2ba1d14dedd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:46.597635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:46.668599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59ab1-8676-4589-b9b3-8be023917720 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:46.693446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6662171a08b64330a873a2ba1d14dedd', 'request_id': 'req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:46.720739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6662171a08b64330a873a2ba1d14dedd', 'request_id': 'req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:46.758259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6662171a08b64330a873a2ba1d14dedd', 'request_id': 'req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:46.799602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] The token cache is being invalidate because project 6662171a08b64330a873a2ba1d14dedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:46.800048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:46.804024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:46.821338 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1220/2444] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:46 2022] DELETE /identity/v3/projects/6662171a08b64330a873a2ba1d14dedd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:46.822265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:46.823402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:46.823687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:46.823967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] PATH_INFO: `/v3/projects/674474eab77d4ebea9b500d64bdf9454` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:46.825654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674474eab77d4ebea9b500d64bdf9454)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:46.825855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:46.827940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:46.834705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:46.891495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118b8b-37ec-4e93-b8bb-a7fc7a592df6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:46.911619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:46.912252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:46.912252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:46.912837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:46.913593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:46.915273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:46.966019 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1221/2445] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:46.970504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:46.976585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:47.001461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674474eab77d4ebea9b500d64bdf9454', 'request_id': 'req-84851f0e-36a9-4891-b86e-a1ef8f32ad36'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.018947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674474eab77d4ebea9b500d64bdf9454', 'request_id': 'req-84851f0e-36a9-4891-b86e-a1ef8f32ad36'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.022742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf520-d7cc-4d91-987c-b2ad4ee9738a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:47.039008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674474eab77d4ebea9b500d64bdf9454', 'request_id': 'req-84851f0e-36a9-4891-b86e-a1ef8f32ad36'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.055695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] The token cache is being invalidate because project 674474eab77d4ebea9b500d64bdf9454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:47.056368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.057271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.059557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1225/2446] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:46 2022] DELETE /identity/v3/projects/674474eab77d4ebea9b500d64bdf9454 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:47.060784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:47.074920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:47.122724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:47.123606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:47.124380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:47.124380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] PATH_INFO: `/v3/users/db5e468ff18c44389e084b73f4f5daf7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:47.125894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5e468ff18c44389e084b73f4f5daf7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:47.128323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:47.208351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5e468ff18c44389e084b73f4f5daf7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.209275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5e468ff18c44389e084b73f4f5daf7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.209990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5e468ff18c44389e084b73f4f5daf7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.248508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5e468ff18c44389e084b73f4f5daf7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.276445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f834a14b-11b6-420c-a298-f2e10ee11705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5e468ff18c44389e084b73f4f5daf7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:47.281338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84851f0e-36a9-4891-b86e-a1ef8f32ad36 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:47.294913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:47.295785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:47.296082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:47.296792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:47.297148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1222/2447] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:46 2022] DELETE /identity/v3/users/db5e468ff18c44389e084b73f4f5daf7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:47.297546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:47.300107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f0ba-9e92-4c71-ba10-b030826386a9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:47.301172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f0ba-9e92-4c71-ba10-b030826386a9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:47.302110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f0ba-9e92-4c71-ba10-b030826386a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:47.318032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:47.351334 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1226/2448] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:47.353784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:47.360268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:47.361922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e4f8f0ba-9e92-4c71-ba10-b030826386a9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:47.368464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e4f8f0ba-9e92-4c71-ba10-b030826386a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:47.408568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ce577-9ab4-44c5-b045-9fb6a7ea06e3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:47.544863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1223/2449] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:47.546600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519bd4-0115-49c5-b6f1-6ab0b38d3ca0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:47.546895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519bd4-0115-49c5-b6f1-6ab0b38d3ca0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:47.547188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82519bd4-0115-49c5-b6f1-6ab0b38d3ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:47.586467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-82519bd4-0115-49c5-b6f1-6ab0b38d3ca0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:47.587920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-82519bd4-0115-49c5-b6f1-6ab0b38d3ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:47.599218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea7bc-4c6c-47c5-8732-08e5123a1bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:47.610462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1224/2450] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:47.611724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82519bd4-0115-49c5-b6f1-6ab0b38d3ca0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:47.615405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea7bc-4c6c-47c5-8732-08e5123a1bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:47.620749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea7bc-4c6c-47c5-8732-08e5123a1bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:47.621166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea7bc-4c6c-47c5-8732-08e5123a1bd4 admin admin] PATH_INFO: `/v3/projects/e2188c9b692f4062bb3f678a54ce6b12/users/29b849c08c724ad3ae642bb1bd8aa288/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:47.631978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82519bd4-0115-49c5-b6f1-6ab0b38d3ca0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:47.653763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:47.654447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:47.654728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:47.655074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:47.655721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:47.656636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:47.657840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:47.671051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ea7bc-4c6c-47c5-8732-08e5123a1bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2188c9b692f4062bb3f678a54ce6b12, user_id=29b849c08c724ad3ae642bb1bd8aa288, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:47.676123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ea7bc-4c6c-47c5-8732-08e5123a1bd4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:47.698956 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1225/2451] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:47.699911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:47.721613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09876686-0c77-4e5d-972f-5918a4ded914 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:47.729412 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1227/2452] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:47 2022] PUT /identity/v3/projects/e2188c9b692f4062bb3f678a54ce6b12/users/29b849c08c724ad3ae642bb1bd8aa288/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:47.734747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a58a4-0702-455b-a253-7cc704ea8652 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:47.734747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a58a4-0702-455b-a253-7cc704ea8652 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:47.734747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a58a4-0702-455b-a253-7cc704ea8652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:47.800206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-134a58a4-0702-455b-a253-7cc704ea8652 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:47.801775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-134a58a4-0702-455b-a253-7cc704ea8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:47.898479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24008c6-d2e4-4cf0-b4b1-09bda32d76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:47.899160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24008c6-d2e4-4cf0-b4b1-09bda32d76c6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:47.899443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24008c6-d2e4-4cf0-b4b1-09bda32d76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:47.899722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24008c6-d2e4-4cf0-b4b1-09bda32d76c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:47.900441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24008c6-d2e4-4cf0-b4b1-09bda32d76c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:47.902375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24008c6-d2e4-4cf0-b4b1-09bda32d76c6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:47.963874 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1226/2453] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:47 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:47.964958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24008c6-d2e4-4cf0-b4b1-09bda32d76c6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:48.018838 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1228/2454] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:48.046300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a58a4-0702-455b-a253-7cc704ea8652 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:48.048078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-134a58a4-0702-455b-a253-7cc704ea8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:48.123599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24008c6-d2e4-4cf0-b4b1-09bda32d76c6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:48.139172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ee7f-9699-4555-a71f-133544a43ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:48.139919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ee7f-9699-4555-a71f-133544a43ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:48.140207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ee7f-9699-4555-a71f-133544a43ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:48.140523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ee7f-9699-4555-a71f-133544a43ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:48.141371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ee7f-9699-4555-a71f-133544a43ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:48.143596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ee7f-9699-4555-a71f-133544a43ff5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:48.199773 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1227/2455] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:47 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:48.206041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ee7f-9699-4555-a71f-133544a43ff5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:48.244397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ee7f-9699-4555-a71f-133544a43ff5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:48.266881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1a6aa-c81b-42a8-9c33-3fa725a495bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:48.270250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1a6aa-c81b-42a8-9c33-3fa725a495bb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:48.270250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1a6aa-c81b-42a8-9c33-3fa725a495bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:48.273255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1a6aa-c81b-42a8-9c33-3fa725a495bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:48.274104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1a6aa-c81b-42a8-9c33-3fa725a495bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:48.282352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1a6aa-c81b-42a8-9c33-3fa725a495bb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:48.323525 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1228/2456] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:48.325532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1a6aa-c81b-42a8-9c33-3fa725a495bb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:48.359522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1a6aa-c81b-42a8-9c33-3fa725a495bb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:48.387098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:48.387876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:48.390595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:48.390917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:48.393482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a58a4-0702-455b-a253-7cc704ea8652 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:48.394489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:48.399601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:48.448123 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1229/2457] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:48.450163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:48.456418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:48.516844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06bd58-af6f-4d2a-a1f0-6dd1d3399c64 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:48.582808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:48.583704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:48.583976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:48.584277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] PATH_INFO: `/v3/projects/3ac3d148f3e14ea9a52e492597f8f54d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:48.597727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac3d148f3e14ea9a52e492597f8f54d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:48.599779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:48.604414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998379d2-ea8e-43be-8e84-23b2ac784515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:48.604414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998379d2-ea8e-43be-8e84-23b2ac784515 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:48.605130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998379d2-ea8e-43be-8e84-23b2ac784515 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:48.605838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998379d2-ea8e-43be-8e84-23b2ac784515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:48.694921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998379d2-ea8e-43be-8e84-23b2ac784515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:48.696363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998379d2-ea8e-43be-8e84-23b2ac784515 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:48.719423 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1229/2458] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:48.737458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998379d2-ea8e-43be-8e84-23b2ac784515 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:48.763416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998379d2-ea8e-43be-8e84-23b2ac784515 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:48.766161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac3d148f3e14ea9a52e492597f8f54d', 'request_id': 'req-de193f21-0918-4c90-8f4d-1bfd489544a5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:48.788724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac3d148f3e14ea9a52e492597f8f54d', 'request_id': 'req-de193f21-0918-4c90-8f4d-1bfd489544a5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:48.814245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac3d148f3e14ea9a52e492597f8f54d', 'request_id': 'req-de193f21-0918-4c90-8f4d-1bfd489544a5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:48.838428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] The token cache is being invalidate because project 3ac3d148f3e14ea9a52e492597f8f54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:48.838727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:48.843187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de193f21-0918-4c90-8f4d-1bfd489544a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:48.857639 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1230/2459] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:48 2022] DELETE /identity/v3/projects/3ac3d148f3e14ea9a52e492597f8f54d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:48.859791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae00f-1a10-49c6-8a4a-e4b865abbe2b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:48.860083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae00f-1a10-49c6-8a4a-e4b865abbe2b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:48.860395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae00f-1a10-49c6-8a4a-e4b865abbe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:48.941158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42f281-6009-48af-a9d7-e23c40f8b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:48.944698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f281-6009-48af-a9d7-e23c40f8b237 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:48.944985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f281-6009-48af-a9d7-e23c40f8b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:48.945267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f281-6009-48af-a9d7-e23c40f8b237 admin admin] PATH_INFO: `/v3/projects/97f645d79d2a4f88a798505443341fb7/users/e3c6ec50f5ca4bbeac3f1204394291eb/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:48.950621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7f4ae00f-1a10-49c6-8a4a-e4b865abbe2b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:48.951886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7f4ae00f-1a10-49c6-8a4a-e4b865abbe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:48.989885 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1231/2460] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:48.995380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc34ad-d462-4e13-9740-25715d61fc7e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:48.995683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc34ad-d462-4e13-9740-25715d61fc7e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:48.995942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc34ad-d462-4e13-9740-25715d61fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:48.999910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42f281-6009-48af-a9d7-e23c40f8b237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f645d79d2a4f88a798505443341fb7, user_id=e3c6ec50f5ca4bbeac3f1204394291eb, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:49.006082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42f281-6009-48af-a9d7-e23c40f8b237 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:49.045611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a6bc34ad-d462-4e13-9740-25715d61fc7e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:49.046928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a6bc34ad-d462-4e13-9740-25715d61fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:49.059054 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1230/2461] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:48 2022] PUT /identity/v3/projects/97f645d79d2a4f88a798505443341fb7/users/e3c6ec50f5ca4bbeac3f1204394291eb/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:49.074219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0be5-1787-4f3a-81a0-0d959ccb8009 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:49.075542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0be5-1787-4f3a-81a0-0d959ccb8009 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:49.075826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0be5-1787-4f3a-81a0-0d959ccb8009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:49.087737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1232/2462] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:49.093879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc34ad-d462-4e13-9740-25715d61fc7e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.120786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc34ad-d462-4e13-9740-25715d61fc7e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:49.144748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-517a0be5-1787-4f3a-81a0-0d959ccb8009 None None] MFA Rules not processed for user `e3c6ec50f5ca4bbeac3f1204394291eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:49.146247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-517a0be5-1787-4f3a-81a0-0d959ccb8009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:49.304012 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1231/2463] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:49.309617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0be5-1787-4f3a-81a0-0d959ccb8009 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.309869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:49.310733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:49.311115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:49.311245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-517a0be5-1787-4f3a-81a0-0d959ccb8009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:49.311574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:49.313121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:49.313121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:49.314830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:49.326748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0be5-1787-4f3a-81a0-0d959ccb8009 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:49.332150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab0630-d277-4f80-bbae-00723cc168e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:49.333270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0630-d277-4f80-bbae-00723cc168e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:49.333270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0630-d277-4f80-bbae-00723cc168e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:49.333471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0630-d277-4f80-bbae-00723cc168e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:49.334893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab0630-d277-4f80-bbae-00723cc168e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:49.337348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab0630-d277-4f80-bbae-00723cc168e1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:49.349188 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1233/2464] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:49.351039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.370606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1232/2465] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:49 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:51:49.374405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab0630-d277-4f80-bbae-00723cc168e1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.375551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d2a1b-a77f-48fd-b734-89aad99a5867 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:49.531364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b4d8-8ebe-4f32-b532-887ab393b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:49.532615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b4d8-8ebe-4f32-b532-887ab393b514 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:49.534282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b4d8-8ebe-4f32-b532-887ab393b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:49.534669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b4d8-8ebe-4f32-b532-887ab393b514 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:49.536087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9b4d8-8ebe-4f32-b532-887ab393b514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:49.540989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9b4d8-8ebe-4f32-b532-887ab393b514 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:49.574968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab0630-d277-4f80-bbae-00723cc168e1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:49.580903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d04f5-6057-4178-b693-0d908dde7334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:49.582040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d04f5-6057-4178-b693-0d908dde7334 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:49.582507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d04f5-6057-4178-b693-0d908dde7334 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:49.582936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d04f5-6057-4178-b693-0d908dde7334 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:49.583786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d04f5-6057-4178-b693-0d908dde7334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:49.587134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d04f5-6057-4178-b693-0d908dde7334 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:49.609226 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1234/2466] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:49 2022] POST /identity/v3/projects => generated 401 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:49.611040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b4d8-8ebe-4f32-b532-887ab393b514 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.621719 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1233/2467] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:49 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:49.623674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d04f5-6057-4178-b693-0d908dde7334 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.644015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d04f5-6057-4178-b693-0d908dde7334 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:49.721396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f81b7-bb8f-4a49-a817-0e3bedf23329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:49.722082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f81b7-bb8f-4a49-a817-0e3bedf23329 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:49.722434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f81b7-bb8f-4a49-a817-0e3bedf23329 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:49.723106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f81b7-bb8f-4a49-a817-0e3bedf23329 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:49.723901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f81b7-bb8f-4a49-a817-0e3bedf23329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:49.731187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f81b7-bb8f-4a49-a817-0e3bedf23329 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:49.742800 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1234/2468] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:49.747749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f81b7-bb8f-4a49-a817-0e3bedf23329 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.760596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f81b7-bb8f-4a49-a817-0e3bedf23329 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:49.766422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688e45-cbe8-4da7-8a68-8350493dc6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:49.767971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688e45-cbe8-4da7-8a68-8350493dc6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:49.768257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688e45-cbe8-4da7-8a68-8350493dc6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:49.768875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688e45-cbe8-4da7-8a68-8350493dc6d5 admin admin] PATH_INFO: `/v3/projects/36233fa44d35474f80063230c496d496/users/5608e63a5941422f8082a017b5b3998f/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:49.776862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b4d8-8ebe-4f32-b532-887ab393b514 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:49.784240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcc322-1afa-4406-beeb-9ad0fb5e4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:49.785285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcc322-1afa-4406-beeb-9ad0fb5e4ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:49.790411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7688e45-cbe8-4da7-8a68-8350493dc6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36233fa44d35474f80063230c496d496, user_id=5608e63a5941422f8082a017b5b3998f, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:49.793708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7688e45-cbe8-4da7-8a68-8350493dc6d5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:49.795340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcc322-1afa-4406-beeb-9ad0fb5e4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:49.795881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcc322-1afa-4406-beeb-9ad0fb5e4ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:49.796856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcc322-1afa-4406-beeb-9ad0fb5e4ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:49.802321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcc322-1afa-4406-beeb-9ad0fb5e4ba6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:49.822641 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1235/2469] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:49 2022] PUT /identity/v3/projects/36233fa44d35474f80063230c496d496/users/5608e63a5941422f8082a017b5b3998f/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:49.824875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688e45-cbe8-4da7-8a68-8350493dc6d5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.859085 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1235/2470] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:49 2022] POST /identity/v3/users => generated 301 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:49.862918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcc322-1afa-4406-beeb-9ad0fb5e4ba6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:49.885853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcc322-1afa-4406-beeb-9ad0fb5e4ba6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:50.016077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688e45-cbe8-4da7-8a68-8350493dc6d5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:50.041154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e4807-846d-4ec4-90e1-366fd05b9126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:50.045542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4807-846d-4ec4-90e1-366fd05b9126 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.046913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4807-846d-4ec4-90e1-366fd05b9126 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.047303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4807-846d-4ec4-90e1-366fd05b9126 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.049494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e4807-846d-4ec4-90e1-366fd05b9126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:50.051368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e4807-846d-4ec4-90e1-366fd05b9126 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:50.055736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9c43-ba63-4fb0-9040-a80090dcb467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:50.056569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9c43-ba63-4fb0-9040-a80090dcb467 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.058281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9c43-ba63-4fb0-9040-a80090dcb467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.058658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9c43-ba63-4fb0-9040-a80090dcb467 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.062347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9c43-ba63-4fb0-9040-a80090dcb467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:50.071781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9c43-ba63-4fb0-9040-a80090dcb467 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:50.097103 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1236/2471] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:50.098485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e4807-846d-4ec4-90e1-366fd05b9126 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:50.113793 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1236/2472] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:50.120200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9c43-ba63-4fb0-9040-a80090dcb467 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:50.142561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e4807-846d-4ec4-90e1-366fd05b9126 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:50.161099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9c43-ba63-4fb0-9040-a80090dcb467 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:50.163776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50f6fc-cbb8-4148-ae04-f7a5ae9841aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:50.166389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50f6fc-cbb8-4148-ae04-f7a5ae9841aa admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.168103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50f6fc-cbb8-4148-ae04-f7a5ae9841aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.169163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50f6fc-cbb8-4148-ae04-f7a5ae9841aa admin admin] PATH_INFO: `/v3/projects/36233fa44d35474f80063230c496d496/users/5608e63a5941422f8082a017b5b3998f/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.179156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50f6fc-cbb8-4148-ae04-f7a5ae9841aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=36233fa44d35474f80063230c496d496, user_id=5608e63a5941422f8082a017b5b3998f, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:50.181980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bc9e3-2247-4787-8ece-4629d3f87512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:50.182800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bc9e3-2247-4787-8ece-4629d3f87512 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.186290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bc9e3-2247-4787-8ece-4629d3f87512 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.186689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bc9e3-2247-4787-8ece-4629d3f87512 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.187225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50f6fc-cbb8-4148-ae04-f7a5ae9841aa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:50.189298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bc9e3-2247-4787-8ece-4629d3f87512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:50.195301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bc9e3-2247-4787-8ece-4629d3f87512 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:50.237548 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1237/2473] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:50 2022] PUT /identity/v3/projects/36233fa44d35474f80063230c496d496/users/5608e63a5941422f8082a017b5b3998f/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:50.243346 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1237/2474] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:51:50.248265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a70f9-5d92-4f05-97c7-1c720dff7b38 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.248719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a70f9-5d92-4f05-97c7-1c720dff7b38 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.249715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bc9e3-2247-4787-8ece-4629d3f87512 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:50.250103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a70f9-5d92-4f05-97c7-1c720dff7b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.274406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bc9e3-2247-4787-8ece-4629d3f87512 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:50.351043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d6cc-800f-491a-b7a2-39e9cd20b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:50.352102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d6cc-800f-491a-b7a2-39e9cd20b56b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.352522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d6cc-800f-491a-b7a2-39e9cd20b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.352901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d6cc-800f-491a-b7a2-39e9cd20b56b admin admin] PATH_INFO: `/v3/projects/5e42ff7200a14509af26780bb5d8e586/users/fe8fb48fff6c43558394e6c253e5a86c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.363009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6c0a70f9-5d92-4f05-97c7-1c720dff7b38 None None] MFA Rules not processed for user `5608e63a5941422f8082a017b5b3998f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:50.364594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6c0a70f9-5d92-4f05-97c7-1c720dff7b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:50.369500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855d6cc-800f-491a-b7a2-39e9cd20b56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e42ff7200a14509af26780bb5d8e586, user_id=fe8fb48fff6c43558394e6c253e5a86c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:50.372649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855d6cc-800f-491a-b7a2-39e9cd20b56b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:50.397805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1238/2475] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:50 2022] PUT /identity/v3/projects/5e42ff7200a14509af26780bb5d8e586/users/fe8fb48fff6c43558394e6c253e5a86c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:50.412372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327d7e-75bd-4847-912d-ac597d9b5acc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.412778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327d7e-75bd-4847-912d-ac597d9b5acc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.413118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327d7e-75bd-4847-912d-ac597d9b5acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.473113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2d327d7e-75bd-4847-912d-ac597d9b5acc None None] MFA Rules not processed for user `fe8fb48fff6c43558394e6c253e5a86c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:50.476570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2d327d7e-75bd-4847-912d-ac597d9b5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:50.547701 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1238/2476] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:50.766161 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1239/2477] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:50.774873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a70f9-5d92-4f05-97c7-1c720dff7b38 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:50.779993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965ba89-92ba-4280-980a-ac9dbd5bb170 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.780420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965ba89-92ba-4280-980a-ac9dbd5bb170 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.785748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965ba89-92ba-4280-980a-ac9dbd5bb170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.793995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a70f9-5d92-4f05-97c7-1c720dff7b38 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:50.866694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c965ba89-92ba-4280-980a-ac9dbd5bb170 None None] MFA Rules not processed for user `29b849c08c724ad3ae642bb1bd8aa288`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:50.888184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c965ba89-92ba-4280-980a-ac9dbd5bb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:50.989284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5412a-48ba-4354-a75c-cb1a883ea9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:50.991395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5412a-48ba-4354-a75c-cb1a883ea9df admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:50.992766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5412a-48ba-4354-a75c-cb1a883ea9df admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:50.994173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5412a-48ba-4354-a75c-cb1a883ea9df admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:50.994850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5412a-48ba-4354-a75c-cb1a883ea9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:51.010553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5412a-48ba-4354-a75c-cb1a883ea9df admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:51.077449 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1240/2478] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:51.079390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965ba89-92ba-4280-980a-ac9dbd5bb170 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:51.082568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c965ba89-92ba-4280-980a-ac9dbd5bb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:51.098563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1239/2479] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:50 2022] POST /identity/v3/projects => generated 403 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:51.101504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5412a-48ba-4354-a75c-cb1a883ea9df admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:51.271981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5412a-48ba-4354-a75c-cb1a883ea9df admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:51.285777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2a389-701c-40f5-9953-f052d1fce965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:51.286862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a389-701c-40f5-9953-f052d1fce965 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:51.287418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a389-701c-40f5-9953-f052d1fce965 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:51.288740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a389-701c-40f5-9953-f052d1fce965 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:51.289702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2a389-701c-40f5-9953-f052d1fce965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:51.292783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2a389-701c-40f5-9953-f052d1fce965 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:51.346467 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1240/2480] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:51 2022] POST /identity/v3/users => generated 308 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:51.350039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2a389-701c-40f5-9953-f052d1fce965 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:51.382911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2a389-701c-40f5-9953-f052d1fce965 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:51.390981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965ba89-92ba-4280-980a-ac9dbd5bb170 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:51.397964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c4c3f-5ae0-43b7-bf1d-8d864dd517f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:51.399011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c4c3f-5ae0-43b7-bf1d-8d864dd517f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:51.399641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c4c3f-5ae0-43b7-bf1d-8d864dd517f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:51.400415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c4c3f-5ae0-43b7-bf1d-8d864dd517f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:51.401630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c4c3f-5ae0-43b7-bf1d-8d864dd517f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:51.403681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c4c3f-5ae0-43b7-bf1d-8d864dd517f3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:51.441540 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1241/2481] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:51.445854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c4c3f-5ae0-43b7-bf1d-8d864dd517f3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:51.461242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c4c3f-5ae0-43b7-bf1d-8d864dd517f3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:51.482729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee065-da0b-4940-bbf8-21595a68f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:51.483861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee065-da0b-4940-bbf8-21595a68f6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:51.486113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee065-da0b-4940-bbf8-21595a68f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:51.486501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee065-da0b-4940-bbf8-21595a68f6cc admin admin] PATH_INFO: `/v3/projects/96b95054ca644756b7c179abf6508a1b/users/defbae2b90ef4b3cb7e8674a3fbefbd8/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:51.538701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ee065-da0b-4940-bbf8-21595a68f6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b95054ca644756b7c179abf6508a1b, user_id=defbae2b90ef4b3cb7e8674a3fbefbd8, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:51.544772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ee065-da0b-4940-bbf8-21595a68f6cc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:51.578731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09b9ce-0497-4835-8d82-db467f32ca8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:51.579414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b9ce-0497-4835-8d82-db467f32ca8f service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:51.579735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b9ce-0497-4835-8d82-db467f32ca8f service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:51.580112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b9ce-0497-4835-8d82-db467f32ca8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:51.594507 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1242/2482] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:51 2022] PUT /identity/v3/projects/96b95054ca644756b7c179abf6508a1b/users/defbae2b90ef4b3cb7e8674a3fbefbd8/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:51.595469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee065-da0b-4940-bbf8-21595a68f6cc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:51.817130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09b9ce-0497-4835-8d82-db467f32ca8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:51.821520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09b9ce-0497-4835-8d82-db467f32ca8f service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:51.826710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee065-da0b-4940-bbf8-21595a68f6cc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:51.852714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026220d0-82d5-4bab-be4d-07a60aaef937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:51.853290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026220d0-82d5-4bab-be4d-07a60aaef937 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:51.853577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026220d0-82d5-4bab-be4d-07a60aaef937 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:51.853864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026220d0-82d5-4bab-be4d-07a60aaef937 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:51.854596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026220d0-82d5-4bab-be4d-07a60aaef937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:51.856275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026220d0-82d5-4bab-be4d-07a60aaef937 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:51.867943 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1241/2483] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:51.893336 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1243/2484] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:51.895647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09b9ce-0497-4835-8d82-db467f32ca8f service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:51.917548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09b9ce-0497-4835-8d82-db467f32ca8f service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:51.932320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373b64-d7fb-425f-bf82-4271e96e645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:51.933546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373b64-d7fb-425f-bf82-4271e96e645c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:51.933977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373b64-d7fb-425f-bf82-4271e96e645c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:51.934403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373b64-d7fb-425f-bf82-4271e96e645c admin admin] PATH_INFO: `/v3/projects/96b95054ca644756b7c179abf6508a1b/users/defbae2b90ef4b3cb7e8674a3fbefbd8/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:51.937548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8373b64-d7fb-425f-bf82-4271e96e645c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b95054ca644756b7c179abf6508a1b, user_id=defbae2b90ef4b3cb7e8674a3fbefbd8, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:51.940867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8373b64-d7fb-425f-bf82-4271e96e645c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:51.999398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1242/2485] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:51 2022] PUT /identity/v3/projects/96b95054ca644756b7c179abf6508a1b/users/defbae2b90ef4b3cb7e8674a3fbefbd8/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:52.008316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e346-7d7a-464b-a935-349ee4181eac None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:52.008925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e346-7d7a-464b-a935-349ee4181eac None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:52.009421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e346-7d7a-464b-a935-349ee4181eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:52.094561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6cf4e346-7d7a-464b-a935-349ee4181eac None None] MFA Rules not processed for user `defbae2b90ef4b3cb7e8674a3fbefbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:52.100960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6cf4e346-7d7a-464b-a935-349ee4181eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:52.312372 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1244/2486] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:52.394662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373b64-d7fb-425f-bf82-4271e96e645c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:52.465782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904bb4-db74-4bde-861b-87e2676e56c3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:52.466350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904bb4-db74-4bde-861b-87e2676e56c3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:52.466803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904bb4-db74-4bde-861b-87e2676e56c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:52.546121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b9904bb4-db74-4bde-861b-87e2676e56c3 None None] MFA Rules not processed for user `ec1a2a2db19c41cca4342aa082770a96`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:52.547452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b9904bb4-db74-4bde-861b-87e2676e56c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:52.601110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373b64-d7fb-425f-bf82-4271e96e645c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:52.614760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b797197-f536-498e-8e71-f29630e73fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:52.616110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797197-f536-498e-8e71-f29630e73fc8 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:52.616320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797197-f536-498e-8e71-f29630e73fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:52.616643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797197-f536-498e-8e71-f29630e73fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:52.752787 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1245/2487] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:52.792078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b797197-f536-498e-8e71-f29630e73fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:52.794881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b797197-f536-498e-8e71-f29630e73fc8 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:52.810372 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1243/2488] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:52 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:53.282347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904bb4-db74-4bde-861b-87e2676e56c3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:53.284580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b9904bb4-db74-4bde-861b-87e2676e56c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:53.306158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904bb4-db74-4bde-861b-87e2676e56c3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:53.311955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3223b-897f-4d96-b3d4-9f847a9fee52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:53.312765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3223b-897f-4d96-b3d4-9f847a9fee52 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:53.313177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3223b-897f-4d96-b3d4-9f847a9fee52 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:53.313555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3223b-897f-4d96-b3d4-9f847a9fee52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:53.324083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3223b-897f-4d96-b3d4-9f847a9fee52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:53.325992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3223b-897f-4d96-b3d4-9f847a9fee52 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:53.348560 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1246/2489] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:54.073194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b797197-f536-498e-8e71-f29630e73fc8 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:54.086304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b797197-f536-498e-8e71-f29630e73fc8 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:54.100587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42728a-fa9e-4ac7-aa76-9a6aaf962807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:54.100788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637c3e-ef76-4a1d-8c2b-f4e18da62b9d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:54.101055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637c3e-ef76-4a1d-8c2b-f4e18da62b9d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:54.101334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637c3e-ef76-4a1d-8c2b-f4e18da62b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:54.105854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42728a-fa9e-4ac7-aa76-9a6aaf962807 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:54.106491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42728a-fa9e-4ac7-aa76-9a6aaf962807 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:54.106870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42728a-fa9e-4ac7-aa76-9a6aaf962807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:54.119860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d2637c3e-ef76-4a1d-8c2b-f4e18da62b9d None None] MFA Rules not processed for user `caca1da9a52c4a2080682b2458fa1e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:54.121096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d2637c3e-ef76-4a1d-8c2b-f4e18da62b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:54.230445 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1247/2490] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:54.234225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42728a-fa9e-4ac7-aa76-9a6aaf962807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:54.235841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42728a-fa9e-4ac7-aa76-9a6aaf962807 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:54.247468 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1244/2491] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:56.215746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637c3e-ef76-4a1d-8c2b-f4e18da62b9d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:56.374709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637c3e-ef76-4a1d-8c2b-f4e18da62b9d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:56.379395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:56.380692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:56.381354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:56.381893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] PATH_INFO: `/v3/users/e3c6ec50f5ca4bbeac3f1204394291eb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:56.383529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c6ec50f5ca4bbeac3f1204394291eb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:56.385728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:56.471827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c6ec50f5ca4bbeac3f1204394291eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:56.486919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c6ec50f5ca4bbeac3f1204394291eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:56.495262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c6ec50f5ca4bbeac3f1204394291eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:56.496762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c6ec50f5ca4bbeac3f1204394291eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:56.497418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c6ec50f5ca4bbeac3f1204394291eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:56.510982 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1248/2492] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:56 2022] DELETE /identity/v3/users/e3c6ec50f5ca4bbeac3f1204394291eb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:56.518404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9a0ff-98fe-47e5-9a2d-0dac7c38a342 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:56.519295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9a0ff-98fe-47e5-9a2d-0dac7c38a342 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:56.519576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9a0ff-98fe-47e5-9a2d-0dac7c38a342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:56.539087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-16e9a0ff-98fe-47e5-9a2d-0dac7c38a342 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:56.540713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-16e9a0ff-98fe-47e5-9a2d-0dac7c38a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:56.632671 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1245/2493] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:56.650655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:56.653676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:56.774862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41c232-6003-4f41-b16b-5401549caf4b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:56.780472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20618e17-eefa-40d0-8a9f-bbf5824c273a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:56.781366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618e17-eefa-40d0-8a9f-bbf5824c273a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:56.782125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618e17-eefa-40d0-8a9f-bbf5824c273a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:56.782585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618e17-eefa-40d0-8a9f-bbf5824c273a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:56.795561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20618e17-eefa-40d0-8a9f-bbf5824c273a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:56.797693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20618e17-eefa-40d0-8a9f-bbf5824c273a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:56.811919 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1249/2494] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:57.294539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9a0ff-98fe-47e5-9a2d-0dac7c38a342 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:57.296041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-16e9a0ff-98fe-47e5-9a2d-0dac7c38a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:57.322771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9a0ff-98fe-47e5-9a2d-0dac7c38a342 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:57.328075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:57.329243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:57.329935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:57.330116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] PATH_INFO: `/v3/projects/97f645d79d2a4f88a798505443341fb7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:57.332035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f645d79d2a4f88a798505443341fb7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:57.334436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:57.401801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f645d79d2a4f88a798505443341fb7', 'request_id': 'req-1f712dff-8057-4a9e-aa33-9857a950859d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.407913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f645d79d2a4f88a798505443341fb7', 'request_id': 'req-1f712dff-8057-4a9e-aa33-9857a950859d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.428544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f645d79d2a4f88a798505443341fb7', 'request_id': 'req-1f712dff-8057-4a9e-aa33-9857a950859d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.447261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] The token cache is being invalidate because project 97f645d79d2a4f88a798505443341fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:57.447555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.450026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.452953 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1246/2495] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:57 2022] DELETE /identity/v3/projects/97f645d79d2a4f88a798505443341fb7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:57.457297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20618e17-eefa-40d0-8a9f-bbf5824c273a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:57.470420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20618e17-eefa-40d0-8a9f-bbf5824c273a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:57.536425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:57.538793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:57.557226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:57.558324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:57.559609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:57.560047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] PATH_INFO: `/v3/users/5608e63a5941422f8082a017b5b3998f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:57.565290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5608e63a5941422f8082a017b5b3998f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:57.572376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:57.628366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f712dff-8057-4a9e-aa33-9857a950859d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:57.638169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:57.639072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:57.639342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:57.639622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] PATH_INFO: `/v3/users/fe8fb48fff6c43558394e6c253e5a86c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:57.642338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8fb48fff6c43558394e6c253e5a86c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:57.644323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:57.657755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5608e63a5941422f8082a017b5b3998f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.674278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5608e63a5941422f8082a017b5b3998f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.683596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5608e63a5941422f8082a017b5b3998f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.684423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5608e63a5941422f8082a017b5b3998f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.685078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83e3c007-987e-4311-ad4f-be5fd18569fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5608e63a5941422f8082a017b5b3998f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.701666 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1250/2496] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:57 2022] DELETE /identity/v3/users/5608e63a5941422f8082a017b5b3998f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:57.705219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c853c8-1dde-440a-aa5a-5252f6b3fbae None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:57.705330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c853c8-1dde-440a-aa5a-5252f6b3fbae None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:57.705671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c853c8-1dde-440a-aa5a-5252f6b3fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:57.710080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8fb48fff6c43558394e6c253e5a86c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.710752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8fb48fff6c43558394e6c253e5a86c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.711374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8fb48fff6c43558394e6c253e5a86c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.735791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8fb48fff6c43558394e6c253e5a86c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.751579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb0624d-b747-4868-8b70-e99583d24190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8fb48fff6c43558394e6c253e5a86c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:57.769977 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1247/2497] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:57 2022] DELETE /identity/v3/users/fe8fb48fff6c43558394e6c253e5a86c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:57.770479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-11c853c8-1dde-440a-aa5a-5252f6b3fbae None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:57.772944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-11c853c8-1dde-440a-aa5a-5252f6b3fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:57.784498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353bc27-01bd-45c6-bd04-090f10894eeb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:57.785775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353bc27-01bd-45c6-bd04-090f10894eeb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:57.786060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353bc27-01bd-45c6-bd04-090f10894eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:57.823860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3353bc27-01bd-45c6-bd04-090f10894eeb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:57.827023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3353bc27-01bd-45c6-bd04-090f10894eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:57.907912 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1251/2498] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:57.934257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c853c8-1dde-440a-aa5a-5252f6b3fbae None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:57.935702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-11c853c8-1dde-440a-aa5a-5252f6b3fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:57.949079 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1248/2499] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:57.963597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353bc27-01bd-45c6-bd04-090f10894eeb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:57.965309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3353bc27-01bd-45c6-bd04-090f10894eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:58.067670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353bc27-01bd-45c6-bd04-090f10894eeb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:58.073673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:58.074322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:58.074601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:58.074874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:58.085390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c853c8-1dde-440a-aa5a-5252f6b3fbae None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:58.086895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:58.088459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:58.094924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d57306-daaa-4f74-b629-d303f6ae7561 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:58.095706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d57306-daaa-4f74-b629-d303f6ae7561 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:58.096095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d57306-daaa-4f74-b629-d303f6ae7561 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:58.096539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d57306-daaa-4f74-b629-d303f6ae7561 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:58.101157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1249/2500] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:51:58.105283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:58.107036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:58.109036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d57306-daaa-4f74-b629-d303f6ae7561 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:58.111314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d57306-daaa-4f74-b629-d303f6ae7561 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:58.135351 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1252/2501] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:51:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:58.137691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb225-66c6-42df-bb24-62771a75ae8c service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:58.148388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:58.149466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:58.149913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:58.150612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] PATH_INFO: `/v3/projects/36233fa44d35474f80063230c496d496` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:58.152783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36233fa44d35474f80063230c496d496)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:58.155061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:58.238474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36233fa44d35474f80063230c496d496', 'request_id': 'req-cadad71b-63ab-4621-bc54-5314390518c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.253293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36233fa44d35474f80063230c496d496', 'request_id': 'req-cadad71b-63ab-4621-bc54-5314390518c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.274610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36233fa44d35474f80063230c496d496', 'request_id': 'req-cadad71b-63ab-4621-bc54-5314390518c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.291670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] The token cache is being invalidate because project 36233fa44d35474f80063230c496d496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:58.292913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.294332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cadad71b-63ab-4621-bc54-5314390518c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.300469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1250/2502] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:58 2022] DELETE /identity/v3/projects/36233fa44d35474f80063230c496d496 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:58.301971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969cdb-2fd3-49ec-8076-ccce555e7240 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:58.302328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969cdb-2fd3-49ec-8076-ccce555e7240 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:58.302594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969cdb-2fd3-49ec-8076-ccce555e7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:58.347577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-72969cdb-2fd3-49ec-8076-ccce555e7240 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:58.348798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-72969cdb-2fd3-49ec-8076-ccce555e7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:58.511781 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1253/2503] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:51:58.519459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b9fd-da4f-48b5-8de3-1f9f73901d5e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:58.519747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b9fd-da4f-48b5-8de3-1f9f73901d5e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:58.520029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314b9fd-da4f-48b5-8de3-1f9f73901d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:58.550605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f314b9fd-da4f-48b5-8de3-1f9f73901d5e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:58.553102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f314b9fd-da4f-48b5-8de3-1f9f73901d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:58.571029 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1251/2504] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:51:58.577026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72969cdb-2fd3-49ec-8076-ccce555e7240 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:58.596139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72969cdb-2fd3-49ec-8076-ccce555e7240 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:58.620869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:58.621555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:58.621840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:58.622120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:58.622859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:51:58.623170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:58.626572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:58.661980 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1254/2505] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:51:58.666851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314b9fd-da4f-48b5-8de3-1f9f73901d5e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:58.681247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314b9fd-da4f-48b5-8de3-1f9f73901d5e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:58.694995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecdcf3-75ff-4d1e-a936-04fdab1346ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:58.696082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecdcf3-75ff-4d1e-a936-04fdab1346ea admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:58.698534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecdcf3-75ff-4d1e-a936-04fdab1346ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:58.702718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecdcf3-75ff-4d1e-a936-04fdab1346ea admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:58.704147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecdcf3-75ff-4d1e-a936-04fdab1346ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:58.706146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecdcf3-75ff-4d1e-a936-04fdab1346ea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:58.716359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:58.719185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:58.763147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7cbd8-0663-4884-891c-7fd71b68e1dc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:58.781304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:58.784044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:58.784380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:58.784659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] PATH_INFO: `/v3/projects/5e42ff7200a14509af26780bb5d8e586` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:58.786177 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1252/2506] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:58 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:58.790428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecdcf3-75ff-4d1e-a936-04fdab1346ea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:58.796588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e42ff7200a14509af26780bb5d8e586)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:58.805619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:58.875333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e42ff7200a14509af26780bb5d8e586', 'request_id': 'req-47eb2b1d-54e0-40f7-8641-d42d228407b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.892259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e42ff7200a14509af26780bb5d8e586', 'request_id': 'req-47eb2b1d-54e0-40f7-8641-d42d228407b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.917478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e42ff7200a14509af26780bb5d8e586', 'request_id': 'req-47eb2b1d-54e0-40f7-8641-d42d228407b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.940129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] The token cache is being invalidate because project 5e42ff7200a14509af26780bb5d8e586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:51:58.940461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.941158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:58.944364 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1255/2507] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:58 2022] DELETE /identity/v3/projects/5e42ff7200a14509af26780bb5d8e586 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:51:58.948252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:58.952619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:58.957088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecdcf3-75ff-4d1e-a936-04fdab1346ea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:59.115577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:59.116260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:59.116577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:59.116858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:59.117997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:59.119519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:59.136770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb2b1d-54e0-40f7-8641-d42d228407b9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:59.144474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:59.145887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:59.146375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:59.147793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] PATH_INFO: `/v3/users/defbae2b90ef4b3cb7e8674a3fbefbd8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:59.150413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=defbae2b90ef4b3cb7e8674a3fbefbd8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:59.153628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:59.188075 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1253/2508] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:51:58 2022] POST /identity/v3/users => generated 287 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:51:59.192727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:59.198975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:59.222154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a995ec-b926-4371-951d-b32b34304447 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:59.228768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a346-9b26-4f9a-a762-154dd20d2e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:59.229035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a346-9b26-4f9a-a762-154dd20d2e44 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:59.229753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a346-9b26-4f9a-a762-154dd20d2e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:59.230045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a346-9b26-4f9a-a762-154dd20d2e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:59.230888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0a346-9b26-4f9a-a762-154dd20d2e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:59.232532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0a346-9b26-4f9a-a762-154dd20d2e44 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:59.256976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defbae2b90ef4b3cb7e8674a3fbefbd8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:59.258603 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1254/2509] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:51:59.262531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a346-9b26-4f9a-a762-154dd20d2e44 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:59.274529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a346-9b26-4f9a-a762-154dd20d2e44 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:59.282424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:59.283430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defbae2b90ef4b3cb7e8674a3fbefbd8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:59.283826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:59.284316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:59.284808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:59.286704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:59.292124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:59.303741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defbae2b90ef4b3cb7e8674a3fbefbd8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:59.305395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defbae2b90ef4b3cb7e8674a3fbefbd8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:59.306281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db8c1f6e-c00f-42d2-85dc-c271ce2d4dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defbae2b90ef4b3cb7e8674a3fbefbd8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:51:59.312724 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1255/2510] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:51:59.326481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:51:59.332682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:59.339167 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1256/2511] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:51:58 2022] DELETE /identity/v3/users/defbae2b90ef4b3cb7e8674a3fbefbd8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:59.368013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76374a24-242d-49d2-b72f-13cd986c16f1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:51:59.717616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20b849-ac51-4108-9724-ff1f7b70e5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:51:59.719809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20b849-ac51-4108-9724-ff1f7b70e5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:59.720281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20b849-ac51-4108-9724-ff1f7b70e5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:59.720640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20b849-ac51-4108-9724-ff1f7b70e5bc admin admin] PATH_INFO: `/v3/projects/8dd487b9b67d4d72b313868e7bc4ba93/users/204050967d254759b99bf4b668dd3c71/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:59.745630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20b849-ac51-4108-9724-ff1f7b70e5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd487b9b67d4d72b313868e7bc4ba93, user_id=204050967d254759b99bf4b668dd3c71, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:51:59.750312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20b849-ac51-4108-9724-ff1f7b70e5bc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:51:59.803854 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1256/2512] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:51:59 2022] PUT /identity/v3/projects/8dd487b9b67d4d72b313868e7bc4ba93/users/204050967d254759b99bf4b668dd3c71/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:51:59.805831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed184c-6fd1-49ac-aa4f-a21d9bee47b9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:51:59.806708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed184c-6fd1-49ac-aa4f-a21d9bee47b9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:51:59.807245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed184c-6fd1-49ac-aa4f-a21d9bee47b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:51:59.845138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-eeed184c-6fd1-49ac-aa4f-a21d9bee47b9 None None] MFA Rules not processed for user `204050967d254759b99bf4b668dd3c71`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:51:59.846753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eeed184c-6fd1-49ac-aa4f-a21d9bee47b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:51:59.995201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20b849-ac51-4108-9724-ff1f7b70e5bc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:00.007537 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1257/2513] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:00.171028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20b849-ac51-4108-9724-ff1f7b70e5bc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:00.177303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126933f9-a3ea-439e-828f-b778da84dc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:00.177303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126933f9-a3ea-439e-828f-b778da84dc61 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:00.177303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126933f9-a3ea-439e-828f-b778da84dc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:00.177878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126933f9-a3ea-439e-828f-b778da84dc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:00.178709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126933f9-a3ea-439e-828f-b778da84dc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:00.180633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126933f9-a3ea-439e-828f-b778da84dc61 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:00.246520 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1257/2514] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:51:59 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:00.251191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed184c-6fd1-49ac-aa4f-a21d9bee47b9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:00.275317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed184c-6fd1-49ac-aa4f-a21d9bee47b9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:00.440216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:00.441963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:00.441963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:00.442517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:00.444722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:00.452671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:00.513536 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1258/2515] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:00 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:00.513930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126933f9-a3ea-439e-828f-b778da84dc61 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:00.531220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126933f9-a3ea-439e-828f-b778da84dc61 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:00.555284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5b8bf-bedc-499c-aa02-c2183a18ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:00.556173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b8bf-bedc-499c-aa02-c2183a18ceae admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:00.556513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b8bf-bedc-499c-aa02-c2183a18ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:00.556844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b8bf-bedc-499c-aa02-c2183a18ceae admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:00.558710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5b8bf-bedc-499c-aa02-c2183a18ceae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:00.560407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5b8bf-bedc-499c-aa02-c2183a18ceae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:00.588010 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1258/2516] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:00.589789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:00.590400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5b8bf-bedc-499c-aa02-c2183a18ceae admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:00.592585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:00.611733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5b8bf-bedc-499c-aa02-c2183a18ceae admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:00.626207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b20009-5c54-4934-8f45-ee04bb9d7c23 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:00.627915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613d1e-bef6-4640-9e24-13f509dcf6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:00.628894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613d1e-bef6-4640-9e24-13f509dcf6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:00.629363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613d1e-bef6-4640-9e24-13f509dcf6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:00.629789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613d1e-bef6-4640-9e24-13f509dcf6d1 admin admin] PATH_INFO: `/v3/projects/8665fee57720441bb81ed6155e740f33/users/4e51d63992a647088c86dc119c630143/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:00.646453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:00.648501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:00.649367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:00.650977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] PATH_INFO: `/v3/projects/96b95054ca644756b7c179abf6508a1b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:00.652449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b95054ca644756b7c179abf6508a1b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:00.659180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e613d1e-bef6-4640-9e24-13f509dcf6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8665fee57720441bb81ed6155e740f33, user_id=4e51d63992a647088c86dc119c630143, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:00.664721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e613d1e-bef6-4640-9e24-13f509dcf6d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:00.665607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:00.705132 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1259/2517] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:00 2022] PUT /identity/v3/projects/8665fee57720441bb81ed6155e740f33/users/4e51d63992a647088c86dc119c630143/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:00.709028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613d1e-bef6-4640-9e24-13f509dcf6d1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:00.779794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b95054ca644756b7c179abf6508a1b', 'request_id': 'req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:00.804575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b95054ca644756b7c179abf6508a1b', 'request_id': 'req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:00.836146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b95054ca644756b7c179abf6508a1b', 'request_id': 'req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:00.861319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613d1e-bef6-4640-9e24-13f509dcf6d1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:00.863780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] The token cache is being invalidate because project 96b95054ca644756b7c179abf6508a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:00.864306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:00.865126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-84d7ab67-aae3-411b-bf3e-3b27fdf4947f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:00.868559 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1259/2518] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:00 2022] DELETE /identity/v3/projects/96b95054ca644756b7c179abf6508a1b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:00.875548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202b85-c6f5-40ec-9023-ebacd84ec0f6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:00.880437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202b85-c6f5-40ec-9023-ebacd84ec0f6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:00.886732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202b85-c6f5-40ec-9023-ebacd84ec0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:00.926949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c8202b85-c6f5-40ec-9023-ebacd84ec0f6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:00.928907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c8202b85-c6f5-40ec-9023-ebacd84ec0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:00.992157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:00.993090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:00.993486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:00.995249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:00.996118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:00.997900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.016258 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1260/2519] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:52:01.017284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.019459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:01.034303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994f43-f2b7-43ef-bde8-f91890306322 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.058129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3896c-86e3-47c4-89dc-8f93866b74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.060242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3896c-86e3-47c4-89dc-8f93866b74f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.060669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3896c-86e3-47c4-89dc-8f93866b74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.061720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3896c-86e3-47c4-89dc-8f93866b74f6 admin admin] PATH_INFO: `/v3/projects/8665fee57720441bb81ed6155e740f33/users/4e51d63992a647088c86dc119c630143/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.064567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3896c-86e3-47c4-89dc-8f93866b74f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8665fee57720441bb81ed6155e740f33, user_id=4e51d63992a647088c86dc119c630143, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.072625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3896c-86e3-47c4-89dc-8f93866b74f6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.075266 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1260/2520] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:52:01.077481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8141-85e4-457c-8e59-ed85c9098031 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.078061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8141-85e4-457c-8e59-ed85c9098031 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.078570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8141-85e4-457c-8e59-ed85c9098031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.093913 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1261/2521] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:01 2022] PUT /identity/v3/projects/8665fee57720441bb81ed6155e740f33/users/4e51d63992a647088c86dc119c630143/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:01.096673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b3aa-59d8-4661-8ee7-fb6d6ef56b01 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.096961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b3aa-59d8-4661-8ee7-fb6d6ef56b01 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.097240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b3aa-59d8-4661-8ee7-fb6d6ef56b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.126442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ebde8141-85e4-457c-8e59-ed85c9098031 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:01.131186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ebde8141-85e4-457c-8e59-ed85c9098031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:01.145497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eb52b3aa-59d8-4661-8ee7-fb6d6ef56b01 None None] MFA Rules not processed for user `4e51d63992a647088c86dc119c630143`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:01.154629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb52b3aa-59d8-4661-8ee7-fb6d6ef56b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:01.217492 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1261/2522] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:01.221379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde8141-85e4-457c-8e59-ed85c9098031 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.234000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde8141-85e4-457c-8e59-ed85c9098031 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.242957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.243635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.243923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.244195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.246238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:01.246565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.248458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.274053 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1262/2523] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:01.283979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.289490 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1262/2524] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:01.290360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b3aa-59d8-4661-8ee7-fb6d6ef56b01 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.309236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f80b5e-0659-4f30-8fe4-e7b915073f99 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.309988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b3aa-59d8-4661-8ee7-fb6d6ef56b01 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.337254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.337942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.338237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.338519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.341150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca7f1b-f76e-4856-9ada-091aa534a342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.341845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca7f1b-f76e-4856-9ada-091aa534a342 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.344412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca7f1b-f76e-4856-9ada-091aa534a342 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.344412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca7f1b-f76e-4856-9ada-091aa534a342 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.344658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:01.344658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.345768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.350223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca7f1b-f76e-4856-9ada-091aa534a342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.352149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca7f1b-f76e-4856-9ada-091aa534a342 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.364447 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1263/2525] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:52:01.366452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.383379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b447bca-77c9-43b6-95cf-70b9cbdeeec4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.390473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7ea9e-e988-4d02-a6f9-fd6427b16031 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.391347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ea9e-e988-4d02-a6f9-fd6427b16031 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.391602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ea9e-e988-4d02-a6f9-fd6427b16031 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.391938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ea9e-e988-4d02-a6f9-fd6427b16031 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.392725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7ea9e-e988-4d02-a6f9-fd6427b16031 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.395090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7ea9e-e988-4d02-a6f9-fd6427b16031 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.399606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1263/2526] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:01 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:01.404626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca7f1b-f76e-4856-9ada-091aa534a342 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.484373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1264/2527] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:01 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:01.486964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7ea9e-e988-4d02-a6f9-fd6427b16031 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.532079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca7f1b-f76e-4856-9ada-091aa534a342 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.629640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7ea9e-e988-4d02-a6f9-fd6427b16031 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.637655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.638886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.639390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.640550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.641508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:01.641980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.642110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b751f-d27c-4786-8242-00bbef4b7a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.643033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b751f-d27c-4786-8242-00bbef4b7a12 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.643382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b751f-d27c-4786-8242-00bbef4b7a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.643875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b751f-d27c-4786-8242-00bbef4b7a12 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.644679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b751f-d27c-4786-8242-00bbef4b7a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.646316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.646827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b751f-d27c-4786-8242-00bbef4b7a12 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.664121 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1265/2528] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:01.694747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.695283 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1264/2529] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:01 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:01.715686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a145e4-fa5a-43e5-9d73-ed19fd0d7ed4 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.737745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d89aae-811a-4632-abc5-8b0166eec447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.742464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d89aae-811a-4632-abc5-8b0166eec447 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.742886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d89aae-811a-4632-abc5-8b0166eec447 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.743171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d89aae-811a-4632-abc5-8b0166eec447 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.743907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d89aae-811a-4632-abc5-8b0166eec447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.746154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d89aae-811a-4632-abc5-8b0166eec447 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.759290 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1266/2530] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:52:01.763687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b751f-d27c-4786-8242-00bbef4b7a12 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.777375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b751f-d27c-4786-8242-00bbef4b7a12 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.782606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c83395-92ff-436d-9850-ec08e4ae7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.783262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83395-92ff-436d-9850-ec08e4ae7dde admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.783556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83395-92ff-436d-9850-ec08e4ae7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.783838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83395-92ff-436d-9850-ec08e4ae7dde admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.784618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c83395-92ff-436d-9850-ec08e4ae7dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.786877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c83395-92ff-436d-9850-ec08e4ae7dde admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.799696 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1265/2531] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:01.805586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d89aae-811a-4632-abc5-8b0166eec447 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:01.844364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d89aae-811a-4632-abc5-8b0166eec447 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:01.852354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee888-a110-48d2-a3ba-50ee2339d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:01.853213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee888-a110-48d2-a3ba-50ee2339d032 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.853659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee888-a110-48d2-a3ba-50ee2339d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.854024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee888-a110-48d2-a3ba-50ee2339d032 admin admin] PATH_INFO: `/v3/projects/4bf2430f14ba4c4a91a8892697828f87/users/c43d639f27724566b79057c2299bb736/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.883747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee888-a110-48d2-a3ba-50ee2339d032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf2430f14ba4c4a91a8892697828f87, user_id=c43d639f27724566b79057c2299bb736, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:01.888050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee888-a110-48d2-a3ba-50ee2339d032 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:01.928724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36818-2e44-496d-bdfb-14873dd2ce22 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:01.929203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36818-2e44-496d-bdfb-14873dd2ce22 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:01.929320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36818-2e44-496d-bdfb-14873dd2ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:01.930800 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1267/2532] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:01 2022] PUT /identity/v3/projects/4bf2430f14ba4c4a91a8892697828f87/users/c43d639f27724566b79057c2299bb736/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:01.959569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3ee36818-2e44-496d-bdfb-14873dd2ce22 None None] MFA Rules not processed for user `c43d639f27724566b79057c2299bb736`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:01.960850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ee36818-2e44-496d-bdfb-14873dd2ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:02.053178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee888-a110-48d2-a3ba-50ee2339d032 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:02.054117 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1266/2533] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:02.195856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee888-a110-48d2-a3ba-50ee2339d032 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:02.202930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:02.203705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.203956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.204239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.205333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:02.207833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:02.262064 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1268/2534] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:02 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:02.266112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee36818-2e44-496d-bdfb-14873dd2ce22 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:02.279566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee36818-2e44-496d-bdfb-14873dd2ce22 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:02.301782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:02.304940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:02.430254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895e682-6a85-4fb5-aed0-d2a5a029e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:02.430841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e682-6a85-4fb5-aed0-d2a5a029e460 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.431120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e682-6a85-4fb5-aed0-d2a5a029e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.431813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e682-6a85-4fb5-aed0-d2a5a029e460 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.432083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e682-6a85-4fb5-aed0-d2a5a029e460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:02.441775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e682-6a85-4fb5-aed0-d2a5a029e460 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:02.475839 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1267/2535] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:02 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:02.476947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895e682-6a85-4fb5-aed0-d2a5a029e460 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:02.491569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895e682-6a85-4fb5-aed0-d2a5a029e460 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:02.506630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec403-2f59-4a21-b920-57b601e7a000 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:02.518254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3ea9-99bf-4eab-a1ad-21eed4931a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:02.518939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3ea9-99bf-4eab-a1ad-21eed4931a96 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.519217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3ea9-99bf-4eab-a1ad-21eed4931a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.521067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3ea9-99bf-4eab-a1ad-21eed4931a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.521859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e3ea9-99bf-4eab-a1ad-21eed4931a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:02.523470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e3ea9-99bf-4eab-a1ad-21eed4931a96 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:02.532115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01e21-771c-475b-9299-5c74fac4b1c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:02.532861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01e21-771c-475b-9299-5c74fac4b1c0 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.533144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01e21-771c-475b-9299-5c74fac4b1c0 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.533422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01e21-771c-475b-9299-5c74fac4b1c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.571221 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1268/2536] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:02.576969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3ea9-99bf-4eab-a1ad-21eed4931a96 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:02.587797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3ea9-99bf-4eab-a1ad-21eed4931a96 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:02.598712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28959ae-39db-402d-9a60-654ac1794793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:02.599679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28959ae-39db-402d-9a60-654ac1794793 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.599983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28959ae-39db-402d-9a60-654ac1794793 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.600257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28959ae-39db-402d-9a60-654ac1794793 admin admin] PATH_INFO: `/v3/projects/b52d678120954ccea2f31fb8b0e41dfb/users/fa473c681fef4df5b5afa0e9756ca00e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.622675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac01e21-771c-475b-9299-5c74fac4b1c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:02.634634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28959ae-39db-402d-9a60-654ac1794793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52d678120954ccea2f31fb8b0e41dfb, user_id=fa473c681fef4df5b5afa0e9756ca00e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:02.635400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac01e21-771c-475b-9299-5c74fac4b1c0 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:02.636603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28959ae-39db-402d-9a60-654ac1794793 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:02.663889 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1269/2537] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:52:02.679707 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1269/2538] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:02 2022] PUT /identity/v3/projects/b52d678120954ccea2f31fb8b0e41dfb/users/fa473c681fef4df5b5afa0e9756ca00e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:52:02.681526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01e21-771c-475b-9299-5c74fac4b1c0 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:02.691535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514373ba-4cb9-4a53-a072-28f38ed2bdb7 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.691916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514373ba-4cb9-4a53-a072-28f38ed2bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.692262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514373ba-4cb9-4a53-a072-28f38ed2bdb7 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.695790 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1270/2539] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:02.700805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01e21-771c-475b-9299-5c74fac4b1c0 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:02.703314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514373ba-4cb9-4a53-a072-28f38ed2bdb7 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:02.832140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514373ba-4cb9-4a53-a072-28f38ed2bdb7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:02.840282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7fa01-bc59-4237-838f-f0257759358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:02.840982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7fa01-bc59-4237-838f-f0257759358f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.841262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7fa01-bc59-4237-838f-f0257759358f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.841534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7fa01-bc59-4237-838f-f0257759358f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.842259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7fa01-bc59-4237-838f-f0257759358f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:02.843862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7fa01-bc59-4237-838f-f0257759358f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:02.884581 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1270/2540] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:02.886046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7fa01-bc59-4237-838f-f0257759358f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:02.897823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7fa01-bc59-4237-838f-f0257759358f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:02.904033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59857695-3058-40f5-a900-1795ea267ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:02.905075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59857695-3058-40f5-a900-1795ea267ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.905208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59857695-3058-40f5-a900-1795ea267ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.905540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59857695-3058-40f5-a900-1795ea267ec5 admin admin] PATH_INFO: `/v3/projects/b52d678120954ccea2f31fb8b0e41dfb/users/fa473c681fef4df5b5afa0e9756ca00e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.908053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59857695-3058-40f5-a900-1795ea267ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52d678120954ccea2f31fb8b0e41dfb, user_id=fa473c681fef4df5b5afa0e9756ca00e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:02.911790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59857695-3058-40f5-a900-1795ea267ec5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:02.945190 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1271/2541] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:02 2022] PUT /identity/v3/projects/b52d678120954ccea2f31fb8b0e41dfb/users/fa473c681fef4df5b5afa0e9756ca00e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:02.947015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbe1f1-9404-4cda-99d8-32e49a77f64b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:02.947015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbe1f1-9404-4cda-99d8-32e49a77f64b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:02.947349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbe1f1-9404-4cda-99d8-32e49a77f64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:02.967623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514373ba-4cb9-4a53-a072-28f38ed2bdb7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:02.977561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-08dbe1f1-9404-4cda-99d8-32e49a77f64b None None] MFA Rules not processed for user `fa473c681fef4df5b5afa0e9756ca00e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:02.978787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-08dbe1f1-9404-4cda-99d8-32e49a77f64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:03.052612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3e22-ee8f-408d-9e34-6d6f6059ad7d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:03.054178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3e22-ee8f-408d-9e34-6d6f6059ad7d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:03.054700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3e22-ee8f-408d-9e34-6d6f6059ad7d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:03.055104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3e22-ee8f-408d-9e34-6d6f6059ad7d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/projects/0b59a556e35f4fb392ef697be3410bb6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:03.056894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3e22-ee8f-408d-9e34-6d6f6059ad7d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b59a556e35f4fb392ef697be3410bb6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:03.059362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3e22-ee8f-408d-9e34-6d6f6059ad7d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:03.070127 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1272/2543] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:03.075038 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1271/2543] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:02 2022] GET /identity/v3/projects/0b59a556e35f4fb392ef697be3410bb6 => generated 369 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:52:03.294183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3e22-ee8f-408d-9e34-6d6f6059ad7d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:03.433633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3e22-ee8f-408d-9e34-6d6f6059ad7d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:03.439678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:03.440360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:03.440644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:03.440916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:03.453214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:03.454935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:03.480745 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1272/2544] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:03.580922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578b8e-f78c-489d-b074-a821016b496b None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:03.581460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578b8e-f78c-489d-b074-a821016b496b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:03.581896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578b8e-f78c-489d-b074-a821016b496b None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:03.584355 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1273/2545] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:03.594017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:03.611456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:03.627525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758878-efe4-4995-b397-1c48e4cc1fcf service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:03.632420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d00b02-cf6f-41f9-b315-4604f4ee1426 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:03.633295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d00b02-cf6f-41f9-b315-4604f4ee1426 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:03.633573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d00b02-cf6f-41f9-b315-4604f4ee1426 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:03.633845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d00b02-cf6f-41f9-b315-4604f4ee1426 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/projects/0b59a556e35f4fb392ef697be3410bb6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:03.635270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d00b02-cf6f-41f9-b315-4604f4ee1426 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b59a556e35f4fb392ef697be3410bb6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:03.637264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d00b02-cf6f-41f9-b315-4604f4ee1426 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:03.639254 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1273/2546] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:03 2022] GET /identity/v3/projects/0b59a556e35f4fb392ef697be3410bb6 => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:03.717856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba578b8e-f78c-489d-b074-a821016b496b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:03.757081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba578b8e-f78c-489d-b074-a821016b496b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:03.782515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:03.783308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:03.783657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:03.784003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:03.785859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:03.789384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:03.791226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:03.812209 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1274/2547] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:03.816856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d00b02-cf6f-41f9-b315-4604f4ee1426 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:03.829626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d00b02-cf6f-41f9-b315-4604f4ee1426 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:03.856485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3134e37-0bb6-4a59-bb1b-74111cd9f496 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:03.857288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134e37-0bb6-4a59-bb1b-74111cd9f496 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:03.857628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134e37-0bb6-4a59-bb1b-74111cd9f496 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:03.857977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134e37-0bb6-4a59-bb1b-74111cd9f496 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:03.858754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3134e37-0bb6-4a59-bb1b-74111cd9f496 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:03.861015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3134e37-0bb6-4a59-bb1b-74111cd9f496 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:03.921560 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1274/2548] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:03 2022] POST /identity/v3/users => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:03.922280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:03.936182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3b211-fc6c-45ae-987f-b3acd617fc4f tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:03.941876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:03.942569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:03.942832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:03.943108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:03.944565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:03.944874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:03.946548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:03.984013 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1275/2549] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:04.423476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117a29-23a3-4914-8334-e31a0f22ec74 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:04.424019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117a29-23a3-4914-8334-e31a0f22ec74 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:04.424019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117a29-23a3-4914-8334-e31a0f22ec74 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:04.425788 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1275/2550] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:04.431269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:04.434328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:04.470742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:04.483415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c91b4-2691-448b-97f1-9bab69a33eaf tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:04.489897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:04.490856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:04.491509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:04.491509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/projects/0b59a556e35f4fb392ef697be3410bb6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:04.493866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b59a556e35f4fb392ef697be3410bb6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:04.495197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:04.504913 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1276/2551] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:04 2022] GET /identity/v3/projects/0b59a556e35f4fb392ef697be3410bb6 => generated 369 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:05.295994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07e8ae-22f9-4213-85e2-0489654074dd None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:05.296606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07e8ae-22f9-4213-85e2-0489654074dd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:05.297084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07e8ae-22f9-4213-85e2-0489654074dd None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:05.299057 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1276/2552] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:05.306731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:05.323058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:05.338369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838eed3-18ee-4943-a64a-68ab90639aef tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:05.343484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:05.344408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:05.344801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:05.345089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/projects/0b59a556e35f4fb392ef697be3410bb6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:05.346378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b59a556e35f4fb392ef697be3410bb6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:05.348711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:05.350604 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1277/2553] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:05 2022] GET /identity/v3/projects/0b59a556e35f4fb392ef697be3410bb6 => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:05.379510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07e8ae-22f9-4213-85e2-0489654074dd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:05.401880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07e8ae-22f9-4213-85e2-0489654074dd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:05.411223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:05.413384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:05.413670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:05.413952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/users/0e2c1e7e33854ec9abd0dc2bc8afb26c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:05.448782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0e2c1e7e33854ec9abd0dc2bc8afb26c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:05.454113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:05.520905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2c1e7e33854ec9abd0dc2bc8afb26c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.534645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2c1e7e33854ec9abd0dc2bc8afb26c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.546063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2c1e7e33854ec9abd0dc2bc8afb26c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.546942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2c1e7e33854ec9abd0dc2bc8afb26c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.547658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2c1e7e33854ec9abd0dc2bc8afb26c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.561952 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1277/2554] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:05 2022] DELETE /identity/v3/users/0e2c1e7e33854ec9abd0dc2bc8afb26c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:05.566032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:05.576446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:05.591291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1ebe-5c38-45da-b5d1-a1d605efe75d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:05.686823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e51d63992a647088c86dc119c630143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8665fee57720441bb81ed6155e740f33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:05.687675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:05.687950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:05.688222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] PATH_INFO: `/v3/projects/0b59a556e35f4fb392ef697be3410bb6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:05.689456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b59a556e35f4fb392ef697be3410bb6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:05.692077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:05.773679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b59a556e35f4fb392ef697be3410bb6', 'request_id': 'req-410f2082-bc23-4b81-9dd8-364464a76e63'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.779846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b59a556e35f4fb392ef697be3410bb6', 'request_id': 'req-410f2082-bc23-4b81-9dd8-364464a76e63'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.793589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b59a556e35f4fb392ef697be3410bb6', 'request_id': 'req-410f2082-bc23-4b81-9dd8-364464a76e63'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.813684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] The token cache is being invalidate because project 0b59a556e35f4fb392ef697be3410bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:05.814493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.815289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-410f2082-bc23-4b81-9dd8-364464a76e63 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:05.820408 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1278/2555] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:05 2022] DELETE /identity/v3/projects/0b59a556e35f4fb392ef697be3410bb6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:05.823821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:05.825298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:05.931155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d085aa-52c3-48d0-a851-e9d0021df28d tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:06.012519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:06.013820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:06.014182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:06.014529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] PATH_INFO: `/v3/users/204050967d254759b99bf4b668dd3c71` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:06.019884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204050967d254759b99bf4b668dd3c71)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:06.022779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:06.132314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204050967d254759b99bf4b668dd3c71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:06.149408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204050967d254759b99bf4b668dd3c71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:06.163077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204050967d254759b99bf4b668dd3c71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:06.164323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204050967d254759b99bf4b668dd3c71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:06.165149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204050967d254759b99bf4b668dd3c71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:06.181400 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1278/2556] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:05 2022] DELETE /identity/v3/users/204050967d254759b99bf4b668dd3c71 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:52:06.185764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe17e3-ed9d-4102-9f97-0e71ec05c6a9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:06.186047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe17e3-ed9d-4102-9f97-0e71ec05c6a9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:06.186341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe17e3-ed9d-4102-9f97-0e71ec05c6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:06.208007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9bfe17e3-ed9d-4102-9f97-0e71ec05c6a9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:06.209865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9bfe17e3-ed9d-4102-9f97-0e71ec05c6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:06.286220 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1279/2557] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:06.293636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:06.294925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:06.370159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce781afd-ca2c-4c38-b109-afd6504d9994 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:06.374199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:06.374882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:06.375329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:06.375447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:06.386146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:06.387602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:06.415762 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1279/2558] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:06.526151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d045-7fb4-4cae-a97c-e8482a6db493 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:06.526599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d045-7fb4-4cae-a97c-e8482a6db493 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:06.527081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d045-7fb4-4cae-a97c-e8482a6db493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:06.569054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5688d045-7fb4-4cae-a97c-e8482a6db493 None None] MFA Rules not processed for user `c26bc5048c9849218cadd12475cd5fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:06.570756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5688d045-7fb4-4cae-a97c-e8482a6db493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:06.687358 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1280/2559] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:06.882831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:06.884473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:06.899804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e2b1-8981-40af-9ac2-c873190f7bc2 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:06.925556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:06.928736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:06.929255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:06.929978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] PATH_INFO: `/v3/projects/8dd487b9b67d4d72b313868e7bc4ba93` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:06.933558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd487b9b67d4d72b313868e7bc4ba93)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:06.955594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:07.082651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd487b9b67d4d72b313868e7bc4ba93', 'request_id': 'req-ce72db53-a070-4442-b25e-ff9cb55c8a02'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.091559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd487b9b67d4d72b313868e7bc4ba93', 'request_id': 'req-ce72db53-a070-4442-b25e-ff9cb55c8a02'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.108191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd487b9b67d4d72b313868e7bc4ba93', 'request_id': 'req-ce72db53-a070-4442-b25e-ff9cb55c8a02'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.143467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] The token cache is being invalidate because project 8dd487b9b67d4d72b313868e7bc4ba93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:07.143948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.148885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.154144 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1280/2560] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:06 2022] DELETE /identity/v3/projects/8dd487b9b67d4d72b313868e7bc4ba93 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:07.155574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d045-7fb4-4cae-a97c-e8482a6db493 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:07.169459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d045-7fb4-4cae-a97c-e8482a6db493 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:07.253154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:07.254027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:07.254543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:07.254904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] PATH_INFO: `/v3/users/4e51d63992a647088c86dc119c630143` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:07.256107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e51d63992a647088c86dc119c630143)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:07.258204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:07.339138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e51d63992a647088c86dc119c630143'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.339867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e51d63992a647088c86dc119c630143'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.340578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e51d63992a647088c86dc119c630143'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.357732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e51d63992a647088c86dc119c630143'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.374053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e51d63992a647088c86dc119c630143'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:07.390376 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1281/2561] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:07 2022] DELETE /identity/v3/users/4e51d63992a647088c86dc119c630143 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:52:07.862624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:07.864495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:07.864962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:07.866897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:07.889841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72db53-a070-4442-b25e-ff9cb55c8a02 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:07.999944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fd789-c292-4465-a4da-d9dc91ea30ec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:08.004953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:08.006106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.006574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.007027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] PATH_INFO: `/v3/projects/8665fee57720441bb81ed6155e740f33` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.008496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8665fee57720441bb81ed6155e740f33)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:08.010786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:08.047499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:08.047499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.047499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.047499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] PATH_INFO: `/v3/users/c43d639f27724566b79057c2299bb736` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.049859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43d639f27724566b79057c2299bb736)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:08.055114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:08.091299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8665fee57720441bb81ed6155e740f33', 'request_id': 'req-643690f5-4d25-404e-9282-89f167e4edcf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.103171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8665fee57720441bb81ed6155e740f33', 'request_id': 'req-643690f5-4d25-404e-9282-89f167e4edcf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.131451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8665fee57720441bb81ed6155e740f33', 'request_id': 'req-643690f5-4d25-404e-9282-89f167e4edcf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.149900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43d639f27724566b79057c2299bb736'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.163026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] The token cache is being invalidate because project 8665fee57720441bb81ed6155e740f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:08.163343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.165113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-643690f5-4d25-404e-9282-89f167e4edcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.177161 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1282/2562] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:07 2022] DELETE /identity/v3/projects/8665fee57720441bb81ed6155e740f33 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:08.180582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8129-a5ac-4c25-a9f3-d3fdc5816178 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.180872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8129-a5ac-4c25-a9f3-d3fdc5816178 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.181165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8129-a5ac-4c25-a9f3-d3fdc5816178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.194961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43d639f27724566b79057c2299bb736'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.219572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43d639f27724566b79057c2299bb736'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.220365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43d639f27724566b79057c2299bb736'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.221107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f43f36f-1e0e-46af-9d6f-b561e5eeb843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43d639f27724566b79057c2299bb736'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:08.240023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-53eb8129-a5ac-4c25-a9f3-d3fdc5816178 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:08.243261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-53eb8129-a5ac-4c25-a9f3-d3fdc5816178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:08.251939 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1281/2563] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:07 2022] DELETE /identity/v3/users/c43d639f27724566b79057c2299bb736 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:08.253424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5a341-4c67-4650-8851-88aa29410328 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.253719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5a341-4c67-4650-8851-88aa29410328 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.254001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5a341-4c67-4650-8851-88aa29410328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.321430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dee5a341-4c67-4650-8851-88aa29410328 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:08.322892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dee5a341-4c67-4650-8851-88aa29410328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:08.401948 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1283/2564] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:08.404730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75de4-0455-49b9-b4a0-155d6e2ff2f8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.406618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75de4-0455-49b9-b4a0-155d6e2ff2f8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.407856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75de4-0455-49b9-b4a0-155d6e2ff2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.446559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-20f75de4-0455-49b9-b4a0-155d6e2ff2f8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:08.448139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-20f75de4-0455-49b9-b4a0-155d6e2ff2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:08.464623 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1284/2565] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:08.469883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f75de4-0455-49b9-b4a0-155d6e2ff2f8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:08.476093 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1282/2566] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:08.486716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f75de4-0455-49b9-b4a0-155d6e2ff2f8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:08.487242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5a341-4c67-4650-8851-88aa29410328 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:08.489926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dee5a341-4c67-4650-8851-88aa29410328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:08.501675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:08.502917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.503910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.503910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.504667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:08.504980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:08.510359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:08.539982 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1285/2567] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:08.541003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:08.562166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c5ca-61d7-47fb-8282-1cae4a3df674 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:08.567649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6184f-63c9-4bac-80eb-c431fe6ce320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:08.569180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6184f-63c9-4bac-80eb-c431fe6ce320 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.581694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6184f-63c9-4bac-80eb-c431fe6ce320 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.582315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6184f-63c9-4bac-80eb-c431fe6ce320 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.584980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6184f-63c9-4bac-80eb-c431fe6ce320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:08.590127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6184f-63c9-4bac-80eb-c431fe6ce320 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:08.595294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5a341-4c67-4650-8851-88aa29410328 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:08.606149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064c7d2-1768-49a0-9682-f8bd3574f1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:08.609088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064c7d2-1768-49a0-9682-f8bd3574f1eb service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.609400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064c7d2-1768-49a0-9682-f8bd3574f1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.610331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064c7d2-1768-49a0-9682-f8bd3574f1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.626465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064c7d2-1768-49a0-9682-f8bd3574f1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:08.628819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064c7d2-1768-49a0-9682-f8bd3574f1eb service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:08.645801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1283/2568] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:08.677091 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1286/2569] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:08 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:52:08.685706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064c7d2-1768-49a0-9682-f8bd3574f1eb service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:08.737209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064c7d2-1768-49a0-9682-f8bd3574f1eb service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:08.920746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23861-2867-40fb-ae11-be4553e098c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:08.921572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23861-2867-40fb-ae11-be4553e098c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:08.921865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23861-2867-40fb-ae11-be4553e098c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:08.922143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23861-2867-40fb-ae11-be4553e098c0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:08.923398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c23861-2867-40fb-ae11-be4553e098c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:08.925411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c23861-2867-40fb-ae11-be4553e098c0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:08.958835 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1284/2570] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:08 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:08.962833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6184f-63c9-4bac-80eb-c431fe6ce320 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:08.993870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6184f-63c9-4bac-80eb-c431fe6ce320 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.023812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6062d47-08f3-4ba7-bb20-89ffc7dd4f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.026611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6062d47-08f3-4ba7-bb20-89ffc7dd4f71 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.028319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6062d47-08f3-4ba7-bb20-89ffc7dd4f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.028932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6062d47-08f3-4ba7-bb20-89ffc7dd4f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.029963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6062d47-08f3-4ba7-bb20-89ffc7dd4f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:09.031910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6062d47-08f3-4ba7-bb20-89ffc7dd4f71 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:09.053449 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1287/2571] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:09.054739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23861-2867-40fb-ae11-be4553e098c0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:09.067347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23861-2867-40fb-ae11-be4553e098c0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.082709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16f1a0-40c4-43c6-bb61-a6173660a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.083409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f1a0-40c4-43c6-bb61-a6173660a496 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.083705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f1a0-40c4-43c6-bb61-a6173660a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.084592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f1a0-40c4-43c6-bb61-a6173660a496 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.085314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16f1a0-40c4-43c6-bb61-a6173660a496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:09.089823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16f1a0-40c4-43c6-bb61-a6173660a496 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:09.115468 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1285/2572] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:09.121128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6062d47-08f3-4ba7-bb20-89ffc7dd4f71 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:09.142532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6062d47-08f3-4ba7-bb20-89ffc7dd4f71 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.155405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.156686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.157148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.157653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73/users/bb5c1d90fa4f4e36ba82527497b2cbd7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.185969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8808e5cb7f49c7b1f2022d423fee73, user_id=bb5c1d90fa4f4e36ba82527497b2cbd7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:09.188627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:09.226912 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1288/2573] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:09 2022] PUT /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73/users/bb5c1d90fa4f4e36ba82527497b2cbd7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:52:09.240396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c16ff0-7b88-4f51-af2a-7706b98e639a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.241006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c16ff0-7b88-4f51-af2a-7706b98e639a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.241466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c16ff0-7b88-4f51-af2a-7706b98e639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.297400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:09.301198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:09.333306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-27c16ff0-7b88-4f51-af2a-7706b98e639a None None] MFA Rules not processed for user `bb5c1d90fa4f4e36ba82527497b2cbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:09.335679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-27c16ff0-7b88-4f51-af2a-7706b98e639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:09.520148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1f1d6-a480-40ed-a020-cea95a9c853f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.536168 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1286/2574] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:52:09.537834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c16ff0-7b88-4f51-af2a-7706b98e639a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:09.545736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.547376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.547874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.548628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] PATH_INFO: `/v3/projects/4bf2430f14ba4c4a91a8892697828f87` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.551152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf2430f14ba4c4a91a8892697828f87)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:09.560451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:09.611193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c16ff0-7b88-4f51-af2a-7706b98e639a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.619294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273e76c-ba1f-4917-94c7-82c975287803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.620521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273e76c-ba1f-4917-94c7-82c975287803 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.620926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273e76c-ba1f-4917-94c7-82c975287803 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.621396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273e76c-ba1f-4917-94c7-82c975287803 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.622305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273e76c-ba1f-4917-94c7-82c975287803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:09.624452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273e76c-ba1f-4917-94c7-82c975287803 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:09.671442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf2430f14ba4c4a91a8892697828f87', 'request_id': 'req-0f635440-aba5-44ca-97ec-8a8a97df00d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:09.686735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf2430f14ba4c4a91a8892697828f87', 'request_id': 'req-0f635440-aba5-44ca-97ec-8a8a97df00d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:09.704427 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1287/2575] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:09 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:09.705529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273e76c-ba1f-4917-94c7-82c975287803 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:09.708784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf2430f14ba4c4a91a8892697828f87', 'request_id': 'req-0f635440-aba5-44ca-97ec-8a8a97df00d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:09.724584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] The token cache is being invalidate because project 4bf2430f14ba4c4a91a8892697828f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:09.725212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:09.727741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:09.733241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1289/2576] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:09 2022] DELETE /identity/v3/projects/4bf2430f14ba4c4a91a8892697828f87 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:52:09.734360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:09.735921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:09.846476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273e76c-ba1f-4917-94c7-82c975287803 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.860987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.862031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.862031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.862404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.863182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:09.870868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:09.902019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635440-aba5-44ca-97ec-8a8a97df00d7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.907298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.908754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.909230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.909755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] PATH_INFO: `/v3/users/fa473c681fef4df5b5afa0e9756ca00e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.913306 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1288/2577] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:09 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:09.915152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:09.915556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa473c681fef4df5b5afa0e9756ca00e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:09.918392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:09.918698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:09.936074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073d559-fe16-497d-beb9-ac7f08ba7333 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.941690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8f0c-6059-4536-a472-c705874944f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.942459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8f0c-6059-4536-a472-c705874944f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.942826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8f0c-6059-4536-a472-c705874944f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.943992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8f0c-6059-4536-a472-c705874944f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:09.945041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8f0c-6059-4536-a472-c705874944f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:09.946933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8f0c-6059-4536-a472-c705874944f5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:09.964576 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1289/2578] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:09.968841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8f0c-6059-4536-a472-c705874944f5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:09.982307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8f0c-6059-4536-a472-c705874944f5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:09.988190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:09.989281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:09.989675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:09.990025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] PATH_INFO: `/v3/projects/83cc0855375147ebb8ad74711570f79a/users/a351bac1d70c4cd981e426dea5c934f1/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:10.011287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc0855375147ebb8ad74711570f79a, user_id=a351bac1d70c4cd981e426dea5c934f1, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:10.014498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:10.030773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa473c681fef4df5b5afa0e9756ca00e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.032240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa473c681fef4df5b5afa0e9756ca00e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.033495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa473c681fef4df5b5afa0e9756ca00e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.039827 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1290/2579] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:09 2022] PUT /identity/v3/projects/83cc0855375147ebb8ad74711570f79a/users/a351bac1d70c4cd981e426dea5c934f1/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:10.041025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:10.043182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:10.051903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa473c681fef4df5b5afa0e9756ca00e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.064599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa473c681fef4df5b5afa0e9756ca00e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.092286 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1290/2580] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:09 2022] DELETE /identity/v3/users/fa473c681fef4df5b5afa0e9756ca00e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:10.180813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40e050-6a41-4d3f-890b-caea8bb9c0b0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:10.191471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:10.193145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:10.322620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c28dd-e4da-4c01-b551-bf3a11a252b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:10.323749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c28dd-e4da-4c01-b551-bf3a11a252b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:10.324554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c28dd-e4da-4c01-b551-bf3a11a252b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:10.325044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c28dd-e4da-4c01-b551-bf3a11a252b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:10.326260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c28dd-e4da-4c01-b551-bf3a11a252b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:10.328529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c28dd-e4da-4c01-b551-bf3a11a252b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:10.348198 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1291/2581] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:10.348782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c28dd-e4da-4c01-b551-bf3a11a252b7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:10.356815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c16d5-0415-45c8-acc5-bd1e2152329b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:10.361533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c28dd-e4da-4c01-b551-bf3a11a252b7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:10.370224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751d4dc-014f-474e-8554-da41a61189a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:10.372626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751d4dc-014f-474e-8554-da41a61189a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:10.373269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274da01-5185-4051-9220-64b97774755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:10.373439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751d4dc-014f-474e-8554-da41a61189a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:10.373698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751d4dc-014f-474e-8554-da41a61189a9 admin admin] PATH_INFO: `/v3/projects/83cc0855375147ebb8ad74711570f79a/users/a351bac1d70c4cd981e426dea5c934f1/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:10.375860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274da01-5185-4051-9220-64b97774755d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:10.376142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751d4dc-014f-474e-8554-da41a61189a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc0855375147ebb8ad74711570f79a, user_id=a351bac1d70c4cd981e426dea5c934f1, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:10.377067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274da01-5185-4051-9220-64b97774755d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:10.377825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274da01-5185-4051-9220-64b97774755d admin admin] PATH_INFO: `/v3/users/29b849c08c724ad3ae642bb1bd8aa288` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:10.381564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274da01-5185-4051-9220-64b97774755d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b849c08c724ad3ae642bb1bd8aa288)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:10.381718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751d4dc-014f-474e-8554-da41a61189a9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:10.390073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274da01-5185-4051-9220-64b97774755d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:10.411434 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1292/2582] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:10 2022] PUT /identity/v3/projects/83cc0855375147ebb8ad74711570f79a/users/a351bac1d70c4cd981e426dea5c934f1/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:10.413490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42b25-5cf0-42bc-8fb0-caf771c781cb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:10.413780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42b25-5cf0-42bc-8fb0-caf771c781cb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:10.414059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42b25-5cf0-42bc-8fb0-caf771c781cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:10.460643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-66c42b25-5cf0-42bc-8fb0-caf771c781cb None None] MFA Rules not processed for user `a351bac1d70c4cd981e426dea5c934f1`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:10.463166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-66c42b25-5cf0-42bc-8fb0-caf771c781cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:10.508367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1274da01-5185-4051-9220-64b97774755d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b849c08c724ad3ae642bb1bd8aa288'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.509291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1274da01-5185-4051-9220-64b97774755d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b849c08c724ad3ae642bb1bd8aa288'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.510394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1274da01-5185-4051-9220-64b97774755d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b849c08c724ad3ae642bb1bd8aa288'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.530113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1274da01-5185-4051-9220-64b97774755d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b849c08c724ad3ae642bb1bd8aa288'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.568364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1274da01-5185-4051-9220-64b97774755d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b849c08c724ad3ae642bb1bd8aa288'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:10.602335 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1291/2583] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:10 2022] DELETE /identity/v3/users/29b849c08c724ad3ae642bb1bd8aa288 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:10.637487 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1293/2584] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:10.650701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274da01-5185-4051-9220-64b97774755d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:10.652727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1274da01-5185-4051-9220-64b97774755d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:10.807920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274da01-5185-4051-9220-64b97774755d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:10.838773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:10.839463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:10.839749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:10.843462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:10.877258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c42b25-5cf0-42bc-8fb0-caf771c781cb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:10.879303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-66c42b25-5cf0-42bc-8fb0-caf771c781cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:10.976599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:10.978938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:10.981950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c42b25-5cf0-42bc-8fb0-caf771c781cb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:10.994713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1292/2585] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:11.004859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:11.006447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:11.131130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:11.132028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.132415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.132788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] PATH_INFO: `/v3/projects/b52d678120954ccea2f31fb8b0e41dfb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.136470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52d678120954ccea2f31fb8b0e41dfb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:11.138336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32257652-bc99-43cb-9517-8e19d592d8ea service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:11.142297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:11.143570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:11.144450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.144825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.145107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] PATH_INFO: `/v3/projects/e2188c9b692f4062bb3f678a54ce6b12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.146862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2188c9b692f4062bb3f678a54ce6b12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:11.149528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:11.269746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52d678120954ccea2f31fb8b0e41dfb', 'request_id': 'req-e6fc5909-9bba-4609-bfc9-688f9146c6cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.282296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52d678120954ccea2f31fb8b0e41dfb', 'request_id': 'req-e6fc5909-9bba-4609-bfc9-688f9146c6cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.286615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2188c9b692f4062bb3f678a54ce6b12', 'request_id': 'req-74771ade-ce7d-45cd-89d9-504864025d44'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.297889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52d678120954ccea2f31fb8b0e41dfb', 'request_id': 'req-e6fc5909-9bba-4609-bfc9-688f9146c6cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.305194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2188c9b692f4062bb3f678a54ce6b12', 'request_id': 'req-74771ade-ce7d-45cd-89d9-504864025d44'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.317887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] The token cache is being invalidate because project b52d678120954ccea2f31fb8b0e41dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:11.319161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2188c9b692f4062bb3f678a54ce6b12', 'request_id': 'req-74771ade-ce7d-45cd-89d9-504864025d44'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.320650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.322549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6fc5909-9bba-4609-bfc9-688f9146c6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.330849 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1294/2586] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:10 2022] DELETE /identity/v3/projects/b52d678120954ccea2f31fb8b0e41dfb => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:11.330849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a255237-4cb9-424b-84b9-0f01ee09bf61 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.330849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a255237-4cb9-424b-84b9-0f01ee09bf61 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.330849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a255237-4cb9-424b-84b9-0f01ee09bf61 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.335524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1295/2587] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:11.338468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c275-8c5d-4e4b-90dc-0953afa295b7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.338777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c275-8c5d-4e4b-90dc-0953afa295b7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.339039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c275-8c5d-4e4b-90dc-0953afa295b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.341829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] The token cache is being invalidate because project e2188c9b692f4062bb3f678a54ce6b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:11.342130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.343262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:11.348159 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1293/2588] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:11 2022] DELETE /identity/v3/projects/e2188c9b692f4062bb3f678a54ce6b12 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:52:11.348159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:11.355824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:11.363639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-80e6c275-8c5d-4e4b-90dc-0953afa295b7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:11.364982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-80e6c275-8c5d-4e4b-90dc-0953afa295b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:11.463224 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1296/2589] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:11.463224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c630-f5e4-4001-a2e0-25e826e91f07 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.463224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c630-f5e4-4001-a2e0-25e826e91f07 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.463224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c630-f5e4-4001-a2e0-25e826e91f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.501430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-df34c630-f5e4-4001-a2e0-25e826e91f07 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:11.502674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-df34c630-f5e4-4001-a2e0-25e826e91f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:11.532068 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1297/2590] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:11.533443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0119-6ae2-4e85-aeb3-2db39b7ce5fd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.533732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0119-6ae2-4e85-aeb3-2db39b7ce5fd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.534014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0119-6ae2-4e85-aeb3-2db39b7ce5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.565193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:11.566906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:11.594576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-212a0119-6ae2-4e85-aeb3-2db39b7ce5fd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:11.596423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-212a0119-6ae2-4e85-aeb3-2db39b7ce5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:11.626558 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1298/2591] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:11.627743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0b66f-7d26-480e-ba8b-6d69cbc8f940 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.628021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0b66f-7d26-480e-ba8b-6d69cbc8f940 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.628298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0b66f-7d26-480e-ba8b-6d69cbc8f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.673828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-83f0b66f-7d26-480e-ba8b-6d69cbc8f940 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:11.674988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-83f0b66f-7d26-480e-ba8b-6d69cbc8f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:11.706876 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1299/2592] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:11.707724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0b66f-7d26-480e-ba8b-6d69cbc8f940 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:11.736992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0b66f-7d26-480e-ba8b-6d69cbc8f940 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:11.742574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74771ade-ce7d-45cd-89d9-504864025d44 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:11.753196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdd73-2843-4c6d-9493-16b717d30063 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:11.754343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdd73-2843-4c6d-9493-16b717d30063 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.755526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdd73-2843-4c6d-9493-16b717d30063 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.755526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdd73-2843-4c6d-9493-16b717d30063 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.769858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bdd73-2843-4c6d-9493-16b717d30063 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:11.770053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:11.770053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.770053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.770053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.770420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:11.770420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:11.770420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:11.770659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bdd73-2843-4c6d-9493-16b717d30063 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:11.776501 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1294/2593] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:11 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:11.777523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdd73-2843-4c6d-9493-16b717d30063 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:11.811193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdd73-2843-4c6d-9493-16b717d30063 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:11.830755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8f2cc-e4c2-412d-9830-fd5e546754ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:11.831431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f2cc-e4c2-412d-9830-fd5e546754ca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.831714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f2cc-e4c2-412d-9830-fd5e546754ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.831994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f2cc-e4c2-412d-9830-fd5e546754ca admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.835774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8f2cc-e4c2-412d-9830-fd5e546754ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:11.836097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8f2cc-e4c2-412d-9830-fd5e546754ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:11.837752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8f2cc-e4c2-412d-9830-fd5e546754ca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:11.860051 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1300/2594] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:11.864381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:11.884144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70049-43fd-401a-b8ef-6d0b4fe765a3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:11.885908 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1295/2595] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:11.888573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e79e-bc60-4e7c-a1ad-7db6046ad964 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.894457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:11.895205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.895581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.895937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.897332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:11.898614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e79e-bc60-4e7c-a1ad-7db6046ad964 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.900036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:11.901395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e79e-bc60-4e7c-a1ad-7db6046ad964 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.906192 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1296/2596] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:11 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:11.907901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7e79e-bc60-4e7c-a1ad-7db6046ad964 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:11.938862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7e79e-bc60-4e7c-a1ad-7db6046ad964 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:11.953057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2efcd-4d9f-45bd-b96f-fbfad5524d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:11.954169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efcd-4d9f-45bd-b96f-fbfad5524d88 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:11.954668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efcd-4d9f-45bd-b96f-fbfad5524d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:11.955349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efcd-4d9f-45bd-b96f-fbfad5524d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:11.956229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2efcd-4d9f-45bd-b96f-fbfad5524d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:11.957802 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1301/2597] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:11 2022] POST /identity/v3/projects => generated 407 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:11.958776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:11.959622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2efcd-4d9f-45bd-b96f-fbfad5524d88 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:11.965103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:12.016352 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1297/2598] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:11 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:12.017566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2efcd-4d9f-45bd-b96f-fbfad5524d88 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.071344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.113285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2efcd-4d9f-45bd-b96f-fbfad5524d88 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.131211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcd31c-f24c-4c8f-b1fa-4a7807461c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.132724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd31c-f24c-4c8f-b1fa-4a7807461c76 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.133110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd31c-f24c-4c8f-b1fa-4a7807461c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.133507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd31c-f24c-4c8f-b1fa-4a7807461c76 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.134311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcd31c-f24c-4c8f-b1fa-4a7807461c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.136393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcd31c-f24c-4c8f-b1fa-4a7807461c76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.178539 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1298/2599] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:12 2022] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:12.179625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcd31c-f24c-4c8f-b1fa-4a7807461c76 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.198807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b5a3e-5ae5-4e15-a9c3-afc1c424c42b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.206151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcd31c-f24c-4c8f-b1fa-4a7807461c76 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.215143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4641-4e63-46f1-8653-48a7a36a7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.216031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4641-4e63-46f1-8653-48a7a36a7565 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.216507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4641-4e63-46f1-8653-48a7a36a7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.216997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4641-4e63-46f1-8653-48a7a36a7565 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.218494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4641-4e63-46f1-8653-48a7a36a7565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.220898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4641-4e63-46f1-8653-48a7a36a7565 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.250902 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1299/2600] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:12 2022] POST /identity/v3/users => generated 295 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:12.252172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4641-4e63-46f1-8653-48a7a36a7565 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.265626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4641-4e63-46f1-8653-48a7a36a7565 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.272982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568f04-aade-4378-9aa1-c91d0d9aaa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.274026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568f04-aade-4378-9aa1-c91d0d9aaa96 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.274518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568f04-aade-4378-9aa1-c91d0d9aaa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.275000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568f04-aade-4378-9aa1-c91d0d9aaa96 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.275926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7568f04-aade-4378-9aa1-c91d0d9aaa96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.276903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0381d8-7db4-42ca-a066-d21f176bea00 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.277829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0381d8-7db4-42ca-a066-d21f176bea00 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.278118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0381d8-7db4-42ca-a066-d21f176bea00 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.278398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0381d8-7db4-42ca-a066-d21f176bea00 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.279389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7568f04-aade-4378-9aa1-c91d0d9aaa96 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.279842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0381d8-7db4-42ca-a066-d21f176bea00 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.282590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0381d8-7db4-42ca-a066-d21f176bea00 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.285457 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1302/2601] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:11 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:12.286612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0381d8-7db4-42ca-a066-d21f176bea00 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.301352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0381d8-7db4-42ca-a066-d21f176bea00 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.308600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949cdba-0fdb-4107-a581-7c7042a25261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.309400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cdba-0fdb-4107-a581-7c7042a25261 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.309729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cdba-0fdb-4107-a581-7c7042a25261 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.310198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949cdba-0fdb-4107-a581-7c7042a25261 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.310936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949cdba-0fdb-4107-a581-7c7042a25261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.312844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949cdba-0fdb-4107-a581-7c7042a25261 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.316627 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1300/2602] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:12.321781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568f04-aade-4378-9aa1-c91d0d9aaa96 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.328526 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1303/2603] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:12.331965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949cdba-0fdb-4107-a581-7c7042a25261 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.345987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949cdba-0fdb-4107-a581-7c7042a25261 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.351913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff8cc-8acd-4853-82e3-6f62ae3f9ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.352582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568f04-aade-4378-9aa1-c91d0d9aaa96 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.353652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff8cc-8acd-4853-82e3-6f62ae3f9ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.354174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff8cc-8acd-4853-82e3-6f62ae3f9ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.355199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff8cc-8acd-4853-82e3-6f62ae3f9ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.356252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ff8cc-8acd-4853-82e3-6f62ae3f9ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.358485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ff8cc-8acd-4853-82e3-6f62ae3f9ea5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.366661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0e5c0-1950-44dc-9896-fc64e42cc13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.367321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e5c0-1950-44dc-9896-fc64e42cc13f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.367596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e5c0-1950-44dc-9896-fc64e42cc13f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.367899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e5c0-1950-44dc-9896-fc64e42cc13f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.369162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0e5c0-1950-44dc-9896-fc64e42cc13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.370458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0e5c0-1950-44dc-9896-fc64e42cc13f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.374085 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1304/2604] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:52:12.379024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff8cc-8acd-4853-82e3-6f62ae3f9ea5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.414484 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1301/2605] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:12.417819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268cc6c-485a-44d1-a214-96ab0e2a2c73 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.419608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff8cc-8acd-4853-82e3-6f62ae3f9ea5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.420110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268cc6c-485a-44d1-a214-96ab0e2a2c73 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.420878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268cc6c-485a-44d1-a214-96ab0e2a2c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.433543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf483-bb7c-4c27-ad66-e4e821daa24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.434836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf483-bb7c-4c27-ad66-e4e821daa24f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.435314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf483-bb7c-4c27-ad66-e4e821daa24f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.437598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf483-bb7c-4c27-ad66-e4e821daa24f admin admin] PATH_INFO: `/v3/projects/a0981190244846a18036aa20dce2dc60/users/72ce9a80c4b444259dda1f6a63e6fe49/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.464447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7268cc6c-485a-44d1-a214-96ab0e2a2c73 None None] MFA Rules not processed for user `bb5c1d90fa4f4e36ba82527497b2cbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:12.466208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7268cc6c-485a-44d1-a214-96ab0e2a2c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:12.476301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdf483-bb7c-4c27-ad66-e4e821daa24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0981190244846a18036aa20dce2dc60, user_id=72ce9a80c4b444259dda1f6a63e6fe49, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.482479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdf483-bb7c-4c27-ad66-e4e821daa24f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.512917 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1305/2606] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:12 2022] PUT /identity/v3/projects/a0981190244846a18036aa20dce2dc60/users/72ce9a80c4b444259dda1f6a63e6fe49/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:12.514082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf483-bb7c-4c27-ad66-e4e821daa24f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.573215 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1302/2607] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:12.575504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147216a-9a84-4461-b40e-95f77efcb938 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.576048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147216a-9a84-4461-b40e-95f77efcb938 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.576603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147216a-9a84-4461-b40e-95f77efcb938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.608945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4147216a-9a84-4461-b40e-95f77efcb938 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:12.611021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4147216a-9a84-4461-b40e-95f77efcb938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:12.618578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf483-bb7c-4c27-ad66-e4e821daa24f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.623216 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1303/2608] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:12.631950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a706a-000b-4020-88d9-04ad04611ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.633106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a706a-000b-4020-88d9-04ad04611ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.633487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a706a-000b-4020-88d9-04ad04611ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.634022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a706a-000b-4020-88d9-04ad04611ea4 admin admin] PATH_INFO: `/v3/projects/521a90d1f7954107a473d8484490c2e1/users/926dd891723346f8b2969d5e53e65563/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.654191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147216a-9a84-4461-b40e-95f77efcb938 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.658293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4147216a-9a84-4461-b40e-95f77efcb938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:12.664081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a706a-000b-4020-88d9-04ad04611ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521a90d1f7954107a473d8484490c2e1, user_id=926dd891723346f8b2969d5e53e65563, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.676526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a706a-000b-4020-88d9-04ad04611ea4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.702672 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1306/2609] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:12 2022] PUT /identity/v3/projects/521a90d1f7954107a473d8484490c2e1/users/926dd891723346f8b2969d5e53e65563/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:12.703900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a706a-000b-4020-88d9-04ad04611ea4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:12.796775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147216a-9a84-4461-b40e-95f77efcb938 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.838084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a706a-000b-4020-88d9-04ad04611ea4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:12.850743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9511ec-ee86-4e1a-8135-2256492e7f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.851753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9511ec-ee86-4e1a-8135-2256492e7f45 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.852206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9511ec-ee86-4e1a-8135-2256492e7f45 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.853272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9511ec-ee86-4e1a-8135-2256492e7f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.856257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3d9511ec-ee86-4e1a-8135-2256492e7f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:12.894571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1b7d9-6fb2-4aa0-bffd-357b568887ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:12.895242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1b7d9-6fb2-4aa0-bffd-357b568887ef service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.895523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1b7d9-6fb2-4aa0-bffd-357b568887ef service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.895798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1b7d9-6fb2-4aa0-bffd-357b568887ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:12.981786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9511ec-ee86-4e1a-8135-2256492e7f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.984035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9511ec-ee86-4e1a-8135-2256492e7f45 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.995679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1b7d9-6fb2-4aa0-bffd-357b568887ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:12.997159 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1307/2610] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:12.997843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1b7d9-6fb2-4aa0-bffd-357b568887ef service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:12.998754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e26b2-7e58-4a64-bd59-22bcc944964f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:12.999147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e26b2-7e58-4a64-bd59-22bcc944964f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:12.999529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e26b2-7e58-4a64-bd59-22bcc944964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:13.016646 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1304/2611] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:13.066463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-576e26b2-7e58-4a64-bd59-22bcc944964f None None] MFA Rules not processed for user `926dd891723346f8b2969d5e53e65563`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:13.067814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-576e26b2-7e58-4a64-bd59-22bcc944964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:13.201107 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1308/2612] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:13.205452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1b7d9-6fb2-4aa0-bffd-357b568887ef service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:13.221638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1b7d9-6fb2-4aa0-bffd-357b568887ef service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:13.229267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c88d57-4348-4167-8782-fec3005adf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:13.230179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c88d57-4348-4167-8782-fec3005adf43 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:13.230617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c88d57-4348-4167-8782-fec3005adf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:13.231046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c88d57-4348-4167-8782-fec3005adf43 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:13.233122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c88d57-4348-4167-8782-fec3005adf43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:13.234405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c88d57-4348-4167-8782-fec3005adf43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:13.304176 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1305/2613] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:13 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:13.308417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e26b2-7e58-4a64-bd59-22bcc944964f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:13.325606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e26b2-7e58-4a64-bd59-22bcc944964f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:13.500161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b311a-6d8c-4c0d-b6bf-1b11624bc2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:13.517157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b311a-6d8c-4c0d-b6bf-1b11624bc2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:13.517597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b311a-6d8c-4c0d-b6bf-1b11624bc2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:13.517980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b311a-6d8c-4c0d-b6bf-1b11624bc2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:13.520034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b311a-6d8c-4c0d-b6bf-1b11624bc2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:13.539147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b311a-6d8c-4c0d-b6bf-1b11624bc2a0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:13.626205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c88d57-4348-4167-8782-fec3005adf43 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:13.627765 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1309/2614] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:13 2022] POST /identity/v3/users => generated 311 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:52:13.649108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c88d57-4348-4167-8782-fec3005adf43 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:13.668444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afaaac-f119-4f12-8825-6694df21d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:13.669347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afaaac-f119-4f12-8825-6694df21d2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:13.669948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afaaac-f119-4f12-8825-6694df21d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:13.671243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afaaac-f119-4f12-8825-6694df21d2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:13.672762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afaaac-f119-4f12-8825-6694df21d2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:13.674996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afaaac-f119-4f12-8825-6694df21d2d7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:13.717431 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1306/2615] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:13.721573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b311a-6d8c-4c0d-b6bf-1b11624bc2a0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:13.768566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b311a-6d8c-4c0d-b6bf-1b11624bc2a0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:13.776110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ef08-5d15-4721-ae30-a1ce48ea0b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:13.782485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ef08-5d15-4721-ae30-a1ce48ea0b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:13.782981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ef08-5d15-4721-ae30-a1ce48ea0b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:13.783374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ef08-5d15-4721-ae30-a1ce48ea0b1c admin admin] PATH_INFO: `/v3/projects/6ea09983e22649e689ebf6103b3436d2/users/262624479e7941c1bafaa1cc07be19be/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:13.821757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52ef08-5d15-4721-ae30-a1ce48ea0b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea09983e22649e689ebf6103b3436d2, user_id=262624479e7941c1bafaa1cc07be19be, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:13.824547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52ef08-5d15-4721-ae30-a1ce48ea0b1c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:13.865260 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1310/2616] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:13 2022] PUT /identity/v3/projects/6ea09983e22649e689ebf6103b3436d2/users/262624479e7941c1bafaa1cc07be19be/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:13.867185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afaaac-f119-4f12-8825-6694df21d2d7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:13.894073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afaaac-f119-4f12-8825-6694df21d2d7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:13.984953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53ea37-f9c2-4a86-bf00-40e57b6e6fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:13.985821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ea37-f9c2-4a86-bf00-40e57b6e6fbd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:13.986347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ea37-f9c2-4a86-bf00-40e57b6e6fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:13.986852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53ea37-f9c2-4a86-bf00-40e57b6e6fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:13.987668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53ea37-f9c2-4a86-bf00-40e57b6e6fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:13.992885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53ea37-f9c2-4a86-bf00-40e57b6e6fbd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:14.015907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ef08-5d15-4721-ae30-a1ce48ea0b1c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:14.031533 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1307/2617] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:52:14.032214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ef08-5d15-4721-ae30-a1ce48ea0b1c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:14.039412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7578c2-976e-46c2-966c-e884125f0d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:14.040339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7578c2-976e-46c2-966c-e884125f0d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:14.040633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7578c2-976e-46c2-966c-e884125f0d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:14.040906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7578c2-976e-46c2-966c-e884125f0d42 admin admin] PATH_INFO: `/v3/projects/6ea09983e22649e689ebf6103b3436d2/users/262624479e7941c1bafaa1cc07be19be/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:14.043134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7578c2-976e-46c2-966c-e884125f0d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea09983e22649e689ebf6103b3436d2, user_id=262624479e7941c1bafaa1cc07be19be, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:14.045852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7578c2-976e-46c2-966c-e884125f0d42 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:14.077244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bcc66-1917-46f0-b24d-736703305c6e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:14.077537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bcc66-1917-46f0-b24d-736703305c6e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:14.077818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bcc66-1917-46f0-b24d-736703305c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:14.079655 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1311/2618] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:14 2022] PUT /identity/v3/projects/6ea09983e22649e689ebf6103b3436d2/users/262624479e7941c1bafaa1cc07be19be/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:14.112627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c46bcc66-1917-46f0-b24d-736703305c6e None None] MFA Rules not processed for user `262624479e7941c1bafaa1cc07be19be`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:14.113876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c46bcc66-1917-46f0-b24d-736703305c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:14.255479 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1308/2619] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:14.430343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee332dc-48aa-44a2-b916-44e313dfd0af None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:14.430874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee332dc-48aa-44a2-b916-44e313dfd0af None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:14.430989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee332dc-48aa-44a2-b916-44e313dfd0af None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:14.433315 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1312/2620] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:14.440015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bcc66-1917-46f0-b24d-736703305c6e None None] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:14.590933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bcc66-1917-46f0-b24d-736703305c6e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:14.621642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee332dc-48aa-44a2-b916-44e313dfd0af None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:14.648357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee332dc-48aa-44a2-b916-44e313dfd0af None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:14.664415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b51f8-af83-4d81-afcd-67dd47da2844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:14.664717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b51f8-af83-4d81-afcd-67dd47da2844 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:14.664972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b51f8-af83-4d81-afcd-67dd47da2844 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:14.665328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b51f8-af83-4d81-afcd-67dd47da2844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:14.689808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b51f8-af83-4d81-afcd-67dd47da2844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:14.692595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b51f8-af83-4d81-afcd-67dd47da2844 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:14.716271 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1313/2621] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:14.778268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bcc66-1917-46f0-b24d-736703305c6e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:14.790310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdb31a-a333-4204-8615-ccc91e5b1f7f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:14.791520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb31a-a333-4204-8615-ccc91e5b1f7f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:14.791955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb31a-a333-4204-8615-ccc91e5b1f7f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:14.792386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb31a-a333-4204-8615-ccc91e5b1f7f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:14.794263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdb31a-a333-4204-8615-ccc91e5b1f7f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:14.799009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdb31a-a333-4204-8615-ccc91e5b1f7f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:14.803241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b51f8-af83-4d81-afcd-67dd47da2844 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:14.806600 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1309/2622] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:14 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:14.825221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b51f8-af83-4d81-afcd-67dd47da2844 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:14.843694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:14.844628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:14.845045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:14.845423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:14.847645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:14.891284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a03d0-3b7c-41ab-85ae-e8a895ba18f4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:14.891641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a03d0-3b7c-41ab-85ae-e8a895ba18f4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:14.892173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a03d0-3b7c-41ab-85ae-e8a895ba18f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:14.922378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8f3a03d0-3b7c-41ab-85ae-e8a895ba18f4 None None] MFA Rules not processed for user `08781c2dd21c4011b5eebde0436042c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:14.928501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8f3a03d0-3b7c-41ab-85ae-e8a895ba18f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:14.980451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:14.983007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:15.006714 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1314/2623] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:52:15.020584 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1310/2624] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:52:15.209554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:15.222568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012a03-ef09-4e6c-b01c-cfe49ec36e4c service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:15.231538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221e077-39da-4acc-b3d0-d08b3ec5071f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:15.232499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221e077-39da-4acc-b3d0-d08b3ec5071f service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:15.232933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221e077-39da-4acc-b3d0-d08b3ec5071f service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:15.233476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221e077-39da-4acc-b3d0-d08b3ec5071f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:15.285937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31309-0b21-4f42-a31b-059d85e2db37 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:15.287083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31309-0b21-4f42-a31b-059d85e2db37 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:15.287083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31309-0b21-4f42-a31b-059d85e2db37 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:15.289133 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1311/2625] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:52:15.295176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31309-0b21-4f42-a31b-059d85e2db37 None None] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:15.324434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31309-0b21-4f42-a31b-059d85e2db37 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:15.341468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31309-0b21-4f42-a31b-059d85e2db37 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:15.351048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221e077-39da-4acc-b3d0-d08b3ec5071f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:15.352002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411deb09-2431-4153-b748-05ed1b7a4f28 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:15.352690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221e077-39da-4acc-b3d0-d08b3ec5071f service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:15.352892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411deb09-2431-4153-b748-05ed1b7a4f28 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:15.353178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411deb09-2431-4153-b748-05ed1b7a4f28 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:15.353454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411deb09-2431-4153-b748-05ed1b7a4f28 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:15.357103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411deb09-2431-4153-b748-05ed1b7a4f28 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:15.359179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411deb09-2431-4153-b748-05ed1b7a4f28 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:15.364599 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1312/2626] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:15 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:15.380099 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1315/2627] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:15.395068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411deb09-2431-4153-b748-05ed1b7a4f28 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:15.417974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411deb09-2431-4153-b748-05ed1b7a4f28 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:15.428784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:15.429481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:15.429774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:15.430058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:15.432657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:15.448903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:15.450625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:15.463188 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1313/2628] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:16.471887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767729a-135d-4918-a0ef-166ab22c5d2e None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:16.472441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767729a-135d-4918-a0ef-166ab22c5d2e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:16.472530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767729a-135d-4918-a0ef-166ab22c5d2e None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:16.474261 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1316/2629] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:16.479412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:16.493942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:16.505520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262221-eca8-4836-b540-c073a3de05fd service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:16.511250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0494b29-a3a3-4bc3-9b57-415cca959385 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:16.512311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0494b29-a3a3-4bc3-9b57-415cca959385 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:16.513006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0494b29-a3a3-4bc3-9b57-415cca959385 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:16.513006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0494b29-a3a3-4bc3-9b57-415cca959385 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:16.514419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0494b29-a3a3-4bc3-9b57-415cca959385 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:16.516707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0494b29-a3a3-4bc3-9b57-415cca959385 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:16.547411 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1314/2630] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:16 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:52:16.668298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740455-a756-4ec0-88f2-c761a5750501 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:16.669311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740455-a756-4ec0-88f2-c761a5750501 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:16.669697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740455-a756-4ec0-88f2-c761a5750501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:16.696102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d7740455-a756-4ec0-88f2-c761a5750501 None None] MFA Rules not processed for user `bb5c1d90fa4f4e36ba82527497b2cbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:16.697712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d7740455-a756-4ec0-88f2-c761a5750501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:16.809089 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1317/2631] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:17.952089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0494b29-a3a3-4bc3-9b57-415cca959385 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:18.036923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976145-e06d-44e5-996f-07a3579e8063 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:18.041996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976145-e06d-44e5-996f-07a3579e8063 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:18.042550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976145-e06d-44e5-996f-07a3579e8063 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:18.049511 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1318/2632] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:18 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:52:18.055218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8976145-e06d-44e5-996f-07a3579e8063 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:18.085081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8976145-e06d-44e5-996f-07a3579e8063 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:18.111735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8976145-e06d-44e5-996f-07a3579e8063 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:18.126312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0494b29-a3a3-4bc3-9b57-415cca959385 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:18.130672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a53f-4b47-4edb-ab0c-18dc3ee54b66 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:18.135705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a53f-4b47-4edb-ab0c-18dc3ee54b66 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:18.136245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a53f-4b47-4edb-ab0c-18dc3ee54b66 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:18.137029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a53f-4b47-4edb-ab0c-18dc3ee54b66 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:18.140829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a53f-4b47-4edb-ab0c-18dc3ee54b66 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:18.147165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a53f-4b47-4edb-ab0c-18dc3ee54b66 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:18.148444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:18.149463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:18.150278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:18.150697 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1319/2633] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:18 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:18.151315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] PATH_INFO: `/v3/users/926dd891723346f8b2969d5e53e65563` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:18.154334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] RBAC: Authorizing `identity:delete_user(user_id=926dd891723346f8b2969d5e53e65563)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:18.158082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:18.281357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926dd891723346f8b2969d5e53e65563'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:18.282052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926dd891723346f8b2969d5e53e65563'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:18.283870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926dd891723346f8b2969d5e53e65563'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:18.319507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926dd891723346f8b2969d5e53e65563'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:18.347195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926dd891723346f8b2969d5e53e65563'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:18.363086 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1315/2634] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:17 2022] DELETE /identity/v3/users/926dd891723346f8b2969d5e53e65563 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:18.367973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cba12-234c-4c65-963e-6ad39cde40ef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:18.369365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cba12-234c-4c65-963e-6ad39cde40ef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:18.369818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cba12-234c-4c65-963e-6ad39cde40ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:18.414050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-850cba12-234c-4c65-963e-6ad39cde40ef None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:18.416305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-850cba12-234c-4c65-963e-6ad39cde40ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:18.576384 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1320/2635] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:52:18.588285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:18.589930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:18.594261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9d41c-c203-478b-b562-23dd7a674e5f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:18.594613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9d41c-c203-478b-b562-23dd7a674e5f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:18.595129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9d41c-c203-478b-b562-23dd7a674e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:18.645498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a4e9d41c-c203-478b-b562-23dd7a674e5f None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:18.651229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4e9d41c-c203-478b-b562-23dd7a674e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:18.729180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39184-bb02-4257-80d3-7b5ddf08383e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:18.738752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:18.739423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:18.739704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:18.740691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:18.751211 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1321/2636] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:18.754421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50638e7-abdb-45bb-aef7-5331d5155972 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:18.754718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50638e7-abdb-45bb-aef7-5331d5155972 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:18.754999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50638e7-abdb-45bb-aef7-5331d5155972 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:18.761929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:18.763632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:18.765620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1322/2637] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:18.769425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50638e7-abdb-45bb-aef7-5331d5155972 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:18.774468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a50638e7-abdb-45bb-aef7-5331d5155972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:18.785240 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1316/2638] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:18.786557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:18.790057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:18.972210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb7e8f-cff7-46e4-b5a8-2dafa5dc210c service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:18.976854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50638e7-abdb-45bb-aef7-5331d5155972 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:18.981315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a50638e7-abdb-45bb-aef7-5331d5155972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:18.986234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e55fa-0a1b-4736-b154-9c59d55a869f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:18.988321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e55fa-0a1b-4736-b154-9c59d55a869f service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:18.990156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e55fa-0a1b-4736-b154-9c59d55a869f service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:18.990976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e55fa-0a1b-4736-b154-9c59d55a869f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:19.012183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e55fa-0a1b-4736-b154-9c59d55a869f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:19.015458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e55fa-0a1b-4736-b154-9c59d55a869f service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:19.038898 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1317/2639] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:52:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:19.233289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50638e7-abdb-45bb-aef7-5331d5155972 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:19.252100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:19.256380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:19.256721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:19.257043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:19.261627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:19.266565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:19.279274 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1323/2640] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:18 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:19.832036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3907880-16f6-4a52-b94b-93c2abe8ea1f None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:19.832485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3907880-16f6-4a52-b94b-93c2abe8ea1f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:19.832776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3907880-16f6-4a52-b94b-93c2abe8ea1f None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:19.835827 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1318/2641] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:19.841434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:19.861329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:19.895227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc3a38-d101-4320-908d-5d6b902c3e68 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:19.906937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:19.907848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:19.908103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:19.908413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:19.926083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:19.928580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:19.930473 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1324/2642] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:19 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:20.111311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb53c1-74dd-4661-b0bd-02f4823a4ca6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:20.111837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb53c1-74dd-4661-b0bd-02f4823a4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:20.111837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb53c1-74dd-4661-b0bd-02f4823a4ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:20.168291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-12cb53c1-74dd-4661-b0bd-02f4823a4ca6 None None] MFA Rules not processed for user `bb5c1d90fa4f4e36ba82527497b2cbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:20.177184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-12cb53c1-74dd-4661-b0bd-02f4823a4ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:20.351008 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1319/2643] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:21.045110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:21.047000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:21.080915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1080-e6f6-40fe-8cd9-3a543f5b33d3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:21.094835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:21.105734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:21.112874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:21.113382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] PATH_INFO: `/v3/projects/521a90d1f7954107a473d8484490c2e1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:21.114998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521a90d1f7954107a473d8484490c2e1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:21.117162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:21.165315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4106-b55d-4e23-a811-ca56d0af5634 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:21.165801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4106-b55d-4e23-a811-ca56d0af5634 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:21.165910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4106-b55d-4e23-a811-ca56d0af5634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:21.238046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521a90d1f7954107a473d8484490c2e1', 'request_id': 'req-ecdbf313-bc33-453a-8a18-2e3f45428df9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.243351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5e8f4106-b55d-4e23-a811-ca56d0af5634 None None] MFA Rules not processed for user `72ce9a80c4b444259dda1f6a63e6fe49`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:21.245280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e8f4106-b55d-4e23-a811-ca56d0af5634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:21.257745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521a90d1f7954107a473d8484490c2e1', 'request_id': 'req-ecdbf313-bc33-453a-8a18-2e3f45428df9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.281825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521a90d1f7954107a473d8484490c2e1', 'request_id': 'req-ecdbf313-bc33-453a-8a18-2e3f45428df9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.299040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] The token cache is being invalidate because project 521a90d1f7954107a473d8484490c2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:21.299547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.312860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.319866 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1325/2644] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:21 2022] DELETE /identity/v3/projects/521a90d1f7954107a473d8484490c2e1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:21.320918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:21.322436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:21.445339 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1320/2645] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:21.447759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f4106-b55d-4e23-a811-ca56d0af5634 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:21.449515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e8f4106-b55d-4e23-a811-ca56d0af5634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:21.456166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf313-bc33-453a-8a18-2e3f45428df9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:21.465006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:21.466346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:21.466846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:21.467830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] PATH_INFO: `/v3/users/262624479e7941c1bafaa1cc07be19be` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:21.469381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=262624479e7941c1bafaa1cc07be19be)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:21.472233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:21.481607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f4106-b55d-4e23-a811-ca56d0af5634 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:21.510191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1415475-1e77-44cd-81c0-b10837af3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:21.511225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415475-1e77-44cd-81c0-b10837af3d35 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:21.512200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415475-1e77-44cd-81c0-b10837af3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:21.512200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415475-1e77-44cd-81c0-b10837af3d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:21.513329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1415475-1e77-44cd-81c0-b10837af3d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:21.515913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1415475-1e77-44cd-81c0-b10837af3d35 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:21.654086 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1321/2646] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:21 2022] POST /identity/v3/projects => generated 389 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:21.656831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1415475-1e77-44cd-81c0-b10837af3d35 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:21.671879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262624479e7941c1bafaa1cc07be19be'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.723113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262624479e7941c1bafaa1cc07be19be'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.746297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262624479e7941c1bafaa1cc07be19be'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.747371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262624479e7941c1bafaa1cc07be19be'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.748161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262624479e7941c1bafaa1cc07be19be'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:21.789309 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1326/2647] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:21 2022] DELETE /identity/v3/users/262624479e7941c1bafaa1cc07be19be => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:21.900992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1415475-1e77-44cd-81c0-b10837af3d35 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:22.052704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baa8c1-8ad3-4fdb-b698-9f3549f1a263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:22.055198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baa8c1-8ad3-4fdb-b698-9f3549f1a263 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:22.056920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baa8c1-8ad3-4fdb-b698-9f3549f1a263 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:22.058050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baa8c1-8ad3-4fdb-b698-9f3549f1a263 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:22.059317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79baa8c1-8ad3-4fdb-b698-9f3549f1a263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:22.062017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79baa8c1-8ad3-4fdb-b698-9f3549f1a263 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:22.122416 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1322/2648] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:21 2022] POST /identity/v3/users => generated 301 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:22.126380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:22.127837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:22.149105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4162c-069c-4a9c-a38d-02fb35edf39a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:22.154273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e6a6c-4ff4-4575-ae0d-6b4e45668540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:22.155763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6a6c-4ff4-4575-ae0d-6b4e45668540 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:22.156378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6a6c-4ff4-4575-ae0d-6b4e45668540 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:22.156974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6a6c-4ff4-4575-ae0d-6b4e45668540 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:22.158316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e6a6c-4ff4-4575-ae0d-6b4e45668540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:22.160553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e6a6c-4ff4-4575-ae0d-6b4e45668540 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:22.179751 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1327/2649] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:22.184845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baa8c1-8ad3-4fdb-b698-9f3549f1a263 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:22.208884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baa8c1-8ad3-4fdb-b698-9f3549f1a263 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:22.215948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c5b4f-fe55-4241-8314-49059069a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:22.217556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c5b4f-fe55-4241-8314-49059069a692 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:22.218239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c5b4f-fe55-4241-8314-49059069a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:22.218795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c5b4f-fe55-4241-8314-49059069a692 admin admin] PATH_INFO: `/v3/projects/e5c74fd9df6a462e8fdb33768ba14e60/users/d5d7865cf8614882b58cad856e16d0c4/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:22.243426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c5b4f-fe55-4241-8314-49059069a692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c74fd9df6a462e8fdb33768ba14e60, user_id=d5d7865cf8614882b58cad856e16d0c4, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:22.248840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c5b4f-fe55-4241-8314-49059069a692 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:22.276754 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1323/2650] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:22 2022] PUT /identity/v3/projects/e5c74fd9df6a462e8fdb33768ba14e60/users/d5d7865cf8614882b58cad856e16d0c4/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:22.280374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e6a6c-4ff4-4575-ae0d-6b4e45668540 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:22.301565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e6a6c-4ff4-4575-ae0d-6b4e45668540 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:22.379633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:22.380704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:22.381323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:22.381908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:22.383150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:22.387655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:22.402770 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1328/2651] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:52:22.407252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c5b4f-fe55-4241-8314-49059069a692 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:22.429255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c5b4f-fe55-4241-8314-49059069a692 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:22.440586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705107d-e642-40b3-b1ef-d0b9e068113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:22.446067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705107d-e642-40b3-b1ef-d0b9e068113d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:22.446595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705107d-e642-40b3-b1ef-d0b9e068113d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:22.447061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705107d-e642-40b3-b1ef-d0b9e068113d admin admin] PATH_INFO: `/v3/projects/e5c74fd9df6a462e8fdb33768ba14e60/users/d5d7865cf8614882b58cad856e16d0c4/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:22.449717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705107d-e642-40b3-b1ef-d0b9e068113d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c74fd9df6a462e8fdb33768ba14e60, user_id=d5d7865cf8614882b58cad856e16d0c4, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:22.452575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705107d-e642-40b3-b1ef-d0b9e068113d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:22.469233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1324/2652] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:22 2022] PUT /identity/v3/projects/e5c74fd9df6a462e8fdb33768ba14e60/users/d5d7865cf8614882b58cad856e16d0c4/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:52:23.365756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:23.371869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:23.402288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a1d13-28c4-4e37-aba3-86854bc33192 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:23.542729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:23.544060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:23.544448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:23.546338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] PATH_INFO: `/v3/projects/6ea09983e22649e689ebf6103b3436d2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:23.547894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea09983e22649e689ebf6103b3436d2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:23.549943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:23.638771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea09983e22649e689ebf6103b3436d2', 'request_id': 'req-3bf966be-9612-43aa-927c-6a6dfebf8615'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:23.656723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea09983e22649e689ebf6103b3436d2', 'request_id': 'req-3bf966be-9612-43aa-927c-6a6dfebf8615'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:23.672557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea09983e22649e689ebf6103b3436d2', 'request_id': 'req-3bf966be-9612-43aa-927c-6a6dfebf8615'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:23.698341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] The token cache is being invalidate because project 6ea09983e22649e689ebf6103b3436d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:23.698753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:23.700454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3bf966be-9612-43aa-927c-6a6dfebf8615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:23.710461 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1329/2653] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:23 2022] DELETE /identity/v3/projects/6ea09983e22649e689ebf6103b3436d2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:23.711990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a43af-b10d-4688-94f6-a4dafd552ca0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:23.713503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a43af-b10d-4688-94f6-a4dafd552ca0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:23.713687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a43af-b10d-4688-94f6-a4dafd552ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:23.746568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-556a43af-b10d-4688-94f6-a4dafd552ca0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:23.749142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-556a43af-b10d-4688-94f6-a4dafd552ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:23.871931 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1325/2654] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:52:23.880754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455d03-c9e9-4085-86e0-7ed5e1411ec4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:23.881214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455d03-c9e9-4085-86e0-7ed5e1411ec4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:23.881601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455d03-c9e9-4085-86e0-7ed5e1411ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:23.933398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b2455d03-c9e9-4085-86e0-7ed5e1411ec4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:23.936502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b2455d03-c9e9-4085-86e0-7ed5e1411ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:23.957450 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1330/2655] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:23.961850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a43af-b10d-4688-94f6-a4dafd552ca0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:23.978045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a43af-b10d-4688-94f6-a4dafd552ca0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:23.993172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:23.993864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:23.997680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:23.998053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:24.000615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:24.000947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:24.004714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:24.055391 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1326/2656] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:24.060011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2455d03-c9e9-4085-86e0-7ed5e1411ec4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:24.070433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2455d03-c9e9-4085-86e0-7ed5e1411ec4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:24.083430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a6abf-ca64-44dd-a3f9-d684945fd294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:24.084910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a6abf-ca64-44dd-a3f9-d684945fd294 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:24.085297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a6abf-ca64-44dd-a3f9-d684945fd294 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:24.085673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a6abf-ca64-44dd-a3f9-d684945fd294 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:24.086494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a6abf-ca64-44dd-a3f9-d684945fd294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:24.090248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a6abf-ca64-44dd-a3f9-d684945fd294 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:24.170678 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1331/2657] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:24 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:52:24.173973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:24.202781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20906d2b-6e48-47f9-a4c5-0e672afd1d16 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:24.362588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b8098-fa5f-481f-be13-2b5472debfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:24.364059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b8098-fa5f-481f-be13-2b5472debfeb admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:24.367164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b8098-fa5f-481f-be13-2b5472debfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:24.368147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b8098-fa5f-481f-be13-2b5472debfeb admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:24.371787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b8098-fa5f-481f-be13-2b5472debfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:24.377046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b8098-fa5f-481f-be13-2b5472debfeb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:24.419968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a6abf-ca64-44dd-a3f9-d684945fd294 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:24.435545 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1327/2658] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:24 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:52:24.439870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a6abf-ca64-44dd-a3f9-d684945fd294 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:24.453105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0f295-2651-4bd1-8146-830b67f99ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:24.455672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0f295-2651-4bd1-8146-830b67f99ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:24.456230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0f295-2651-4bd1-8146-830b67f99ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:24.456531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0f295-2651-4bd1-8146-830b67f99ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:24.457300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0f295-2651-4bd1-8146-830b67f99ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:24.459499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0f295-2651-4bd1-8146-830b67f99ae3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:24.495019 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1332/2659] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:24.499144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b8098-fa5f-481f-be13-2b5472debfeb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:24.513398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b8098-fa5f-481f-be13-2b5472debfeb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:24.533996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1bf3a-6652-4b98-a788-1708e671b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:24.534696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1bf3a-6652-4b98-a788-1708e671b196 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:24.534985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1bf3a-6652-4b98-a788-1708e671b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:24.535289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1bf3a-6652-4b98-a788-1708e671b196 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:24.536030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1bf3a-6652-4b98-a788-1708e671b196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:24.541606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1bf3a-6652-4b98-a788-1708e671b196 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:24.576449 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1328/2660] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:24.580570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0f295-2651-4bd1-8146-830b67f99ae3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:24.610341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0f295-2651-4bd1-8146-830b67f99ae3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:24.626080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d6885-821e-4de2-9d5f-089452b59b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:24.626995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6885-821e-4de2-9d5f-089452b59b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:24.627457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6885-821e-4de2-9d5f-089452b59b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:24.627736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6885-821e-4de2-9d5f-089452b59b8d admin admin] PATH_INFO: `/v3/projects/81e756cebb9c45ddb687ea373d7ddaa3/users/05654d818a474f378f6cc02850b57e1b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:24.674191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d6885-821e-4de2-9d5f-089452b59b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e756cebb9c45ddb687ea373d7ddaa3, user_id=05654d818a474f378f6cc02850b57e1b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:24.685904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d6885-821e-4de2-9d5f-089452b59b8d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:24.720961 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1333/2661] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:24 2022] PUT /identity/v3/projects/81e756cebb9c45ddb687ea373d7ddaa3/users/05654d818a474f378f6cc02850b57e1b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:24.734181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033df509-8532-4b4c-a57b-37471888b9f9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:24.734739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033df509-8532-4b4c-a57b-37471888b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:24.734739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033df509-8532-4b4c-a57b-37471888b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:24.769330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-033df509-8532-4b4c-a57b-37471888b9f9 None None] MFA Rules not processed for user `05654d818a474f378f6cc02850b57e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:24.770647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-033df509-8532-4b4c-a57b-37471888b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:24.853677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1329/2662] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:24.859741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d6885-821e-4de2-9d5f-089452b59b8d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:25.078674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866715cb-37c3-46e7-a0fd-5101041c9075 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:25.078964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866715cb-37c3-46e7-a0fd-5101041c9075 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:25.079273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866715cb-37c3-46e7-a0fd-5101041c9075 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:25.081098 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1330/2663] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:52:25.095341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866715cb-37c3-46e7-a0fd-5101041c9075 None None] Authenticating service token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 20:52:25.097464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-866715cb-37c3-46e7-a0fd-5101041c9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:25.113407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d6885-821e-4de2-9d5f-089452b59b8d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:25.127600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7403a-a01e-4ced-b35a-691f9e3cb9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:25.128963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7403a-a01e-4ced-b35a-691f9e3cb9ce admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:25.129461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7403a-a01e-4ced-b35a-691f9e3cb9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:25.130137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7403a-a01e-4ced-b35a-691f9e3cb9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:25.132099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7403a-a01e-4ced-b35a-691f9e3cb9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:25.134497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7403a-a01e-4ced-b35a-691f9e3cb9ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:25.203418 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1334/2664] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:24 2022] POST /identity/v3/projects => generated 387 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:25.215262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7403a-a01e-4ced-b35a-691f9e3cb9ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:25.305065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866715cb-37c3-46e7-a0fd-5101041c9075 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:25.310078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-866715cb-37c3-46e7-a0fd-5101041c9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:25.455284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7403a-a01e-4ced-b35a-691f9e3cb9ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:25.471637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f04ae-b4ef-40d0-832f-a6c869b2c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:25.472523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f04ae-b4ef-40d0-832f-a6c869b2c235 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:25.472685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f04ae-b4ef-40d0-832f-a6c869b2c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:25.473275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866715cb-37c3-46e7-a0fd-5101041c9075 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:25.473732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f04ae-b4ef-40d0-832f-a6c869b2c235 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:25.475339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f04ae-b4ef-40d0-832f-a6c869b2c235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:25.478171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f04ae-b4ef-40d0-832f-a6c869b2c235 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:25.551463 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1335/2665] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:25 2022] POST /identity/v3/users => generated 300 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:25.557228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f04ae-b4ef-40d0-832f-a6c869b2c235 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:25.595596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f04ae-b4ef-40d0-832f-a6c869b2c235 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:25.627769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab77d-5d76-463a-93ac-6c3a815faaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:25.628495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab77d-5d76-463a-93ac-6c3a815faaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:25.628777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab77d-5d76-463a-93ac-6c3a815faaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:25.632891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab77d-5d76-463a-93ac-6c3a815faaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:25.633699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ab77d-5d76-463a-93ac-6c3a815faaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:25.635325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ab77d-5d76-463a-93ac-6c3a815faaf1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:25.710141 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1336/2666] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:52:25.712842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab77d-5d76-463a-93ac-6c3a815faaf1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:25.757768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab77d-5d76-463a-93ac-6c3a815faaf1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:25.769458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab398e81-0da8-4683-9c82-58239db7ed92 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351bac1d70c4cd981e426dea5c934f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83cc0855375147ebb8ad74711570f79a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:25.771962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab398e81-0da8-4683-9c82-58239db7ed92 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:25.774530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab398e81-0da8-4683-9c82-58239db7ed92 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:25.779319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab398e81-0da8-4683-9c82-58239db7ed92 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:25.786108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab398e81-0da8-4683-9c82-58239db7ed92 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorizing `identity:get_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:25.788006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc56301-15c8-48d3-bc53-733a846b245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:25.790423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab398e81-0da8-4683-9c82-58239db7ed92 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:25.792690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56301-15c8-48d3-bc53-733a846b245d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:25.793266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56301-15c8-48d3-bc53-733a846b245d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:25.795948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56301-15c8-48d3-bc53-733a846b245d admin admin] PATH_INFO: `/v3/projects/347e5866bf314d0b90d0603ca14aa736/users/5dc83497d84643b6a3d839a097f1680a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:25.798652 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1331/2667] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 20:52:25 2022] GET /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 381 bytes in 704 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:52:25.834941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc56301-15c8-48d3-bc53-733a846b245d admin admin] RBAC: Authorizing `identity:create_grant(project_id=347e5866bf314d0b90d0603ca14aa736, user_id=5dc83497d84643b6a3d839a097f1680a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:25.842913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc56301-15c8-48d3-bc53-733a846b245d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:25.874520 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1337/2668] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:25 2022] PUT /identity/v3/projects/347e5866bf314d0b90d0603ca14aa736/users/5dc83497d84643b6a3d839a097f1680a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:25.878896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab398e81-0da8-4683-9c82-58239db7ed92 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:25.898195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab398e81-0da8-4683-9c82-58239db7ed92 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:26.118359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763854a8-ca6f-412a-a2b5-4b55a4f00e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:26.119149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763854a8-ca6f-412a-a2b5-4b55a4f00e8a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:26.121493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763854a8-ca6f-412a-a2b5-4b55a4f00e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:26.124697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763854a8-ca6f-412a-a2b5-4b55a4f00e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:26.131052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763854a8-ca6f-412a-a2b5-4b55a4f00e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:26.131052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763854a8-ca6f-412a-a2b5-4b55a4f00e8a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:26.187742 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1332/2669] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:26.189554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc56301-15c8-48d3-bc53-733a846b245d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:26.214174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc56301-15c8-48d3-bc53-733a846b245d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:26.241114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472108e-58c1-47c0-9a9a-70abf4949f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:26.242184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472108e-58c1-47c0-9a9a-70abf4949f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:26.247969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472108e-58c1-47c0-9a9a-70abf4949f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:26.248415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472108e-58c1-47c0-9a9a-70abf4949f4a admin admin] PATH_INFO: `/v3/projects/347e5866bf314d0b90d0603ca14aa736/users/5dc83497d84643b6a3d839a097f1680a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:26.252283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472108e-58c1-47c0-9a9a-70abf4949f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=347e5866bf314d0b90d0603ca14aa736, user_id=5dc83497d84643b6a3d839a097f1680a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:26.261907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472108e-58c1-47c0-9a9a-70abf4949f4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:26.301670 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1338/2670] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:26 2022] PUT /identity/v3/projects/347e5866bf314d0b90d0603ca14aa736/users/5dc83497d84643b6a3d839a097f1680a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:26.316409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6673-f1dd-48d5-884c-9ae20a5a2a7f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:26.317936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6673-f1dd-48d5-884c-9ae20a5a2a7f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:26.319530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6673-f1dd-48d5-884c-9ae20a5a2a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:26.400218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1d6f6673-f1dd-48d5-884c-9ae20a5a2a7f None None] MFA Rules not processed for user `5dc83497d84643b6a3d839a097f1680a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:26.403030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1d6f6673-f1dd-48d5-884c-9ae20a5a2a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:26.614346 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1333/2671] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:26.627627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930471f2-fefc-4abf-b064-6f79354afe85 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:26.628460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930471f2-fefc-4abf-b064-6f79354afe85 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:26.628911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930471f2-fefc-4abf-b064-6f79354afe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:26.675139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-930471f2-fefc-4abf-b064-6f79354afe85 None None] MFA Rules not processed for user `05654d818a474f378f6cc02850b57e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:26.679259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-930471f2-fefc-4abf-b064-6f79354afe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:26.857509 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1339/2672] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:26.911193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f6673-f1dd-48d5-884c-9ae20a5a2a7f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:26.913259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1d6f6673-f1dd-48d5-884c-9ae20a5a2a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:27.049590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930471f2-fefc-4abf-b064-6f79354afe85 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:27.078215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f6673-f1dd-48d5-884c-9ae20a5a2a7f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:27.084547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:27.085686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:27.086120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:27.086579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] PATH_INFO: `/v3/users/bb5c1d90fa4f4e36ba82527497b2cbd7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:27.088486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5c1d90fa4f4e36ba82527497b2cbd7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:27.090583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:27.214046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5c1d90fa4f4e36ba82527497b2cbd7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:27.215812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5c1d90fa4f4e36ba82527497b2cbd7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:27.216651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5c1d90fa4f4e36ba82527497b2cbd7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:27.225511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930471f2-fefc-4abf-b064-6f79354afe85 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:27.242267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:27.242807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:27.243097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:27.243370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:27.245915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:27.252282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5c1d90fa4f4e36ba82527497b2cbd7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:27.268881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc42ffb9-2ff0-4131-9cae-8b39e40c6710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5c1d90fa4f4e36ba82527497b2cbd7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:27.284574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:27.289539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:27.302033 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1334/2673] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:26 2022] DELETE /identity/v3/users/bb5c1d90fa4f4e36ba82527497b2cbd7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:27.304130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5dca-444c-4131-8408-14ec77fe4f8c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:27.304585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5dca-444c-4131-8408-14ec77fe4f8c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:27.304871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5dca-444c-4131-8408-14ec77fe4f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:27.319612 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1340/2674] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:27.349267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-547a5dca-444c-4131-8408-14ec77fe4f8c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:27.350578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-547a5dca-444c-4131-8408-14ec77fe4f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:27.532399 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1335/2675] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:52:27.558334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:27.560557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:27.698687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434e6b-2f0e-4d19-8713-bb01b172a88a service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:27.846708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b8bab-2135-4edd-9f0e-5cc020339b34 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:27.847033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b8bab-2135-4edd-9f0e-5cc020339b34 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:27.847313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b8bab-2135-4edd-9f0e-5cc020339b34 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:27.850628 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1336/2676] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:52:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:52:27.867752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ccd3-3da2-4e94-9c4f-687f0c019873 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:27.868034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ccd3-3da2-4e94-9c4f-687f0c019873 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:27.868319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ccd3-3da2-4e94-9c4f-687f0c019873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:27.932633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3989ccd3-3da2-4e94-9c4f-687f0c019873 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:27.936839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3989ccd3-3da2-4e94-9c4f-687f0c019873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:27.947868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:27.951773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:27.952663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:27.957985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:27.999198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:28.000947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:28.061228 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1341/2677] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:28.244713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1337/2678] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:28.285943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:28.288472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:28.330230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903d26-3646-4845-91f6-0afc7a256de2 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:28.344455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a754d7-0bd1-489e-be29-04ec7cec2b60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:28.345465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a754d7-0bd1-489e-be29-04ec7cec2b60 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:28.345959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a754d7-0bd1-489e-be29-04ec7cec2b60 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:28.346474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a754d7-0bd1-489e-be29-04ec7cec2b60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:28.367925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a754d7-0bd1-489e-be29-04ec7cec2b60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:28.384839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a754d7-0bd1-489e-be29-04ec7cec2b60 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:28.429720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1342/2679] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:29.040280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989ccd3-3da2-4e94-9c4f-687f0c019873 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:29.043230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3989ccd3-3da2-4e94-9c4f-687f0c019873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:29.087179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989ccd3-3da2-4e94-9c4f-687f0c019873 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:29.105755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:29.111679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:29.116131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:29.116713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] PATH_INFO: `/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:29.119930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8808e5cb7f49c7b1f2022d423fee73)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:29.122309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:29.358077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8808e5cb7f49c7b1f2022d423fee73', 'request_id': 'req-f801f1fb-04ee-4615-a90f-e6770dc8821d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:29.380223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8808e5cb7f49c7b1f2022d423fee73', 'request_id': 'req-f801f1fb-04ee-4615-a90f-e6770dc8821d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:29.402435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8808e5cb7f49c7b1f2022d423fee73', 'request_id': 'req-f801f1fb-04ee-4615-a90f-e6770dc8821d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:29.455635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] The token cache is being invalidate because project 4e8808e5cb7f49c7b1f2022d423fee73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:29.456847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:29.457815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f801f1fb-04ee-4615-a90f-e6770dc8821d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:29.465317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a754d7-0bd1-489e-be29-04ec7cec2b60 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:29.467797 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1338/2680] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:29 2022] DELETE /identity/v3/projects/4e8808e5cb7f49c7b1f2022d423fee73 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:29.484061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a754d7-0bd1-489e-be29-04ec7cec2b60 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:29.495111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5ed7-db60-4d16-bd0d-2b5092f3dd9b None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:29.495984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5ed7-db60-4d16-bd0d-2b5092f3dd9b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:29.496506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5ed7-db60-4d16-bd0d-2b5092f3dd9b None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:29.498547 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1339/2681] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:52:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 20:52:29.504659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638037-ccfb-4dcc-bfd4-856e1ee5ba64 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:29.505244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638037-ccfb-4dcc-bfd4-856e1ee5ba64 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:29.505826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638037-ccfb-4dcc-bfd4-856e1ee5ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:29.559125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c5638037-ccfb-4dcc-bfd4-856e1ee5ba64 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:29.562271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c5638037-ccfb-4dcc-bfd4-856e1ee5ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:29.782154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:29.785863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:29.787992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:29.789236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] PATH_INFO: `/v3/users/a351bac1d70c4cd981e426dea5c934f1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:29.793580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a351bac1d70c4cd981e426dea5c934f1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:29.800549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:29.913217 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1340/2682] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:29.914784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1646f-a706-44ff-bfbd-7b6f8e87566a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:29.923477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1646f-a706-44ff-bfbd-7b6f8e87566a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:29.923833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1646f-a706-44ff-bfbd-7b6f8e87566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:29.951027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a351bac1d70c4cd981e426dea5c934f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:29.980071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-68f1646f-a706-44ff-bfbd-7b6f8e87566a None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:29.984119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a351bac1d70c4cd981e426dea5c934f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:29.985578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-68f1646f-a706-44ff-bfbd-7b6f8e87566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:30.008068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a351bac1d70c4cd981e426dea5c934f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:30.009065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a351bac1d70c4cd981e426dea5c934f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:30.009855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a351bac1d70c4cd981e426dea5c934f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:30.064250 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1343/2683] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:52:29 2022] DELETE /identity/v3/users/a351bac1d70c4cd981e426dea5c934f1 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:30.065199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:30.067812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:30.187136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1341/2684] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:30.242204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1646f-a706-44ff-bfbd-7b6f8e87566a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:30.243972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-68f1646f-a706-44ff-bfbd-7b6f8e87566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:30.262706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1646f-a706-44ff-bfbd-7b6f8e87566a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:30.289213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376edda-0a92-43f4-9102-f75c20cc282a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:30.290157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8fc0e-d645-4e20-87fc-edd9ae456f3a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:30.291169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376edda-0a92-43f4-9102-f75c20cc282a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:30.292748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376edda-0a92-43f4-9102-f75c20cc282a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:30.296648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376edda-0a92-43f4-9102-f75c20cc282a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:30.308706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a696d1-d5a5-49fa-891a-6db2405f1287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:30.309901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a696d1-d5a5-49fa-891a-6db2405f1287 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:30.313043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a696d1-d5a5-49fa-891a-6db2405f1287 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:30.315152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a696d1-d5a5-49fa-891a-6db2405f1287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:30.328889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-88a696d1-d5a5-49fa-891a-6db2405f1287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:30.335884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376edda-0a92-43f4-9102-f75c20cc282a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:30.345606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376edda-0a92-43f4-9102-f75c20cc282a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:30.385735 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1342/2685] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:30.495511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a696d1-d5a5-49fa-891a-6db2405f1287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:30.497612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a696d1-d5a5-49fa-891a-6db2405f1287 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:30.542125 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1344/2686] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:30.941103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53467-b37c-4f4a-a23f-a469e2d44daa None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:30.941411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53467-b37c-4f4a-a23f-a469e2d44daa None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:30.941691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53467-b37c-4f4a-a23f-a469e2d44daa None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:30.944855 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1343/2687] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:52:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:52:30.952949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910135-e80c-4820-ad3b-10ee99d34e3c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:30.953599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910135-e80c-4820-ad3b-10ee99d34e3c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:30.953599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910135-e80c-4820-ad3b-10ee99d34e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:31.008705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-63910135-e80c-4820-ad3b-10ee99d34e3c None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:31.015143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-63910135-e80c-4820-ad3b-10ee99d34e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:31.215919 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1345/2688] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:31.253439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc53467-b37c-4f4a-a23f-a469e2d44daa None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:31.258319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6cc53467-b37c-4f4a-a23f-a469e2d44daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:31.288451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc53467-b37c-4f4a-a23f-a469e2d44daa None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:31.306126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295e3ae-12b7-40a3-a8fb-3168c17ad26f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:31.307743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e3ae-12b7-40a3-a8fb-3168c17ad26f service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:31.308363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e3ae-12b7-40a3-a8fb-3168c17ad26f service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:31.309081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e3ae-12b7-40a3-a8fb-3168c17ad26f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:31.329117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295e3ae-12b7-40a3-a8fb-3168c17ad26f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:31.331881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295e3ae-12b7-40a3-a8fb-3168c17ad26f service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:31.366206 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1344/2689] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:31.980361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63910135-e80c-4820-ad3b-10ee99d34e3c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:31.982075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-63910135-e80c-4820-ad3b-10ee99d34e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:32.237133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63910135-e80c-4820-ad3b-10ee99d34e3c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:32.254437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:32.259037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:32.259366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:32.259625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] PATH_INFO: `/v3/projects/83cc0855375147ebb8ad74711570f79a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:32.265757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cc0855375147ebb8ad74711570f79a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:32.270085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:32.401757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cc0855375147ebb8ad74711570f79a', 'request_id': 'req-04ea016f-79fd-4967-8321-1e91f22b1ed6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:32.417228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cc0855375147ebb8ad74711570f79a', 'request_id': 'req-04ea016f-79fd-4967-8321-1e91f22b1ed6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:32.435087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cc0855375147ebb8ad74711570f79a', 'request_id': 'req-04ea016f-79fd-4967-8321-1e91f22b1ed6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:32.464852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] The token cache is being invalidate because project 83cc0855375147ebb8ad74711570f79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:52:32.467444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:32.479407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-04ea016f-79fd-4967-8321-1e91f22b1ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:52:32.488609 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1346/2690] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:52:31 2022] DELETE /identity/v3/projects/83cc0855375147ebb8ad74711570f79a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:52:32.496733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb5537-0452-4477-b679-f217724ad651 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:32.497308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb5537-0452-4477-b679-f217724ad651 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:32.497841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb5537-0452-4477-b679-f217724ad651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:32.537249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4ddb5537-0452-4477-b679-f217724ad651 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:32.547100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4ddb5537-0452-4477-b679-f217724ad651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:32.716643 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1345/2691] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:32.717755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784d593-ff29-441c-b715-b61ea1883ad6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:32.718155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784d593-ff29-441c-b715-b61ea1883ad6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:32.718441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784d593-ff29-441c-b715-b61ea1883ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:32.745608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7784d593-ff29-441c-b715-b61ea1883ad6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:32.748467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7784d593-ff29-441c-b715-b61ea1883ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:32.767317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb5537-0452-4477-b679-f217724ad651 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:32.768832 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1347/2692] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:32.781796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb5537-0452-4477-b679-f217724ad651 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:32.788520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:32.789741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:32.790792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:32.791295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:32.792266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:52:32.793012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:32.795090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:32.815289 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1346/2693] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:52:32.815769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784d593-ff29-441c-b715-b61ea1883ad6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:32.829403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784d593-ff29-441c-b715-b61ea1883ad6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:32.842128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3c110-862e-4458-b94f-7d740b13d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:32.842829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c110-862e-4458-b94f-7d740b13d571 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:32.852164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c110-862e-4458-b94f-7d740b13d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:32.852595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c110-862e-4458-b94f-7d740b13d571 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:32.853474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3c110-862e-4458-b94f-7d740b13d571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:32.855457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3c110-862e-4458-b94f-7d740b13d571 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:32.920531 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1348/2694] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:52:32 2022] POST /identity/v3/projects => generated 395 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:32.923683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:32.953549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264453a4-5669-4cd9-a998-7b92c6c2d94c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:33.089061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d36f4-ddb9-46cf-9fb4-1506e7a081e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:33.089911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d36f4-ddb9-46cf-9fb4-1506e7a081e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:33.090305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d36f4-ddb9-46cf-9fb4-1506e7a081e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:33.090471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d36f4-ddb9-46cf-9fb4-1506e7a081e6 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:33.091216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d36f4-ddb9-46cf-9fb4-1506e7a081e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:33.107705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d36f4-ddb9-46cf-9fb4-1506e7a081e6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:33.194332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3c110-862e-4458-b94f-7d740b13d571 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:33.200882 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1347/2695] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:52:32 2022] POST /identity/v3/users => generated 298 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:52:33.208078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3c110-862e-4458-b94f-7d740b13d571 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:33.216080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6f654-998d-456b-b93f-f293bb8480c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:33.217519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6f654-998d-456b-b93f-f293bb8480c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:33.217979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6f654-998d-456b-b93f-f293bb8480c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:33.218416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6f654-998d-456b-b93f-f293bb8480c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:33.219299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6f654-998d-456b-b93f-f293bb8480c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:33.221116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6f654-998d-456b-b93f-f293bb8480c0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:33.234813 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1349/2696] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:33.239255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d36f4-ddb9-46cf-9fb4-1506e7a081e6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:33.252484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d36f4-ddb9-46cf-9fb4-1506e7a081e6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:33.260785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c14998-bddc-4f80-984a-7ff28779619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:33.261561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c14998-bddc-4f80-984a-7ff28779619c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:33.261923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c14998-bddc-4f80-984a-7ff28779619c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:33.262780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c14998-bddc-4f80-984a-7ff28779619c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:33.263604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c14998-bddc-4f80-984a-7ff28779619c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:33.265310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c14998-bddc-4f80-984a-7ff28779619c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:33.292520 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1348/2697] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:52:33.292753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6f654-998d-456b-b93f-f293bb8480c0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:33.308026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6f654-998d-456b-b93f-f293bb8480c0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:33.316734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:33.319183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:33.319667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:33.320132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] PATH_INFO: `/v3/projects/869a0cf6b5604ec89af633eb5012ff5b/users/d0a4a7cd3a234092987f7fb637c91e38/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:33.363919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869a0cf6b5604ec89af633eb5012ff5b, user_id=d0a4a7cd3a234092987f7fb637c91e38, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:33.366564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:33.397585 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1350/2698] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:52:33 2022] PUT /identity/v3/projects/869a0cf6b5604ec89af633eb5012ff5b/users/d0a4a7cd3a234092987f7fb637c91e38/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:52:33.402839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4e35d-c491-4bbc-b373-d4a0360b2b32 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:33.406741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4e35d-c491-4bbc-b373-d4a0360b2b32 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:33.407241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4e35d-c491-4bbc-b373-d4a0360b2b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:33.438985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-90f4e35d-c491-4bbc-b373-d4a0360b2b32 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:33.444963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-90f4e35d-c491-4bbc-b373-d4a0360b2b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:33.548099 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1349/2699] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:33.602010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:33.605615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:33.713645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf0967-a5e3-4093-a6ca-c83765a50c31 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:33.714130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf0967-a5e3-4093-a6ca-c83765a50c31 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:33.714566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf0967-a5e3-4093-a6ca-c83765a50c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:33.722600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58500-a38c-4065-8f9c-1cffafe35198 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:33.732645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:33.733333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:33.733602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:33.733883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:33.756384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:33.757845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:33.765390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-82bf0967-a5e3-4093-a6ca-c83765a50c31 None None] MFA Rules not processed for user `d5d7865cf8614882b58cad856e16d0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:33.767841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-82bf0967-a5e3-4093-a6ca-c83765a50c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:33.768686 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1351/2700] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:33.916396 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1350/2701] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:33.922508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:33.924477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:34.021935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c2fe0-4adc-472c-9331-124727178a8c service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:34.026071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9800f3-4649-4adc-95c1-d7159de05e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:34.026850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9800f3-4649-4adc-95c1-d7159de05e6b service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:34.027085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9800f3-4649-4adc-95c1-d7159de05e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:34.027413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9800f3-4649-4adc-95c1-d7159de05e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:34.030120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe9800f3-4649-4adc-95c1-d7159de05e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:34.097358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9800f3-4649-4adc-95c1-d7159de05e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:34.098823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9800f3-4649-4adc-95c1-d7159de05e6b service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:34.109018 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1352/2702] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:42.486735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783d85-5f02-463d-9773-5a76dadb7272 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:42.487581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783d85-5f02-463d-9773-5a76dadb7272 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:42.488020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783d85-5f02-463d-9773-5a76dadb7272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:42.534855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0e783d85-5f02-463d-9773-5a76dadb7272 None None] MFA Rules not processed for user `d0a4a7cd3a234092987f7fb637c91e38`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:42.536255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0e783d85-5f02-463d-9773-5a76dadb7272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:42.628517 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1351/2703] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:42.630699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b46a-221c-42ce-b9ff-3c2181575c84 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:42.631155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b46a-221c-42ce-b9ff-3c2181575c84 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:42.631279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b46a-221c-42ce-b9ff-3c2181575c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:42.675403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a373b46a-221c-42ce-b9ff-3c2181575c84 None None] MFA Rules not processed for user `d0a4a7cd3a234092987f7fb637c91e38`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:42.675403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a373b46a-221c-42ce-b9ff-3c2181575c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:42.694425 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1353/2704] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:43.002352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e783d85-5f02-463d-9773-5a76dadb7272 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:43.004112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0e783d85-5f02-463d-9773-5a76dadb7272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:43.149381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e783d85-5f02-463d-9773-5a76dadb7272 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:43.155963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99bf3-cbf7-4802-84eb-c971e4b7f2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:43.156875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99bf3-cbf7-4802-84eb-c971e4b7f2e6 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:43.157158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99bf3-cbf7-4802-84eb-c971e4b7f2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:43.157444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99bf3-cbf7-4802-84eb-c971e4b7f2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:43.175872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc99bf3-cbf7-4802-84eb-c971e4b7f2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:43.179344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc99bf3-cbf7-4802-84eb-c971e4b7f2e6 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:43.197188 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1352/2705] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:50.553027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20c2a7-b812-453b-9a16-d301c3efa331 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:50.553852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20c2a7-b812-453b-9a16-d301c3efa331 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:50.554241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20c2a7-b812-453b-9a16-d301c3efa331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:50.578632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cd20c2a7-b812-453b-9a16-d301c3efa331 None None] MFA Rules not processed for user `ec1a2a2db19c41cca4342aa082770a96`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:50.580037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cd20c2a7-b812-453b-9a16-d301c3efa331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:50.648719 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1354/2706] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:50.838231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99bf3-cbf7-4802-84eb-c971e4b7f2e6 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:52:50.852714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99bf3-cbf7-4802-84eb-c971e4b7f2e6 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:52:50.860988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f738-6814-4416-a692-ae702fe130be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:52:50.862461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f738-6814-4416-a692-ae702fe130be service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:50.862746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f738-6814-4416-a692-ae702fe130be service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:50.863019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f738-6814-4416-a692-ae702fe130be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:50.865700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6862f738-6814-4416-a692-ae702fe130be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:50.943002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862f738-6814-4416-a692-ae702fe130be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:52:50.944606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862f738-6814-4416-a692-ae702fe130be service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:52:50.956322 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1353/2707] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:52:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:52.180873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354114-58a1-4ec0-8f4a-b3586c8cc67c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:52.181378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354114-58a1-4ec0-8f4a-b3586c8cc67c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:52.181472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354114-58a1-4ec0-8f4a-b3586c8cc67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:52.226754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a3354114-58a1-4ec0-8f4a-b3586c8cc67c None None] MFA Rules not processed for user `05654d818a474f378f6cc02850b57e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:52.228275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a3354114-58a1-4ec0-8f4a-b3586c8cc67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:52.538993 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1355/2708] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:52:55.666761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dccda-88ec-48a0-9d54-99e3bd364688 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:52:55.667694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dccda-88ec-48a0-9d54-99e3bd364688 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:52:55.668201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dccda-88ec-48a0-9d54-99e3bd364688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:52:55.735617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3e2dccda-88ec-48a0-9d54-99e3bd364688 None None] MFA Rules not processed for user `1fc7244fbf3b4298b92daf9e442fe669`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:52:55.737817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3e2dccda-88ec-48a0-9d54-99e3bd364688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:52:55.813955 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1354/2709] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:02.893588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3354114-58a1-4ec0-8f4a-b3586c8cc67c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:02.895237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a3354114-58a1-4ec0-8f4a-b3586c8cc67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:03.072076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3354114-58a1-4ec0-8f4a-b3586c8cc67c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:03.079564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c81f5d-6257-4ed4-9273-8b586868c551 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:03.080447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c81f5d-6257-4ed4-9273-8b586868c551 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:03.080722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c81f5d-6257-4ed4-9273-8b586868c551 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:03.081173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c81f5d-6257-4ed4-9273-8b586868c551 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:03.083174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-95c81f5d-6257-4ed4-9273-8b586868c551 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:03.097120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c81f5d-6257-4ed4-9273-8b586868c551 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:03.099956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c81f5d-6257-4ed4-9273-8b586868c551 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:03.113070 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1356/2710] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:53:06.515670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dccda-88ec-48a0-9d54-99e3bd364688 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:06.517601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3e2dccda-88ec-48a0-9d54-99e3bd364688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:06.539741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dccda-88ec-48a0-9d54-99e3bd364688 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:06.547377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8c9af-b8a9-45cd-8ed7-25789379ff57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:06.548040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c9af-b8a9-45cd-8ed7-25789379ff57 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:06.548574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c9af-b8a9-45cd-8ed7-25789379ff57 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:06.549038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c9af-b8a9-45cd-8ed7-25789379ff57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:06.558044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-efc8c9af-b8a9-45cd-8ed7-25789379ff57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:06.604021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8c9af-b8a9-45cd-8ed7-25789379ff57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:06.606865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8c9af-b8a9-45cd-8ed7-25789379ff57 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:06.622790 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1355/2711] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:09.332402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f245-a86e-4b11-b9ab-78664001c0c3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:09.333412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f245-a86e-4b11-b9ab-78664001c0c3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:09.333956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f245-a86e-4b11-b9ab-78664001c0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:09.354170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ae97f245-a86e-4b11-b9ab-78664001c0c3 None None] MFA Rules not processed for user `d0a4a7cd3a234092987f7fb637c91e38`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:09.355589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ae97f245-a86e-4b11-b9ab-78664001c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:09.365007 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1357/2712] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:15.314411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51efdf-567f-49c5-aaed-cc855d8d782d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:15.314999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51efdf-567f-49c5-aaed-cc855d8d782d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:15.314999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51efdf-567f-49c5-aaed-cc855d8d782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:15.366123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9f51efdf-567f-49c5-aaed-cc855d8d782d None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:15.369038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f51efdf-567f-49c5-aaed-cc855d8d782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:15.489804 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1356/2713] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 20:53:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:53:15.526250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97f245-a86e-4b11-b9ab-78664001c0c3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:15.527903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ae97f245-a86e-4b11-b9ab-78664001c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:15.667981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97f245-a86e-4b11-b9ab-78664001c0c3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:15.674308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b7d0f-e4fa-44ff-a59b-b7548ebc4ed3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:15.675373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b7d0f-e4fa-44ff-a59b-b7548ebc4ed3 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:15.675929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b7d0f-e4fa-44ff-a59b-b7548ebc4ed3 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:15.676571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b7d0f-e4fa-44ff-a59b-b7548ebc4ed3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:15.704198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b7d0f-e4fa-44ff-a59b-b7548ebc4ed3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:15.705934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b7d0f-e4fa-44ff-a59b-b7548ebc4ed3 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:15.740187 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1358/2714] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:53:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:17.873726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe51b-c4fa-49a8-a391-c39b250e822c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:17.874233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe51b-c4fa-49a8-a391-c39b250e822c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:17.874343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe51b-c4fa-49a8-a391-c39b250e822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:17.917232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d8dbe51b-c4fa-49a8-a391-c39b250e822c None None] MFA Rules not processed for user `c26bc5048c9849218cadd12475cd5fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:17.923447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d8dbe51b-c4fa-49a8-a391-c39b250e822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:18.050695 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1357/2715] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:53:20.215591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69304bf9-816c-417b-b801-9863815ab637 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:20.216057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69304bf9-816c-417b-b801-9863815ab637 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:20.216286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69304bf9-816c-417b-b801-9863815ab637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:20.238287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-69304bf9-816c-417b-b801-9863815ab637 None None] MFA Rules not processed for user `72ce9a80c4b444259dda1f6a63e6fe49`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:20.240615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69304bf9-816c-417b-b801-9863815ab637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:20.248293 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1359/2716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:20.258152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112473e-755d-4cc9-8595-0af05086ca36 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:20.259147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112473e-755d-4cc9-8595-0af05086ca36 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:20.259437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112473e-755d-4cc9-8595-0af05086ca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:20.278700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9112473e-755d-4cc9-8595-0af05086ca36 None None] MFA Rules not processed for user `72ce9a80c4b444259dda1f6a63e6fe49`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:20.280479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9112473e-755d-4cc9-8595-0af05086ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:20.288113 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1358/2717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:53:28.129714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82376-7130-46a9-9148-66388e48a9b0 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:28.130710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82376-7130-46a9-9148-66388e48a9b0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:28.131215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82376-7130-46a9-9148-66388e48a9b0 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:28.133547 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1360/2718] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:53:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:53:28.140303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273b16-701e-413a-9a77-592842eb6432 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:28.140937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273b16-701e-413a-9a77-592842eb6432 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:28.140937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273b16-701e-413a-9a77-592842eb6432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:28.169036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-06273b16-701e-413a-9a77-592842eb6432 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:28.170588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-06273b16-701e-413a-9a77-592842eb6432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:28.183002 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1359/2719] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:28.194559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82376-7130-46a9-9148-66388e48a9b0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:28.196499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fad82376-7130-46a9-9148-66388e48a9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:28.210954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82376-7130-46a9-9148-66388e48a9b0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:28.215357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5019eb1-41a2-40ef-870e-8ef19ce9c935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:28.216299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5019eb1-41a2-40ef-870e-8ef19ce9c935 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:28.216835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5019eb1-41a2-40ef-870e-8ef19ce9c935 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:28.217340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5019eb1-41a2-40ef-870e-8ef19ce9c935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:28.231866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5019eb1-41a2-40ef-870e-8ef19ce9c935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:28.233492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5019eb1-41a2-40ef-870e-8ef19ce9c935 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:28.248815 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1361/2720] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:53:29.158065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c68f55-b6a6-4540-bfc0-dd41f2391101 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:29.158622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c68f55-b6a6-4540-bfc0-dd41f2391101 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:29.158622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c68f55-b6a6-4540-bfc0-dd41f2391101 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:29.160441 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1360/2721] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:53:29.166437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f7d1-a59b-4ed1-9332-103144304328 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:29.168788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f7d1-a59b-4ed1-9332-103144304328 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:29.169311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f7d1-a59b-4ed1-9332-103144304328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:29.194069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a988f7d1-a59b-4ed1-9332-103144304328 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:29.196572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a988f7d1-a59b-4ed1-9332-103144304328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:29.207597 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1362/2722] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:29.234519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c68f55-b6a6-4540-bfc0-dd41f2391101 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:29.254042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c68f55-b6a6-4540-bfc0-dd41f2391101 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:29.261611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5637-a6e9-4343-bb9b-6e22b561c14f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:29.262266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5637-a6e9-4343-bb9b-6e22b561c14f service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:29.262549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5637-a6e9-4343-bb9b-6e22b561c14f service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:29.262828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5637-a6e9-4343-bb9b-6e22b561c14f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:29.275071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5637-a6e9-4343-bb9b-6e22b561c14f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:29.277561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5637-a6e9-4343-bb9b-6e22b561c14f service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:29.289956 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1361/2723] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:33.866254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f7d1-a59b-4ed1-9332-103144304328 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:33.871481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a988f7d1-a59b-4ed1-9332-103144304328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:33.890386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f7d1-a59b-4ed1-9332-103144304328 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:33.897751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:33.899237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:33.900648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:33.904627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] PATH_INFO: `/v3/users/08781c2dd21c4011b5eebde0436042c2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:33.906986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08781c2dd21c4011b5eebde0436042c2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:33.910836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:33.979410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08781c2dd21c4011b5eebde0436042c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:33.994355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08781c2dd21c4011b5eebde0436042c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.005131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08781c2dd21c4011b5eebde0436042c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.005786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08781c2dd21c4011b5eebde0436042c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.007051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08781c2dd21c4011b5eebde0436042c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.025845 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1363/2724] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:53:33 2022] DELETE /identity/v3/users/08781c2dd21c4011b5eebde0436042c2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:34.284288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5637-a6e9-4343-bb9b-6e22b561c14f service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:34.301735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5637-a6e9-4343-bb9b-6e22b561c14f service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:34.388054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:34.389731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:34.390017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:34.390353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] PATH_INFO: `/v3/projects/76afd67dfef14c3db64ccbd812036427` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:34.391631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76afd67dfef14c3db64ccbd812036427)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:34.393611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:34.447133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76afd67dfef14c3db64ccbd812036427', 'request_id': 'req-c860b725-af2a-46ce-b960-36d34aa188f9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.453604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76afd67dfef14c3db64ccbd812036427', 'request_id': 'req-c860b725-af2a-46ce-b960-36d34aa188f9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.462022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76afd67dfef14c3db64ccbd812036427', 'request_id': 'req-c860b725-af2a-46ce-b960-36d34aa188f9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.475721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] The token cache is being invalidate because project 76afd67dfef14c3db64ccbd812036427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:53:34.476259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.476966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.478629 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1362/2725] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:53:34 2022] DELETE /identity/v3/projects/76afd67dfef14c3db64ccbd812036427 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:34.482665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:34.484071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:34.498471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d4068-5e56-4720-a798-0b97f0159b50 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:34.593883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:34.594781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:34.595061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:34.595333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] PATH_INFO: `/v3/users/600eccefce944161ae08c77f40c7d31d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:34.596620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=600eccefce944161ae08c77f40c7d31d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:34.599103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:34.675394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600eccefce944161ae08c77f40c7d31d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.691247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600eccefce944161ae08c77f40c7d31d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.707239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600eccefce944161ae08c77f40c7d31d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.708427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600eccefce944161ae08c77f40c7d31d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.709090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814e026c-8d3e-40c3-8013-b105c6a1f60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600eccefce944161ae08c77f40c7d31d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:34.725366 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1364/2726] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:53:34 2022] DELETE /identity/v3/users/600eccefce944161ae08c77f40c7d31d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:34.918901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:34.922032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:34.947961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860b725-af2a-46ce-b960-36d34aa188f9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:35.017599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:35.018491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.018767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.020764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] PATH_INFO: `/v3/projects/9f4dce37deef48de9f0dbae35d08257e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.021530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4dce37deef48de9f0dbae35d08257e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:35.023760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:35.079160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4dce37deef48de9f0dbae35d08257e', 'request_id': 'req-be758c9a-831e-4a4d-ae7c-824565169ebf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:35.086744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4dce37deef48de9f0dbae35d08257e', 'request_id': 'req-be758c9a-831e-4a4d-ae7c-824565169ebf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:35.095865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4dce37deef48de9f0dbae35d08257e', 'request_id': 'req-be758c9a-831e-4a4d-ae7c-824565169ebf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:35.114388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] The token cache is being invalidate because project 9f4dce37deef48de9f0dbae35d08257e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:53:35.114543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:35.115496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be758c9a-831e-4a4d-ae7c-824565169ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:35.118815 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1363/2727] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:53:34 2022] DELETE /identity/v3/projects/9f4dce37deef48de9f0dbae35d08257e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:35.124248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c2b73-f177-47dd-b3f4-ef365ebc8f48 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.124782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c2b73-f177-47dd-b3f4-ef365ebc8f48 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.124880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c2b73-f177-47dd-b3f4-ef365ebc8f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.147648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4c1c2b73-f177-47dd-b3f4-ef365ebc8f48 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:35.149144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4c1c2b73-f177-47dd-b3f4-ef365ebc8f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:35.239882 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1365/2728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:35.242432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2fd55-ec50-48e7-bbde-6337f57749e6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.242432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2fd55-ec50-48e7-bbde-6337f57749e6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.242664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2fd55-ec50-48e7-bbde-6337f57749e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.264210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9de2fd55-ec50-48e7-bbde-6337f57749e6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:35.265698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9de2fd55-ec50-48e7-bbde-6337f57749e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:35.277951 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1364/2729] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:35.279816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c2b73-f177-47dd-b3f4-ef365ebc8f48 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:35.291203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c2b73-f177-47dd-b3f4-ef365ebc8f48 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:35.298291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:35.298968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.299247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.299673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.300576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:53:35.301874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:35.303756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:35.321902 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1366/2730] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:53:35.324918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2fd55-ec50-48e7-bbde-6337f57749e6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:35.335634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2fd55-ec50-48e7-bbde-6337f57749e6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:35.343436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01ffa3-d49a-431e-8fc0-4daef480428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:35.343910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01ffa3-d49a-431e-8fc0-4daef480428e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.344296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01ffa3-d49a-431e-8fc0-4daef480428e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.344931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01ffa3-d49a-431e-8fc0-4daef480428e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.345734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01ffa3-d49a-431e-8fc0-4daef480428e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:35.349416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01ffa3-d49a-431e-8fc0-4daef480428e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:35.388503 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1365/2731] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:53:35 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:35.391104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:35.402097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8180-7a81-4eba-a792-5bdd6fe2580b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:35.459026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a953c7-e72b-4f3b-8e7d-a223e1177706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:35.459693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a953c7-e72b-4f3b-8e7d-a223e1177706 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.459969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a953c7-e72b-4f3b-8e7d-a223e1177706 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.460240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a953c7-e72b-4f3b-8e7d-a223e1177706 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.460957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a953c7-e72b-4f3b-8e7d-a223e1177706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:35.462838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a953c7-e72b-4f3b-8e7d-a223e1177706 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:35.483437 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1367/2732] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:53:35 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:35.488162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01ffa3-d49a-431e-8fc0-4daef480428e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:35.498814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01ffa3-d49a-431e-8fc0-4daef480428e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:35.503680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715a584-e8e2-404c-91f9-f6f8de66cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:35.504410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a584-e8e2-404c-91f9-f6f8de66cd3b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.504703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a584-e8e2-404c-91f9-f6f8de66cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.504973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715a584-e8e2-404c-91f9-f6f8de66cd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.505736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715a584-e8e2-404c-91f9-f6f8de66cd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:35.507321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715a584-e8e2-404c-91f9-f6f8de66cd3b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:35.517864 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1366/2733] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:35.522327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a953c7-e72b-4f3b-8e7d-a223e1177706 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:35.532366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a953c7-e72b-4f3b-8e7d-a223e1177706 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:35.537807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d59c-7900-4c8a-87f6-e4725f8c83c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:35.538464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d59c-7900-4c8a-87f6-e4725f8c83c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.538762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d59c-7900-4c8a-87f6-e4725f8c83c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.539043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d59c-7900-4c8a-87f6-e4725f8c83c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.539758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d59c-7900-4c8a-87f6-e4725f8c83c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:35.541459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d59c-7900-4c8a-87f6-e4725f8c83c3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:35.553704 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1368/2734] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:35.557897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715a584-e8e2-404c-91f9-f6f8de66cd3b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:35.568160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715a584-e8e2-404c-91f9-f6f8de66cd3b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:35.573090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:35.574168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.574611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.574891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] PATH_INFO: `/v3/projects/8afe7deba36e44b5ae5b22b362acc99b/users/75ff4094040d46e2a25e2e78de7b2992/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.591880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8afe7deba36e44b5ae5b22b362acc99b, user_id=75ff4094040d46e2a25e2e78de7b2992, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:35.594642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:35.608224 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1367/2735] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:53:35 2022] PUT /identity/v3/projects/8afe7deba36e44b5ae5b22b362acc99b/users/75ff4094040d46e2a25e2e78de7b2992/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:35.618670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b33e-c5a0-4adc-94d9-89d5cfb2735f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:35.618959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b33e-c5a0-4adc-94d9-89d5cfb2735f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:35.619238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63b33e-c5a0-4adc-94d9-89d5cfb2735f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:35.650591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7a63b33e-c5a0-4adc-94d9-89d5cfb2735f None None] MFA Rules not processed for user `75ff4094040d46e2a25e2e78de7b2992`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:35.651780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7a63b33e-c5a0-4adc-94d9-89d5cfb2735f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:35.716472 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1369/2736] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:37.592263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:37.594661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:37.686802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee934c42-ddd9-4b3c-af0b-8396b71c3372 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:37.700735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:37.702441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:37.702973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:37.703559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:37.716481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:37.718498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:37.739368 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1368/2737] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:37.915196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6a96-2ed8-472f-ab47-6e75799d3da4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:37.915826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6a96-2ed8-472f-ab47-6e75799d3da4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:37.915826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6a96-2ed8-472f-ab47-6e75799d3da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:37.946899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bb1e6a96-2ed8-472f-ab47-6e75799d3da4 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:37.948674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bb1e6a96-2ed8-472f-ab47-6e75799d3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:38.040670 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1370/2738] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:38.051160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:38.052739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:38.171517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605432a-bc65-476b-9821-a145fe955c6b service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:38.184360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccf9dc-2fd4-488e-9146-2dff8aab7246 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:38.185781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf9dc-2fd4-488e-9146-2dff8aab7246 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:38.186520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf9dc-2fd4-488e-9146-2dff8aab7246 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:38.187630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf9dc-2fd4-488e-9146-2dff8aab7246 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:38.204694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccf9dc-2fd4-488e-9146-2dff8aab7246 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:38.209172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccf9dc-2fd4-488e-9146-2dff8aab7246 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:38.229888 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1369/2739] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:53:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:38.451872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f9eb-0a9e-442b-b166-7f04dca7773f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:38.452489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f9eb-0a9e-442b-b166-7f04dca7773f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:38.453053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f9eb-0a9e-442b-b166-7f04dca7773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:38.476322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1e36f9eb-0a9e-442b-b166-7f04dca7773f None None] MFA Rules not processed for user `75ff4094040d46e2a25e2e78de7b2992`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:38.477899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e36f9eb-0a9e-442b-b166-7f04dca7773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:38.487618 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1371/2740] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:53:39.927247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25849f-b611-4505-8c42-5cfe17baadf7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:39.928123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25849f-b611-4505-8c42-5cfe17baadf7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:39.928500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25849f-b611-4505-8c42-5cfe17baadf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:39.948185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1b25849f-b611-4505-8c42-5cfe17baadf7 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:39.949553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1b25849f-b611-4505-8c42-5cfe17baadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:39.961072 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1370/2741] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:39.977654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f9eb-0a9e-442b-b166-7f04dca7773f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:39.993519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f9eb-0a9e-442b-b166-7f04dca7773f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:39.999243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e615e43-9cfb-4631-a5bf-e548a1b94cf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:39.999848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615e43-9cfb-4631-a5bf-e548a1b94cf0 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:40.000119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615e43-9cfb-4631-a5bf-e548a1b94cf0 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:40.000433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615e43-9cfb-4631-a5bf-e548a1b94cf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:40.010611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e615e43-9cfb-4631-a5bf-e548a1b94cf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:40.012935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e615e43-9cfb-4631-a5bf-e548a1b94cf0 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:40.041222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1372/2742] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:40.178060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25849f-b611-4505-8c42-5cfe17baadf7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:40.244292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25849f-b611-4505-8c42-5cfe17baadf7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:40.248991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:40.249853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:40.250148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:40.250411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] PATH_INFO: `/v3/users/75ff4094040d46e2a25e2e78de7b2992` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:40.251605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ff4094040d46e2a25e2e78de7b2992)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:40.253556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:40.301144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ff4094040d46e2a25e2e78de7b2992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.302109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ff4094040d46e2a25e2e78de7b2992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.303536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ff4094040d46e2a25e2e78de7b2992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.320731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ff4094040d46e2a25e2e78de7b2992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.328555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ff4094040d46e2a25e2e78de7b2992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.342375 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1371/2743] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:53:40 2022] DELETE /identity/v3/users/75ff4094040d46e2a25e2e78de7b2992 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:40.346870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478fa44-a336-46c2-87a5-a6df54493e3a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:40.347154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478fa44-a336-46c2-87a5-a6df54493e3a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:40.347427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478fa44-a336-46c2-87a5-a6df54493e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:40.365978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2478fa44-a336-46c2-87a5-a6df54493e3a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:40.367096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2478fa44-a336-46c2-87a5-a6df54493e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:40.427914 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1373/2744] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:53:40.437984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:40.439471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:40.496751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ed72-648f-40c4-9d06-eeef445a32a4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:40.500360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb90f6-0bbc-4e61-81fa-3b1ad3448a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:40.501009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb90f6-0bbc-4e61-81fa-3b1ad3448a34 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:40.501285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb90f6-0bbc-4e61-81fa-3b1ad3448a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:40.501685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb90f6-0bbc-4e61-81fa-3b1ad3448a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:40.511866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb90f6-0bbc-4e61-81fa-3b1ad3448a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:40.513512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb90f6-0bbc-4e61-81fa-3b1ad3448a34 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:40.524637 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1372/2745] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:40.833501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478fa44-a336-46c2-87a5-a6df54493e3a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:40.835412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2478fa44-a336-46c2-87a5-a6df54493e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:40.869426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478fa44-a336-46c2-87a5-a6df54493e3a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:40.875022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:40.875873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:40.876149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:40.876645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] PATH_INFO: `/v3/projects/8afe7deba36e44b5ae5b22b362acc99b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:40.878042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8afe7deba36e44b5ae5b22b362acc99b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:40.880535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:40.931355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8afe7deba36e44b5ae5b22b362acc99b', 'request_id': 'req-7ed999e3-1365-4593-93d9-3da323fa2a18'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.937203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8afe7deba36e44b5ae5b22b362acc99b', 'request_id': 'req-7ed999e3-1365-4593-93d9-3da323fa2a18'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.945363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8afe7deba36e44b5ae5b22b362acc99b', 'request_id': 'req-7ed999e3-1365-4593-93d9-3da323fa2a18'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.957380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] The token cache is being invalidate because project 8afe7deba36e44b5ae5b22b362acc99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:53:40.957766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.958627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7ed999e3-1365-4593-93d9-3da323fa2a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:40.960758 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1374/2746] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:53:40 2022] DELETE /identity/v3/projects/8afe7deba36e44b5ae5b22b362acc99b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:40.965988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb97e7-0893-43c0-82e1-591124e3037f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:40.966487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb97e7-0893-43c0-82e1-591124e3037f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:40.966604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb97e7-0893-43c0-82e1-591124e3037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:40.984600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5feb97e7-0893-43c0-82e1-591124e3037f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:40.985804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5feb97e7-0893-43c0-82e1-591124e3037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:41.045510 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1373/2747] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:53:41.055072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183da1e-131a-4d3d-a77f-5bf476e98c7e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.055626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183da1e-131a-4d3d-a77f-5bf476e98c7e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.055626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183da1e-131a-4d3d-a77f-5bf476e98c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.077202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3183da1e-131a-4d3d-a77f-5bf476e98c7e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:41.078545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3183da1e-131a-4d3d-a77f-5bf476e98c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:41.089722 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1375/2748] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:41.094167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb97e7-0893-43c0-82e1-591124e3037f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:41.106114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb97e7-0893-43c0-82e1-591124e3037f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:41.111315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:41.112129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.114081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.114477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.115429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:53:41.115842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:41.117591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:41.143554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1374/2749] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:53:41.145025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183da1e-131a-4d3d-a77f-5bf476e98c7e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:41.155514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183da1e-131a-4d3d-a77f-5bf476e98c7e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:41.162384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10524939-0be0-4b90-bb1d-197f74ac46cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:41.163068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10524939-0be0-4b90-bb1d-197f74ac46cb admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.163348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10524939-0be0-4b90-bb1d-197f74ac46cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.163630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10524939-0be0-4b90-bb1d-197f74ac46cb admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.164499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10524939-0be0-4b90-bb1d-197f74ac46cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:41.166419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10524939-0be0-4b90-bb1d-197f74ac46cb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:41.197917 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1376/2750] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:53:41 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:41.202649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:41.213242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878ddd9-7e5c-4347-8107-f3fb11a31d30 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:41.270861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3901fa8-04ef-483f-b9f1-49fdca64d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:41.271526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3901fa8-04ef-483f-b9f1-49fdca64d9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.271807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3901fa8-04ef-483f-b9f1-49fdca64d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.272104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3901fa8-04ef-483f-b9f1-49fdca64d9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.272852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3901fa8-04ef-483f-b9f1-49fdca64d9a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:41.274764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3901fa8-04ef-483f-b9f1-49fdca64d9a8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:41.295806 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1375/2751] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:53:41 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:41.300614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10524939-0be0-4b90-bb1d-197f74ac46cb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:41.312933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10524939-0be0-4b90-bb1d-197f74ac46cb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:41.317804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee9cb-883b-4029-8d5e-d753c3089495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:41.318459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee9cb-883b-4029-8d5e-d753c3089495 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.318736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee9cb-883b-4029-8d5e-d753c3089495 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.319009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee9cb-883b-4029-8d5e-d753c3089495 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.319725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cee9cb-883b-4029-8d5e-d753c3089495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:41.321371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cee9cb-883b-4029-8d5e-d753c3089495 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:41.334517 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1377/2752] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:53:41.338569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3901fa8-04ef-483f-b9f1-49fdca64d9a8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:41.349675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3901fa8-04ef-483f-b9f1-49fdca64d9a8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:41.355493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887441b-75f2-4710-8d42-4bf304f9af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:41.356273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887441b-75f2-4710-8d42-4bf304f9af8d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.356798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887441b-75f2-4710-8d42-4bf304f9af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.356983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887441b-75f2-4710-8d42-4bf304f9af8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.357703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887441b-75f2-4710-8d42-4bf304f9af8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:41.359301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887441b-75f2-4710-8d42-4bf304f9af8d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:41.372187 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1376/2753] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:41.376091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee9cb-883b-4029-8d5e-d753c3089495 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:41.385979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee9cb-883b-4029-8d5e-d753c3089495 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:41.390614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:41.391493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.391765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.392036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] PATH_INFO: `/v3/projects/de5e39a92fe94f05bf371c31414cc390/users/86d51248862040cdb3d5fbb208532248/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.406919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5e39a92fe94f05bf371c31414cc390, user_id=86d51248862040cdb3d5fbb208532248, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:41.409658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:41.424877 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1378/2754] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:53:41 2022] PUT /identity/v3/projects/de5e39a92fe94f05bf371c31414cc390/users/86d51248862040cdb3d5fbb208532248/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:53:41.430895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c4669-b843-437d-bd0e-fa1956dddf8b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.431183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c4669-b843-437d-bd0e-fa1956dddf8b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.431687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c4669-b843-437d-bd0e-fa1956dddf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.466266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e17c4669-b843-437d-bd0e-fa1956dddf8b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:41.467686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e17c4669-b843-437d-bd0e-fa1956dddf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:41.552973 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1377/2755] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:41.564448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:41.567646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:41.658529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e0a59-6a88-43b6-aa57-b87aab0b5d14 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:41.664585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e06a7-6d07-4024-9042-d8638395fe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:41.665060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e06a7-6d07-4024-9042-d8638395fe7f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:41.665536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e06a7-6d07-4024-9042-d8638395fe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:41.665917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e06a7-6d07-4024-9042-d8638395fe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:41.703619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e06a7-6d07-4024-9042-d8638395fe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:41.707943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e06a7-6d07-4024-9042-d8638395fe7f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:41.738739 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1379/2756] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:45.588578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c4669-b843-437d-bd0e-fa1956dddf8b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:45.590330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e17c4669-b843-437d-bd0e-fa1956dddf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:45.618814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c4669-b843-437d-bd0e-fa1956dddf8b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:45.639318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:45.640091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:45.641216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:45.641527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] PATH_INFO: `/v3/users/05654d818a474f378f6cc02850b57e1b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:45.649447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05654d818a474f378f6cc02850b57e1b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:45.651407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:45.808947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05654d818a474f378f6cc02850b57e1b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:45.809864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05654d818a474f378f6cc02850b57e1b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:45.810488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05654d818a474f378f6cc02850b57e1b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:45.843193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05654d818a474f378f6cc02850b57e1b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:45.860403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05654d818a474f378f6cc02850b57e1b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:45.881294 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1378/2757] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:53:45 2022] DELETE /identity/v3/users/05654d818a474f378f6cc02850b57e1b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:45.886987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9603ea-d8fc-4fea-8a12-6fd74c9fa0ce None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:45.886987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9603ea-d8fc-4fea-8a12-6fd74c9fa0ce None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:45.886987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9603ea-d8fc-4fea-8a12-6fd74c9fa0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:45.923787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5c9603ea-d8fc-4fea-8a12-6fd74c9fa0ce None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:45.925678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5c9603ea-d8fc-4fea-8a12-6fd74c9fa0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:46.025511 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1380/2758] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:46.090617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:46.092807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:46.237090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ae64-58d2-483b-9a13-e5cbefe7a240 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:46.246044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:46.246330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:46.246583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:46.246848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:46.267161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:46.268663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:46.298454 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1379/2759] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:47.359335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ecbd9-6142-4a83-b2b0-6b0274d37aaf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:47.359807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ecbd9-6142-4a83-b2b0-6b0274d37aaf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:47.359918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ecbd9-6142-4a83-b2b0-6b0274d37aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:47.397932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-273ecbd9-6142-4a83-b2b0-6b0274d37aaf None None] MFA Rules not processed for user `86d51248862040cdb3d5fbb208532248`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:47.399321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-273ecbd9-6142-4a83-b2b0-6b0274d37aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:47.494799 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1381/2760] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:47.718837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:47.722167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:47.742346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc73aba-cf14-46a3-a21a-34fd972173d0 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:47.747095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:47.747962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:47.748239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:47.748533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] PATH_INFO: `/v3/projects/81e756cebb9c45ddb687ea373d7ddaa3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:47.749746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e756cebb9c45ddb687ea373d7ddaa3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:47.751658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:47.832056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e756cebb9c45ddb687ea373d7ddaa3', 'request_id': 'req-a53c0fd6-2844-47fb-9ab0-04659824bc32'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:47.838366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e756cebb9c45ddb687ea373d7ddaa3', 'request_id': 'req-a53c0fd6-2844-47fb-9ab0-04659824bc32'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:47.849317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e756cebb9c45ddb687ea373d7ddaa3', 'request_id': 'req-a53c0fd6-2844-47fb-9ab0-04659824bc32'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:47.866827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] The token cache is being invalidate because project 81e756cebb9c45ddb687ea373d7ddaa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:53:47.867330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:47.868146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:47.870376 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1380/2761] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:53:47 2022] DELETE /identity/v3/projects/81e756cebb9c45ddb687ea373d7ddaa3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:47.874259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ecbd9-6142-4a83-b2b0-6b0274d37aaf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:47.895339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ecbd9-6142-4a83-b2b0-6b0274d37aaf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:47.962932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:47.963739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:47.964016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:47.964282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] PATH_INFO: `/v3/users/5dc83497d84643b6a3d839a097f1680a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:47.965545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc83497d84643b6a3d839a097f1680a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:47.967474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:48.023722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc83497d84643b6a3d839a097f1680a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.039641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc83497d84643b6a3d839a097f1680a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.050187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc83497d84643b6a3d839a097f1680a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.050929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc83497d84643b6a3d839a097f1680a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.051639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc83497d84643b6a3d839a097f1680a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.068385 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1382/2762] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:53:47 2022] DELETE /identity/v3/users/5dc83497d84643b6a3d839a097f1680a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:48.302187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:48.304546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:48.336388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c0fd6-2844-47fb-9ab0-04659824bc32 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:48.518996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:48.521116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:48.521623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:48.522208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] PATH_INFO: `/v3/projects/347e5866bf314d0b90d0603ca14aa736` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:48.523929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=347e5866bf314d0b90d0603ca14aa736)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:48.526309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:48.714045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347e5866bf314d0b90d0603ca14aa736', 'request_id': 'req-35adaaf9-0810-4be3-85ce-9edb200d7ca2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.716945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:48.718516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:48.747296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347e5866bf314d0b90d0603ca14aa736', 'request_id': 'req-35adaaf9-0810-4be3-85ce-9edb200d7ca2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.767450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347e5866bf314d0b90d0603ca14aa736', 'request_id': 'req-35adaaf9-0810-4be3-85ce-9edb200d7ca2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.785987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] The token cache is being invalidate because project 347e5866bf314d0b90d0603ca14aa736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:53:48.787652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.788753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35adaaf9-0810-4be3-85ce-9edb200d7ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:48.802056 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1381/2763] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:53:48 2022] DELETE /identity/v3/projects/347e5866bf314d0b90d0603ca14aa736 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:48.805091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2e24-5c44-4912-889d-636a783bbbdf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:48.807084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2e24-5c44-4912-889d-636a783bbbdf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:48.807455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2e24-5c44-4912-889d-636a783bbbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:48.843036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ff4a2e24-5c44-4912-889d-636a783bbbdf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:48.844466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ff4a2e24-5c44-4912-889d-636a783bbbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:48.856589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d402a0-2342-47b3-aeaa-2b69f783dd54 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:48.933629 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1382/2764] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:48.942753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa65e-b1d2-4f4a-8a5a-cfd2cf79e8c5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:48.943100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa65e-b1d2-4f4a-8a5a-cfd2cf79e8c5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:48.943381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa65e-b1d2-4f4a-8a5a-cfd2cf79e8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:48.970302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6cdaa65e-b1d2-4f4a-8a5a-cfd2cf79e8c5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:48.971483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:48.971990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6cdaa65e-b1d2-4f4a-8a5a-cfd2cf79e8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:48.973129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:48.973653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:48.974042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:48.976051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:48.988380 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1383/2765] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:48.995054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaa65e-b1d2-4f4a-8a5a-cfd2cf79e8c5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.009183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaa65e-b1d2-4f4a-8a5a-cfd2cf79e8c5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.015621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.016737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.017037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.017308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.018060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:53:49.018395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.020023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.038687 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1384/2766] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:53:49.040260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.052782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45f0e0-36b7-42f6-bc17-48180f2ec913 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.059112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def63b-ab4d-4066-9c2e-52d005485001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.059776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def63b-ab4d-4066-9c2e-52d005485001 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.061534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def63b-ab4d-4066-9c2e-52d005485001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.061534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def63b-ab4d-4066-9c2e-52d005485001 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.061928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77def63b-ab4d-4066-9c2e-52d005485001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.063874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.064736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77def63b-ab4d-4066-9c2e-52d005485001 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.065649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.089686 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1383/2767] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:49.100822 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1385/2768] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:53:49 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:49.102228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.114133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078de883-b9c5-43e0-a9e1-dbad6a39f8e7 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.174466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b87acc-6890-4381-b025-a281f2dfeb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.175384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87acc-6890-4381-b025-a281f2dfeb03 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.175740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87acc-6890-4381-b025-a281f2dfeb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.176161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87acc-6890-4381-b025-a281f2dfeb03 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.176966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b87acc-6890-4381-b025-a281f2dfeb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.178947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b87acc-6890-4381-b025-a281f2dfeb03 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.209095 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1384/2769] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:53:49 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:49.210555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def63b-ab4d-4066-9c2e-52d005485001 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.223845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def63b-ab4d-4066-9c2e-52d005485001 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.230957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d024dd6-5890-4f34-a7c6-421b4d0d9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.233215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d024dd6-5890-4f34-a7c6-421b4d0d9069 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.233504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d024dd6-5890-4f34-a7c6-421b4d0d9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.233942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d024dd6-5890-4f34-a7c6-421b4d0d9069 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.234719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d024dd6-5890-4f34-a7c6-421b4d0d9069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.236789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d024dd6-5890-4f34-a7c6-421b4d0d9069 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.251344 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1386/2770] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:49.252736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b87acc-6890-4381-b025-a281f2dfeb03 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.264354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b87acc-6890-4381-b025-a281f2dfeb03 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.271447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038174e9-b8e1-4b4f-bd83-4267fa89bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.272964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038174e9-b8e1-4b4f-bd83-4267fa89bc9c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.273262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038174e9-b8e1-4b4f-bd83-4267fa89bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.273541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038174e9-b8e1-4b4f-bd83-4267fa89bc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.274276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038174e9-b8e1-4b4f-bd83-4267fa89bc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.275986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038174e9-b8e1-4b4f-bd83-4267fa89bc9c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.312085 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1385/2771] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:49.321141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d024dd6-5890-4f34-a7c6-421b4d0d9069 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.331926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d024dd6-5890-4f34-a7c6-421b4d0d9069 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.337484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb971-5981-4557-826c-f538983bcf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.338361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb971-5981-4557-826c-f538983bcf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.338641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb971-5981-4557-826c-f538983bcf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.338909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb971-5981-4557-826c-f538983bcf8d admin admin] PATH_INFO: `/v3/projects/4d249188994442d588a4f02cb0feddf0/users/1a5a8ee8faae4585a519215a61c533b1/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.360791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fb971-5981-4557-826c-f538983bcf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d249188994442d588a4f02cb0feddf0, user_id=1a5a8ee8faae4585a519215a61c533b1, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.366232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fb971-5981-4557-826c-f538983bcf8d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.385320 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1387/2772] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:53:49 2022] PUT /identity/v3/projects/4d249188994442d588a4f02cb0feddf0/users/1a5a8ee8faae4585a519215a61c533b1/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:49.395989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32443438-2d7d-471b-9907-ca992f429f11 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.396277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32443438-2d7d-471b-9907-ca992f429f11 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.396597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32443438-2d7d-471b-9907-ca992f429f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.429432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-32443438-2d7d-471b-9907-ca992f429f11 None None] MFA Rules not processed for user `1a5a8ee8faae4585a519215a61c533b1`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:49.430649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-32443438-2d7d-471b-9907-ca992f429f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:49.533440 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1386/2773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:49.538483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb971-5981-4557-826c-f538983bcf8d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.617121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb971-5981-4557-826c-f538983bcf8d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.623343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eefc7-fa62-4657-bedc-7137807188c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.624066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eefc7-fa62-4657-bedc-7137807188c9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.624383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eefc7-fa62-4657-bedc-7137807188c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.624671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eefc7-fa62-4657-bedc-7137807188c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.625365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709eefc7-fa62-4657-bedc-7137807188c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.627278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709eefc7-fa62-4657-bedc-7137807188c9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.658552 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1388/2774] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:53:49 2022] POST /identity/v3/projects => generated 409 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:49.662434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32443438-2d7d-471b-9907-ca992f429f11 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.674388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32443438-2d7d-471b-9907-ca992f429f11 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.753023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675743c1-9551-4f67-8cfb-f60e6eff44a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.753715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675743c1-9551-4f67-8cfb-f60e6eff44a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.753987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675743c1-9551-4f67-8cfb-f60e6eff44a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.754814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675743c1-9551-4f67-8cfb-f60e6eff44a9 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.755544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675743c1-9551-4f67-8cfb-f60e6eff44a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.757543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675743c1-9551-4f67-8cfb-f60e6eff44a9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.779674 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1387/2775] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:53:49 2022] POST /identity/v3/users => generated 311 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:49.783671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eefc7-fa62-4657-bedc-7137807188c9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.795833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eefc7-fa62-4657-bedc-7137807188c9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.801600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ece97-3137-4e13-a49b-752d695fc75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.802292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ece97-3137-4e13-a49b-752d695fc75d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.802576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ece97-3137-4e13-a49b-752d695fc75d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.803018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ece97-3137-4e13-a49b-752d695fc75d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.803833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ece97-3137-4e13-a49b-752d695fc75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.805936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ece97-3137-4e13-a49b-752d695fc75d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.820377 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1389/2776] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:49.823654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675743c1-9551-4f67-8cfb-f60e6eff44a9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.837095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675743c1-9551-4f67-8cfb-f60e6eff44a9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.842198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a7c8-cfda-4283-a196-81c9dcee51a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.843268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a7c8-cfda-4283-a196-81c9dcee51a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.843814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a7c8-cfda-4283-a196-81c9dcee51a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.844191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a7c8-cfda-4283-a196-81c9dcee51a6 admin admin] PATH_INFO: `/v3/projects/8c2acccf70b44cf8b382e9037b60064b/users/b2b7dbd83eb843a8b90bedf57665d354/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.860623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926a7c8-cfda-4283-a196-81c9dcee51a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2acccf70b44cf8b382e9037b60064b, user_id=b2b7dbd83eb843a8b90bedf57665d354, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.864230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926a7c8-cfda-4283-a196-81c9dcee51a6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.883936 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1388/2777] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:53:49 2022] PUT /identity/v3/projects/8c2acccf70b44cf8b382e9037b60064b/users/b2b7dbd83eb843a8b90bedf57665d354/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:49.884877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ece97-3137-4e13-a49b-752d695fc75d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:49.895878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ece97-3137-4e13-a49b-752d695fc75d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:49.962158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e809c74-ddce-4a06-bc4a-9a1fc36fe8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:49.962949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e809c74-ddce-4a06-bc4a-9a1fc36fe8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:49.963298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e809c74-ddce-4a06-bc4a-9a1fc36fe8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:49.963705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e809c74-ddce-4a06-bc4a-9a1fc36fe8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:49.964552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e809c74-ddce-4a06-bc4a-9a1fc36fe8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:49.966677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e809c74-ddce-4a06-bc4a-9a1fc36fe8e6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:49.981313 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1390/2778] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:49.985134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a7c8-cfda-4283-a196-81c9dcee51a6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:50.002581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a7c8-cfda-4283-a196-81c9dcee51a6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:50.011445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75836c1-552b-49b3-801b-ee9cc733490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:50.012629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75836c1-552b-49b3-801b-ee9cc733490b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:50.012629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75836c1-552b-49b3-801b-ee9cc733490b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:50.012938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75836c1-552b-49b3-801b-ee9cc733490b admin admin] PATH_INFO: `/v3/projects/8c2acccf70b44cf8b382e9037b60064b/users/b2b7dbd83eb843a8b90bedf57665d354/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:50.015198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75836c1-552b-49b3-801b-ee9cc733490b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2acccf70b44cf8b382e9037b60064b, user_id=b2b7dbd83eb843a8b90bedf57665d354, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:50.019186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75836c1-552b-49b3-801b-ee9cc733490b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:50.052454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8ddd5-914a-4565-8ba8-bca62ce5089e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:50.052789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8ddd5-914a-4565-8ba8-bca62ce5089e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:50.052968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8ddd5-914a-4565-8ba8-bca62ce5089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:50.053724 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1389/2779] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:53:49 2022] PUT /identity/v3/projects/8c2acccf70b44cf8b382e9037b60064b/users/b2b7dbd83eb843a8b90bedf57665d354/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:53:50.085525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-03d8ddd5-914a-4565-8ba8-bca62ce5089e None None] MFA Rules not processed for user `b2b7dbd83eb843a8b90bedf57665d354`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:50.087215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-03d8ddd5-914a-4565-8ba8-bca62ce5089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:50.189520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75836c1-552b-49b3-801b-ee9cc733490b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:50.196274 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1391/2780] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:53:50.266406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75836c1-552b-49b3-801b-ee9cc733490b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:50.272386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:50.273714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:50.274109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:50.275201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] PATH_INFO: `/v3/users/1a5a8ee8faae4585a519215a61c533b1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:50.276625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5a8ee8faae4585a519215a61c533b1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:50.279296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:50.366581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5a8ee8faae4585a519215a61c533b1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:50.388456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5a8ee8faae4585a519215a61c533b1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:50.409396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5a8ee8faae4585a519215a61c533b1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:50.410285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5a8ee8faae4585a519215a61c533b1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:50.412928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5a8ee8faae4585a519215a61c533b1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:50.448168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2543fb-933b-4b8a-846d-c16750c50ca2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:50.448807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2543fb-933b-4b8a-846d-c16750c50ca2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:50.449239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2543fb-933b-4b8a-846d-c16750c50ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:50.452014 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1390/2781] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:53:50 2022] DELETE /identity/v3/users/1a5a8ee8faae4585a519215a61c533b1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:50.481199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ac2543fb-933b-4b8a-846d-c16750c50ca2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:50.482993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ac2543fb-933b-4b8a-846d-c16750c50ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:50.627723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1392/2782] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:50.640180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:50.642974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:50.793903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d94ed-0995-4378-b2d6-05d3351eaeea admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:50.800607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b397-3305-4ceb-b4b4-dba0e2ca54cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:50.802191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b397-3305-4ceb-b4b4-dba0e2ca54cf service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:50.802191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b397-3305-4ceb-b4b4-dba0e2ca54cf service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:50.802406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b397-3305-4ceb-b4b4-dba0e2ca54cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:50.814681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b397-3305-4ceb-b4b4-dba0e2ca54cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:50.816353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b397-3305-4ceb-b4b4-dba0e2ca54cf service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:50.832859 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1391/2783] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:51.713619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2543fb-933b-4b8a-846d-c16750c50ca2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:51.720089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ac2543fb-933b-4b8a-846d-c16750c50ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:51.743875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2543fb-933b-4b8a-846d-c16750c50ca2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:51.759563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:51.760906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:51.762126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:51.762598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] PATH_INFO: `/v3/projects/4d249188994442d588a4f02cb0feddf0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:51.765634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d249188994442d588a4f02cb0feddf0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:51.771440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:51.845133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d249188994442d588a4f02cb0feddf0', 'request_id': 'req-ef018eff-d151-4e4c-bd22-edc8f340fc8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:51.851415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d249188994442d588a4f02cb0feddf0', 'request_id': 'req-ef018eff-d151-4e4c-bd22-edc8f340fc8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:51.865447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d249188994442d588a4f02cb0feddf0', 'request_id': 'req-ef018eff-d151-4e4c-bd22-edc8f340fc8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:51.882340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] The token cache is being invalidate because project 4d249188994442d588a4f02cb0feddf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:53:51.882659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:51.883345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:51.887891 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1393/2784] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:53:51 2022] DELETE /identity/v3/projects/4d249188994442d588a4f02cb0feddf0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:51.889185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b397-3305-4ceb-b4b4-dba0e2ca54cf service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:51.901698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b397-3305-4ceb-b4b4-dba0e2ca54cf service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:51.999899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:52.001498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:52.001943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:52.002411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] PATH_INFO: `/v3/users/b2b7dbd83eb843a8b90bedf57665d354` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:52.003898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b7dbd83eb843a8b90bedf57665d354)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:52.007592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:52.123152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b7dbd83eb843a8b90bedf57665d354'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:52.138766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b7dbd83eb843a8b90bedf57665d354'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:52.151172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b7dbd83eb843a8b90bedf57665d354'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:52.152026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b7dbd83eb843a8b90bedf57665d354'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:52.153040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-955d14b8-3fc0-4fba-ba1f-58991664b2ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b7dbd83eb843a8b90bedf57665d354'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:52.193416 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1392/2785] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:53:51 2022] DELETE /identity/v3/users/b2b7dbd83eb843a8b90bedf57665d354 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:52.833732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:52.835357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:52.891546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef018eff-d151-4e4c-bd22-edc8f340fc8c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:52.978509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:52.980167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:52.980899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:52.981289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] PATH_INFO: `/v3/projects/8c2acccf70b44cf8b382e9037b60064b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:52.984073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2acccf70b44cf8b382e9037b60064b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:52.987575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:53.055809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2acccf70b44cf8b382e9037b60064b', 'request_id': 'req-4f929999-c7dd-41a4-bc28-b71dbd24b37e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:53.063438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2acccf70b44cf8b382e9037b60064b', 'request_id': 'req-4f929999-c7dd-41a4-bc28-b71dbd24b37e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:53.078336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2acccf70b44cf8b382e9037b60064b', 'request_id': 'req-4f929999-c7dd-41a4-bc28-b71dbd24b37e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:53.095894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] The token cache is being invalidate because project 8c2acccf70b44cf8b382e9037b60064b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:53:53.096807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:53.097742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f929999-c7dd-41a4-bc28-b71dbd24b37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:53:53.106521 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1394/2786] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:53:52 2022] DELETE /identity/v3/projects/8c2acccf70b44cf8b382e9037b60064b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:53:53.107513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a1fd-4bff-4393-ba1d-b582f9df5547 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.108425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a1fd-4bff-4393-ba1d-b582f9df5547 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.108925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a1fd-4bff-4393-ba1d-b582f9df5547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.131820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6f39a1fd-4bff-4393-ba1d-b582f9df5547 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:53.134049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6f39a1fd-4bff-4393-ba1d-b582f9df5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:53.228359 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1393/2787] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:53.290980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0722df-87a8-4752-bf02-9cabeb724ee2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.291341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0722df-87a8-4752-bf02-9cabeb724ee2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.291626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0722df-87a8-4752-bf02-9cabeb724ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.319346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6e0722df-87a8-4752-bf02-9cabeb724ee2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:53.320950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6e0722df-87a8-4752-bf02-9cabeb724ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:53.336535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1395/2788] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:53.340672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39a1fd-4bff-4393-ba1d-b582f9df5547 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:53.352288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39a1fd-4bff-4393-ba1d-b582f9df5547 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:53.360028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:53.361031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.361509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.363017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.365831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:53:53.366354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:53.368610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:53.382243 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1394/2789] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:53:53.386999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0722df-87a8-4752-bf02-9cabeb724ee2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:53.396869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0722df-87a8-4752-bf02-9cabeb724ee2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:53.404062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcde95a-59f1-4cf7-88be-fd37127601cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:53.404289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcde95a-59f1-4cf7-88be-fd37127601cb admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.404726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcde95a-59f1-4cf7-88be-fd37127601cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.405074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcde95a-59f1-4cf7-88be-fd37127601cb admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.405837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcde95a-59f1-4cf7-88be-fd37127601cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:53.407967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcde95a-59f1-4cf7-88be-fd37127601cb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:53.456895 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1396/2790] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:53:53 2022] POST /identity/v3/projects => generated 411 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:53:53.458935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:53.474573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca1b80-b327-438a-8fed-ed61abd0b507 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:53.557192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746e841-3c15-447f-bf65-800a33a73cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:53.558261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e841-3c15-447f-bf65-800a33a73cbe admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.558772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e841-3c15-447f-bf65-800a33a73cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.559255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e841-3c15-447f-bf65-800a33a73cbe admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.560156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746e841-3c15-447f-bf65-800a33a73cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:53.562281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746e841-3c15-447f-bf65-800a33a73cbe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:53.590349 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1395/2791] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:53:53 2022] POST /identity/v3/users => generated 306 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:53:53.591649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcde95a-59f1-4cf7-88be-fd37127601cb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:53.606568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcde95a-59f1-4cf7-88be-fd37127601cb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:53.611518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699b597-2307-4b99-99f2-abed1c7ba613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:53.612229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b597-2307-4b99-99f2-abed1c7ba613 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.612604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b597-2307-4b99-99f2-abed1c7ba613 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.613135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b597-2307-4b99-99f2-abed1c7ba613 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.614461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699b597-2307-4b99-99f2-abed1c7ba613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:53.616139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699b597-2307-4b99-99f2-abed1c7ba613 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:53.627772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1397/2792] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:53.633158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746e841-3c15-447f-bf65-800a33a73cbe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:53.647139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746e841-3c15-447f-bf65-800a33a73cbe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:53.654479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f64e01-ae72-4266-b89b-cb7cd04418e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:53.655276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64e01-ae72-4266-b89b-cb7cd04418e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.655730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64e01-ae72-4266-b89b-cb7cd04418e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.656012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64e01-ae72-4266-b89b-cb7cd04418e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.657408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f64e01-ae72-4266-b89b-cb7cd04418e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:53.659003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f64e01-ae72-4266-b89b-cb7cd04418e2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:53.672392 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1396/2793] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:53:53.675163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699b597-2307-4b99-99f2-abed1c7ba613 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:53.691427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699b597-2307-4b99-99f2-abed1c7ba613 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:53.702014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:53.703158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.703665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.704108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] PATH_INFO: `/v3/projects/8a274e94e3e643c4b814892e2429db0e/users/d05e321d65ab4c218cebea855d1aad86/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.723638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a274e94e3e643c4b814892e2429db0e, user_id=d05e321d65ab4c218cebea855d1aad86, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:53.729520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:53.746626 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1398/2794] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:53:53 2022] PUT /identity/v3/projects/8a274e94e3e643c4b814892e2429db0e/users/d05e321d65ab4c218cebea855d1aad86/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:53:53.752022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b80de5-f15a-4184-8369-29057dcb5a68 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.752302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b80de5-f15a-4184-8369-29057dcb5a68 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.752627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b80de5-f15a-4184-8369-29057dcb5a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.772380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-00b80de5-f15a-4184-8369-29057dcb5a68 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:53.773640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00b80de5-f15a-4184-8369-29057dcb5a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:53.850515 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1397/2795] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:53:53.860486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:53.868020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:53.942104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f4465-9014-4522-8fd0-562636af3981 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:53.945796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fa64d-c6db-42fb-823e-4d920d70d579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:53.946510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa64d-c6db-42fb-823e-4d920d70d579 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:53.946794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa64d-c6db-42fb-823e-4d920d70d579 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:53.947073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa64d-c6db-42fb-823e-4d920d70d579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:53.958041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fa64d-c6db-42fb-823e-4d920d70d579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:53.959512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fa64d-c6db-42fb-823e-4d920d70d579 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:53.983775 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1399/2796] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:54.414977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80614b-326f-4cfe-8052-3967a481751c None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:54.415555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80614b-326f-4cfe-8052-3967a481751c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:54.415555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80614b-326f-4cfe-8052-3967a481751c None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:54.417574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1398/2797] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:53:54.423644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b688c-7c66-4d2f-a1b3-53489780b9f8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:54.423963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b688c-7c66-4d2f-a1b3-53489780b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:54.424243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b688c-7c66-4d2f-a1b3-53489780b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:54.454877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-028b688c-7c66-4d2f-a1b3-53489780b9f8 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:53:54.456153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-028b688c-7c66-4d2f-a1b3-53489780b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:54.598790 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1400/2798] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:53:54.620860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80614b-326f-4cfe-8052-3967a481751c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:53:54.623602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dc80614b-326f-4cfe-8052-3967a481751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:53:54.643256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80614b-326f-4cfe-8052-3967a481751c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:53:54.664664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d05e6-941b-4c56-be3d-a2be4631d546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:53:54.665799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d05e6-941b-4c56-be3d-a2be4631d546 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:53:54.666377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d05e6-941b-4c56-be3d-a2be4631d546 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:53:54.667325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d05e6-941b-4c56-be3d-a2be4631d546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:53:54.679496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d05e6-941b-4c56-be3d-a2be4631d546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:53:54.681488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d05e6-941b-4c56-be3d-a2be4631d546 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:53:54.702478 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1399/2799] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:53:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:00.909506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0a10-38cd-4d15-947e-6c60d0bb37da None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:00.909969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0a10-38cd-4d15-947e-6c60d0bb37da None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:00.910092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0a10-38cd-4d15-947e-6c60d0bb37da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:00.945721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6dce0a10-38cd-4d15-947e-6c60d0bb37da None None] MFA Rules not processed for user `d05e321d65ab4c218cebea855d1aad86`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:00.947130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6dce0a10-38cd-4d15-947e-6c60d0bb37da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:01.058303 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1401/2800] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:01.059085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4aeb2-5b40-4d01-89d3-70969b655698 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:01.059577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4aeb2-5b40-4d01-89d3-70969b655698 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:01.059661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4aeb2-5b40-4d01-89d3-70969b655698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:01.081531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-54e4aeb2-5b40-4d01-89d3-70969b655698 None None] MFA Rules not processed for user `d05e321d65ab4c218cebea855d1aad86`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:01.084108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-54e4aeb2-5b40-4d01-89d3-70969b655698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:01.094656 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1400/2801] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:54:02.850691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0a10-38cd-4d15-947e-6c60d0bb37da None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:02.852248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6dce0a10-38cd-4d15-947e-6c60d0bb37da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:03.019097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0a10-38cd-4d15-947e-6c60d0bb37da None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:03.037331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:03.037917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:03.038265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:03.038545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:03.051615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:03.056234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:03.100074 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1402/2802] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:02 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:12.618200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901dd1d-00f1-4e20-9b63-d37696099c19 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:12.619749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901dd1d-00f1-4e20-9b63-d37696099c19 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:12.620036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901dd1d-00f1-4e20-9b63-d37696099c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:12.644314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8901dd1d-00f1-4e20-9b63-d37696099c19 None None] MFA Rules not processed for user `ec1a2a2db19c41cca4342aa082770a96`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:12.645784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8901dd1d-00f1-4e20-9b63-d37696099c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:12.705483 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1401/2803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:18.320702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:18.322732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:18.364693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465610dc-8c6d-4909-835f-f1534f2ca703 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:18.397862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:18.399911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:18.400512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:18.401714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] PATH_INFO: `/v3/users/caca1da9a52c4a2080682b2458fa1e4f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:18.403711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=caca1da9a52c4a2080682b2458fa1e4f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:18.408730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:18.557201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caca1da9a52c4a2080682b2458fa1e4f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:18.557985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caca1da9a52c4a2080682b2458fa1e4f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:18.558633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caca1da9a52c4a2080682b2458fa1e4f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:18.582992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caca1da9a52c4a2080682b2458fa1e4f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:18.606198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caca1da9a52c4a2080682b2458fa1e4f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:18.630117 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1403/2804] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:18 2022] DELETE /identity/v3/users/caca1da9a52c4a2080682b2458fa1e4f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:18.631664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4044b-7dc4-4e5a-95f7-d40ba4a2fab1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:18.632135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4044b-7dc4-4e5a-95f7-d40ba4a2fab1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:18.636062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4044b-7dc4-4e5a-95f7-d40ba4a2fab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:18.659371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fdd4044b-7dc4-4e5a-95f7-d40ba4a2fab1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:18.661138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fdd4044b-7dc4-4e5a-95f7-d40ba4a2fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:18.743093 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1402/2805] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:54:18.763381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:18.765053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:18.896309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700f7a-16e1-4620-87e5-fed7ec6d6c1b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:18.911060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f053b-4201-4642-9c14-5d01346a215d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:18.911648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f053b-4201-4642-9c14-5d01346a215d service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:18.911931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f053b-4201-4642-9c14-5d01346a215d service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:18.912218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f053b-4201-4642-9c14-5d01346a215d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:18.944234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f053b-4201-4642-9c14-5d01346a215d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:18.950208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f053b-4201-4642-9c14-5d01346a215d service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:18.982324 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1404/2806] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:20.095063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4044b-7dc4-4e5a-95f7-d40ba4a2fab1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:20.098865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fdd4044b-7dc4-4e5a-95f7-d40ba4a2fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:20.143461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4044b-7dc4-4e5a-95f7-d40ba4a2fab1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:20.156772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:20.158208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:20.158910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:20.159443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] PATH_INFO: `/v3/projects/6d9ffdaf1d654c9bbbda43ed9214c964` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:20.161567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9ffdaf1d654c9bbbda43ed9214c964)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:20.173038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:20.297288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9ffdaf1d654c9bbbda43ed9214c964', 'request_id': 'req-d20f70ad-6382-44a7-996b-3dbd4e6171c8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.305727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9ffdaf1d654c9bbbda43ed9214c964', 'request_id': 'req-d20f70ad-6382-44a7-996b-3dbd4e6171c8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.324179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9ffdaf1d654c9bbbda43ed9214c964', 'request_id': 'req-d20f70ad-6382-44a7-996b-3dbd4e6171c8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.344950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] The token cache is being invalidate because project 6d9ffdaf1d654c9bbbda43ed9214c964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:20.345613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.346958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.350917 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1403/2807] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:20 2022] DELETE /identity/v3/projects/6d9ffdaf1d654c9bbbda43ed9214c964 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:20.354588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f053b-4201-4642-9c14-5d01346a215d service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:20.439565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f053b-4201-4642-9c14-5d01346a215d service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:20.570858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:20.578484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:20.578832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:20.582211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] PATH_INFO: `/v3/users/2ac1049b15c340a7935a20e794d075c6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:20.586585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac1049b15c340a7935a20e794d075c6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:20.592182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:20.729527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac1049b15c340a7935a20e794d075c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.733451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac1049b15c340a7935a20e794d075c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.735097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac1049b15c340a7935a20e794d075c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.758938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac1049b15c340a7935a20e794d075c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.771404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b6510bec-7644-4244-981e-66006ca435d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac1049b15c340a7935a20e794d075c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:20.791998 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1405/2808] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:20 2022] DELETE /identity/v3/users/2ac1049b15c340a7935a20e794d075c6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:21.180176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:21.186313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:21.222104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f70ad-6382-44a7-996b-3dbd4e6171c8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:21.357203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:21.358080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:21.358395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:21.358830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] PATH_INFO: `/v3/projects/85fb7ac785b04495b0aebd17fa4efb4a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:21.361035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85fb7ac785b04495b0aebd17fa4efb4a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:21.366990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:21.454619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85fb7ac785b04495b0aebd17fa4efb4a', 'request_id': 'req-fc379366-823a-4a57-a7ee-b1e915f716b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:21.467077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85fb7ac785b04495b0aebd17fa4efb4a', 'request_id': 'req-fc379366-823a-4a57-a7ee-b1e915f716b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:21.482661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85fb7ac785b04495b0aebd17fa4efb4a', 'request_id': 'req-fc379366-823a-4a57-a7ee-b1e915f716b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:21.503091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] The token cache is being invalidate because project 85fb7ac785b04495b0aebd17fa4efb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:21.503893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:21.505917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc379366-823a-4a57-a7ee-b1e915f716b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:21.509217 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1404/2809] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:21 2022] DELETE /identity/v3/projects/85fb7ac785b04495b0aebd17fa4efb4a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:21.516797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e44b-3abd-47cb-9fe9-21b89790afbd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:21.517930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e44b-3abd-47cb-9fe9-21b89790afbd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:21.518537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e44b-3abd-47cb-9fe9-21b89790afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:21.556005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b5f9e44b-3abd-47cb-9fe9-21b89790afbd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:21.557828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b5f9e44b-3abd-47cb-9fe9-21b89790afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:21.637373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1406/2810] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:21.645671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f6df9-4e2b-44d3-b357-4ec79e1f5b3c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:21.645671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f6df9-4e2b-44d3-b357-4ec79e1f5b3c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:21.646134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f6df9-4e2b-44d3-b357-4ec79e1f5b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:21.680580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0f2f6df9-4e2b-44d3-b357-4ec79e1f5b3c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:21.682051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f2f6df9-4e2b-44d3-b357-4ec79e1f5b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:21.705805 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1405/2811] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:21.710138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9e44b-3abd-47cb-9fe9-21b89790afbd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:21.744731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9e44b-3abd-47cb-9fe9-21b89790afbd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:21.756895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:21.757960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:21.758590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:21.759100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:21.760195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:54:21.761907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:21.764419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:21.800419 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1407/2812] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:54:21.805021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f6df9-4e2b-44d3-b357-4ec79e1f5b3c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:21.817817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f6df9-4e2b-44d3-b357-4ec79e1f5b3c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:21.826103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c271-f423-48b3-af9a-e96a81bf568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:21.828428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c271-f423-48b3-af9a-e96a81bf568f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:21.829340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c271-f423-48b3-af9a-e96a81bf568f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:21.829872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c271-f423-48b3-af9a-e96a81bf568f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:21.831159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c271-f423-48b3-af9a-e96a81bf568f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:21.836751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c271-f423-48b3-af9a-e96a81bf568f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:21.910886 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1406/2813] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:21 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:54:21.915070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:21.933676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a60a6-3178-4c86-8d54-bfdc792cdf65 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:22.028017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb01c-aab7-40d3-9ffc-50a3235be592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:22.028733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb01c-aab7-40d3-9ffc-50a3235be592 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.029108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb01c-aab7-40d3-9ffc-50a3235be592 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.029293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb01c-aab7-40d3-9ffc-50a3235be592 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.029984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeb01c-aab7-40d3-9ffc-50a3235be592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:22.031900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeb01c-aab7-40d3-9ffc-50a3235be592 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:22.061538 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1408/2814] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:21 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:22.065092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c271-f423-48b3-af9a-e96a81bf568f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:22.077048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c271-f423-48b3-af9a-e96a81bf568f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:22.091539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdaf9c-77fe-47d5-b87c-2bd9eb45510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:22.093856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdaf9c-77fe-47d5-b87c-2bd9eb45510c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.095122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdaf9c-77fe-47d5-b87c-2bd9eb45510c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.095552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdaf9c-77fe-47d5-b87c-2bd9eb45510c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.098135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdaf9c-77fe-47d5-b87c-2bd9eb45510c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:22.101427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdaf9c-77fe-47d5-b87c-2bd9eb45510c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:22.114598 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1407/2815] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:22.118752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb01c-aab7-40d3-9ffc-50a3235be592 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:22.130083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb01c-aab7-40d3-9ffc-50a3235be592 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:22.141740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d5a09-1867-4ab1-9411-13d514825457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:22.142604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5a09-1867-4ab1-9411-13d514825457 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.143506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5a09-1867-4ab1-9411-13d514825457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.143843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5a09-1867-4ab1-9411-13d514825457 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.145282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d5a09-1867-4ab1-9411-13d514825457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:22.146929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d5a09-1867-4ab1-9411-13d514825457 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:22.167711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdaf9c-77fe-47d5-b87c-2bd9eb45510c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:22.178848 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1409/2816] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:22.180314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdaf9c-77fe-47d5-b87c-2bd9eb45510c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:22.187705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d0312-653e-45df-a926-325e65dcb43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:22.189035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0312-653e-45df-a926-325e65dcb43c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.189331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0312-653e-45df-a926-325e65dcb43c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.189609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0312-653e-45df-a926-325e65dcb43c admin admin] PATH_INFO: `/v3/projects/dabc5bb30faa4af797e9ba1cd4bad547/users/ab3fa7eadddf42b4b700593dad828e44/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.209142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d0312-653e-45df-a926-325e65dcb43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabc5bb30faa4af797e9ba1cd4bad547, user_id=ab3fa7eadddf42b4b700593dad828e44, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:22.212633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d0312-653e-45df-a926-325e65dcb43c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:22.244453 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1408/2817] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:22 2022] PUT /identity/v3/projects/dabc5bb30faa4af797e9ba1cd4bad547/users/ab3fa7eadddf42b4b700593dad828e44/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:22.246496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd93dc-962c-4d10-8f0c-01c7dc6e93f1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.246861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd93dc-962c-4d10-8f0c-01c7dc6e93f1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.247209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd93dc-962c-4d10-8f0c-01c7dc6e93f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.280762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bedd93dc-962c-4d10-8f0c-01c7dc6e93f1 None None] MFA Rules not processed for user `ab3fa7eadddf42b4b700593dad828e44`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:22.282218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bedd93dc-962c-4d10-8f0c-01c7dc6e93f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:22.385997 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1410/2818] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:22.390260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d0312-653e-45df-a926-325e65dcb43c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:22.510631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d0312-653e-45df-a926-325e65dcb43c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:22.519919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81f46-a3b9-46e9-9d17-363a7da41b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:22.520887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81f46-a3b9-46e9-9d17-363a7da41b68 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.521272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81f46-a3b9-46e9-9d17-363a7da41b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.521698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81f46-a3b9-46e9-9d17-363a7da41b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.523507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f81f46-a3b9-46e9-9d17-363a7da41b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:22.526317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f81f46-a3b9-46e9-9d17-363a7da41b68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:22.602011 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1409/2819] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:22 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:54:22.607141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd93dc-962c-4d10-8f0c-01c7dc6e93f1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:22.625475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd93dc-962c-4d10-8f0c-01c7dc6e93f1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:22.762541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c52c90-81a1-41cd-a9ef-3144b4edd909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:22.763644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52c90-81a1-41cd-a9ef-3144b4edd909 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.764156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52c90-81a1-41cd-a9ef-3144b4edd909 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.764801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52c90-81a1-41cd-a9ef-3144b4edd909 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.765490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c52c90-81a1-41cd-a9ef-3144b4edd909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:22.771538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c52c90-81a1-41cd-a9ef-3144b4edd909 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:22.793942 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1411/2820] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:22 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:22.798382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81f46-a3b9-46e9-9d17-363a7da41b68 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:22.825577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81f46-a3b9-46e9-9d17-363a7da41b68 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:22.832283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5fb15-f369-4c3d-97ac-90abf124ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:22.833040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5fb15-f369-4c3d-97ac-90abf124ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.833450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5fb15-f369-4c3d-97ac-90abf124ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.833837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5fb15-f369-4c3d-97ac-90abf124ac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.836036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5fb15-f369-4c3d-97ac-90abf124ac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:22.836674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5fb15-f369-4c3d-97ac-90abf124ac08 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:22.856421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c52c90-81a1-41cd-a9ef-3144b4edd909 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:22.857083 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1410/2821] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:22.869867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c52c90-81a1-41cd-a9ef-3144b4edd909 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:22.875278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6ef3-ec80-4615-8b38-631b1c0ac44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:22.876181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6ef3-ec80-4615-8b38-631b1c0ac44a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:22.876536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6ef3-ec80-4615-8b38-631b1c0ac44a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:22.876823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6ef3-ec80-4615-8b38-631b1c0ac44a admin admin] PATH_INFO: `/v3/projects/044539d0759e4edd8a8cf729fb4a2955/users/198721299a4841c6803ff197299dc7ec/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:22.905707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6ef3-ec80-4615-8b38-631b1c0ac44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=044539d0759e4edd8a8cf729fb4a2955, user_id=198721299a4841c6803ff197299dc7ec, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:22.908717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6ef3-ec80-4615-8b38-631b1c0ac44a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:22.935333 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1412/2822] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:22 2022] PUT /identity/v3/projects/044539d0759e4edd8a8cf729fb4a2955/users/198721299a4841c6803ff197299dc7ec/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:54:22.940161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5fb15-f369-4c3d-97ac-90abf124ac08 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:22.951288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5fb15-f369-4c3d-97ac-90abf124ac08 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:23.116150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd5ae1-2008-49ad-8e15-bc11fa6fc25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:23.119305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5ae1-2008-49ad-8e15-bc11fa6fc25c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:23.120868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5ae1-2008-49ad-8e15-bc11fa6fc25c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:23.121387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5ae1-2008-49ad-8e15-bc11fa6fc25c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:23.125124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd5ae1-2008-49ad-8e15-bc11fa6fc25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:23.129764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd5ae1-2008-49ad-8e15-bc11fa6fc25c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:23.154947 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1411/2823] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:23.159598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6ef3-ec80-4615-8b38-631b1c0ac44a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:23.176593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6ef3-ec80-4615-8b38-631b1c0ac44a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:23.190694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48c705-f623-4cd9-b3b5-835f472ef5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:23.192222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48c705-f623-4cd9-b3b5-835f472ef5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:23.193928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48c705-f623-4cd9-b3b5-835f472ef5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:23.194310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48c705-f623-4cd9-b3b5-835f472ef5f3 admin admin] PATH_INFO: `/v3/projects/044539d0759e4edd8a8cf729fb4a2955/users/198721299a4841c6803ff197299dc7ec/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:23.198663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48c705-f623-4cd9-b3b5-835f472ef5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044539d0759e4edd8a8cf729fb4a2955, user_id=198721299a4841c6803ff197299dc7ec, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:23.201481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48c705-f623-4cd9-b3b5-835f472ef5f3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:23.216136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1413/2824] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:23 2022] PUT /identity/v3/projects/044539d0759e4edd8a8cf729fb4a2955/users/198721299a4841c6803ff197299dc7ec/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:54:23.226798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cd47-2b2d-485c-bc28-9de0b20beab9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:23.227348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cd47-2b2d-485c-bc28-9de0b20beab9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:23.227466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cd47-2b2d-485c-bc28-9de0b20beab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:23.281844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bc47cd47-2b2d-485c-bc28-9de0b20beab9 None None] MFA Rules not processed for user `198721299a4841c6803ff197299dc7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:23.287585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bc47cd47-2b2d-485c-bc28-9de0b20beab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:23.405332 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1412/2825] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:23.416898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6291-ca53-405b-8732-b146eb574d07 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:23.417138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6291-ca53-405b-8732-b146eb574d07 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:23.417411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6291-ca53-405b-8732-b146eb574d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:23.451956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d14c6291-ca53-405b-8732-b146eb574d07 None None] MFA Rules not processed for user `ab3fa7eadddf42b4b700593dad828e44`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:23.453365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d14c6291-ca53-405b-8732-b146eb574d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:23.581227 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1414/2826] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:23.609798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47cd47-2b2d-485c-bc28-9de0b20beab9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:23.611239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bc47cd47-2b2d-485c-bc28-9de0b20beab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:23.771612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47cd47-2b2d-485c-bc28-9de0b20beab9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:23.789513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:23.790567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:23.790954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:23.791336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] PATH_INFO: `/v3/users/86d51248862040cdb3d5fbb208532248` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:23.793449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d51248862040cdb3d5fbb208532248)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:23.795573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:23.884860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d51248862040cdb3d5fbb208532248'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:23.902837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d51248862040cdb3d5fbb208532248'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:23.912105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d51248862040cdb3d5fbb208532248'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:23.912874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d51248862040cdb3d5fbb208532248'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:23.913549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d51248862040cdb3d5fbb208532248'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:23.927672 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1413/2827] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:23 2022] DELETE /identity/v3/users/86d51248862040cdb3d5fbb208532248 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:23.983180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c6291-ca53-405b-8732-b146eb574d07 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:23.984743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d14c6291-ca53-405b-8732-b146eb574d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:24.073963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c6291-ca53-405b-8732-b146eb574d07 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:24.138991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:24.140261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:24.185636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaffc9-8cba-4eaf-afe1-ced6f41741a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:24.186561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaffc9-8cba-4eaf-afe1-ced6f41741a8 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.187900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaffc9-8cba-4eaf-afe1-ced6f41741a8 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.188428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaffc9-8cba-4eaf-afe1-ced6f41741a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.191471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fdaaffc9-8cba-4eaf-afe1-ced6f41741a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:24.233268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ef09-a649-4717-a1cc-d9b6eef662a7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:24.238693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:24.239757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.240273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.240795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] PATH_INFO: `/v3/projects/de5e39a92fe94f05bf371c31414cc390` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.242032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5e39a92fe94f05bf371c31414cc390)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:24.244026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:24.262667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaaffc9-8cba-4eaf-afe1-ced6f41741a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:24.265241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaaffc9-8cba-4eaf-afe1-ced6f41741a8 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:24.287159 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1415/2828] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:24.303606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5e39a92fe94f05bf371c31414cc390', 'request_id': 'req-639a3630-9ac8-4726-a10f-28dcac55847f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:24.327528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5e39a92fe94f05bf371c31414cc390', 'request_id': 'req-639a3630-9ac8-4726-a10f-28dcac55847f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:24.343278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5e39a92fe94f05bf371c31414cc390', 'request_id': 'req-639a3630-9ac8-4726-a10f-28dcac55847f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:24.373552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] The token cache is being invalidate because project de5e39a92fe94f05bf371c31414cc390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:24.373847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:24.374510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-639a3630-9ac8-4726-a10f-28dcac55847f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:24.376091 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1414/2829] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:24 2022] DELETE /identity/v3/projects/de5e39a92fe94f05bf371c31414cc390 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:24.381192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743271d1-ac19-4f42-87ef-1f0fda708890 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.381480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743271d1-ac19-4f42-87ef-1f0fda708890 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.381756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743271d1-ac19-4f42-87ef-1f0fda708890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.401688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-743271d1-ac19-4f42-87ef-1f0fda708890 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:24.403014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-743271d1-ac19-4f42-87ef-1f0fda708890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:24.465971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1416/2830] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:24.474602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59acc0a-f6ac-4dc9-b1c3-74189c844ee8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.475010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59acc0a-f6ac-4dc9-b1c3-74189c844ee8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.475552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59acc0a-f6ac-4dc9-b1c3-74189c844ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.494649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e59acc0a-f6ac-4dc9-b1c3-74189c844ee8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:24.495994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e59acc0a-f6ac-4dc9-b1c3-74189c844ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:24.504300 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1415/2831] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:54:24.508758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743271d1-ac19-4f42-87ef-1f0fda708890 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:24.518824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743271d1-ac19-4f42-87ef-1f0fda708890 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:24.524260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:24.524965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.525247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.525522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.526449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:54:24.526759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:24.528424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:24.541946 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1417/2832] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:54:24.546327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59acc0a-f6ac-4dc9-b1c3-74189c844ee8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:24.556182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59acc0a-f6ac-4dc9-b1c3-74189c844ee8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:24.561162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c9ad-af73-4012-9430-a495a3bd0a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:24.561838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c9ad-af73-4012-9430-a495a3bd0a6f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.562121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c9ad-af73-4012-9430-a495a3bd0a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.562398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c9ad-af73-4012-9430-a495a3bd0a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.563110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c9ad-af73-4012-9430-a495a3bd0a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:24.565110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c9ad-af73-4012-9430-a495a3bd0a6f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:24.599326 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1416/2833] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:24 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:24.603328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:24.614463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0770d5-5368-4918-a294-9d7caac738ca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:24.677013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab0173-e1dc-49fa-b82f-c456c505dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:24.678236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab0173-e1dc-49fa-b82f-c456c505dbde admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.678522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab0173-e1dc-49fa-b82f-c456c505dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.678803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab0173-e1dc-49fa-b82f-c456c505dbde admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.679534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab0173-e1dc-49fa-b82f-c456c505dbde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:24.681714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab0173-e1dc-49fa-b82f-c456c505dbde admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:24.706050 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1418/2834] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:24 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:24.710924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c9ad-af73-4012-9430-a495a3bd0a6f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:24.721094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c9ad-af73-4012-9430-a495a3bd0a6f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:24.726069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a765dbc-58fc-4cc4-919c-97ee6b223247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:24.727054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765dbc-58fc-4cc4-919c-97ee6b223247 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.727054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765dbc-58fc-4cc4-919c-97ee6b223247 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.727277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765dbc-58fc-4cc4-919c-97ee6b223247 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.728037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a765dbc-58fc-4cc4-919c-97ee6b223247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:24.730222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a765dbc-58fc-4cc4-919c-97ee6b223247 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:24.740854 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1417/2835] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:24.744413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab0173-e1dc-49fa-b82f-c456c505dbde admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:24.755759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab0173-e1dc-49fa-b82f-c456c505dbde admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:24.760894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91855bc-1246-471f-b077-96249adfcd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:24.761664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91855bc-1246-471f-b077-96249adfcd14 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.762052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91855bc-1246-471f-b077-96249adfcd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.762395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91855bc-1246-471f-b077-96249adfcd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.763187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91855bc-1246-471f-b077-96249adfcd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:24.764924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91855bc-1246-471f-b077-96249adfcd14 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:24.776322 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1419/2836] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:54:24.780571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a765dbc-58fc-4cc4-919c-97ee6b223247 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:24.790620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a765dbc-58fc-4cc4-919c-97ee6b223247 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:24.795416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:24.796289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.796595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.796865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] PATH_INFO: `/v3/projects/799dc988526740b99a2466ee6a7d21b9/users/cc44425712c34222a08a2937a3b3fba4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.811437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=799dc988526740b99a2466ee6a7d21b9, user_id=cc44425712c34222a08a2937a3b3fba4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:24.814132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:24.831543 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1418/2837] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:24 2022] PUT /identity/v3/projects/799dc988526740b99a2466ee6a7d21b9/users/cc44425712c34222a08a2937a3b3fba4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:54:24.908146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6639f3b-0761-4ae5-9c49-6825d4369e41 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:24.908492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6639f3b-0761-4ae5-9c49-6825d4369e41 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:24.908758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6639f3b-0761-4ae5-9c49-6825d4369e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:24.939044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b6639f3b-0761-4ae5-9c49-6825d4369e41 None None] MFA Rules not processed for user `cc44425712c34222a08a2937a3b3fba4`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:24.940456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b6639f3b-0761-4ae5-9c49-6825d4369e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:25.013461 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1420/2838] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:25.815244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:25.817951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:25.926503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ba7cd-6f06-4766-8e45-2ffa7c5424ec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:25.933250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba451-c0e5-404d-84e9-ba5fc134e9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:25.933900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba451-c0e5-404d-84e9-ba5fc134e9e9 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:25.934185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba451-c0e5-404d-84e9-ba5fc134e9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:25.934464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba451-c0e5-404d-84e9-ba5fc134e9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:25.943950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ba451-c0e5-404d-84e9-ba5fc134e9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:25.945834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ba451-c0e5-404d-84e9-ba5fc134e9e9 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:25.959139 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1419/2839] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:54:26.015850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6639f3b-0761-4ae5-9c49-6825d4369e41 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:26.088601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6639f3b-0761-4ae5-9c49-6825d4369e41 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:26.094484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:26.094724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:26.095069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:26.095414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] PATH_INFO: `/v3/users/cc44425712c34222a08a2937a3b3fba4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:26.096676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc44425712c34222a08a2937a3b3fba4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:26.099187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:26.151302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc44425712c34222a08a2937a3b3fba4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.151950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc44425712c34222a08a2937a3b3fba4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.152571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc44425712c34222a08a2937a3b3fba4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.165027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc44425712c34222a08a2937a3b3fba4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.173897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc44425712c34222a08a2937a3b3fba4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.186701 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1421/2840] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:26 2022] DELETE /identity/v3/users/cc44425712c34222a08a2937a3b3fba4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:26.191898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8ebd-e351-436e-974e-8a9aea4a2ecd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:26.192193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8ebd-e351-436e-974e-8a9aea4a2ecd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:26.192500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8ebd-e351-436e-974e-8a9aea4a2ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:26.210914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-885c8ebd-e351-436e-974e-8a9aea4a2ecd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:26.212394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-885c8ebd-e351-436e-974e-8a9aea4a2ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:26.324179 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1420/2841] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:26.336761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:26.338436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:26.418864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37abeb2-ad78-4271-9abd-ac3926d3cd42 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:26.423009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b63e4b-9a39-472d-8be0-f34973d14791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:26.423928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63e4b-9a39-472d-8be0-f34973d14791 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:26.424433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63e4b-9a39-472d-8be0-f34973d14791 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:26.424918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63e4b-9a39-472d-8be0-f34973d14791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:26.436701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b63e4b-9a39-472d-8be0-f34973d14791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:26.438490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b63e4b-9a39-472d-8be0-f34973d14791 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:26.449719 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1422/2842] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:54:26.743100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8ebd-e351-436e-974e-8a9aea4a2ecd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:26.744548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-885c8ebd-e351-436e-974e-8a9aea4a2ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:26.764544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8ebd-e351-436e-974e-8a9aea4a2ecd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:26.775258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:26.776139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:26.776472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:26.776772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] PATH_INFO: `/v3/projects/799dc988526740b99a2466ee6a7d21b9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:26.778024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=799dc988526740b99a2466ee6a7d21b9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:26.779948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:26.831630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799dc988526740b99a2466ee6a7d21b9', 'request_id': 'req-fbeba349-6656-4e40-92ed-4e067fe58d1c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.837579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799dc988526740b99a2466ee6a7d21b9', 'request_id': 'req-fbeba349-6656-4e40-92ed-4e067fe58d1c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.845612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799dc988526740b99a2466ee6a7d21b9', 'request_id': 'req-fbeba349-6656-4e40-92ed-4e067fe58d1c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.859034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] The token cache is being invalidate because project 799dc988526740b99a2466ee6a7d21b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:26.859323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.860020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fbeba349-6656-4e40-92ed-4e067fe58d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:26.861782 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1421/2843] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:26 2022] DELETE /identity/v3/projects/799dc988526740b99a2466ee6a7d21b9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:26.868317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263011-92b5-43a8-abef-6cba88b60a44 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:26.868639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263011-92b5-43a8-abef-6cba88b60a44 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:26.868922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263011-92b5-43a8-abef-6cba88b60a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:26.893803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-79263011-92b5-43a8-abef-6cba88b60a44 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:26.895229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-79263011-92b5-43a8-abef-6cba88b60a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:26.969178 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1423/2844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:26.977838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c897c-08c8-408a-baf4-c614aa521019 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:26.978121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c897c-08c8-408a-baf4-c614aa521019 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:26.979281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c897c-08c8-408a-baf4-c614aa521019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:27.005541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e87c897c-08c8-408a-baf4-c614aa521019 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:27.006742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e87c897c-08c8-408a-baf4-c614aa521019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:27.015290 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1422/2845] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:27.019433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79263011-92b5-43a8-abef-6cba88b60a44 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:27.030310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79263011-92b5-43a8-abef-6cba88b60a44 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:27.035610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:27.036269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:27.036579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:27.036858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:27.037580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:54:27.037888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:27.039478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:27.055849 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1424/2846] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:54:27.060907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c897c-08c8-408a-baf4-c614aa521019 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:27.071736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c897c-08c8-408a-baf4-c614aa521019 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:27.077637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ccb3-5707-4068-98bc-6edc19700e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:27.078592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ccb3-5707-4068-98bc-6edc19700e6f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:27.078880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ccb3-5707-4068-98bc-6edc19700e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:27.079202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ccb3-5707-4068-98bc-6edc19700e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:27.080214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ccb3-5707-4068-98bc-6edc19700e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:27.083585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ccb3-5707-4068-98bc-6edc19700e6f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:27.115274 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1423/2847] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:27 2022] POST /identity/v3/projects => generated 395 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:27.120403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:27.133156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe42e8-43f3-40ea-9799-708fab442a98 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:27.213960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c203c-ee5e-406d-ae42-b2d1c1a5eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:27.214637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c203c-ee5e-406d-ae42-b2d1c1a5eb96 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:27.215104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c203c-ee5e-406d-ae42-b2d1c1a5eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:27.215575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c203c-ee5e-406d-ae42-b2d1c1a5eb96 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:27.216475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c203c-ee5e-406d-ae42-b2d1c1a5eb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:27.218570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c203c-ee5e-406d-ae42-b2d1c1a5eb96 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:27.252061 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1425/2848] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:27 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:27.256240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ccb3-5707-4068-98bc-6edc19700e6f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:27.276251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ccb3-5707-4068-98bc-6edc19700e6f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:27.293545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8459311-c9f2-48ec-bc5c-bc6b2af4b7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:27.294710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8459311-c9f2-48ec-bc5c-bc6b2af4b7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:27.295947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8459311-c9f2-48ec-bc5c-bc6b2af4b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:27.296504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8459311-c9f2-48ec-bc5c-bc6b2af4b7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:27.297640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8459311-c9f2-48ec-bc5c-bc6b2af4b7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:27.299756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8459311-c9f2-48ec-bc5c-bc6b2af4b7b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:27.317575 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1424/2849] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:27.321538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c203c-ee5e-406d-ae42-b2d1c1a5eb96 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:27.332986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c203c-ee5e-406d-ae42-b2d1c1a5eb96 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:27.338584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc30965-2a6a-4a89-849b-247d3136d3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:27.339258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc30965-2a6a-4a89-849b-247d3136d3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:27.339630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc30965-2a6a-4a89-849b-247d3136d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:27.339921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc30965-2a6a-4a89-849b-247d3136d3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:27.340706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc30965-2a6a-4a89-849b-247d3136d3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:27.342515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc30965-2a6a-4a89-849b-247d3136d3a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:27.354527 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1426/2850] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:54:27.358424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8459311-c9f2-48ec-bc5c-bc6b2af4b7b7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:27.369422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8459311-c9f2-48ec-bc5c-bc6b2af4b7b7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:27.374883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:27.375854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:27.376117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:27.376904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] PATH_INFO: `/v3/projects/8c0b0cac9d204f91b873271c7ced6fb3/users/b619186490cd489d854ec0ad316b5361/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:27.393757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0b0cac9d204f91b873271c7ced6fb3, user_id=b619186490cd489d854ec0ad316b5361, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:27.397985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:27.419623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1425/2851] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:27 2022] PUT /identity/v3/projects/8c0b0cac9d204f91b873271c7ced6fb3/users/b619186490cd489d854ec0ad316b5361/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:27.431600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9a54-b273-4278-a5d4-3fe3a7628336 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:27.431897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9a54-b273-4278-a5d4-3fe3a7628336 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:27.432518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9a54-b273-4278-a5d4-3fe3a7628336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:27.465256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-465e9a54-b273-4278-a5d4-3fe3a7628336 None None] MFA Rules not processed for user `b619186490cd489d854ec0ad316b5361`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:27.466564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-465e9a54-b273-4278-a5d4-3fe3a7628336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:27.536147 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1427/2852] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:28.098233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:28.101804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:28.242661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4dcc-4fb8-4489-8713-43b7fb6519da admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:28.250598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31247277-b025-41e7-a8a8-c85453599e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:28.251422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31247277-b025-41e7-a8a8-c85453599e8a service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:28.251934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31247277-b025-41e7-a8a8-c85453599e8a service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:28.252585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31247277-b025-41e7-a8a8-c85453599e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:28.268678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31247277-b025-41e7-a8a8-c85453599e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:28.273075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31247277-b025-41e7-a8a8-c85453599e8a service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:28.298711 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1426/2853] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:28.358786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d11d0-7aed-48e3-9f32-cea3d0f64be9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:28.359411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d11d0-7aed-48e3-9f32-cea3d0f64be9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:28.360547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d11d0-7aed-48e3-9f32-cea3d0f64be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:28.417446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f63d11d0-7aed-48e3-9f32-cea3d0f64be9 None None] MFA Rules not processed for user `b619186490cd489d854ec0ad316b5361`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:28.421011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f63d11d0-7aed-48e3-9f32-cea3d0f64be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:28.439806 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1428/2854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:29.350752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31247277-b025-41e7-a8a8-c85453599e8a service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:29.437538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31247277-b025-41e7-a8a8-c85453599e8a service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:29.443894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:29.445096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:29.445577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:29.446017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] PATH_INFO: `/v3/users/b619186490cd489d854ec0ad316b5361` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:29.447823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b619186490cd489d854ec0ad316b5361)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:29.450028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:29.526216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b619186490cd489d854ec0ad316b5361'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:29.545386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b619186490cd489d854ec0ad316b5361'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:29.556532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b619186490cd489d854ec0ad316b5361'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:29.557557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b619186490cd489d854ec0ad316b5361'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:29.558401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b619186490cd489d854ec0ad316b5361'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:29.578418 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1427/2855] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:29 2022] DELETE /identity/v3/users/b619186490cd489d854ec0ad316b5361 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:29.586066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ba15d-4905-4165-ab65-7de53db941cd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:29.586982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ba15d-4905-4165-ab65-7de53db941cd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:29.587601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ba15d-4905-4165-ab65-7de53db941cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:29.615906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-813ba15d-4905-4165-ab65-7de53db941cd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:29.617831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-813ba15d-4905-4165-ab65-7de53db941cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:29.715238 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1429/2856] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:29.723189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:29.729700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:29.818701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e66034-bd6c-4c97-8215-e25c6f4852c4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:29.827875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964e655-00cf-4e4b-bdfe-5b6e91d3da1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:29.829337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e655-00cf-4e4b-bdfe-5b6e91d3da1b service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:29.829858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e655-00cf-4e4b-bdfe-5b6e91d3da1b service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:29.831021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e655-00cf-4e4b-bdfe-5b6e91d3da1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:29.852748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964e655-00cf-4e4b-bdfe-5b6e91d3da1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:29.854472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964e655-00cf-4e4b-bdfe-5b6e91d3da1b service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:29.873639 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1428/2857] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:31.229887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ba15d-4905-4165-ab65-7de53db941cd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:31.231854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-813ba15d-4905-4165-ab65-7de53db941cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:31.247806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ba15d-4905-4165-ab65-7de53db941cd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:31.254621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:31.255713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:31.256147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:31.256674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] PATH_INFO: `/v3/projects/8c0b0cac9d204f91b873271c7ced6fb3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:31.262482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0b0cac9d204f91b873271c7ced6fb3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:31.265036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:31.382242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0b0cac9d204f91b873271c7ced6fb3', 'request_id': 'req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:31.392506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0b0cac9d204f91b873271c7ced6fb3', 'request_id': 'req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:31.413297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0b0cac9d204f91b873271c7ced6fb3', 'request_id': 'req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:31.451114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] The token cache is being invalidate because project 8c0b0cac9d204f91b873271c7ced6fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:31.451480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:31.452677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6026ad40-86a5-4bde-8f5d-7237db6b3ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:31.461466 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1430/2858] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:31 2022] DELETE /identity/v3/projects/8c0b0cac9d204f91b873271c7ced6fb3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:31.464523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739b3f-4a75-436f-8724-b999b38ce187 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:31.464994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739b3f-4a75-436f-8724-b999b38ce187 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:31.465110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739b3f-4a75-436f-8724-b999b38ce187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:31.505481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ca739b3f-4a75-436f-8724-b999b38ce187 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:31.506857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ca739b3f-4a75-436f-8724-b999b38ce187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:31.608251 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1429/2859] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:31.610826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1db5-0b34-437d-b918-145dff738e32 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:31.611159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1db5-0b34-437d-b918-145dff738e32 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:31.611437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1db5-0b34-437d-b918-145dff738e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:31.652118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-799d1db5-0b34-437d-b918-145dff738e32 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:31.654029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-799d1db5-0b34-437d-b918-145dff738e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:31.686271 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1431/2860] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:31.690058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca739b3f-4a75-436f-8724-b999b38ce187 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:31.717358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca739b3f-4a75-436f-8724-b999b38ce187 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:31.729883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:31.730648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:31.730939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:31.731224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:31.737716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:54:31.738613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:31.742506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:31.774740 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1430/2861] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:54:31.779462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d1db5-0b34-437d-b918-145dff738e32 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:31.794261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d1db5-0b34-437d-b918-145dff738e32 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:31.802908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda158-5641-4ff1-bed5-07c09f0aecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:31.803735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda158-5641-4ff1-bed5-07c09f0aecd4 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:31.804137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda158-5641-4ff1-bed5-07c09f0aecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:31.804885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda158-5641-4ff1-bed5-07c09f0aecd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:31.805660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afda158-5641-4ff1-bed5-07c09f0aecd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:31.811691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afda158-5641-4ff1-bed5-07c09f0aecd4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:31.875201 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1432/2862] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:31 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:31.876467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:31.896808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce4e2b-c65e-4474-98f3-d79609704ef6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:32.038054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d49582-598d-4bab-80e0-df7595160a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:32.038658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d49582-598d-4bab-80e0-df7595160a21 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:32.038943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d49582-598d-4bab-80e0-df7595160a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:32.039222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d49582-598d-4bab-80e0-df7595160a21 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:32.039965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d49582-598d-4bab-80e0-df7595160a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:32.042165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d49582-598d-4bab-80e0-df7595160a21 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:32.086378 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1431/2863] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:31 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:32.090641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda158-5641-4ff1-bed5-07c09f0aecd4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:32.107027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda158-5641-4ff1-bed5-07c09f0aecd4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:32.117153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0e08-d5f1-4c0c-a402-c3f3a85b2fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:32.117839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0e08-d5f1-4c0c-a402-c3f3a85b2fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:32.118122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0e08-d5f1-4c0c-a402-c3f3a85b2fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:32.118405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0e08-d5f1-4c0c-a402-c3f3a85b2fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:32.119137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af0e08-d5f1-4c0c-a402-c3f3a85b2fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:32.120892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af0e08-d5f1-4c0c-a402-c3f3a85b2fb9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:32.155104 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1433/2864] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:32.156225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d49582-598d-4bab-80e0-df7595160a21 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:32.176395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d49582-598d-4bab-80e0-df7595160a21 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:32.191344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd61013-b49d-45a7-9756-68ec97e42d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:32.192296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61013-b49d-45a7-9756-68ec97e42d12 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:32.192818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61013-b49d-45a7-9756-68ec97e42d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:32.193346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61013-b49d-45a7-9756-68ec97e42d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:32.194293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd61013-b49d-45a7-9756-68ec97e42d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:32.198067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd61013-b49d-45a7-9756-68ec97e42d12 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:32.228230 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1432/2865] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:32.229561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0e08-d5f1-4c0c-a402-c3f3a85b2fb9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:32.249560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0e08-d5f1-4c0c-a402-c3f3a85b2fb9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:32.265415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:32.266319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:32.266603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:32.266886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] PATH_INFO: `/v3/projects/29dd33f3e21c4153b2dc5ec75558b150/users/40515f5be4664c98a06359ae852e7b84/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:32.283916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29dd33f3e21c4153b2dc5ec75558b150, user_id=40515f5be4664c98a06359ae852e7b84, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:32.287754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:32.306188 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1434/2866] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:32 2022] PUT /identity/v3/projects/29dd33f3e21c4153b2dc5ec75558b150/users/40515f5be4664c98a06359ae852e7b84/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:54:32.311763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b589b-c1df-480a-ace6-04f291083cd9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:32.312316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b589b-c1df-480a-ace6-04f291083cd9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:32.312763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b589b-c1df-480a-ace6-04f291083cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:32.332061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-af9b589b-c1df-480a-ace6-04f291083cd9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:32.335792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-af9b589b-c1df-480a-ace6-04f291083cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:32.408414 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1433/2867] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:32.430644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:32.432970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:32.503062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e67b2-2304-485d-a1e6-e7f05fa223f8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:32.507012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7187c-57ac-42a5-81f1-8bab604e51ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:32.507664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7187c-57ac-42a5-81f1-8bab604e51ec service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:32.507948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7187c-57ac-42a5-81f1-8bab604e51ec service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:32.508225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7187c-57ac-42a5-81f1-8bab604e51ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:32.518549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7187c-57ac-42a5-81f1-8bab604e51ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:32.520604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7187c-57ac-42a5-81f1-8bab604e51ec service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:32.535772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1435/2868] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:35.403464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2002-0e84-4b93-b318-0c384cc173af None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:35.404018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2002-0e84-4b93-b318-0c384cc173af None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:35.404273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2002-0e84-4b93-b318-0c384cc173af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:35.460472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-317f2002-0e84-4b93-b318-0c384cc173af None None] MFA Rules not processed for user `40515f5be4664c98a06359ae852e7b84`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:35.462353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-317f2002-0e84-4b93-b318-0c384cc173af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:35.589422 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1434/2869] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:35.597761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589138-b198-4c06-933c-5fdf8bee27a5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:35.598311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589138-b198-4c06-933c-5fdf8bee27a5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:35.598636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589138-b198-4c06-933c-5fdf8bee27a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:35.619597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b1589138-b198-4c06-933c-5fdf8bee27a5 None None] MFA Rules not processed for user `40515f5be4664c98a06359ae852e7b84`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:35.620853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b1589138-b198-4c06-933c-5fdf8bee27a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:35.630323 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1436/2870] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:36.275945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f2002-0e84-4b93-b318-0c384cc173af None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:36.278329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-317f2002-0e84-4b93-b318-0c384cc173af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:36.387289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f2002-0e84-4b93-b318-0c384cc173af None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:36.395756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3526f02-4078-499a-92b1-501bb487ffd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:36.396498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526f02-4078-499a-92b1-501bb487ffd0 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:36.396786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526f02-4078-499a-92b1-501bb487ffd0 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:36.397057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526f02-4078-499a-92b1-501bb487ffd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:36.411046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3526f02-4078-499a-92b1-501bb487ffd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:36.412692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3526f02-4078-499a-92b1-501bb487ffd0 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:36.434697 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1435/2871] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:36.743589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589138-b198-4c06-933c-5fdf8bee27a5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:36.746510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b1589138-b198-4c06-933c-5fdf8bee27a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:36.763135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589138-b198-4c06-933c-5fdf8bee27a5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:36.767679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:36.768789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:36.769885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:36.770158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] PATH_INFO: `/v3/users/d0a4a7cd3a234092987f7fb637c91e38` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:36.771341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a4a7cd3a234092987f7fb637c91e38)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:36.773344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:36.820609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a4a7cd3a234092987f7fb637c91e38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:36.821206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a4a7cd3a234092987f7fb637c91e38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:36.821842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a4a7cd3a234092987f7fb637c91e38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:36.834131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a4a7cd3a234092987f7fb637c91e38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:36.844943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eca32204-192b-43e9-90e8-e6d057192ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a4a7cd3a234092987f7fb637c91e38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:36.857859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1437/2872] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:36 2022] DELETE /identity/v3/users/d0a4a7cd3a234092987f7fb637c91e38 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:37.092234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3526f02-4078-499a-92b1-501bb487ffd0 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:37.105782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3526f02-4078-499a-92b1-501bb487ffd0 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:37.168056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:37.169297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.169747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.170177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] PATH_INFO: `/v3/projects/869a0cf6b5604ec89af633eb5012ff5b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.171579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869a0cf6b5604ec89af633eb5012ff5b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:37.173711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:37.226272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869a0cf6b5604ec89af633eb5012ff5b', 'request_id': 'req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:37.232737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869a0cf6b5604ec89af633eb5012ff5b', 'request_id': 'req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:37.240900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869a0cf6b5604ec89af633eb5012ff5b', 'request_id': 'req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:37.252522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] The token cache is being invalidate because project 869a0cf6b5604ec89af633eb5012ff5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:37.253125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:37.253873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9a85e62f-3b50-4d7e-bf5d-c8525cde8223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:37.255633 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1436/2873] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:37 2022] DELETE /identity/v3/projects/869a0cf6b5604ec89af633eb5012ff5b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:37.260697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328df900-70e6-48cf-95bd-4664e70d4ef9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.261079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328df900-70e6-48cf-95bd-4664e70d4ef9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.261568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328df900-70e6-48cf-95bd-4664e70d4ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.280746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-328df900-70e6-48cf-95bd-4664e70d4ef9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:37.282083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-328df900-70e6-48cf-95bd-4664e70d4ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:37.369534 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1438/2874] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:37.377553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a83d9-4b72-42cb-b8a6-08b70e5cac66 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.378071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a83d9-4b72-42cb-b8a6-08b70e5cac66 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.379059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a83d9-4b72-42cb-b8a6-08b70e5cac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.401404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dd5a83d9-4b72-42cb-b8a6-08b70e5cac66 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:37.403744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd5a83d9-4b72-42cb-b8a6-08b70e5cac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:37.415398 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1437/2875] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:37.420401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328df900-70e6-48cf-95bd-4664e70d4ef9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:37.432668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328df900-70e6-48cf-95bd-4664e70d4ef9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:37.438918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:37.439888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.440437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.441597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.442843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:54:37.443373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:37.445384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:37.460637 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1439/2876] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:54:37.464674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a83d9-4b72-42cb-b8a6-08b70e5cac66 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:37.474510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a83d9-4b72-42cb-b8a6-08b70e5cac66 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:37.480139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866fc5a-8c35-4086-a726-322d89ecd8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:37.481039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866fc5a-8c35-4086-a726-322d89ecd8dc admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.481930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866fc5a-8c35-4086-a726-322d89ecd8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.482379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866fc5a-8c35-4086-a726-322d89ecd8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.483425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866fc5a-8c35-4086-a726-322d89ecd8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:37.485554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866fc5a-8c35-4086-a726-322d89ecd8dc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:37.540577 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1438/2877] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:37 2022] POST /identity/v3/projects => generated 395 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:37.544166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:37.556472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa189832-ef2f-48e7-992f-edf9a085dc2c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:37.631862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fdd8c-e003-441e-899b-05ae8f851648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:37.632823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fdd8c-e003-441e-899b-05ae8f851648 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.633174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fdd8c-e003-441e-899b-05ae8f851648 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.633524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fdd8c-e003-441e-899b-05ae8f851648 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.634489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fdd8c-e003-441e-899b-05ae8f851648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:37.637225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fdd8c-e003-441e-899b-05ae8f851648 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:37.669230 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1440/2878] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:37 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:37.673278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866fc5a-8c35-4086-a726-322d89ecd8dc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:37.685306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866fc5a-8c35-4086-a726-322d89ecd8dc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:37.694628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7a0ae-04ce-448c-9ee8-297ea5ffaedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:37.696390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7a0ae-04ce-448c-9ee8-297ea5ffaedf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.696390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7a0ae-04ce-448c-9ee8-297ea5ffaedf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.696390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7a0ae-04ce-448c-9ee8-297ea5ffaedf admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.700290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7a0ae-04ce-448c-9ee8-297ea5ffaedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:37.700290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7a0ae-04ce-448c-9ee8-297ea5ffaedf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:37.712948 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1439/2879] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:54:37.716733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fdd8c-e003-441e-899b-05ae8f851648 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:37.728742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fdd8c-e003-441e-899b-05ae8f851648 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:37.747686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a36153-170f-480e-928c-35aac98b4522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:37.750674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36153-170f-480e-928c-35aac98b4522 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.752908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36153-170f-480e-928c-35aac98b4522 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.755731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36153-170f-480e-928c-35aac98b4522 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.759474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a36153-170f-480e-928c-35aac98b4522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:37.764159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a36153-170f-480e-928c-35aac98b4522 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:37.788858 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1441/2880] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:37.793212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7a0ae-04ce-448c-9ee8-297ea5ffaedf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:37.811616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7a0ae-04ce-448c-9ee8-297ea5ffaedf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:37.826718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:37.827638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.827925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.828205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] PATH_INFO: `/v3/projects/7b55ec03cf7e44ae93a098de85e466aa/users/7c79863efa6f43239352d85a59f69ed9/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.861083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b55ec03cf7e44ae93a098de85e466aa, user_id=7c79863efa6f43239352d85a59f69ed9, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:37.862849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:37.905926 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1440/2881] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:37 2022] PUT /identity/v3/projects/7b55ec03cf7e44ae93a098de85e466aa/users/7c79863efa6f43239352d85a59f69ed9/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:54:37.917512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d37560-0890-4374-adef-ef8fe79a1fdc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:37.918134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d37560-0890-4374-adef-ef8fe79a1fdc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:37.918708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d37560-0890-4374-adef-ef8fe79a1fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:37.980029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-33d37560-0890-4374-adef-ef8fe79a1fdc None None] MFA Rules not processed for user `7c79863efa6f43239352d85a59f69ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:37.981309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-33d37560-0890-4374-adef-ef8fe79a1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:38.068440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1442/2882] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:38.986800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:38.989416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:39.068190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fbfbb-6316-4c57-ad65-45f4d9429336 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:39.074595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:39.075497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:39.076010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:39.076292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:39.085255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:39.086947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:39.096223 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1441/2883] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:54:39.551002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f39bb-c2bc-4a3e-bf31-f611c2b99ace None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:39.551902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f39bb-c2bc-4a3e-bf31-f611c2b99ace None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:39.552181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f39bb-c2bc-4a3e-bf31-f611c2b99ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:39.571404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e94f39bb-c2bc-4a3e-bf31-f611c2b99ace None None] MFA Rules not processed for user `c26bc5048c9849218cadd12475cd5fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:39.572668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e94f39bb-c2bc-4a3e-bf31-f611c2b99ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:39.633282 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1443/2884] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:43.509446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:43.510970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:43.609444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515bafb-7fd3-4b21-bcb4-2ab0b44a842f service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:43.629025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:43.633324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:43.633848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:43.634504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] PATH_INFO: `/v3/users/1fc7244fbf3b4298b92daf9e442fe669` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:43.637606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc7244fbf3b4298b92daf9e442fe669)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:43.640044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:43.718745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc7244fbf3b4298b92daf9e442fe669'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:43.751878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc7244fbf3b4298b92daf9e442fe669'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:43.781551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc7244fbf3b4298b92daf9e442fe669'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:43.782453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc7244fbf3b4298b92daf9e442fe669'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:43.783349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-60991e34-6a7b-4549-89c6-7274e5666496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc7244fbf3b4298b92daf9e442fe669'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:43.808898 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1442/2885] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:43 2022] DELETE /identity/v3/users/1fc7244fbf3b4298b92daf9e442fe669 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:44.047428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f39bb-c2bc-4a3e-bf31-f611c2b99ace None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:44.087311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f39bb-c2bc-4a3e-bf31-f611c2b99ace None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:44.233612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:44.234950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:44.235509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:44.236236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] PATH_INFO: `/v3/projects/04d2b5b9a01e4133b1f4f7f351cf0c0a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:44.238904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d2b5b9a01e4133b1f4f7f351cf0c0a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:44.241249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:44.339259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'request_id': 'req-67e40e71-51f4-4993-ab96-95d4987e8178'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.344828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'request_id': 'req-67e40e71-51f4-4993-ab96-95d4987e8178'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.350692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9aed-b6bd-4215-a44c-67752f9ec381 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:44.350973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9aed-b6bd-4215-a44c-67752f9ec381 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:44.351458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9aed-b6bd-4215-a44c-67752f9ec381 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:44.353589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1443/2886] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:54:44.362203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e313a-88dd-440c-9b10-413e2a0e1dfe None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:44.362414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'request_id': 'req-67e40e71-51f4-4993-ab96-95d4987e8178'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.362543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e313a-88dd-440c-9b10-413e2a0e1dfe None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:44.363356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e313a-88dd-440c-9b10-413e2a0e1dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:44.387459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] The token cache is being invalidate because project 04d2b5b9a01e4133b1f4f7f351cf0c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:44.387665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-732e313a-88dd-440c-9b10-413e2a0e1dfe None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:44.388122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.388691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-732e313a-88dd-440c-9b10-413e2a0e1dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:44.391417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.395156 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1444/2887] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:44 2022] DELETE /identity/v3/projects/04d2b5b9a01e4133b1f4f7f351cf0c0a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:44.399343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:44.401551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:44.486031 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1444/2888] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:54:44.497280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e313a-88dd-440c-9b10-413e2a0e1dfe None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:44.498809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-732e313a-88dd-440c-9b10-413e2a0e1dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:44.515387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e313a-88dd-440c-9b10-413e2a0e1dfe None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:44.522599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54722-61e3-49aa-b915-5ccf25a452c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:44.523345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54722-61e3-49aa-b915-5ccf25a452c7 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:44.523696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54722-61e3-49aa-b915-5ccf25a452c7 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:44.524146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54722-61e3-49aa-b915-5ccf25a452c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:44.534661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da54722-61e3-49aa-b915-5ccf25a452c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:44.536279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40e71-51f4-4993-ab96-95d4987e8178 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:44.537625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da54722-61e3-49aa-b915-5ccf25a452c7 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:44.541472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:44.542950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:44.543237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:44.543598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] PATH_INFO: `/v3/users/65d81e6c7c1640eca1aa9fd51510f6ce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:44.545046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d81e6c7c1640eca1aa9fd51510f6ce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:44.546985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:44.575034 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1445/2889] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:44.616108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d81e6c7c1640eca1aa9fd51510f6ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.617429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d81e6c7c1640eca1aa9fd51510f6ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.620815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d81e6c7c1640eca1aa9fd51510f6ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.651257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d81e6c7c1640eca1aa9fd51510f6ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.665702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-52e6863b-809e-489b-a98a-a8e4851ee87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d81e6c7c1640eca1aa9fd51510f6ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:44.696390 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1445/2890] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:44 2022] DELETE /identity/v3/users/65d81e6c7c1640eca1aa9fd51510f6ce => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:45.078167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54722-61e3-49aa-b915-5ccf25a452c7 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:45.093344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54722-61e3-49aa-b915-5ccf25a452c7 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:45.215648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:45.217192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.217981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.218520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] PATH_INFO: `/v3/projects/468c5e5a1f98468ba44fa46e65bdbede` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.220288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468c5e5a1f98468ba44fa46e65bdbede)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:45.223301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:45.285662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468c5e5a1f98468ba44fa46e65bdbede', 'request_id': 'req-1e944538-f05f-41a5-8104-a9c922784561'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:45.293106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468c5e5a1f98468ba44fa46e65bdbede', 'request_id': 'req-1e944538-f05f-41a5-8104-a9c922784561'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:45.301816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468c5e5a1f98468ba44fa46e65bdbede', 'request_id': 'req-1e944538-f05f-41a5-8104-a9c922784561'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:45.321612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] The token cache is being invalidate because project 468c5e5a1f98468ba44fa46e65bdbede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:45.321919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:45.322666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1e944538-f05f-41a5-8104-a9c922784561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:45.324531 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1446/2891] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:45 2022] DELETE /identity/v3/projects/468c5e5a1f98468ba44fa46e65bdbede => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:45.336482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9068a-87f8-460b-beee-eb62c51497e9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.337405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9068a-87f8-460b-beee-eb62c51497e9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.337773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9068a-87f8-460b-beee-eb62c51497e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.360507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b5f9068a-87f8-460b-beee-eb62c51497e9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:45.361773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b5f9068a-87f8-460b-beee-eb62c51497e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:45.467213 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1446/2892] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:45.469084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b66c-0c97-4fe6-b6a9-e624da5357dd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.469377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b66c-0c97-4fe6-b6a9-e624da5357dd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.469865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b66c-0c97-4fe6-b6a9-e624da5357dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.491125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e406b66c-0c97-4fe6-b6a9-e624da5357dd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:45.492570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e406b66c-0c97-4fe6-b6a9-e624da5357dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:45.509538 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1447/2893] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:45.514065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9068a-87f8-460b-beee-eb62c51497e9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:45.525584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9068a-87f8-460b-beee-eb62c51497e9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:45.530911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:45.531613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.531889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.532367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.533164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:54:45.533475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:45.535764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:45.549528 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1447/2894] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:54:45.554498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406b66c-0c97-4fe6-b6a9-e624da5357dd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:45.564793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406b66c-0c97-4fe6-b6a9-e624da5357dd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:45.570397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67384bef-0eb2-4d9b-84e3-e7f4fa2237ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:45.571345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67384bef-0eb2-4d9b-84e3-e7f4fa2237ae admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.571812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67384bef-0eb2-4d9b-84e3-e7f4fa2237ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.572240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67384bef-0eb2-4d9b-84e3-e7f4fa2237ae admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.573131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67384bef-0eb2-4d9b-84e3-e7f4fa2237ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:45.575206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67384bef-0eb2-4d9b-84e3-e7f4fa2237ae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:45.607575 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1448/2895] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:45 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:54:45.612479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:45.628377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5be4-bb31-4674-8d12-79521eaf8613 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:45.712635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6fae-2410-4e94-acc9-aa2cf02068d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:45.713860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6fae-2410-4e94-acc9-aa2cf02068d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.714282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6fae-2410-4e94-acc9-aa2cf02068d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.714563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6fae-2410-4e94-acc9-aa2cf02068d7 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.715257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf6fae-2410-4e94-acc9-aa2cf02068d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:45.717320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf6fae-2410-4e94-acc9-aa2cf02068d7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:45.752686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67384bef-0eb2-4d9b-84e3-e7f4fa2237ae admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:45.760568 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1448/2896] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:45 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:45.792858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67384bef-0eb2-4d9b-84e3-e7f4fa2237ae admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:45.799518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41429cfa-801f-4faf-a845-b37571f79773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:45.801321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41429cfa-801f-4faf-a845-b37571f79773 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.801869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41429cfa-801f-4faf-a845-b37571f79773 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.802368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41429cfa-801f-4faf-a845-b37571f79773 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.803606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41429cfa-801f-4faf-a845-b37571f79773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:45.806190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41429cfa-801f-4faf-a845-b37571f79773 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:45.820531 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1449/2897] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:45.825277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6fae-2410-4e94-acc9-aa2cf02068d7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:45.843006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6fae-2410-4e94-acc9-aa2cf02068d7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:45.849356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4935d-d90b-4bc0-b853-f8169b4a10ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:45.850022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4935d-d90b-4bc0-b853-f8169b4a10ff admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.850474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4935d-d90b-4bc0-b853-f8169b4a10ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.850625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4935d-d90b-4bc0-b853-f8169b4a10ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.851359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4935d-d90b-4bc0-b853-f8169b4a10ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:45.853051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4935d-d90b-4bc0-b853-f8169b4a10ff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:45.865050 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1449/2898] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:45.869507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41429cfa-801f-4faf-a845-b37571f79773 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:45.882306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41429cfa-801f-4faf-a845-b37571f79773 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:45.890566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527dd5b-296e-4370-bcef-f7b88364e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:45.891522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527dd5b-296e-4370-bcef-f7b88364e718 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.891874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527dd5b-296e-4370-bcef-f7b88364e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.892205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527dd5b-296e-4370-bcef-f7b88364e718 admin admin] PATH_INFO: `/v3/projects/756e52c91ebf4bc9bacebcc1431abb28/users/076a0cb931aa4bcd8c4b4d95c387fb4c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:45.921092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527dd5b-296e-4370-bcef-f7b88364e718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756e52c91ebf4bc9bacebcc1431abb28, user_id=076a0cb931aa4bcd8c4b4d95c387fb4c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:45.924656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527dd5b-296e-4370-bcef-f7b88364e718 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:45.952321 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1450/2899] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:45 2022] PUT /identity/v3/projects/756e52c91ebf4bc9bacebcc1431abb28/users/076a0cb931aa4bcd8c4b4d95c387fb4c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:54:45.965748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216653-1b78-4134-9333-a23068e485c0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:45.966036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216653-1b78-4134-9333-a23068e485c0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:45.966751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216653-1b78-4134-9333-a23068e485c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:46.027655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-86216653-1b78-4134-9333-a23068e485c0 None None] MFA Rules not processed for user `076a0cb931aa4bcd8c4b4d95c387fb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:46.029684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-86216653-1b78-4134-9333-a23068e485c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:46.154058 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1450/2900] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:46.155249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527dd5b-296e-4370-bcef-f7b88364e718 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:46.327034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527dd5b-296e-4370-bcef-f7b88364e718 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:46.334409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980256c-be14-45df-b706-d2b5e52bca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:46.335338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980256c-be14-45df-b706-d2b5e52bca86 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:46.335822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980256c-be14-45df-b706-d2b5e52bca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:46.336361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980256c-be14-45df-b706-d2b5e52bca86 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:46.337225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980256c-be14-45df-b706-d2b5e52bca86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:46.341274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980256c-be14-45df-b706-d2b5e52bca86 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:46.392024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1451/2901] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:46 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:46.397196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216653-1b78-4134-9333-a23068e485c0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:46.412155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216653-1b78-4134-9333-a23068e485c0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:46.556825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc988d-984d-4c78-884b-a38541963fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:46.557701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc988d-984d-4c78-884b-a38541963fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:46.557985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc988d-984d-4c78-884b-a38541963fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:46.558266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc988d-984d-4c78-884b-a38541963fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:46.559207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc988d-984d-4c78-884b-a38541963fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:46.561811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc988d-984d-4c78-884b-a38541963fe4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:46.601041 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1451/2902] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:46 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:46.604797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980256c-be14-45df-b706-d2b5e52bca86 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:46.617152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980256c-be14-45df-b706-d2b5e52bca86 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:46.622421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2abe-1fe8-4e41-b9f6-1fb359989f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:46.623164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2abe-1fe8-4e41-b9f6-1fb359989f0a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:46.623672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2abe-1fe8-4e41-b9f6-1fb359989f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:46.624079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2abe-1fe8-4e41-b9f6-1fb359989f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:46.625070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d2abe-1fe8-4e41-b9f6-1fb359989f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:46.626665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d2abe-1fe8-4e41-b9f6-1fb359989f0a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:46.638910 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1452/2903] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:54:46.645423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc988d-984d-4c78-884b-a38541963fe4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:46.659278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc988d-984d-4c78-884b-a38541963fe4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:46.664616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73caff-7ee4-40ff-b546-cf85aa6430a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:46.665572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73caff-7ee4-40ff-b546-cf85aa6430a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:46.665856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73caff-7ee4-40ff-b546-cf85aa6430a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:46.666137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73caff-7ee4-40ff-b546-cf85aa6430a5 admin admin] PATH_INFO: `/v3/projects/166cb17d87cc4b648b91c4fc60947b5f/users/c0c85377b4ee450381ddad97c3048adc/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:46.682747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73caff-7ee4-40ff-b546-cf85aa6430a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166cb17d87cc4b648b91c4fc60947b5f, user_id=c0c85377b4ee450381ddad97c3048adc, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:46.685628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73caff-7ee4-40ff-b546-cf85aa6430a5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:46.704783 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1452/2904] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:46 2022] PUT /identity/v3/projects/166cb17d87cc4b648b91c4fc60947b5f/users/c0c85377b4ee450381ddad97c3048adc/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:46.710016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2abe-1fe8-4e41-b9f6-1fb359989f0a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:46.723166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2abe-1fe8-4e41-b9f6-1fb359989f0a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:46.797889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99c40-142d-42d5-a753-1a9049860f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:46.798975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99c40-142d-42d5-a753-1a9049860f4a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:46.799432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99c40-142d-42d5-a753-1a9049860f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:46.799789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99c40-142d-42d5-a753-1a9049860f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:46.801136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c99c40-142d-42d5-a753-1a9049860f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:46.803017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c99c40-142d-42d5-a753-1a9049860f4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:46.818947 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1453/2905] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:46.820471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73caff-7ee4-40ff-b546-cf85aa6430a5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:46.832808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73caff-7ee4-40ff-b546-cf85aa6430a5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:46.838175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:46.839085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:46.839719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:46.839719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] PATH_INFO: `/v3/projects/166cb17d87cc4b648b91c4fc60947b5f/users/c0c85377b4ee450381ddad97c3048adc/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:46.841662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=166cb17d87cc4b648b91c4fc60947b5f, user_id=c0c85377b4ee450381ddad97c3048adc, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:46.844289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:46.855677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1453/2906] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:46 2022] PUT /identity/v3/projects/166cb17d87cc4b648b91c4fc60947b5f/users/c0c85377b4ee450381ddad97c3048adc/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:46.867279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a18b2c-17cf-4364-b0dc-de42fc972dc1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:46.867571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a18b2c-17cf-4364-b0dc-de42fc972dc1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:46.867852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a18b2c-17cf-4364-b0dc-de42fc972dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:46.901954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b1a18b2c-17cf-4364-b0dc-de42fc972dc1 None None] MFA Rules not processed for user `c0c85377b4ee450381ddad97c3048adc`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:46.903360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b1a18b2c-17cf-4364-b0dc-de42fc972dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:46.961762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:46.963927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:47.000386 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1454/2907] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:47.012634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7d2d-85e6-42f5-9524-9ca742a708ac None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:47.013501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7d2d-85e6-42f5-9524-9ca742a708ac None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:47.014767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7d2d-85e6-42f5-9524-9ca742a708ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:47.053227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aeeb7d2d-85e6-42f5-9524-9ca742a708ac None None] MFA Rules not processed for user `076a0cb931aa4bcd8c4b4d95c387fb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:47.056225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aeeb7d2d-85e6-42f5-9524-9ca742a708ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:47.109470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1136087-f129-444f-9a70-bc683dd3b94b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:47.119717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:47.121198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:47.121869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:47.122381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] PATH_INFO: `/v3/users/7c79863efa6f43239352d85a59f69ed9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:47.126464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c79863efa6f43239352d85a59f69ed9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:47.132074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:47.149971 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1455/2908] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:47.212847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c79863efa6f43239352d85a59f69ed9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:47.214392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c79863efa6f43239352d85a59f69ed9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:47.215282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c79863efa6f43239352d85a59f69ed9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:47.233241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c79863efa6f43239352d85a59f69ed9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:47.242125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c79863efa6f43239352d85a59f69ed9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:47.260532 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1454/2909] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:46 2022] DELETE /identity/v3/users/7c79863efa6f43239352d85a59f69ed9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:54:47.265727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de303d92-b801-4e1b-a0bb-ef45581c7d2e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:47.266100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de303d92-b801-4e1b-a0bb-ef45581c7d2e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:47.266500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de303d92-b801-4e1b-a0bb-ef45581c7d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:47.293779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-de303d92-b801-4e1b-a0bb-ef45581c7d2e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:47.295541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de303d92-b801-4e1b-a0bb-ef45581c7d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:47.373129 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1456/2910] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:47.383225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:47.385260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:47.483148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e306cd6-c62c-4a2b-8948-4978a6603420 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:47.489386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9cc85-dae7-4a30-a75c-9f32d8c79967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:47.490218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9cc85-dae7-4a30-a75c-9f32d8c79967 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:47.490671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9cc85-dae7-4a30-a75c-9f32d8c79967 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:47.491098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9cc85-dae7-4a30-a75c-9f32d8c79967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:47.502320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9cc85-dae7-4a30-a75c-9f32d8c79967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:47.504415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9cc85-dae7-4a30-a75c-9f32d8c79967 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:47.516283 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1455/2911] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:47.892563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de303d92-b801-4e1b-a0bb-ef45581c7d2e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:47.894255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de303d92-b801-4e1b-a0bb-ef45581c7d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:47.938380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de303d92-b801-4e1b-a0bb-ef45581c7d2e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:47.943674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:47.944689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:47.945191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:47.945683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] PATH_INFO: `/v3/projects/7b55ec03cf7e44ae93a098de85e466aa` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:47.946985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b55ec03cf7e44ae93a098de85e466aa)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:47.949132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:48.020420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b55ec03cf7e44ae93a098de85e466aa', 'request_id': 'req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:48.034034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b55ec03cf7e44ae93a098de85e466aa', 'request_id': 'req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:48.045570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b55ec03cf7e44ae93a098de85e466aa', 'request_id': 'req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:48.059107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] The token cache is being invalidate because project 7b55ec03cf7e44ae93a098de85e466aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:48.059426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:48.060535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be1aa79e-3c51-48e1-8671-24e4ebfc4bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:48.062310 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1457/2912] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:47 2022] DELETE /identity/v3/projects/7b55ec03cf7e44ae93a098de85e466aa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:48.068060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3817d5-ef86-4278-b90c-dfd832461ee5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.068535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3817d5-ef86-4278-b90c-dfd832461ee5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.068908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3817d5-ef86-4278-b90c-dfd832461ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.089655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fa3817d5-ef86-4278-b90c-dfd832461ee5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:48.091574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa3817d5-ef86-4278-b90c-dfd832461ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:48.157637 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1456/2913] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:48.167535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a74f6-1d1f-45c6-be03-45d6ba5e6a55 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.167821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a74f6-1d1f-45c6-be03-45d6ba5e6a55 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.168254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a74f6-1d1f-45c6-be03-45d6ba5e6a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.188206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5d9a74f6-1d1f-45c6-be03-45d6ba5e6a55 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:48.189981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5d9a74f6-1d1f-45c6-be03-45d6ba5e6a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:48.200444 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1458/2914] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:48.208646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3817d5-ef86-4278-b90c-dfd832461ee5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:48.219730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3817d5-ef86-4278-b90c-dfd832461ee5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:48.227632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:48.228304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.228686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.228963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.229682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:54:48.229987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:48.231579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:48.244453 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1457/2915] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:54:48.248956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a74f6-1d1f-45c6-be03-45d6ba5e6a55 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:48.258443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a74f6-1d1f-45c6-be03-45d6ba5e6a55 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:48.264960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b19c5-4e81-4448-a8c8-182a64ce9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:48.265744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b19c5-4e81-4448-a8c8-182a64ce9da0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.266139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b19c5-4e81-4448-a8c8-182a64ce9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.266511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b19c5-4e81-4448-a8c8-182a64ce9da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.267418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b19c5-4e81-4448-a8c8-182a64ce9da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:48.270846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b19c5-4e81-4448-a8c8-182a64ce9da0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:48.283217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:48.287223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:48.311360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1459/2916] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:48 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:54:48.312402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b19c5-4e81-4448-a8c8-182a64ce9da0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:48.406324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b19c5-4e81-4448-a8c8-182a64ce9da0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:48.415376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55845e-9bd7-46d9-aaa3-04e8cc20a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:48.416209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55845e-9bd7-46d9-aaa3-04e8cc20a9ee admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.416626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55845e-9bd7-46d9-aaa3-04e8cc20a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.417004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55845e-9bd7-46d9-aaa3-04e8cc20a9ee admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.417997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55845e-9bd7-46d9-aaa3-04e8cc20a9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:48.421131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55845e-9bd7-46d9-aaa3-04e8cc20a9ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:48.423409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e167f6-2c0d-4709-b94f-b8a07377d2dd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:48.450072 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1460/2917] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:48 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:48.454826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55845e-9bd7-46d9-aaa3-04e8cc20a9ee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:48.472280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55845e-9bd7-46d9-aaa3-04e8cc20a9ee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:48.478797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88231-0ca0-4025-a833-19dc93e5a865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:48.479740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88231-0ca0-4025-a833-19dc93e5a865 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.480451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88231-0ca0-4025-a833-19dc93e5a865 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.481038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88231-0ca0-4025-a833-19dc93e5a865 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.481837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b88231-0ca0-4025-a833-19dc93e5a865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:48.486369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b88231-0ca0-4025-a833-19dc93e5a865 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:48.501183 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1461/2918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:48.505954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88231-0ca0-4025-a833-19dc93e5a865 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:48.508319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:48.509687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.510793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.511493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.514114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:48.519561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88231-0ca0-4025-a833-19dc93e5a865 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:48.527344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7c559-da80-4d25-9726-abd4a2f53c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:48.533157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c559-da80-4d25-9726-abd4a2f53c9a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.533725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c559-da80-4d25-9726-abd4a2f53c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.534117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c559-da80-4d25-9726-abd4a2f53c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.535426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7c559-da80-4d25-9726-abd4a2f53c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:48.537231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7c559-da80-4d25-9726-abd4a2f53c9a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:48.553820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1462/2919] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:48.558057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7c559-da80-4d25-9726-abd4a2f53c9a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:48.571684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7c559-da80-4d25-9726-abd4a2f53c9a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:48.577798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ec2ab-e114-4c5e-9197-722df5deaeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:48.578972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ec2ab-e114-4c5e-9197-722df5deaeda admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.579353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ec2ab-e114-4c5e-9197-722df5deaeda admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.579730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ec2ab-e114-4c5e-9197-722df5deaeda admin admin] PATH_INFO: `/v3/projects/fb90ae6c04ac4979bc1773ded57360ff/users/a497c148ef46454abff7c97c7cdbfc12/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.599556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ec2ab-e114-4c5e-9197-722df5deaeda admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb90ae6c04ac4979bc1773ded57360ff, user_id=a497c148ef46454abff7c97c7cdbfc12, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:48.602405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ec2ab-e114-4c5e-9197-722df5deaeda admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:48.606923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:48.608483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:48.616748 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1463/2920] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:48 2022] PUT /identity/v3/projects/fb90ae6c04ac4979bc1773ded57360ff/users/a497c148ef46454abff7c97c7cdbfc12/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:54:48.626695 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1458/2921] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:48.627253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695569-cf4f-4d55-b27e-3b5b9f4ac3ba None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:48.627995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695569-cf4f-4d55-b27e-3b5b9f4ac3ba None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:48.627995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695569-cf4f-4d55-b27e-3b5b9f4ac3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:48.659115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b2695569-cf4f-4d55-b27e-3b5b9f4ac3ba None None] MFA Rules not processed for user `a497c148ef46454abff7c97c7cdbfc12`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:48.660980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b2695569-cf4f-4d55-b27e-3b5b9f4ac3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:48.769176 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1464/2922] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:54:49.227442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:49.229037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:49.243173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355a3e8-3aa9-45dc-bf04-592d1ab62fda service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:49.316779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ace0-5695-4597-809f-13a308fe3810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:49.317450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ace0-5695-4597-809f-13a308fe3810 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:49.317737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ace0-5695-4597-809f-13a308fe3810 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:49.318018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ace0-5695-4597-809f-13a308fe3810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:49.319919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5b42ace0-5695-4597-809f-13a308fe3810 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:49.401206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42ace0-5695-4597-809f-13a308fe3810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:49.403006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42ace0-5695-4597-809f-13a308fe3810 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:49.420559 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1459/2923] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:49.982819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2695569-cf4f-4d55-b27e-3b5b9f4ac3ba None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:49.996296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2695569-cf4f-4d55-b27e-3b5b9f4ac3ba None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:50.002002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f281-dda4-4450-b7e0-a466f7ed0a62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:50.002707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f281-dda4-4450-b7e0-a466f7ed0a62 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:50.002990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f281-dda4-4450-b7e0-a466f7ed0a62 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:50.003868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f281-dda4-4450-b7e0-a466f7ed0a62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:50.012016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9f281-dda4-4450-b7e0-a466f7ed0a62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:50.013636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9f281-dda4-4450-b7e0-a466f7ed0a62 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:50.022473 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1465/2924] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:50.953627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49d9d3-6318-41cb-8e4a-fe30acad8ade None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:50.954097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49d9d3-6318-41cb-8e4a-fe30acad8ade None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:50.954214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49d9d3-6318-41cb-8e4a-fe30acad8ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:50.972582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0a49d9d3-6318-41cb-8e4a-fe30acad8ade None None] MFA Rules not processed for user `ab3fa7eadddf42b4b700593dad828e44`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:50.974379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0a49d9d3-6318-41cb-8e4a-fe30acad8ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:51.044767 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1460/2925] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:51.129218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f281-dda4-4450-b7e0-a466f7ed0a62 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:51.222417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f281-dda4-4450-b7e0-a466f7ed0a62 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:51.235795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:51.237015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:51.238294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:51.238886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] PATH_INFO: `/v3/users/a497c148ef46454abff7c97c7cdbfc12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:51.240405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a497c148ef46454abff7c97c7cdbfc12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:51.243206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:51.295602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a497c148ef46454abff7c97c7cdbfc12'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:51.312902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a497c148ef46454abff7c97c7cdbfc12'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:51.322447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a497c148ef46454abff7c97c7cdbfc12'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:51.323089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a497c148ef46454abff7c97c7cdbfc12'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:51.323749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a497c148ef46454abff7c97c7cdbfc12'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:51.338707 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1466/2926] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:54:51 2022] DELETE /identity/v3/users/a497c148ef46454abff7c97c7cdbfc12 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:51.343095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb613364-99c7-44b6-91f4-b323a53f6da5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:51.343457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb613364-99c7-44b6-91f4-b323a53f6da5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:51.343809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb613364-99c7-44b6-91f4-b323a53f6da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:51.364136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bb613364-99c7-44b6-91f4-b323a53f6da5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:51.365534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bb613364-99c7-44b6-91f4-b323a53f6da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:51.428686 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1461/2927] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:54:51.442481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:51.443927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:51.557953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb25028-5d2f-4bb8-ba83-4c196a87ce7a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:51.569059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc607eb-8582-4979-b786-2631e7657d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:51.569737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc607eb-8582-4979-b786-2631e7657d88 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:51.570075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc607eb-8582-4979-b786-2631e7657d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:51.570299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc607eb-8582-4979-b786-2631e7657d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:51.593568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc607eb-8582-4979-b786-2631e7657d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:51.595105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc607eb-8582-4979-b786-2631e7657d88 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:51.606322 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1467/2928] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:54:52.204699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb613364-99c7-44b6-91f4-b323a53f6da5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:52.207044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bb613364-99c7-44b6-91f4-b323a53f6da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:52.248217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb613364-99c7-44b6-91f4-b323a53f6da5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:52.275995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:52.277789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:52.278209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:52.278662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] PATH_INFO: `/v3/projects/fb90ae6c04ac4979bc1773ded57360ff` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:52.281180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb90ae6c04ac4979bc1773ded57360ff)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:52.283888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:52.365971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb90ae6c04ac4979bc1773ded57360ff', 'request_id': 'req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:52.372654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb90ae6c04ac4979bc1773ded57360ff', 'request_id': 'req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:52.382837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb90ae6c04ac4979bc1773ded57360ff', 'request_id': 'req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:52.399413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] The token cache is being invalidate because project fb90ae6c04ac4979bc1773ded57360ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:54:52.399639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:52.400717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d35fbab1-d5dd-4a88-bed0-fe272ffecf65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:54:52.406977 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1462/2929] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:52 2022] DELETE /identity/v3/projects/fb90ae6c04ac4979bc1773ded57360ff => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:52.408625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f641a5-9dd9-46c0-9f65-e74ac9536bf4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:52.409096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f641a5-9dd9-46c0-9f65-e74ac9536bf4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:52.409245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f641a5-9dd9-46c0-9f65-e74ac9536bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:52.490230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c8f641a5-9dd9-46c0-9f65-e74ac9536bf4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:52.492209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c8f641a5-9dd9-46c0-9f65-e74ac9536bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:52.679904 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1468/2930] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:52.687786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0198aa-3d05-4fb4-bbd8-302728de4e3a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:52.688073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0198aa-3d05-4fb4-bbd8-302728de4e3a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:52.688391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0198aa-3d05-4fb4-bbd8-302728de4e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:52.714890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2c0198aa-3d05-4fb4-bbd8-302728de4e3a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:52.716705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2c0198aa-3d05-4fb4-bbd8-302728de4e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:52.744797 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1463/2931] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:52.746932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f641a5-9dd9-46c0-9f65-e74ac9536bf4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:52.765840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f641a5-9dd9-46c0-9f65-e74ac9536bf4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:52.771513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:52.772240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:52.772848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:52.773196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:52.774117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:54:52.774499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:52.776579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:52.792733 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1469/2932] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:54:52.796634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0198aa-3d05-4fb4-bbd8-302728de4e3a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:52.806967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0198aa-3d05-4fb4-bbd8-302728de4e3a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:52.811752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb298ca9-1d18-4823-9dd2-f4500c042c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:52.812449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298ca9-1d18-4823-9dd2-f4500c042c7d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:52.812832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298ca9-1d18-4823-9dd2-f4500c042c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:52.812997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298ca9-1d18-4823-9dd2-f4500c042c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:52.813817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb298ca9-1d18-4823-9dd2-f4500c042c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:52.815635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb298ca9-1d18-4823-9dd2-f4500c042c7d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:52.849783 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1464/2933] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:54:52 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:52.851095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:52.864143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41f4c-991d-4524-a67d-f182b3247a47 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:52.971652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2739023-32b8-417c-8f4f-eeeef294f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:52.972571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2739023-32b8-417c-8f4f-eeeef294f415 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:52.972876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2739023-32b8-417c-8f4f-eeeef294f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:52.973191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2739023-32b8-417c-8f4f-eeeef294f415 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:52.974235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2739023-32b8-417c-8f4f-eeeef294f415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:52.976197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2739023-32b8-417c-8f4f-eeeef294f415 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:53.033445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb298ca9-1d18-4823-9dd2-f4500c042c7d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:53.035465 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1470/2934] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:54:52 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:54:53.049067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb298ca9-1d18-4823-9dd2-f4500c042c7d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:53.060254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a571-145c-4b5d-8dd6-f28e9dc03aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:53.061092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a571-145c-4b5d-8dd6-f28e9dc03aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:53.061374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a571-145c-4b5d-8dd6-f28e9dc03aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:53.061647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a571-145c-4b5d-8dd6-f28e9dc03aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:53.062559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a571-145c-4b5d-8dd6-f28e9dc03aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:53.064364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a571-145c-4b5d-8dd6-f28e9dc03aa4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:53.076635 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1465/2935] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:53.080841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2739023-32b8-417c-8f4f-eeeef294f415 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:53.098382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2739023-32b8-417c-8f4f-eeeef294f415 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:53.124267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd5415-c4e8-4fa6-bca9-6e11686ce12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:53.126093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5415-c4e8-4fa6-bca9-6e11686ce12b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:53.126861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5415-c4e8-4fa6-bca9-6e11686ce12b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:53.127222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5415-c4e8-4fa6-bca9-6e11686ce12b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:53.140498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd5415-c4e8-4fa6-bca9-6e11686ce12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:53.145160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd5415-c4e8-4fa6-bca9-6e11686ce12b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:53.173745 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1471/2936] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:54:53.178452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a571-145c-4b5d-8dd6-f28e9dc03aa4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:53.200840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a571-145c-4b5d-8dd6-f28e9dc03aa4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:53.208923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:53.211572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:53.212144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:53.212691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] PATH_INFO: `/v3/projects/808305a45737485185adcb60012ea91a/users/ccc221761620472ea3cd887988f9f2c0/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:53.252167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808305a45737485185adcb60012ea91a, user_id=ccc221761620472ea3cd887988f9f2c0, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:53.255242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:53.306759 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1466/2937] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:54:53 2022] PUT /identity/v3/projects/808305a45737485185adcb60012ea91a/users/ccc221761620472ea3cd887988f9f2c0/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:54:53.312315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed21ea-ed6d-4cb1-b5bc-f8329a444112 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:53.312888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed21ea-ed6d-4cb1-b5bc-f8329a444112 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:53.313496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed21ea-ed6d-4cb1-b5bc-f8329a444112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:53.338293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-67ed21ea-ed6d-4cb1-b5bc-f8329a444112 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:53.343086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-67ed21ea-ed6d-4cb1-b5bc-f8329a444112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:53.504694 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1472/2938] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:53.515742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:53.518284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:53.600963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c1eb-b676-41eb-947d-6583cfee6ee7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:53.605756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8adf9b-2d8f-460f-bce0-cac1a8001059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:53.607370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adf9b-2d8f-460f-bce0-cac1a8001059 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:53.608541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adf9b-2d8f-460f-bce0-cac1a8001059 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:53.608981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adf9b-2d8f-460f-bce0-cac1a8001059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:53.622686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8adf9b-2d8f-460f-bce0-cac1a8001059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:53.624638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8adf9b-2d8f-460f-bce0-cac1a8001059 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:53.643005 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1467/2939] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:54:54.862157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12444b9-e053-43a6-938f-c83b1875ab60 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:54.863492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12444b9-e053-43a6-938f-c83b1875ab60 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:54.863492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12444b9-e053-43a6-938f-c83b1875ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:54.931352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d12444b9-e053-43a6-938f-c83b1875ab60 None None] MFA Rules not processed for user `ccc221761620472ea3cd887988f9f2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:54.935059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d12444b9-e053-43a6-938f-c83b1875ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:55.058270 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1473/2940] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:55.058832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4c3cd-5849-4d66-8b7b-d431d651b398 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:55.059348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4c3cd-5849-4d66-8b7b-d431d651b398 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:55.059471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4c3cd-5849-4d66-8b7b-d431d651b398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:55.090956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-71b4c3cd-5849-4d66-8b7b-d431d651b398 None None] MFA Rules not processed for user `ccc221761620472ea3cd887988f9f2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:54:55.092799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71b4c3cd-5849-4d66-8b7b-d431d651b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:55.110106 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1468/2941] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:54:56.354113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12444b9-e053-43a6-938f-c83b1875ab60 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:54:56.355700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d12444b9-e053-43a6-938f-c83b1875ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:54:56.440388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12444b9-e053-43a6-938f-c83b1875ab60 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:54:56.446747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:54:56.447423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:54:56.447863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:54:56.448201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:54:56.458037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:54:56.459747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:54:56.471377 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1474/2942] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:08.744123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4c3cd-5849-4d66-8b7b-d431d651b398 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:08.746479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71b4c3cd-5849-4d66-8b7b-d431d651b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:08.766572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4c3cd-5849-4d66-8b7b-d431d651b398 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:08.773364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:08.774068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:08.776564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:08.777110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:08.779472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:08.856513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:08.858497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:08.871891 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1469/2943] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:10.331269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:10.334102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:10.352118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cbdcb-a6bd-476b-8094-8e24c84c59a8 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:10.358107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:10.359473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:10.360021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:10.360683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] PATH_INFO: `/v3/users/40515f5be4664c98a06359ae852e7b84` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:10.362911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40515f5be4664c98a06359ae852e7b84)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:10.364924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:10.414758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40515f5be4664c98a06359ae852e7b84'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.427518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40515f5be4664c98a06359ae852e7b84'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.437134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40515f5be4664c98a06359ae852e7b84'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.437751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40515f5be4664c98a06359ae852e7b84'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.438363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c3737613-c1d4-4402-902f-01ef35486380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40515f5be4664c98a06359ae852e7b84'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.450978 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1475/2944] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:10 2022] DELETE /identity/v3/users/40515f5be4664c98a06359ae852e7b84 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:10.649010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:10.690477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fb51f-7478-47a8-ab64-ae9a0041cf5f service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:10.762156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:10.763411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:10.763890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:10.764248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] PATH_INFO: `/v3/projects/29dd33f3e21c4153b2dc5ec75558b150` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:10.765989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29dd33f3e21c4153b2dc5ec75558b150)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:10.768230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:10.825384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29dd33f3e21c4153b2dc5ec75558b150', 'request_id': 'req-dc69eeb1-38a6-4d39-8fe9-934507a2d970'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.831645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29dd33f3e21c4153b2dc5ec75558b150', 'request_id': 'req-dc69eeb1-38a6-4d39-8fe9-934507a2d970'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.841226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29dd33f3e21c4153b2dc5ec75558b150', 'request_id': 'req-dc69eeb1-38a6-4d39-8fe9-934507a2d970'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.857053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] The token cache is being invalidate because project 29dd33f3e21c4153b2dc5ec75558b150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:10.857365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.858018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dc69eeb1-38a6-4d39-8fe9-934507a2d970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:10.859678 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1470/2945] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:10 2022] DELETE /identity/v3/projects/29dd33f3e21c4153b2dc5ec75558b150 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:10.864878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c71f1-542c-40b7-9d92-000a15b6acb0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:10.865172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c71f1-542c-40b7-9d92-000a15b6acb0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:10.865481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c71f1-542c-40b7-9d92-000a15b6acb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:10.888474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-997c71f1-542c-40b7-9d92-000a15b6acb0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:10.889834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-997c71f1-542c-40b7-9d92-000a15b6acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:10.953360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1476/2946] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:10.961483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20115e-7aa5-4331-ac21-1ab189b3439b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:10.961852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20115e-7aa5-4331-ac21-1ab189b3439b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:10.962129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20115e-7aa5-4331-ac21-1ab189b3439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:10.981267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9f20115e-7aa5-4331-ac21-1ab189b3439b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:10.982549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f20115e-7aa5-4331-ac21-1ab189b3439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:10.991090 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1471/2947] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:10.996386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c71f1-542c-40b7-9d92-000a15b6acb0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:11.008144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c71f1-542c-40b7-9d92-000a15b6acb0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:11.016220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:11.017605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:11.018063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:11.018488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:11.020238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:55:11.020650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:11.022966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:11.045414 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1477/2948] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:55:11.050669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20115e-7aa5-4331-ac21-1ab189b3439b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:11.064210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20115e-7aa5-4331-ac21-1ab189b3439b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:11.071831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404738-e025-411a-84a0-2ffa79d2bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:11.072839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404738-e025-411a-84a0-2ffa79d2bc92 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:11.074085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404738-e025-411a-84a0-2ffa79d2bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:11.074589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404738-e025-411a-84a0-2ffa79d2bc92 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:11.075507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404738-e025-411a-84a0-2ffa79d2bc92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:11.077927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404738-e025-411a-84a0-2ffa79d2bc92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:11.110561 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1472/2949] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:11 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:11.115850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:11.127265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fb9cb-c7c9-4810-94cd-ebedf213f8a0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:11.206713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4eaa-1879-4639-bc48-cdabfca6eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:11.207316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4eaa-1879-4639-bc48-cdabfca6eb07 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:11.208281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4eaa-1879-4639-bc48-cdabfca6eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:11.208281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4eaa-1879-4639-bc48-cdabfca6eb07 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:11.208731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f4eaa-1879-4639-bc48-cdabfca6eb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:11.210635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f4eaa-1879-4639-bc48-cdabfca6eb07 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:11.236771 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1478/2950] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:11 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:55:11.241123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404738-e025-411a-84a0-2ffa79d2bc92 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:11.255641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404738-e025-411a-84a0-2ffa79d2bc92 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:11.260582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78f4e-1fcc-4f07-a515-7c8ede2d5983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:11.261481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78f4e-1fcc-4f07-a515-7c8ede2d5983 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:11.261759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78f4e-1fcc-4f07-a515-7c8ede2d5983 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:11.262029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78f4e-1fcc-4f07-a515-7c8ede2d5983 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:11.262750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a78f4e-1fcc-4f07-a515-7c8ede2d5983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:11.264416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a78f4e-1fcc-4f07-a515-7c8ede2d5983 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:11.279020 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1473/2951] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:11.282786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4eaa-1879-4639-bc48-cdabfca6eb07 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:11.294782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4eaa-1879-4639-bc48-cdabfca6eb07 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:11.300706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef81950-f8cf-4e22-80a1-198ec2b4bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:11.301483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef81950-f8cf-4e22-80a1-198ec2b4bdce admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:11.301838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef81950-f8cf-4e22-80a1-198ec2b4bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:11.302337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef81950-f8cf-4e22-80a1-198ec2b4bdce admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:11.303226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef81950-f8cf-4e22-80a1-198ec2b4bdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:11.304912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef81950-f8cf-4e22-80a1-198ec2b4bdce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:11.319050 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1479/2952] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:11.332230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78f4e-1fcc-4f07-a515-7c8ede2d5983 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:11.344885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78f4e-1fcc-4f07-a515-7c8ede2d5983 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:11.351030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:11.352403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:11.352753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:11.353121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] PATH_INFO: `/v3/projects/4e7060607f9342ad93e2ddbab97d8d2b/users/605ee8b93b804ecc9f21177c4cbf0b2a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:11.369979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7060607f9342ad93e2ddbab97d8d2b, user_id=605ee8b93b804ecc9f21177c4cbf0b2a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:11.375198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:11.392723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1474/2953] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:11 2022] PUT /identity/v3/projects/4e7060607f9342ad93e2ddbab97d8d2b/users/605ee8b93b804ecc9f21177c4cbf0b2a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:11.398849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea310b-c76b-4b23-9f0a-a9401d88f1a2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:11.399350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea310b-c76b-4b23-9f0a-a9401d88f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:11.399470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea310b-c76b-4b23-9f0a-a9401d88f1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:11.420278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-adea310b-c76b-4b23-9f0a-a9401d88f1a2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:11.420954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-adea310b-c76b-4b23-9f0a-a9401d88f1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:11.531987 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1480/2954] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:11.542107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:11.544683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:11.642887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7381b-0cab-4168-a473-7dbb79fa1caf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:11.648811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d85735-165f-4ce1-bde3-978b96c41cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:11.649680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d85735-165f-4ce1-bde3-978b96c41cac service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:11.650347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d85735-165f-4ce1-bde3-978b96c41cac service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:11.650347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d85735-165f-4ce1-bde3-978b96c41cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:11.675638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d85735-165f-4ce1-bde3-978b96c41cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:11.677249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d85735-165f-4ce1-bde3-978b96c41cac service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:11.691044 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1475/2955] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:55:12.731109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cd1c-8b08-45ca-9e41-f415d714d95a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:12.731680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cd1c-8b08-45ca-9e41-f415d714d95a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:12.731680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cd1c-8b08-45ca-9e41-f415d714d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:12.752136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0d66cd1c-8b08-45ca-9e41-f415d714d95a None None] MFA Rules not processed for user `076a0cb931aa4bcd8c4b4d95c387fb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:12.754399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0d66cd1c-8b08-45ca-9e41-f415d714d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:12.819724 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1481/2956] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:55:18.856426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44df7-ac18-49a7-92b0-6d24ed11af1b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:18.856911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44df7-ac18-49a7-92b0-6d24ed11af1b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:18.858019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44df7-ac18-49a7-92b0-6d24ed11af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:18.921140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-19f44df7-ac18-49a7-92b0-6d24ed11af1b None None] MFA Rules not processed for user `605ee8b93b804ecc9f21177c4cbf0b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:18.922921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-19f44df7-ac18-49a7-92b0-6d24ed11af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:19.030066 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1476/2957] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:19.039925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056fb6-f3f2-44e5-9be1-bb1c4e5612fd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:19.040475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056fb6-f3f2-44e5-9be1-bb1c4e5612fd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:19.040583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056fb6-f3f2-44e5-9be1-bb1c4e5612fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:19.062060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0b056fb6-f3f2-44e5-9be1-bb1c4e5612fd None None] MFA Rules not processed for user `605ee8b93b804ecc9f21177c4cbf0b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:19.063531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0b056fb6-f3f2-44e5-9be1-bb1c4e5612fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:19.072836 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1482/2958] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:19.636514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44df7-ac18-49a7-92b0-6d24ed11af1b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:19.638111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-19f44df7-ac18-49a7-92b0-6d24ed11af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:19.722137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44df7-ac18-49a7-92b0-6d24ed11af1b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:19.736907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2c324-c637-4702-a596-c3927b43d245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:19.738454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c324-c637-4702-a596-c3927b43d245 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:19.738799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c324-c637-4702-a596-c3927b43d245 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:19.739105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c324-c637-4702-a596-c3927b43d245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:19.748695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2c324-c637-4702-a596-c3927b43d245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:19.750519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2c324-c637-4702-a596-c3927b43d245 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:19.771142 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1477/2959] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:24.028939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056fb6-f3f2-44e5-9be1-bb1c4e5612fd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:24.037935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0b056fb6-f3f2-44e5-9be1-bb1c4e5612fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:24.061095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056fb6-f3f2-44e5-9be1-bb1c4e5612fd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:24.074947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5e229-6e0a-4b2b-99a5-cb8b4b0fa5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:24.076045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5e229-6e0a-4b2b-99a5-cb8b4b0fa5ad service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:24.076590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5e229-6e0a-4b2b-99a5-cb8b4b0fa5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:24.077025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5e229-6e0a-4b2b-99a5-cb8b4b0fa5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:24.079343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-24b5e229-6e0a-4b2b-99a5-cb8b4b0fa5ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:24.102128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5e229-6e0a-4b2b-99a5-cb8b4b0fa5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:24.103908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5e229-6e0a-4b2b-99a5-cb8b4b0fa5ad service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:24.130516 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1483/2960] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:26.564226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2c324-c637-4702-a596-c3927b43d245 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:26.576858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2c324-c637-4702-a596-c3927b43d245 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:26.580964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f9a79-b5e2-4c10-9ffa-ee74c20b1df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:26.581644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9a79-b5e2-4c10-9ffa-ee74c20b1df5 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:26.581928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9a79-b5e2-4c10-9ffa-ee74c20b1df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:26.582399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9a79-b5e2-4c10-9ffa-ee74c20b1df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:26.584648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-763f9a79-b5e2-4c10-9ffa-ee74c20b1df5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:26.633629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f9a79-b5e2-4c10-9ffa-ee74c20b1df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:26.639094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f9a79-b5e2-4c10-9ffa-ee74c20b1df5 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:26.657948 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1478/2961] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:27.663670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641487-f5a3-4bb0-b2a9-5d691689a49f None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:27.664222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641487-f5a3-4bb0-b2a9-5d691689a49f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:27.664482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641487-f5a3-4bb0-b2a9-5d691689a49f None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:27.667034 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1484/2962] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:55:27.678659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994874a-5e6a-407b-9635-b5ef01e398d0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:27.679634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994874a-5e6a-407b-9635-b5ef01e398d0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:27.680154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994874a-5e6a-407b-9635-b5ef01e398d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:27.702930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5994874a-5e6a-407b-9635-b5ef01e398d0 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:27.704428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5994874a-5e6a-407b-9635-b5ef01e398d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:27.788626 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1479/2963] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:27.872237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641487-f5a3-4bb0-b2a9-5d691689a49f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:27.874406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce641487-f5a3-4bb0-b2a9-5d691689a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:27.901351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641487-f5a3-4bb0-b2a9-5d691689a49f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:27.912637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:27.913303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:27.913578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:27.914056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:27.924575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:27.926156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:27.939799 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1485/2964] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:28.298298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994874a-5e6a-407b-9635-b5ef01e398d0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:28.342747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994874a-5e6a-407b-9635-b5ef01e398d0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:28.360511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:28.361428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:28.361872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:28.362882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:28.370980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:28.400249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:28.405224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:28.426330 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1480/2965] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:31.796591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:31.802387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:31.836068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de346b-e29a-4f99-beca-a31215a70342 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:31.850164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:31.852521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:31.853814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:31.854256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] PATH_INFO: `/v3/users/d05e321d65ab4c218cebea855d1aad86` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:31.857551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05e321d65ab4c218cebea855d1aad86)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:31.862760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:31.932791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05e321d65ab4c218cebea855d1aad86'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:31.958950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05e321d65ab4c218cebea855d1aad86'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:31.982042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05e321d65ab4c218cebea855d1aad86'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:31.982795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05e321d65ab4c218cebea855d1aad86'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:31.983391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0cd0f237-bd30-4ac9-91b3-1f781ec49972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05e321d65ab4c218cebea855d1aad86'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:32.009458 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1486/2966] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:31 2022] DELETE /identity/v3/users/d05e321d65ab4c218cebea855d1aad86 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:32.358449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:32.377192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41308326-032f-4721-9ea7-c4ca3112b9b4 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:32.480962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:32.482322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:32.482903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:32.483373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] PATH_INFO: `/v3/projects/8a274e94e3e643c4b814892e2429db0e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:32.485341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a274e94e3e643c4b814892e2429db0e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:32.488952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:32.553640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a274e94e3e643c4b814892e2429db0e', 'request_id': 'req-a5e65d00-f686-4173-9bc8-c74cc71b0a77'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:32.561548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a274e94e3e643c4b814892e2429db0e', 'request_id': 'req-a5e65d00-f686-4173-9bc8-c74cc71b0a77'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:32.570462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a274e94e3e643c4b814892e2429db0e', 'request_id': 'req-a5e65d00-f686-4173-9bc8-c74cc71b0a77'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:32.583512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] The token cache is being invalidate because project 8a274e94e3e643c4b814892e2429db0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:32.584156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:32.584991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a5e65d00-f686-4173-9bc8-c74cc71b0a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:32.586737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1481/2967] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:32 2022] DELETE /identity/v3/projects/8a274e94e3e643c4b814892e2429db0e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:32.592755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57d44-4413-4b06-8f12-0c0045b5b9b9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:32.593042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57d44-4413-4b06-8f12-0c0045b5b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:32.593552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57d44-4413-4b06-8f12-0c0045b5b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:32.618117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f1d57d44-4413-4b06-8f12-0c0045b5b9b9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:32.619631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f1d57d44-4413-4b06-8f12-0c0045b5b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:32.732450 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1487/2968] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:32.741485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205e422-0111-4ee6-8594-fa33743f1ffc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:32.742225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205e422-0111-4ee6-8594-fa33743f1ffc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:32.742682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205e422-0111-4ee6-8594-fa33743f1ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:32.766612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6205e422-0111-4ee6-8594-fa33743f1ffc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:32.767941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6205e422-0111-4ee6-8594-fa33743f1ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:32.777947 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1482/2969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:32.782283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57d44-4413-4b06-8f12-0c0045b5b9b9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:32.798091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57d44-4413-4b06-8f12-0c0045b5b9b9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:32.804828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:32.805947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:32.806822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:32.807331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:32.808321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:55:32.808660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:32.810854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:32.845677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1488/2970] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:55:32.850028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205e422-0111-4ee6-8594-fa33743f1ffc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:32.860747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205e422-0111-4ee6-8594-fa33743f1ffc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:32.868180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3f0d-a190-49c7-ba36-a6793a635026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:32.869115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3f0d-a190-49c7-ba36-a6793a635026 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:32.869553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3f0d-a190-49c7-ba36-a6793a635026 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:32.869984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3f0d-a190-49c7-ba36-a6793a635026 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:32.870718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d3f0d-a190-49c7-ba36-a6793a635026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:32.872838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d3f0d-a190-49c7-ba36-a6793a635026 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:32.907912 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1483/2971] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:32 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:32.909762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:32.922485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5416dca-b5bf-41df-8cf2-07305d271a78 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:33.008173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288c44f-d684-406f-9ed3-944e6e75004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:33.009066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c44f-d684-406f-9ed3-944e6e75004c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:33.009462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c44f-d684-406f-9ed3-944e6e75004c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:33.009936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c44f-d684-406f-9ed3-944e6e75004c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:33.010761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288c44f-d684-406f-9ed3-944e6e75004c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:33.013091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288c44f-d684-406f-9ed3-944e6e75004c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:33.037085 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1489/2972] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:32 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:33.043134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3f0d-a190-49c7-ba36-a6793a635026 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:33.055109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3f0d-a190-49c7-ba36-a6793a635026 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:33.061143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08099a2-59dd-4012-b8ce-0229619d582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:33.061880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08099a2-59dd-4012-b8ce-0229619d582c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:33.062164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08099a2-59dd-4012-b8ce-0229619d582c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:33.062552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08099a2-59dd-4012-b8ce-0229619d582c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:33.063335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08099a2-59dd-4012-b8ce-0229619d582c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:33.065770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08099a2-59dd-4012-b8ce-0229619d582c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:33.077937 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1484/2973] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:55:33.083292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288c44f-d684-406f-9ed3-944e6e75004c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:33.097576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288c44f-d684-406f-9ed3-944e6e75004c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:33.105464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d9ab1-4cfa-4932-a78b-0d172fa65cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:33.106314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d9ab1-4cfa-4932-a78b-0d172fa65cca admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:33.106567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d9ab1-4cfa-4932-a78b-0d172fa65cca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:33.106845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d9ab1-4cfa-4932-a78b-0d172fa65cca admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:33.108155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d9ab1-4cfa-4932-a78b-0d172fa65cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:33.110458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d9ab1-4cfa-4932-a78b-0d172fa65cca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:33.128048 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1490/2974] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:33.132210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08099a2-59dd-4012-b8ce-0229619d582c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:33.146144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08099a2-59dd-4012-b8ce-0229619d582c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:33.152921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:33.153749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:33.154121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:33.154404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] PATH_INFO: `/v3/projects/07730507b50b4050bd8a83933845823e/users/42169857eb434258a4e925c8161dbed5/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:33.188072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07730507b50b4050bd8a83933845823e, user_id=42169857eb434258a4e925c8161dbed5, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:33.192770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:33.218437 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1485/2975] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:33 2022] PUT /identity/v3/projects/07730507b50b4050bd8a83933845823e/users/42169857eb434258a4e925c8161dbed5/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:33.224528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8c78-b7f7-4720-bd7a-4e1ee55159aa None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:33.224955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8c78-b7f7-4720-bd7a-4e1ee55159aa None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:33.225765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8c78-b7f7-4720-bd7a-4e1ee55159aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:33.257029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-38cd8c78-b7f7-4720-bd7a-4e1ee55159aa None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:33.258788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38cd8c78-b7f7-4720-bd7a-4e1ee55159aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:33.405341 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1491/2976] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:55:33.416971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:33.420886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:33.525251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02315a7d-fa1d-4469-a623-68db56ce0186 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:33.529687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:33.530821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:33.531347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:33.531841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:33.545986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:33.548185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:33.560437 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1486/2977] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:33.970161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8c78-b7f7-4720-bd7a-4e1ee55159aa None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:33.972382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38cd8c78-b7f7-4720-bd7a-4e1ee55159aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:33.991027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8c78-b7f7-4720-bd7a-4e1ee55159aa None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:34.002166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:34.003938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:34.004221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:34.005033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:34.013228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:34.033058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:34.035549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:34.047487 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1492/2978] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:35.579329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:35.581871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:35.768846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300774c2-b987-4816-a21a-65fe6caffb09 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:35.794172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545dee7-e4df-48a5-b289-95ad311f8f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:35.795167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545dee7-e4df-48a5-b289-95ad311f8f74 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:35.795881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545dee7-e4df-48a5-b289-95ad311f8f74 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:35.796373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545dee7-e4df-48a5-b289-95ad311f8f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:35.798890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f545dee7-e4df-48a5-b289-95ad311f8f74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:35.816534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545dee7-e4df-48a5-b289-95ad311f8f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:35.818959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545dee7-e4df-48a5-b289-95ad311f8f74 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:35.833858 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1487/2979] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:36.046441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:36.048180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:36.075651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78730012-b618-45a7-9bfa-a93b99b1313f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:36.101314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:36.102512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:36.103347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:36.103785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] PATH_INFO: `/v3/users/076a0cb931aa4bcd8c4b4d95c387fb4c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:36.109111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=076a0cb931aa4bcd8c4b4d95c387fb4c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:36.111972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:36.193326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076a0cb931aa4bcd8c4b4d95c387fb4c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:36.210406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076a0cb931aa4bcd8c4b4d95c387fb4c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:36.224369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076a0cb931aa4bcd8c4b4d95c387fb4c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:36.227362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076a0cb931aa4bcd8c4b4d95c387fb4c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:36.229774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076a0cb931aa4bcd8c4b4d95c387fb4c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:36.256459 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1493/2980] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:36 2022] DELETE /identity/v3/users/076a0cb931aa4bcd8c4b4d95c387fb4c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:36.261772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8912ae-25bb-48cc-8890-05015f70e5dc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:36.262399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8912ae-25bb-48cc-8890-05015f70e5dc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:36.262890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8912ae-25bb-48cc-8890-05015f70e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:36.301479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4d8912ae-25bb-48cc-8890-05015f70e5dc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:36.305143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4d8912ae-25bb-48cc-8890-05015f70e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:36.460597 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1488/2981] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:36.468593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:36.471046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:36.606203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cf21a-001e-4cb5-bda3-f2af9298d112 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:36.613258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083991c6-e20a-41e8-b057-bd322b8a4b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:36.614179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083991c6-e20a-41e8-b057-bd322b8a4b82 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:36.615331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083991c6-e20a-41e8-b057-bd322b8a4b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:36.615592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083991c6-e20a-41e8-b057-bd322b8a4b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:36.637326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083991c6-e20a-41e8-b057-bd322b8a4b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:36.638802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083991c6-e20a-41e8-b057-bd322b8a4b82 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:36.666637 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1494/2982] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:37.051534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8912ae-25bb-48cc-8890-05015f70e5dc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:37.053482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4d8912ae-25bb-48cc-8890-05015f70e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:37.080282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8912ae-25bb-48cc-8890-05015f70e5dc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:37.095788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:37.098111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:37.098881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:37.099337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] PATH_INFO: `/v3/projects/756e52c91ebf4bc9bacebcc1431abb28` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:37.103001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=756e52c91ebf4bc9bacebcc1431abb28)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:37.106570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:37.216350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756e52c91ebf4bc9bacebcc1431abb28', 'request_id': 'req-02877cb5-a529-4518-9707-ac4a61d38015'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.223994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756e52c91ebf4bc9bacebcc1431abb28', 'request_id': 'req-02877cb5-a529-4518-9707-ac4a61d38015'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.239221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756e52c91ebf4bc9bacebcc1431abb28', 'request_id': 'req-02877cb5-a529-4518-9707-ac4a61d38015'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.267211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] The token cache is being invalidate because project 756e52c91ebf4bc9bacebcc1431abb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:37.269780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.271517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02877cb5-a529-4518-9707-ac4a61d38015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.275931 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1489/2983] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:37 2022] DELETE /identity/v3/projects/756e52c91ebf4bc9bacebcc1431abb28 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:37.280154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083991c6-e20a-41e8-b057-bd322b8a4b82 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:37.298688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083991c6-e20a-41e8-b057-bd322b8a4b82 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:37.460023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642325-aaa3-48e4-8a1c-5fdd62641ef0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:37.460621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642325-aaa3-48e4-8a1c-5fdd62641ef0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:37.461071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642325-aaa3-48e4-8a1c-5fdd62641ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:37.476091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:37.479960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:37.480436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:37.482440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] PATH_INFO: `/v3/users/c0c85377b4ee450381ddad97c3048adc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:37.488916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c85377b4ee450381ddad97c3048adc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:37.496937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:37.514749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-19642325-aaa3-48e4-8a1c-5fdd62641ef0 None None] MFA Rules not processed for user `ab3fa7eadddf42b4b700593dad828e44`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:37.517596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-19642325-aaa3-48e4-8a1c-5fdd62641ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:37.610003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c85377b4ee450381ddad97c3048adc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.652660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c85377b4ee450381ddad97c3048adc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.659750 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1490/2984] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:37.672297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c85377b4ee450381ddad97c3048adc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.680357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c85377b4ee450381ddad97c3048adc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.681956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-850d2dec-fbeb-479c-acd4-ea336b9a3e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c85377b4ee450381ddad97c3048adc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:37.709687 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1495/2985] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:37 2022] DELETE /identity/v3/users/c0c85377b4ee450381ddad97c3048adc => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:38.756587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19642325-aaa3-48e4-8a1c-5fdd62641ef0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:38.758243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-19642325-aaa3-48e4-8a1c-5fdd62641ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:38.801543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19642325-aaa3-48e4-8a1c-5fdd62641ef0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:38.932614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:38.937894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:38.938482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:38.939463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] PATH_INFO: `/v3/projects/166cb17d87cc4b648b91c4fc60947b5f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:38.945333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=166cb17d87cc4b648b91c4fc60947b5f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:38.948440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:39.071591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166cb17d87cc4b648b91c4fc60947b5f', 'request_id': 'req-eb9f0a47-f558-421c-9af8-554467fcfce0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:39.084959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166cb17d87cc4b648b91c4fc60947b5f', 'request_id': 'req-eb9f0a47-f558-421c-9af8-554467fcfce0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:39.111475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166cb17d87cc4b648b91c4fc60947b5f', 'request_id': 'req-eb9f0a47-f558-421c-9af8-554467fcfce0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:39.127956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] The token cache is being invalidate because project 166cb17d87cc4b648b91c4fc60947b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:39.128412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:39.129496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-eb9f0a47-f558-421c-9af8-554467fcfce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:39.133321 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1491/2986] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:38 2022] DELETE /identity/v3/projects/166cb17d87cc4b648b91c4fc60947b5f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:39.136868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f54b6-12e7-421f-b74c-e9dfd34a4ed6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.138584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f54b6-12e7-421f-b74c-e9dfd34a4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.138584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f54b6-12e7-421f-b74c-e9dfd34a4ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.163401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-416f54b6-12e7-421f-b74c-e9dfd34a4ed6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:39.165490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-416f54b6-12e7-421f-b74c-e9dfd34a4ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:39.261413 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1496/2987] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:39.269884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef4301-9b9d-497d-b9cc-c8577693a555 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.270931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef4301-9b9d-497d-b9cc-c8577693a555 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.271665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef4301-9b9d-497d-b9cc-c8577693a555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.298428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f9ef4301-9b9d-497d-b9cc-c8577693a555 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:39.299874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f9ef4301-9b9d-497d-b9cc-c8577693a555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:39.315632 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1492/2988] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:39.317108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f54b6-12e7-421f-b74c-e9dfd34a4ed6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:39.330538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f54b6-12e7-421f-b74c-e9dfd34a4ed6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:39.345116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:39.345803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.346345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.346870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.347861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:55:39.348361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:39.352542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:39.378010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef4301-9b9d-497d-b9cc-c8577693a555 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:39.384211 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1497/2989] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:55:39.388953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef4301-9b9d-497d-b9cc-c8577693a555 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:39.394791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5eb42-e63e-4603-9f7e-864c6a705a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:39.395757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5eb42-e63e-4603-9f7e-864c6a705a60 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.396188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5eb42-e63e-4603-9f7e-864c6a705a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.397023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5eb42-e63e-4603-9f7e-864c6a705a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.398080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5eb42-e63e-4603-9f7e-864c6a705a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:39.400193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5eb42-e63e-4603-9f7e-864c6a705a60 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:39.458991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:39.469986 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1493/2990] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:39 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:39.471916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0da0ed-516b-41b0-9287-e57daf609546 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:39.564832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea61c-b40a-4117-8019-ceb1fae3d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:39.566476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea61c-b40a-4117-8019-ceb1fae3d2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.567090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea61c-b40a-4117-8019-ceb1fae3d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.567680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea61c-b40a-4117-8019-ceb1fae3d2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.568654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ea61c-b40a-4117-8019-ceb1fae3d2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:39.570804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ea61c-b40a-4117-8019-ceb1fae3d2f1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:39.608108 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1498/2991] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:39 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:39.613704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5eb42-e63e-4603-9f7e-864c6a705a60 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:39.628575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5eb42-e63e-4603-9f7e-864c6a705a60 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:39.646235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1d2a-531e-4956-862b-47df686b42f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:39.646929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1d2a-531e-4956-862b-47df686b42f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.647294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1d2a-531e-4956-862b-47df686b42f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.647561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1d2a-531e-4956-862b-47df686b42f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.648403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e1d2a-531e-4956-862b-47df686b42f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:39.650096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e1d2a-531e-4956-862b-47df686b42f5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:39.679284 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1494/2992] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:39.686644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea61c-b40a-4117-8019-ceb1fae3d2f1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:39.701981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea61c-b40a-4117-8019-ceb1fae3d2f1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:39.711121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e76a58-048d-4bf4-b78e-a62289da6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:39.711910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76a58-048d-4bf4-b78e-a62289da6e3c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.713428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76a58-048d-4bf4-b78e-a62289da6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.713868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e76a58-048d-4bf4-b78e-a62289da6e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.718783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e76a58-048d-4bf4-b78e-a62289da6e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:39.722118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e76a58-048d-4bf4-b78e-a62289da6e3c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:39.751032 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1499/2993] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:39.752224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1d2a-531e-4956-862b-47df686b42f5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:39.766290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1d2a-531e-4956-862b-47df686b42f5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:39.779141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360bb95-a4a7-43fb-85e3-f33172495520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:39.780237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360bb95-a4a7-43fb-85e3-f33172495520 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.780570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360bb95-a4a7-43fb-85e3-f33172495520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.780857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360bb95-a4a7-43fb-85e3-f33172495520 admin admin] PATH_INFO: `/v3/projects/b19698456a82425ea00402284be14a6c/users/db901f4355f14e299e182ff4691007bc/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.807717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360bb95-a4a7-43fb-85e3-f33172495520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19698456a82425ea00402284be14a6c, user_id=db901f4355f14e299e182ff4691007bc, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:39.811340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360bb95-a4a7-43fb-85e3-f33172495520 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:39.862141 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1495/2994] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:39 2022] PUT /identity/v3/projects/b19698456a82425ea00402284be14a6c/users/db901f4355f14e299e182ff4691007bc/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:39.871423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84232fb9-15cd-4519-b08d-8faad45c30d5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:39.874015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84232fb9-15cd-4519-b08d-8faad45c30d5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:39.874517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84232fb9-15cd-4519-b08d-8faad45c30d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:39.945012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-84232fb9-15cd-4519-b08d-8faad45c30d5 None None] MFA Rules not processed for user `db901f4355f14e299e182ff4691007bc`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:39.947861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-84232fb9-15cd-4519-b08d-8faad45c30d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:40.140212 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1500/2995] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:40.145903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360bb95-a4a7-43fb-85e3-f33172495520 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:40.260217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360bb95-a4a7-43fb-85e3-f33172495520 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:40.270516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9e02-f066-471c-92ed-30bb2551cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:40.271752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9e02-f066-471c-92ed-30bb2551cf9c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:40.272101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9e02-f066-471c-92ed-30bb2551cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:40.272957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9e02-f066-471c-92ed-30bb2551cf9c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:40.274829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd9e02-f066-471c-92ed-30bb2551cf9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:40.279960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd9e02-f066-471c-92ed-30bb2551cf9c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:40.351820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84232fb9-15cd-4519-b08d-8faad45c30d5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:40.363592 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1496/2996] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:40 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:40.368885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84232fb9-15cd-4519-b08d-8faad45c30d5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:40.514427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0564b-9b07-494a-93c5-c2886508eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:40.515443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0564b-9b07-494a-93c5-c2886508eaed admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:40.516008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0564b-9b07-494a-93c5-c2886508eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:40.516565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0564b-9b07-494a-93c5-c2886508eaed admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:40.517538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0564b-9b07-494a-93c5-c2886508eaed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:40.522308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0564b-9b07-494a-93c5-c2886508eaed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:40.570779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9e02-f066-471c-92ed-30bb2551cf9c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:40.571199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1501/2997] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:40 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:40.586434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9e02-f066-471c-92ed-30bb2551cf9c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:40.599107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb2f67-730f-4320-ad3d-a9e9d7a9c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:40.600602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2f67-730f-4320-ad3d-a9e9d7a9c393 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:40.601311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2f67-730f-4320-ad3d-a9e9d7a9c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:40.601782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2f67-730f-4320-ad3d-a9e9d7a9c393 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:40.602776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb2f67-730f-4320-ad3d-a9e9d7a9c393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:40.607445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb2f67-730f-4320-ad3d-a9e9d7a9c393 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:40.663669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0564b-9b07-494a-93c5-c2886508eaed admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:40.673209 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1497/2998] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:40.688202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0564b-9b07-494a-93c5-c2886508eaed admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:40.724783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b4a8-2448-4242-9045-f75993f939f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:40.729035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b4a8-2448-4242-9045-f75993f939f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:40.729035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b4a8-2448-4242-9045-f75993f939f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:40.729035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b4a8-2448-4242-9045-f75993f939f7 admin admin] PATH_INFO: `/v3/projects/2fc1f684a7ab40a993960fc7def6df16/users/b3e499904b7e421d823d2a76b5b197ab/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:40.783133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2b4a8-2448-4242-9045-f75993f939f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc1f684a7ab40a993960fc7def6df16, user_id=b3e499904b7e421d823d2a76b5b197ab, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:40.787661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2b4a8-2448-4242-9045-f75993f939f7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:40.830792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb2f67-730f-4320-ad3d-a9e9d7a9c393 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:40.831370 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1502/2999] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:40 2022] PUT /identity/v3/projects/2fc1f684a7ab40a993960fc7def6df16/users/b3e499904b7e421d823d2a76b5b197ab/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:40.853199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb2f67-730f-4320-ad3d-a9e9d7a9c393 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:40.986494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc270417-f68d-47b8-b626-2e0a33ffdbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:40.988907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270417-f68d-47b8-b626-2e0a33ffdbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:40.989279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270417-f68d-47b8-b626-2e0a33ffdbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:40.989836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270417-f68d-47b8-b626-2e0a33ffdbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:40.991751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc270417-f68d-47b8-b626-2e0a33ffdbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:40.993559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc270417-f68d-47b8-b626-2e0a33ffdbe0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:41.016150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b4a8-2448-4242-9045-f75993f939f7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:41.016679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1498/3000] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:41.031478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b4a8-2448-4242-9045-f75993f939f7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:41.037264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b256-d914-4a8c-b81e-dda68af23eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:41.038325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b256-d914-4a8c-b81e-dda68af23eff admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:41.038901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b256-d914-4a8c-b81e-dda68af23eff admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:41.039334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b256-d914-4a8c-b81e-dda68af23eff admin admin] PATH_INFO: `/v3/projects/2fc1f684a7ab40a993960fc7def6df16/users/b3e499904b7e421d823d2a76b5b197ab/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:41.041791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6b256-d914-4a8c-b81e-dda68af23eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc1f684a7ab40a993960fc7def6df16, user_id=b3e499904b7e421d823d2a76b5b197ab, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:41.044716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6b256-d914-4a8c-b81e-dda68af23eff admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:41.062748 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1503/3001] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:41 2022] PUT /identity/v3/projects/2fc1f684a7ab40a993960fc7def6df16/users/b3e499904b7e421d823d2a76b5b197ab/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:41.079748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8948-caa1-49d0-b5bb-e7cb37ac796c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:41.080432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8948-caa1-49d0-b5bb-e7cb37ac796c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:41.080835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8948-caa1-49d0-b5bb-e7cb37ac796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:41.131311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-046f8948-caa1-49d0-b5bb-e7cb37ac796c None None] MFA Rules not processed for user `b3e499904b7e421d823d2a76b5b197ab`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:41.133987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-046f8948-caa1-49d0-b5bb-e7cb37ac796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:41.248392 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1499/3002] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:41.258707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789373d1-ee9a-4e00-a732-6d655d43240b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:41.259206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789373d1-ee9a-4e00-a732-6d655d43240b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:41.259292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789373d1-ee9a-4e00-a732-6d655d43240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:41.327735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-789373d1-ee9a-4e00-a732-6d655d43240b None None] MFA Rules not processed for user `42169857eb434258a4e925c8161dbed5`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:41.329425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-789373d1-ee9a-4e00-a732-6d655d43240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:41.408371 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1504/3003] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:41.524102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8948-caa1-49d0-b5bb-e7cb37ac796c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:41.526036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-046f8948-caa1-49d0-b5bb-e7cb37ac796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:41.679638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8948-caa1-49d0-b5bb-e7cb37ac796c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:41.689772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:41.695471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:41.698077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:41.698615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:41.723596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:41.729804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:41.753999 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1500/3004] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:41.815886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789373d1-ee9a-4e00-a732-6d655d43240b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:41.845886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789373d1-ee9a-4e00-a732-6d655d43240b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:41.854740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:41.856467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:41.857511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:41.857511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:41.871115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:41.873277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:41.890204 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1505/3005] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:42.433997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:42.435896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:42.454958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f922-6403-4fc5-8292-ec3f96347bdc service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:42.463861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a3a4c-8f0b-4bfc-8cfb-4c6d6a67c0be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:42.469504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a3a4c-8f0b-4bfc-8cfb-4c6d6a67c0be service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:42.470746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a3a4c-8f0b-4bfc-8cfb-4c6d6a67c0be service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:42.477513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a3a4c-8f0b-4bfc-8cfb-4c6d6a67c0be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:42.627410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a3a4c-8f0b-4bfc-8cfb-4c6d6a67c0be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:42.634238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a3a4c-8f0b-4bfc-8cfb-4c6d6a67c0be service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:42.667137 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1501/3006] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:46.579876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:46.582007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:46.699936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8cfe1-5f99-4338-aed6-bd54fcc6c959 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:46.709890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:46.714829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:46.715478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:46.716105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] PATH_INFO: `/v3/users/ec1a2a2db19c41cca4342aa082770a96` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:46.719131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1a2a2db19c41cca4342aa082770a96)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:46.725133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:46.853728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1a2a2db19c41cca4342aa082770a96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:46.890957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1a2a2db19c41cca4342aa082770a96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:46.906217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1a2a2db19c41cca4342aa082770a96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:46.907140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1a2a2db19c41cca4342aa082770a96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:46.908021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1a2a2db19c41cca4342aa082770a96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:46.929025 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1506/3007] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:46 2022] DELETE /identity/v3/users/ec1a2a2db19c41cca4342aa082770a96 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:47.326065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a3a4c-8f0b-4bfc-8cfb-4c6d6a67c0be service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:47.339521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a3a4c-8f0b-4bfc-8cfb-4c6d6a67c0be service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:47.468798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:47.470825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:47.478619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:47.479692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:47.480076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:47.480853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] PATH_INFO: `/v3/projects/a6f02f88286b49babe665db9d00787a2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:47.482401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f02f88286b49babe665db9d00787a2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:47.484769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:47.563348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f02f88286b49babe665db9d00787a2', 'request_id': 'req-9d29f539-98f1-443a-9f62-61164d13d1dd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.576180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f02f88286b49babe665db9d00787a2', 'request_id': 'req-9d29f539-98f1-443a-9f62-61164d13d1dd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.589712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad91c0-daa9-43e4-9d39-fc1c22e4034d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:47.596544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f02f88286b49babe665db9d00787a2', 'request_id': 'req-9d29f539-98f1-443a-9f62-61164d13d1dd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.614359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] The token cache is being invalidate because project a6f02f88286b49babe665db9d00787a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:47.614631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.615771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.623589 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1502/3008] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:47 2022] DELETE /identity/v3/projects/a6f02f88286b49babe665db9d00787a2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:47.625656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:47.629295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:47.730031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:47.730946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:47.731231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:47.731509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] PATH_INFO: `/v3/users/db901f4355f14e299e182ff4691007bc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:47.732834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=db901f4355f14e299e182ff4691007bc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:47.735213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:47.778727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f539-98f1-443a-9f62-61164d13d1dd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:47.788018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:47.789353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:47.789483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:47.790161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] PATH_INFO: `/v3/users/f5aab6790464416b85cee1a9996d6a31` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:47.791164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aab6790464416b85cee1a9996d6a31)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:47.793735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:47.827320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db901f4355f14e299e182ff4691007bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.844601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db901f4355f14e299e182ff4691007bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.871365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aab6790464416b85cee1a9996d6a31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.872929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aab6790464416b85cee1a9996d6a31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.873575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aab6790464416b85cee1a9996d6a31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.874652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db901f4355f14e299e182ff4691007bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.876960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db901f4355f14e299e182ff4691007bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.878660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d772178a-2363-4f31-a02d-f3bc249175ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db901f4355f14e299e182ff4691007bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.900079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aab6790464416b85cee1a9996d6a31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.912914 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1507/3009] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:47 2022] DELETE /identity/v3/users/db901f4355f14e299e182ff4691007bc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:47.914859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c1d7-aa32-4d13-a9e8-c7c86cb5b782 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:47.915195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c1d7-aa32-4d13-a9e8-c7c86cb5b782 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:47.915648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c1d7-aa32-4d13-a9e8-c7c86cb5b782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:47.921074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aab6790464416b85cee1a9996d6a31'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:47.937218 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1503/3010] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:47 2022] DELETE /identity/v3/users/f5aab6790464416b85cee1a9996d6a31 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:47.950377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fe60c1d7-aa32-4d13-a9e8-c7c86cb5b782 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:47.951878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe60c1d7-aa32-4d13-a9e8-c7c86cb5b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:48.061973 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1508/3011] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:48.091509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:48.093259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:48.158539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d76a7a-ba57-43ec-8d69-27a91eff587a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:48.190140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f9b2-5262-4375-bbfa-22addc0f16e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:48.191041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f9b2-5262-4375-bbfa-22addc0f16e0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:48.191472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f9b2-5262-4375-bbfa-22addc0f16e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:48.191929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f9b2-5262-4375-bbfa-22addc0f16e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:48.206645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f9b2-5262-4375-bbfa-22addc0f16e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:48.208622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f9b2-5262-4375-bbfa-22addc0f16e0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:48.221935 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1504/3012] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:48.394281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60c1d7-aa32-4d13-a9e8-c7c86cb5b782 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:48.397182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe60c1d7-aa32-4d13-a9e8-c7c86cb5b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:48.423051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60c1d7-aa32-4d13-a9e8-c7c86cb5b782 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:48.431838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:48.433174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:48.435096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:48.435612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] PATH_INFO: `/v3/projects/49cea17e4a9b45f388e8d8b4bf2b42f4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:48.437827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cea17e4a9b45f388e8d8b4bf2b42f4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:48.442081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:48.530814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cea17e4a9b45f388e8d8b4bf2b42f4', 'request_id': 'req-db628390-58dd-4914-8fe7-5b1644a7e290'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.540211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cea17e4a9b45f388e8d8b4bf2b42f4', 'request_id': 'req-db628390-58dd-4914-8fe7-5b1644a7e290'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.551501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cea17e4a9b45f388e8d8b4bf2b42f4', 'request_id': 'req-db628390-58dd-4914-8fe7-5b1644a7e290'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.563774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] The token cache is being invalidate because project 49cea17e4a9b45f388e8d8b4bf2b42f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:48.564073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.565369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db628390-58dd-4914-8fe7-5b1644a7e290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.570240 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1509/3013] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:48 2022] DELETE /identity/v3/projects/49cea17e4a9b45f388e8d8b4bf2b42f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:48.571932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039cff-47cd-4739-abf2-f3c776b13b30 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:48.573294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039cff-47cd-4739-abf2-f3c776b13b30 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:48.573586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039cff-47cd-4739-abf2-f3c776b13b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:48.594432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d9039cff-47cd-4739-abf2-f3c776b13b30 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:48.595873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d9039cff-47cd-4739-abf2-f3c776b13b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:48.670360 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1505/3014] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:55:48.678442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a061f9-f5da-49e5-8cb9-8f645eebcd1f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:48.679032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a061f9-f5da-49e5-8cb9-8f645eebcd1f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:48.679032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a061f9-f5da-49e5-8cb9-8f645eebcd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:48.715559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-00a061f9-f5da-49e5-8cb9-8f645eebcd1f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:48.720293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039cff-47cd-4739-abf2-f3c776b13b30 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:48.720727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00a061f9-f5da-49e5-8cb9-8f645eebcd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:48.722603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d9039cff-47cd-4739-abf2-f3c776b13b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:48.735911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039cff-47cd-4739-abf2-f3c776b13b30 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:48.737800 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1510/3015] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:48.747607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:48.748591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:48.748874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:48.749152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] PATH_INFO: `/v3/projects/b19698456a82425ea00402284be14a6c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:48.749362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a061f9-f5da-49e5-8cb9-8f645eebcd1f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:48.750397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19698456a82425ea00402284be14a6c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:48.752413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:48.770677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a061f9-f5da-49e5-8cb9-8f645eebcd1f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:48.776695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:48.778160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:48.778536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:48.778828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:48.780463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:55:48.781494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:48.784366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:48.797670 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1511/3016] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:55:48.802499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:48.813216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb5aa-ef4b-4578-86fb-ccc7eade095d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:48.817951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19698456a82425ea00402284be14a6c', 'request_id': 'req-a7561028-d1bc-4811-81d7-7e861d22f32d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.823870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19698456a82425ea00402284be14a6c', 'request_id': 'req-a7561028-d1bc-4811-81d7-7e861d22f32d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.835803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19698456a82425ea00402284be14a6c', 'request_id': 'req-a7561028-d1bc-4811-81d7-7e861d22f32d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.849125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] The token cache is being invalidate because project b19698456a82425ea00402284be14a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:48.849473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.850179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:48.851806 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1506/3017] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:48 2022] DELETE /identity/v3/projects/b19698456a82425ea00402284be14a6c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:48.855757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:48.857235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:48.880610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:48.881347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:48.882000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:48.883321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:48.884099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:48.886108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:48.918862 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1512/3018] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:48 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:55:48.920180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:48.921899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:48.933504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7561028-d1bc-4811-81d7-7e861d22f32d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:48.995241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e824a-7f28-48f6-abda-8e3d2a27174e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:49.001165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d81f5e-08df-4e6c-af8e-e9debd1f9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.002645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81f5e-08df-4e6c-af8e-e9debd1f9320 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.002937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81f5e-08df-4e6c-af8e-e9debd1f9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.003227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81f5e-08df-4e6c-af8e-e9debd1f9320 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.003978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d81f5e-08df-4e6c-af8e-e9debd1f9320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.004977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.006308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.006464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d81f5e-08df-4e6c-af8e-e9debd1f9320 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.006567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.006816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] PATH_INFO: `/v3/users/b3e499904b7e421d823d2a76b5b197ab` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.008344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e499904b7e421d823d2a76b5b197ab)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.011670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.030898 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1513/3019] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:48 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:49.035304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d81f5e-08df-4e6c-af8e-e9debd1f9320 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:49.045879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d81f5e-08df-4e6c-af8e-e9debd1f9320 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:49.063892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.065331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.065617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.065920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.067265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.068494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e499904b7e421d823d2a76b5b197ab'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.069339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.069462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e499904b7e421d823d2a76b5b197ab'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.070106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e499904b7e421d823d2a76b5b197ab'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.088304 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1514/3020] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:55:49.088552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e499904b7e421d823d2a76b5b197ab'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.089564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:49.091781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:49.097636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e499904b7e421d823d2a76b5b197ab'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.108355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89fa7c-aad4-4c21-a09f-267c7adbf82e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:49.115844 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1507/3021] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:48 2022] DELETE /identity/v3/users/b3e499904b7e421d823d2a76b5b197ab => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:49.121837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeb486-4414-40f5-996b-8150f92452c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.122857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb486-4414-40f5-996b-8150f92452c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.123351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb486-4414-40f5-996b-8150f92452c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.123848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb486-4414-40f5-996b-8150f92452c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.124884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aeb486-4414-40f5-996b-8150f92452c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.126822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aeb486-4414-40f5-996b-8150f92452c1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.139705 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1515/3022] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:55:49.143575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:49.242397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a095494-b24d-4b5b-980a-eeb012bd174c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:49.248084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.249274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.249558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.249840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] PATH_INFO: `/v3/projects/63acbd462dfc418fab3fbeedccacb9c7/users/0d694f3e8da440a9a1cac8ca2de030e8/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.265728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=63acbd462dfc418fab3fbeedccacb9c7, user_id=0d694f3e8da440a9a1cac8ca2de030e8, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.269128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.292933 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1508/3023] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:49 2022] PUT /identity/v3/projects/63acbd462dfc418fab3fbeedccacb9c7/users/0d694f3e8da440a9a1cac8ca2de030e8/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:49.294590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723700c-f5ed-4811-8d5a-9d6aaa014537 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.295299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723700c-f5ed-4811-8d5a-9d6aaa014537 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.295299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723700c-f5ed-4811-8d5a-9d6aaa014537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.319536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e723700c-f5ed-4811-8d5a-9d6aaa014537 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:49.321067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e723700c-f5ed-4811-8d5a-9d6aaa014537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:49.401048 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1516/3024] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:49.414712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:49.417225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:49.502581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723700c-f5ed-4811-8d5a-9d6aaa014537 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:49.504038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e723700c-f5ed-4811-8d5a-9d6aaa014537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:49.505027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffa620-5586-4149-bd36-3648bc4388fc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:49.510202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fa79b-a9b0-4d3c-82a5-c1915e0eff0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.511815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fa79b-a9b0-4d3c-82a5-c1915e0eff0e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.512109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fa79b-a9b0-4d3c-82a5-c1915e0eff0e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.512430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fa79b-a9b0-4d3c-82a5-c1915e0eff0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.525308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fa79b-a9b0-4d3c-82a5-c1915e0eff0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.526778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fa79b-a9b0-4d3c-82a5-c1915e0eff0e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.535452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723700c-f5ed-4811-8d5a-9d6aaa014537 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:49.541794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.542926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.543174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.543447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] PATH_INFO: `/v3/projects/2fc1f684a7ab40a993960fc7def6df16` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.544919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc1f684a7ab40a993960fc7def6df16)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.545416 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1509/3025] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:49.546971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.599484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc1f684a7ab40a993960fc7def6df16', 'request_id': 'req-00a62e28-7199-4ae5-a964-4cca7006c3ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.605816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc1f684a7ab40a993960fc7def6df16', 'request_id': 'req-00a62e28-7199-4ae5-a964-4cca7006c3ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.617477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc1f684a7ab40a993960fc7def6df16', 'request_id': 'req-00a62e28-7199-4ae5-a964-4cca7006c3ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.630995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] The token cache is being invalidate because project 2fc1f684a7ab40a993960fc7def6df16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:49.631606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.632312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a62e28-7199-4ae5-a964-4cca7006c3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:49.638977 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1517/3026] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:49 2022] DELETE /identity/v3/projects/2fc1f684a7ab40a993960fc7def6df16 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:49.640384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab45786-09d7-476f-933c-94cd018ff1c7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.640886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab45786-09d7-476f-933c-94cd018ff1c7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.641031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab45786-09d7-476f-933c-94cd018ff1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.666108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5ab45786-09d7-476f-933c-94cd018ff1c7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:49.667762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5ab45786-09d7-476f-933c-94cd018ff1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:49.746885 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1510/3027] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:49.761865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3272b0-62ae-45b1-ba5b-060e00bb046e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.762338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3272b0-62ae-45b1-ba5b-060e00bb046e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.762684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3272b0-62ae-45b1-ba5b-060e00bb046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.785498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7d3272b0-62ae-45b1-ba5b-060e00bb046e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:49.786734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d3272b0-62ae-45b1-ba5b-060e00bb046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:49.797883 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1518/3028] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:49.802958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab45786-09d7-476f-933c-94cd018ff1c7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:49.813538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab45786-09d7-476f-933c-94cd018ff1c7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:49.821797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.822684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.822926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.823261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.824215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:55:49.824572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.826805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.843610 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1511/3029] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:55:49.845058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3272b0-62ae-45b1-ba5b-060e00bb046e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:49.856920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3272b0-62ae-45b1-ba5b-060e00bb046e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:49.863281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe89017-2310-4db9-8311-ccd95bfe563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:49.864044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe89017-2310-4db9-8311-ccd95bfe563c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:49.864594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe89017-2310-4db9-8311-ccd95bfe563c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:49.865098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe89017-2310-4db9-8311-ccd95bfe563c admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:49.865858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe89017-2310-4db9-8311-ccd95bfe563c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:49.867980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe89017-2310-4db9-8311-ccd95bfe563c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:49.904524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1519/3030] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:49 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:49.905193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:49.932863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad47b5-50d9-4e48-9efd-afbb8e3207c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.009633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138b45a-7ccf-4cca-96b1-b994e87f12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.010301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138b45a-7ccf-4cca-96b1-b994e87f12d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.010580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138b45a-7ccf-4cca-96b1-b994e87f12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.010857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138b45a-7ccf-4cca-96b1-b994e87f12d5 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.011559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138b45a-7ccf-4cca-96b1-b994e87f12d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.013492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138b45a-7ccf-4cca-96b1-b994e87f12d5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.036583 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1512/3031] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:49 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:50.041101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe89017-2310-4db9-8311-ccd95bfe563c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.052424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe89017-2310-4db9-8311-ccd95bfe563c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.057371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9189d-4ea5-408a-a7ec-2a0b95bc0f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.058066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9189d-4ea5-408a-a7ec-2a0b95bc0f4e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.058350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9189d-4ea5-408a-a7ec-2a0b95bc0f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.058623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9189d-4ea5-408a-a7ec-2a0b95bc0f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.059341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9189d-4ea5-408a-a7ec-2a0b95bc0f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.060973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9189d-4ea5-408a-a7ec-2a0b95bc0f4e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.073076 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1520/3032] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:55:50.077614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138b45a-7ccf-4cca-96b1-b994e87f12d5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.087128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138b45a-7ccf-4cca-96b1-b994e87f12d5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.092410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8394-df92-4844-9e88-8bd230481f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.093141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8394-df92-4844-9e88-8bd230481f43 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.094135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8394-df92-4844-9e88-8bd230481f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.094135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8394-df92-4844-9e88-8bd230481f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.094590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8394-df92-4844-9e88-8bd230481f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.096881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8394-df92-4844-9e88-8bd230481f43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.107212 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1513/3033] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:50.111343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9189d-4ea5-408a-a7ec-2a0b95bc0f4e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.122182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9189d-4ea5-408a-a7ec-2a0b95bc0f4e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.126826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0190bb-86da-46db-82f1-bf524cff8059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.127895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0190bb-86da-46db-82f1-bf524cff8059 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.128244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0190bb-86da-46db-82f1-bf524cff8059 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.128585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0190bb-86da-46db-82f1-bf524cff8059 admin admin] PATH_INFO: `/v3/projects/f74599f5d93247128d6eed7dfd59bdd8/users/c435f34d4a004b219b62a33caf970841/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.144681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0190bb-86da-46db-82f1-bf524cff8059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74599f5d93247128d6eed7dfd59bdd8, user_id=c435f34d4a004b219b62a33caf970841, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.147297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0190bb-86da-46db-82f1-bf524cff8059 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.162273 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1521/3034] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:50 2022] PUT /identity/v3/projects/f74599f5d93247128d6eed7dfd59bdd8/users/c435f34d4a004b219b62a33caf970841/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:50.172704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaca52-dbd8-4144-8153-e6e70a7f86ec None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.172998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaca52-dbd8-4144-8153-e6e70a7f86ec None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.173411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaca52-dbd8-4144-8153-e6e70a7f86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.215699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-edaaca52-dbd8-4144-8153-e6e70a7f86ec None None] MFA Rules not processed for user `c435f34d4a004b219b62a33caf970841`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:50.217007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-edaaca52-dbd8-4144-8153-e6e70a7f86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:50.286561 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1514/3035] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:50.291062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0190bb-86da-46db-82f1-bf524cff8059 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.363066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0190bb-86da-46db-82f1-bf524cff8059 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.368578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e219-34fd-482a-a833-62bf81776a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.369273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e219-34fd-482a-a833-62bf81776a50 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.369559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e219-34fd-482a-a833-62bf81776a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.369841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e219-34fd-482a-a833-62bf81776a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.370599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3e219-34fd-482a-a833-62bf81776a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.372638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3e219-34fd-482a-a833-62bf81776a50 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.398571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1522/3036] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:50 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:55:50.402564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaca52-dbd8-4144-8153-e6e70a7f86ec None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.414351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaca52-dbd8-4144-8153-e6e70a7f86ec None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.480891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b97d-0873-4917-877c-cc192b8ab093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.481573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b97d-0873-4917-877c-cc192b8ab093 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.481853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b97d-0873-4917-877c-cc192b8ab093 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.482127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b97d-0873-4917-877c-cc192b8ab093 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.482832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1b97d-0873-4917-877c-cc192b8ab093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.484914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1b97d-0873-4917-877c-cc192b8ab093 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.506298 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1515/3037] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:50 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:50.510442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e219-34fd-482a-a833-62bf81776a50 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.521240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e219-34fd-482a-a833-62bf81776a50 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.525961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916b762-ce38-4052-a4ed-c02120ed3c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.526624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b762-ce38-4052-a4ed-c02120ed3c58 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.526910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b762-ce38-4052-a4ed-c02120ed3c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.527191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b762-ce38-4052-a4ed-c02120ed3c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.527909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916b762-ce38-4052-a4ed-c02120ed3c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.529532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916b762-ce38-4052-a4ed-c02120ed3c58 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.540821 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1523/3038] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:50.545156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b97d-0873-4917-877c-cc192b8ab093 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.556230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b97d-0873-4917-877c-cc192b8ab093 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.561040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359c28e-9cd1-4d5e-aed9-909351242e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.561927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c28e-9cd1-4d5e-aed9-909351242e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.562208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c28e-9cd1-4d5e-aed9-909351242e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.562527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c28e-9cd1-4d5e-aed9-909351242e7b admin admin] PATH_INFO: `/v3/projects/09dac1ebed254b7eb708a2744966d19d/users/ee23354a7764475e86463f052771d935/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.578101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359c28e-9cd1-4d5e-aed9-909351242e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dac1ebed254b7eb708a2744966d19d, user_id=ee23354a7764475e86463f052771d935, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.580867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359c28e-9cd1-4d5e-aed9-909351242e7b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.595201 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1516/3039] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:50 2022] PUT /identity/v3/projects/09dac1ebed254b7eb708a2744966d19d/users/ee23354a7764475e86463f052771d935/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:50.600140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916b762-ce38-4052-a4ed-c02120ed3c58 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.610401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916b762-ce38-4052-a4ed-c02120ed3c58 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.673404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30fba7-c09e-416a-83a6-8dba6f816f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.674126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30fba7-c09e-416a-83a6-8dba6f816f7f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.674939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30fba7-c09e-416a-83a6-8dba6f816f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.675221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30fba7-c09e-416a-83a6-8dba6f816f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.675948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30fba7-c09e-416a-83a6-8dba6f816f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.677841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30fba7-c09e-416a-83a6-8dba6f816f7f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.697295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359c28e-9cd1-4d5e-aed9-909351242e7b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:50.700693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1524/3040] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:50.708933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359c28e-9cd1-4d5e-aed9-909351242e7b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:50.714691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87420dbe-fc68-4b25-b6a1-33295767c840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:50.716054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420dbe-fc68-4b25-b6a1-33295767c840 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.716054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420dbe-fc68-4b25-b6a1-33295767c840 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.716379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420dbe-fc68-4b25-b6a1-33295767c840 admin admin] PATH_INFO: `/v3/projects/09dac1ebed254b7eb708a2744966d19d/users/ee23354a7764475e86463f052771d935/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.719015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87420dbe-fc68-4b25-b6a1-33295767c840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dac1ebed254b7eb708a2744966d19d, user_id=ee23354a7764475e86463f052771d935, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:50.722131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87420dbe-fc68-4b25-b6a1-33295767c840 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:50.737960 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1517/3041] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:50 2022] PUT /identity/v3/projects/09dac1ebed254b7eb708a2744966d19d/users/ee23354a7764475e86463f052771d935/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:50.748800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fea95-761b-4572-b324-840f67ad85a5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.749093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fea95-761b-4572-b324-840f67ad85a5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.749371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fea95-761b-4572-b324-840f67ad85a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:50.778382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ac6fea95-761b-4572-b324-840f67ad85a5 None None] MFA Rules not processed for user `ee23354a7764475e86463f052771d935`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:50.779625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ac6fea95-761b-4572-b324-840f67ad85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:50.852661 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1525/3042] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:50.978136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d605c3-e96f-4d61-b1e7-2853a4ac5f21 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:50.978720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d605c3-e96f-4d61-b1e7-2853a4ac5f21 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:50.979276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d605c3-e96f-4d61-b1e7-2853a4ac5f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:51.015793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-23d605c3-e96f-4d61-b1e7-2853a4ac5f21 None None] MFA Rules not processed for user `0d694f3e8da440a9a1cac8ca2de030e8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:51.017090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-23d605c3-e96f-4d61-b1e7-2853a4ac5f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:51.096026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fea95-761b-4572-b324-840f67ad85a5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:51.098609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ac6fea95-761b-4572-b324-840f67ad85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:51.150059 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1518/3043] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:51.155133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d605c3-e96f-4d61-b1e7-2853a4ac5f21 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:51.162015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-23d605c3-e96f-4d61-b1e7-2853a4ac5f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:51.211625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fea95-761b-4572-b324-840f67ad85a5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:51.222162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028d9fa-c4d3-4745-bfb6-8aa2dd435081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:51.224002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d9fa-c4d3-4745-bfb6-8aa2dd435081 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:51.237783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d9fa-c4d3-4745-bfb6-8aa2dd435081 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:51.238326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d9fa-c4d3-4745-bfb6-8aa2dd435081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:51.254132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028d9fa-c4d3-4745-bfb6-8aa2dd435081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:51.256208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028d9fa-c4d3-4745-bfb6-8aa2dd435081 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:51.259874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d605c3-e96f-4d61-b1e7-2853a4ac5f21 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:51.268386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3835c1-ac2d-45db-b271-661146bfee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:51.269390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3835c1-ac2d-45db-b271-661146bfee78 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:51.269881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3835c1-ac2d-45db-b271-661146bfee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:51.270394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3835c1-ac2d-45db-b271-661146bfee78 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:51.271369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3835c1-ac2d-45db-b271-661146bfee78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:51.274765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3835c1-ac2d-45db-b271-661146bfee78 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:51.289189 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1526/3044] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:55:51.320412 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1519/3045] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:51 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:51.321241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028d9fa-c4d3-4745-bfb6-8aa2dd435081 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:51.339345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028d9fa-c4d3-4745-bfb6-8aa2dd435081 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:51.425416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542d01-6cf5-4fe8-b21d-7ffebf300b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:51.426252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542d01-6cf5-4fe8-b21d-7ffebf300b0c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:51.427159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542d01-6cf5-4fe8-b21d-7ffebf300b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:51.428303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542d01-6cf5-4fe8-b21d-7ffebf300b0c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:51.429039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542d01-6cf5-4fe8-b21d-7ffebf300b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:51.431950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542d01-6cf5-4fe8-b21d-7ffebf300b0c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:51.461663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3835c1-ac2d-45db-b271-661146bfee78 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:51.463450 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1527/3046] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:51 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:55:51.476094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3835c1-ac2d-45db-b271-661146bfee78 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:51.481093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9ea79-9f34-4d52-abdb-2fdf34df6597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:51.481783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9ea79-9f34-4d52-abdb-2fdf34df6597 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:51.482075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9ea79-9f34-4d52-abdb-2fdf34df6597 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:51.482384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9ea79-9f34-4d52-abdb-2fdf34df6597 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:51.483150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9ea79-9f34-4d52-abdb-2fdf34df6597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:51.484943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9ea79-9f34-4d52-abdb-2fdf34df6597 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:51.497318 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1520/3047] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:51.506608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542d01-6cf5-4fe8-b21d-7ffebf300b0c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:51.529316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542d01-6cf5-4fe8-b21d-7ffebf300b0c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:51.535270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57446-ab03-4a8f-93b9-db8c5d0b7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:51.536706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57446-ab03-4a8f-93b9-db8c5d0b7a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:51.536706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57446-ab03-4a8f-93b9-db8c5d0b7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:51.536916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57446-ab03-4a8f-93b9-db8c5d0b7a4a admin admin] PATH_INFO: `/v3/projects/f642268b70be4aae83c2f209575ec73e/users/36001b7e02424690a991c6ac7a50adce/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:51.553103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae57446-ab03-4a8f-93b9-db8c5d0b7a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f642268b70be4aae83c2f209575ec73e, user_id=36001b7e02424690a991c6ac7a50adce, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:51.556483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae57446-ab03-4a8f-93b9-db8c5d0b7a4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:51.572667 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1528/3048] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:51 2022] PUT /identity/v3/projects/f642268b70be4aae83c2f209575ec73e/users/36001b7e02424690a991c6ac7a50adce/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:51.576797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9ea79-9f34-4d52-abdb-2fdf34df6597 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:51.587422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9ea79-9f34-4d52-abdb-2fdf34df6597 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:51.653370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d4f36-6fcf-4d59-be8c-81ad6eb8132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:51.654836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4f36-6fcf-4d59-be8c-81ad6eb8132e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:51.656678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4f36-6fcf-4d59-be8c-81ad6eb8132e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:51.657032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4f36-6fcf-4d59-be8c-81ad6eb8132e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:51.660015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d4f36-6fcf-4d59-be8c-81ad6eb8132e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:51.661886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d4f36-6fcf-4d59-be8c-81ad6eb8132e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:51.682037 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1521/3049] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:51.683887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57446-ab03-4a8f-93b9-db8c5d0b7a4a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:51.707234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57446-ab03-4a8f-93b9-db8c5d0b7a4a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:51.715162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7694d9a-a1d0-4b69-b97b-bbef3c8d112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:51.716122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694d9a-a1d0-4b69-b97b-bbef3c8d112c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:51.716451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694d9a-a1d0-4b69-b97b-bbef3c8d112c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:51.717044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694d9a-a1d0-4b69-b97b-bbef3c8d112c admin admin] PATH_INFO: `/v3/projects/f642268b70be4aae83c2f209575ec73e/users/36001b7e02424690a991c6ac7a50adce/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:51.720694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7694d9a-a1d0-4b69-b97b-bbef3c8d112c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f642268b70be4aae83c2f209575ec73e, user_id=36001b7e02424690a991c6ac7a50adce, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:51.724574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7694d9a-a1d0-4b69-b97b-bbef3c8d112c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:51.739303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1529/3050] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:51 2022] PUT /identity/v3/projects/f642268b70be4aae83c2f209575ec73e/users/36001b7e02424690a991c6ac7a50adce/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:52.496301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c767e-87ac-4a10-a3e5-a22525b000ff None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:52.496806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c767e-87ac-4a10-a3e5-a22525b000ff None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:52.496919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c767e-87ac-4a10-a3e5-a22525b000ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:52.526672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8d8c767e-87ac-4a10-a3e5-a22525b000ff None None] MFA Rules not processed for user `36001b7e02424690a991c6ac7a50adce`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:52.527893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8d8c767e-87ac-4a10-a3e5-a22525b000ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:52.556112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7694d9a-a1d0-4b69-b97b-bbef3c8d112c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:52.697641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7694d9a-a1d0-4b69-b97b-bbef3c8d112c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:52.713462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1522/3051] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:52.713676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:52.713676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:52.713676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:52.713676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] PATH_INFO: `/v3/users/c435f34d4a004b219b62a33caf970841` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:52.714030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c435f34d4a004b219b62a33caf970841)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:52.714030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:52.715163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce643f6-4100-437f-8fbd-df38467c0489 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:52.715448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce643f6-4100-437f-8fbd-df38467c0489 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:52.715722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce643f6-4100-437f-8fbd-df38467c0489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:52.759541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1ce643f6-4100-437f-8fbd-df38467c0489 None None] MFA Rules not processed for user `0d694f3e8da440a9a1cac8ca2de030e8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:52.763780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1ce643f6-4100-437f-8fbd-df38467c0489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:52.798359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c435f34d4a004b219b62a33caf970841'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:52.814354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c435f34d4a004b219b62a33caf970841'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:52.824728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c435f34d4a004b219b62a33caf970841'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:52.826575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c435f34d4a004b219b62a33caf970841'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:52.827511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c84c662-8339-4069-b16b-3d261dde472a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c435f34d4a004b219b62a33caf970841'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:52.847814 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1530/3052] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:52 2022] DELETE /identity/v3/users/c435f34d4a004b219b62a33caf970841 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:52.850160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceeacf-8388-4f9c-8ae7-1dd6b7628e30 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:52.850659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceeacf-8388-4f9c-8ae7-1dd6b7628e30 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:52.851170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceeacf-8388-4f9c-8ae7-1dd6b7628e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:52.876130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4aceeacf-8388-4f9c-8ae7-1dd6b7628e30 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:52.878565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4aceeacf-8388-4f9c-8ae7-1dd6b7628e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:52.900843 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1523/3053] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:52.951415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1531/3054] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:52.961839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce643f6-4100-437f-8fbd-df38467c0489 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:52.963234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1ce643f6-4100-437f-8fbd-df38467c0489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:53.025245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce643f6-4100-437f-8fbd-df38467c0489 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:53.081758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:53.082406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:53.082684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:53.082959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:53.092717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:53.094164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:53.107276 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1524/3055] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:55:53.382851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceeacf-8388-4f9c-8ae7-1dd6b7628e30 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:53.384427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4aceeacf-8388-4f9c-8ae7-1dd6b7628e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:53.389043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:53.390517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:53.416035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceeacf-8388-4f9c-8ae7-1dd6b7628e30 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:53.421102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:53.421960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:53.422238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:53.422507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] PATH_INFO: `/v3/projects/f74599f5d93247128d6eed7dfd59bdd8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:53.424646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74599f5d93247128d6eed7dfd59bdd8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:53.426820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:53.481811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74599f5d93247128d6eed7dfd59bdd8', 'request_id': 'req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.483168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324418fa-8800-476f-a524-caeb9f2a1ed2 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:53.488934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74599f5d93247128d6eed7dfd59bdd8', 'request_id': 'req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.503028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74599f5d93247128d6eed7dfd59bdd8', 'request_id': 'req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.514755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] The token cache is being invalidate because project f74599f5d93247128d6eed7dfd59bdd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:53.515130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.515893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.517715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1532/3056] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:53 2022] DELETE /identity/v3/projects/f74599f5d93247128d6eed7dfd59bdd8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:53.521460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:53.523010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:53.560938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:53.561744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:53.562048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:53.562321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:53.564228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:53.594290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e6cc-bfc3-469e-8498-bc48d5f399d8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:53.599879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:53.600793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:53.601068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:53.601339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] PATH_INFO: `/v3/users/ee23354a7764475e86463f052771d935` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:53.602549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee23354a7764475e86463f052771d935)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:53.604474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:53.630005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:53.631635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:53.642159 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1525/3057] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:55:53.658922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee23354a7764475e86463f052771d935'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.683545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee23354a7764475e86463f052771d935'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.703475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee23354a7764475e86463f052771d935'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.704597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee23354a7764475e86463f052771d935'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.705036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee23354a7764475e86463f052771d935'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:53.719304 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1533/3058] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:55:53 2022] DELETE /identity/v3/users/ee23354a7764475e86463f052771d935 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:54.001685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:54.005268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:54.074219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f25b84-ec7f-4a48-9df8-a69d0c19f09d service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:54.131002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d3b4-3d78-4dc9-9576-9ebb9ea83307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:54.131759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d3b4-3d78-4dc9-9576-9ebb9ea83307 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.132038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d3b4-3d78-4dc9-9576-9ebb9ea83307 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.132627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d3b4-3d78-4dc9-9576-9ebb9ea83307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.134481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e7c5d3b4-3d78-4dc9-9576-9ebb9ea83307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:54.144686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5d3b4-3d78-4dc9-9576-9ebb9ea83307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:54.146178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5d3b4-3d78-4dc9-9576-9ebb9ea83307 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:54.155679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1526/3059] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:54.305623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:54.307343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:54.403003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b505-9dfd-409e-ab4b-26577deec3ef admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:54.409040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:54.410020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.410410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.410779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] PATH_INFO: `/v3/projects/09dac1ebed254b7eb708a2744966d19d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.412262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09dac1ebed254b7eb708a2744966d19d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:54.414456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:54.472582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09dac1ebed254b7eb708a2744966d19d', 'request_id': 'req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:54.478387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09dac1ebed254b7eb708a2744966d19d', 'request_id': 'req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:54.488458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09dac1ebed254b7eb708a2744966d19d', 'request_id': 'req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:54.502075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] The token cache is being invalidate because project 09dac1ebed254b7eb708a2744966d19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:55:54.502553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:54.503225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-814bfca8-f0c5-45cd-b568-baed8c1dcc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:55:54.509140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1534/3060] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:55:54 2022] DELETE /identity/v3/projects/09dac1ebed254b7eb708a2744966d19d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:54.511014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010775e4-c3e1-4e27-b15f-8e7c3b04b685 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.511349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010775e4-c3e1-4e27-b15f-8e7c3b04b685 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.511634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010775e4-c3e1-4e27-b15f-8e7c3b04b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.530607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-010775e4-c3e1-4e27-b15f-8e7c3b04b685 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:54.531875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-010775e4-c3e1-4e27-b15f-8e7c3b04b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:54.559114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1da8-497f-4b91-ae9a-f1e065deff28 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.559411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1da8-497f-4b91-ae9a-f1e065deff28 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.559698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1da8-497f-4b91-ae9a-f1e065deff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.588808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-673d1da8-497f-4b91-ae9a-f1e065deff28 None None] MFA Rules not processed for user `ccc221761620472ea3cd887988f9f2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:54.590581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-673d1da8-497f-4b91-ae9a-f1e065deff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:54.611467 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1527/3061] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:55:54.621555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654391a9-0ee7-40f9-8dc4-7f278fddba9e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.621845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654391a9-0ee7-40f9-8dc4-7f278fddba9e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.622222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654391a9-0ee7-40f9-8dc4-7f278fddba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.645420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-654391a9-0ee7-40f9-8dc4-7f278fddba9e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:54.646677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-654391a9-0ee7-40f9-8dc4-7f278fddba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:54.659309 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1528/3062] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:54.664962 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1535/3063] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:55:54.665465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654391a9-0ee7-40f9-8dc4-7f278fddba9e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:54.673709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654391a9-0ee7-40f9-8dc4-7f278fddba9e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:54.678975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:54.679636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.679920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.680199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.681221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:55:54.681578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:54.683116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:54.695893 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1529/3064] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:55:54.700232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d1da8-497f-4b91-ae9a-f1e065deff28 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:54.714939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d1da8-497f-4b91-ae9a-f1e065deff28 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:54.727789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbfed9-cca2-4d2c-b186-2a199b1ed4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:54.727789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbfed9-cca2-4d2c-b186-2a199b1ed4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.727789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbfed9-cca2-4d2c-b186-2a199b1ed4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.728096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbfed9-cca2-4d2c-b186-2a199b1ed4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.729598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:54.730803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbfed9-cca2-4d2c-b186-2a199b1ed4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:54.731642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:54.732776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbfed9-cca2-4d2c-b186-2a199b1ed4e2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:54.784493 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1536/3065] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:54 2022] POST /identity/v3/projects => generated 397 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:55:54.788319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbfed9-cca2-4d2c-b186-2a199b1ed4e2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:54.840802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd94f12-3f8c-469a-a05b-475e85d85cca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:54.864867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbfed9-cca2-4d2c-b186-2a199b1ed4e2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:54.871406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73963f-85ea-48e5-b2ab-81a5a391d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:54.872197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73963f-85ea-48e5-b2ab-81a5a391d53e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.872614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73963f-85ea-48e5-b2ab-81a5a391d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.873482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73963f-85ea-48e5-b2ab-81a5a391d53e admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.874459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73963f-85ea-48e5-b2ab-81a5a391d53e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:54.876924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73963f-85ea-48e5-b2ab-81a5a391d53e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:54.909269 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1537/3066] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:54 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:54.910192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73963f-85ea-48e5-b2ab-81a5a391d53e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:54.929257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73963f-85ea-48e5-b2ab-81a5a391d53e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:54.934610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:54.935494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.935953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.936135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef4735-ee30-4195-8885-6eb4c3a07a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:54.936599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.937196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4735-ee30-4195-8885-6eb4c3a07a25 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:54.937576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4735-ee30-4195-8885-6eb4c3a07a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:54.937879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4735-ee30-4195-8885-6eb4c3a07a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:54.938916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef4735-ee30-4195-8885-6eb4c3a07a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:54.939042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:54.941357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef4735-ee30-4195-8885-6eb4c3a07a25 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:54.951999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:54.953664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:54.962695 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1538/3067] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:54.966065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef4735-ee30-4195-8885-6eb4c3a07a25 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:54.967864 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1530/3068] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:55:54.988951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef4735-ee30-4195-8885-6eb4c3a07a25 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:54.997209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc309e-15d1-4769-bf5a-484e5aae400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:55.002686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc309e-15d1-4769-bf5a-484e5aae400e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.003007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc309e-15d1-4769-bf5a-484e5aae400e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.003293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc309e-15d1-4769-bf5a-484e5aae400e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.005376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc309e-15d1-4769-bf5a-484e5aae400e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:55.008108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc309e-15d1-4769-bf5a-484e5aae400e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:55.024592 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1539/3069] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:55.029299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:55.048214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7393-4478-4837-ab59-6cb8b581fc82 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:55.054941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4492b-a862-4023-a004-d971a1c5088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:55.056107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4492b-a862-4023-a004-d971a1c5088c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.056393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4492b-a862-4023-a004-d971a1c5088c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.056727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4492b-a862-4023-a004-d971a1c5088c admin admin] PATH_INFO: `/v3/projects/ba474a1f664d4cfcaea1fd186c243b60/users/a1a6b64d6ce34d408dba77434484aaf2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.080096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4492b-a862-4023-a004-d971a1c5088c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba474a1f664d4cfcaea1fd186c243b60, user_id=a1a6b64d6ce34d408dba77434484aaf2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:55.084565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4492b-a862-4023-a004-d971a1c5088c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:55.105843 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1531/3070] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:55 2022] PUT /identity/v3/projects/ba474a1f664d4cfcaea1fd186c243b60/users/a1a6b64d6ce34d408dba77434484aaf2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:55:55.117681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe8c5-9f81-477c-b493-8010ebb88c8a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.117984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe8c5-9f81-477c-b493-8010ebb88c8a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.118272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe8c5-9f81-477c-b493-8010ebb88c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.155062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a80fe8c5-9f81-477c-b493-8010ebb88c8a None None] MFA Rules not processed for user `a1a6b64d6ce34d408dba77434484aaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:55.156693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a80fe8c5-9f81-477c-b493-8010ebb88c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:55.254820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1540/3071] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:55.255692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4492b-a862-4023-a004-d971a1c5088c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:55.347864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4492b-a862-4023-a004-d971a1c5088c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:55.355632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca5148-bd1a-4041-95a3-c28c75a3e065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:55.356498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca5148-bd1a-4041-95a3-c28c75a3e065 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.356793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca5148-bd1a-4041-95a3-c28c75a3e065 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.358038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca5148-bd1a-4041-95a3-c28c75a3e065 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.358869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca5148-bd1a-4041-95a3-c28c75a3e065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:55.361315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca5148-bd1a-4041-95a3-c28c75a3e065 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:55.402359 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1532/3072] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:55:55 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:55.406716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe8c5-9f81-477c-b493-8010ebb88c8a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:55.433651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe8c5-9f81-477c-b493-8010ebb88c8a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:55.543352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a74293-1446-4673-9139-f0da8cd80230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:55.544595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a74293-1446-4673-9139-f0da8cd80230 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.544854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a74293-1446-4673-9139-f0da8cd80230 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.545126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a74293-1446-4673-9139-f0da8cd80230 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.546089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a74293-1446-4673-9139-f0da8cd80230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:55.548066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a74293-1446-4673-9139-f0da8cd80230 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:55.584068 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1541/3073] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:55:55 2022] POST /identity/v3/users => generated 308 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:55:55.588217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca5148-bd1a-4041-95a3-c28c75a3e065 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:55.601442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca5148-bd1a-4041-95a3-c28c75a3e065 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:55.609596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ffb1-128c-40b6-8dd1-1818f4c3084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:55.610381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ffb1-128c-40b6-8dd1-1818f4c3084a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.610736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ffb1-128c-40b6-8dd1-1818f4c3084a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.611088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ffb1-128c-40b6-8dd1-1818f4c3084a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.613559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26ffb1-128c-40b6-8dd1-1818f4c3084a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:55.615728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26ffb1-128c-40b6-8dd1-1818f4c3084a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:55.629346 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1533/3074] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:55.633898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a74293-1446-4673-9139-f0da8cd80230 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:55.646471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a74293-1446-4673-9139-f0da8cd80230 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:55.652535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cd55e-a072-4106-845c-555a37c530a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:55.653589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd55e-a072-4106-845c-555a37c530a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.653896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd55e-a072-4106-845c-555a37c530a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.654234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd55e-a072-4106-845c-555a37c530a1 admin admin] PATH_INFO: `/v3/projects/59201875320043da8c25f1e39a607788/users/e259e4d0c11e4b6fbf36c71bee3dc511/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.673335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cd55e-a072-4106-845c-555a37c530a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59201875320043da8c25f1e39a607788, user_id=e259e4d0c11e4b6fbf36c71bee3dc511, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:55.676623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cd55e-a072-4106-845c-555a37c530a1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:55.696705 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1542/3075] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:55 2022] PUT /identity/v3/projects/59201875320043da8c25f1e39a607788/users/e259e4d0c11e4b6fbf36c71bee3dc511/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:55.700534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ffb1-128c-40b6-8dd1-1818f4c3084a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:55.713203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ffb1-128c-40b6-8dd1-1818f4c3084a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:55.774432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb50585-8cf4-4cfd-b65e-2d964e97b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:55.775491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb50585-8cf4-4cfd-b65e-2d964e97b8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.776471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb50585-8cf4-4cfd-b65e-2d964e97b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.777003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb50585-8cf4-4cfd-b65e-2d964e97b8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.777889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb50585-8cf4-4cfd-b65e-2d964e97b8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:55.780314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb50585-8cf4-4cfd-b65e-2d964e97b8a3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:55.790861 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1534/3076] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:55:55.794971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cd55e-a072-4106-845c-555a37c530a1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:55.807406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cd55e-a072-4106-845c-555a37c530a1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:55.813869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:55.815586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.815969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.816555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] PATH_INFO: `/v3/projects/59201875320043da8c25f1e39a607788/users/e259e4d0c11e4b6fbf36c71bee3dc511/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.818992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59201875320043da8c25f1e39a607788, user_id=e259e4d0c11e4b6fbf36c71bee3dc511, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:55.822379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:55.834687 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1543/3077] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:55:55 2022] PUT /identity/v3/projects/59201875320043da8c25f1e39a607788/users/e259e4d0c11e4b6fbf36c71bee3dc511/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:55:55.846532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a9b2-d23b-43a7-b47a-a7a04cf2c506 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:55.846970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a9b2-d23b-43a7-b47a-a7a04cf2c506 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:55.847114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a9b2-d23b-43a7-b47a-a7a04cf2c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:55.878133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b314a9b2-d23b-43a7-b47a-a7a04cf2c506 None None] MFA Rules not processed for user `e259e4d0c11e4b6fbf36c71bee3dc511`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:55.879567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b314a9b2-d23b-43a7-b47a-a7a04cf2c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:55.961677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1535/3078] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:55:57.039402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:57.043091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:57.154227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfe68-1fd5-480d-9ba9-4789ed5a408b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:57.162639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36b31a-daec-4c68-9a79-187de3d0fa23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:57.163594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36b31a-daec-4c68-9a79-187de3d0fa23 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:57.163970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36b31a-daec-4c68-9a79-187de3d0fa23 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:57.164340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36b31a-daec-4c68-9a79-187de3d0fa23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:57.183439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36b31a-daec-4c68-9a79-187de3d0fa23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:57.185343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36b31a-daec-4c68-9a79-187de3d0fa23 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:57.199839 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1544/3079] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:55:59.755963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcefe3-ccbc-4a2b-9fd9-631386590540 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:59.756573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcefe3-ccbc-4a2b-9fd9-631386590540 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:59.756573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcefe3-ccbc-4a2b-9fd9-631386590540 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:59.758332 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1536/3080] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 20:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:55:59.763749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b840c1a-003e-46d7-93f9-ee782ce93ed2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:59.764152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b840c1a-003e-46d7-93f9-ee782ce93ed2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:59.764457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b840c1a-003e-46d7-93f9-ee782ce93ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:59.784213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4b840c1a-003e-46d7-93f9-ee782ce93ed2 None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:55:59.786875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4b840c1a-003e-46d7-93f9-ee782ce93ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:59.862243 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1545/3081] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:55:59.884759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcefe3-ccbc-4a2b-9fd9-631386590540 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:55:59.887045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5ffcefe3-ccbc-4a2b-9fd9-631386590540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:55:59.905064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcefe3-ccbc-4a2b-9fd9-631386590540 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:55:59.909511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da817768-c86f-4a75-8860-a9fa6905ed35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:55:59.911059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da817768-c86f-4a75-8860-a9fa6905ed35 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:55:59.911059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da817768-c86f-4a75-8860-a9fa6905ed35 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:55:59.911278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da817768-c86f-4a75-8860-a9fa6905ed35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:55:59.920108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da817768-c86f-4a75-8860-a9fa6905ed35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:55:59.921757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da817768-c86f-4a75-8860-a9fa6905ed35 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:55:59.932370 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1537/3082] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:55:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:00.401008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b840c1a-003e-46d7-93f9-ee782ce93ed2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:00.412852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b840c1a-003e-46d7-93f9-ee782ce93ed2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:00.418745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c17fb4-c89f-4a4b-af13-5ce063512163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:00.419658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c17fb4-c89f-4a4b-af13-5ce063512163 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:00.420025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c17fb4-c89f-4a4b-af13-5ce063512163 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:00.420311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c17fb4-c89f-4a4b-af13-5ce063512163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:00.422388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-59c17fb4-c89f-4a4b-af13-5ce063512163 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:00.490506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c17fb4-c89f-4a4b-af13-5ce063512163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:00.492128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c17fb4-c89f-4a4b-af13-5ce063512163 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:00.504523 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1546/3083] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:06.017334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da817768-c86f-4a75-8860-a9fa6905ed35 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:06.029150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab252-d607-4b5d-a10d-bd7748bc3dda None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:06.029682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab252-d607-4b5d-a10d-bd7748bc3dda None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:06.029682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab252-d607-4b5d-a10d-bd7748bc3dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:06.036207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da817768-c86f-4a75-8860-a9fa6905ed35 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:06.042004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:06.042866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:06.043277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:06.043563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:06.046813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6d2ab252-d607-4b5d-a10d-bd7748bc3dda None None] MFA Rules not processed for user `ab3fa7eadddf42b4b700593dad828e44`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:06.048006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6d2ab252-d607-4b5d-a10d-bd7748bc3dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:06.141006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:06.141821 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1547/3084] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:56:06.143332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:06.153221 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1538/3085] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:06.172020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ab252-d607-4b5d-a10d-bd7748bc3dda None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:06.284901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:06.287397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:06.304703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fb7fe-dee2-4252-ae92-de30295a3793 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:06.313791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ab252-d607-4b5d-a10d-bd7748bc3dda None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:06.317255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e13747-8aad-4143-a550-778db638a9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:06.318293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13747-8aad-4143-a550-778db638a9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:06.318708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13747-8aad-4143-a550-778db638a9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:06.318842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13747-8aad-4143-a550-778db638a9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:06.324805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-16e13747-8aad-4143-a550-778db638a9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:06.350632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13747-8aad-4143-a550-778db638a9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:06.354992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13747-8aad-4143-a550-778db638a9c6 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:06.378770 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1539/3086] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:06.380457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:06.381457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:06.381841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:06.382238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] PATH_INFO: `/v3/users/a1a6b64d6ce34d408dba77434484aaf2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:06.384808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a6b64d6ce34d408dba77434484aaf2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:06.387043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:06.498465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a6b64d6ce34d408dba77434484aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:06.516432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a6b64d6ce34d408dba77434484aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:06.527718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a6b64d6ce34d408dba77434484aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:06.529583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a6b64d6ce34d408dba77434484aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:06.530423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a6b64d6ce34d408dba77434484aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:06.548295 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1548/3087] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:06 2022] DELETE /identity/v3/users/a1a6b64d6ce34d408dba77434484aaf2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:06.554497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019320-ab1f-43d4-82b5-1a6d765c2f93 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:06.554788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019320-ab1f-43d4-82b5-1a6d765c2f93 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:06.555068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019320-ab1f-43d4-82b5-1a6d765c2f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:06.573388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fe019320-ab1f-43d4-82b5-1a6d765c2f93 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:06.575369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fe019320-ab1f-43d4-82b5-1a6d765c2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:06.669768 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1540/3088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:06.701396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:06.704139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:06.800647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdb159-1268-4534-bf4e-5f6a496934a0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:06.805675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac924-2d4a-415d-bbbf-f7f00725d4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:06.807755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac924-2d4a-415d-bbbf-f7f00725d4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:06.808442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac924-2d4a-415d-bbbf-f7f00725d4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:06.808929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac924-2d4a-415d-bbbf-f7f00725d4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:06.820903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ac924-2d4a-415d-bbbf-f7f00725d4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:06.824433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ac924-2d4a-415d-bbbf-f7f00725d4a0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:06.838169 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1549/3089] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:08.134743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019320-ab1f-43d4-82b5-1a6d765c2f93 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:08.138393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fe019320-ab1f-43d4-82b5-1a6d765c2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:08.154144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019320-ab1f-43d4-82b5-1a6d765c2f93 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:08.163060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:08.164157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:08.164760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:08.165244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] PATH_INFO: `/v3/projects/ba474a1f664d4cfcaea1fd186c243b60` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:08.166947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba474a1f664d4cfcaea1fd186c243b60)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:08.169200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:08.313546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba474a1f664d4cfcaea1fd186c243b60', 'request_id': 'req-7857f650-ba85-4d68-a3e4-c616e6c9bb30'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.328732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba474a1f664d4cfcaea1fd186c243b60', 'request_id': 'req-7857f650-ba85-4d68-a3e4-c616e6c9bb30'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.367287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba474a1f664d4cfcaea1fd186c243b60', 'request_id': 'req-7857f650-ba85-4d68-a3e4-c616e6c9bb30'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.386268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] The token cache is being invalidate because project ba474a1f664d4cfcaea1fd186c243b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:08.386566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.389315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7857f650-ba85-4d68-a3e4-c616e6c9bb30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.391238 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1541/3090] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:08 2022] DELETE /identity/v3/projects/ba474a1f664d4cfcaea1fd186c243b60 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:08.395823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac924-2d4a-415d-bbbf-f7f00725d4a0 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:08.412646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac924-2d4a-415d-bbbf-f7f00725d4a0 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:08.486225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:08.487475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:08.487475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:08.487730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] PATH_INFO: `/v3/users/e259e4d0c11e4b6fbf36c71bee3dc511` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:08.489617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e259e4d0c11e4b6fbf36c71bee3dc511)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:08.491714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:08.603814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e259e4d0c11e4b6fbf36c71bee3dc511'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.657074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e259e4d0c11e4b6fbf36c71bee3dc511'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.667707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311f3ac-5b37-4b41-b003-b9b6805c26bb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:08.669843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311f3ac-5b37-4b41-b003-b9b6805c26bb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:08.670216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311f3ac-5b37-4b41-b003-b9b6805c26bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:08.686292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e259e4d0c11e4b6fbf36c71bee3dc511'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.687617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e259e4d0c11e4b6fbf36c71bee3dc511'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.688400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e259e4d0c11e4b6fbf36c71bee3dc511'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:08.718415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5311f3ac-5b37-4b41-b003-b9b6805c26bb None None] MFA Rules not processed for user `605ee8b93b804ecc9f21177c4cbf0b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:08.721905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5311f3ac-5b37-4b41-b003-b9b6805c26bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:08.726792 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1550/3091] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:08 2022] DELETE /identity/v3/users/e259e4d0c11e4b6fbf36c71bee3dc511 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:08.850015 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1542/3092] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:09.546888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:09.558355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:09.712155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90783c6c-47cc-4b16-a639-02f7412069ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:09.720551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:09.722533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:09.722987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:09.723513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] PATH_INFO: `/v3/projects/59201875320043da8c25f1e39a607788` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:09.739330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59201875320043da8c25f1e39a607788)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:09.742497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:09.853482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59201875320043da8c25f1e39a607788', 'request_id': 'req-362181c3-35fe-4946-8923-f43feb090658'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:09.877901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59201875320043da8c25f1e39a607788', 'request_id': 'req-362181c3-35fe-4946-8923-f43feb090658'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:09.894999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59201875320043da8c25f1e39a607788', 'request_id': 'req-362181c3-35fe-4946-8923-f43feb090658'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:09.921220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] The token cache is being invalidate because project 59201875320043da8c25f1e39a607788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:09.921534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:09.924295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:09.928845 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1551/3093] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:09 2022] DELETE /identity/v3/projects/59201875320043da8c25f1e39a607788 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:09.935615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534e89-a8c4-4665-acf0-792ec8b6deab None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:09.936214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534e89-a8c4-4665-acf0-792ec8b6deab None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:09.936214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534e89-a8c4-4665-acf0-792ec8b6deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:09.977637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-35534e89-a8c4-4665-acf0-792ec8b6deab None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:09.978892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-35534e89-a8c4-4665-acf0-792ec8b6deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:10.023942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:10.025463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:10.208300 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1543/3094] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:10.210870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c1e7-953a-42bf-93c0-ba583239ff7b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.212446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c1e7-953a-42bf-93c0-ba583239ff7b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.212891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c1e7-953a-42bf-93c0-ba583239ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.216047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362181c3-35fe-4946-8923-f43feb090658 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:10.228100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:10.229085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.229534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.229995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.240236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:10.247066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-97d3c1e7-953a-42bf-93c0-ba583239ff7b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:10.248921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-97d3c1e7-953a-42bf-93c0-ba583239ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:10.259954 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1544/3095] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:10.265417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3c1e7-953a-42bf-93c0-ba583239ff7b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:10.268102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:10.272736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:10.292037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3c1e7-953a-42bf-93c0-ba583239ff7b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:10.300200 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1552/3096] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:56:10.302317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:10.303756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.304258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.305137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.306734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:56:10.308032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:10.310142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:10.327229 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1545/3097] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:56:10.331519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:10.346965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c2694-7713-4cfe-8679-87ea63987733 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:10.351651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4585df3-8884-4150-b965-bac8edeacc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:10.352316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4585df3-8884-4150-b965-bac8edeacc62 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.352635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4585df3-8884-4150-b965-bac8edeacc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.352912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4585df3-8884-4150-b965-bac8edeacc62 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.353615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4585df3-8884-4150-b965-bac8edeacc62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:10.355557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4585df3-8884-4150-b965-bac8edeacc62 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:10.390014 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1553/3098] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:56:10 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:10.394841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:10.407735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea426b-9bb6-4716-9169-175f150e81da admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:10.484905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd39a70-2b35-4fab-afa3-8b85aa8eeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:10.485582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd39a70-2b35-4fab-afa3-8b85aa8eeebd admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.485867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd39a70-2b35-4fab-afa3-8b85aa8eeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.488283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd39a70-2b35-4fab-afa3-8b85aa8eeebd admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.489097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd39a70-2b35-4fab-afa3-8b85aa8eeebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:10.491297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd39a70-2b35-4fab-afa3-8b85aa8eeebd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:10.541327 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1546/3099] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:56:10 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:10.542026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4585df3-8884-4150-b965-bac8edeacc62 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:10.553420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4585df3-8884-4150-b965-bac8edeacc62 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:10.559544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c8451-c524-4825-830c-51f6d4b415a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:10.560418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c8451-c524-4825-830c-51f6d4b415a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.560786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c8451-c524-4825-830c-51f6d4b415a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.561068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c8451-c524-4825-830c-51f6d4b415a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.561804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c8451-c524-4825-830c-51f6d4b415a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:10.563406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c8451-c524-4825-830c-51f6d4b415a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:10.574966 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1554/3100] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:10.579223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd39a70-2b35-4fab-afa3-8b85aa8eeebd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:10.593348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd39a70-2b35-4fab-afa3-8b85aa8eeebd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:10.598413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6c406-0569-4617-a717-6a15ef99c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:10.599164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6c406-0569-4617-a717-6a15ef99c8ef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.599528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6c406-0569-4617-a717-6a15ef99c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.599885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6c406-0569-4617-a717-6a15ef99c8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.600743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6c406-0569-4617-a717-6a15ef99c8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:10.602431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6c406-0569-4617-a717-6a15ef99c8ef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:10.616889 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1547/3101] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:10.620775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c8451-c524-4825-830c-51f6d4b415a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:10.634459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c8451-c524-4825-830c-51f6d4b415a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:10.646271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2937-f0f3-4db6-93a4-93bd6dd5e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:10.647845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2937-f0f3-4db6-93a4-93bd6dd5e428 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.648495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2937-f0f3-4db6-93a4-93bd6dd5e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.648913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2937-f0f3-4db6-93a4-93bd6dd5e428 admin admin] PATH_INFO: `/v3/projects/ac7c7b1e5ce345fd99f7b69afd3a5554/users/bb905e794fc44406911ef1d5b77cc26a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.685488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2937-f0f3-4db6-93a4-93bd6dd5e428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7c7b1e5ce345fd99f7b69afd3a5554, user_id=bb905e794fc44406911ef1d5b77cc26a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:10.691315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2937-f0f3-4db6-93a4-93bd6dd5e428 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:10.733177 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1555/3102] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:10 2022] PUT /identity/v3/projects/ac7c7b1e5ce345fd99f7b69afd3a5554/users/bb905e794fc44406911ef1d5b77cc26a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:56:10.745568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb7f8-ef13-456b-b616-8228445e3af9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:10.748451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb7f8-ef13-456b-b616-8228445e3af9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:10.748451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb7f8-ef13-456b-b616-8228445e3af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:10.801388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5a6fb7f8-ef13-456b-b616-8228445e3af9 None None] MFA Rules not processed for user `bb905e794fc44406911ef1d5b77cc26a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:10.803854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5a6fb7f8-ef13-456b-b616-8228445e3af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:10.936513 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1548/3103] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:10.938694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2937-f0f3-4db6-93a4-93bd6dd5e428 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:11.071014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2937-f0f3-4db6-93a4-93bd6dd5e428 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:11.085664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6b1bf-91c3-44c2-aada-aac161be6c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:11.087778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b1bf-91c3-44c2-aada-aac161be6c66 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.088493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b1bf-91c3-44c2-aada-aac161be6c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.088833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b1bf-91c3-44c2-aada-aac161be6c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.090019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6b1bf-91c3-44c2-aada-aac161be6c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:11.092283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6b1bf-91c3-44c2-aada-aac161be6c66 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:11.132919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fb7f8-ef13-456b-b616-8228445e3af9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:11.140931 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1556/3104] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:56:10 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:11.148482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fb7f8-ef13-456b-b616-8228445e3af9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:11.235524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c2c67-8f8f-43c3-8ce5-9f053467ca1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:11.236406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2c67-8f8f-43c3-8ce5-9f053467ca1f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.237025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2c67-8f8f-43c3-8ce5-9f053467ca1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.237339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2c67-8f8f-43c3-8ce5-9f053467ca1f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.238785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c2c67-8f8f-43c3-8ce5-9f053467ca1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:11.241174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c2c67-8f8f-43c3-8ce5-9f053467ca1f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:11.284742 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1549/3105] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:56:11 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:11.286856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6b1bf-91c3-44c2-aada-aac161be6c66 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:11.301390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6b1bf-91c3-44c2-aada-aac161be6c66 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:11.307885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:11.308784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.309069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.309344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.310072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:11.333265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:11.361147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c2c67-8f8f-43c3-8ce5-9f053467ca1f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:11.361854 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1557/3106] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:11.391013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c2c67-8f8f-43c3-8ce5-9f053467ca1f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:11.398526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e531549-a7f0-4b1c-8c01-92b14093fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:11.400182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e531549-a7f0-4b1c-8c01-92b14093fa4f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.400504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e531549-a7f0-4b1c-8c01-92b14093fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.400781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e531549-a7f0-4b1c-8c01-92b14093fa4f admin admin] PATH_INFO: `/v3/projects/ce545f10a3af4fb8b11a2402abf15972/users/e4c93f5edd134d5aab4e4f3bbe8e444e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.427984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e531549-a7f0-4b1c-8c01-92b14093fa4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce545f10a3af4fb8b11a2402abf15972, user_id=e4c93f5edd134d5aab4e4f3bbe8e444e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:11.431976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e531549-a7f0-4b1c-8c01-92b14093fa4f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:11.462637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:11.464447 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1550/3107] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:11 2022] PUT /identity/v3/projects/ce545f10a3af4fb8b11a2402abf15972/users/e4c93f5edd134d5aab4e4f3bbe8e444e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:56:11.466113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:11.466663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e531549-a7f0-4b1c-8c01-92b14093fa4f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:11.483138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bb675-7d84-4e42-8fa8-dd4972ae7688 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:11.572862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:11.573754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.574039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.574317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] PATH_INFO: `/v3/users/42169857eb434258a4e925c8161dbed5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.575591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=42169857eb434258a4e925c8161dbed5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:11.577558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:11.600758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e531549-a7f0-4b1c-8c01-92b14093fa4f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:11.606652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e3bb3-7c27-4183-bf13-aee264515a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:11.608084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e3bb3-7c27-4183-bf13-aee264515a52 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.608386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e3bb3-7c27-4183-bf13-aee264515a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.608670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e3bb3-7c27-4183-bf13-aee264515a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.609478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e3bb3-7c27-4183-bf13-aee264515a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:11.611094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e3bb3-7c27-4183-bf13-aee264515a52 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:11.623916 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1551/3108] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:11.627971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e3bb3-7c27-4183-bf13-aee264515a52 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:11.639228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42169857eb434258a4e925c8161dbed5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:11.652113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e3bb3-7c27-4183-bf13-aee264515a52 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:11.654601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42169857eb434258a4e925c8161dbed5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:11.661379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74582a66-e8d0-453f-a114-66f03251efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:11.665319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582a66-e8d0-453f-a114-66f03251efab admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.665618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582a66-e8d0-453f-a114-66f03251efab admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.665896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582a66-e8d0-453f-a114-66f03251efab admin admin] PATH_INFO: `/v3/projects/ce545f10a3af4fb8b11a2402abf15972/users/e4c93f5edd134d5aab4e4f3bbe8e444e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.670051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74582a66-e8d0-453f-a114-66f03251efab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce545f10a3af4fb8b11a2402abf15972, user_id=e4c93f5edd134d5aab4e4f3bbe8e444e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:11.670393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42169857eb434258a4e925c8161dbed5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:11.671337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42169857eb434258a4e925c8161dbed5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:11.672276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7fa4ba20-cc0f-44f0-8326-f3b26bb6f5fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42169857eb434258a4e925c8161dbed5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:11.675593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74582a66-e8d0-453f-a114-66f03251efab admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:11.703521 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1558/3110] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:11 2022] DELETE /identity/v3/users/42169857eb434258a4e925c8161dbed5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:11.705898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b40cd0-205e-4e65-8bc7-4920efc5bf88 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.706556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b40cd0-205e-4e65-8bc7-4920efc5bf88 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.707837 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1552/3110] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:11 2022] PUT /identity/v3/projects/ce545f10a3af4fb8b11a2402abf15972/users/e4c93f5edd134d5aab4e4f3bbe8e444e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:11.708456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b40cd0-205e-4e65-8bc7-4920efc5bf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.752943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-53b40cd0-205e-4e65-8bc7-4920efc5bf88 None None] MFA Rules not processed for user `e4c93f5edd134d5aab4e4f3bbe8e444e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:11.754540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53b40cd0-205e-4e65-8bc7-4920efc5bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:11.933928 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1559/3111] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:11.943121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc20943-ff81-4936-baf3-edf472bc92d3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:11.943981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc20943-ff81-4936-baf3-edf472bc92d3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:11.944438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc20943-ff81-4936-baf3-edf472bc92d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:11.971820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1cc20943-ff81-4936-baf3-edf472bc92d3 None None] MFA Rules not processed for user `bb905e794fc44406911ef1d5b77cc26a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:11.973560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1cc20943-ff81-4936-baf3-edf472bc92d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:12.062482 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1553/3112] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:12.075249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b40cd0-205e-4e65-8bc7-4920efc5bf88 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:12.076826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53b40cd0-205e-4e65-8bc7-4920efc5bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:12.171339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b40cd0-205e-4e65-8bc7-4920efc5bf88 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:12.176453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:12.177478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.177835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.178207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] PATH_INFO: `/v3/projects/07730507b50b4050bd8a83933845823e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.179503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=07730507b50b4050bd8a83933845823e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:12.181803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:12.240218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07730507b50b4050bd8a83933845823e', 'request_id': 'req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:12.246774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07730507b50b4050bd8a83933845823e', 'request_id': 'req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:12.259358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07730507b50b4050bd8a83933845823e', 'request_id': 'req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:12.274665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] The token cache is being invalidate because project 07730507b50b4050bd8a83933845823e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:12.275046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:12.275883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:12.277511 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1560/3113] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:12 2022] DELETE /identity/v3/projects/07730507b50b4050bd8a83933845823e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:12.282627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985021-d024-4e2d-9337-e9e63aa4869e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.282919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985021-d024-4e2d-9337-e9e63aa4869e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.283746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985021-d024-4e2d-9337-e9e63aa4869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.313881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8a985021-d024-4e2d-9337-e9e63aa4869e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:12.315986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a985021-d024-4e2d-9337-e9e63aa4869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:12.365351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:12.367176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:12.430415 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1554/3114] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:12.433633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a985021-d024-4e2d-9337-e9e63aa4869e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:12.435517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a985021-d024-4e2d-9337-e9e63aa4869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:12.474151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa9e47-8dcb-4dea-961e-89c4d80a7feb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:12.482237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12c9af-e589-41b9-b8e6-004b8b5a7944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:12.482895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12c9af-e589-41b9-b8e6-004b8b5a7944 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.483180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12c9af-e589-41b9-b8e6-004b8b5a7944 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.483460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12c9af-e589-41b9-b8e6-004b8b5a7944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.485294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8f12c9af-e589-41b9-b8e6-004b8b5a7944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:12.520984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a985021-d024-4e2d-9337-e9e63aa4869e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:12.530068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:12.530808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.531189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.531533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.535985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:12.552175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12c9af-e589-41b9-b8e6-004b8b5a7944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:12.554308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12c9af-e589-41b9-b8e6-004b8b5a7944 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:12.565370 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1561/3115] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:56:12.566981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafed02-b258-4f4d-b1b9-44c072fb94a8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.567501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafed02-b258-4f4d-b1b9-44c072fb94a8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.568282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafed02-b258-4f4d-b1b9-44c072fb94a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.588544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1cafed02-b258-4f4d-b1b9-44c072fb94a8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:12.589812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1cafed02-b258-4f4d-b1b9-44c072fb94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:12.599537 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1562/3116] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:12.604114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafed02-b258-4f4d-b1b9-44c072fb94a8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:12.615256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafed02-b258-4f4d-b1b9-44c072fb94a8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:12.622032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:12.622789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.623763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.624299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.625232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:56:12.625769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:12.627575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:12.648319 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1563/3117] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:56:12.649419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:12.651005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:12.652663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:12.662297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142e75-349b-4be4-9a5d-b98b92ae4634 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:12.669285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43c85a-6fa2-4c35-9400-90d52f4f9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:12.670085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43c85a-6fa2-4c35-9400-90d52f4f9bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.670439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43c85a-6fa2-4c35-9400-90d52f4f9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.670818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43c85a-6fa2-4c35-9400-90d52f4f9bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.671594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43c85a-6fa2-4c35-9400-90d52f4f9bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:12.673675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43c85a-6fa2-4c35-9400-90d52f4f9bc7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:12.690930 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1555/3118] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:12.743491 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1564/3119] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:56:12 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:12.750319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:12.764026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63fd40-5adf-4c9d-949d-095658e0958e service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:12.883899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c9305-ed63-4f2b-99e9-3d436e0914ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:12.884605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c9305-ed63-4f2b-99e9-3d436e0914ae admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.884890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c9305-ed63-4f2b-99e9-3d436e0914ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.885167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c9305-ed63-4f2b-99e9-3d436e0914ae admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.885893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c9305-ed63-4f2b-99e9-3d436e0914ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:12.888098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c9305-ed63-4f2b-99e9-3d436e0914ae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:12.931877 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1556/3120] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:56:12 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:12.933377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43c85a-6fa2-4c35-9400-90d52f4f9bc7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:12.945318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43c85a-6fa2-4c35-9400-90d52f4f9bc7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:12.952112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08c69-b0e3-4e4f-aa46-de670b372748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:12.952981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08c69-b0e3-4e4f-aa46-de670b372748 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.953368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08c69-b0e3-4e4f-aa46-de670b372748 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.953576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08c69-b0e3-4e4f-aa46-de670b372748 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:12.954356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08c69-b0e3-4e4f-aa46-de670b372748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:12.957227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08c69-b0e3-4e4f-aa46-de670b372748 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:12.975894 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1565/3121] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:12.980098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c9305-ed63-4f2b-99e9-3d436e0914ae admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:12.992101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c9305-ed63-4f2b-99e9-3d436e0914ae admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:12.997564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68386782-3d81-4342-88bb-fb825f10ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:12.998361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68386782-3d81-4342-88bb-fb825f10ed55 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:12.998832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68386782-3d81-4342-88bb-fb825f10ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:12.999408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68386782-3d81-4342-88bb-fb825f10ed55 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:13.000293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68386782-3d81-4342-88bb-fb825f10ed55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:13.002477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68386782-3d81-4342-88bb-fb825f10ed55 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:13.019429 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1557/3122] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:56:13.023349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08c69-b0e3-4e4f-aa46-de670b372748 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:13.037809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08c69-b0e3-4e4f-aa46-de670b372748 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:13.043451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:13.044616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:13.045055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:13.045495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] PATH_INFO: `/v3/projects/b959eb07a97740dca63d3cf3d2ed0a63/users/5a3a1e86138d41b991f5e44a1e8ae2eb/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:13.065134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b959eb07a97740dca63d3cf3d2ed0a63, user_id=5a3a1e86138d41b991f5e44a1e8ae2eb, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:13.068833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:13.093498 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1566/3123] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:13 2022] PUT /identity/v3/projects/b959eb07a97740dca63d3cf3d2ed0a63/users/5a3a1e86138d41b991f5e44a1e8ae2eb/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:13.100890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bb13-6b58-4387-a94c-ee28ac19023c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:13.101474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bb13-6b58-4387-a94c-ee28ac19023c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:13.101834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bb13-6b58-4387-a94c-ee28ac19023c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:13.133069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b6f7bb13-6b58-4387-a94c-ee28ac19023c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:13.134772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b6f7bb13-6b58-4387-a94c-ee28ac19023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:13.221927 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1558/3124] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:56:13.235145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:13.238662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:13.331287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7477e-9acf-4f32-a359-96ac05d9cd4f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:13.335533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7f00d-2510-49d3-992a-a6f7b21c1381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:13.336925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f00d-2510-49d3-992a-a6f7b21c1381 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:13.336925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f00d-2510-49d3-992a-a6f7b21c1381 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:13.336925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f00d-2510-49d3-992a-a6f7b21c1381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:13.349654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7f00d-2510-49d3-992a-a6f7b21c1381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:13.351659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7f00d-2510-49d3-992a-a6f7b21c1381 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:13.366456 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1567/3125] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:56:14.516749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8afe9-f583-42b3-807b-b5dd003792bd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:14.517283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8afe9-f583-42b3-807b-b5dd003792bd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:14.517283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8afe9-f583-42b3-807b-b5dd003792bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:14.568019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-aeb8afe9-f583-42b3-807b-b5dd003792bd None None] MFA Rules not processed for user `5a3a1e86138d41b991f5e44a1e8ae2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:14.569210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aeb8afe9-f583-42b3-807b-b5dd003792bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:14.694891 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1559/3126] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:14.707239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdf40-37e1-4de1-bc7c-3202040d9381 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:14.708142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdf40-37e1-4de1-bc7c-3202040d9381 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:14.708632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdf40-37e1-4de1-bc7c-3202040d9381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:14.729363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-03dfdf40-37e1-4de1-bc7c-3202040d9381 None None] MFA Rules not processed for user `5a3a1e86138d41b991f5e44a1e8ae2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:14.730947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-03dfdf40-37e1-4de1-bc7c-3202040d9381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:14.740779 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1568/3127] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:56:15.226820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8afe9-f583-42b3-807b-b5dd003792bd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:15.310687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8afe9-f583-42b3-807b-b5dd003792bd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:15.318511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8dc0f-2a58-4709-bc3b-e6b94dc81f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:15.319305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dc0f-2a58-4709-bc3b-e6b94dc81f62 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:15.319459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dc0f-2a58-4709-bc3b-e6b94dc81f62 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:15.319730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dc0f-2a58-4709-bc3b-e6b94dc81f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:15.328720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8dc0f-2a58-4709-bc3b-e6b94dc81f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:15.330346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8dc0f-2a58-4709-bc3b-e6b94dc81f62 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:15.340717 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1560/3128] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:17.320301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05970e52-653a-438f-a9b7-9c7052e716bf None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:17.321432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05970e52-653a-438f-a9b7-9c7052e716bf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:17.322179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05970e52-653a-438f-a9b7-9c7052e716bf None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:17.324803 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1569/3129] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:56:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:56:17.331310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d5b7-2a17-4ab1-a555-b7f51ae022db None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:17.332285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d5b7-2a17-4ab1-a555-b7f51ae022db None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:17.332812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d5b7-2a17-4ab1-a555-b7f51ae022db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:17.356912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2218d5b7-2a17-4ab1-a555-b7f51ae022db None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:17.358177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2218d5b7-2a17-4ab1-a555-b7f51ae022db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:17.472553 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1561/3130] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:17.500872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05970e52-653a-438f-a9b7-9c7052e716bf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:17.509249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-05970e52-653a-438f-a9b7-9c7052e716bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:17.549863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05970e52-653a-438f-a9b7-9c7052e716bf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:17.567489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc6070-bac6-47da-b227-e2b6ce9a8213 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:17.568157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6070-bac6-47da-b227-e2b6ce9a8213 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:17.568521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6070-bac6-47da-b227-e2b6ce9a8213 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:17.568800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6070-bac6-47da-b227-e2b6ce9a8213 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:17.586256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc6070-bac6-47da-b227-e2b6ce9a8213 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:17.589214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc6070-bac6-47da-b227-e2b6ce9a8213 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:17.607716 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1570/3131] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:17.931573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d5b7-2a17-4ab1-a555-b7f51ae022db None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:17.964788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d5b7-2a17-4ab1-a555-b7f51ae022db None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:17.987425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:17.988106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:17.988421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:17.988754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:17.991515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:18.008551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:18.010942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:18.024620 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1562/3132] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:25.221422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc6070-bac6-47da-b227-e2b6ce9a8213 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:25.233733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc6070-bac6-47da-b227-e2b6ce9a8213 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:25.239878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399ce54-471a-4371-8efb-40a04b58ac3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:25.240538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ce54-471a-4371-8efb-40a04b58ac3e service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:25.240817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ce54-471a-4371-8efb-40a04b58ac3e service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:25.241089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399ce54-471a-4371-8efb-40a04b58ac3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:25.242816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8399ce54-471a-4371-8efb-40a04b58ac3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:25.304009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399ce54-471a-4371-8efb-40a04b58ac3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:25.305719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399ce54-471a-4371-8efb-40a04b58ac3e service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:25.316804 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1571/3133] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:26.205669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:26.216909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d16f-659a-4ece-aefb-1afb5ea859e6 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:26.223154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:26.223969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:26.224356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:26.224711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:26.226615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:26.289083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:26.290653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:26.301470 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1563/3134] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:28.551763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d608-e634-4349-a788-3f18c4bcb6dc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:28.552947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d608-e634-4349-a788-3f18c4bcb6dc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:28.553528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d608-e634-4349-a788-3f18c4bcb6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:28.575517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3596d608-e634-4349-a788-3f18c4bcb6dc None None] MFA Rules not processed for user `ab3fa7eadddf42b4b700593dad828e44`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:28.591572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3596d608-e634-4349-a788-3f18c4bcb6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:28.658145 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1572/3135] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:30.225848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:30.227372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:30.250953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27f18-f992-4dba-af8a-e7bf9af7861d service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:30.264527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:30.265764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:30.266262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:30.266880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] PATH_INFO: `/v3/users/bb905e794fc44406911ef1d5b77cc26a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:30.270621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb905e794fc44406911ef1d5b77cc26a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:30.276625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:30.384389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb905e794fc44406911ef1d5b77cc26a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:30.385096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb905e794fc44406911ef1d5b77cc26a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:30.387517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb905e794fc44406911ef1d5b77cc26a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:30.414738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb905e794fc44406911ef1d5b77cc26a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:30.444044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb905e794fc44406911ef1d5b77cc26a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:30.465594 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1564/3136] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:30 2022] DELETE /identity/v3/users/bb905e794fc44406911ef1d5b77cc26a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:30.470782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2f0e9-ae90-4e0b-85bb-a30c7ecd8af9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:30.471284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2f0e9-ae90-4e0b-85bb-a30c7ecd8af9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:30.471284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2f0e9-ae90-4e0b-85bb-a30c7ecd8af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:30.505466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-90b2f0e9-ae90-4e0b-85bb-a30c7ecd8af9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:30.506737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-90b2f0e9-ae90-4e0b-85bb-a30c7ecd8af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:30.594913 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1573/3137] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:30.615103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:30.616585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:30.795868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6809-1ee6-4dd5-b5b6-31d521dfd114 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:30.801433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02673-adc5-492f-8f98-665cf7f87e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:30.802530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02673-adc5-492f-8f98-665cf7f87e6e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:30.803170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02673-adc5-492f-8f98-665cf7f87e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:30.803694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02673-adc5-492f-8f98-665cf7f87e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:30.816377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb02673-adc5-492f-8f98-665cf7f87e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:30.820462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb02673-adc5-492f-8f98-665cf7f87e6e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:30.837000 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1565/3138] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:31.123859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2f0e9-ae90-4e0b-85bb-a30c7ecd8af9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:31.125555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-90b2f0e9-ae90-4e0b-85bb-a30c7ecd8af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:31.145484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2f0e9-ae90-4e0b-85bb-a30c7ecd8af9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:31.152090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:31.154000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:31.154645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:31.155125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] PATH_INFO: `/v3/projects/ac7c7b1e5ce345fd99f7b69afd3a5554` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:31.157089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7c7b1e5ce345fd99f7b69afd3a5554)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:31.160535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:31.247192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'request_id': 'req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.264920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'request_id': 'req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.277986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'request_id': 'req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.291721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] The token cache is being invalidate because project ac7c7b1e5ce345fd99f7b69afd3a5554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:31.292080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.293399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.295335 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1574/3139] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:31 2022] DELETE /identity/v3/projects/ac7c7b1e5ce345fd99f7b69afd3a5554 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:31.300353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02673-adc5-492f-8f98-665cf7f87e6e service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:31.321703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02673-adc5-492f-8f98-665cf7f87e6e service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:31.415392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:31.417491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:31.418780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:31.419521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] PATH_INFO: `/v3/users/e4c93f5edd134d5aab4e4f3bbe8e444e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:31.421486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c93f5edd134d5aab4e4f3bbe8e444e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:31.437600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:31.556656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c93f5edd134d5aab4e4f3bbe8e444e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.557344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c93f5edd134d5aab4e4f3bbe8e444e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.563134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c93f5edd134d5aab4e4f3bbe8e444e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.585175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c93f5edd134d5aab4e4f3bbe8e444e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.595146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-84448cf9-637b-40c4-b31b-676035c97661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c93f5edd134d5aab4e4f3bbe8e444e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:31.613438 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1566/3140] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:31 2022] DELETE /identity/v3/users/e4c93f5edd134d5aab4e4f3bbe8e444e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:32.235029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:32.237684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:32.273296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe1129-c1de-4bd8-9f60-d6c8ed6bbf3e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:32.466283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:32.467534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:32.468019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:32.468560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] PATH_INFO: `/v3/projects/ce545f10a3af4fb8b11a2402abf15972` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:32.471049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce545f10a3af4fb8b11a2402abf15972)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:32.481571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:32.574644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce545f10a3af4fb8b11a2402abf15972', 'request_id': 'req-3e5db24f-dc19-42f2-adea-0725649195fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:32.582505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce545f10a3af4fb8b11a2402abf15972', 'request_id': 'req-3e5db24f-dc19-42f2-adea-0725649195fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:32.597102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce545f10a3af4fb8b11a2402abf15972', 'request_id': 'req-3e5db24f-dc19-42f2-adea-0725649195fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:32.622558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] The token cache is being invalidate because project ce545f10a3af4fb8b11a2402abf15972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:32.623562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:32.624501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e5db24f-dc19-42f2-adea-0725649195fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:32.627662 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1575/3141] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:32 2022] DELETE /identity/v3/projects/ce545f10a3af4fb8b11a2402abf15972 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:32.633417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e9f7-318f-4cf2-b2ac-7aa14b55f9e1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:32.635485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e9f7-318f-4cf2-b2ac-7aa14b55f9e1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:32.636004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e9f7-318f-4cf2-b2ac-7aa14b55f9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:32.693203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7be9e9f7-318f-4cf2-b2ac-7aa14b55f9e1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:32.694986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7be9e9f7-318f-4cf2-b2ac-7aa14b55f9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:32.801764 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1567/3142] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:56:32.810344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d40ec8-332b-4dbf-814a-9f404998cde3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:32.810772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d40ec8-332b-4dbf-814a-9f404998cde3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:32.811154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d40ec8-332b-4dbf-814a-9f404998cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:32.840306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a5d40ec8-332b-4dbf-814a-9f404998cde3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:32.842348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a5d40ec8-332b-4dbf-814a-9f404998cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:32.853654 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1576/3143] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:32.857831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9e9f7-318f-4cf2-b2ac-7aa14b55f9e1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:32.874143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9e9f7-318f-4cf2-b2ac-7aa14b55f9e1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:32.881265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:32.882263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:32.883198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:32.883560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:32.884438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:56:32.884823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:32.889917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:32.932274 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1568/3144] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:56:32.932865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d40ec8-332b-4dbf-814a-9f404998cde3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:32.944847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d40ec8-332b-4dbf-814a-9f404998cde3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:32.964964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68090e0e-5c2d-4bef-bca0-864e61a7ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:32.965655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68090e0e-5c2d-4bef-bca0-864e61a7ea89 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:32.965988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68090e0e-5c2d-4bef-bca0-864e61a7ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:32.966206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68090e0e-5c2d-4bef-bca0-864e61a7ea89 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:32.966909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68090e0e-5c2d-4bef-bca0-864e61a7ea89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:32.969248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68090e0e-5c2d-4bef-bca0-864e61a7ea89 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:33.023589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:33.030616 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1577/3145] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:56:32 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:56:33.038458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bbc57-4ea3-42ed-8bee-872f4b52a741 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:33.113507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a710b-96ad-4531-96c9-242bb3b41adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:33.114315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a710b-96ad-4531-96c9-242bb3b41adc admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:33.114676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a710b-96ad-4531-96c9-242bb3b41adc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:33.115058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a710b-96ad-4531-96c9-242bb3b41adc admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:33.116099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a710b-96ad-4531-96c9-242bb3b41adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:33.118447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a710b-96ad-4531-96c9-242bb3b41adc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:33.181573 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1569/3146] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:56:33 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:33.185002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68090e0e-5c2d-4bef-bca0-864e61a7ea89 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:33.195372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68090e0e-5c2d-4bef-bca0-864e61a7ea89 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:33.200660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947151dd-564f-431c-9332-55a462f5cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:33.201258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947151dd-564f-431c-9332-55a462f5cae4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:33.201613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947151dd-564f-431c-9332-55a462f5cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:33.202046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947151dd-564f-431c-9332-55a462f5cae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:33.202787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947151dd-564f-431c-9332-55a462f5cae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:33.204421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947151dd-564f-431c-9332-55a462f5cae4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:33.218756 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1578/3147] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:33.222731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a710b-96ad-4531-96c9-242bb3b41adc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:33.234184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a710b-96ad-4531-96c9-242bb3b41adc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:33.249142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98716eb0-de02-48f0-b9f0-0d7456cb86b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:33.249705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98716eb0-de02-48f0-b9f0-0d7456cb86b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:33.249989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98716eb0-de02-48f0-b9f0-0d7456cb86b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:33.250266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98716eb0-de02-48f0-b9f0-0d7456cb86b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:33.251054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98716eb0-de02-48f0-b9f0-0d7456cb86b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:33.252774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98716eb0-de02-48f0-b9f0-0d7456cb86b2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:33.265345 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1570/3148] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:33.269725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947151dd-564f-431c-9332-55a462f5cae4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:33.281644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947151dd-564f-431c-9332-55a462f5cae4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:33.288756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:33.289896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:33.290397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:33.290751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] PATH_INFO: `/v3/projects/293e8257104f47469cf322754e382cad/users/43615d3db32e4691a7be7a57127ae380/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:33.333545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293e8257104f47469cf322754e382cad, user_id=43615d3db32e4691a7be7a57127ae380, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:33.337253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:33.364694 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1579/3149] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:33 2022] PUT /identity/v3/projects/293e8257104f47469cf322754e382cad/users/43615d3db32e4691a7be7a57127ae380/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:33.450428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85295a2-1acd-4b34-978f-35ff44424290 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:33.450867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85295a2-1acd-4b34-978f-35ff44424290 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:33.451294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85295a2-1acd-4b34-978f-35ff44424290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:33.521054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e85295a2-1acd-4b34-978f-35ff44424290 None None] MFA Rules not processed for user `43615d3db32e4691a7be7a57127ae380`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:33.522503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e85295a2-1acd-4b34-978f-35ff44424290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:33.668415 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1571/3150] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:33.920132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:33.921935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:34.013790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd60fc-0f0f-469c-9afc-e2a491c01296 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:34.023194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba83ce-dbb5-4159-988e-9549d5c0c1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:34.023871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba83ce-dbb5-4159-988e-9549d5c0c1d6 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:34.024167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba83ce-dbb5-4159-988e-9549d5c0c1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:34.024472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba83ce-dbb5-4159-988e-9549d5c0c1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:34.035936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba83ce-dbb5-4159-988e-9549d5c0c1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:34.038934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba83ce-dbb5-4159-988e-9549d5c0c1d6 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:34.052765 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1580/3151] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:34.184524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90fec-1c83-4d3f-b859-892084d6d422 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:34.184962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90fec-1c83-4d3f-b859-892084d6d422 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:34.185331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90fec-1c83-4d3f-b859-892084d6d422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:34.230300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-24c90fec-1c83-4d3f-b859-892084d6d422 None None] MFA Rules not processed for user `0d694f3e8da440a9a1cac8ca2de030e8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:34.232664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-24c90fec-1c83-4d3f-b859-892084d6d422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:34.339541 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1572/3152] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:35.913400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba83ce-dbb5-4159-988e-9549d5c0c1d6 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:36.034583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba83ce-dbb5-4159-988e-9549d5c0c1d6 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:36.039793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:36.040782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:36.041135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:36.041477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] PATH_INFO: `/v3/users/43615d3db32e4691a7be7a57127ae380` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:36.043039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43615d3db32e4691a7be7a57127ae380)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:36.045351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:36.101783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43615d3db32e4691a7be7a57127ae380'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:36.116464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43615d3db32e4691a7be7a57127ae380'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:36.125622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43615d3db32e4691a7be7a57127ae380'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:36.126697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43615d3db32e4691a7be7a57127ae380'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:36.127664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43615d3db32e4691a7be7a57127ae380'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:36.147505 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1581/3153] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:35 2022] DELETE /identity/v3/users/43615d3db32e4691a7be7a57127ae380 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:56:36.152211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec691b-43ff-47ce-aae3-4b5688445c1f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:36.153697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec691b-43ff-47ce-aae3-4b5688445c1f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:36.153981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec691b-43ff-47ce-aae3-4b5688445c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:36.177300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b0ec691b-43ff-47ce-aae3-4b5688445c1f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:36.178840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0ec691b-43ff-47ce-aae3-4b5688445c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:36.245054 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1573/3154] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:56:36.254732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:36.256341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:36.325316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0dbce-e140-45f4-8f6f-b69f3fe88e14 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:36.328931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60d256-151d-4987-b3f4-3ad5a6d26b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:36.329620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60d256-151d-4987-b3f4-3ad5a6d26b6d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:36.330448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60d256-151d-4987-b3f4-3ad5a6d26b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:36.330727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60d256-151d-4987-b3f4-3ad5a6d26b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:36.340090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60d256-151d-4987-b3f4-3ad5a6d26b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:36.341561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60d256-151d-4987-b3f4-3ad5a6d26b6d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:36.351047 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1582/3155] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:37.287986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec691b-43ff-47ce-aae3-4b5688445c1f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:37.290158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0ec691b-43ff-47ce-aae3-4b5688445c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:37.303489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec691b-43ff-47ce-aae3-4b5688445c1f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:37.310834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:37.312001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.312412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.312965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] PATH_INFO: `/v3/projects/293e8257104f47469cf322754e382cad` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.314858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=293e8257104f47469cf322754e382cad)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:37.317424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:37.373141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293e8257104f47469cf322754e382cad', 'request_id': 'req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:37.380568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293e8257104f47469cf322754e382cad', 'request_id': 'req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:37.389524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293e8257104f47469cf322754e382cad', 'request_id': 'req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:37.402726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] The token cache is being invalidate because project 293e8257104f47469cf322754e382cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:37.403908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:37.404833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2e62461a-a042-4b95-a2cf-c41dfb48c8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:37.411371 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1574/3156] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:37 2022] DELETE /identity/v3/projects/293e8257104f47469cf322754e382cad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:37.412995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f03d7-fec4-4e35-bc8e-437cd39b0eef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.413474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f03d7-fec4-4e35-bc8e-437cd39b0eef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.413594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f03d7-fec4-4e35-bc8e-437cd39b0eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.435273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bd4f03d7-fec4-4e35-bc8e-437cd39b0eef None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:37.436932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bd4f03d7-fec4-4e35-bc8e-437cd39b0eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:37.543103 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1583/3157] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:37.551609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae688c-c1fe-4592-94af-8958e5322741 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.551897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae688c-c1fe-4592-94af-8958e5322741 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.552588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae688c-c1fe-4592-94af-8958e5322741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.580224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2dae688c-c1fe-4592-94af-8958e5322741 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:37.581863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2dae688c-c1fe-4592-94af-8958e5322741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:37.592829 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1575/3158] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:37.597767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f03d7-fec4-4e35-bc8e-437cd39b0eef None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:37.610945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f03d7-fec4-4e35-bc8e-437cd39b0eef None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:37.615791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:37.616488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.617107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.617396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.618131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:56:37.618441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:37.620440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:37.634689 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1584/3159] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:56:37.639262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae688c-c1fe-4592-94af-8958e5322741 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:37.650067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae688c-c1fe-4592-94af-8958e5322741 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:37.654951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfebc9-9cd9-4b0e-87e9-bc20341174cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:37.655703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfebc9-9cd9-4b0e-87e9-bc20341174cd admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.656060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfebc9-9cd9-4b0e-87e9-bc20341174cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.656473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfebc9-9cd9-4b0e-87e9-bc20341174cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.657235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfebc9-9cd9-4b0e-87e9-bc20341174cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:37.659843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfebc9-9cd9-4b0e-87e9-bc20341174cd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:37.692381 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1576/3160] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:56:37 2022] POST /identity/v3/projects => generated 395 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:56:37.696923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:37.713644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131deb90-5039-4a67-9928-581f578ad28d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:37.772008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d5ab1-0494-4760-8563-f0b2fd02f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:37.772782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5ab1-0494-4760-8563-f0b2fd02f89c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.773071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5ab1-0494-4760-8563-f0b2fd02f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.773352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5ab1-0494-4760-8563-f0b2fd02f89c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.774046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d5ab1-0494-4760-8563-f0b2fd02f89c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:37.775966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d5ab1-0494-4760-8563-f0b2fd02f89c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:37.796363 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1585/3161] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:56:37 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:37.800649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfebc9-9cd9-4b0e-87e9-bc20341174cd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:37.819295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfebc9-9cd9-4b0e-87e9-bc20341174cd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:37.825656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f1e7-48f3-4822-8605-023d3f6af687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:37.826901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f1e7-48f3-4822-8605-023d3f6af687 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.827339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f1e7-48f3-4822-8605-023d3f6af687 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.827760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f1e7-48f3-4822-8605-023d3f6af687 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.829277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2f1e7-48f3-4822-8605-023d3f6af687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:37.831085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2f1e7-48f3-4822-8605-023d3f6af687 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:37.846563 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1577/3162] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:37.850366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d5ab1-0494-4760-8563-f0b2fd02f89c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:37.865222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d5ab1-0494-4760-8563-f0b2fd02f89c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:37.877129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718742c2-fce9-4c34-8af8-31e673e8dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:37.877129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718742c2-fce9-4c34-8af8-31e673e8dfed admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.877129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718742c2-fce9-4c34-8af8-31e673e8dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.877129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718742c2-fce9-4c34-8af8-31e673e8dfed admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.877516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718742c2-fce9-4c34-8af8-31e673e8dfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:37.880678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718742c2-fce9-4c34-8af8-31e673e8dfed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:37.897687 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1586/3163] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:37.905759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f1e7-48f3-4822-8605-023d3f6af687 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:37.920544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f1e7-48f3-4822-8605-023d3f6af687 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:37.930472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:37.931624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.931906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.932190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] PATH_INFO: `/v3/projects/73f78ca2c7a340a78e721152554d946d/users/1e358656f43848e3a13a46c6fb72d685/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:37.950736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f78ca2c7a340a78e721152554d946d, user_id=1e358656f43848e3a13a46c6fb72d685, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:37.953623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:37.973304 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1578/3164] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:37 2022] PUT /identity/v3/projects/73f78ca2c7a340a78e721152554d946d/users/1e358656f43848e3a13a46c6fb72d685/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:37.978650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fb63c-7933-41e6-9a5a-0b4a1b4e60c1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:37.978938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fb63c-7933-41e6-9a5a-0b4a1b4e60c1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:37.979289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fb63c-7933-41e6-9a5a-0b4a1b4e60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:38.000295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-310fb63c-7933-41e6-9a5a-0b4a1b4e60c1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:38.001631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-310fb63c-7933-41e6-9a5a-0b4a1b4e60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:38.077946 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1587/3165] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:38.089225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:38.091680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:38.192136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc63b-9ea8-4faa-be07-3511633fe93f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:38.213856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:38.226005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:38.227061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:38.227353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:38.262771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:38.265429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:38.289927 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1579/3166] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:39.940907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea20ce4-37b7-4038-9693-95a7adcf2636 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:39.942166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea20ce4-37b7-4038-9693-95a7adcf2636 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:39.942667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea20ce4-37b7-4038-9693-95a7adcf2636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:40.020312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-eea20ce4-37b7-4038-9693-95a7adcf2636 None None] MFA Rules not processed for user `1e358656f43848e3a13a46c6fb72d685`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:40.022667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eea20ce4-37b7-4038-9693-95a7adcf2636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:40.114388 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1588/3167] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:40.412017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:40.414190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:40.490953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a661a-1995-4f8a-b9e7-68797b5092df service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:40.497938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71414bc6-7468-4f68-bc1e-807ac800b122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:40.498812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414bc6-7468-4f68-bc1e-807ac800b122 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:40.499269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414bc6-7468-4f68-bc1e-807ac800b122 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:40.499543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414bc6-7468-4f68-bc1e-807ac800b122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:40.508266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71414bc6-7468-4f68-bc1e-807ac800b122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:40.509976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71414bc6-7468-4f68-bc1e-807ac800b122 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:40.519624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1580/3168] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:41.052283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db3eff-c489-42ef-a929-2b7790399333 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:41.052839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db3eff-c489-42ef-a929-2b7790399333 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:41.052931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db3eff-c489-42ef-a929-2b7790399333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:41.071384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-40db3eff-c489-42ef-a929-2b7790399333 None None] MFA Rules not processed for user `ab3fa7eadddf42b4b700593dad828e44`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:41.072647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-40db3eff-c489-42ef-a929-2b7790399333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:41.127365 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1589/3169] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:56:42.650791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71414bc6-7468-4f68-bc1e-807ac800b122 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:42.669881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71414bc6-7468-4f68-bc1e-807ac800b122 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:42.675175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:42.676035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:42.676314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:42.676634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] PATH_INFO: `/v3/users/1e358656f43848e3a13a46c6fb72d685` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:42.677811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e358656f43848e3a13a46c6fb72d685)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:42.679729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:42.726948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e358656f43848e3a13a46c6fb72d685'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:42.727602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e358656f43848e3a13a46c6fb72d685'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:42.728204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e358656f43848e3a13a46c6fb72d685'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:42.740721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e358656f43848e3a13a46c6fb72d685'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:42.747630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-128a4e2f-6b80-4957-a78e-f225b9c49972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e358656f43848e3a13a46c6fb72d685'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:42.760015 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1581/3170] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:42 2022] DELETE /identity/v3/users/1e358656f43848e3a13a46c6fb72d685 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:42.955810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db3eff-c489-42ef-a929-2b7790399333 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:42.987583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db3eff-c489-42ef-a929-2b7790399333 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:43.054319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:43.055433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.055900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.056174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] PATH_INFO: `/v3/projects/73f78ca2c7a340a78e721152554d946d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.057685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f78ca2c7a340a78e721152554d946d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:43.059577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:43.118029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f78ca2c7a340a78e721152554d946d', 'request_id': 'req-7dd1a840-503a-4f27-aed9-d4c9f589ae26'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:43.124113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f78ca2c7a340a78e721152554d946d', 'request_id': 'req-7dd1a840-503a-4f27-aed9-d4c9f589ae26'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:43.134678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f78ca2c7a340a78e721152554d946d', 'request_id': 'req-7dd1a840-503a-4f27-aed9-d4c9f589ae26'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:43.146998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] The token cache is being invalidate because project 73f78ca2c7a340a78e721152554d946d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:43.147291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:43.147941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dd1a840-503a-4f27-aed9-d4c9f589ae26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:43.149509 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1590/3171] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:42 2022] DELETE /identity/v3/projects/73f78ca2c7a340a78e721152554d946d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:43.154755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5238-9bb7-436c-98a3-c1383a2255f1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.155060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5238-9bb7-436c-98a3-c1383a2255f1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.155358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5238-9bb7-436c-98a3-c1383a2255f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.174498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fbfe5238-9bb7-436c-98a3-c1383a2255f1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:43.175698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fbfe5238-9bb7-436c-98a3-c1383a2255f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:43.234280 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1582/3172] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:56:43.242230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cae9c6-fd51-4fb9-b83c-1dac06576f39 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.242517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cae9c6-fd51-4fb9-b83c-1dac06576f39 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.242791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cae9c6-fd51-4fb9-b83c-1dac06576f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.261056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-78cae9c6-fd51-4fb9-b83c-1dac06576f39 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:43.262237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-78cae9c6-fd51-4fb9-b83c-1dac06576f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:43.272640 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1591/3173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:43.276738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe5238-9bb7-436c-98a3-c1383a2255f1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:43.286669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe5238-9bb7-436c-98a3-c1383a2255f1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:43.291254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:43.291927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.292207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.292518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.293275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:56:43.293583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:43.295210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:43.306866 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1583/3174] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:56:43.311226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cae9c6-fd51-4fb9-b83c-1dac06576f39 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:43.321077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cae9c6-fd51-4fb9-b83c-1dac06576f39 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:43.326027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb955-943d-4e75-99fe-cc9acba167de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:43.326837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb955-943d-4e75-99fe-cc9acba167de admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.327126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb955-943d-4e75-99fe-cc9acba167de admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.327399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb955-943d-4e75-99fe-cc9acba167de admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.328097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cb955-943d-4e75-99fe-cc9acba167de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:43.330638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cb955-943d-4e75-99fe-cc9acba167de admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:43.356524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1592/3175] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:56:43 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:43.360781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:43.370506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc942e-80f7-4dad-91bf-449420b64fc7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:43.447310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a731ce-b077-45ff-9790-bdebeb19f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:43.447310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a731ce-b077-45ff-9790-bdebeb19f2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.447310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a731ce-b077-45ff-9790-bdebeb19f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.447310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a731ce-b077-45ff-9790-bdebeb19f2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.447781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a731ce-b077-45ff-9790-bdebeb19f2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:43.449044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a731ce-b077-45ff-9790-bdebeb19f2b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:43.476622 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1584/3176] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:56:43 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:56:43.477845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb955-943d-4e75-99fe-cc9acba167de admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:43.490320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb955-943d-4e75-99fe-cc9acba167de admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:43.498819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb980e22-8fcc-472d-b9ea-1a2ed5431d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:43.499513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb980e22-8fcc-472d-b9ea-1a2ed5431d0e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.499794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb980e22-8fcc-472d-b9ea-1a2ed5431d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.500251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb980e22-8fcc-472d-b9ea-1a2ed5431d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.501008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb980e22-8fcc-472d-b9ea-1a2ed5431d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:43.505928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb980e22-8fcc-472d-b9ea-1a2ed5431d0e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:43.519034 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1593/3177] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:43.522917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a731ce-b077-45ff-9790-bdebeb19f2b9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:43.534380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a731ce-b077-45ff-9790-bdebeb19f2b9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:43.541656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaaa06-58b1-47fc-964e-9be83f8045bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:43.544752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaaa06-58b1-47fc-964e-9be83f8045bb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.545272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaaa06-58b1-47fc-964e-9be83f8045bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.545738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaaa06-58b1-47fc-964e-9be83f8045bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.546710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaaa06-58b1-47fc-964e-9be83f8045bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:43.549373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaaa06-58b1-47fc-964e-9be83f8045bb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:43.566219 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1585/3178] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:43.567553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb980e22-8fcc-472d-b9ea-1a2ed5431d0e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:43.581683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb980e22-8fcc-472d-b9ea-1a2ed5431d0e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:43.586924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:43.588231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.589689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.590181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] PATH_INFO: `/v3/projects/5c496adb59f3467687458650e28da232/users/33f01d50bf4e41ff95c09af549cd37e9/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.608395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c496adb59f3467687458650e28da232, user_id=33f01d50bf4e41ff95c09af549cd37e9, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:43.611993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:43.628856 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1594/3179] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:43 2022] PUT /identity/v3/projects/5c496adb59f3467687458650e28da232/users/33f01d50bf4e41ff95c09af549cd37e9/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:43.633903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7f6a-513d-40a7-9221-78e7b531a364 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.634284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7f6a-513d-40a7-9221-78e7b531a364 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.634491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7f6a-513d-40a7-9221-78e7b531a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.657152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-af7e7f6a-513d-40a7-9221-78e7b531a364 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:43.659401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-af7e7f6a-513d-40a7-9221-78e7b531a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:43.734330 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1586/3180] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:43.776535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:43.778305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:43.862167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3030e-cf66-4d83-8abb-540b6182f512 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:43.866536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e372d-e693-457b-b4a9-161eceedeceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:43.867681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e372d-e693-457b-b4a9-161eceedeceb service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:43.868099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e372d-e693-457b-b4a9-161eceedeceb service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:43.868804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e372d-e693-457b-b4a9-161eceedeceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:43.880267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e372d-e693-457b-b4a9-161eceedeceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:43.881884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e372d-e693-457b-b4a9-161eceedeceb service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:43.893540 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1595/3181] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:46.540316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e7f6a-513d-40a7-9221-78e7b531a364 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:46.543162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-af7e7f6a-513d-40a7-9221-78e7b531a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:46.560672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e7f6a-513d-40a7-9221-78e7b531a364 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:46.574368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:46.576127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:46.576543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:46.576918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] PATH_INFO: `/v3/users/c26bc5048c9849218cadd12475cd5fbe` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:46.578545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26bc5048c9849218cadd12475cd5fbe)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:46.581612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:46.666557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26bc5048c9849218cadd12475cd5fbe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:46.669931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26bc5048c9849218cadd12475cd5fbe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:46.670840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26bc5048c9849218cadd12475cd5fbe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:46.702745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26bc5048c9849218cadd12475cd5fbe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:46.713980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26bc5048c9849218cadd12475cd5fbe'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:46.732737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1587/3182] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:46 2022] DELETE /identity/v3/users/c26bc5048c9849218cadd12475cd5fbe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:56:46.737999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f94456-e2fe-4bf0-94ae-38002885a44e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:46.739034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f94456-e2fe-4bf0-94ae-38002885a44e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:46.739522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f94456-e2fe-4bf0-94ae-38002885a44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:46.765562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-49f94456-e2fe-4bf0-94ae-38002885a44e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:46.767086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-49f94456-e2fe-4bf0-94ae-38002885a44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:46.871527 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1596/3183] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:46.908590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:46.910213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:47.000045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4385-336a-4f5c-8b02-c9ea5c95ecb8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:47.005500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8dd3-c3fa-430b-b527-c59bb89f2ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:47.006200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8dd3-c3fa-430b-b527-c59bb89f2ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:47.006486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8dd3-c3fa-430b-b527-c59bb89f2ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:47.006764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8dd3-c3fa-430b-b527-c59bb89f2ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:47.018371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a8dd3-c3fa-430b-b527-c59bb89f2ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:47.021775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a8dd3-c3fa-430b-b527-c59bb89f2ac6 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:47.033668 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1588/3184] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:47.664578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f94456-e2fe-4bf0-94ae-38002885a44e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:47.668316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-49f94456-e2fe-4bf0-94ae-38002885a44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:47.696356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f94456-e2fe-4bf0-94ae-38002885a44e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:47.702926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:47.703915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:47.704295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:47.705284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] PATH_INFO: `/v3/projects/e2599a1bea39406f9b1e548ab3f1cd22` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:47.707058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2599a1bea39406f9b1e548ab3f1cd22)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:47.709845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:47.802323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2599a1bea39406f9b1e548ab3f1cd22', 'request_id': 'req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:47.812855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2599a1bea39406f9b1e548ab3f1cd22', 'request_id': 'req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:47.828937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2599a1bea39406f9b1e548ab3f1cd22', 'request_id': 'req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:47.845562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] The token cache is being invalidate because project e2599a1bea39406f9b1e548ab3f1cd22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:47.846154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:47.847058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:47.849254 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1597/3185] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:47 2022] DELETE /identity/v3/projects/e2599a1bea39406f9b1e548ab3f1cd22 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:47.853568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8dd3-c3fa-430b-b527-c59bb89f2ac6 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:47.865743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8dd3-c3fa-430b-b527-c59bb89f2ac6 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:47.934174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:47.935063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:47.935337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:47.935607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] PATH_INFO: `/v3/users/168c8aa254304f4097c3a3c75e3e423a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:47.942788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=168c8aa254304f4097c3a3c75e3e423a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:47.944966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:48.019304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168c8aa254304f4097c3a3c75e3e423a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.019971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168c8aa254304f4097c3a3c75e3e423a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.020644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168c8aa254304f4097c3a3c75e3e423a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.034312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168c8aa254304f4097c3a3c75e3e423a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.043367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764ae4e3-cb57-4561-bde5-a462b7ffde62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168c8aa254304f4097c3a3c75e3e423a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.076057 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1589/3186] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:56:47 2022] DELETE /identity/v3/users/168c8aa254304f4097c3a3c75e3e423a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:56:48.261431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:48.263363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:48.279977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7ac6-7a67-4cf4-9965-81f91a7078ff admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:48.345035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:48.346253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:48.346623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:48.346998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] PATH_INFO: `/v3/projects/407c70643b364ed8a2371acba506a19f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:48.348485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=407c70643b364ed8a2371acba506a19f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:48.350458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:48.409720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407c70643b364ed8a2371acba506a19f', 'request_id': 'req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.415385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407c70643b364ed8a2371acba506a19f', 'request_id': 'req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.425327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407c70643b364ed8a2371acba506a19f', 'request_id': 'req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.439947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] The token cache is being invalidate because project 407c70643b364ed8a2371acba506a19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:56:48.440250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.441701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642a74ac-bd82-4183-8fd8-dd48a94fc7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:56:48.445345 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1598/3187] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:48 2022] DELETE /identity/v3/projects/407c70643b364ed8a2371acba506a19f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:48.449765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286869cd-c1d7-4564-b839-7442e783b7f2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:48.450351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286869cd-c1d7-4564-b839-7442e783b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:48.452304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286869cd-c1d7-4564-b839-7442e783b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:48.478783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-286869cd-c1d7-4564-b839-7442e783b7f2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:48.480012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-286869cd-c1d7-4564-b839-7442e783b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:48.604503 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1590/3188] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:48.609498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3007c-08ea-40af-806e-2d9776eafeff None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:48.610011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3007c-08ea-40af-806e-2d9776eafeff None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:48.610449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3007c-08ea-40af-806e-2d9776eafeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:48.643871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e4e3007c-08ea-40af-806e-2d9776eafeff None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:48.645661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e4e3007c-08ea-40af-806e-2d9776eafeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:48.658719 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1599/3189] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:48.660477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286869cd-c1d7-4564-b839-7442e783b7f2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:48.676534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286869cd-c1d7-4564-b839-7442e783b7f2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:48.688587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:48.689970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:48.690352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:48.691522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:48.692461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:56:48.693039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:48.698002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:48.744274 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1591/3190] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:56:48.748797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3007c-08ea-40af-806e-2d9776eafeff None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:48.770921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3007c-08ea-40af-806e-2d9776eafeff None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:48.777097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3132f-aeb3-411c-8e2e-e83e3808674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:48.777960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3132f-aeb3-411c-8e2e-e83e3808674f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:48.778739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3132f-aeb3-411c-8e2e-e83e3808674f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:48.779168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3132f-aeb3-411c-8e2e-e83e3808674f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:48.780102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3132f-aeb3-411c-8e2e-e83e3808674f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:48.782163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3132f-aeb3-411c-8e2e-e83e3808674f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:48.837220 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1600/3191] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:56:48 2022] POST /identity/v3/projects => generated 393 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:56:48.841128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:48.852939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726fdd-1bc7-4123-b724-a70b3134910a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:48.940725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5583a7-12fa-4149-9c6a-7b0d1c9d0424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:48.941398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5583a7-12fa-4149-9c6a-7b0d1c9d0424 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:48.941844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5583a7-12fa-4149-9c6a-7b0d1c9d0424 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:48.942262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5583a7-12fa-4149-9c6a-7b0d1c9d0424 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:48.943653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5583a7-12fa-4149-9c6a-7b0d1c9d0424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:48.946014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5583a7-12fa-4149-9c6a-7b0d1c9d0424 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:48.977873 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1592/3192] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:56:48 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:56:48.982060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3132f-aeb3-411c-8e2e-e83e3808674f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.000794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3132f-aeb3-411c-8e2e-e83e3808674f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.018897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f4225-eae4-46d7-97f9-db705aef94d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.019745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f4225-eae4-46d7-97f9-db705aef94d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.020248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f4225-eae4-46d7-97f9-db705aef94d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.020513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f4225-eae4-46d7-97f9-db705aef94d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.021312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f4225-eae4-46d7-97f9-db705aef94d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.023577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f4225-eae4-46d7-97f9-db705aef94d4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.060258 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1601/3193] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:49.062666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5583a7-12fa-4149-9c6a-7b0d1c9d0424 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.076725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5583a7-12fa-4149-9c6a-7b0d1c9d0424 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.083167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53c746-1ffd-487c-8d52-fe3cde94ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.084074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53c746-1ffd-487c-8d52-fe3cde94ead6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.084653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53c746-1ffd-487c-8d52-fe3cde94ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.085118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53c746-1ffd-487c-8d52-fe3cde94ead6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.086055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53c746-1ffd-487c-8d52-fe3cde94ead6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.088624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53c746-1ffd-487c-8d52-fe3cde94ead6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.108245 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1593/3194] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:49.110172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f4225-eae4-46d7-97f9-db705aef94d4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.121309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f4225-eae4-46d7-97f9-db705aef94d4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.126780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875afa07-ab43-40ba-bd0b-c4fa620f68a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.127983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875afa07-ab43-40ba-bd0b-c4fa620f68a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.128393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875afa07-ab43-40ba-bd0b-c4fa620f68a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.128910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875afa07-ab43-40ba-bd0b-c4fa620f68a0 admin admin] PATH_INFO: `/v3/projects/106062f100884d929b001725a5daa730/users/4a93bc6b2b584caab5baabf5fdbea583/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.144807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875afa07-ab43-40ba-bd0b-c4fa620f68a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106062f100884d929b001725a5daa730, user_id=4a93bc6b2b584caab5baabf5fdbea583, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.147906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875afa07-ab43-40ba-bd0b-c4fa620f68a0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.162034 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1602/3195] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:49 2022] PUT /identity/v3/projects/106062f100884d929b001725a5daa730/users/4a93bc6b2b584caab5baabf5fdbea583/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:49.174157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7829-d920-4a23-af08-4d97b3dc0d49 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.174495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7829-d920-4a23-af08-4d97b3dc0d49 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.174715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7829-d920-4a23-af08-4d97b3dc0d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.216548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-384e7829-d920-4a23-af08-4d97b3dc0d49 None None] MFA Rules not processed for user `4a93bc6b2b584caab5baabf5fdbea583`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:49.219837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-384e7829-d920-4a23-af08-4d97b3dc0d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:49.300093 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1594/3196] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:49.305018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875afa07-ab43-40ba-bd0b-c4fa620f68a0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.370382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875afa07-ab43-40ba-bd0b-c4fa620f68a0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.395736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f681-2539-40ab-bd28-6d19b7806cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.396448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f681-2539-40ab-bd28-6d19b7806cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.396737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f681-2539-40ab-bd28-6d19b7806cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.397042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f681-2539-40ab-bd28-6d19b7806cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.397915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f681-2539-40ab-bd28-6d19b7806cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.399868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f681-2539-40ab-bd28-6d19b7806cc8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.430395 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1603/3197] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:56:49 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:56:49.434734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e7829-d920-4a23-af08-4d97b3dc0d49 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.445605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e7829-d920-4a23-af08-4d97b3dc0d49 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.506168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5428dcd-b0dc-4af2-b101-86c5eb2a1a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.506857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5428dcd-b0dc-4af2-b101-86c5eb2a1a18 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.507142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5428dcd-b0dc-4af2-b101-86c5eb2a1a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.507424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5428dcd-b0dc-4af2-b101-86c5eb2a1a18 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.508119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5428dcd-b0dc-4af2-b101-86c5eb2a1a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.510150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5428dcd-b0dc-4af2-b101-86c5eb2a1a18 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.538881 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1595/3198] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:56:49 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:56:49.540759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f681-2539-40ab-bd28-6d19b7806cc8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.552622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f681-2539-40ab-bd28-6d19b7806cc8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.560009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd872430-c889-4d61-ad0a-d504d4ccc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.560930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872430-c889-4d61-ad0a-d504d4ccc22d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.561340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872430-c889-4d61-ad0a-d504d4ccc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.561714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd872430-c889-4d61-ad0a-d504d4ccc22d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.562792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd872430-c889-4d61-ad0a-d504d4ccc22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.564908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd872430-c889-4d61-ad0a-d504d4ccc22d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.579043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1604/3199] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:49.580663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5428dcd-b0dc-4af2-b101-86c5eb2a1a18 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.591354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5428dcd-b0dc-4af2-b101-86c5eb2a1a18 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.597121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d031e7-f8a9-45fb-9c9e-261052cc8458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.598011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d031e7-f8a9-45fb-9c9e-261052cc8458 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.598292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d031e7-f8a9-45fb-9c9e-261052cc8458 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.598567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d031e7-f8a9-45fb-9c9e-261052cc8458 admin admin] PATH_INFO: `/v3/projects/78c6c05f9889458fa6889998b10a07e9/users/4ab8bb3c01cb41499325b8ebe4f223ef/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.615615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d031e7-f8a9-45fb-9c9e-261052cc8458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c6c05f9889458fa6889998b10a07e9, user_id=4ab8bb3c01cb41499325b8ebe4f223ef, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.618331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d031e7-f8a9-45fb-9c9e-261052cc8458 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.635559 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1596/3200] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:49 2022] PUT /identity/v3/projects/78c6c05f9889458fa6889998b10a07e9/users/4ab8bb3c01cb41499325b8ebe4f223ef/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:49.639723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd872430-c889-4d61-ad0a-d504d4ccc22d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.654462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd872430-c889-4d61-ad0a-d504d4ccc22d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.722017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86297a18-1853-4026-889d-828bbf872101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.723364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297a18-1853-4026-889d-828bbf872101 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.723364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297a18-1853-4026-889d-828bbf872101 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.723671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297a18-1853-4026-889d-828bbf872101 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.724555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86297a18-1853-4026-889d-828bbf872101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.729880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86297a18-1853-4026-889d-828bbf872101 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.740306 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1605/3201] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:56:49.744623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d031e7-f8a9-45fb-9c9e-261052cc8458 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:49.758860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d031e7-f8a9-45fb-9c9e-261052cc8458 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:49.764462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc42e3-7307-4425-a3ed-7b5742ab1e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:49.765360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc42e3-7307-4425-a3ed-7b5742ab1e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.765645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc42e3-7307-4425-a3ed-7b5742ab1e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.765973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc42e3-7307-4425-a3ed-7b5742ab1e7b admin admin] PATH_INFO: `/v3/projects/78c6c05f9889458fa6889998b10a07e9/users/4ab8bb3c01cb41499325b8ebe4f223ef/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.768457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc42e3-7307-4425-a3ed-7b5742ab1e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c6c05f9889458fa6889998b10a07e9, user_id=4ab8bb3c01cb41499325b8ebe4f223ef, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:49.770985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc42e3-7307-4425-a3ed-7b5742ab1e7b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:49.789833 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1597/3202] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:56:49 2022] PUT /identity/v3/projects/78c6c05f9889458fa6889998b10a07e9/users/4ab8bb3c01cb41499325b8ebe4f223ef/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:56:49.792834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7202356-1f6e-4159-ae91-f1ea831b45bc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.793311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7202356-1f6e-4159-ae91-f1ea831b45bc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.793784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7202356-1f6e-4159-ae91-f1ea831b45bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.835269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a7202356-1f6e-4159-ae91-f1ea831b45bc None None] MFA Rules not processed for user `4ab8bb3c01cb41499325b8ebe4f223ef`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:49.836567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a7202356-1f6e-4159-ae91-f1ea831b45bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:49.940548 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1606/3203] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:49.948376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c80d3a-4873-4377-8892-a964205bb69e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:49.948898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c80d3a-4873-4377-8892-a964205bb69e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:49.948898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c80d3a-4873-4377-8892-a964205bb69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:49.969344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-80c80d3a-4873-4377-8892-a964205bb69e None None] MFA Rules not processed for user `4a93bc6b2b584caab5baabf5fdbea583`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:49.971302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-80c80d3a-4873-4377-8892-a964205bb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:50.102582 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1598/3204] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:50.419987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7202356-1f6e-4159-ae91-f1ea831b45bc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:50.421512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a7202356-1f6e-4159-ae91-f1ea831b45bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:50.529567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7202356-1f6e-4159-ae91-f1ea831b45bc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:50.536859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:50.537633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:50.538607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:50.538607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:50.547071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:50.549543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:50.561940 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1607/3205] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:50.971013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76b72-f4e1-4e77-802a-b34e695fe110 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:50.971553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76b72-f4e1-4e77-802a-b34e695fe110 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:50.971553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76b72-f4e1-4e77-802a-b34e695fe110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:50.991507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a2f76b72-f4e1-4e77-802a-b34e695fe110 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:50.995908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a2f76b72-f4e1-4e77-802a-b34e695fe110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:51.086970 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1599/3206] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:51.162716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:51.164465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:51.307428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c60a-8316-4a6c-955b-0d1674f7d748 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:51.314520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3e8a2-2702-4b83-ada9-1c6161d7d2f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:51.315919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e8a2-2702-4b83-ada9-1c6161d7d2f3 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:51.316670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e8a2-2702-4b83-ada9-1c6161d7d2f3 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:51.317338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e8a2-2702-4b83-ada9-1c6161d7d2f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:51.354324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3e8a2-2702-4b83-ada9-1c6161d7d2f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:51.356512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3e8a2-2702-4b83-ada9-1c6161d7d2f3 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:51.389143 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1608/3207] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:56:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:51.974843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08127-f235-4810-8f0e-33e6da108665 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:51.975321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08127-f235-4810-8f0e-33e6da108665 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:51.975406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08127-f235-4810-8f0e-33e6da108665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:52.008011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bbb08127-f235-4810-8f0e-33e6da108665 None None] MFA Rules not processed for user `33f01d50bf4e41ff95c09af549cd37e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:52.010427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bbb08127-f235-4810-8f0e-33e6da108665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:52.180046 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1600/3208] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:56:52.189890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3e8a2-2702-4b83-ada9-1c6161d7d2f3 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:56:52.206266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3e8a2-2702-4b83-ada9-1c6161d7d2f3 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:56:52.212261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883c4df-50e2-4d43-9340-17b56a51280b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:56:52.213259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883c4df-50e2-4d43-9340-17b56a51280b service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:52.213981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883c4df-50e2-4d43-9340-17b56a51280b service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:52.214497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883c4df-50e2-4d43-9340-17b56a51280b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:52.225717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883c4df-50e2-4d43-9340-17b56a51280b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:56:52.228007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883c4df-50e2-4d43-9340-17b56a51280b service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:56:52.240285 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1609/3209] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:56:56.786882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29b35a-d91a-48f8-8088-b60c79b69d83 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:56:56.787786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29b35a-d91a-48f8-8088-b60c79b69d83 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:56:56.788243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29b35a-d91a-48f8-8088-b60c79b69d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:56:56.830558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cc29b35a-d91a-48f8-8088-b60c79b69d83 None None] MFA Rules not processed for user `33f01d50bf4e41ff95c09af549cd37e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:56:56.832017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc29b35a-d91a-48f8-8088-b60c79b69d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:56:56.850503 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1601/3210] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:02.396753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228fcb-f6b7-4f72-8fd9-825a14647e2d None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:02.398114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228fcb-f6b7-4f72-8fd9-825a14647e2d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:02.398645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228fcb-f6b7-4f72-8fd9-825a14647e2d None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:02.405825 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1610/3211] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:57:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:57:02.412724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa4dd-9ba4-445e-b744-5a4e17e2b03a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:02.415324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa4dd-9ba4-445e-b744-5a4e17e2b03a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:02.415609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa4dd-9ba4-445e-b744-5a4e17e2b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:02.466231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-633fa4dd-9ba4-445e-b744-5a4e17e2b03a None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:02.467740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-633fa4dd-9ba4-445e-b744-5a4e17e2b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:02.638698 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1602/3212] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:02.655231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88228fcb-f6b7-4f72-8fd9-825a14647e2d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:02.657052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-88228fcb-f6b7-4f72-8fd9-825a14647e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:02.698519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88228fcb-f6b7-4f72-8fd9-825a14647e2d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:02.710794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:02.722331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:02.722629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:02.722906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:02.744273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:02.745914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:02.771638 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1611/3213] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:03.101558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa4dd-9ba4-445e-b744-5a4e17e2b03a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:03.117143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa4dd-9ba4-445e-b744-5a4e17e2b03a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:03.134599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:03.135656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:03.136131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:03.136624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:03.142734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:03.174980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:03.177511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:03.215089 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1603/3214] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:03.675416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:03.676966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:03.804091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fedc86-2652-4602-8472-37a03d117e0d service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:03.810616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2f1c8-3ac1-4e36-adf7-308f026eed7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:03.811489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f1c8-3ac1-4e36-adf7-308f026eed7b service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:03.812287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f1c8-3ac1-4e36-adf7-308f026eed7b service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:03.812917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f1c8-3ac1-4e36-adf7-308f026eed7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:03.820064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-67b2f1c8-3ac1-4e36-adf7-308f026eed7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:03.852570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2f1c8-3ac1-4e36-adf7-308f026eed7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:03.854990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2f1c8-3ac1-4e36-adf7-308f026eed7b service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:03.873219 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1612/3215] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:57:03.945855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:03.960968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb1e-3cd3-47e5-857b-9a0a85cdd73a service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:03.970660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:03.971521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:03.971942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:03.972829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:03.985747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:04.002784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:04.004280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:04.023422 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1604/3216] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:57:06.029613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372618-0c5c-4b0a-9714-aa361cdbe9ca None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:06.030080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372618-0c5c-4b0a-9714-aa361cdbe9ca None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:06.030449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372618-0c5c-4b0a-9714-aa361cdbe9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:06.050492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3a372618-0c5c-4b0a-9714-aa361cdbe9ca None None] MFA Rules not processed for user `ccc221761620472ea3cd887988f9f2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:06.051788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3a372618-0c5c-4b0a-9714-aa361cdbe9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:06.251132 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1613/3217] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:09.498746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:09.521893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a21069-44eb-4855-98db-d83cea027ec2 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:09.530252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420141f4-8193-4b6f-a30c-10174dfa0d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:09.531214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420141f4-8193-4b6f-a30c-10174dfa0d0a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:09.531626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420141f4-8193-4b6f-a30c-10174dfa0d0a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:09.531961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420141f4-8193-4b6f-a30c-10174dfa0d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:09.546104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420141f4-8193-4b6f-a30c-10174dfa0d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:09.548265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420141f4-8193-4b6f-a30c-10174dfa0d0a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:09.583058 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1605/3218] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:09.612652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8d1d-072a-45bf-ac86-e3866d509b81 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:09.613187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8d1d-072a-45bf-ac86-e3866d509b81 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:09.613297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8d1d-072a-45bf-ac86-e3866d509b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:09.676794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-823e8d1d-072a-45bf-ac86-e3866d509b81 None None] MFA Rules not processed for user `4a93bc6b2b584caab5baabf5fdbea583`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:09.683654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-823e8d1d-072a-45bf-ac86-e3866d509b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:09.715906 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1614/3219] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:09.723329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031949a-a0a5-4381-b2a4-9205f493c1ba None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:09.723880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031949a-a0a5-4381-b2a4-9205f493c1ba None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:09.724358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031949a-a0a5-4381-b2a4-9205f493c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:09.768998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5031949a-a0a5-4381-b2a4-9205f493c1ba None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:09.773204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5031949a-a0a5-4381-b2a4-9205f493c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:09.792863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1606/3220] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:09.808788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8d1d-072a-45bf-ac86-e3866d509b81 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:09.831053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8d1d-072a-45bf-ac86-e3866d509b81 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:09.848948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fff72-a69e-4735-8641-ac90b725adce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:09.850758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fff72-a69e-4735-8641-ac90b725adce service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:09.851133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fff72-a69e-4735-8641-ac90b725adce service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:09.852901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fff72-a69e-4735-8641-ac90b725adce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:09.885019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fff72-a69e-4735-8641-ac90b725adce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:09.887286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fff72-a69e-4735-8641-ac90b725adce service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:09.901566 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1615/3221] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:57:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:11.149881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a44ea-5f4d-4517-8703-ba3541ffc3da None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:11.150526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a44ea-5f4d-4517-8703-ba3541ffc3da None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:11.150526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a44ea-5f4d-4517-8703-ba3541ffc3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:11.185355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-534a44ea-5f4d-4517-8703-ba3541ffc3da None None] MFA Rules not processed for user `5a3a1e86138d41b991f5e44a1e8ae2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:11.187269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-534a44ea-5f4d-4517-8703-ba3541ffc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:11.338520 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1607/3222] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:20.073546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb6ae-c0d4-419d-bef8-80d89e62b681 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:20.074070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb6ae-c0d4-419d-bef8-80d89e62b681 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:20.074192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb6ae-c0d4-419d-bef8-80d89e62b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:20.091820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ec5fb6ae-c0d4-419d-bef8-80d89e62b681 None None] MFA Rules not processed for user `0d694f3e8da440a9a1cac8ca2de030e8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:20.093076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec5fb6ae-c0d4-419d-bef8-80d89e62b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:20.146178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1616/3223] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:31.689024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a44ea-5f4d-4517-8703-ba3541ffc3da None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:31.691131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-534a44ea-5f4d-4517-8703-ba3541ffc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:31.759896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a44ea-5f4d-4517-8703-ba3541ffc3da None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:31.765101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:31.766759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:31.767040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:31.767514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] PATH_INFO: `/v3/users/ccc221761620472ea3cd887988f9f2c0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:31.768768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc221761620472ea3cd887988f9f2c0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:31.770762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:31.823864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc221761620472ea3cd887988f9f2c0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:31.824650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc221761620472ea3cd887988f9f2c0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:31.825277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc221761620472ea3cd887988f9f2c0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:31.837739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc221761620472ea3cd887988f9f2c0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:31.846618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac432f0-8ca0-424c-877a-8b84010ba58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc221761620472ea3cd887988f9f2c0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:31.862158 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1608/3224] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:31 2022] DELETE /identity/v3/users/ccc221761620472ea3cd887988f9f2c0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:32.040171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb6ae-c0d4-419d-bef8-80d89e62b681 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:32.052131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb6ae-c0d4-419d-bef8-80d89e62b681 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:32.116638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:32.117652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.118037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.118412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] PATH_INFO: `/v3/projects/808305a45737485185adcb60012ea91a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.119686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808305a45737485185adcb60012ea91a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:32.121682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:32.169055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808305a45737485185adcb60012ea91a', 'request_id': 'req-2f7d940f-20f7-47cd-abbe-751c00071807'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:32.175090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808305a45737485185adcb60012ea91a', 'request_id': 'req-2f7d940f-20f7-47cd-abbe-751c00071807'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:32.184113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808305a45737485185adcb60012ea91a', 'request_id': 'req-2f7d940f-20f7-47cd-abbe-751c00071807'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:32.198429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] The token cache is being invalidate because project 808305a45737485185adcb60012ea91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:32.198732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:32.199386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f7d940f-20f7-47cd-abbe-751c00071807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:32.205116 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1617/3225] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:32 2022] DELETE /identity/v3/projects/808305a45737485185adcb60012ea91a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:32.207171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f8e6-ee82-497a-9cc1-437a5f170eb6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.207500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f8e6-ee82-497a-9cc1-437a5f170eb6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.207794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f8e6-ee82-497a-9cc1-437a5f170eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.228135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ff01f8e6-ee82-497a-9cc1-437a5f170eb6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:32.229658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ff01f8e6-ee82-497a-9cc1-437a5f170eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:32.305808 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1609/3226] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:32.314209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8544-4bb8-41ea-b91e-0b59a3d38d60 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.314522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8544-4bb8-41ea-b91e-0b59a3d38d60 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.314798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8544-4bb8-41ea-b91e-0b59a3d38d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.336677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-913d8544-4bb8-41ea-b91e-0b59a3d38d60 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:32.338193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-913d8544-4bb8-41ea-b91e-0b59a3d38d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:32.348456 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1618/3227] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:32.352438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01f8e6-ee82-497a-9cc1-437a5f170eb6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:32.364190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01f8e6-ee82-497a-9cc1-437a5f170eb6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:32.376451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:32.377649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.378098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.378379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.379111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:57:32.379415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:32.381270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:32.399002 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1610/3228] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:57:32.400723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8544-4bb8-41ea-b91e-0b59a3d38d60 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:32.417476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8544-4bb8-41ea-b91e-0b59a3d38d60 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:32.426951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff395a-5c1a-4324-b16c-898bfa71ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:32.427972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff395a-5c1a-4324-b16c-898bfa71ae68 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.428698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff395a-5c1a-4324-b16c-898bfa71ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.429522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff395a-5c1a-4324-b16c-898bfa71ae68 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.430452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff395a-5c1a-4324-b16c-898bfa71ae68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:32.433301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff395a-5c1a-4324-b16c-898bfa71ae68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:32.467519 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1619/3229] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:32 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:57:32.472115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:32.481951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533bfc6-b78c-4eef-832f-ee054abe1620 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:32.540488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ea86c-b2f9-4f81-8502-0ae4a717c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:32.541166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ea86c-b2f9-4f81-8502-0ae4a717c453 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.541451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ea86c-b2f9-4f81-8502-0ae4a717c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.541730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ea86c-b2f9-4f81-8502-0ae4a717c453 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.542419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ea86c-b2f9-4f81-8502-0ae4a717c453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:32.544352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ea86c-b2f9-4f81-8502-0ae4a717c453 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:32.566293 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1611/3230] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:32 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:32.570285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff395a-5c1a-4324-b16c-898bfa71ae68 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:32.581557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff395a-5c1a-4324-b16c-898bfa71ae68 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:32.586224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e2dcc-dad1-434e-924f-bf89fd44332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:32.586885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2dcc-dad1-434e-924f-bf89fd44332a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.587167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2dcc-dad1-434e-924f-bf89fd44332a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.587443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2dcc-dad1-434e-924f-bf89fd44332a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.588162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2dcc-dad1-434e-924f-bf89fd44332a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:32.589969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2dcc-dad1-434e-924f-bf89fd44332a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:32.603566 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1620/3231] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:57:32.604814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ea86c-b2f9-4f81-8502-0ae4a717c453 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:32.616154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ea86c-b2f9-4f81-8502-0ae4a717c453 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:32.621026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6de13-3fff-4b9d-8627-169b0e1d5651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:32.621794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6de13-3fff-4b9d-8627-169b0e1d5651 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.622143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6de13-3fff-4b9d-8627-169b0e1d5651 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.622487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6de13-3fff-4b9d-8627-169b0e1d5651 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.623282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6de13-3fff-4b9d-8627-169b0e1d5651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:32.625058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6de13-3fff-4b9d-8627-169b0e1d5651 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:32.636858 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1612/3232] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:32.642054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e2dcc-dad1-434e-924f-bf89fd44332a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:32.652356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e2dcc-dad1-434e-924f-bf89fd44332a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:32.657118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:32.657994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.658287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.658552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] PATH_INFO: `/v3/projects/72c7d19a9f264a299de3fef34d6cc2e3/users/60cfee67e3df4200a93528bcb8036b9e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.676442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c7d19a9f264a299de3fef34d6cc2e3, user_id=60cfee67e3df4200a93528bcb8036b9e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:32.679214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:32.697459 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1621/3233] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:32 2022] PUT /identity/v3/projects/72c7d19a9f264a299de3fef34d6cc2e3/users/60cfee67e3df4200a93528bcb8036b9e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:32.702777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2313f-4247-44d7-873a-eb419597e756 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.703217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2313f-4247-44d7-873a-eb419597e756 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.703346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2313f-4247-44d7-873a-eb419597e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.722291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f7f2313f-4247-44d7-873a-eb419597e756 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:32.723528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f7f2313f-4247-44d7-873a-eb419597e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:32.803665 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1613/3234] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:32.814954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:32.816957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:32.897906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87544d0-ae1a-403e-9350-7d91466f94fc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:32.902094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657d13-f05f-438b-95c6-3c3f89c90e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:32.902986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657d13-f05f-438b-95c6-3c3f89c90e0a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:32.903487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657d13-f05f-438b-95c6-3c3f89c90e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:32.903955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657d13-f05f-438b-95c6-3c3f89c90e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:32.914226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657d13-f05f-438b-95c6-3c3f89c90e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:32.916251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8657d13-f05f-438b-95c6-3c3f89c90e0a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:32.929223 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1622/3235] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:57:33.835005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edad78-4d86-4e57-8c36-0aefc69d2c02 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:33.835569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edad78-4d86-4e57-8c36-0aefc69d2c02 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:33.836260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edad78-4d86-4e57-8c36-0aefc69d2c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:33.875482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-09edad78-4d86-4e57-8c36-0aefc69d2c02 None None] MFA Rules not processed for user `60cfee67e3df4200a93528bcb8036b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:33.878256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-09edad78-4d86-4e57-8c36-0aefc69d2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:33.978067 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1614/3236] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:33.989515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a010-313d-4d81-888f-f2199e7e2de5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:33.989515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a010-313d-4d81-888f-f2199e7e2de5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:33.989515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a010-313d-4d81-888f-f2199e7e2de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:34.038234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-38d0a010-313d-4d81-888f-f2199e7e2de5 None None] MFA Rules not processed for user `60cfee67e3df4200a93528bcb8036b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:34.040523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38d0a010-313d-4d81-888f-f2199e7e2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:34.054730 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1623/3237] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:34.198115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edad78-4d86-4e57-8c36-0aefc69d2c02 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:34.198115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-09edad78-4d86-4e57-8c36-0aefc69d2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:34.265148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edad78-4d86-4e57-8c36-0aefc69d2c02 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:34.271200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609d4dd-0e90-4db3-bc53-158ce65e4bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:34.271883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d4dd-0e90-4db3-bc53-158ce65e4bce service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:34.272168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d4dd-0e90-4db3-bc53-158ce65e4bce service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:34.272482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d4dd-0e90-4db3-bc53-158ce65e4bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:34.281383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d4dd-0e90-4db3-bc53-158ce65e4bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:34.283828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d4dd-0e90-4db3-bc53-158ce65e4bce service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:34.298298 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1615/3238] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:35.178097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a010-313d-4d81-888f-f2199e7e2de5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:35.179553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38d0a010-313d-4d81-888f-f2199e7e2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:35.195627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a010-313d-4d81-888f-f2199e7e2de5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:35.200688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:35.201562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:35.201838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:35.202285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] PATH_INFO: `/v3/users/ab3fa7eadddf42b4b700593dad828e44` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:35.203826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3fa7eadddf42b4b700593dad828e44)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:35.205998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:35.259366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3fa7eadddf42b4b700593dad828e44'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:35.271052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3fa7eadddf42b4b700593dad828e44'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:35.281848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3fa7eadddf42b4b700593dad828e44'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:35.282656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3fa7eadddf42b4b700593dad828e44'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:35.283347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3fa7eadddf42b4b700593dad828e44'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:35.300079 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1624/3239] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:35 2022] DELETE /identity/v3/users/ab3fa7eadddf42b4b700593dad828e44 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:35.302533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9059c46-c198-476f-bf37-8c3f57993aea None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:35.303849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9059c46-c198-476f-bf37-8c3f57993aea None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:35.304276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9059c46-c198-476f-bf37-8c3f57993aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:35.322982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a9059c46-c198-476f-bf37-8c3f57993aea None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:35.324500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a9059c46-c198-476f-bf37-8c3f57993aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:35.404016 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1616/3240] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:35.412222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:35.413969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:35.474608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5238ab-f7fc-42c8-8119-a23ac19f3d3f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:35.478648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5599f1-8384-453f-b9fb-c9f2a34d9607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:35.483946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5599f1-8384-453f-b9fb-c9f2a34d9607 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:35.483946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5599f1-8384-453f-b9fb-c9f2a34d9607 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:35.483946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5599f1-8384-453f-b9fb-c9f2a34d9607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:35.498200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5599f1-8384-453f-b9fb-c9f2a34d9607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:35.499664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5599f1-8384-453f-b9fb-c9f2a34d9607 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:35.515749 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1625/3241] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:35.915352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9059c46-c198-476f-bf37-8c3f57993aea None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:35.917594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a9059c46-c198-476f-bf37-8c3f57993aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:35.943101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9059c46-c198-476f-bf37-8c3f57993aea None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:35.950174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:35.951290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:35.951771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:35.952205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] PATH_INFO: `/v3/projects/dabc5bb30faa4af797e9ba1cd4bad547` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:35.955344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabc5bb30faa4af797e9ba1cd4bad547)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:35.960608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:36.042058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabc5bb30faa4af797e9ba1cd4bad547', 'request_id': 'req-13a7be4b-331a-49ab-9e22-9ad62e7c9354'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.056378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabc5bb30faa4af797e9ba1cd4bad547', 'request_id': 'req-13a7be4b-331a-49ab-9e22-9ad62e7c9354'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.069248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabc5bb30faa4af797e9ba1cd4bad547', 'request_id': 'req-13a7be4b-331a-49ab-9e22-9ad62e7c9354'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.082322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] The token cache is being invalidate because project dabc5bb30faa4af797e9ba1cd4bad547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:36.083238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.083383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13a7be4b-331a-49ab-9e22-9ad62e7c9354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.085140 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1617/3242] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:35 2022] DELETE /identity/v3/projects/dabc5bb30faa4af797e9ba1cd4bad547 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:36.089146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5599f1-8384-453f-b9fb-c9f2a34d9607 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:36.109056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5599f1-8384-453f-b9fb-c9f2a34d9607 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:36.176421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:36.177332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:36.177613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:36.178012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] PATH_INFO: `/v3/users/198721299a4841c6803ff197299dc7ec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:36.179751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=198721299a4841c6803ff197299dc7ec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:36.182393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:36.272346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198721299a4841c6803ff197299dc7ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.299854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198721299a4841c6803ff197299dc7ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.326757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198721299a4841c6803ff197299dc7ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.327604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198721299a4841c6803ff197299dc7ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.328677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-eb2f52c5-9720-4741-9101-8fe321452120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198721299a4841c6803ff197299dc7ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:36.351209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1626/3243] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:36 2022] DELETE /identity/v3/users/198721299a4841c6803ff197299dc7ec => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:36.463628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b24e-a0c1-49f2-8f31-3c4977c928cc None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:36.464290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b24e-a0c1-49f2-8f31-3c4977c928cc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:36.464290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b24e-a0c1-49f2-8f31-3c4977c928cc None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:36.466055 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1618/3244] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:57:36.472913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27e48-bfa2-4ed8-936a-20e4f0bcd071 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:36.473887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27e48-bfa2-4ed8-936a-20e4f0bcd071 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:36.474426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27e48-bfa2-4ed8-936a-20e4f0bcd071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:36.498785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-40d27e48-bfa2-4ed8-936a-20e4f0bcd071 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:36.501332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-40d27e48-bfa2-4ed8-936a-20e4f0bcd071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:36.631520 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1627/3245] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:36.660265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b24e-a0c1-49f2-8f31-3c4977c928cc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:36.662435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0af0b24e-a0c1-49f2-8f31-3c4977c928cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:36.682775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0b24e-a0c1-49f2-8f31-3c4977c928cc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:36.689709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2848e-d45c-43bc-b327-535fd741faac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:36.690650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2848e-d45c-43bc-b327-535fd741faac service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:36.691121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2848e-d45c-43bc-b327-535fd741faac service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:36.691557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2848e-d45c-43bc-b327-535fd741faac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:36.703074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2848e-d45c-43bc-b327-535fd741faac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:36.705706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2848e-d45c-43bc-b327-535fd741faac service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:36.728074 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1619/3246] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:37.007766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27e48-bfa2-4ed8-936a-20e4f0bcd071 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:37.009786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-40d27e48-bfa2-4ed8-936a-20e4f0bcd071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:37.090221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27e48-bfa2-4ed8-936a-20e4f0bcd071 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:37.096662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:37.097639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.097981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.098263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] PATH_INFO: `/v3/projects/044539d0759e4edd8a8cf729fb4a2955` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.099570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=044539d0759e4edd8a8cf729fb4a2955)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:37.101858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:37.198032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044539d0759e4edd8a8cf729fb4a2955', 'request_id': 'req-453e6d20-7691-47b9-b76f-f3ce9affcb2a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:37.207527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044539d0759e4edd8a8cf729fb4a2955', 'request_id': 'req-453e6d20-7691-47b9-b76f-f3ce9affcb2a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:37.220264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044539d0759e4edd8a8cf729fb4a2955', 'request_id': 'req-453e6d20-7691-47b9-b76f-f3ce9affcb2a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:37.248269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] The token cache is being invalidate because project 044539d0759e4edd8a8cf729fb4a2955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:37.248269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:37.248631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-453e6d20-7691-47b9-b76f-f3ce9affcb2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:37.250178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1628/3247] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:37 2022] DELETE /identity/v3/projects/044539d0759e4edd8a8cf729fb4a2955 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:37.255026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ae78-83e4-4692-a788-88c5a8d1ea42 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.255385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ae78-83e4-4692-a788-88c5a8d1ea42 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.255743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ae78-83e4-4692-a788-88c5a8d1ea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.292748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-96c8ae78-83e4-4692-a788-88c5a8d1ea42 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:37.294217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-96c8ae78-83e4-4692-a788-88c5a8d1ea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:37.398589 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1620/3248] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:37.405990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261daae-1b09-4e2d-a9cf-afe56f1fa82c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.407449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261daae-1b09-4e2d-a9cf-afe56f1fa82c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.407449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261daae-1b09-4e2d-a9cf-afe56f1fa82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.441907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3261daae-1b09-4e2d-a9cf-afe56f1fa82c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:37.443237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3261daae-1b09-4e2d-a9cf-afe56f1fa82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:37.452922 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1629/3249] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:37.461814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ae78-83e4-4692-a788-88c5a8d1ea42 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:37.474743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ae78-83e4-4692-a788-88c5a8d1ea42 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:37.479772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:37.480974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.481336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.481685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.482689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:57:37.483238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:37.484994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:37.498305 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1621/3250] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:57:37.502767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261daae-1b09-4e2d-a9cf-afe56f1fa82c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:37.512573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261daae-1b09-4e2d-a9cf-afe56f1fa82c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:37.518079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5413c1-c505-41cc-ae9f-a2d882e74083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:37.518643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5413c1-c505-41cc-ae9f-a2d882e74083 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.519144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5413c1-c505-41cc-ae9f-a2d882e74083 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.519820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5413c1-c505-41cc-ae9f-a2d882e74083 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.520758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5413c1-c505-41cc-ae9f-a2d882e74083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:37.523045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5413c1-c505-41cc-ae9f-a2d882e74083 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:37.572706 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1630/3251] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:37 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:37.573989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:37.590757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af635ea-3f95-4d55-9ad4-1477faba5e7b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:37.692701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0b88-c00c-4ecb-a62c-64dfd5cd715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:37.693651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0b88-c00c-4ecb-a62c-64dfd5cd715d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.693939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0b88-c00c-4ecb-a62c-64dfd5cd715d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.694216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0b88-c00c-4ecb-a62c-64dfd5cd715d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.696066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd0b88-c00c-4ecb-a62c-64dfd5cd715d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:37.698218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd0b88-c00c-4ecb-a62c-64dfd5cd715d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:37.726321 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1622/3252] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:37 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:57:37.730987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5413c1-c505-41cc-ae9f-a2d882e74083 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:37.744553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5413c1-c505-41cc-ae9f-a2d882e74083 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:37.750572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb75968-ce1c-454d-a866-238aa06ce218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:37.751519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75968-ce1c-454d-a866-238aa06ce218 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.751678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75968-ce1c-454d-a866-238aa06ce218 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.751954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb75968-ce1c-454d-a866-238aa06ce218 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.752782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb75968-ce1c-454d-a866-238aa06ce218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:37.755220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb75968-ce1c-454d-a866-238aa06ce218 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:37.768197 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1631/3253] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:57:37.771968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0b88-c00c-4ecb-a62c-64dfd5cd715d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:37.786061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0b88-c00c-4ecb-a62c-64dfd5cd715d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:37.793701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ced8b4-2d0f-4d92-9f51-65e95d5128fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:37.794753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ced8b4-2d0f-4d92-9f51-65e95d5128fa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.796448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ced8b4-2d0f-4d92-9f51-65e95d5128fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.796941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ced8b4-2d0f-4d92-9f51-65e95d5128fa admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.798674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ced8b4-2d0f-4d92-9f51-65e95d5128fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:37.800732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ced8b4-2d0f-4d92-9f51-65e95d5128fa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:37.812780 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1623/3254] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:37.817590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb75968-ce1c-454d-a866-238aa06ce218 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:37.830023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb75968-ce1c-454d-a866-238aa06ce218 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:37.836658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce2c40-afe6-474f-abdf-b9e2a4f6535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:37.838261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2c40-afe6-474f-abdf-b9e2a4f6535f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.838556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2c40-afe6-474f-abdf-b9e2a4f6535f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.839481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2c40-afe6-474f-abdf-b9e2a4f6535f admin admin] PATH_INFO: `/v3/projects/eba55f50287a466fa60373088ef7f5ff/users/dc5857f4ed34409babe14c01a10d3e88/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.874132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce2c40-afe6-474f-abdf-b9e2a4f6535f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba55f50287a466fa60373088ef7f5ff, user_id=dc5857f4ed34409babe14c01a10d3e88, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:37.879371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce2c40-afe6-474f-abdf-b9e2a4f6535f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:37.895455 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1632/3255] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:37 2022] PUT /identity/v3/projects/eba55f50287a466fa60373088ef7f5ff/users/dc5857f4ed34409babe14c01a10d3e88/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:37.906498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165461d-f273-437b-9f15-d32188a83f6e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:37.906835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165461d-f273-437b-9f15-d32188a83f6e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:37.907251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165461d-f273-437b-9f15-d32188a83f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:37.935886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b165461d-f273-437b-9f15-d32188a83f6e None None] MFA Rules not processed for user `dc5857f4ed34409babe14c01a10d3e88`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:37.937395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b165461d-f273-437b-9f15-d32188a83f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:38.032572 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1624/3256] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:38.037264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce2c40-afe6-474f-abdf-b9e2a4f6535f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:38.142214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce2c40-afe6-474f-abdf-b9e2a4f6535f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:38.151577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862c72-8549-4d74-a5dd-52ce294b4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:38.152474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862c72-8549-4d74-a5dd-52ce294b4713 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:38.152748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862c72-8549-4d74-a5dd-52ce294b4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:38.153244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862c72-8549-4d74-a5dd-52ce294b4713 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:38.154435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c862c72-8549-4d74-a5dd-52ce294b4713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:38.157262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c862c72-8549-4d74-a5dd-52ce294b4713 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:38.218753 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1633/3257] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:38 2022] POST /identity/v3/projects => generated 393 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:38.224905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165461d-f273-437b-9f15-d32188a83f6e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:38.240275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165461d-f273-437b-9f15-d32188a83f6e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:38.332945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f4e4-29ff-4a13-8735-c401b9091247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:38.334863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f4e4-29ff-4a13-8735-c401b9091247 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:38.335181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f4e4-29ff-4a13-8735-c401b9091247 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:38.335524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f4e4-29ff-4a13-8735-c401b9091247 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:38.336348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f4e4-29ff-4a13-8735-c401b9091247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:38.338332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f4e4-29ff-4a13-8735-c401b9091247 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:38.366566 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1625/3258] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:38 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:57:38.367403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862c72-8549-4d74-a5dd-52ce294b4713 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:38.378047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862c72-8549-4d74-a5dd-52ce294b4713 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:38.386110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352cac9-db90-4a0c-828c-36c702114ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:38.387107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cac9-db90-4a0c-828c-36c702114ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:38.387578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cac9-db90-4a0c-828c-36c702114ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:38.388675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cac9-db90-4a0c-828c-36c702114ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:38.390074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352cac9-db90-4a0c-828c-36c702114ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:38.392690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352cac9-db90-4a0c-828c-36c702114ca6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:38.411873 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1634/3259] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:57:38.412854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f4e4-29ff-4a13-8735-c401b9091247 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:38.427011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f4e4-29ff-4a13-8735-c401b9091247 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:38.434153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcf362-1516-42f8-93f6-78cd64c773a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:38.435199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcf362-1516-42f8-93f6-78cd64c773a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:38.435547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcf362-1516-42f8-93f6-78cd64c773a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:38.436459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcf362-1516-42f8-93f6-78cd64c773a4 admin admin] PATH_INFO: `/v3/projects/1f969ce2097d43f08a67616f2acc6ea9/users/72025c1788a24f9fb58c47caee5467b9/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:38.459521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcf362-1516-42f8-93f6-78cd64c773a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f969ce2097d43f08a67616f2acc6ea9, user_id=72025c1788a24f9fb58c47caee5467b9, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:38.462425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcf362-1516-42f8-93f6-78cd64c773a4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:38.493853 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1626/3260] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:38 2022] PUT /identity/v3/projects/1f969ce2097d43f08a67616f2acc6ea9/users/72025c1788a24f9fb58c47caee5467b9/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:57:38.498237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352cac9-db90-4a0c-828c-36c702114ca6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:38.508863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352cac9-db90-4a0c-828c-36c702114ca6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:38.581211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f55a1d-b620-4f52-a1d4-34baa64dcf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:38.581917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55a1d-b620-4f52-a1d4-34baa64dcf63 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:38.582339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55a1d-b620-4f52-a1d4-34baa64dcf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:38.582683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55a1d-b620-4f52-a1d4-34baa64dcf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:38.583480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f55a1d-b620-4f52-a1d4-34baa64dcf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:38.585345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f55a1d-b620-4f52-a1d4-34baa64dcf63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:38.604488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcf362-1516-42f8-93f6-78cd64c773a4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:38.614939 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1635/3261] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:38.618038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcf362-1516-42f8-93f6-78cd64c773a4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:38.636396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:38.637313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:38.637773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:38.638060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] PATH_INFO: `/v3/projects/1f969ce2097d43f08a67616f2acc6ea9/users/72025c1788a24f9fb58c47caee5467b9/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:38.643420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f969ce2097d43f08a67616f2acc6ea9, user_id=72025c1788a24f9fb58c47caee5467b9, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:38.649719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:38.681528 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1627/3262] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:38 2022] PUT /identity/v3/projects/1f969ce2097d43f08a67616f2acc6ea9/users/72025c1788a24f9fb58c47caee5467b9/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:38.769582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf612a-4647-44a8-8e96-5300367decf3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:38.769988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf612a-4647-44a8-8e96-5300367decf3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:38.770258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf612a-4647-44a8-8e96-5300367decf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:38.802074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d6bf612a-4647-44a8-8e96-5300367decf3 None None] MFA Rules not processed for user `72025c1788a24f9fb58c47caee5467b9`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:38.803353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d6bf612a-4647-44a8-8e96-5300367decf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:38.893445 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1636/3263] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:39.147367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:39.149702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:39.237723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e403142-0828-4b3b-8ef0-0470a94e6587 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:39.247205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66be1bf-fda1-422a-b154-ec6cb25b959e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:39.248365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66be1bf-fda1-422a-b154-ec6cb25b959e service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:39.248365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66be1bf-fda1-422a-b154-ec6cb25b959e service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:39.248814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66be1bf-fda1-422a-b154-ec6cb25b959e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:39.259444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66be1bf-fda1-422a-b154-ec6cb25b959e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:39.264830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66be1bf-fda1-422a-b154-ec6cb25b959e service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:39.277723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1628/3264] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:39.315590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf612a-4647-44a8-8e96-5300367decf3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:39.331226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf612a-4647-44a8-8e96-5300367decf3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:39.339260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704c4e1-48ff-440e-a44f-af35d79efbc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:39.340101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704c4e1-48ff-440e-a44f-af35d79efbc4 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:39.340476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704c4e1-48ff-440e-a44f-af35d79efbc4 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:39.340944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704c4e1-48ff-440e-a44f-af35d79efbc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:39.403841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704c4e1-48ff-440e-a44f-af35d79efbc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:39.405499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704c4e1-48ff-440e-a44f-af35d79efbc4 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:39.416138 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1637/3265] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:39.435032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66be1bf-fda1-422a-b154-ec6cb25b959e service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:39.602464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66be1bf-fda1-422a-b154-ec6cb25b959e service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:39.614955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:39.618525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:39.619010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:39.620914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] PATH_INFO: `/v3/users/dc5857f4ed34409babe14c01a10d3e88` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:39.623097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc5857f4ed34409babe14c01a10d3e88)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:39.626294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:39.740202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc5857f4ed34409babe14c01a10d3e88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:39.741711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc5857f4ed34409babe14c01a10d3e88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:39.742541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc5857f4ed34409babe14c01a10d3e88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:39.769648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc5857f4ed34409babe14c01a10d3e88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:39.789437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc5857f4ed34409babe14c01a10d3e88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:39.849614 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1629/3266] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:39 2022] DELETE /identity/v3/users/dc5857f4ed34409babe14c01a10d3e88 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:39.855217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d712-1b90-4760-9659-4faf5af41f4d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:39.855512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d712-1b90-4760-9659-4faf5af41f4d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:39.855794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d712-1b90-4760-9659-4faf5af41f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:39.883327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4cf4d712-1b90-4760-9659-4faf5af41f4d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:39.895118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4cf4d712-1b90-4760-9659-4faf5af41f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:40.006480 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1638/3267] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:40.039895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:40.039895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:40.128454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad86c5-84dd-42ed-a8ff-6e0282dd76e2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:40.134796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb4f0-23ae-463a-a6c6-eb7dad51e64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:40.135603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb4f0-23ae-463a-a6c6-eb7dad51e64e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:40.136118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb4f0-23ae-463a-a6c6-eb7dad51e64e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:40.136632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb4f0-23ae-463a-a6c6-eb7dad51e64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:40.149522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bb4f0-23ae-463a-a6c6-eb7dad51e64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:40.151903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bb4f0-23ae-463a-a6c6-eb7dad51e64e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:40.164885 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1630/3268] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:40.911485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4d712-1b90-4760-9659-4faf5af41f4d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:40.912959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4cf4d712-1b90-4760-9659-4faf5af41f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:40.930108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4d712-1b90-4760-9659-4faf5af41f4d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:40.936200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:40.937413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:40.938023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:40.938465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] PATH_INFO: `/v3/projects/eba55f50287a466fa60373088ef7f5ff` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:40.939928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba55f50287a466fa60373088ef7f5ff)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:40.943133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:41.003438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba55f50287a466fa60373088ef7f5ff', 'request_id': 'req-9d67970e-a383-43a3-974a-ee94e67a3cac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.009091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba55f50287a466fa60373088ef7f5ff', 'request_id': 'req-9d67970e-a383-43a3-974a-ee94e67a3cac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.016638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba55f50287a466fa60373088ef7f5ff', 'request_id': 'req-9d67970e-a383-43a3-974a-ee94e67a3cac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.030638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] The token cache is being invalidate because project eba55f50287a466fa60373088ef7f5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:41.030840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.033378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.035164 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1639/3269] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:40 2022] DELETE /identity/v3/projects/eba55f50287a466fa60373088ef7f5ff => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:41.039084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb4f0-23ae-463a-a6c6-eb7dad51e64e service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:41.051678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb4f0-23ae-463a-a6c6-eb7dad51e64e service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:41.112743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:41.113700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:41.114056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:41.114408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] PATH_INFO: `/v3/users/72025c1788a24f9fb58c47caee5467b9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:41.115676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72025c1788a24f9fb58c47caee5467b9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:41.117746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:41.167867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72025c1788a24f9fb58c47caee5467b9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.168636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72025c1788a24f9fb58c47caee5467b9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.169316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72025c1788a24f9fb58c47caee5467b9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.182494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72025c1788a24f9fb58c47caee5467b9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.192228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-672c6259-9095-4722-b4f6-f9ecc3570929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72025c1788a24f9fb58c47caee5467b9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.205765 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1631/3270] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:41 2022] DELETE /identity/v3/users/72025c1788a24f9fb58c47caee5467b9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:41.683111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:41.684801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:41.720733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67970e-a383-43a3-974a-ee94e67a3cac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:41.797938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:41.799117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:41.799481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:41.800938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] PATH_INFO: `/v3/projects/1f969ce2097d43f08a67616f2acc6ea9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:41.802224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f969ce2097d43f08a67616f2acc6ea9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:41.804141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:41.884418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f969ce2097d43f08a67616f2acc6ea9', 'request_id': 'req-065040dc-880d-4f6d-a11a-4cc9c2185147'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.894969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f969ce2097d43f08a67616f2acc6ea9', 'request_id': 'req-065040dc-880d-4f6d-a11a-4cc9c2185147'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.904908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f969ce2097d43f08a67616f2acc6ea9', 'request_id': 'req-065040dc-880d-4f6d-a11a-4cc9c2185147'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.917598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] The token cache is being invalidate because project 1f969ce2097d43f08a67616f2acc6ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:41.918259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.918681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-065040dc-880d-4f6d-a11a-4cc9c2185147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:41.920341 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1640/3271] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:41 2022] DELETE /identity/v3/projects/1f969ce2097d43f08a67616f2acc6ea9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:41.927036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1674-ab90-4491-9f3d-665eff40f952 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:41.927438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1674-ab90-4491-9f3d-665eff40f952 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:41.927789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1674-ab90-4491-9f3d-665eff40f952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:41.948358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cddd1674-ab90-4491-9f3d-665eff40f952 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:41.949704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cddd1674-ab90-4491-9f3d-665eff40f952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:42.016691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1632/3272] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:42.024986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec33d12-9083-400a-9ef8-b0ff404a2bdf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.025894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec33d12-9083-400a-9ef8-b0ff404a2bdf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.025894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec33d12-9083-400a-9ef8-b0ff404a2bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.044848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3ec33d12-9083-400a-9ef8-b0ff404a2bdf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:42.046097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ec33d12-9083-400a-9ef8-b0ff404a2bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:42.054808 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1641/3273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:42.059309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd1674-ab90-4491-9f3d-665eff40f952 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:42.069799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd1674-ab90-4491-9f3d-665eff40f952 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:42.074460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:42.075102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.075381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.075650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.076386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:57:42.076691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:42.078270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:42.089479 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1633/3274] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:57:42.093754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec33d12-9083-400a-9ef8-b0ff404a2bdf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:42.102874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec33d12-9083-400a-9ef8-b0ff404a2bdf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:42.107476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834442cf-44a2-4240-bd56-b489044d7ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:42.108113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834442cf-44a2-4240-bd56-b489044d7ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.108438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834442cf-44a2-4240-bd56-b489044d7ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.108715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834442cf-44a2-4240-bd56-b489044d7ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.109396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834442cf-44a2-4240-bd56-b489044d7ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:42.111815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834442cf-44a2-4240-bd56-b489044d7ce0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:42.141528 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1642/3275] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:42 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:42.142642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:42.152711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461c85d-4cbb-4739-b891-f1f4c9feb737 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:42.212509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8de03-57f4-4ba7-b494-b83d903a5f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:42.213187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8de03-57f4-4ba7-b494-b83d903a5f8a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.213503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8de03-57f4-4ba7-b494-b83d903a5f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.213782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8de03-57f4-4ba7-b494-b83d903a5f8a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.214477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8de03-57f4-4ba7-b494-b83d903a5f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:42.216431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8de03-57f4-4ba7-b494-b83d903a5f8a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:42.241169 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1634/3276] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:42 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:57:42.245998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834442cf-44a2-4240-bd56-b489044d7ce0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:42.256913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834442cf-44a2-4240-bd56-b489044d7ce0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:42.261625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eb96b-f251-4e2a-8935-d0b41790dc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:42.262314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eb96b-f251-4e2a-8935-d0b41790dc01 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.262599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eb96b-f251-4e2a-8935-d0b41790dc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.262879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eb96b-f251-4e2a-8935-d0b41790dc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.263598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eb96b-f251-4e2a-8935-d0b41790dc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:42.265259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eb96b-f251-4e2a-8935-d0b41790dc01 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:42.275941 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1643/3277] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:57:42.280074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8de03-57f4-4ba7-b494-b83d903a5f8a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:42.290206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8de03-57f4-4ba7-b494-b83d903a5f8a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:42.295072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc236f-adbc-4442-afda-fcc551015dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:42.295726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc236f-adbc-4442-afda-fcc551015dec admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.296009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc236f-adbc-4442-afda-fcc551015dec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.296360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc236f-adbc-4442-afda-fcc551015dec admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.297043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc236f-adbc-4442-afda-fcc551015dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:42.299232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc236f-adbc-4442-afda-fcc551015dec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:42.314332 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1635/3278] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:57:42.315495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eb96b-f251-4e2a-8935-d0b41790dc01 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:42.341434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eb96b-f251-4e2a-8935-d0b41790dc01 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:42.349941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:42.352434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.353144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.353961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] PATH_INFO: `/v3/projects/5d27e01b703a488e80050c9bc4f2eb50/users/47557f4fab704b198009bc8a3684cb5f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.371118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d27e01b703a488e80050c9bc4f2eb50, user_id=47557f4fab704b198009bc8a3684cb5f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:42.374645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:42.396365 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1644/3279] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:42 2022] PUT /identity/v3/projects/5d27e01b703a488e80050c9bc4f2eb50/users/47557f4fab704b198009bc8a3684cb5f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:42.408363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267714-5ec3-434d-8aa2-9d9efde849dd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.408664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267714-5ec3-434d-8aa2-9d9efde849dd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.409254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267714-5ec3-434d-8aa2-9d9efde849dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.451473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-75267714-5ec3-434d-8aa2-9d9efde849dd None None] MFA Rules not processed for user `47557f4fab704b198009bc8a3684cb5f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:42.453676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-75267714-5ec3-434d-8aa2-9d9efde849dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:42.551518 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1636/3280] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:42.587327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:42.589256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:42.662269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa01b-6a3d-4197-8d3d-4bcf8aa33e7b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:42.667938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48a0c4-bd99-4e05-8d3b-77a8e52da42a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:42.668639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48a0c4-bd99-4e05-8d3b-77a8e52da42a service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:42.668906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48a0c4-bd99-4e05-8d3b-77a8e52da42a service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:42.669185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48a0c4-bd99-4e05-8d3b-77a8e52da42a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:42.677718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48a0c4-bd99-4e05-8d3b-77a8e52da42a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:42.679309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48a0c4-bd99-4e05-8d3b-77a8e52da42a service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:42.689154 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1645/3281] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:43.239480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267714-5ec3-434d-8aa2-9d9efde849dd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:43.317436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267714-5ec3-434d-8aa2-9d9efde849dd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:43.322732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:43.323592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:43.324107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:43.324430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] PATH_INFO: `/v3/users/47557f4fab704b198009bc8a3684cb5f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:43.326376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47557f4fab704b198009bc8a3684cb5f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:43.328299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:43.410657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47557f4fab704b198009bc8a3684cb5f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:43.411678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47557f4fab704b198009bc8a3684cb5f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:43.412401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47557f4fab704b198009bc8a3684cb5f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:43.434567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47557f4fab704b198009bc8a3684cb5f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:43.449050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47557f4fab704b198009bc8a3684cb5f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:43.464565 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1637/3282] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:43 2022] DELETE /identity/v3/users/47557f4fab704b198009bc8a3684cb5f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:43.469194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a572-f019-4bb1-94f5-d58e3da7b262 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:43.470744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a572-f019-4bb1-94f5-d58e3da7b262 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:43.471258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a572-f019-4bb1-94f5-d58e3da7b262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:43.490410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8125a572-f019-4bb1-94f5-d58e3da7b262 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:43.492078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8125a572-f019-4bb1-94f5-d58e3da7b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:43.581052 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1646/3283] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:43.594398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:43.596015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:43.744876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19e46-8f66-49d9-b667-0ce3b195fc85 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:43.749105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7345-344d-423b-85b7-0fd82003564e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:43.749769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7345-344d-423b-85b7-0fd82003564e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:43.751099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7345-344d-423b-85b7-0fd82003564e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:43.751623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7345-344d-423b-85b7-0fd82003564e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:43.762240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f7345-344d-423b-85b7-0fd82003564e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:43.764237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f7345-344d-423b-85b7-0fd82003564e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:43.775502 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1638/3284] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:44.149771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125a572-f019-4bb1-94f5-d58e3da7b262 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:44.150779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8125a572-f019-4bb1-94f5-d58e3da7b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:44.170578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125a572-f019-4bb1-94f5-d58e3da7b262 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:44.183823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:44.185679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.186155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.186586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] PATH_INFO: `/v3/projects/5d27e01b703a488e80050c9bc4f2eb50` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.188162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d27e01b703a488e80050c9bc4f2eb50)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:44.191312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:44.287908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d27e01b703a488e80050c9bc4f2eb50', 'request_id': 'req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.297214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d27e01b703a488e80050c9bc4f2eb50', 'request_id': 'req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.310892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d27e01b703a488e80050c9bc4f2eb50', 'request_id': 'req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.327212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] The token cache is being invalidate because project 5d27e01b703a488e80050c9bc4f2eb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:44.327514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.329133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17c49e7d-d685-4dad-afc0-2e3579fbeb8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.335079 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1647/3285] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:44 2022] DELETE /identity/v3/projects/5d27e01b703a488e80050c9bc4f2eb50 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:44.336962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a549af-1204-4db6-9e95-c4406075d019 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.337459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a549af-1204-4db6-9e95-c4406075d019 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.337657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a549af-1204-4db6-9e95-c4406075d019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.363913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d8a549af-1204-4db6-9e95-c4406075d019 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:44.365934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d8a549af-1204-4db6-9e95-c4406075d019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:44.439582 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1639/3286] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:44.447691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2cdde-3d2d-4318-a32e-5dfd092fab36 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.447989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2cdde-3d2d-4318-a32e-5dfd092fab36 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.448513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2cdde-3d2d-4318-a32e-5dfd092fab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.469677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9fb2cdde-3d2d-4318-a32e-5dfd092fab36 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:44.472565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9fb2cdde-3d2d-4318-a32e-5dfd092fab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:44.483623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1648/3287] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:44.488787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a549af-1204-4db6-9e95-c4406075d019 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:44.500047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a549af-1204-4db6-9e95-c4406075d019 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:44.505421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:44.506223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.506593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.506965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.507780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:57:44.508357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:44.510033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:44.523548 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1640/3288] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:57:44.529054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2cdde-3d2d-4318-a32e-5dfd092fab36 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:44.549856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2cdde-3d2d-4318-a32e-5dfd092fab36 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:44.556560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc264c-dbd7-4688-b16d-3b97b350244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:44.557682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc264c-dbd7-4688-b16d-3b97b350244e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.557972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc264c-dbd7-4688-b16d-3b97b350244e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.558431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc264c-dbd7-4688-b16d-3b97b350244e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.559069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc264c-dbd7-4688-b16d-3b97b350244e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:44.563914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc264c-dbd7-4688-b16d-3b97b350244e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:44.593507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:44.598101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:44.623247 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1649/3289] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:44 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:44.625470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc264c-dbd7-4688-b16d-3b97b350244e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:44.631902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ba960-383e-418f-aff9-919204252d92 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:44.730616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:44.732877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.733347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.733823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] PATH_INFO: `/v3/users/4a93bc6b2b584caab5baabf5fdbea583` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.736214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a93bc6b2b584caab5baabf5fdbea583)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:44.738669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:44.746187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc264c-dbd7-4688-b16d-3b97b350244e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:44.755021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271996-146c-4420-9e8e-51c22f569fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:44.755812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271996-146c-4420-9e8e-51c22f569fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.756397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271996-146c-4420-9e8e-51c22f569fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.756785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93271996-146c-4420-9e8e-51c22f569fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.758594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93271996-146c-4420-9e8e-51c22f569fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:44.762259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93271996-146c-4420-9e8e-51c22f569fa1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:44.795581 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1650/3290] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:44 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:57:44.800799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271996-146c-4420-9e8e-51c22f569fa1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:44.815440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93271996-146c-4420-9e8e-51c22f569fa1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:44.824202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:44.825922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.825922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.826142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.826783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:44.828502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:44.832803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a93bc6b2b584caab5baabf5fdbea583'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.833763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a93bc6b2b584caab5baabf5fdbea583'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.834640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a93bc6b2b584caab5baabf5fdbea583'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.852908 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1651/3291] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:44.853277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a93bc6b2b584caab5baabf5fdbea583'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.857650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:44.859807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:44.863103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4996e12-4792-42a5-8082-e3ad53a1ff7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a93bc6b2b584caab5baabf5fdbea583'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:44.885940 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1641/3292] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:44 2022] DELETE /identity/v3/users/4a93bc6b2b584caab5baabf5fdbea583 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:57:44.887543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea34f-ea6c-43d9-8e83-21b462f84ceb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.887829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea34f-ea6c-43d9-8e83-21b462f84ceb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.888108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea34f-ea6c-43d9-8e83-21b462f84ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.892807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a495-0219-4272-b1bb-257d517d6ac6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:44.906000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8fbea34f-ea6c-43d9-8e83-21b462f84ceb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:44.907414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8fbea34f-ea6c-43d9-8e83-21b462f84ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:44.970890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac339049-fe18-465b-a10b-d9e19528d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:44.971369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac339049-fe18-465b-a10b-d9e19528d9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:44.971661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac339049-fe18-465b-a10b-d9e19528d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:44.971941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac339049-fe18-465b-a10b-d9e19528d9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:44.972761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac339049-fe18-465b-a10b-d9e19528d9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:44.974373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac339049-fe18-465b-a10b-d9e19528d9c1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:44.986873 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1652/3293] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:44.992285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac339049-fe18-465b-a10b-d9e19528d9c1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:45.001809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1642/3294] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:45.013201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbea34f-ea6c-43d9-8e83-21b462f84ceb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:45.014621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8fbea34f-ea6c-43d9-8e83-21b462f84ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:45.015710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac339049-fe18-465b-a10b-d9e19528d9c1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:45.022491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514298a3-7d87-4581-b1a9-afebc61edd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:45.024179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514298a3-7d87-4581-b1a9-afebc61edd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:45.024774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514298a3-7d87-4581-b1a9-afebc61edd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:45.025351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514298a3-7d87-4581-b1a9-afebc61edd02 admin admin] PATH_INFO: `/v3/projects/d99e2ff1d3274058a039b44ef7eb3bcd/users/31edbb3f54824064b0c9bd59d3f9b598/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:45.047848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514298a3-7d87-4581-b1a9-afebc61edd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99e2ff1d3274058a039b44ef7eb3bcd, user_id=31edbb3f54824064b0c9bd59d3f9b598, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:45.051071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514298a3-7d87-4581-b1a9-afebc61edd02 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:45.081173 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1653/3295] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:44 2022] PUT /identity/v3/projects/d99e2ff1d3274058a039b44ef7eb3bcd/users/31edbb3f54824064b0c9bd59d3f9b598/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:57:45.085975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab83a-eb39-4605-a074-a8e3e278cdba None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:45.086257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab83a-eb39-4605-a074-a8e3e278cdba None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:45.086532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab83a-eb39-4605-a074-a8e3e278cdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:45.117424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1f5ab83a-eb39-4605-a074-a8e3e278cdba None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:45.118656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1f5ab83a-eb39-4605-a074-a8e3e278cdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:45.123584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbea34f-ea6c-43d9-8e83-21b462f84ceb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:45.191855 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1654/3296] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:45.200430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:45.201270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:45.201519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:45.201923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:45.203974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ab83a-eb39-4605-a074-a8e3e278cdba None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:45.215398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:45.217001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ab83a-eb39-4605-a074-a8e3e278cdba None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:45.217748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:45.223281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5d4e2-11b9-4162-ae95-399019f26e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:45.225696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5d4e2-11b9-4162-ae95-399019f26e4f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:45.225929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5d4e2-11b9-4162-ae95-399019f26e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:45.226211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5d4e2-11b9-4162-ae95-399019f26e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:45.231236 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1643/3297] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:57:45.242307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5d4e2-11b9-4162-ae95-399019f26e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:45.244037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5d4e2-11b9-4162-ae95-399019f26e4f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:45.260565 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1655/3298] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:45.554892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:45.565276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:45.597902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9c4b-92f4-4629-b67b-0242a4ff56cd service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:45.612193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:45.613879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:45.614485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:45.615068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] PATH_INFO: `/v3/projects/106062f100884d929b001725a5daa730` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:45.623360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106062f100884d929b001725a5daa730)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:45.626540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:45.713934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106062f100884d929b001725a5daa730', 'request_id': 'req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.720952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106062f100884d929b001725a5daa730', 'request_id': 'req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.738638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106062f100884d929b001725a5daa730', 'request_id': 'req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.756103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] The token cache is being invalidate because project 106062f100884d929b001725a5daa730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:45.756543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.757441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.759320 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1644/3299] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:45 2022] DELETE /identity/v3/projects/106062f100884d929b001725a5daa730 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:45.763288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5d4e2-11b9-4162-ae95-399019f26e4f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:45.776754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5d4e2-11b9-4162-ae95-399019f26e4f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:45.846848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:45.848368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:45.848516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:45.848767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] PATH_INFO: `/v3/users/4ab8bb3c01cb41499325b8ebe4f223ef` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:45.850148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab8bb3c01cb41499325b8ebe4f223ef)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:45.852814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:45.959283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab8bb3c01cb41499325b8ebe4f223ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.972925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab8bb3c01cb41499325b8ebe4f223ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.981891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab8bb3c01cb41499325b8ebe4f223ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.982620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab8bb3c01cb41499325b8ebe4f223ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.983229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21abe7ed-a8db-43a2-8559-299c3c75d6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab8bb3c01cb41499325b8ebe4f223ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:45.997897 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1656/3300] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:45 2022] DELETE /identity/v3/users/4ab8bb3c01cb41499325b8ebe4f223ef => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:46.474757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:46.476273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:46.494040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1faf-4f86-43f9-8b3f-f47d6fd77787 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:46.553647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:46.554515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:46.554794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:46.555068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] PATH_INFO: `/v3/projects/78c6c05f9889458fa6889998b10a07e9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:46.556641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c6c05f9889458fa6889998b10a07e9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:46.558973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:46.614441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c6c05f9889458fa6889998b10a07e9', 'request_id': 'req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:46.622041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c6c05f9889458fa6889998b10a07e9', 'request_id': 'req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:46.633327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c6c05f9889458fa6889998b10a07e9', 'request_id': 'req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:46.653218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] The token cache is being invalidate because project 78c6c05f9889458fa6889998b10a07e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:46.653722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:46.654547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6e519fe-48f2-4ca0-a4f0-6827434a6b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:46.656719 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1645/3301] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:46 2022] DELETE /identity/v3/projects/78c6c05f9889458fa6889998b10a07e9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:46.663672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3939eb6-8ea0-40d0-9909-ee2f10edccec None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:46.664186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3939eb6-8ea0-40d0-9909-ee2f10edccec None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:46.664642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3939eb6-8ea0-40d0-9909-ee2f10edccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:46.687761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e3939eb6-8ea0-40d0-9909-ee2f10edccec None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:46.690499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e3939eb6-8ea0-40d0-9909-ee2f10edccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:46.785086 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1657/3302] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:46.798029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ba20-f479-45f5-9f57-4538cc558c83 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:46.798404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ba20-f479-45f5-9f57-4538cc558c83 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:46.798687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ba20-f479-45f5-9f57-4538cc558c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:46.838516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e654ba20-f479-45f5-9f57-4538cc558c83 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:46.839910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e654ba20-f479-45f5-9f57-4538cc558c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:46.863905 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1646/3303] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:46.865806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3939eb6-8ea0-40d0-9909-ee2f10edccec None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:46.878870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3939eb6-8ea0-40d0-9909-ee2f10edccec None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:46.885991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:46.886899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:46.887480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:46.887951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:46.888920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:57:46.889421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:46.892496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:46.911684 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1658/3304] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:57:46.912033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ba20-f479-45f5-9f57-4538cc558c83 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:46.925334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ba20-f479-45f5-9f57-4538cc558c83 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:46.935396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163839-bf25-4819-b7cc-d2e1600aa217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:46.936299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163839-bf25-4819-b7cc-d2e1600aa217 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:46.937072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163839-bf25-4819-b7cc-d2e1600aa217 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:46.937356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163839-bf25-4819-b7cc-d2e1600aa217 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:46.941212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d163839-bf25-4819-b7cc-d2e1600aa217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:46.943266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d163839-bf25-4819-b7cc-d2e1600aa217 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:47.009270 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1647/3305] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:46 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:47.009450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:47.027154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ab390-aa78-408b-97ef-12aec4adc10b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:47.119741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9b1b6-51ba-431e-8ee2-0326e3d67f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:47.120687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b1b6-51ba-431e-8ee2-0326e3d67f01 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:47.121162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b1b6-51ba-431e-8ee2-0326e3d67f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:47.121528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b1b6-51ba-431e-8ee2-0326e3d67f01 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:47.122597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9b1b6-51ba-431e-8ee2-0326e3d67f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:47.124760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9b1b6-51ba-431e-8ee2-0326e3d67f01 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:47.168147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163839-bf25-4819-b7cc-d2e1600aa217 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:47.170406 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1659/3306] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:47 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:57:47.189725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163839-bf25-4819-b7cc-d2e1600aa217 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:47.201748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c27469-c99e-41da-9dd8-9ca3f1d2068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:47.204189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c27469-c99e-41da-9dd8-9ca3f1d2068f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:47.205510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c27469-c99e-41da-9dd8-9ca3f1d2068f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:47.206311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c27469-c99e-41da-9dd8-9ca3f1d2068f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:47.207740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c27469-c99e-41da-9dd8-9ca3f1d2068f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:47.209618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c27469-c99e-41da-9dd8-9ca3f1d2068f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:47.238469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9b1b6-51ba-431e-8ee2-0326e3d67f01 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:47.238952 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1648/3307] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:47.254858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9b1b6-51ba-431e-8ee2-0326e3d67f01 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:47.261282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192264f-6a32-4ba6-bb61-4ce3a86ea915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:47.262308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192264f-6a32-4ba6-bb61-4ce3a86ea915 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:47.262595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192264f-6a32-4ba6-bb61-4ce3a86ea915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:47.262926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192264f-6a32-4ba6-bb61-4ce3a86ea915 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:47.263743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192264f-6a32-4ba6-bb61-4ce3a86ea915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:47.265596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192264f-6a32-4ba6-bb61-4ce3a86ea915 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:47.287207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c27469-c99e-41da-9dd8-9ca3f1d2068f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:47.303033 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1660/3308] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:47.303661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c27469-c99e-41da-9dd8-9ca3f1d2068f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:47.309378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:47.310268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:47.310545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:47.310817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] PATH_INFO: `/v3/projects/0eaac4cd79ca4f808d452057a3216fdd/users/927e2fa8122b464a8046bdc5a2c94544/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:47.334189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaac4cd79ca4f808d452057a3216fdd, user_id=927e2fa8122b464a8046bdc5a2c94544, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:47.339781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:47.375359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59095828-69dd-4629-8a73-f01db9e514ae None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:47.376190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59095828-69dd-4629-8a73-f01db9e514ae None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:47.376771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59095828-69dd-4629-8a73-f01db9e514ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:47.378987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1649/3309] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:47 2022] PUT /identity/v3/projects/0eaac4cd79ca4f808d452057a3216fdd/users/927e2fa8122b464a8046bdc5a2c94544/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:47.407953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-59095828-69dd-4629-8a73-f01db9e514ae None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:47.410438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-59095828-69dd-4629-8a73-f01db9e514ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:47.495607 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1661/3310] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:47.526298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:47.529216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:47.608589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83239-6fd5-444d-96b4-5921346b145b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:47.613754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6947-4bac-4be4-9fcb-6df1f88666d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:47.614606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6947-4bac-4be4-9fcb-6df1f88666d1 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:47.615041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6947-4bac-4be4-9fcb-6df1f88666d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:47.615488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6947-4bac-4be4-9fcb-6df1f88666d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:47.625772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6947-4bac-4be4-9fcb-6df1f88666d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:47.627475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6947-4bac-4be4-9fcb-6df1f88666d1 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:47.639704 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1650/3311] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:49.856645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a01e9a-9273-4201-838a-b3799a43786b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:49.857236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a01e9a-9273-4201-838a-b3799a43786b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:49.857340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a01e9a-9273-4201-838a-b3799a43786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:49.896573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-31a01e9a-9273-4201-838a-b3799a43786b None None] MFA Rules not processed for user `927e2fa8122b464a8046bdc5a2c94544`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:49.898468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-31a01e9a-9273-4201-838a-b3799a43786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:50.002486 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1662/3312] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:50.007700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6947-4bac-4be4-9fcb-6df1f88666d1 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:50.026519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6947-4bac-4be4-9fcb-6df1f88666d1 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:50.033189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:50.034455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:50.034982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:50.035480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:50.037498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:50.040551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:50.091937 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1651/3313] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:50 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:50.094615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a01e9a-9273-4201-838a-b3799a43786b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:50.109612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a01e9a-9273-4201-838a-b3799a43786b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:50.185512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116eb6e-653a-4b35-9e69-d26c0c1f20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:50.186295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116eb6e-653a-4b35-9e69-d26c0c1f20a5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:50.186567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116eb6e-653a-4b35-9e69-d26c0c1f20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:50.187020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116eb6e-653a-4b35-9e69-d26c0c1f20a5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:50.188035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116eb6e-653a-4b35-9e69-d26c0c1f20a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:50.192068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116eb6e-653a-4b35-9e69-d26c0c1f20a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:50.222870 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1663/3314] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:50 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:50.223787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:50.223951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116eb6e-653a-4b35-9e69-d26c0c1f20a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:50.226800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:50.240697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116eb6e-653a-4b35-9e69-d26c0c1f20a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:50.250187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639afd9a-51bb-49bd-bdf5-11341fb40ff4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:50.254969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec8a1-6503-42b2-a774-cbe1d06c12a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:50.255664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec8a1-6503-42b2-a774-cbe1d06c12a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:50.256526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec8a1-6503-42b2-a774-cbe1d06c12a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:50.256966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec8a1-6503-42b2-a774-cbe1d06c12a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:50.258502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec8a1-6503-42b2-a774-cbe1d06c12a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:50.262636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec8a1-6503-42b2-a774-cbe1d06c12a1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:50.266605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:50.267511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:50.267773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:50.268061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] PATH_INFO: `/v3/users/605ee8b93b804ecc9f21177c4cbf0b2a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:50.269472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605ee8b93b804ecc9f21177c4cbf0b2a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:50.271744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:50.279647 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1664/3315] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:50.283497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec8a1-6503-42b2-a774-cbe1d06c12a1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:50.294158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec8a1-6503-42b2-a774-cbe1d06c12a1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:50.302017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:50.303812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:50.304232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:50.305087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] PATH_INFO: `/v3/projects/2c8b0fee8ceb425baae8c1d9bfd288e3/users/21869bf6a5804322ba1f5ade3c625d6c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:50.330754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8b0fee8ceb425baae8c1d9bfd288e3, user_id=21869bf6a5804322ba1f5ade3c625d6c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:50.332911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605ee8b93b804ecc9f21177c4cbf0b2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:50.333935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:50.334257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605ee8b93b804ecc9f21177c4cbf0b2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:50.335809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605ee8b93b804ecc9f21177c4cbf0b2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:50.355285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605ee8b93b804ecc9f21177c4cbf0b2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:50.361789 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1665/3316] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:50 2022] PUT /identity/v3/projects/2c8b0fee8ceb425baae8c1d9bfd288e3/users/21869bf6a5804322ba1f5ade3c625d6c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:57:50.362990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:50.364886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:50.368773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605ee8b93b804ecc9f21177c4cbf0b2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:50.390572 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1652/3317] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:50 2022] DELETE /identity/v3/users/605ee8b93b804ecc9f21177c4cbf0b2a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:50.492269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5a695-3268-4320-b383-8a68bc5b7273 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:50.567654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:50.569732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:50.569859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:50.570128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:50.571038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:50.574246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:50.589871 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1666/3318] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:50.593678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:50.604852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3d9e-0f7d-4295-9e9b-0041277eb251 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:50.611251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07cb8d-36ad-437a-a669-2fddc04ec457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:50.612533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07cb8d-36ad-437a-a669-2fddc04ec457 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:50.612970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07cb8d-36ad-437a-a669-2fddc04ec457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:50.613397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07cb8d-36ad-437a-a669-2fddc04ec457 admin admin] PATH_INFO: `/v3/projects/2c8b0fee8ceb425baae8c1d9bfd288e3/users/21869bf6a5804322ba1f5ade3c625d6c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:50.616010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07cb8d-36ad-437a-a669-2fddc04ec457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8b0fee8ceb425baae8c1d9bfd288e3, user_id=21869bf6a5804322ba1f5ade3c625d6c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:50.619079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07cb8d-36ad-437a-a669-2fddc04ec457 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:50.637492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1653/3319] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:50 2022] PUT /identity/v3/projects/2c8b0fee8ceb425baae8c1d9bfd288e3/users/21869bf6a5804322ba1f5ade3c625d6c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:50.788540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:50.790148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:50.812444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a1459-8d64-476b-a54b-1fe47e641419 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:50.947684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:50.951543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:50.952154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:50.952765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] PATH_INFO: `/v3/projects/4e7060607f9342ad93e2ddbab97d8d2b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:50.955183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7060607f9342ad93e2ddbab97d8d2b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:50.958912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:51.086229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7060607f9342ad93e2ddbab97d8d2b', 'request_id': 'req-fd18a590-0e12-4d90-8fc5-92f478dfc104'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:51.114460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7060607f9342ad93e2ddbab97d8d2b', 'request_id': 'req-fd18a590-0e12-4d90-8fc5-92f478dfc104'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:51.144193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7060607f9342ad93e2ddbab97d8d2b', 'request_id': 'req-fd18a590-0e12-4d90-8fc5-92f478dfc104'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:51.181710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] The token cache is being invalidate because project 4e7060607f9342ad93e2ddbab97d8d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:51.184786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:51.185552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fd18a590-0e12-4d90-8fc5-92f478dfc104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:51.192317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb64b5-ab8b-4189-9240-341613c831e2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.192859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb64b5-ab8b-4189-9240-341613c831e2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.193390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb64b5-ab8b-4189-9240-341613c831e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.194896 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1667/3320] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:50 2022] DELETE /identity/v3/projects/4e7060607f9342ad93e2ddbab97d8d2b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:51.214163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-07fb64b5-ab8b-4189-9240-341613c831e2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:51.215703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-07fb64b5-ab8b-4189-9240-341613c831e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:51.283805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1654/3321] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:51.291307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801d44-493c-43f3-8550-6078a198040a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.291604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801d44-493c-43f3-8550-6078a198040a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.291881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801d44-493c-43f3-8550-6078a198040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.314087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d1801d44-493c-43f3-8550-6078a198040a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:51.315796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d1801d44-493c-43f3-8550-6078a198040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:51.325786 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1668/3322] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:51.330926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb64b5-ab8b-4189-9240-341613c831e2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:51.341404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb64b5-ab8b-4189-9240-341613c831e2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:51.346462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:51.347146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.347424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.347699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.348458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:57:51.348924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:51.350681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:51.365609 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1655/3323] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:57:51.370389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1801d44-493c-43f3-8550-6078a198040a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:51.380911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1801d44-493c-43f3-8550-6078a198040a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:51.388070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353366-6afa-47e7-8e2a-a94272c8dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:51.389064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353366-6afa-47e7-8e2a-a94272c8dbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.389541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353366-6afa-47e7-8e2a-a94272c8dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.390002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353366-6afa-47e7-8e2a-a94272c8dbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.390882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353366-6afa-47e7-8e2a-a94272c8dbd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:51.393696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353366-6afa-47e7-8e2a-a94272c8dbd3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:51.444108 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1669/3324] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:51 2022] POST /identity/v3/projects => generated 401 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:57:51.450034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:51.464786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c77c21-faaa-4aab-af76-73ca0c452607 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:51.588959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5d4f9-f6ca-46d4-993e-b5bc7042d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:51.592313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d4f9-f6ca-46d4-993e-b5bc7042d291 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.592849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d4f9-f6ca-46d4-993e-b5bc7042d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.593405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d4f9-f6ca-46d4-993e-b5bc7042d291 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.595676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5d4f9-f6ca-46d4-993e-b5bc7042d291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:51.597962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5d4f9-f6ca-46d4-993e-b5bc7042d291 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:51.649464 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1656/3325] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:51 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:51.653727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353366-6afa-47e7-8e2a-a94272c8dbd3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:51.664979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353366-6afa-47e7-8e2a-a94272c8dbd3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:51.669926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6a589-a6d9-4f04-87da-4dad3e1c2863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:51.670748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6a589-a6d9-4f04-87da-4dad3e1c2863 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.671182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6a589-a6d9-4f04-87da-4dad3e1c2863 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.671561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6a589-a6d9-4f04-87da-4dad3e1c2863 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.672994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6a589-a6d9-4f04-87da-4dad3e1c2863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:51.674697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6a589-a6d9-4f04-87da-4dad3e1c2863 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:51.691687 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1670/3326] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:51.695492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5d4f9-f6ca-46d4-993e-b5bc7042d291 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:51.720984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5d4f9-f6ca-46d4-993e-b5bc7042d291 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:51.731237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f25a0-6ee0-45b8-9ec9-13d7c78357f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:51.737249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f25a0-6ee0-45b8-9ec9-13d7c78357f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.737736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f25a0-6ee0-45b8-9ec9-13d7c78357f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.737997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f25a0-6ee0-45b8-9ec9-13d7c78357f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.738980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f25a0-6ee0-45b8-9ec9-13d7c78357f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:51.741772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f25a0-6ee0-45b8-9ec9-13d7c78357f9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:51.771809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1657/3327] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:51.776569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6a589-a6d9-4f04-87da-4dad3e1c2863 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:51.812381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6a589-a6d9-4f04-87da-4dad3e1c2863 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:51.819369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72989b-e87f-45b4-a46d-85376035e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:51.821436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72989b-e87f-45b4-a46d-85376035e48a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.821968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72989b-e87f-45b4-a46d-85376035e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.823102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72989b-e87f-45b4-a46d-85376035e48a admin admin] PATH_INFO: `/v3/projects/090a062b91aa4d50b1a37e0d8ce4bb08/users/a591ef3e8a7344509c9e467c37788240/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.865327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72989b-e87f-45b4-a46d-85376035e48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=090a062b91aa4d50b1a37e0d8ce4bb08, user_id=a591ef3e8a7344509c9e467c37788240, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:51.869163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72989b-e87f-45b4-a46d-85376035e48a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:51.888601 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1671/3328] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:51 2022] PUT /identity/v3/projects/090a062b91aa4d50b1a37e0d8ce4bb08/users/a591ef3e8a7344509c9e467c37788240/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:51.898973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5bdf-5e21-4a60-b2b1-cfe8407622e3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:51.899691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5bdf-5e21-4a60-b2b1-cfe8407622e3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:51.900163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5bdf-5e21-4a60-b2b1-cfe8407622e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:51.937136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3d9e5bdf-5e21-4a60-b2b1-cfe8407622e3 None None] MFA Rules not processed for user `a591ef3e8a7344509c9e467c37788240`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:51.938608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3d9e5bdf-5e21-4a60-b2b1-cfe8407622e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.036431 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1658/3329] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:52.046055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72989b-e87f-45b4-a46d-85376035e48a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:52.193020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72989b-e87f-45b4-a46d-85376035e48a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:52.204558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:52.205524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:52.205814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:52.206090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] PATH_INFO: `/v3/users/a591ef3e8a7344509c9e467c37788240` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:52.207337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a591ef3e8a7344509c9e467c37788240)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:52.209316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:52.210839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4274d-f1d1-406f-9652-86b7e02b538e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:52.211718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4274d-f1d1-406f-9652-86b7e02b538e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:52.212295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4274d-f1d1-406f-9652-86b7e02b538e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:52.262326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-34f4274d-f1d1-406f-9652-86b7e02b538e None None] MFA Rules not processed for user `21869bf6a5804322ba1f5ade3c625d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:52.264094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-34f4274d-f1d1-406f-9652-86b7e02b538e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.314052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a591ef3e8a7344509c9e467c37788240'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:52.349194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a591ef3e8a7344509c9e467c37788240'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:52.374375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a591ef3e8a7344509c9e467c37788240'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:52.377519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a591ef3e8a7344509c9e467c37788240'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:52.378396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1fa4938-a684-415e-8f71-b178067be041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a591ef3e8a7344509c9e467c37788240'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:52.415801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1672/3330] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:57:52 2022] DELETE /identity/v3/users/a591ef3e8a7344509c9e467c37788240 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:52.416881 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1659/3331] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:52.425589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027f4d-f22c-4e27-8b5a-a13876cca04d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:52.428864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463762d-00ff-4938-9cff-d118e93ab102 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:52.429413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463762d-00ff-4938-9cff-d118e93ab102 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:52.429899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463762d-00ff-4938-9cff-d118e93ab102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:52.431377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027f4d-f22c-4e27-8b5a-a13876cca04d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:52.431748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027f4d-f22c-4e27-8b5a-a13876cca04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:52.453934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a463762d-00ff-4938-9cff-d118e93ab102 None None] MFA Rules not processed for user `927e2fa8122b464a8046bdc5a2c94544`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:52.455507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a463762d-00ff-4938-9cff-d118e93ab102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.474805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-31027f4d-f22c-4e27-8b5a-a13876cca04d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:52.477791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-31027f4d-f22c-4e27-8b5a-a13876cca04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.590942 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1660/3332] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:52.617515 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1673/3333] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:52.636991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463762d-00ff-4938-9cff-d118e93ab102 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:52.638429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a463762d-00ff-4938-9cff-d118e93ab102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.688896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31027f4d-f22c-4e27-8b5a-a13876cca04d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:52.690646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-31027f4d-f22c-4e27-8b5a-a13876cca04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.759726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463762d-00ff-4938-9cff-d118e93ab102 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:52.771373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5060c2-5769-4c3b-ad5a-b56845fd7d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:52.772917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5060c2-5769-4c3b-ad5a-b56845fd7d88 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:52.773506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5060c2-5769-4c3b-ad5a-b56845fd7d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:52.774060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5060c2-5769-4c3b-ad5a-b56845fd7d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:52.792458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5060c2-5769-4c3b-ad5a-b56845fd7d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:52.800497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5060c2-5769-4c3b-ad5a-b56845fd7d88 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:52.816691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1661/3334] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:57:52.819823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df9e41-c73a-49f3-bea9-958fd4485ba6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:52.820117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df9e41-c73a-49f3-bea9-958fd4485ba6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:52.820433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df9e41-c73a-49f3-bea9-958fd4485ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:52.825455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31027f4d-f22c-4e27-8b5a-a13876cca04d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:52.838794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:52.840119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:52.840324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:52.840665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:52.843130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.857709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-71df9e41-c73a-49f3-bea9-958fd4485ba6 None None] MFA Rules not processed for user `31edbb3f54824064b0c9bd59d3f9b598`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:52.858533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:52.859191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71df9e41-c73a-49f3-bea9-958fd4485ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.860699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:52.874948 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1674/3335] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:57:52.947249 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1662/3336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:52.957004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:52.964718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:52.995328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca5441-7e42-4eb1-8418-981111d2e688 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:53.001850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e0ed5-6375-4336-8a27-630981497503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:53.002650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0ed5-6375-4336-8a27-630981497503 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:53.003034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0ed5-6375-4336-8a27-630981497503 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:53.003380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0ed5-6375-4336-8a27-630981497503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:53.019717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e0ed5-6375-4336-8a27-630981497503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:53.021676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e0ed5-6375-4336-8a27-630981497503 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:53.037047 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1675/3337] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:53.435731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df9e41-c73a-49f3-bea9-958fd4485ba6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:53.440689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71df9e41-c73a-49f3-bea9-958fd4485ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:53.465563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df9e41-c73a-49f3-bea9-958fd4485ba6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:53.474356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:53.475938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:53.476295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:53.476697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] PATH_INFO: `/v3/projects/090a062b91aa4d50b1a37e0d8ce4bb08` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:53.478083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=090a062b91aa4d50b1a37e0d8ce4bb08)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:53.480061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:53.538486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090a062b91aa4d50b1a37e0d8ce4bb08', 'request_id': 'req-831366f2-1efd-4f57-9965-518b3df2b6aa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:53.545411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090a062b91aa4d50b1a37e0d8ce4bb08', 'request_id': 'req-831366f2-1efd-4f57-9965-518b3df2b6aa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:53.555613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090a062b91aa4d50b1a37e0d8ce4bb08', 'request_id': 'req-831366f2-1efd-4f57-9965-518b3df2b6aa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:53.568081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] The token cache is being invalidate because project 090a062b91aa4d50b1a37e0d8ce4bb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:57:53.568407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:53.569044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-831366f2-1efd-4f57-9965-518b3df2b6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:57:53.570717 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1663/3338] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:53 2022] DELETE /identity/v3/projects/090a062b91aa4d50b1a37e0d8ce4bb08 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:57:53.577499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab691-a3b7-4beb-a77e-0e9fd1199d9c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:53.578007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab691-a3b7-4beb-a77e-0e9fd1199d9c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:53.578111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feab691-a3b7-4beb-a77e-0e9fd1199d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:53.599498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3feab691-a3b7-4beb-a77e-0e9fd1199d9c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:53.601023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3feab691-a3b7-4beb-a77e-0e9fd1199d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:53.667127 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1676/3339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:57:53.678743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0c76-b9e5-4cc3-92fc-7ba1d209d218 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:53.679329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0c76-b9e5-4cc3-92fc-7ba1d209d218 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:53.679819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0c76-b9e5-4cc3-92fc-7ba1d209d218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:53.704595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1b4b0c76-b9e5-4cc3-92fc-7ba1d209d218 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:53.705902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1b4b0c76-b9e5-4cc3-92fc-7ba1d209d218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:53.715966 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1664/3340] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:53.720820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab691-a3b7-4beb-a77e-0e9fd1199d9c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:53.740022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feab691-a3b7-4beb-a77e-0e9fd1199d9c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:53.747016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:53.747698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:53.747983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:53.748263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:53.749050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:57:53.749362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:53.751498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:53.779032 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1677/3341] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:57:53.780370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b0c76-b9e5-4cc3-92fc-7ba1d209d218 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:53.790566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b0c76-b9e5-4cc3-92fc-7ba1d209d218 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:53.796990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e9791-736f-49cc-b37a-c7f537db9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:53.797843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9791-736f-49cc-b37a-c7f537db9a7e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:53.798178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9791-736f-49cc-b37a-c7f537db9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:53.798442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9791-736f-49cc-b37a-c7f537db9a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:53.799352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e9791-736f-49cc-b37a-c7f537db9a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:53.801642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e9791-736f-49cc-b37a-c7f537db9a7e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:53.840708 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1665/3342] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:57:53 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:53.845246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:53.856899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e773a9-6a67-4b58-b228-a8f1fea7bf80 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:53.927735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e397-3db3-4f70-a452-1ef7abcf6b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:53.929092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e397-3db3-4f70-a452-1ef7abcf6b8c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:53.929596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e397-3db3-4f70-a452-1ef7abcf6b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:53.930481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e397-3db3-4f70-a452-1ef7abcf6b8c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:53.931473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e397-3db3-4f70-a452-1ef7abcf6b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:53.935753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e397-3db3-4f70-a452-1ef7abcf6b8c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:53.971873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e9791-736f-49cc-b37a-c7f537db9a7e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:53.975854 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1678/3343] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:57:53 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:57:53.989397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e9791-736f-49cc-b37a-c7f537db9a7e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:53.999185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d431-ebae-4997-893e-841cf626f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:54.001013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d431-ebae-4997-893e-841cf626f480 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:54.001540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d431-ebae-4997-893e-841cf626f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:54.002067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d431-ebae-4997-893e-841cf626f480 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:54.003320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d431-ebae-4997-893e-841cf626f480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:54.006055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d431-ebae-4997-893e-841cf626f480 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:54.026057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e397-3db3-4f70-a452-1ef7abcf6b8c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:54.027737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1666/3344] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:57:54.038598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e397-3db3-4f70-a452-1ef7abcf6b8c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:54.048831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132fbdb-f961-4443-a2e8-e4bffb3088cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:54.049723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132fbdb-f961-4443-a2e8-e4bffb3088cc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:54.050067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132fbdb-f961-4443-a2e8-e4bffb3088cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:54.050402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132fbdb-f961-4443-a2e8-e4bffb3088cc admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:54.051409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132fbdb-f961-4443-a2e8-e4bffb3088cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:54.053201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132fbdb-f961-4443-a2e8-e4bffb3088cc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:54.093466 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1679/3345] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:57:54.094689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d431-ebae-4997-893e-841cf626f480 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:54.113906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d431-ebae-4997-893e-841cf626f480 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:54.129147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f34b6-2f98-4c28-a9aa-d11fc303f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:54.130080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f34b6-2f98-4c28-a9aa-d11fc303f141 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:54.130372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f34b6-2f98-4c28-a9aa-d11fc303f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:54.130655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f34b6-2f98-4c28-a9aa-d11fc303f141 admin admin] PATH_INFO: `/v3/projects/7fbbbcdc1b76467abd0d49ef006fb692/users/e7c2cbc8cc8b4685bc1847cc6b8413a3/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:54.190734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f34b6-2f98-4c28-a9aa-d11fc303f141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbbbcdc1b76467abd0d49ef006fb692, user_id=e7c2cbc8cc8b4685bc1847cc6b8413a3, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:54.197206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f34b6-2f98-4c28-a9aa-d11fc303f141 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:54.242104 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1667/3346] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:57:54 2022] PUT /identity/v3/projects/7fbbbcdc1b76467abd0d49ef006fb692/users/e7c2cbc8cc8b4685bc1847cc6b8413a3/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:57:54.253369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee3e0-8aeb-405f-a7b2-f2757ffc2f2b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:54.253648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee3e0-8aeb-405f-a7b2-f2757ffc2f2b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:54.253927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee3e0-8aeb-405f-a7b2-f2757ffc2f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:54.316559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-619ee3e0-8aeb-405f-a7b2-f2757ffc2f2b None None] MFA Rules not processed for user `e7c2cbc8cc8b4685bc1847cc6b8413a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:54.318140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-619ee3e0-8aeb-405f-a7b2-f2757ffc2f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:54.457828 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1680/3347] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:54.463212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13cb1-766b-4ae3-ae20-84c52cc8ee9d None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:54.464677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13cb1-766b-4ae3-ae20-84c52cc8ee9d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:54.465229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13cb1-766b-4ae3-ae20-84c52cc8ee9d None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:54.468254 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1668/3348] 10.222.0.30 () {54 vars in 963 bytes} [Sat Feb 19 20:57:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:57:54.475676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c32249-8f70-4b0e-8b03-2dee3489f022 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:54.476698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c32249-8f70-4b0e-8b03-2dee3489f022 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:54.477219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c32249-8f70-4b0e-8b03-2dee3489f022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:54.552493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d6c32249-8f70-4b0e-8b03-2dee3489f022 None None] MFA Rules not processed for user `9398233d060c43048d49d758695153a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:54.553897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d6c32249-8f70-4b0e-8b03-2dee3489f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:54.671809 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1681/3349] 10.222.0.30 () {58 vars in 1060 bytes} [Sat Feb 19 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:57:54.680710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d13cb1-766b-4ae3-ae20-84c52cc8ee9d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:57:54.694825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d13cb1-766b-4ae3-ae20-84c52cc8ee9d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:57:54.708091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:57:54.709009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:54.711061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:54.711520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:54.730811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:57:54.732538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:57:54.766709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1669/3350] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:57:56.733362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fd928-de4f-4aa0-9a4a-3decbc646ae6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:57:56.733823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fd928-de4f-4aa0-9a4a-3decbc646ae6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:57:56.733952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fd928-de4f-4aa0-9a4a-3decbc646ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:57:56.774517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-974fd928-de4f-4aa0-9a4a-3decbc646ae6 None None] MFA Rules not processed for user `60cfee67e3df4200a93528bcb8036b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:57:56.779058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-974fd928-de4f-4aa0-9a4a-3decbc646ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:57:56.884893 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1682/3351] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:00.749023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:00.752021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:00.895997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a90a0-90e6-45e4-8602-8d82766071fc service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:00.901274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:00.902630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:00.903127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:00.903861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] PATH_INFO: `/v3/users/31edbb3f54824064b0c9bd59d3f9b598` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:00.905351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=31edbb3f54824064b0c9bd59d3f9b598)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:00.923075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:01.036268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31edbb3f54824064b0c9bd59d3f9b598'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.036979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31edbb3f54824064b0c9bd59d3f9b598'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.041451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31edbb3f54824064b0c9bd59d3f9b598'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.073881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31edbb3f54824064b0c9bd59d3f9b598'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.084913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6e52e6ec-8c14-4e48-abb4-c6674d7544dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31edbb3f54824064b0c9bd59d3f9b598'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.110400 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1670/3352] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:00 2022] DELETE /identity/v3/users/31edbb3f54824064b0c9bd59d3f9b598 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:01.354491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fd928-de4f-4aa0-9a4a-3decbc646ae6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:01.370673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fd928-de4f-4aa0-9a4a-3decbc646ae6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:01.496751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:01.498409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:01.498700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:01.499065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] PATH_INFO: `/v3/projects/d99e2ff1d3274058a039b44ef7eb3bcd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:01.501940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99e2ff1d3274058a039b44ef7eb3bcd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:01.504184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:01.590899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99e2ff1d3274058a039b44ef7eb3bcd', 'request_id': 'req-2deed294-5389-417c-afaf-3aae0981952b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.598813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99e2ff1d3274058a039b44ef7eb3bcd', 'request_id': 'req-2deed294-5389-417c-afaf-3aae0981952b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.612703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99e2ff1d3274058a039b44ef7eb3bcd', 'request_id': 'req-2deed294-5389-417c-afaf-3aae0981952b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.629859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] The token cache is being invalidate because project d99e2ff1d3274058a039b44ef7eb3bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:01.632057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.633571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2deed294-5389-417c-afaf-3aae0981952b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:01.635820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1683/3353] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:01 2022] DELETE /identity/v3/projects/d99e2ff1d3274058a039b44ef7eb3bcd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:01.640925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fc7bd-67ea-47f0-9a25-e282affd7d02 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:01.641477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fc7bd-67ea-47f0-9a25-e282affd7d02 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:01.641949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fc7bd-67ea-47f0-9a25-e282affd7d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:01.702035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-df1fc7bd-67ea-47f0-9a25-e282affd7d02 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:01.702035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-df1fc7bd-67ea-47f0-9a25-e282affd7d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:01.842381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6eaf-4c58-4808-a91d-e80bf32f29a6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:01.842996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6eaf-4c58-4808-a91d-e80bf32f29a6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:01.843461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6eaf-4c58-4808-a91d-e80bf32f29a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:01.852411 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1671/3354] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:01.871766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0eff6eaf-4c58-4808-a91d-e80bf32f29a6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:01.873484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0eff6eaf-4c58-4808-a91d-e80bf32f29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:01.889637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fc7bd-67ea-47f0-9a25-e282affd7d02 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:01.896527 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1684/3355] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:01.904242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fc7bd-67ea-47f0-9a25-e282affd7d02 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:01.910595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:01.911595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:01.912565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:01.913019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:01.914045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:01.914533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:01.916560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:01.939857 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1672/3356] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:01.941705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6eaf-4c58-4808-a91d-e80bf32f29a6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:01.952629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6eaf-4c58-4808-a91d-e80bf32f29a6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:01.960413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b7004-7ffc-4ead-806a-97293c830c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:01.961515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7004-7ffc-4ead-806a-97293c830c79 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:01.961967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7004-7ffc-4ead-806a-97293c830c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:01.962413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7004-7ffc-4ead-806a-97293c830c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:01.963265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b7004-7ffc-4ead-806a-97293c830c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:01.965807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b7004-7ffc-4ead-806a-97293c830c79 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:02.009677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1685/3357] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:01 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:02.010627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:02.024987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa4b6-19c5-42c4-86ac-4a9d5ae7bbbb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:02.136258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0264e3-1d24-4efd-8945-4997c5aca13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:02.138309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0264e3-1d24-4efd-8945-4997c5aca13f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:02.138808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0264e3-1d24-4efd-8945-4997c5aca13f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:02.139382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0264e3-1d24-4efd-8945-4997c5aca13f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:02.141310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0264e3-1d24-4efd-8945-4997c5aca13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:02.144698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0264e3-1d24-4efd-8945-4997c5aca13f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:02.210963 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1673/3358] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:02 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:02.212727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b7004-7ffc-4ead-806a-97293c830c79 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:02.233342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b7004-7ffc-4ead-806a-97293c830c79 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:02.241280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ea2d-ead7-49c7-bc2e-246ee5aca3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:02.242595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ea2d-ead7-49c7-bc2e-246ee5aca3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:02.242934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ea2d-ead7-49c7-bc2e-246ee5aca3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:02.243221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ea2d-ead7-49c7-bc2e-246ee5aca3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:02.243954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ea2d-ead7-49c7-bc2e-246ee5aca3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:02.246697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ea2d-ead7-49c7-bc2e-246ee5aca3d2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:02.289629 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1686/3359] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:02.289876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0264e3-1d24-4efd-8945-4997c5aca13f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:02.305244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0264e3-1d24-4efd-8945-4997c5aca13f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:02.316937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd9667-20e6-498a-851e-45cd19581e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:02.317720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd9667-20e6-498a-851e-45cd19581e7f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:02.318407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd9667-20e6-498a-851e-45cd19581e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:02.318407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd9667-20e6-498a-851e-45cd19581e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:02.319511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd9667-20e6-498a-851e-45cd19581e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:02.321326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd9667-20e6-498a-851e-45cd19581e7f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:02.348443 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1674/3360] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:58:02.351607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ea2d-ead7-49c7-bc2e-246ee5aca3d2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:02.369766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ea2d-ead7-49c7-bc2e-246ee5aca3d2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:02.377839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:02.379137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:02.379664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:02.380167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] PATH_INFO: `/v3/projects/ba0a055a14bb46128600e77140b79b10/users/5228f69460a3451c90e6254f5c6b6eeb/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:02.403994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0a055a14bb46128600e77140b79b10, user_id=5228f69460a3451c90e6254f5c6b6eeb, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:02.414328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:02.482376 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1687/3361] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:02 2022] PUT /identity/v3/projects/ba0a055a14bb46128600e77140b79b10/users/5228f69460a3451c90e6254f5c6b6eeb/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:02.485323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285d0a-cc50-4034-aa6b-67f9e41ffced None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:02.485576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285d0a-cc50-4034-aa6b-67f9e41ffced None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:02.485838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285d0a-cc50-4034-aa6b-67f9e41ffced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:02.543348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e7285d0a-cc50-4034-aa6b-67f9e41ffced None None] MFA Rules not processed for user `5228f69460a3451c90e6254f5c6b6eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:02.545770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e7285d0a-cc50-4034-aa6b-67f9e41ffced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:02.677419 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1675/3362] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:02.690398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:02.696364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:02.715268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdeb4-0109-4925-88a2-c555a370e8c7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:02.715844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdeb4-0109-4925-88a2-c555a370e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:02.716304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdeb4-0109-4925-88a2-c555a370e8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:02.752615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-115cdeb4-0109-4925-88a2-c555a370e8c7 None None] MFA Rules not processed for user `0d694f3e8da440a9a1cac8ca2de030e8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:02.757546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-115cdeb4-0109-4925-88a2-c555a370e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:02.851193 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1676/3363] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:02.885668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1eaa4-1580-47c6-b12f-0676891a9c51 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:02.901813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2584097-b97b-4e97-814d-9db7b66d9f04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:02.912287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2584097-b97b-4e97-814d-9db7b66d9f04 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:02.912890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2584097-b97b-4e97-814d-9db7b66d9f04 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:02.914332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2584097-b97b-4e97-814d-9db7b66d9f04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:02.945135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2584097-b97b-4e97-814d-9db7b66d9f04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:02.952225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2584097-b97b-4e97-814d-9db7b66d9f04 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:02.999632 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1688/3364] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:03.137601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cdeb4-0109-4925-88a2-c555a370e8c7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:03.139278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-115cdeb4-0109-4925-88a2-c555a370e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:03.266693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cdeb4-0109-4925-88a2-c555a370e8c7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:03.273306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:03.274077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:03.274433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:03.274784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:03.276850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:03.378612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:03.380772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:03.402651 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1677/3365] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:04.136235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbc9d-f3cb-4065-a5d2-ca34772e44c5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:04.136778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbc9d-f3cb-4065-a5d2-ca34772e44c5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:04.136965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbc9d-f3cb-4065-a5d2-ca34772e44c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:04.157958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3cabbc9d-f3cb-4065-a5d2-ca34772e44c5 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:04.160041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3cabbc9d-f3cb-4065-a5d2-ca34772e44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:04.244540 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1689/3366] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:04.263271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:04.265378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:04.347827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3aac7-4730-4949-b750-64f68b01fc33 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:04.354739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd8ee-c6da-42ea-b1c1-f192d70ccfa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:04.355400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd8ee-c6da-42ea-b1c1-f192d70ccfa5 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:04.356265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd8ee-c6da-42ea-b1c1-f192d70ccfa5 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:04.356582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd8ee-c6da-42ea-b1c1-f192d70ccfa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:04.365618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd8ee-c6da-42ea-b1c1-f192d70ccfa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:04.367209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd8ee-c6da-42ea-b1c1-f192d70ccfa5 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:04.383287 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1678/3367] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:58:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:06.166175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560dba-de04-4c62-a42c-84cf1ea7ff66 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:06.167111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560dba-de04-4c62-a42c-84cf1ea7ff66 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:06.167493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560dba-de04-4c62-a42c-84cf1ea7ff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:06.205328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-03560dba-de04-4c62-a42c-84cf1ea7ff66 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:06.208880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-03560dba-de04-4c62-a42c-84cf1ea7ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:06.229360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1690/3368] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:06.244070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd8ee-c6da-42ea-b1c1-f192d70ccfa5 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:06.255967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd8ee-c6da-42ea-b1c1-f192d70ccfa5 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:06.262316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ec2c3-9b03-4443-9829-5f4089055ebb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:06.262972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ec2c3-9b03-4443-9829-5f4089055ebb service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:06.263260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ec2c3-9b03-4443-9829-5f4089055ebb service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:06.263531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ec2c3-9b03-4443-9829-5f4089055ebb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:06.274409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ec2c3-9b03-4443-9829-5f4089055ebb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:06.276266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ec2c3-9b03-4443-9829-5f4089055ebb service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:06.297410 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1679/3369] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:58:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:07.245335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03560dba-de04-4c62-a42c-84cf1ea7ff66 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:07.246987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-03560dba-de04-4c62-a42c-84cf1ea7ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:07.382995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03560dba-de04-4c62-a42c-84cf1ea7ff66 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:07.403634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:07.404312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:07.404628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:07.410287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:07.413265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:07.448254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:07.450115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:07.472921 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1691/3370] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:08.736629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ec2c3-9b03-4443-9829-5f4089055ebb service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:08.758472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ec2c3-9b03-4443-9829-5f4089055ebb service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:08.793473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a230dd8-52f4-4444-8713-6ce7221cc703 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:08.795905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a230dd8-52f4-4444-8713-6ce7221cc703 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:08.799400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a230dd8-52f4-4444-8713-6ce7221cc703 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:08.799675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a230dd8-52f4-4444-8713-6ce7221cc703 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:08.805006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a230dd8-52f4-4444-8713-6ce7221cc703 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:08.862463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a230dd8-52f4-4444-8713-6ce7221cc703 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:08.865531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a230dd8-52f4-4444-8713-6ce7221cc703 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:08.881165 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1680/3371] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:08.987360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:08.989121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:09.124569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295826c-4dfa-4bc1-93e9-a8d8fe99a9e0 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:09.131423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:09.132824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:09.133362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:09.133825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] PATH_INFO: `/v3/users/e7c2cbc8cc8b4685bc1847cc6b8413a3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:09.136116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c2cbc8cc8b4685bc1847cc6b8413a3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:09.138983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:09.233171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c2cbc8cc8b4685bc1847cc6b8413a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:09.257461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def66b-9fb6-473e-a912-d0fab7ac4c8a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:09.257748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def66b-9fb6-473e-a912-d0fab7ac4c8a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:09.258493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def66b-9fb6-473e-a912-d0fab7ac4c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:09.261204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c2cbc8cc8b4685bc1847cc6b8413a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:09.281865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c2cbc8cc8b4685bc1847cc6b8413a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:09.282994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c2cbc8cc8b4685bc1847cc6b8413a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:09.283786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-517ce252-9c32-4343-8c9c-5377a47f77c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c2cbc8cc8b4685bc1847cc6b8413a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:09.292645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-57def66b-9fb6-473e-a912-d0fab7ac4c8a None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:09.292645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57def66b-9fb6-473e-a912-d0fab7ac4c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:09.306715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1692/3372] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:08 2022] DELETE /identity/v3/users/e7c2cbc8cc8b4685bc1847cc6b8413a3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:09.310959 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1681/3373] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:58:09.311951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1b56-b267-452a-9f03-c4798323f52e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:09.312503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1b56-b267-452a-9f03-c4798323f52e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:09.313617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1b56-b267-452a-9f03-c4798323f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:09.335018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-45cb1b56-b267-452a-9f03-c4798323f52e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:09.336727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-45cb1b56-b267-452a-9f03-c4798323f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:09.340053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57def66b-9fb6-473e-a912-d0fab7ac4c8a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:09.341863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57def66b-9fb6-473e-a912-d0fab7ac4c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:09.368829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57def66b-9fb6-473e-a912-d0fab7ac4c8a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:09.423542 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1693/3374] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:58:09.437219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1b56-b267-452a-9f03-c4798323f52e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:09.439073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-45cb1b56-b267-452a-9f03-c4798323f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:09.499587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:09.500599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:09.500989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:09.501423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:09.529292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1b56-b267-452a-9f03-c4798323f52e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:09.543857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1789e7-7c8d-4dc0-b69c-d5ce1fe000c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:09.544583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1789e7-7c8d-4dc0-b69c-d5ce1fe000c0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:09.544865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1789e7-7c8d-4dc0-b69c-d5ce1fe000c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:09.545139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1789e7-7c8d-4dc0-b69c-d5ce1fe000c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:09.579083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1789e7-7c8d-4dc0-b69c-d5ce1fe000c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:09.580581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1789e7-7c8d-4dc0-b69c-d5ce1fe000c0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:09.605463 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1694/3375] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:09.664869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:09.666810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:09.682773 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1682/3376] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:58:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:10.091144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d8dc-e474-4b80-a811-eb784e35263b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:10.091704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d8dc-e474-4b80-a811-eb784e35263b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:10.092270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d8dc-e474-4b80-a811-eb784e35263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:10.125509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-db79d8dc-e474-4b80-a811-eb784e35263b None None] MFA Rules not processed for user `5228f69460a3451c90e6254f5c6b6eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:10.134519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-db79d8dc-e474-4b80-a811-eb784e35263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:10.213134 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1695/3377] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:10.481246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:10.482734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:10.506998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126e1cb-d089-436a-9608-87763315df89 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:10.518120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:10.519053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:10.519334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:10.520727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] PATH_INFO: `/v3/projects/7fbbbcdc1b76467abd0d49ef006fb692` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:10.535477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbbbcdc1b76467abd0d49ef006fb692)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:10.546534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:10.656603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbbbcdc1b76467abd0d49ef006fb692', 'request_id': 'req-f257e3fe-1c36-4c04-994e-31adff177dd5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:10.673174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbbbcdc1b76467abd0d49ef006fb692', 'request_id': 'req-f257e3fe-1c36-4c04-994e-31adff177dd5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:10.701673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbbbcdc1b76467abd0d49ef006fb692', 'request_id': 'req-f257e3fe-1c36-4c04-994e-31adff177dd5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:10.720294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] The token cache is being invalidate because project 7fbbbcdc1b76467abd0d49ef006fb692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:10.721529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:10.722268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f257e3fe-1c36-4c04-994e-31adff177dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:10.727771 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1683/3378] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:10 2022] DELETE /identity/v3/projects/7fbbbcdc1b76467abd0d49ef006fb692 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:10.735874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c09404-18f6-480a-9e14-e29da22b3830 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:10.736465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c09404-18f6-480a-9e14-e29da22b3830 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:10.736908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c09404-18f6-480a-9e14-e29da22b3830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:10.758533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f2c09404-18f6-480a-9e14-e29da22b3830 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:10.760039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f2c09404-18f6-480a-9e14-e29da22b3830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:10.836533 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1696/3379] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:10.844863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e780f-7365-43f7-b009-ad34e3a9ce36 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:10.846126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e780f-7365-43f7-b009-ad34e3a9ce36 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:10.846666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e780f-7365-43f7-b009-ad34e3a9ce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:10.884140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-618e780f-7365-43f7-b009-ad34e3a9ce36 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:10.885778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-618e780f-7365-43f7-b009-ad34e3a9ce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:10.903703 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1684/3380] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:10.908049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c09404-18f6-480a-9e14-e29da22b3830 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:10.918636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c09404-18f6-480a-9e14-e29da22b3830 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:10.938285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:10.938967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:10.939245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:10.939516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:10.940244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:10.941007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:10.942612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:10.976475 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1697/3381] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:58:10.980550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e780f-7365-43f7-b009-ad34e3a9ce36 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:11.006381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e780f-7365-43f7-b009-ad34e3a9ce36 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:11.014253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c81a5-c4e0-4dbb-9645-3720cacccf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:11.017395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c81a5-c4e0-4dbb-9645-3720cacccf57 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:11.019022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c81a5-c4e0-4dbb-9645-3720cacccf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:11.019929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c81a5-c4e0-4dbb-9645-3720cacccf57 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:11.020848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c81a5-c4e0-4dbb-9645-3720cacccf57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:11.023576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c81a5-c4e0-4dbb-9645-3720cacccf57 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:11.061061 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1685/3382] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:10 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:11.065598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:11.079643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307b7d-a709-4640-9ce7-04270432ba1f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:11.198369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeaf00-6ec7-43ff-8257-455aa1813e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:11.201205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeaf00-6ec7-43ff-8257-455aa1813e82 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:11.201920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeaf00-6ec7-43ff-8257-455aa1813e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:11.202710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeaf00-6ec7-43ff-8257-455aa1813e82 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:11.204319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeaf00-6ec7-43ff-8257-455aa1813e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:11.208360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeaf00-6ec7-43ff-8257-455aa1813e82 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:11.255830 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1698/3383] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:11 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:11.258424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c81a5-c4e0-4dbb-9645-3720cacccf57 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:11.277708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c81a5-c4e0-4dbb-9645-3720cacccf57 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:11.286983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b4c6e-b107-4cbb-9d5f-1d5efafd9f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:11.288432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b4c6e-b107-4cbb-9d5f-1d5efafd9f36 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:11.289048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b4c6e-b107-4cbb-9d5f-1d5efafd9f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:11.289193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b4c6e-b107-4cbb-9d5f-1d5efafd9f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:11.290204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b4c6e-b107-4cbb-9d5f-1d5efafd9f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:11.291719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b4c6e-b107-4cbb-9d5f-1d5efafd9f36 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:11.316394 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1686/3384] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:11.320459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeaf00-6ec7-43ff-8257-455aa1813e82 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:11.355182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeaf00-6ec7-43ff-8257-455aa1813e82 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:11.362590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa5c62-622e-4aac-af64-67fd17470088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:11.364600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5c62-622e-4aac-af64-67fd17470088 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:11.365670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5c62-622e-4aac-af64-67fd17470088 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:11.366304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5c62-622e-4aac-af64-67fd17470088 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:11.367274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa5c62-622e-4aac-af64-67fd17470088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:11.370985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa5c62-622e-4aac-af64-67fd17470088 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:11.423821 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1699/3385] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:11.428162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b4c6e-b107-4cbb-9d5f-1d5efafd9f36 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:11.461580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b4c6e-b107-4cbb-9d5f-1d5efafd9f36 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:11.479078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ffda-347c-4416-a992-a2b9ff8de89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:11.480401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ffda-347c-4416-a992-a2b9ff8de89e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:11.480853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ffda-347c-4416-a992-a2b9ff8de89e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:11.481512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ffda-347c-4416-a992-a2b9ff8de89e admin admin] PATH_INFO: `/v3/projects/9e29ccf0af6a4566b2b5895350a3ae38/users/34d5f2fafa544375a58321a899b1fda2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:11.527762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ffda-347c-4416-a992-a2b9ff8de89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e29ccf0af6a4566b2b5895350a3ae38, user_id=34d5f2fafa544375a58321a899b1fda2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:11.530509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ffda-347c-4416-a992-a2b9ff8de89e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:11.564264 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1687/3386] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:11 2022] PUT /identity/v3/projects/9e29ccf0af6a4566b2b5895350a3ae38/users/34d5f2fafa544375a58321a899b1fda2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:11.576873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a429a-90f3-4a43-8220-d9846b420e93 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:11.577566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a429a-90f3-4a43-8220-d9846b420e93 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:11.577566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a429a-90f3-4a43-8220-d9846b420e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:11.663313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-365a429a-90f3-4a43-8220-d9846b420e93 None None] MFA Rules not processed for user `34d5f2fafa544375a58321a899b1fda2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:11.664710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-365a429a-90f3-4a43-8220-d9846b420e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:11.695921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba1de-5bdf-4498-b725-6cf09ee22e63 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:11.696531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba1de-5bdf-4498-b725-6cf09ee22e63 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:11.696993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba1de-5bdf-4498-b725-6cf09ee22e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:11.722038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a75ba1de-5bdf-4498-b725-6cf09ee22e63 None None] MFA Rules not processed for user `5228f69460a3451c90e6254f5c6b6eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:11.723631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a75ba1de-5bdf-4498-b725-6cf09ee22e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:11.855013 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1700/3387] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:58:11.859159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a429a-90f3-4a43-8220-d9846b420e93 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:11.986530 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1688/3388] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:12.022293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a429a-90f3-4a43-8220-d9846b420e93 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:12.037120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7984db-3ae7-40c9-9c8e-84bc82ed36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:12.038214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7984db-3ae7-40c9-9c8e-84bc82ed36dc admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:12.038735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7984db-3ae7-40c9-9c8e-84bc82ed36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:12.039249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7984db-3ae7-40c9-9c8e-84bc82ed36dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:12.040179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7984db-3ae7-40c9-9c8e-84bc82ed36dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:12.042425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7984db-3ae7-40c9-9c8e-84bc82ed36dc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:12.116652 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1701/3389] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:11 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:12.117943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ba1de-5bdf-4498-b725-6cf09ee22e63 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:12.153378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ba1de-5bdf-4498-b725-6cf09ee22e63 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:12.299561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78913-7667-4203-b751-cfeac1e0ad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:12.300258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78913-7667-4203-b751-cfeac1e0ad5a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:12.301234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78913-7667-4203-b751-cfeac1e0ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:12.311976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78913-7667-4203-b751-cfeac1e0ad5a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:12.313600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd78913-7667-4203-b751-cfeac1e0ad5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:12.316697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd78913-7667-4203-b751-cfeac1e0ad5a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:12.357448 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1689/3390] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:12 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:12.362121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7984db-3ae7-40c9-9c8e-84bc82ed36dc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:12.373678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7984db-3ae7-40c9-9c8e-84bc82ed36dc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:12.406024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e315-2b39-46b1-b227-5213ea2e8a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:12.407933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e315-2b39-46b1-b227-5213ea2e8a14 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:12.408224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e315-2b39-46b1-b227-5213ea2e8a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:12.410934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e315-2b39-46b1-b227-5213ea2e8a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:12.413232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06e315-2b39-46b1-b227-5213ea2e8a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:12.419256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06e315-2b39-46b1-b227-5213ea2e8a14 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:12.465481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78913-7667-4203-b751-cfeac1e0ad5a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:12.478000 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1702/3391] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:58:12.479321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78913-7667-4203-b751-cfeac1e0ad5a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:12.491854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3285-29e3-4d44-a691-696fd21ee1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:12.495352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3285-29e3-4d44-a691-696fd21ee1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:12.495644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3285-29e3-4d44-a691-696fd21ee1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:12.496116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3285-29e3-4d44-a691-696fd21ee1bf admin admin] PATH_INFO: `/v3/projects/0b2a76c905d2442c80a694e36cee88e4/users/5461c5e91a654ee397282b247652ef7a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:12.555846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c3285-29e3-4d44-a691-696fd21ee1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2a76c905d2442c80a694e36cee88e4, user_id=5461c5e91a654ee397282b247652ef7a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:12.561837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c3285-29e3-4d44-a691-696fd21ee1bf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:12.599655 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1690/3392] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:12 2022] PUT /identity/v3/projects/0b2a76c905d2442c80a694e36cee88e4/users/5461c5e91a654ee397282b247652ef7a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:12.604751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e315-2b39-46b1-b227-5213ea2e8a14 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:12.629192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e315-2b39-46b1-b227-5213ea2e8a14 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:12.743553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99856983-c268-411c-a799-99615ba0edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:12.744750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99856983-c268-411c-a799-99615ba0edd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:12.745425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99856983-c268-411c-a799-99615ba0edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:12.745863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99856983-c268-411c-a799-99615ba0edd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:12.746945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99856983-c268-411c-a799-99615ba0edd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:12.748798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99856983-c268-411c-a799-99615ba0edd5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:12.789829 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1703/3393] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:12.793949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3285-29e3-4d44-a691-696fd21ee1bf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:12.807041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3285-29e3-4d44-a691-696fd21ee1bf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:12.826226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126e49-cbb8-4ce2-86d0-b666f1f3744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:12.827135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126e49-cbb8-4ce2-86d0-b666f1f3744b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:12.827417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126e49-cbb8-4ce2-86d0-b666f1f3744b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:12.827700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126e49-cbb8-4ce2-86d0-b666f1f3744b admin admin] PATH_INFO: `/v3/projects/0b2a76c905d2442c80a694e36cee88e4/users/5461c5e91a654ee397282b247652ef7a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:12.836476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc126e49-cbb8-4ce2-86d0-b666f1f3744b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2a76c905d2442c80a694e36cee88e4, user_id=5461c5e91a654ee397282b247652ef7a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:12.839339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc126e49-cbb8-4ce2-86d0-b666f1f3744b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:12.873816 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1691/3394] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:12 2022] PUT /identity/v3/projects/0b2a76c905d2442c80a694e36cee88e4/users/5461c5e91a654ee397282b247652ef7a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:12.885526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b25d-4066-47cc-90fe-b7f9cad3814e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:12.885817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b25d-4066-47cc-90fe-b7f9cad3814e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:12.886104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b25d-4066-47cc-90fe-b7f9cad3814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:12.943724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e713b25d-4066-47cc-90fe-b7f9cad3814e None None] MFA Rules not processed for user `5461c5e91a654ee397282b247652ef7a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:12.948577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e713b25d-4066-47cc-90fe-b7f9cad3814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:13.147864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126e49-cbb8-4ce2-86d0-b666f1f3744b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.148665 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1704/3395] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:13.166469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126e49-cbb8-4ce2-86d0-b666f1f3744b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.188596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.189296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.189584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.189862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.194108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.197617 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:13.197617 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:13.197617 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:13.199271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.234212 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1692/3396] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Feb 19 20:58:13 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:13.242443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713b25d-4066-47cc-90fe-b7f9cad3814e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.258443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713b25d-4066-47cc-90fe-b7f9cad3814e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.269475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.270639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.271156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.271739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3d80492b0cef4aaebc8a0848bc3a5cde` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.272974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=3d80492b0cef4aaebc8a0848bc3a5cde)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.274595 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:13.274595 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:58:13.274595 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:58:13.275488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.289934 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1705/3397] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:58:13 2022] GET /identity/v3/OS-OAUTH1/consumers/3d80492b0cef4aaebc8a0848bc3a5cde => generated 221 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:13.293093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.311826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124658fc-eae3-410a-b9a9-e3f59a8002c0 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.318307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.319445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.319951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.321074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3d80492b0cef4aaebc8a0848bc3a5cde` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.322002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=3d80492b0cef4aaebc8a0848bc3a5cde)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.323681 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:13.323681 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:13.323681 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:13.325687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.326317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invalidating token cache because consumer 3d80492b0cef4aaebc8a0848bc3a5cde has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:13.326855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:13.328221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:13.360226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '3d80492b0cef4aaebc8a0848bc3a5cde', 'request_id': 'req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:13.393424 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1693/3398] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:58:13 2022] DELETE /identity/v3/OS-OAUTH1/consumers/3d80492b0cef4aaebc8a0848bc3a5cde => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:13.398717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.403228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:13.427094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449fa1c-f9bc-4ed2-8597-bc9c2fcc293b tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.435497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.436502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.436972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.437464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.438678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.440114 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:13.440114 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:58:13.440114 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:58:13.441386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.469660 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1706/3399] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Feb 19 20:58:13 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:13.473864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.491545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8a86-a3f7-4bfb-8137-31ccded9ed36 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.513010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.515010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.515347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.516402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03680a8174b5498dafe4818b8eeb7b67` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.517917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=03680a8174b5498dafe4818b8eeb7b67)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.519654 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:13.519654 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:13.519654 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:13.521085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.529007 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1694/3400] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:58:13 2022] GET /identity/v3/OS-OAUTH1/consumers/03680a8174b5498dafe4818b8eeb7b67 => generated 220 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:13.533916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.570891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b99fd-5cd6-47eb-a4e2-e4f6216d1536 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.579808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.581752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.582342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.583287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03680a8174b5498dafe4818b8eeb7b67` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.584189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=03680a8174b5498dafe4818b8eeb7b67)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.585413 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:13.585413 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:58:13.585413 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:58:13.587262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.587703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invalidating token cache because consumer 03680a8174b5498dafe4818b8eeb7b67 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:13.588193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:13.589349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:13.612903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '03680a8174b5498dafe4818b8eeb7b67', 'request_id': 'req-4504d736-f80b-41e4-a892-4549d3dee8e9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:13.660164 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1707/3401] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:58:13 2022] DELETE /identity/v3/OS-OAUTH1/consumers/03680a8174b5498dafe4818b8eeb7b67 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:13.665663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.668837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:13.715436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a7a00-9265-4501-9eec-524a8f314076 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.731677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.733070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.733553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.734015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03680a8174b5498dafe4818b8eeb7b67` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.736063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=03680a8174b5498dafe4818b8eeb7b67)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.740920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.776524 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Feb 19 20:58:13.784895 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1695/3402] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:58:13 2022] GET /identity/v3/OS-OAUTH1/consumers/03680a8174b5498dafe4818b8eeb7b67 => generated 74 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:58:13.788763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.805402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d736-f80b-41e4-a892-4549d3dee8e9 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.821274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.822770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.823665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.825208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03680a8174b5498dafe4818b8eeb7b67` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.828146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=03680a8174b5498dafe4818b8eeb7b67)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.832587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.833178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invalidating token cache because consumer 03680a8174b5498dafe4818b8eeb7b67 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:13.835715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:13.841016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:13.872413 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Feb 19 20:58:13.879851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1708/3403] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:58:13 2022] DELETE /identity/v3/OS-OAUTH1/consumers/03680a8174b5498dafe4818b8eeb7b67 => generated 74 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:58:13.880586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:13.884787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:13.936221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc55d95-1546-47af-894d-76b515526bb1 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:13.946231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001224-5ef3-4320-99b2-e57de6f102d2 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:13.946983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001224-5ef3-4320-99b2-e57de6f102d2 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:13.947953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001224-5ef3-4320-99b2-e57de6f102d2 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:13.948366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001224-5ef3-4320-99b2-e57de6f102d2 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:13.949171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49001224-5ef3-4320-99b2-e57de6f102d2 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:13.951047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49001224-5ef3-4320-99b2-e57de6f102d2 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:13.989000 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1696/3404] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Feb 19 20:58:13 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:13.992686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.004361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15912e81-1359-4564-b566-9d96af98f0d8 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:14.048472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0530b-fafe-410c-a486-bc85c1494a82 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:14.049170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0530b-fafe-410c-a486-bc85c1494a82 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:14.049444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0530b-fafe-410c-a486-bc85c1494a82 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:14.049724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0530b-fafe-410c-a486-bc85c1494a82 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:14.050466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0530b-fafe-410c-a486-bc85c1494a82 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:14.052104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0530b-fafe-410c-a486-bc85c1494a82 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:14.088032 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1709/3405] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Feb 19 20:58:13 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:14.088759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001224-5ef3-4320-99b2-e57de6f102d2 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.115839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001224-5ef3-4320-99b2-e57de6f102d2 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:14.132448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:14.133126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:14.133432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:14.133694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:14.134349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:14.135386 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:14.135386 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:14.135386 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:14.136277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:14.162614 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1697/3406] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Feb 19 20:58:14 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:58:14.164818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0530b-fafe-410c-a486-bc85c1494a82 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.180700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0530b-fafe-410c-a486-bc85c1494a82 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:14.192003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:14.193514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:14.194020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:14.194300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/267bb5caab1f4a89aa759a23e121990b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:14.195009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=267bb5caab1f4a89aa759a23e121990b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:14.197741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:14.198201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invalidating token cache because consumer 267bb5caab1f4a89aa759a23e121990b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:14.200063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.201209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.220833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '267bb5caab1f4a89aa759a23e121990b', 'request_id': 'req-40be5fcf-065f-4901-a82e-18bb45b25f7d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.284361 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1710/3407] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:58:14 2022] DELETE /identity/v3/OS-OAUTH1/consumers/267bb5caab1f4a89aa759a23e121990b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:14.288386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.296432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:14.314867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d118f1-62ec-452c-bd44-8165fcc9a512 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:14.321600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:14.322802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:14.323274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:14.323871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a70c5b097793410294d4fe82c4b18900` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:14.325941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a70c5b097793410294d4fe82c4b18900)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:14.339236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:14.339560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invalidating token cache because consumer a70c5b097793410294d4fe82c4b18900 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:14.339866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.340925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.367225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a70c5b097793410294d4fe82c4b18900', 'request_id': 'req-cba6cb05-d160-4f86-82e7-bddf07ed5189'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.405795 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1698/3408] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:58:14 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a70c5b097793410294d4fe82c4b18900 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:14.410758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.427782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5fcf-065f-4901-a82e-18bb45b25f7d tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:14.458374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbf8c2-3fd6-4fea-9242-e6c26c0276ec tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:14.459048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbf8c2-3fd6-4fea-9242-e6c26c0276ec tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:14.459342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbf8c2-3fd6-4fea-9242-e6c26c0276ec tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:14.459619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbf8c2-3fd6-4fea-9242-e6c26c0276ec tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:14.460404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbf8c2-3fd6-4fea-9242-e6c26c0276ec tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:14.462212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbf8c2-3fd6-4fea-9242-e6c26c0276ec tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:14.492782 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1711/3409] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Feb 19 20:58:14 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:14.496858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.498664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:14.547886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6cb05-d160-4f86-82e7-bddf07ed5189 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:14.566660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:14.567839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:14.568375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:14.569556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/99ddc78c1cc54cd991a6b5e8be8a3744` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:14.570466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=99ddc78c1cc54cd991a6b5e8be8a3744)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:14.575077 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:14.575077 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:14.575077 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:14.578931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:14.618063 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1699/3410] 10.222.0.30 () {60 vars in 1284 bytes} [Sat Feb 19 20:58:14 2022] PATCH /identity/v3/OS-OAUTH1/consumers/99ddc78c1cc54cd991a6b5e8be8a3744 => generated 220 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:58:14.622127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbf8c2-3fd6-4fea-9242-e6c26c0276ec tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.650414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbf8c2-3fd6-4fea-9242-e6c26c0276ec tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:14.668768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:14.671412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:14.674336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:14.676400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/99ddc78c1cc54cd991a6b5e8be8a3744` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:14.680232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=99ddc78c1cc54cd991a6b5e8be8a3744)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:14.686862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:14.704982 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1712/3411] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:58:14 2022] GET /identity/v3/OS-OAUTH1/consumers/99ddc78c1cc54cd991a6b5e8be8a3744 => generated 220 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:14.709406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.739045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24858593-0d72-47ac-9923-932216aa8689 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:14.764990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5461c5e91a654ee397282b247652ef7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b2a76c905d2442c80a694e36cee88e4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:14.768941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:14.768941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:14.768941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/99ddc78c1cc54cd991a6b5e8be8a3744` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:14.769613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=99ddc78c1cc54cd991a6b5e8be8a3744)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:14.780237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:14.782450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invalidating token cache because consumer 99ddc78c1cc54cd991a6b5e8be8a3744 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:14.784423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.786800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.834461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4bc90e82-1143-4657-a4d2-02a4f9977ac6 tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '99ddc78c1cc54cd991a6b5e8be8a3744', 'request_id': 'req-4bc90e82-1143-4657-a4d2-02a4f9977ac6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:14.869421 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1700/3412] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:58:14 2022] DELETE /identity/v3/OS-OAUTH1/consumers/99ddc78c1cc54cd991a6b5e8be8a3744 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:14.877243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:14.879335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:15.150353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449e937-7557-4b72-98be-6232a50f326f tempest-OAUTHConsumersV3Test-1904941179 tempest-OAUTHConsumersV3Test-1904941179-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:15.169550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:15.173973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:15.176889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:15.177751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] PATH_INFO: `/v3/users/34d5f2fafa544375a58321a899b1fda2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:15.179585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d5f2fafa544375a58321a899b1fda2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:15.183543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:15.287562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d5f2fafa544375a58321a899b1fda2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:15.312211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d5f2fafa544375a58321a899b1fda2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:15.331233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d5f2fafa544375a58321a899b1fda2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:15.333594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d5f2fafa544375a58321a899b1fda2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:15.336475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d5f2fafa544375a58321a899b1fda2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:15.392097 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1713/3413] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:14 2022] DELETE /identity/v3/users/34d5f2fafa544375a58321a899b1fda2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:15.394383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64724076-f9de-42b3-aa4b-f7c52bc4fe2a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:15.394684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64724076-f9de-42b3-aa4b-f7c52bc4fe2a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:15.394962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64724076-f9de-42b3-aa4b-f7c52bc4fe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:15.459991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-64724076-f9de-42b3-aa4b-f7c52bc4fe2a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:15.462309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-64724076-f9de-42b3-aa4b-f7c52bc4fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:15.716805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1701/3414] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:15.750547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:15.753326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:15.869856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417cfa4-ce34-4fc1-942d-a58bbe58c8d8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:15.876573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:15.877956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:15.878160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:15.878436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:15.892894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:15.894946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:15.907554 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1714/3415] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:17.787114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64724076-f9de-42b3-aa4b-f7c52bc4fe2a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:17.793282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-64724076-f9de-42b3-aa4b-f7c52bc4fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:17.818495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64724076-f9de-42b3-aa4b-f7c52bc4fe2a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:17.830496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:17.831513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:17.831754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:17.832207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] PATH_INFO: `/v3/users/33f01d50bf4e41ff95c09af549cd37e9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:17.833732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f01d50bf4e41ff95c09af549cd37e9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:17.835685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:17.916868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:17.918615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:17.929282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f01d50bf4e41ff95c09af549cd37e9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:17.930031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f01d50bf4e41ff95c09af549cd37e9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:17.930764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f01d50bf4e41ff95c09af549cd37e9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:17.938338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75345-0112-4892-ac96-8ccba1c92507 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:17.945178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:17.947494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:17.947784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:17.948068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] PATH_INFO: `/v3/projects/9e29ccf0af6a4566b2b5895350a3ae38` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:17.949259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f01d50bf4e41ff95c09af549cd37e9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:17.949419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e29ccf0af6a4566b2b5895350a3ae38)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:17.951278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:17.978942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f01d50bf4e41ff95c09af549cd37e9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.019465 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1702/3416] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:17 2022] DELETE /identity/v3/users/33f01d50bf4e41ff95c09af549cd37e9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:18.048814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e29ccf0af6a4566b2b5895350a3ae38', 'request_id': 'req-b25796c9-5337-4950-a2c8-50ab187f61ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.076189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e29ccf0af6a4566b2b5895350a3ae38', 'request_id': 'req-b25796c9-5337-4950-a2c8-50ab187f61ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.118231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e29ccf0af6a4566b2b5895350a3ae38', 'request_id': 'req-b25796c9-5337-4950-a2c8-50ab187f61ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.134204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] The token cache is being invalidate because project 9e29ccf0af6a4566b2b5895350a3ae38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:18.134861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.137342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.151377 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1715/3417] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:17 2022] DELETE /identity/v3/projects/9e29ccf0af6a4566b2b5895350a3ae38 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:18.152429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:18.153963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:18.324756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98315395-1f4b-44c0-bcaf-b8e51edd9d5f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:18.447753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:18.451512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:18.452596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:18.453623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] PATH_INFO: `/v3/users/5461c5e91a654ee397282b247652ef7a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:18.456267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5461c5e91a654ee397282b247652ef7a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:18.459064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:18.537824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5461c5e91a654ee397282b247652ef7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.538584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5461c5e91a654ee397282b247652ef7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.539318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5461c5e91a654ee397282b247652ef7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.554207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5461c5e91a654ee397282b247652ef7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.569419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63229da8-6d4f-4255-8d42-f7a77311932c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5461c5e91a654ee397282b247652ef7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:18.600845 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1703/3418] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:18 2022] DELETE /identity/v3/users/5461c5e91a654ee397282b247652ef7a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:18.857473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:18.860621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:18.886823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25796c9-5337-4950-a2c8-50ab187f61ec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:18.967173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:18.968998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:18.969457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:18.969903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] PATH_INFO: `/v3/projects/5c496adb59f3467687458650e28da232` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:18.971368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c496adb59f3467687458650e28da232)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:18.973815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:19.032581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c496adb59f3467687458650e28da232', 'request_id': 'req-90ebe463-4936-4c19-9e76-3efd0ef32683'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:19.041148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c496adb59f3467687458650e28da232', 'request_id': 'req-90ebe463-4936-4c19-9e76-3efd0ef32683'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:19.051245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c496adb59f3467687458650e28da232', 'request_id': 'req-90ebe463-4936-4c19-9e76-3efd0ef32683'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:19.066681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] The token cache is being invalidate because project 5c496adb59f3467687458650e28da232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:19.067282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:19.068526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90ebe463-4936-4c19-9e76-3efd0ef32683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:19.073961 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1716/3419] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:18 2022] DELETE /identity/v3/projects/5c496adb59f3467687458650e28da232 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:19.076506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dbe92-3e29-47b2-ad59-dcc0556bc261 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.077305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dbe92-3e29-47b2-ad59-dcc0556bc261 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.078248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dbe92-3e29-47b2-ad59-dcc0556bc261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.097259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b66dbe92-3e29-47b2-ad59-dcc0556bc261 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:19.098485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b66dbe92-3e29-47b2-ad59-dcc0556bc261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:19.163558 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1704/3420] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:19.172939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5571b5-ce6c-45f5-a1e0-b5a6baff8c6d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.173507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5571b5-ce6c-45f5-a1e0-b5a6baff8c6d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.173824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5571b5-ce6c-45f5-a1e0-b5a6baff8c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.195162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cb5571b5-ce6c-45f5-a1e0-b5a6baff8c6d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:19.196807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cb5571b5-ce6c-45f5-a1e0-b5a6baff8c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:19.206461 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1717/3421] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:19.211158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dbe92-3e29-47b2-ad59-dcc0556bc261 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:19.222294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dbe92-3e29-47b2-ad59-dcc0556bc261 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:19.228682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:19.229453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.229739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.230010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.230890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:19.231197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:19.232856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:19.246078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1705/3422] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:19.250654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5571b5-ce6c-45f5-a1e0-b5a6baff8c6d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:19.260100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5571b5-ce6c-45f5-a1e0-b5a6baff8c6d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:19.265453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1e688-7cbe-4dd3-8df4-889be8dac664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:19.267266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e688-7cbe-4dd3-8df4-889be8dac664 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.267563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e688-7cbe-4dd3-8df4-889be8dac664 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.267836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1e688-7cbe-4dd3-8df4-889be8dac664 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.268704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1e688-7cbe-4dd3-8df4-889be8dac664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:19.270654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1e688-7cbe-4dd3-8df4-889be8dac664 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:19.305560 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1718/3423] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:19 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:19.310395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:19.328237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fe253-568d-43aa-abd3-cffcedaa5268 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:19.411189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa314c47-1920-483f-a87e-404b29bdbc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:19.412319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314c47-1920-483f-a87e-404b29bdbc5f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.412638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314c47-1920-483f-a87e-404b29bdbc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.412920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314c47-1920-483f-a87e-404b29bdbc5f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.414893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa314c47-1920-483f-a87e-404b29bdbc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:19.415985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa314c47-1920-483f-a87e-404b29bdbc5f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:19.445241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1706/3424] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:19 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:19.449743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1e688-7cbe-4dd3-8df4-889be8dac664 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:19.479697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1e688-7cbe-4dd3-8df4-889be8dac664 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:19.485811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95ff1-6523-4a43-b449-9c236d35dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:19.486622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95ff1-6523-4a43-b449-9c236d35dccf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.486911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95ff1-6523-4a43-b449-9c236d35dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.487244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95ff1-6523-4a43-b449-9c236d35dccf admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.487983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a95ff1-6523-4a43-b449-9c236d35dccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:19.490227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a95ff1-6523-4a43-b449-9c236d35dccf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:19.511049 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1719/3425] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:19.512143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa314c47-1920-483f-a87e-404b29bdbc5f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:19.524973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa314c47-1920-483f-a87e-404b29bdbc5f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:19.533415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14971dcc-5707-4609-999f-a497dd14e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:19.534332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14971dcc-5707-4609-999f-a497dd14e223 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.534726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14971dcc-5707-4609-999f-a497dd14e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.535111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14971dcc-5707-4609-999f-a497dd14e223 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.536003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14971dcc-5707-4609-999f-a497dd14e223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:19.537985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14971dcc-5707-4609-999f-a497dd14e223 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:19.563842 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1707/3426] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:58:19.565205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95ff1-6523-4a43-b449-9c236d35dccf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:19.590721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95ff1-6523-4a43-b449-9c236d35dccf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:19.598150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:19.599188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.600189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.600189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] PATH_INFO: `/v3/projects/5b11084a5a46488cbb721afa4256a6bd/users/0f88ec14e66c4dafa9aeb5595692a225/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.628517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b11084a5a46488cbb721afa4256a6bd, user_id=0f88ec14e66c4dafa9aeb5595692a225, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:19.631975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:19.670644 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1720/3427] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:19 2022] PUT /identity/v3/projects/5b11084a5a46488cbb721afa4256a6bd/users/0f88ec14e66c4dafa9aeb5595692a225/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:19.676319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e848-63c7-4f3f-823d-f0d875f2de5f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.676986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e848-63c7-4f3f-823d-f0d875f2de5f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.677447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e848-63c7-4f3f-823d-f0d875f2de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.709143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eac9e848-63c7-4f3f-823d-f0d875f2de5f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:19.710569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eac9e848-63c7-4f3f-823d-f0d875f2de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:19.819326 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1708/3428] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:19.828953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:19.831227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:19.892885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e86d3a-8b02-43d4-ac58-4f33de19ccfb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:19.897657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:19.898676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:19.898676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:19.898892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:19.908815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:19.910612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:19.922334 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1721/3429] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:19.989323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9e848-63c7-4f3f-823d-f0d875f2de5f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:19.991191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eac9e848-63c7-4f3f-823d-f0d875f2de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:20.130748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9e848-63c7-4f3f-823d-f0d875f2de5f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:20.152501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a672472-4506-4d0e-9ac1-a88829df924d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:20.153467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a672472-4506-4d0e-9ac1-a88829df924d service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:20.154385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a672472-4506-4d0e-9ac1-a88829df924d service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:20.154831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a672472-4506-4d0e-9ac1-a88829df924d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:20.157851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9a672472-4506-4d0e-9ac1-a88829df924d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:20.234530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a672472-4506-4d0e-9ac1-a88829df924d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:20.236161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a672472-4506-4d0e-9ac1-a88829df924d service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:20.249469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1709/3430] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:20.253187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:20.256034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:20.274290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefc174-d9b0-4023-9fc7-39a92d74a984 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:20.280419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:20.282339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:20.282812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:20.283249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] PATH_INFO: `/v3/projects/0b2a76c905d2442c80a694e36cee88e4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:20.284686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2a76c905d2442c80a694e36cee88e4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:20.287626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:20.415817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2a76c905d2442c80a694e36cee88e4', 'request_id': 'req-def1352c-857f-447f-8d0e-12ee8e101de2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:20.428778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2a76c905d2442c80a694e36cee88e4', 'request_id': 'req-def1352c-857f-447f-8d0e-12ee8e101de2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:20.442079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2a76c905d2442c80a694e36cee88e4', 'request_id': 'req-def1352c-857f-447f-8d0e-12ee8e101de2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:20.488125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] The token cache is being invalidate because project 0b2a76c905d2442c80a694e36cee88e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:20.488125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:20.508392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-def1352c-857f-447f-8d0e-12ee8e101de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:20.518342 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1722/3431] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:20 2022] DELETE /identity/v3/projects/0b2a76c905d2442c80a694e36cee88e4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:20.523412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4923a-67cd-4708-983d-b1a663f0caf2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:20.523412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4923a-67cd-4708-983d-b1a663f0caf2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:20.523662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4923a-67cd-4708-983d-b1a663f0caf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:20.553237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-48e4923a-67cd-4708-983d-b1a663f0caf2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:20.555515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-48e4923a-67cd-4708-983d-b1a663f0caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:20.665622 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1710/3432] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:20.673758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f82e-3fd3-42d1-b423-ba5e5fc3146d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:20.674045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f82e-3fd3-42d1-b423-ba5e5fc3146d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:20.674496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f82e-3fd3-42d1-b423-ba5e5fc3146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:20.697855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bba2f82e-3fd3-42d1-b423-ba5e5fc3146d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:20.699344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bba2f82e-3fd3-42d1-b423-ba5e5fc3146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:20.709186 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1723/3433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:20.713407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4923a-67cd-4708-983d-b1a663f0caf2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:20.723630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4923a-67cd-4708-983d-b1a663f0caf2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:20.735374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:20.736083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:20.736415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:20.736696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:20.737613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:20.737880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:20.739485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:20.757371 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1711/3434] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:20.759873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f82e-3fd3-42d1-b423-ba5e5fc3146d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:20.783985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f82e-3fd3-42d1-b423-ba5e5fc3146d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:20.795352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe41ec-8891-4290-8e9d-f1c8aa32596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:20.795917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe41ec-8891-4290-8e9d-f1c8aa32596b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:20.796212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe41ec-8891-4290-8e9d-f1c8aa32596b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:20.796571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe41ec-8891-4290-8e9d-f1c8aa32596b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:20.797467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe41ec-8891-4290-8e9d-f1c8aa32596b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:20.799633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe41ec-8891-4290-8e9d-f1c8aa32596b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:20.848867 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1724/3435] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:20 2022] POST /identity/v3/projects => generated 369 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:20.853745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:20.866267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3ba1a-f264-406f-8522-4b2e5a438c76 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:20.950949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4304-74cc-4e54-96d3-c3f3f1ad61da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:20.951318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4304-74cc-4e54-96d3-c3f3f1ad61da admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:20.952362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4304-74cc-4e54-96d3-c3f3f1ad61da admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:20.952661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4304-74cc-4e54-96d3-c3f3f1ad61da admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:20.954974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4304-74cc-4e54-96d3-c3f3f1ad61da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:20.964609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4304-74cc-4e54-96d3-c3f3f1ad61da admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:21.025171 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1712/3436] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:20 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:21.029134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe41ec-8891-4290-8e9d-f1c8aa32596b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:21.045646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe41ec-8891-4290-8e9d-f1c8aa32596b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:21.058530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec533-4237-41aa-a6ac-ffdff1d8a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:21.059227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec533-4237-41aa-a6ac-ffdff1d8a605 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:21.059512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec533-4237-41aa-a6ac-ffdff1d8a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:21.059792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec533-4237-41aa-a6ac-ffdff1d8a605 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:21.060557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec533-4237-41aa-a6ac-ffdff1d8a605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:21.065065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec533-4237-41aa-a6ac-ffdff1d8a605 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:21.103360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1725/3437] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:21.107148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4304-74cc-4e54-96d3-c3f3f1ad61da admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:21.131081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4304-74cc-4e54-96d3-c3f3f1ad61da admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:21.140050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c2d2d-c01f-47e0-844f-edf16e61d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:21.141679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2d2d-c01f-47e0-844f-edf16e61d19a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:21.143142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2d2d-c01f-47e0-844f-edf16e61d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:21.143703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2d2d-c01f-47e0-844f-edf16e61d19a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:21.144882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c2d2d-c01f-47e0-844f-edf16e61d19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:21.147177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c2d2d-c01f-47e0-844f-edf16e61d19a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:21.161278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1713/3438] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:21.165862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec533-4237-41aa-a6ac-ffdff1d8a605 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:21.180718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec533-4237-41aa-a6ac-ffdff1d8a605 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:21.190115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25803-2d6a-45fd-9751-abb1be4f8c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:21.192210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25803-2d6a-45fd-9751-abb1be4f8c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:21.192912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25803-2d6a-45fd-9751-abb1be4f8c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:21.193447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25803-2d6a-45fd-9751-abb1be4f8c82 admin admin] PATH_INFO: `/v3/projects/1c8343da444e4075813e216ad73ff443/users/3d02daf96872454e84a3a2177c711185/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:21.212929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f25803-2d6a-45fd-9751-abb1be4f8c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8343da444e4075813e216ad73ff443, user_id=3d02daf96872454e84a3a2177c711185, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:21.223790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f25803-2d6a-45fd-9751-abb1be4f8c82 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:21.246842 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1726/3439] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:21 2022] PUT /identity/v3/projects/1c8343da444e4075813e216ad73ff443/users/3d02daf96872454e84a3a2177c711185/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:21.258305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c594af-04c3-40f4-9685-a3b9700b089d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:21.258733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c594af-04c3-40f4-9685-a3b9700b089d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:21.259135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c594af-04c3-40f4-9685-a3b9700b089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:21.326724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d2c594af-04c3-40f4-9685-a3b9700b089d None None] MFA Rules not processed for user `3d02daf96872454e84a3a2177c711185`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:21.329472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d2c594af-04c3-40f4-9685-a3b9700b089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:21.446122 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1714/3440] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:21.450468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25803-2d6a-45fd-9751-abb1be4f8c82 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:21.563155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25803-2d6a-45fd-9751-abb1be4f8c82 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:21.570077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee974-808a-414e-bc85-d73cfec1033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:21.571195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee974-808a-414e-bc85-d73cfec1033c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:21.571677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee974-808a-414e-bc85-d73cfec1033c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:21.572055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee974-808a-414e-bc85-d73cfec1033c admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:21.572920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ee974-808a-414e-bc85-d73cfec1033c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:21.575051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ee974-808a-414e-bc85-d73cfec1033c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:21.610751 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1727/3441] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:21 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:21.614996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c594af-04c3-40f4-9685-a3b9700b089d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:21.631695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c594af-04c3-40f4-9685-a3b9700b089d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:21.799022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516e1d4-7039-497f-b34d-68ea61bffc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:21.799723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e1d4-7039-497f-b34d-68ea61bffc09 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:21.800053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e1d4-7039-497f-b34d-68ea61bffc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:21.800823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e1d4-7039-497f-b34d-68ea61bffc09 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:21.801313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516e1d4-7039-497f-b34d-68ea61bffc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:21.803710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516e1d4-7039-497f-b34d-68ea61bffc09 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:21.865853 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1715/3442] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:21 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:21.866056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee974-808a-414e-bc85-d73cfec1033c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:21.895138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee974-808a-414e-bc85-d73cfec1033c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:21.904145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71b153-a8b6-4928-9c0c-4d340b4c6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:21.907678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b153-a8b6-4928-9c0c-4d340b4c6bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:21.908099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b153-a8b6-4928-9c0c-4d340b4c6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:21.908425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b153-a8b6-4928-9c0c-4d340b4c6bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:21.909766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71b153-a8b6-4928-9c0c-4d340b4c6bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:21.914018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71b153-a8b6-4928-9c0c-4d340b4c6bb4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:21.941307 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1728/3443] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:21.945324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516e1d4-7039-497f-b34d-68ea61bffc09 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:21.959427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516e1d4-7039-497f-b34d-68ea61bffc09 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:21.971603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe32e-ff47-47a8-9dd7-ac83071a423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:21.973353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe32e-ff47-47a8-9dd7-ac83071a423c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:21.973714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe32e-ff47-47a8-9dd7-ac83071a423c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:21.974667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe32e-ff47-47a8-9dd7-ac83071a423c admin admin] PATH_INFO: `/v3/projects/02f664f171ec456695c643fee0a40fe5/users/cce24bf9f2b94d088f725815266b704b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:22.000495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe32e-ff47-47a8-9dd7-ac83071a423c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f664f171ec456695c643fee0a40fe5, user_id=cce24bf9f2b94d088f725815266b704b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:22.003382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe32e-ff47-47a8-9dd7-ac83071a423c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:22.032510 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1716/3444] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:21 2022] PUT /identity/v3/projects/02f664f171ec456695c643fee0a40fe5/users/cce24bf9f2b94d088f725815266b704b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:22.038443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71b153-a8b6-4928-9c0c-4d340b4c6bb4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:22.054614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71b153-a8b6-4928-9c0c-4d340b4c6bb4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:22.159172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2699272-0d43-467a-bf1d-27f9c98e6e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:22.159172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2699272-0d43-467a-bf1d-27f9c98e6e50 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:22.159172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2699272-0d43-467a-bf1d-27f9c98e6e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:22.159172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2699272-0d43-467a-bf1d-27f9c98e6e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:22.159787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2699272-0d43-467a-bf1d-27f9c98e6e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:22.162147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2699272-0d43-467a-bf1d-27f9c98e6e50 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:22.178262 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1729/3445] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:22.184729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe32e-ff47-47a8-9dd7-ac83071a423c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:22.198778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe32e-ff47-47a8-9dd7-ac83071a423c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:22.206642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774903e-196e-47a3-b7fd-a366aff5ffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:22.208393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774903e-196e-47a3-b7fd-a366aff5ffff admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:22.210505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774903e-196e-47a3-b7fd-a366aff5ffff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:22.211055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774903e-196e-47a3-b7fd-a366aff5ffff admin admin] PATH_INFO: `/v3/projects/02f664f171ec456695c643fee0a40fe5/users/cce24bf9f2b94d088f725815266b704b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:22.214323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774903e-196e-47a3-b7fd-a366aff5ffff admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f664f171ec456695c643fee0a40fe5, user_id=cce24bf9f2b94d088f725815266b704b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:22.218076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774903e-196e-47a3-b7fd-a366aff5ffff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:22.243607 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1717/3446] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:22 2022] PUT /identity/v3/projects/02f664f171ec456695c643fee0a40fe5/users/cce24bf9f2b94d088f725815266b704b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:22.257904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0b47-cf0c-4b58-a9bb-6c93270d989d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:22.258453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0b47-cf0c-4b58-a9bb-6c93270d989d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:22.258997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0b47-cf0c-4b58-a9bb-6c93270d989d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:22.333208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0f7c0b47-cf0c-4b58-a9bb-6c93270d989d None None] MFA Rules not processed for user `cce24bf9f2b94d088f725815266b704b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:22.340041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f7c0b47-cf0c-4b58-a9bb-6c93270d989d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:22.485208 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1730/3447] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:22.485851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774903e-196e-47a3-b7fd-a366aff5ffff admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:22.511090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774903e-196e-47a3-b7fd-a366aff5ffff admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:22.527844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae639b-1731-4af3-9cf5-fe426419685f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:22.528711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae639b-1731-4af3-9cf5-fe426419685f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:22.529081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae639b-1731-4af3-9cf5-fe426419685f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:22.529426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae639b-1731-4af3-9cf5-fe426419685f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:22.530933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae639b-1731-4af3-9cf5-fe426419685f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:22.535500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae639b-1731-4af3-9cf5-fe426419685f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:22.618726 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1718/3448] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:22 2022] POST /identity/v3/projects => generated 358 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:22.620711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c0b47-cf0c-4b58-a9bb-6c93270d989d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:22.633685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c0b47-cf0c-4b58-a9bb-6c93270d989d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:22.829627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:22.832249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:22.832945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:22.833951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:22.835468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:22.842186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:22.844080 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.common [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 19 20:58:22.900303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1731/3449] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:22 2022] POST /identity/v3/users => generated 416 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:22.909547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae639b-1731-4af3-9cf5-fe426419685f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:22.938059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae639b-1731-4af3-9cf5-fe426419685f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:22.947766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:22.949310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:22.949580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:22.949947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/users/d265daad30c044ba8597632d3af76fec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:22.976123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_user(user_id=d265daad30c044ba8597632d3af76fec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:22.979715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:22.984533 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1719/3450] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 20:58:22 2022] GET /identity/v3/users/d265daad30c044ba8597632d3af76fec => generated 416 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:22.985969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:23.003020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613094a-3f34-43d7-9520-55358dc34f36 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:23.018349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:23.022236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:23.022750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:23.023017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/users/d265daad30c044ba8597632d3af76fec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:23.029957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d265daad30c044ba8597632d3af76fec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:23.036377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:23.118176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd265daad30c044ba8597632d3af76fec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.136614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd265daad30c044ba8597632d3af76fec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.148792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd265daad30c044ba8597632d3af76fec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.149855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd265daad30c044ba8597632d3af76fec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.152570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd265daad30c044ba8597632d3af76fec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.173002 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1732/3451] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:22 2022] DELETE /identity/v3/users/d265daad30c044ba8597632d3af76fec => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:23.176749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:23.179934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:23.199623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294cfef-9017-470e-a2de-d6bd95cb3dd2 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:23.335665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:23.337708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:23.347925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:23.348292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/b2e11df0671d44a3b63e26e9de0e0f40` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:23.355326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b2e11df0671d44a3b63e26e9de0e0f40)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:23.365339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:23.646199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e11df0671d44a3b63e26e9de0e0f40', 'request_id': 'req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.677417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e11df0671d44a3b63e26e9de0e0f40', 'request_id': 'req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.703902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e11df0671d44a3b63e26e9de0e0f40', 'request_id': 'req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.739784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project b2e11df0671d44a3b63e26e9de0e0f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:23.740135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.740970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:23.743674 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1720/3452] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:23 2022] DELETE /identity/v3/projects/b2e11df0671d44a3b63e26e9de0e0f40 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:23.748896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:23.768187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0500883-c9cf-4ef9-abac-a5b2f80aee52 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:23.929808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dafe1-9b14-4f4f-b30d-34a6beb5f53f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:23.930085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dafe1-9b14-4f4f-b30d-34a6beb5f53f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:23.930378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dafe1-9b14-4f4f-b30d-34a6beb5f53f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:23.930661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dafe1-9b14-4f4f-b30d-34a6beb5f53f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:23.931393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dafe1-9b14-4f4f-b30d-34a6beb5f53f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:23.944291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dafe1-9b14-4f4f-b30d-34a6beb5f53f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:23.973489 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1733/3453] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:23 2022] POST /identity/v3/projects => generated 349 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:23.977342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:23.979012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:24.001237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81bac2-fe29-4d4a-8ac0-5ae0251b5335 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:24.119337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:24.120305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:24.121703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:24.121703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:24.122399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:24.122844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:24.125186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:24.172289 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1721/3454] 10.222.0.30 () {58 vars in 1159 bytes} [Sat Feb 19 20:58:23 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:24.175970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dafe1-9b14-4f4f-b30d-34a6beb5f53f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:24.188020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dafe1-9b14-4f4f-b30d-34a6beb5f53f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:24.208491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:24.209181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:24.209469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:24.209748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:24.210456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:24.212291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:24.233699 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1734/3455] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 20:58:24 2022] GET /identity/v3/domains => generated 830 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:24.238015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:24.249490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d36a5d-ff81-4696-b4c5-a10d0d6245ac tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:24.255970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:24.257430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:24.258130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:24.258993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/a21deade5ff54a2b8212f72b0dc48acd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:24.260746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:update_project(project_id=a21deade5ff54a2b8212f72b0dc48acd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:24.262797 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:24.262797 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:24.262797 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:24.264442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:24.279126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.280233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.330470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.341755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.346638 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1722/3456] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Feb 19 20:58:24 2022] PATCH /identity/v3/projects/a21deade5ff54a2b8212f72b0dc48acd => generated 363 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:24.350850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:24.353171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:24.372162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af00685-fcae-4f9e-bc36-a5ec384c4839 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:24.498533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:24.498533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:24.498533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:24.498881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/a21deade5ff54a2b8212f72b0dc48acd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:24.543028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a21deade5ff54a2b8212f72b0dc48acd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:24.544774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:24.611878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.642151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.818471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd', 'request_id': 'req-8c371d7c-e059-4f57-bba3-3fee541e2af3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.844638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd', 'request_id': 'req-8c371d7c-e059-4f57-bba3-3fee541e2af3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.878871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd', 'request_id': 'req-8c371d7c-e059-4f57-bba3-3fee541e2af3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.947652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project a21deade5ff54a2b8212f72b0dc48acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:24.950474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:24.954524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.001899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd', 'request_id': 'req-8c371d7c-e059-4f57-bba3-3fee541e2af3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.018290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd', 'request_id': 'req-8c371d7c-e059-4f57-bba3-3fee541e2af3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.021240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a21deade5ff54a2b8212f72b0dc48acd', 'request_id': 'req-8c371d7c-e059-4f57-bba3-3fee541e2af3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.042527 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1735/3457] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:24 2022] DELETE /identity/v3/projects/a21deade5ff54a2b8212f72b0dc48acd => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:25.048407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:25.063655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fe354-394b-42e5-b5bf-66a87c08ae30 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:25.282597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7bd97-7052-4883-a711-1d629b5201bc tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:25.284073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7bd97-7052-4883-a711-1d629b5201bc tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:25.284682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7bd97-7052-4883-a711-1d629b5201bc tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:25.285616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7bd97-7052-4883-a711-1d629b5201bc tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:25.287263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7bd97-7052-4883-a711-1d629b5201bc tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:25.290040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7bd97-7052-4883-a711-1d629b5201bc tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:25.387086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:25.390584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:25.402632 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1723/3458] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:25 2022] POST /identity/v3/projects => generated 360 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:25.424577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c371d7c-e059-4f57-bba3-3fee541e2af3 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:25.681074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:25.681969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:25.682253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:25.682528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/fad0937a35e6429891c8c71ffc82b353` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:25.685435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_project(project_id=fad0937a35e6429891c8c71ffc82b353)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:25.690478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:25.705349 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1736/3459] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:25 2022] GET /identity/v3/projects/fad0937a35e6429891c8c71ffc82b353 => generated 360 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:25.706811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7bd97-7052-4883-a711-1d629b5201bc tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:25.725249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7bd97-7052-4883-a711-1d629b5201bc tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:25.740505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:25.743360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:25.743915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:25.746833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/fad0937a35e6429891c8c71ffc82b353` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:25.750700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fad0937a35e6429891c8c71ffc82b353)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:25.758473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:25.887511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad0937a35e6429891c8c71ffc82b353', 'request_id': 'req-f0acfc55-26ea-4291-87c5-892bd8442f53'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.905789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad0937a35e6429891c8c71ffc82b353', 'request_id': 'req-f0acfc55-26ea-4291-87c5-892bd8442f53'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.931223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad0937a35e6429891c8c71ffc82b353', 'request_id': 'req-f0acfc55-26ea-4291-87c5-892bd8442f53'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.960521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project fad0937a35e6429891c8c71ffc82b353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:25.961100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.963269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:25.972829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:25.973796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1724/3460] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:25 2022] DELETE /identity/v3/projects/fad0937a35e6429891c8c71ffc82b353 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:25.975621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:26.000932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a461-8fb1-43c0-9c87-be7c9089b793 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:26.142585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dfa2f-43c6-462d-a7af-cde1b225ab63 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:26.143586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dfa2f-43c6-462d-a7af-cde1b225ab63 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:26.144246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dfa2f-43c6-462d-a7af-cde1b225ab63 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:26.145350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dfa2f-43c6-462d-a7af-cde1b225ab63 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:26.146451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dfa2f-43c6-462d-a7af-cde1b225ab63 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:26.150106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dfa2f-43c6-462d-a7af-cde1b225ab63 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:26.214071 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1737/3461] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:25 2022] POST /identity/v3/projects => generated 361 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:26.220075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:26.231525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acfc55-26ea-4291-87c5-892bd8442f53 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:26.336322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:26.338517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:26.339008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:26.339491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/065406e08d1847aaacfa08962cf19f09` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:26.341294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_project(project_id=065406e08d1847aaacfa08962cf19f09)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:26.345638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:26.347844 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1725/3462] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:26 2022] GET /identity/v3/projects/065406e08d1847aaacfa08962cf19f09 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:26.352723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dfa2f-43c6-462d-a7af-cde1b225ab63 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:26.368368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dfa2f-43c6-462d-a7af-cde1b225ab63 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:26.374804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:26.375761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:26.376050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:26.376392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/065406e08d1847aaacfa08962cf19f09` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:26.377839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=065406e08d1847aaacfa08962cf19f09)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:26.380369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:26.461832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065406e08d1847aaacfa08962cf19f09', 'request_id': 'req-77e2ac36-db81-4203-ac43-e41151365263'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:26.487685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065406e08d1847aaacfa08962cf19f09', 'request_id': 'req-77e2ac36-db81-4203-ac43-e41151365263'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:26.503361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065406e08d1847aaacfa08962cf19f09', 'request_id': 'req-77e2ac36-db81-4203-ac43-e41151365263'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:26.522527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project 065406e08d1847aaacfa08962cf19f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:26.524732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:26.526462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:26.529874 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1738/3463] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:26 2022] DELETE /identity/v3/projects/065406e08d1847aaacfa08962cf19f09 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:26.535733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:26.538185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:26.562020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c358ebc-b3cb-41bc-ab66-93b9d7633e3b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:26.637751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b32f0-9171-4b70-b86a-2a81cb619017 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:26.639532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b32f0-9171-4b70-b86a-2a81cb619017 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:26.640796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b32f0-9171-4b70-b86a-2a81cb619017 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:26.641617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b32f0-9171-4b70-b86a-2a81cb619017 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:26.642823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b32f0-9171-4b70-b86a-2a81cb619017 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:26.644910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b32f0-9171-4b70-b86a-2a81cb619017 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:26.730140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:26.749254 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1726/3464] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 20:58:26 2022] POST /identity/v3/projects => generated 347 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:26.752202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2ac36-db81-4203-ac43-e41151365263 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:26.899003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd9d46-204b-4a0d-9ada-98e7448db1fe tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:26.900650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd9d46-204b-4a0d-9ada-98e7448db1fe tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:26.900650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd9d46-204b-4a0d-9ada-98e7448db1fe tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:26.900938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd9d46-204b-4a0d-9ada-98e7448db1fe tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/6d315bf2ac1d4c399b4432648d8c2f53` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:26.911815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd9d46-204b-4a0d-9ada-98e7448db1fe tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d315bf2ac1d4c399b4432648d8c2f53)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:26.917451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd9d46-204b-4a0d-9ada-98e7448db1fe tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:26.928400 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1739/3465] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:26 2022] GET /identity/v3/projects/6d315bf2ac1d4c399b4432648d8c2f53 => generated 347 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:26.931267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b32f0-9171-4b70-b86a-2a81cb619017 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:26.952662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b32f0-9171-4b70-b86a-2a81cb619017 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:26.964169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:26.965255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:26.965544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:26.965819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/6d315bf2ac1d4c399b4432648d8c2f53` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:26.979114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d315bf2ac1d4c399b4432648d8c2f53)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:26.988477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:27.013250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a255f-63d1-44f4-b189-0772a282b11c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:27.014029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a255f-63d1-44f4-b189-0772a282b11c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:27.014029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a255f-63d1-44f4-b189-0772a282b11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:27.058310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f29a255f-63d1-44f4-b189-0772a282b11c None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:27.060537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f29a255f-63d1-44f4-b189-0772a282b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:27.077051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d315bf2ac1d4c399b4432648d8c2f53', 'request_id': 'req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:27.082760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d315bf2ac1d4c399b4432648d8c2f53', 'request_id': 'req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:27.096220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d315bf2ac1d4c399b4432648d8c2f53', 'request_id': 'req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:27.148700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project 6d315bf2ac1d4c399b4432648d8c2f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:27.149197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:27.150388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:27.161193 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1727/3466] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:26 2022] DELETE /identity/v3/projects/6d315bf2ac1d4c399b4432648d8c2f53 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:27.165145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:27.173504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:27.249370 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1740/3467] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:27.271313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a255f-63d1-44f4-b189-0772a282b11c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:27.273839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f29a255f-63d1-44f4-b189-0772a282b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:27.319733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c18e5-dbf0-40b7-8c21-ff38d09f0ab7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:27.329092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:27.329849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:27.330663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:27.330825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:27.331506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:27.332644 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:27.332644 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:27.332644 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:27.333911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:27.370538 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1728/3468] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 20:58:27 2022] POST /identity/v3/domains => generated 275 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:27.375445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:27.489749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a255f-63d1-44f4-b189-0772a282b11c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:27.524674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7050eb1-4cb8-46f6-96d9-d958d06b66aa tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:27.531703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbff365-541b-434c-9867-2df7da88634f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:27.532432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbff365-541b-434c-9867-2df7da88634f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:27.532798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbff365-541b-434c-9867-2df7da88634f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:27.533854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbff365-541b-434c-9867-2df7da88634f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:27.534584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbff365-541b-434c-9867-2df7da88634f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:27.538754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbff365-541b-434c-9867-2df7da88634f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:27.629738 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1729/3469] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:27 2022] POST /identity/v3/projects => generated 403 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:27.634563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbff365-541b-434c-9867-2df7da88634f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:27.655635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a9721-2854-42f1-adcb-9e381466942b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:27.658091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9721-2854-42f1-adcb-9e381466942b service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:27.658399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9721-2854-42f1-adcb-9e381466942b service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:27.659359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9721-2854-42f1-adcb-9e381466942b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:27.811677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbff365-541b-434c-9867-2df7da88634f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:27.820569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7155b-d94e-4e51-9c2a-853edc2bc40f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:27.823419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7155b-d94e-4e51-9c2a-853edc2bc40f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:27.824008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7155b-d94e-4e51-9c2a-853edc2bc40f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:27.824598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7155b-d94e-4e51-9c2a-853edc2bc40f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/982625dc1b2c417eb07e6d8b87c91e7c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:27.826636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7155b-d94e-4e51-9c2a-853edc2bc40f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_project(project_id=982625dc1b2c417eb07e6d8b87c91e7c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:27.830510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7155b-d94e-4e51-9c2a-853edc2bc40f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:27.841680 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1730/3470] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:27 2022] GET /identity/v3/projects/982625dc1b2c417eb07e6d8b87c91e7c => generated 403 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:27.841943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9721-2854-42f1-adcb-9e381466942b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:27.844989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7155b-d94e-4e51-9c2a-853edc2bc40f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:27.846179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9721-2854-42f1-adcb-9e381466942b service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:27.865297 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1741/3471] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:27.881464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7155b-d94e-4e51-9c2a-853edc2bc40f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:27.889423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:27.890942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:27.892358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:27.892358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/982625dc1b2c417eb07e6d8b87c91e7c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:27.892867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=982625dc1b2c417eb07e6d8b87c91e7c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:27.898554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:28.043799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982625dc1b2c417eb07e6d8b87c91e7c', 'request_id': 'req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.061305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982625dc1b2c417eb07e6d8b87c91e7c', 'request_id': 'req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.073618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982625dc1b2c417eb07e6d8b87c91e7c', 'request_id': 'req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.102349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project 982625dc1b2c417eb07e6d8b87c91e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:28.102629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.103357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17ee3bdf-401a-4b6e-aab9-feb6a1850bb4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.105357 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1731/3472] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:27 2022] DELETE /identity/v3/projects/982625dc1b2c417eb07e6d8b87c91e7c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:28.110206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a9721-2854-42f1-adcb-9e381466942b service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:28.131717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a9721-2854-42f1-adcb-9e381466942b service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:28.299115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029a4bf-90c0-44ad-b7cb-87155edf870a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:28.299633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029a4bf-90c0-44ad-b7cb-87155edf870a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:28.300148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029a4bf-90c0-44ad-b7cb-87155edf870a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:28.322132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:28.323325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:28.324994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:28.325565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains/bde8af025cc442458fe07ff563375e9d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:28.329632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bde8af025cc442458fe07ff563375e9d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:28.330922 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:28.330922 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:58:28.330922 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:58:28.332684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:28.350707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1029a4bf-90c0-44ad-b7cb-87155edf870a None None] MFA Rules not processed for user `0f88ec14e66c4dafa9aeb5595692a225`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:28.353826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1029a4bf-90c0-44ad-b7cb-87155edf870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:28.363026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bde8af025cc442458fe07ff563375e9d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.363978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bde8af025cc442458fe07ff563375e9d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.412395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bde8af025cc442458fe07ff563375e9d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.414229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bde8af025cc442458fe07ff563375e9d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.432654 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1742/3473] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 20:58:28 2022] PATCH /identity/v3/domains/bde8af025cc442458fe07ff563375e9d => generated 276 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:28.435201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:28.445888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:28.630483 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1732/3474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:28.675725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f2462-4780-4e9a-86c1-50060682965e tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:28.691981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:28.692909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:28.693195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:28.693478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains/bde8af025cc442458fe07ff563375e9d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:28.723918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bde8af025cc442458fe07ff563375e9d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:28.724959 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:28.724959 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:58:28.724959 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:58:28.725873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:28.801335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bde8af025cc442458fe07ff563375e9d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.810924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bde8af025cc442458fe07ff563375e9d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.899815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde8af025cc442458fe07ff563375e9d', 'request_id': 'req-6691f4de-4f7d-4a95-81d0-8833be92a0e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.925402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde8af025cc442458fe07ff563375e9d', 'request_id': 'req-6691f4de-4f7d-4a95-81d0-8833be92a0e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.945785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde8af025cc442458fe07ff563375e9d', 'request_id': 'req-6691f4de-4f7d-4a95-81d0-8833be92a0e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.983602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project bde8af025cc442458fe07ff563375e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:28.985505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:28.991719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:29.018678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bde8af025cc442458fe07ff563375e9d', 'request_id': 'req-6691f4de-4f7d-4a95-81d0-8833be92a0e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:29.029380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bde8af025cc442458fe07ff563375e9d', 'request_id': 'req-6691f4de-4f7d-4a95-81d0-8833be92a0e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:29.032259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bde8af025cc442458fe07ff563375e9d', 'request_id': 'req-6691f4de-4f7d-4a95-81d0-8833be92a0e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:29.047367 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1743/3475] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:28 2022] DELETE /identity/v3/domains/bde8af025cc442458fe07ff563375e9d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:29.052635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029a4bf-90c0-44ad-b7cb-87155edf870a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:29.072081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029a4bf-90c0-44ad-b7cb-87155edf870a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:29.189702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:29.190934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:29.191596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:29.192093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:29.196836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:29.199939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:29.231851 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1733/3476] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 20:58:29 2022] POST /identity/v3/domains => generated 276 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:29.241300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:29.244291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:29.276478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691f4de-4f7d-4a95-81d0-8833be92a0e7 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:29.369545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67dde1-6812-44b8-84f1-596acbbbd93b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:29.370616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67dde1-6812-44b8-84f1-596acbbbd93b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:29.371166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67dde1-6812-44b8-84f1-596acbbbd93b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:29.371932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67dde1-6812-44b8-84f1-596acbbbd93b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:29.373956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67dde1-6812-44b8-84f1-596acbbbd93b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:29.375695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:29.377896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67dde1-6812-44b8-84f1-596acbbbd93b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:29.378568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:29.471829 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1744/3477] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:29 2022] POST /identity/v3/projects => generated 409 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:29.474333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67dde1-6812-44b8-84f1-596acbbbd93b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:29.603298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71853503-989c-4902-967a-8039e0ee61bd tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:29.651136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67dde1-6812-44b8-84f1-596acbbbd93b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:29.666319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700c80a-e300-4821-8eef-ac646866b480 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:29.667152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700c80a-e300-4821-8eef-ac646866b480 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:29.667435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700c80a-e300-4821-8eef-ac646866b480 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:29.667974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700c80a-e300-4821-8eef-ac646866b480 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:29.673700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700c80a-e300-4821-8eef-ac646866b480 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:29.676773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700c80a-e300-4821-8eef-ac646866b480 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:29.741550 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1745/3478] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:29 2022] POST /identity/v3/projects => generated 405 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:29.744010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700c80a-e300-4821-8eef-ac646866b480 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:29.880867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:29.882904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:29.888015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:29.888554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:29.896355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:29.988220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700c80a-e300-4821-8eef-ac646866b480 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:29.997943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:30.000870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:30.001760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:30.005445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/0ed563136fcb4093bdd10bc4901ad56e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:30.008178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ed563136fcb4093bdd10bc4901ad56e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:30.011753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:30.089274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:30.091583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:30.127464 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1734/3479] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:58:30.136702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed563136fcb4093bdd10bc4901ad56e', 'request_id': 'req-5ecb125f-7a53-4a67-bde2-f5b147dd4411'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.146993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed563136fcb4093bdd10bc4901ad56e', 'request_id': 'req-5ecb125f-7a53-4a67-bde2-f5b147dd4411'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.172212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed563136fcb4093bdd10bc4901ad56e', 'request_id': 'req-5ecb125f-7a53-4a67-bde2-f5b147dd4411'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.189817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project 0ed563136fcb4093bdd10bc4901ad56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:30.190122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.190893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.192963 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1746/3480] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:29 2022] DELETE /identity/v3/projects/0ed563136fcb4093bdd10bc4901ad56e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:30.198270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:30.217328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4191-9120-420e-9330-a7ad64355276 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:30.360709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:30.367140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:30.367375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:30.367665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/91e85d22772d4490bd29e181f992ed4f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:30.371888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91e85d22772d4490bd29e181f992ed4f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:30.379533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:30.551189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e85d22772d4490bd29e181f992ed4f', 'request_id': 'req-68e321a5-bff1-43a1-8bbb-a3af43650385'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.580253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e85d22772d4490bd29e181f992ed4f', 'request_id': 'req-68e321a5-bff1-43a1-8bbb-a3af43650385'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.621613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e85d22772d4490bd29e181f992ed4f', 'request_id': 'req-68e321a5-bff1-43a1-8bbb-a3af43650385'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.641156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project 91e85d22772d4490bd29e181f992ed4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:30.649215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.652542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.654745 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1735/3481] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:30 2022] DELETE /identity/v3/projects/91e85d22772d4490bd29e181f992ed4f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:30.661030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:30.663308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:30.684682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb125f-7a53-4a67-bde2-f5b147dd4411 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:30.760948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:30.762323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:30.762444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:30.762720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains/96cff9c9424f4e7f8b4bffc99d1bb906` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:30.765018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=96cff9c9424f4e7f8b4bffc99d1bb906)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:30.767463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:30.797720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.798641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.838981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.842284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:30.850165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1747/3482] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 20:58:30 2022] PATCH /identity/v3/domains/96cff9c9424f4e7f8b4bffc99d1bb906 => generated 277 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:30.850894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:30.852368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:30.871435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e321a5-bff1-43a1-8bbb-a3af43650385 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:30.955613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:30.956610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:30.957059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:30.957339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains/96cff9c9424f4e7f8b4bffc99d1bb906` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:30.975146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=96cff9c9424f4e7f8b4bffc99d1bb906)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:30.976654 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:30.976654 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:30.976654 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:30.977544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:31.005776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.029252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.193625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906', 'request_id': 'req-6ab480b0-edf0-499e-bcad-a0999581434d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.213265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906', 'request_id': 'req-6ab480b0-edf0-499e-bcad-a0999581434d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.239265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906', 'request_id': 'req-6ab480b0-edf0-499e-bcad-a0999581434d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.268715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project 96cff9c9424f4e7f8b4bffc99d1bb906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:31.269418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.271016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.302693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906', 'request_id': 'req-6ab480b0-edf0-499e-bcad-a0999581434d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.306628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906', 'request_id': 'req-6ab480b0-edf0-499e-bcad-a0999581434d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.319462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '96cff9c9424f4e7f8b4bffc99d1bb906', 'request_id': 'req-6ab480b0-edf0-499e-bcad-a0999581434d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:31.343259 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1736/3483] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:30 2022] DELETE /identity/v3/domains/96cff9c9424f4e7f8b4bffc99d1bb906 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:31.348878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:31.350485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:31.431609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6243c2-0cc8-4eee-aac3-a959f989c114 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:31.556860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bb241-3b88-4c09-b16c-782f3e2a9e4b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:31.558842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bb241-3b88-4c09-b16c-782f3e2a9e4b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:31.559394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bb241-3b88-4c09-b16c-782f3e2a9e4b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:31.559655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bb241-3b88-4c09-b16c-782f3e2a9e4b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:31.561086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bb241-3b88-4c09-b16c-782f3e2a9e4b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:31.565013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bb241-3b88-4c09-b16c-782f3e2a9e4b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:31.666751 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1748/3484] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:31 2022] POST /identity/v3/projects => generated 376 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:31.668252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:31.669910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:31.704061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab480b0-edf0-499e-bcad-a0999581434d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:31.854557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aa7ff-2994-4736-a643-dda99ce91332 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:31.856618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aa7ff-2994-4736-a643-dda99ce91332 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:31.857114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aa7ff-2994-4736-a643-dda99ce91332 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:31.857568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aa7ff-2994-4736-a643-dda99ce91332 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/aa1588407a694eeba2b54c3720ee046a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:31.859139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aa7ff-2994-4736-a643-dda99ce91332 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_project(project_id=aa1588407a694eeba2b54c3720ee046a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:31.862338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aa7ff-2994-4736-a643-dda99ce91332 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:31.864495 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1737/3485] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:31 2022] GET /identity/v3/projects/aa1588407a694eeba2b54c3720ee046a => generated 376 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:58:31.868959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bb241-3b88-4c09-b16c-782f3e2a9e4b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:31.898784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bb241-3b88-4c09-b16c-782f3e2a9e4b tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:31.923146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:31.925997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:31.926648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:31.926648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:31.927311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:31.929407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:31.985200 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1749/3486] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 20:58:31 2022] GET /identity/v3/projects => generated 7299 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:31.985841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aa7ff-2994-4736-a643-dda99ce91332 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:32.006406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aa7ff-2994-4736-a643-dda99ce91332 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:32.021178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:32.022370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:32.022511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:32.022711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/aa1588407a694eeba2b54c3720ee046a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:32.024075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa1588407a694eeba2b54c3720ee046a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:32.026029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:32.195692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1588407a694eeba2b54c3720ee046a', 'request_id': 'req-710d1972-a77d-4af8-b382-b17cbc0e3171'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:32.209156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1588407a694eeba2b54c3720ee046a', 'request_id': 'req-710d1972-a77d-4af8-b382-b17cbc0e3171'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:32.245767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1588407a694eeba2b54c3720ee046a', 'request_id': 'req-710d1972-a77d-4af8-b382-b17cbc0e3171'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:32.272577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project aa1588407a694eeba2b54c3720ee046a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:32.272870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:32.280745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:32.286203 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1738/3487] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:31 2022] DELETE /identity/v3/projects/aa1588407a694eeba2b54c3720ee046a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:32.290905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:32.293124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:32.331151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324169b-8222-4edf-9a47-4c99a80e72ae tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:32.520594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf74a3-7b8d-41ff-bd06-0ae36f140219 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:32.521475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf74a3-7b8d-41ff-bd06-0ae36f140219 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:32.521861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf74a3-7b8d-41ff-bd06-0ae36f140219 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:32.522147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf74a3-7b8d-41ff-bd06-0ae36f140219 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:32.522852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf74a3-7b8d-41ff-bd06-0ae36f140219 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:32.525384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf74a3-7b8d-41ff-bd06-0ae36f140219 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:32.590628 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1750/3488] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 20:58:32 2022] POST /identity/v3/projects => generated 348 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:32.595269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:32.635735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d1972-a77d-4af8-b382-b17cbc0e3171 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:32.886483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b9293-048c-4ef0-abbc-daaf04ad942d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:32.887380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b9293-048c-4ef0-abbc-daaf04ad942d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:32.891715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b9293-048c-4ef0-abbc-daaf04ad942d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:32.892049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b9293-048c-4ef0-abbc-daaf04ad942d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/dc248ac4d27d4d0a87e546378700da89` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:32.894784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b9293-048c-4ef0-abbc-daaf04ad942d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:update_project(project_id=dc248ac4d27d4d0a87e546378700da89)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:32.896781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b9293-048c-4ef0-abbc-daaf04ad942d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:33.016221 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1739/3489] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Feb 19 20:58:32 2022] PATCH /identity/v3/projects/dc248ac4d27d4d0a87e546378700da89 => generated 362 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:33.020173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf74a3-7b8d-41ff-bd06-0ae36f140219 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:33.034834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf74a3-7b8d-41ff-bd06-0ae36f140219 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:33.052192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:33.054343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:33.054819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:33.055275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/dc248ac4d27d4d0a87e546378700da89` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:33.077686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_project(project_id=dc248ac4d27d4d0a87e546378700da89)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:33.081579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:33.085360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1751/3490] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:33 2022] GET /identity/v3/projects/dc248ac4d27d4d0a87e546378700da89 => generated 349 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:33.089590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b9293-048c-4ef0-abbc-daaf04ad942d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:33.103163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b9293-048c-4ef0-abbc-daaf04ad942d tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:33.109118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:33.110192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:33.110663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:33.111115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/dc248ac4d27d4d0a87e546378700da89` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:33.116042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc248ac4d27d4d0a87e546378700da89)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:33.121118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:33.234613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc248ac4d27d4d0a87e546378700da89', 'request_id': 'req-0d3706f2-b017-4a2c-b4d3-136a9523768c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:33.249844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc248ac4d27d4d0a87e546378700da89', 'request_id': 'req-0d3706f2-b017-4a2c-b4d3-136a9523768c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:33.264228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc248ac4d27d4d0a87e546378700da89', 'request_id': 'req-0d3706f2-b017-4a2c-b4d3-136a9523768c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:33.291214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project dc248ac4d27d4d0a87e546378700da89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:33.292947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:33.294730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:33.299039 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1740/3491] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:33 2022] DELETE /identity/v3/projects/dc248ac4d27d4d0a87e546378700da89 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:33.304084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:33.306406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:33.343544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d8e91-66bd-4e46-a0e5-60bd576bd7a9 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:33.494452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a71da-ad51-4b9c-954f-61439c7a1e1a tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:33.495411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a71da-ad51-4b9c-954f-61439c7a1e1a tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:33.495411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a71da-ad51-4b9c-954f-61439c7a1e1a tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:33.495684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a71da-ad51-4b9c-954f-61439c7a1e1a tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:33.496476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a71da-ad51-4b9c-954f-61439c7a1e1a tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:33.498581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a71da-ad51-4b9c-954f-61439c7a1e1a tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:33.574936 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1752/3492] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:33 2022] POST /identity/v3/projects => generated 361 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:33.578823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:33.601854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3706f2-b017-4a2c-b4d3-136a9523768c tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:33.940928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230bd31-b2c9-432a-80f8-4b10f07708d5 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:33.942331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bd31-b2c9-432a-80f8-4b10f07708d5 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:33.942331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bd31-b2c9-432a-80f8-4b10f07708d5 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:33.942584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bd31-b2c9-432a-80f8-4b10f07708d5 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/68f625fa361b461c8b55f1c5a8630e2b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:33.943825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230bd31-b2c9-432a-80f8-4b10f07708d5 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:update_project(project_id=68f625fa361b461c8b55f1c5a8630e2b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:33.946009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230bd31-b2c9-432a-80f8-4b10f07708d5 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:34.070415 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1741/3493] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Feb 19 20:58:33 2022] PATCH /identity/v3/projects/68f625fa361b461c8b55f1c5a8630e2b => generated 373 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:34.073807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a71da-ad51-4b9c-954f-61439c7a1e1a tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:34.109049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a71da-ad51-4b9c-954f-61439c7a1e1a tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:34.120291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:34.132676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:34.132967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:34.133258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/68f625fa361b461c8b55f1c5a8630e2b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:34.171017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_project(project_id=68f625fa361b461c8b55f1c5a8630e2b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:34.177253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:34.186656 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1753/3494] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:34 2022] GET /identity/v3/projects/68f625fa361b461c8b55f1c5a8630e2b => generated 360 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:34.189688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230bd31-b2c9-432a-80f8-4b10f07708d5 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:34.204915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230bd31-b2c9-432a-80f8-4b10f07708d5 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:34.218364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:34.220827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:34.221121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:34.221409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/68f625fa361b461c8b55f1c5a8630e2b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:34.226624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68f625fa361b461c8b55f1c5a8630e2b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:34.231662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:34.397648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f625fa361b461c8b55f1c5a8630e2b', 'request_id': 'req-66378a24-30e5-4541-aed8-ed6aaaf239a1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:34.410048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f625fa361b461c8b55f1c5a8630e2b', 'request_id': 'req-66378a24-30e5-4541-aed8-ed6aaaf239a1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:34.427852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f625fa361b461c8b55f1c5a8630e2b', 'request_id': 'req-66378a24-30e5-4541-aed8-ed6aaaf239a1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:34.448657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project 68f625fa361b461c8b55f1c5a8630e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:34.450953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:34.450953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:34.456519 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1742/3495] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:34 2022] DELETE /identity/v3/projects/68f625fa361b461c8b55f1c5a8630e2b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:34.461691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:34.464007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:34.488115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26fd79-90d0-49ff-9e91-2cb6745ce333 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:34.655102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597edee-cc04-48d3-bfa6-61a2221c6034 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:34.656692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597edee-cc04-48d3-bfa6-61a2221c6034 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:34.657120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597edee-cc04-48d3-bfa6-61a2221c6034 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:34.657412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597edee-cc04-48d3-bfa6-61a2221c6034 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:34.658925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597edee-cc04-48d3-bfa6-61a2221c6034 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:34.664873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597edee-cc04-48d3-bfa6-61a2221c6034 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:34.766252 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1754/3496] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:34 2022] POST /identity/v3/projects => generated 354 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:34.769447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:34.785565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66378a24-30e5-4541-aed8-ed6aaaf239a1 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:34.974258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:34.975204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:34.975495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:34.975781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/96cd5a7990cb49ef99ddc42b788d1ace` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:34.977643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:update_project(project_id=96cd5a7990cb49ef99ddc42b788d1ace)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:34.982798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:35.065802 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1743/3497] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Feb 19 20:58:34 2022] PATCH /identity/v3/projects/96cd5a7990cb49ef99ddc42b788d1ace => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:58:35.068675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597edee-cc04-48d3-bfa6-61a2221c6034 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:35.085561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597edee-cc04-48d3-bfa6-61a2221c6034 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:35.098616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:35.101574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:35.119609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdbe93-52aa-423d-853c-9fce2d58c093 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:35.120455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdbe93-52aa-423d-853c-9fce2d58c093 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:35.120783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdbe93-52aa-423d-853c-9fce2d58c093 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:35.121066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdbe93-52aa-423d-853c-9fce2d58c093 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/96cd5a7990cb49ef99ddc42b788d1ace` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:35.192735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdbe93-52aa-423d-853c-9fce2d58c093 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:get_project(project_id=96cd5a7990cb49ef99ddc42b788d1ace)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:35.192735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdbe93-52aa-423d-853c-9fce2d58c093 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:35.192735 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1755/3498] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:35 2022] GET /identity/v3/projects/96cd5a7990cb49ef99ddc42b788d1ace => generated 355 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:35.205069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdbe93-52aa-423d-853c-9fce2d58c093 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:35.244929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdbe93-52aa-423d-853c-9fce2d58c093 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:35.298640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:35.299532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:35.299814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:35.300091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/projects/96cd5a7990cb49ef99ddc42b788d1ace` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:35.302389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96cd5a7990cb49ef99ddc42b788d1ace)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:35.307495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:35.333637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4ad5-e004-4f4d-a675-b0c49ffaca72 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:35.363557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:35.365048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:35.365329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:35.365653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] PATH_INFO: `/v3/users/60cfee67e3df4200a93528bcb8036b9e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:35.368089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cfee67e3df4200a93528bcb8036b9e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:35.371842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:35.516549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cd5a7990cb49ef99ddc42b788d1ace', 'request_id': 'req-f6ee3d20-0e84-43d1-9035-958f807b709f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.548653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cfee67e3df4200a93528bcb8036b9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.549988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cfee67e3df4200a93528bcb8036b9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.581736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cfee67e3df4200a93528bcb8036b9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.582091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cd5a7990cb49ef99ddc42b788d1ace', 'request_id': 'req-f6ee3d20-0e84-43d1-9035-958f807b709f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.598543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cd5a7990cb49ef99ddc42b788d1ace', 'request_id': 'req-f6ee3d20-0e84-43d1-9035-958f807b709f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.624128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cfee67e3df4200a93528bcb8036b9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.628251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] The token cache is being invalidate because project 96cd5a7990cb49ef99ddc42b788d1ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:35.629341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.630477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.634266 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1756/3499] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:35 2022] DELETE /identity/v3/projects/96cd5a7990cb49ef99ddc42b788d1ace => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:35.639945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:35.645032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:35.649097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cfee67e3df4200a93528bcb8036b9e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:35.684555 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1744/3500] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:35 2022] DELETE /identity/v3/users/60cfee67e3df4200a93528bcb8036b9e => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:35.801314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee3d20-0e84-43d1-9035-958f807b709f tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:35.991546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:35.993645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:35.994238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:35.994780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains/96cff9c9424f4e7f8b4bffc99d1bb906` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:36.005799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:58:36.018663 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Could not find domain: 96cff9c9424f4e7f8b4bffc99d1bb906.: keystone.exception.DomainNotFound: Could not find domain: 96cff9c9424f4e7f8b4bffc99d1bb906. Feb 19 20:58:36.022248 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1757/3501] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 20:58:35 2022] PATCH /identity/v3/domains/96cff9c9424f4e7f8b4bffc99d1bb906 => generated 112 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 20:58:36.026161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:36.027907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:36.066737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485942ae-faf2-4723-9c4e-6a26bcc2df64 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:36.114741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce24bf9f2b94d088f725815266b704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02f664f171ec456695c643fee0a40fe5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:36.116432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:36.116902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:36.117343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] PATH_INFO: `/v3/domains/bde8af025cc442458fe07ff563375e9d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:36.133024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 20:58:36.151433 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Could not find domain: bde8af025cc442458fe07ff563375e9d.: keystone.exception.DomainNotFound: Could not find domain: bde8af025cc442458fe07ff563375e9d. Feb 19 20:58:36.164424 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1745/3502] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 20:58:36 2022] PATCH /identity/v3/domains/bde8af025cc442458fe07ff563375e9d => generated 112 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 20:58:36.168182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:36.170888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:36.381971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244a3f-bff6-49f3-9c0c-2e9aef2d6aa4 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:36.403666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:36.404822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:36.405107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:36.405384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] PATH_INFO: `/v3/users/3d02daf96872454e84a3a2177c711185` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:36.410896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d02daf96872454e84a3a2177c711185)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:36.415935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:36.546434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:36.547853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d02daf96872454e84a3a2177c711185'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.552511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:36.581475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d02daf96872454e84a3a2177c711185'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.592524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad812-ca99-4622-a77d-31347a4b1229 tempest-ProjectsTestJSON-272530071 tempest-ProjectsTestJSON-272530071-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:36.601815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d02daf96872454e84a3a2177c711185'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.605779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d02daf96872454e84a3a2177c711185'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.607077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-18de92d2-7f36-442c-a957-022693d38494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d02daf96872454e84a3a2177c711185'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.608130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:36.609128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:36.609890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:36.610564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] PATH_INFO: `/v3/projects/72c7d19a9f264a299de3fef34d6cc2e3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:36.619879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c7d19a9f264a299de3fef34d6cc2e3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:36.622794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:36.652471 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1758/3503] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:36 2022] DELETE /identity/v3/users/3d02daf96872454e84a3a2177c711185 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:36.654244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69960129-373a-4fc3-a89a-be9fce02fcd0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:36.654774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69960129-373a-4fc3-a89a-be9fce02fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:36.655062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69960129-373a-4fc3-a89a-be9fce02fcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:36.690627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-69960129-373a-4fc3-a89a-be9fce02fcd0 None None] MFA Rules not processed for user `0f88ec14e66c4dafa9aeb5595692a225`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:36.695220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69960129-373a-4fc3-a89a-be9fce02fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:36.829167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c7d19a9f264a299de3fef34d6cc2e3', 'request_id': 'req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.847382 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1759/3504] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:36.850826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c7d19a9f264a299de3fef34d6cc2e3', 'request_id': 'req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.852604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb80212-a863-4935-a675-06e8ce5706d2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:36.853028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb80212-a863-4935-a675-06e8ce5706d2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:36.853433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb80212-a863-4935-a675-06e8ce5706d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:36.870938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c7d19a9f264a299de3fef34d6cc2e3', 'request_id': 'req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.908728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] The token cache is being invalidate because project 72c7d19a9f264a299de3fef34d6cc2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:36.910826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.912642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04ad6ef5-1bad-4b8c-a7f7-359b9a695571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:36.917230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4fb80212-a863-4935-a675-06e8ce5706d2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:36.917411 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1746/3505] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:36 2022] DELETE /identity/v3/projects/72c7d19a9f264a299de3fef34d6cc2e3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:36.918832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4fb80212-a863-4935-a675-06e8ce5706d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:36.924123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7505-4652-4e3b-8237-fe14fa4ae3fd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:36.924673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7505-4652-4e3b-8237-fe14fa4ae3fd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:36.925132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7505-4652-4e3b-8237-fe14fa4ae3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:36.977690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ab3c7505-4652-4e3b-8237-fe14fa4ae3fd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:36.980093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ab3c7505-4652-4e3b-8237-fe14fa4ae3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:37.156542 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1760/3506] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:37.206323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb80212-a863-4935-a675-06e8ce5706d2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:37.208169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4fb80212-a863-4935-a675-06e8ce5706d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:37.214101 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1747/3507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:58:37.223039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49182-b236-4fe7-b4b9-a0170d2f408b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:37.223554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49182-b236-4fe7-b4b9-a0170d2f408b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:37.224021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49182-b236-4fe7-b4b9-a0170d2f408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:37.284055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-55a49182-b236-4fe7-b4b9-a0170d2f408b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:37.288404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55a49182-b236-4fe7-b4b9-a0170d2f408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:37.312204 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1748/3508] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:37.316982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a49182-b236-4fe7-b4b9-a0170d2f408b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:37.340709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a49182-b236-4fe7-b4b9-a0170d2f408b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:37.362612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:37.363522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:37.363963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:37.364431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:37.365367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:37.365991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:37.367743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:37.404096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb80212-a863-4935-a675-06e8ce5706d2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:37.414500 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1749/3509] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:37.415324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a8a20-b7b8-4e5e-97d2-dd8eaf527529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:37.416217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8a20-b7b8-4e5e-97d2-dd8eaf527529 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:37.416531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8a20-b7b8-4e5e-97d2-dd8eaf527529 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:37.416910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8a20-b7b8-4e5e-97d2-dd8eaf527529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:37.417916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:37.433637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a8a20-b7b8-4e5e-97d2-dd8eaf527529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:37.433876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e260f9e-ccb3-4626-a3c9-d95ba0aa7fad admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:37.435571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a8a20-b7b8-4e5e-97d2-dd8eaf527529 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:37.456450 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1761/3510] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:58:37.456871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bcbb1-9c80-41d9-9129-853a2fe4e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:37.466517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bcbb1-9c80-41d9-9129-853a2fe4e0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:37.466804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bcbb1-9c80-41d9-9129-853a2fe4e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:37.467263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bcbb1-9c80-41d9-9129-853a2fe4e0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:37.471069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bcbb1-9c80-41d9-9129-853a2fe4e0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:37.473603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bcbb1-9c80-41d9-9129-853a2fe4e0b0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:37.543417 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1750/3511] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:37 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:37.548781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a8a20-b7b8-4e5e-97d2-dd8eaf527529 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:37.575154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a8a20-b7b8-4e5e-97d2-dd8eaf527529 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:37.717137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c2b93-89a5-4aac-a7b6-0fbf74c6014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:37.717850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c2b93-89a5-4aac-a7b6-0fbf74c6014d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:37.718134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c2b93-89a5-4aac-a7b6-0fbf74c6014d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:37.718507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c2b93-89a5-4aac-a7b6-0fbf74c6014d admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:37.719149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c2b93-89a5-4aac-a7b6-0fbf74c6014d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:37.721206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c2b93-89a5-4aac-a7b6-0fbf74c6014d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:37.774080 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1762/3512] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:37 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:37.781114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bcbb1-9c80-41d9-9129-853a2fe4e0b0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:37.807282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bcbb1-9c80-41d9-9129-853a2fe4e0b0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:37.830753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e448-2816-4105-b1d2-e18b49b936d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:37.832697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e448-2816-4105-b1d2-e18b49b936d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:37.836581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e448-2816-4105-b1d2-e18b49b936d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:37.840011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e448-2816-4105-b1d2-e18b49b936d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:37.846049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8e448-2816-4105-b1d2-e18b49b936d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:37.868769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8e448-2816-4105-b1d2-e18b49b936d2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:37.901839 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1751/3513] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:37.905309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c2b93-89a5-4aac-a7b6-0fbf74c6014d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:37.929749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c2b93-89a5-4aac-a7b6-0fbf74c6014d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:37.953406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfb962-5b9c-48b8-97d7-9099f4454ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:37.954129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb962-5b9c-48b8-97d7-9099f4454ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:37.954447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb962-5b9c-48b8-97d7-9099f4454ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:37.954700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb962-5b9c-48b8-97d7-9099f4454ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:37.955398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfb962-5b9c-48b8-97d7-9099f4454ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:37.973028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfb962-5b9c-48b8-97d7-9099f4454ea4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:37.988396 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1763/3514] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:37.992127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e448-2816-4105-b1d2-e18b49b936d2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:38.004509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e448-2816-4105-b1d2-e18b49b936d2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:38.011457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:38.012913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:38.013451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:38.014132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] PATH_INFO: `/v3/projects/2f4aa3e254e944d4a85f2085a89a921b/users/e94820c6c6d04bcbae0e183cb51aa3b1/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:38.033768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4aa3e254e944d4a85f2085a89a921b, user_id=e94820c6c6d04bcbae0e183cb51aa3b1, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:38.038000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:38.059620 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1752/3515] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:37 2022] PUT /identity/v3/projects/2f4aa3e254e944d4a85f2085a89a921b/users/e94820c6c6d04bcbae0e183cb51aa3b1/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:38.065555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07641a-3768-4416-8e6e-7e770ad52266 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:38.066253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07641a-3768-4416-8e6e-7e770ad52266 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:38.067186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07641a-3768-4416-8e6e-7e770ad52266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:38.110219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5d07641a-3768-4416-8e6e-7e770ad52266 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:38.113511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5d07641a-3768-4416-8e6e-7e770ad52266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:38.268239 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1764/3516] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:38.298912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:38.301713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:38.414912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9f49b-86c1-45ae-be3d-119686cc4323 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:38.425338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e6a39-b909-49e4-9b8e-2f90d20a50d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:38.427280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6a39-b909-49e4-9b8e-2f90d20a50d3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:38.427735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6a39-b909-49e4-9b8e-2f90d20a50d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:38.428183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6a39-b909-49e4-9b8e-2f90d20a50d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:38.448436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e6a39-b909-49e4-9b8e-2f90d20a50d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:38.451242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e6a39-b909-49e4-9b8e-2f90d20a50d3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:38.469762 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1753/3517] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:39.479044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07641a-3768-4416-8e6e-7e770ad52266 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:39.482764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5d07641a-3768-4416-8e6e-7e770ad52266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:39.542770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07641a-3768-4416-8e6e-7e770ad52266 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:39.550388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:39.552160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:39.552642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:39.553075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] PATH_INFO: `/v3/projects/1c8343da444e4075813e216ad73ff443` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:39.557832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8343da444e4075813e216ad73ff443)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:39.567384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:39.714687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8343da444e4075813e216ad73ff443', 'request_id': 'req-e56a6394-478b-46c1-ac55-c1eac65019ae'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:39.726548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8343da444e4075813e216ad73ff443', 'request_id': 'req-e56a6394-478b-46c1-ac55-c1eac65019ae'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:39.743120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8343da444e4075813e216ad73ff443', 'request_id': 'req-e56a6394-478b-46c1-ac55-c1eac65019ae'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:39.773369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] The token cache is being invalidate because project 1c8343da444e4075813e216ad73ff443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:39.773993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:39.776053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:39.781917 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1765/3518] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:39 2022] DELETE /identity/v3/projects/1c8343da444e4075813e216ad73ff443 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:39.783828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e6a39-b909-49e4-9b8e-2f90d20a50d3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:39.798864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e6a39-b909-49e4-9b8e-2f90d20a50d3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:39.866547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:39.869743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:40.003442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:40.006647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:40.007186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:40.007628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] PATH_INFO: `/v3/users/cce24bf9f2b94d088f725815266b704b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:40.013930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce24bf9f2b94d088f725815266b704b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:40.016683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:40.060939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a6394-478b-46c1-ac55-c1eac65019ae admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:40.071763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:40.076727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:40.077291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:40.080648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] PATH_INFO: `/v3/users/927e2fa8122b464a8046bdc5a2c94544` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:40.082913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=927e2fa8122b464a8046bdc5a2c94544)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:40.088854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:40.144888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce24bf9f2b94d088f725815266b704b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.146045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce24bf9f2b94d088f725815266b704b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.147783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce24bf9f2b94d088f725815266b704b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.182633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce24bf9f2b94d088f725815266b704b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.195731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f56423b1-f245-452a-879a-4e574b373c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce24bf9f2b94d088f725815266b704b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.215267 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1754/3519] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:39 2022] DELETE /identity/v3/users/cce24bf9f2b94d088f725815266b704b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:40.227682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927e2fa8122b464a8046bdc5a2c94544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.279149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927e2fa8122b464a8046bdc5a2c94544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.314670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927e2fa8122b464a8046bdc5a2c94544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.316510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927e2fa8122b464a8046bdc5a2c94544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.317748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce20d6c0-01c4-4b74-b1c6-e49ea4b47cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927e2fa8122b464a8046bdc5a2c94544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:40.367822 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1766/3520] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:39 2022] DELETE /identity/v3/users/927e2fa8122b464a8046bdc5a2c94544 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:40.778610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed18f-e22e-4d1c-8773-8c3c47955433 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:40.778898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed18f-e22e-4d1c-8773-8c3c47955433 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:40.779362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed18f-e22e-4d1c-8773-8c3c47955433 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:40.782115 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1755/3521] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 20:58:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 20:58:40.787649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984040-3f5b-426d-9265-9a95361f3592 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:40.788565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984040-3f5b-426d-9265-9a95361f3592 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:40.789028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984040-3f5b-426d-9265-9a95361f3592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:40.858335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2d984040-3f5b-426d-9265-9a95361f3592 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:40.860151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2d984040-3f5b-426d-9265-9a95361f3592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:40.998044 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1767/3522] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:41.030218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed18f-e22e-4d1c-8773-8c3c47955433 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:41.033438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-825ed18f-e22e-4d1c-8773-8c3c47955433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:41.103393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed18f-e22e-4d1c-8773-8c3c47955433 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:41.110229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984040-3f5b-426d-9265-9a95361f3592 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:41.111711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2d984040-3f5b-426d-9265-9a95361f3592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:41.131783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:41.156483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:41.156995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:41.157623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:41.206996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:41.217740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:41.286522 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1756/3523] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:41.287428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:41.296751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:41.412591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984040-3f5b-426d-9265-9a95361f3592 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:41.431946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:41.436129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:41.436438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:41.436719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:41.452985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:41.597214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02031b0e-8eee-4ce1-a2ec-20791327bfca service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:41.626836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:41.627933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:41.628467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:41.628935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] PATH_INFO: `/v3/projects/0eaac4cd79ca4f808d452057a3216fdd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:41.632271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eaac4cd79ca4f808d452057a3216fdd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:41.634445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:41.656225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:41.657878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:41.681220 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1768/3524] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:41.757377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eaac4cd79ca4f808d452057a3216fdd', 'request_id': 'req-7f1f1f6d-9d67-4448-a507-e061e17bd34e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:41.765334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eaac4cd79ca4f808d452057a3216fdd', 'request_id': 'req-7f1f1f6d-9d67-4448-a507-e061e17bd34e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:41.790814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eaac4cd79ca4f808d452057a3216fdd', 'request_id': 'req-7f1f1f6d-9d67-4448-a507-e061e17bd34e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:41.813694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] The token cache is being invalidate because project 0eaac4cd79ca4f808d452057a3216fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:41.813991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:41.816484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:41.821088 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1757/3525] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:41 2022] DELETE /identity/v3/projects/0eaac4cd79ca4f808d452057a3216fdd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:41.824910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:41.857962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937d94b-0665-4280-ad84-2f038154ad68 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:41.995348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:41.996972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:41.997264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:41.997548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] PATH_INFO: `/v3/users/21869bf6a5804322ba1f5ade3c625d6c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:41.998794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21869bf6a5804322ba1f5ade3c625d6c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:42.002342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:42.081173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21869bf6a5804322ba1f5ade3c625d6c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.112758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21869bf6a5804322ba1f5ade3c625d6c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.133681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21869bf6a5804322ba1f5ade3c625d6c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.134592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21869bf6a5804322ba1f5ade3c625d6c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.135397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21869bf6a5804322ba1f5ade3c625d6c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.195668 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1769/3526] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:41 2022] DELETE /identity/v3/users/21869bf6a5804322ba1f5ade3c625d6c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:42.398527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:42.401327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:42.496279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1f6d-9d67-4448-a507-e061e17bd34e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:42.517409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:42.519419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:42.578889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:42.579585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:42.580056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:42.580665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:42.587904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:42.667044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8071e6e-89d9-4b03-a92f-9f4d23726f04 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:42.675361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:42.676605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:42.676930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:42.677293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] PATH_INFO: `/v3/projects/02f664f171ec456695c643fee0a40fe5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:42.678754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f664f171ec456695c643fee0a40fe5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:42.681998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:42.682472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:42.686448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:42.699983 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1758/3527] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:42.701481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:42.703687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:42.723119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c6c5-1318-4e3e-97cf-d4d91c9bbc34 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:42.736070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:42.737345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:42.737924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:42.738496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] PATH_INFO: `/v3/projects/2c8b0fee8ceb425baae8c1d9bfd288e3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:42.740653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8b0fee8ceb425baae8c1d9bfd288e3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:42.742803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:42.791656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f664f171ec456695c643fee0a40fe5', 'request_id': 'req-a541c744-cb6f-421a-901b-6bcf133bfc8f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.810791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f664f171ec456695c643fee0a40fe5', 'request_id': 'req-a541c744-cb6f-421a-901b-6bcf133bfc8f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.828628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f664f171ec456695c643fee0a40fe5', 'request_id': 'req-a541c744-cb6f-421a-901b-6bcf133bfc8f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.833031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8b0fee8ceb425baae8c1d9bfd288e3', 'request_id': 'req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.839439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8b0fee8ceb425baae8c1d9bfd288e3', 'request_id': 'req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.847714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] The token cache is being invalidate because project 02f664f171ec456695c643fee0a40fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:42.848576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.849752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a541c744-cb6f-421a-901b-6bcf133bfc8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.855624 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1770/3528] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:42 2022] DELETE /identity/v3/projects/02f664f171ec456695c643fee0a40fe5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:42.861393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4dbbb-0fbb-4a01-aee2-61bbdcebc597 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:42.861906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4dbbb-0fbb-4a01-aee2-61bbdcebc597 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:42.862480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4dbbb-0fbb-4a01-aee2-61bbdcebc597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:42.874397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8b0fee8ceb425baae8c1d9bfd288e3', 'request_id': 'req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.891589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9fc4dbbb-0fbb-4a01-aee2-61bbdcebc597 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:42.893508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9fc4dbbb-0fbb-4a01-aee2-61bbdcebc597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:42.916170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] The token cache is being invalidate because project 2c8b0fee8ceb425baae8c1d9bfd288e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:42.916500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.936628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:42.944602 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1759/3529] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:42 2022] DELETE /identity/v3/projects/2c8b0fee8ceb425baae8c1d9bfd288e3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:42.948225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:42.955324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:43.024259 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1771/3530] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:43.026183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8a6a-4933-4e97-8da3-4218cfa90487 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.026670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8a6a-4933-4e97-8da3-4218cfa90487 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.027961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8a6a-4933-4e97-8da3-4218cfa90487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.062977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-370b8a6a-4933-4e97-8da3-4218cfa90487 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:43.064543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-370b8a6a-4933-4e97-8da3-4218cfa90487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:43.073800 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1772/3531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:43.075215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77307cab-020e-4307-b07e-6babf5ed3248 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.075889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77307cab-020e-4307-b07e-6babf5ed3248 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.076049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77307cab-020e-4307-b07e-6babf5ed3248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.108653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8de3df-6f04-4dcd-a16c-4257df9a98d6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.112255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-77307cab-020e-4307-b07e-6babf5ed3248 None None] MFA Rules not processed for user `e94820c6c6d04bcbae0e183cb51aa3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:43.113721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-77307cab-020e-4307-b07e-6babf5ed3248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:43.125398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030003a4-74dc-4ba6-93b5-60f122b41b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:43.126012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030003a4-74dc-4ba6-93b5-60f122b41b1a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.126282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030003a4-74dc-4ba6-93b5-60f122b41b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.126568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030003a4-74dc-4ba6-93b5-60f122b41b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.128567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-030003a4-74dc-4ba6-93b5-60f122b41b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:43.148474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030003a4-74dc-4ba6-93b5-60f122b41b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:43.149934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030003a4-74dc-4ba6-93b5-60f122b41b1a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:43.172541 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1760/3532] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:43.173879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c114e52-903b-4667-8e44-afe20bb9f5cf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.174163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c114e52-903b-4667-8e44-afe20bb9f5cf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.174441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c114e52-903b-4667-8e44-afe20bb9f5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.216050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7c114e52-903b-4667-8e44-afe20bb9f5cf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:43.219763 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1773/3533] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:43.221207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded11a37-1fed-42c0-836c-437eae8529ea None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.221517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded11a37-1fed-42c0-836c-437eae8529ea None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.221770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded11a37-1fed-42c0-836c-437eae8529ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.223092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c114e52-903b-4667-8e44-afe20bb9f5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:43.258145 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1761/3534] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:43.259563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09991fe3-e6ea-4576-af74-415a746af69f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.259853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09991fe3-e6ea-4576-af74-415a746af69f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.260128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09991fe3-e6ea-4576-af74-415a746af69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.279448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ded11a37-1fed-42c0-836c-437eae8529ea None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:43.281217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ded11a37-1fed-42c0-836c-437eae8529ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:43.310629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-09991fe3-e6ea-4576-af74-415a746af69f None None] MFA Rules not processed for user `e94820c6c6d04bcbae0e183cb51aa3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:43.311890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-09991fe3-e6ea-4576-af74-415a746af69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:43.314488 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1774/3535] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:43.316630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded11a37-1fed-42c0-836c-437eae8529ea None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.333029 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1762/3536] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:43.333029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09991fe3-e6ea-4576-af74-415a746af69f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.337929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded11a37-1fed-42c0-836c-437eae8529ea None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.350122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:43.351196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.351751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.353385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.354678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:43.356036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:43.357747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09991fe3-e6ea-4576-af74-415a746af69f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.358531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:43.375877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:43.376422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.376913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.377279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.378021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:43.378326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:43.382696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:43.384653 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1775/3537] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:43.388057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.399946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8f5e-ca74-4975-bf9c-342d63a2e5c9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.410161 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1763/3538] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:43.410953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acadcc-283a-4724-bb4a-386538327fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:43.411838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acadcc-283a-4724-bb4a-386538327fca admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.412291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acadcc-283a-4724-bb4a-386538327fca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.412798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acadcc-283a-4724-bb4a-386538327fca admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.413943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acadcc-283a-4724-bb4a-386538327fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:43.414596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.417017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acadcc-283a-4724-bb4a-386538327fca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:43.440040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78660f2e-3400-4f3a-bb5d-1cff31b1be6e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.460606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:43.465856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.466203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.466598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.468015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:43.480292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:43.492134 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1776/3539] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:43.499775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acadcc-283a-4724-bb4a-386538327fca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.596183 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1764/3540] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:43.597682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.606231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:43.693875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acadcc-283a-4724-bb4a-386538327fca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.786947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57977-2eb7-4279-938f-5b476b679ef2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.795100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497df31-75a5-4f5b-bc7b-1843f9a3db1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:43.796106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497df31-75a5-4f5b-bc7b-1843f9a3db1e service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.800795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497df31-75a5-4f5b-bc7b-1843f9a3db1e service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.801901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497df31-75a5-4f5b-bc7b-1843f9a3db1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.835189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6f52-4e5d-4f16-a45f-aaec0bb8ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:43.839140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6f52-4e5d-4f16-a45f-aaec0bb8ca7b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.839815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6f52-4e5d-4f16-a45f-aaec0bb8ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.840261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6f52-4e5d-4f16-a45f-aaec0bb8ca7b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.841625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e6f52-4e5d-4f16-a45f-aaec0bb8ca7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:43.844846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e6f52-4e5d-4f16-a45f-aaec0bb8ca7b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:43.889116 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1777/3541] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/users => generated 293 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:43.890276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497df31-75a5-4f5b-bc7b-1843f9a3db1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:43.891306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6f52-4e5d-4f16-a45f-aaec0bb8ca7b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.902272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497df31-75a5-4f5b-bc7b-1843f9a3db1e service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:43.906403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6f52-4e5d-4f16-a45f-aaec0bb8ca7b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.913889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f30ad-f3d6-422d-aa1b-312d61c71b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:43.914908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f30ad-f3d6-422d-aa1b-312d61c71b88 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:43.915358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f30ad-f3d6-422d-aa1b-312d61c71b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:43.915807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f30ad-f3d6-422d-aa1b-312d61c71b88 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:43.916710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f30ad-f3d6-422d-aa1b-312d61c71b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:43.918787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f30ad-f3d6-422d-aa1b-312d61c71b88 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:43.937155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1765/3542] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:43.939796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497df31-75a5-4f5b-bc7b-1843f9a3db1e service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.966518 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1778/3543] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:43 2022] POST /identity/v3/users => generated 286 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:43.970983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f30ad-f3d6-422d-aa1b-312d61c71b88 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:43.974233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497df31-75a5-4f5b-bc7b-1843f9a3db1e service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:43.997473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7d2bf-791c-4125-be00-e504d15ed353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.000119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7d2bf-791c-4125-be00-e504d15ed353 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.000598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7d2bf-791c-4125-be00-e504d15ed353 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.001035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7d2bf-791c-4125-be00-e504d15ed353 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.001950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7d2bf-791c-4125-be00-e504d15ed353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.004853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7d2bf-791c-4125-be00-e504d15ed353 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.009784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f30ad-f3d6-422d-aa1b-312d61c71b88 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.034999 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1766/3544] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:44.038833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7d2bf-791c-4125-be00-e504d15ed353 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.039573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f7d85-cfdd-4777-baaa-8a2ebe6e2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.040999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f7d85-cfdd-4777-baaa-8a2ebe6e2ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.041515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f7d85-cfdd-4777-baaa-8a2ebe6e2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.041810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f7d85-cfdd-4777-baaa-8a2ebe6e2ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.042559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f7d85-cfdd-4777-baaa-8a2ebe6e2ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.044317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f7d85-cfdd-4777-baaa-8a2ebe6e2ae7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.079108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7d2bf-791c-4125-be00-e504d15ed353 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.085294 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1779/3545] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:44.091812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f7d85-cfdd-4777-baaa-8a2ebe6e2ae7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.094823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d368b-54b1-4917-802a-eb6b259bff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.097400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d368b-54b1-4917-802a-eb6b259bff8f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.098301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d368b-54b1-4917-802a-eb6b259bff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.099376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d368b-54b1-4917-802a-eb6b259bff8f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.101749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d368b-54b1-4917-802a-eb6b259bff8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.105373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d368b-54b1-4917-802a-eb6b259bff8f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.125705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f7d85-cfdd-4777-baaa-8a2ebe6e2ae7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.133290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400892e1-9ca7-4aca-8b61-5cc3e1ac066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.134692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400892e1-9ca7-4aca-8b61-5cc3e1ac066a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.135709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400892e1-9ca7-4aca-8b61-5cc3e1ac066a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.136197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400892e1-9ca7-4aca-8b61-5cc3e1ac066a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.137667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400892e1-9ca7-4aca-8b61-5cc3e1ac066a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.141764 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1767/3546] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:58:44.143292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400892e1-9ca7-4aca-8b61-5cc3e1ac066a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.143466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d368b-54b1-4917-802a-eb6b259bff8f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.163095 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1780/3547] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:44.166069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400892e1-9ca7-4aca-8b61-5cc3e1ac066a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.170124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d368b-54b1-4917-802a-eb6b259bff8f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.179276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400892e1-9ca7-4aca-8b61-5cc3e1ac066a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.180746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2b4e-75d3-4775-b26b-55a95500c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.181653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2b4e-75d3-4775-b26b-55a95500c666 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.182892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2b4e-75d3-4775-b26b-55a95500c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.182892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2b4e-75d3-4775-b26b-55a95500c666 admin admin] PATH_INFO: `/v3/projects/afaef71d160a4be5b8a14e36bc9b7a14/users/6357a8e93af14d4794f5014312d9e261/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.186447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cb65c-a355-42af-90fc-1cc2a2bbd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.188270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb65c-a355-42af-90fc-1cc2a2bbd130 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.189017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb65c-a355-42af-90fc-1cc2a2bbd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.189743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb65c-a355-42af-90fc-1cc2a2bbd130 admin admin] PATH_INFO: `/v3/projects/a8c68ae4f3aa48ab8478d0a4019dd481/users/351aab489ec74b039337b89d216e3c0e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.210681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cb65c-a355-42af-90fc-1cc2a2bbd130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c68ae4f3aa48ab8478d0a4019dd481, user_id=351aab489ec74b039337b89d216e3c0e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.215765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cb65c-a355-42af-90fc-1cc2a2bbd130 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.217804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2b4e-75d3-4775-b26b-55a95500c666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaef71d160a4be5b8a14e36bc9b7a14, user_id=6357a8e93af14d4794f5014312d9e261, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.221518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2b4e-75d3-4775-b26b-55a95500c666 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.249867 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1768/3548] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:44 2022] PUT /identity/v3/projects/afaef71d160a4be5b8a14e36bc9b7a14/users/6357a8e93af14d4794f5014312d9e261/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:44.251582 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1781/3549] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:44 2022] PUT /identity/v3/projects/a8c68ae4f3aa48ab8478d0a4019dd481/users/351aab489ec74b039337b89d216e3c0e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:44.251714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdfd8-c4bb-4494-bcde-b640dd4fbc96 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.251872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdfd8-c4bb-4494-bcde-b640dd4fbc96 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.252445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdfd8-c4bb-4494-bcde-b640dd4fbc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.272625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ae6e-8415-4282-b42e-6e5854a0deea None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.273143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ae6e-8415-4282-b42e-6e5854a0deea None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.273615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ae6e-8415-4282-b42e-6e5854a0deea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.292283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-31ecdfd8-c4bb-4494-bcde-b640dd4fbc96 None None] MFA Rules not processed for user `6357a8e93af14d4794f5014312d9e261`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:44.293937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-31ecdfd8-c4bb-4494-bcde-b640dd4fbc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:44.318780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1b39ae6e-8415-4282-b42e-6e5854a0deea None None] MFA Rules not processed for user `351aab489ec74b039337b89d216e3c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:44.320443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1b39ae6e-8415-4282-b42e-6e5854a0deea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:44.420363 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1769/3550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:58:44.426149 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1782/3551] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:44.434357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecdfd8-c4bb-4494-bcde-b640dd4fbc96 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.519902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecdfd8-c4bb-4494-bcde-b640dd4fbc96 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.529243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb2cb6-5288-4922-8e46-0f1e7910846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.530363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb2cb6-5288-4922-8e46-0f1e7910846c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.531022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb2cb6-5288-4922-8e46-0f1e7910846c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.531641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb2cb6-5288-4922-8e46-0f1e7910846c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.532834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb2cb6-5288-4922-8e46-0f1e7910846c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.536532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb2cb6-5288-4922-8e46-0f1e7910846c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.606387 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1770/3552] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:44 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:44.607362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ae6e-8415-4282-b42e-6e5854a0deea None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.628895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ae6e-8415-4282-b42e-6e5854a0deea None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.778938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb7838-627c-455a-b967-f37e0b2cf4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.780073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7838-627c-455a-b967-f37e0b2cf4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.780879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7838-627c-455a-b967-f37e0b2cf4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.781260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7838-627c-455a-b967-f37e0b2cf4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.783416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb7838-627c-455a-b967-f37e0b2cf4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.785796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb7838-627c-455a-b967-f37e0b2cf4c2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.859997 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1783/3553] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:44 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:44.861960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb2cb6-5288-4922-8e46-0f1e7910846c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.881045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb2cb6-5288-4922-8e46-0f1e7910846c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.887400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.888530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.889064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.889556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:44.892941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:44.895913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:44.939807 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1771/3554] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:44.940124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb7838-627c-455a-b967-f37e0b2cf4c2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.940858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:44.942644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:44.955364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb7838-627c-455a-b967-f37e0b2cf4c2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:44.966452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623158f8-866f-4d6e-9266-4a30ae272b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:44.968906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623158f8-866f-4d6e-9266-4a30ae272b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:44.969308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623158f8-866f-4d6e-9266-4a30ae272b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:44.970584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623158f8-866f-4d6e-9266-4a30ae272b72 admin admin] PATH_INFO: `/v3/projects/cc4125ad19724f5995aeaf2887b24213/users/8d1daa692d434e6a94144240ba6072c7/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:45.006024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623158f8-866f-4d6e-9266-4a30ae272b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4125ad19724f5995aeaf2887b24213, user_id=8d1daa692d434e6a94144240ba6072c7, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:45.008770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623158f8-866f-4d6e-9266-4a30ae272b72 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:45.041319 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1784/3555] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:44 2022] PUT /identity/v3/projects/cc4125ad19724f5995aeaf2887b24213/users/8d1daa692d434e6a94144240ba6072c7/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:45.043162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623158f8-866f-4d6e-9266-4a30ae272b72 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:45.108695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c782da-3608-40c2-a523-d5a9d8f297c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:45.204586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623158f8-866f-4d6e-9266-4a30ae272b72 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:45.229660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1796ce1-a3fe-4928-9c5c-b1e203b18840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:45.231000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796ce1-a3fe-4928-9c5c-b1e203b18840 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:45.231294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796ce1-a3fe-4928-9c5c-b1e203b18840 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:45.231571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1796ce1-a3fe-4928-9c5c-b1e203b18840 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:45.233211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1796ce1-a3fe-4928-9c5c-b1e203b18840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:45.236125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1796ce1-a3fe-4928-9c5c-b1e203b18840 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:45.257262 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1785/3556] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:45.265935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1796ce1-a3fe-4928-9c5c-b1e203b18840 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:45.287433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c21433-e375-4028-8265-f16c6a04d4b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:45.290998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21433-e375-4028-8265-f16c6a04d4b2 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:45.291863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21433-e375-4028-8265-f16c6a04d4b2 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:45.292353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21433-e375-4028-8265-f16c6a04d4b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:45.293500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1796ce1-a3fe-4928-9c5c-b1e203b18840 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:45.305151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e4c6b-5eb6-48bb-bad1-f585ccc4c821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:45.306051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e4c6b-5eb6-48bb-bad1-f585ccc4c821 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:45.306748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e4c6b-5eb6-48bb-bad1-f585ccc4c821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:45.307050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e4c6b-5eb6-48bb-bad1-f585ccc4c821 admin admin] PATH_INFO: `/v3/projects/cc4125ad19724f5995aeaf2887b24213/users/8d1daa692d434e6a94144240ba6072c7/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:45.311564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e4c6b-5eb6-48bb-bad1-f585ccc4c821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4125ad19724f5995aeaf2887b24213, user_id=8d1daa692d434e6a94144240ba6072c7, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:45.319916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e4c6b-5eb6-48bb-bad1-f585ccc4c821 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:45.346091 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1786/3557] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:45 2022] PUT /identity/v3/projects/cc4125ad19724f5995aeaf2887b24213/users/8d1daa692d434e6a94144240ba6072c7/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:45.356559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475ded4-5368-4fe0-8a16-d347ec491b7e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:45.356773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475ded4-5368-4fe0-8a16-d347ec491b7e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:45.357107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475ded4-5368-4fe0-8a16-d347ec491b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:45.415508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c21433-e375-4028-8265-f16c6a04d4b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:45.417341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c21433-e375-4028-8265-f16c6a04d4b2 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:45.429776 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1772/3558] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:45.457302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b475ded4-5368-4fe0-8a16-d347ec491b7e None None] MFA Rules not processed for user `8d1daa692d434e6a94144240ba6072c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:45.458167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b475ded4-5368-4fe0-8a16-d347ec491b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:45.630391 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1787/3559] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:45.633563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c21433-e375-4028-8265-f16c6a04d4b2 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:45.758755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c21433-e375-4028-8265-f16c6a04d4b2 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:45.769290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5e1a1-a5c7-4d66-9f8b-8b4d61494287 tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1daa692d434e6a94144240ba6072c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc4125ad19724f5995aeaf2887b24213', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:45.770718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5e1a1-a5c7-4d66-9f8b-8b4d61494287 tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:45.771629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5e1a1-a5c7-4d66-9f8b-8b4d61494287 tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:45.772129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5e1a1-a5c7-4d66-9f8b-8b4d61494287 tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:45.773090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5e1a1-a5c7-4d66-9f8b-8b4d61494287 tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:45.776010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5e1a1-a5c7-4d66-9f8b-8b4d61494287 tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:45.841113 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1773/3560] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:45 2022] POST /identity/v3/projects => generated 360 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:45.845420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475ded4-5368-4fe0-8a16-d347ec491b7e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:45.929815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475ded4-5368-4fe0-8a16-d347ec491b7e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:46.007425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6357a8e93af14d4794f5014312d9e261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaef71d160a4be5b8a14e36bc9b7a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:46.008682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:46.008976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:46.009263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] PATH_INFO: `/v3/projects/69ee82abbd65493ab5a3ffb598a1a423` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:46.010762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] RBAC: Authorizing `identity:delete_project(project_id=69ee82abbd65493ab5a3ffb598a1a423)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:46.023732 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Feb 19 20:58:46.028292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1788/3561] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:45 2022] DELETE /identity/v3/projects/69ee82abbd65493ab5a3ffb598a1a423 => generated 136 bytes in 183 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Feb 19 20:58:46.030481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5e1a1-a5c7-4d66-9f8b-8b4d61494287 tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:46.115064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5e1a1-a5c7-4d66-9f8b-8b4d61494287 tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:46.121792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1daa692d434e6a94144240ba6072c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc4125ad19724f5995aeaf2887b24213', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:46.123207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:46.123496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:46.123781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] PATH_INFO: `/v3/projects/69ee82abbd65493ab5a3ffb598a1a423` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:46.125135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69ee82abbd65493ab5a3ffb598a1a423)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:46.127740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:46.188204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ee82abbd65493ab5a3ffb598a1a423', 'request_id': 'req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.195206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ee82abbd65493ab5a3ffb598a1a423', 'request_id': 'req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.204413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ee82abbd65493ab5a3ffb598a1a423', 'request_id': 'req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.218863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] The token cache is being invalidate because project 69ee82abbd65493ab5a3ffb598a1a423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:46.219461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.220828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9b61a376-2ba7-4cd0-8fa4-0e713ee75d2a tempest-ProjectsNegativeTestJSON-2121679905 tempest-ProjectsNegativeTestJSON-2121679905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.222802 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1774/3562] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:46 2022] DELETE /identity/v3/projects/69ee82abbd65493ab5a3ffb598a1a423 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:46.228151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:46.230276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:46.352949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c66d0-a759-4422-9bb4-a8e900260141 tempest-ProjectsNegativeTestJSON-1380390505 tempest-ProjectsNegativeTestJSON-1380390505-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:46.437832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:46.439979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:46.440501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:46.440879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] PATH_INFO: `/v3/users/6357a8e93af14d4794f5014312d9e261` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:46.442656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6357a8e93af14d4794f5014312d9e261)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:46.446113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:46.512534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6357a8e93af14d4794f5014312d9e261'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.530337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6357a8e93af14d4794f5014312d9e261'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.550160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6357a8e93af14d4794f5014312d9e261'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.551818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6357a8e93af14d4794f5014312d9e261'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.553099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6357a8e93af14d4794f5014312d9e261'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:46.583986 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1789/3563] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:46 2022] DELETE /identity/v3/users/6357a8e93af14d4794f5014312d9e261 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:46.586162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f96e8-b408-44d3-a480-d36a95eb8096 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:46.586162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f96e8-b408-44d3-a480-d36a95eb8096 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:46.586749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f96e8-b408-44d3-a480-d36a95eb8096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:46.615842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fd6f96e8-b408-44d3-a480-d36a95eb8096 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:46.617729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fd6f96e8-b408-44d3-a480-d36a95eb8096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:46.701165 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1775/3564] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:46.716421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:46.717932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:46.855930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e90d5c-39e8-4c7f-a4eb-b96f589215b3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:46.865522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e56cdc-5c43-4b07-b57c-9f8d96eb195a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:46.867758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56cdc-5c43-4b07-b57c-9f8d96eb195a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:46.868235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56cdc-5c43-4b07-b57c-9f8d96eb195a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:46.871176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56cdc-5c43-4b07-b57c-9f8d96eb195a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:46.886732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e56cdc-5c43-4b07-b57c-9f8d96eb195a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:46.888411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e56cdc-5c43-4b07-b57c-9f8d96eb195a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:46.900552 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1790/3565] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:47.557516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f96e8-b408-44d3-a480-d36a95eb8096 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:47.559542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fd6f96e8-b408-44d3-a480-d36a95eb8096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:47.586877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f96e8-b408-44d3-a480-d36a95eb8096 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:47.603567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:47.604500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:47.604778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:47.605048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] PATH_INFO: `/v3/projects/afaef71d160a4be5b8a14e36bc9b7a14` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:47.608760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afaef71d160a4be5b8a14e36bc9b7a14)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:47.616428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:47.717931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afaef71d160a4be5b8a14e36bc9b7a14', 'request_id': 'req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:47.737754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afaef71d160a4be5b8a14e36bc9b7a14', 'request_id': 'req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:47.769821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afaef71d160a4be5b8a14e36bc9b7a14', 'request_id': 'req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:47.790756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] The token cache is being invalidate because project afaef71d160a4be5b8a14e36bc9b7a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:47.806653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:47.809160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:47.819187 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1776/3566] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:47 2022] DELETE /identity/v3/projects/afaef71d160a4be5b8a14e36bc9b7a14 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:47.823208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e56cdc-5c43-4b07-b57c-9f8d96eb195a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:47.841325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e56cdc-5c43-4b07-b57c-9f8d96eb195a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:47.950972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:47.952482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:47.952765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:47.953548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] PATH_INFO: `/v3/users/8d1daa692d434e6a94144240ba6072c7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:47.954816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1daa692d434e6a94144240ba6072c7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:47.957917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:48.036321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1daa692d434e6a94144240ba6072c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:48.054350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1daa692d434e6a94144240ba6072c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:48.065615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1daa692d434e6a94144240ba6072c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:48.068192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1daa692d434e6a94144240ba6072c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:48.069264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41385404-d95d-46fd-bb70-3215c05a7f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1daa692d434e6a94144240ba6072c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:48.089533 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1791/3567] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:47 2022] DELETE /identity/v3/users/8d1daa692d434e6a94144240ba6072c7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:48.652103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:48.654258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:48.691495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1e3a2-f25f-452e-a518-7ad8d7fa6b1c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:48.895451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:48.896762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:48.899446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:48.901799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] PATH_INFO: `/v3/projects/cc4125ad19724f5995aeaf2887b24213` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:48.908303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4125ad19724f5995aeaf2887b24213)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:48.911354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:49.036882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4125ad19724f5995aeaf2887b24213', 'request_id': 'req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:49.055381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4125ad19724f5995aeaf2887b24213', 'request_id': 'req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:49.071507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4125ad19724f5995aeaf2887b24213', 'request_id': 'req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:49.103801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] The token cache is being invalidate because project cc4125ad19724f5995aeaf2887b24213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:49.104104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:49.105868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b4dceceb-3fb3-45a9-ad54-d4b6f385ad19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:49.113967 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1777/3568] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:48 2022] DELETE /identity/v3/projects/cc4125ad19724f5995aeaf2887b24213 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:49.119175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d6ec-3cd2-4956-a674-70f06a2f43f0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.119784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d6ec-3cd2-4956-a674-70f06a2f43f0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.119784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d6ec-3cd2-4956-a674-70f06a2f43f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:49.152713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-40b0d6ec-3cd2-4956-a674-70f06a2f43f0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:49.156322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-40b0d6ec-3cd2-4956-a674-70f06a2f43f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:49.333326 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1792/3569] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:49.336299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a48e0-1c25-49a6-a369-5605b45e971e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.337137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a48e0-1c25-49a6-a369-5605b45e971e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.337436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a48e0-1c25-49a6-a369-5605b45e971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:49.366957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0b4a48e0-1c25-49a6-a369-5605b45e971e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:49.368565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0b4a48e0-1c25-49a6-a369-5605b45e971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:49.384387 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1778/3570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:49.387223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0d6ec-3cd2-4956-a674-70f06a2f43f0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:49.405389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0d6ec-3cd2-4956-a674-70f06a2f43f0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:49.412318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:49.413397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.413991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.414513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:49.416047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:49.416761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:49.418637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:49.444417 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1793/3571] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:49.446762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a48e0-1c25-49a6-a369-5605b45e971e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:49.475797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a48e0-1c25-49a6-a369-5605b45e971e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:49.484350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eed47-fd93-4767-80b7-61f3125bbcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:49.484609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eed47-fd93-4767-80b7-61f3125bbcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.484969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eed47-fd93-4767-80b7-61f3125bbcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.485275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eed47-fd93-4767-80b7-61f3125bbcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:49.486697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eed47-fd93-4767-80b7-61f3125bbcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:49.490092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eed47-fd93-4767-80b7-61f3125bbcf2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:49.570255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:49.571204 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1779/3572] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:49 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:49.582155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57562b5-2465-40ce-9836-35018d478670 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:49.703057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e8bfe-1342-4975-aaa5-59528c57b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:49.704272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8bfe-1342-4975-aaa5-59528c57b795 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.704599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8bfe-1342-4975-aaa5-59528c57b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.704936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8bfe-1342-4975-aaa5-59528c57b795 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:49.706090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e8bfe-1342-4975-aaa5-59528c57b795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:49.708129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e8bfe-1342-4975-aaa5-59528c57b795 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:49.746992 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1794/3573] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:49 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:49.751643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eed47-fd93-4767-80b7-61f3125bbcf2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:49.763452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eed47-fd93-4767-80b7-61f3125bbcf2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:49.769426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701785a2-2890-4f88-806c-211d583b5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:49.770171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701785a2-2890-4f88-806c-211d583b5d94 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.770533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701785a2-2890-4f88-806c-211d583b5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.770888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701785a2-2890-4f88-806c-211d583b5d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:49.771729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701785a2-2890-4f88-806c-211d583b5d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:49.773729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701785a2-2890-4f88-806c-211d583b5d94 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:49.793643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e8bfe-1342-4975-aaa5-59528c57b795 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:49.800663 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1780/3574] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:49.805016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e8bfe-1342-4975-aaa5-59528c57b795 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:49.811682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0580ac1-94d0-4d1e-a7a3-bde0de90d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:49.813293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580ac1-94d0-4d1e-a7a3-bde0de90d1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.813742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580ac1-94d0-4d1e-a7a3-bde0de90d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.814185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580ac1-94d0-4d1e-a7a3-bde0de90d1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:49.815320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0580ac1-94d0-4d1e-a7a3-bde0de90d1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:49.817437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0580ac1-94d0-4d1e-a7a3-bde0de90d1b5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:49.833944 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1795/3575] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:49.835790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701785a2-2890-4f88-806c-211d583b5d94 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:49.860771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701785a2-2890-4f88-806c-211d583b5d94 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:49.875606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9edbb-b863-48ce-9bb1-12c10d4f447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:49.879315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9edbb-b863-48ce-9bb1-12c10d4f447e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.879673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9edbb-b863-48ce-9bb1-12c10d4f447e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.879960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9edbb-b863-48ce-9bb1-12c10d4f447e admin admin] PATH_INFO: `/v3/projects/0fca2d4f883b4eccad1aae17ff04253f/users/68d558d376c2485f9886acae35cc895b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:49.913212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9edbb-b863-48ce-9bb1-12c10d4f447e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fca2d4f883b4eccad1aae17ff04253f, user_id=68d558d376c2485f9886acae35cc895b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:49.917375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9edbb-b863-48ce-9bb1-12c10d4f447e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:49.939567 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1781/3576] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:49 2022] PUT /identity/v3/projects/0fca2d4f883b4eccad1aae17ff04253f/users/68d558d376c2485f9886acae35cc895b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:49.951703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32ef33-82f2-4d82-9d89-f22d5c4d73bb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:49.951998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32ef33-82f2-4d82-9d89-f22d5c4d73bb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:49.952349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32ef33-82f2-4d82-9d89-f22d5c4d73bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:50.021796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9b32ef33-82f2-4d82-9d89-f22d5c4d73bb None None] MFA Rules not processed for user `68d558d376c2485f9886acae35cc895b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:50.023131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9b32ef33-82f2-4d82-9d89-f22d5c4d73bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:50.180902 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1796/3577] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:50.185136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9edbb-b863-48ce-9bb1-12c10d4f447e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:50.420395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9edbb-b863-48ce-9bb1-12c10d4f447e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:50.434616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134ff35-6e20-4100-9fc2-3a41b5c07e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:50.435222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ff35-6e20-4100-9fc2-3a41b5c07e02 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:50.435493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ff35-6e20-4100-9fc2-3a41b5c07e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:50.435778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ff35-6e20-4100-9fc2-3a41b5c07e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:50.436563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134ff35-6e20-4100-9fc2-3a41b5c07e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:50.448834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134ff35-6e20-4100-9fc2-3a41b5c07e02 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:50.497328 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1782/3578] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:50 2022] POST /identity/v3/projects => generated 367 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:50.498713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32ef33-82f2-4d82-9d89-f22d5c4d73bb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:50.520318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32ef33-82f2-4d82-9d89-f22d5c4d73bb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:50.743394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad45cf-57a3-4531-bb2e-8d713348e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:50.744084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad45cf-57a3-4531-bb2e-8d713348e83d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:50.744384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad45cf-57a3-4531-bb2e-8d713348e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:50.744752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad45cf-57a3-4531-bb2e-8d713348e83d admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:50.745439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad45cf-57a3-4531-bb2e-8d713348e83d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:50.747416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad45cf-57a3-4531-bb2e-8d713348e83d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:50.794261 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1797/3579] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:50 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:50.798712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134ff35-6e20-4100-9fc2-3a41b5c07e02 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:50.811039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134ff35-6e20-4100-9fc2-3a41b5c07e02 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:50.824500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7338d8-c298-4381-bc40-0704029e0ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:50.825299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7338d8-c298-4381-bc40-0704029e0ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:50.825677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7338d8-c298-4381-bc40-0704029e0ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:50.826219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7338d8-c298-4381-bc40-0704029e0ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:50.827178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7338d8-c298-4381-bc40-0704029e0ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:50.833832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7338d8-c298-4381-bc40-0704029e0ef5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:50.862984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad45cf-57a3-4531-bb2e-8d713348e83d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:50.863733 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1783/3580] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:50.877985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad45cf-57a3-4531-bb2e-8d713348e83d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:50.893929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add2df-a30e-4376-b087-e3ecbc623bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:50.895110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add2df-a30e-4376-b087-e3ecbc623bed admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:50.895580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add2df-a30e-4376-b087-e3ecbc623bed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:50.896054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add2df-a30e-4376-b087-e3ecbc623bed admin admin] PATH_INFO: `/v3/projects/dde717f283984458842f4df165074ea0/users/c7e94f40f5864945a26f03b2071a2233/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:50.927228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add2df-a30e-4376-b087-e3ecbc623bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde717f283984458842f4df165074ea0, user_id=c7e94f40f5864945a26f03b2071a2233, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:50.929930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add2df-a30e-4376-b087-e3ecbc623bed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:50.947099 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1798/3581] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:50 2022] PUT /identity/v3/projects/dde717f283984458842f4df165074ea0/users/c7e94f40f5864945a26f03b2071a2233/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:50.951490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7338d8-c298-4381-bc40-0704029e0ef5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:50.965670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7338d8-c298-4381-bc40-0704029e0ef5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.031933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165bd8f-792e-42e8-b194-fdf782ff73e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.035349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165bd8f-792e-42e8-b194-fdf782ff73e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.035349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165bd8f-792e-42e8-b194-fdf782ff73e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.035349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165bd8f-792e-42e8-b194-fdf782ff73e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.035349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165bd8f-792e-42e8-b194-fdf782ff73e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.035815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165bd8f-792e-42e8-b194-fdf782ff73e0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:51.053971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add2df-a30e-4376-b087-e3ecbc623bed admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:51.065621 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1784/3582] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:51.066905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add2df-a30e-4376-b087-e3ecbc623bed admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.072499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029ed04-a6be-4bb8-bb32-b95c4e7b717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.073393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029ed04-a6be-4bb8-bb32-b95c4e7b717f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.073677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029ed04-a6be-4bb8-bb32-b95c4e7b717f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.073952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029ed04-a6be-4bb8-bb32-b95c4e7b717f admin admin] PATH_INFO: `/v3/projects/dde717f283984458842f4df165074ea0/users/c7e94f40f5864945a26f03b2071a2233/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.076996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029ed04-a6be-4bb8-bb32-b95c4e7b717f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde717f283984458842f4df165074ea0, user_id=c7e94f40f5864945a26f03b2071a2233, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.081521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029ed04-a6be-4bb8-bb32-b95c4e7b717f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:51.112672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b257494-334d-4e62-af38-8f004c5843c5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.113034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b257494-334d-4e62-af38-8f004c5843c5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.113224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b257494-334d-4e62-af38-8f004c5843c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.114853 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1799/3583] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:51 2022] PUT /identity/v3/projects/dde717f283984458842f4df165074ea0/users/c7e94f40f5864945a26f03b2071a2233/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:51.163141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2b257494-334d-4e62-af38-8f004c5843c5 None None] MFA Rules not processed for user `c7e94f40f5864945a26f03b2071a2233`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:51.165006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2b257494-334d-4e62-af38-8f004c5843c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:51.177879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2607c3-f46e-49c9-971d-6a2ffe48dfd1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.178160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2607c3-f46e-49c9-971d-6a2ffe48dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.178618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2607c3-f46e-49c9-971d-6a2ffe48dfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.210237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4c2607c3-f46e-49c9-971d-6a2ffe48dfd1 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:51.213534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4c2607c3-f46e-49c9-971d-6a2ffe48dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:51.324116 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1800/3584] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:58:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:58:51.340798 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1785/3585] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:51.344436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2607c3-f46e-49c9-971d-6a2ffe48dfd1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:51.345379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b257494-334d-4e62-af38-8f004c5843c5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:51.351986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4c2607c3-f46e-49c9-971d-6a2ffe48dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:51.394856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b257494-334d-4e62-af38-8f004c5843c5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.411061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad42e-a5c7-42df-b63c-638af9630568 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.413402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad42e-a5c7-42df-b63c-638af9630568 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.414557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad42e-a5c7-42df-b63c-638af9630568 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.415894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad42e-a5c7-42df-b63c-638af9630568 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.417397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ad42e-a5c7-42df-b63c-638af9630568 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.434826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ad42e-a5c7-42df-b63c-638af9630568 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:51.468241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1786/3586] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 20:58:51 2022] POST /identity/v3/services => generated 239 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:51.472168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad42e-a5c7-42df-b63c-638af9630568 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:51.506257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad42e-a5c7-42df-b63c-638af9630568 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.513445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.514377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.514829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.514996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services/1dd943baad794a61ad05d77e36a99000` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.516265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1dd943baad794a61ad05d77e36a99000)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.517590 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:51.517590 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 20:58:51.517590 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 20:58:51.518471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:51.576939 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1787/3587] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:51 2022] DELETE /identity/v3/services/1dd943baad794a61ad05d77e36a99000 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:51.578441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2607c3-f46e-49c9-971d-6a2ffe48dfd1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.589587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:51.619742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba51ac9-4b6b-43c5-9d7f-a289a1809ccd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.621365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba51ac9-4b6b-43c5-9d7f-a289a1809ccd service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.622789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba51ac9-4b6b-43c5-9d7f-a289a1809ccd service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.623527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba51ac9-4b6b-43c5-9d7f-a289a1809ccd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.646678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba51ac9-4b6b-43c5-9d7f-a289a1809ccd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.648859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba51ac9-4b6b-43c5-9d7f-a289a1809ccd service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:51.658383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c395c-3aa7-425f-a5c6-86d88ea6c9d5 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.670146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaae8b2-c22f-447d-af06-faeee2ace02e tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.670838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaae8b2-c22f-447d-af06-faeee2ace02e tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.671132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaae8b2-c22f-447d-af06-faeee2ace02e tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.672205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaae8b2-c22f-447d-af06-faeee2ace02e tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.675253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaae8b2-c22f-447d-af06-faeee2ace02e tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.676999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaae8b2-c22f-447d-af06-faeee2ace02e tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:51.681074 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1801/3588] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:58:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:51.713423 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1788/3589] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:51 2022] POST /identity/v3/services => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:51.715882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba51ac9-4b6b-43c5-9d7f-a289a1809ccd service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:51.731642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba51ac9-4b6b-43c5-9d7f-a289a1809ccd service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.769060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.770827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.772230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.772722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services/26f326cbfcd046d69c433395db3427ed` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.774290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:update_service(service_id=26f326cbfcd046d69c433395db3427ed)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.779078 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:51.779078 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:58:51.779078 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:58:51.781530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:51.817678 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1802/3590] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Feb 19 20:58:51 2022] PATCH /identity/v3/services/26f326cbfcd046d69c433395db3427ed => generated 279 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:51.819061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaae8b2-c22f-447d-af06-faeee2ace02e tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:51.832221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaae8b2-c22f-447d-af06-faeee2ace02e tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.900276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014769a-1542-40d6-b129-744edf634a1a tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.901493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014769a-1542-40d6-b129-744edf634a1a tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.907197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014769a-1542-40d6-b129-744edf634a1a tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.910591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014769a-1542-40d6-b129-744edf634a1a tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services/26f326cbfcd046d69c433395db3427ed` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.911544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014769a-1542-40d6-b129-744edf634a1a tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:get_service(service_id=26f326cbfcd046d69c433395db3427ed)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.913385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014769a-1542-40d6-b129-744edf634a1a tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:51.940652 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1789/3591] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:51 2022] GET /identity/v3/services/26f326cbfcd046d69c433395db3427ed => generated 279 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:51.944771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:51.957945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5cd9-c020-4365-830a-de3b383a17cc tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:51.990146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:51.992219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:51.992762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:51.993307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services/26f326cbfcd046d69c433395db3427ed` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:51.994200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:delete_service(service_id=26f326cbfcd046d69c433395db3427ed)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:51.995452 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:51.995452 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 20:58:51.995452 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 20:58:51.996792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.046736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783090f-a8c7-48f5-910b-99f14395f164 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.047183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783090f-a8c7-48f5-910b-99f14395f164 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.047548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783090f-a8c7-48f5-910b-99f14395f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.067735 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1803/3592] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:51 2022] DELETE /identity/v3/services/26f326cbfcd046d69c433395db3427ed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:52.069016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.079060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9783090f-a8c7-48f5-910b-99f14395f164 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:52.082225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9783090f-a8c7-48f5-910b-99f14395f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:52.100138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9fad5-40f2-4ec3-a1c9-01a0afe3ce75 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.106312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.107220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.107505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.107780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services/26f326cbfcd046d69c433395db3427ed` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.108528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:get_service(service_id=26f326cbfcd046d69c433395db3427ed)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.111707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.121523 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1790/3593] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:52.133933 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Could not find service: 26f326cbfcd046d69c433395db3427ed.: keystone.exception.ServiceNotFound: Could not find service: 26f326cbfcd046d69c433395db3427ed. Feb 19 20:58:52.140704 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1804/3594] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 20:58:52 2022] GET /identity/v3/services/26f326cbfcd046d69c433395db3427ed => generated 113 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 20:58:52.141181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783090f-a8c7-48f5-910b-99f14395f164 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.168013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.169426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783090f-a8c7-48f5-910b-99f14395f164 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.185238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359b00d-85b3-4bd3-bb80-4dbcd5e61a35 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.186023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359b00d-85b3-4bd3-bb80-4dbcd5e61a35 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.186382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359b00d-85b3-4bd3-bb80-4dbcd5e61a35 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.186732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359b00d-85b3-4bd3-bb80-4dbcd5e61a35 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.188105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359b00d-85b3-4bd3-bb80-4dbcd5e61a35 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.189824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359b00d-85b3-4bd3-bb80-4dbcd5e61a35 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.216318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e374-ae49-4cea-9c44-6ad7adbdd7c2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.223650 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1791/3595] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:52 2022] POST /identity/v3/services => generated 275 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:58:52.226716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359b00d-85b3-4bd3-bb80-4dbcd5e61a35 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.261615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8520ebc-2fa7-4ab5-a425-5441e1d4334d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.264894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8520ebc-2fa7-4ab5-a425-5441e1d4334d service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.266178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8520ebc-2fa7-4ab5-a425-5441e1d4334d service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.266178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8520ebc-2fa7-4ab5-a425-5441e1d4334d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.275492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359b00d-85b3-4bd3-bb80-4dbcd5e61a35 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.282463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8520ebc-2fa7-4ab5-a425-5441e1d4334d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.284727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8520ebc-2fa7-4ab5-a425-5441e1d4334d service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.289619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0eb4f-2dfc-4c69-9e3c-dfc0bf0d777f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.289619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0eb4f-2dfc-4c69-9e3c-dfc0bf0d777f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.289619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0eb4f-2dfc-4c69-9e3c-dfc0bf0d777f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.290019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0eb4f-2dfc-4c69-9e3c-dfc0bf0d777f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.290019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0eb4f-2dfc-4c69-9e3c-dfc0bf0d777f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.294708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0eb4f-2dfc-4c69-9e3c-dfc0bf0d777f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.306798 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1805/3596] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:58:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:52.320224 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1792/3597] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:52 2022] POST /identity/v3/services => generated 274 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:52.324306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8520ebc-2fa7-4ab5-a425-5441e1d4334d service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.339134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8520ebc-2fa7-4ab5-a425-5441e1d4334d service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.360523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52272559-4349-4586-92fe-ca4521375a29 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.361246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52272559-4349-4586-92fe-ca4521375a29 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.361534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52272559-4349-4586-92fe-ca4521375a29 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.361809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52272559-4349-4586-92fe-ca4521375a29 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.363272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52272559-4349-4586-92fe-ca4521375a29 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.365378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52272559-4349-4586-92fe-ca4521375a29 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.402027 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1806/3598] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:52 2022] POST /identity/v3/services => generated 275 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:52.406163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0eb4f-2dfc-4c69-9e3c-dfc0bf0d777f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.425276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0eb4f-2dfc-4c69-9e3c-dfc0bf0d777f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.454764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea260-dece-4802-87f8-a6b97cd680e1 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.455555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea260-dece-4802-87f8-a6b97cd680e1 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.460094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea260-dece-4802-87f8-a6b97cd680e1 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.460541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea260-dece-4802-87f8-a6b97cd680e1 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.461379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bea260-dece-4802-87f8-a6b97cd680e1 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.463222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bea260-dece-4802-87f8-a6b97cd680e1 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.486622 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1793/3599] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 20:58:52 2022] GET /identity/v3/services => generated 2979 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:52.490760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52272559-4349-4586-92fe-ca4521375a29 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.505160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52272559-4349-4586-92fe-ca4521375a29 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.517051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.518105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.518105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.518354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.519443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1396596496) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:52.519850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.527646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.535433 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1807/3600] 10.222.0.30 () {58 vars in 1221 bytes} [Sat Feb 19 20:58:52 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1396596496 => generated 418 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:52.540153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea260-dece-4802-87f8-a6b97cd680e1 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.557550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea260-dece-4802-87f8-a6b97cd680e1 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.570472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.571549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.572059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.572700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.573634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1949040584) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:52.574167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.576102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.591671 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1794/3601] 10.222.0.30 () {58 vars in 1221 bytes} [Sat Feb 19 20:58:52 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1949040584 => generated 417 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:52.595518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.606771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dda696-4826-43ab-a9e4-e1ae8ae47e15 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.618545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.619335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.619706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.620441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.621398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1103544550) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:52.622076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.624155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.633677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1808/3602] 10.222.0.30 () {58 vars in 1221 bytes} [Sat Feb 19 20:58:52 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1103544550 => generated 418 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:52.637159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.650766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a7e33-6245-4c53-94cb-6111a652411f tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.665117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6af4e3-26af-46c9-b515-84e2991762d8 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.666106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af4e3-26af-46c9-b515-84e2991762d8 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.666489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af4e3-26af-46c9-b515-84e2991762d8 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.666866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af4e3-26af-46c9-b515-84e2991762d8 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services/ec52f17e249a4d068063a8d87ee5d68b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.667632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6af4e3-26af-46c9-b515-84e2991762d8 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ec52f17e249a4d068063a8d87ee5d68b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.676764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6af4e3-26af-46c9-b515-84e2991762d8 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.711453 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1795/3603] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:52 2022] DELETE /identity/v3/services/ec52f17e249a4d068063a8d87ee5d68b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:52.715703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.742074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730550f-73e3-4063-8844-d504d81b1562 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.793128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349121e-b796-41f2-b410-b1a104237897 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.796845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349121e-b796-41f2-b410-b1a104237897 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.797109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349121e-b796-41f2-b410-b1a104237897 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.797587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349121e-b796-41f2-b410-b1a104237897 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services/dc45c8bfd49d4fa5a6589155cee14ca0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.801112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349121e-b796-41f2-b410-b1a104237897 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:delete_service(service_id=dc45c8bfd49d4fa5a6589155cee14ca0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.807784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349121e-b796-41f2-b410-b1a104237897 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:52.853658 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1809/3604] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:52 2022] DELETE /identity/v3/services/dc45c8bfd49d4fa5a6589155cee14ca0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:52.858303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6af4e3-26af-46c9-b515-84e2991762d8 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:52.878311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6af4e3-26af-46c9-b515-84e2991762d8 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:52.944116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883340b-f146-4e92-81ce-c0b84ee87fd2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e94f40f5864945a26f03b2071a2233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde717f283984458842f4df165074ea0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:52.947231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883340b-f146-4e92-81ce-c0b84ee87fd2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:52.947914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883340b-f146-4e92-81ce-c0b84ee87fd2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:52.948392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883340b-f146-4e92-81ce-c0b84ee87fd2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] PATH_INFO: `/v3/services/a043bba825b74f46b73dd67023fcf54c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:52.949306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883340b-f146-4e92-81ce-c0b84ee87fd2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a043bba825b74f46b73dd67023fcf54c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:52.952566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883340b-f146-4e92-81ce-c0b84ee87fd2 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:53.004586 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1796/3605] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:52 2022] DELETE /identity/v3/services/a043bba825b74f46b73dd67023fcf54c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:53.006280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349121e-b796-41f2-b410-b1a104237897 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:53.164168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349121e-b796-41f2-b410-b1a104237897 tempest-ServicesTestJSON-475097692 tempest-ServicesTestJSON-475097692-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:53.205939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:53.207639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:53.208462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:53.208906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] PATH_INFO: `/v3/users/68d558d376c2485f9886acae35cc895b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:53.211076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d558d376c2485f9886acae35cc895b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:53.213605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:53.295480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d558d376c2485f9886acae35cc895b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:53.309873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d558d376c2485f9886acae35cc895b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:53.348297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d558d376c2485f9886acae35cc895b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:53.349528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d558d376c2485f9886acae35cc895b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:53.350945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d558d376c2485f9886acae35cc895b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:53.387982 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1810/3606] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:53 2022] DELETE /identity/v3/users/68d558d376c2485f9886acae35cc895b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:53.393060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de833-b775-458b-b809-dd0ecbafe278 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:53.393459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de833-b775-458b-b809-dd0ecbafe278 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:53.393869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de833-b775-458b-b809-dd0ecbafe278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:53.424309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f60de833-b775-458b-b809-dd0ecbafe278 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:53.431276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f60de833-b775-458b-b809-dd0ecbafe278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:53.596539 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1797/3607] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:53.635510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:53.637560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:53.797484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ecbad-b66f-405d-b2c1-03ffe93f48c8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:53.810641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:53.811431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:53.811724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:53.812763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:53.835461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:53.837170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:53.866274 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1811/3608] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:54.344174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de833-b775-458b-b809-dd0ecbafe278 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:54.345791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f60de833-b775-458b-b809-dd0ecbafe278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:54.388631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de833-b775-458b-b809-dd0ecbafe278 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:54.409078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:54.411231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:54.413904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:54.414370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] PATH_INFO: `/v3/users/351aab489ec74b039337b89d216e3c0e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:54.416648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=351aab489ec74b039337b89d216e3c0e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:54.427481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:54.470643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:54.473107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:54.513111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedbe94-ba4c-4769-830d-87145c2e38fd service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:54.540058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:54.544290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:54.547226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:54.547715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] PATH_INFO: `/v3/projects/0fca2d4f883b4eccad1aae17ff04253f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:54.555121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fca2d4f883b4eccad1aae17ff04253f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:54.561563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:54.568149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351aab489ec74b039337b89d216e3c0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.572932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351aab489ec74b039337b89d216e3c0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.573624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351aab489ec74b039337b89d216e3c0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.633277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351aab489ec74b039337b89d216e3c0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.652219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bcd802a1-fe71-4001-838b-f7d76fb7a65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351aab489ec74b039337b89d216e3c0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.676136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fca2d4f883b4eccad1aae17ff04253f', 'request_id': 'req-055d6aee-1929-4ee6-80e4-4b956c49ae59'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.678936 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1798/3609] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:54 2022] DELETE /identity/v3/users/351aab489ec74b039337b89d216e3c0e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:58:54.682671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa271d-7616-455c-986a-1a96c433171e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:54.684525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa271d-7616-455c-986a-1a96c433171e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:54.684985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa271d-7616-455c-986a-1a96c433171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:54.704986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fca2d4f883b4eccad1aae17ff04253f', 'request_id': 'req-055d6aee-1929-4ee6-80e4-4b956c49ae59'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.736628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fca2d4f883b4eccad1aae17ff04253f', 'request_id': 'req-055d6aee-1929-4ee6-80e4-4b956c49ae59'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.739477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-63fa271d-7616-455c-986a-1a96c433171e None None] MFA Rules not processed for user `5a3a1e86138d41b991f5e44a1e8ae2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:54.745067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-63fa271d-7616-455c-986a-1a96c433171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:54.754255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] The token cache is being invalidate because project 0fca2d4f883b4eccad1aae17ff04253f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:54.754822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.755772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-055d6aee-1929-4ee6-80e4-4b956c49ae59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:54.761659 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1812/3610] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:54 2022] DELETE /identity/v3/projects/0fca2d4f883b4eccad1aae17ff04253f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:54.765702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea80d-9cde-49f9-8bdd-bcb883395b3b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:54.768476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea80d-9cde-49f9-8bdd-bcb883395b3b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:54.768967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea80d-9cde-49f9-8bdd-bcb883395b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:54.804762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4caea80d-9cde-49f9-8bdd-bcb883395b3b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:54.807905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4caea80d-9cde-49f9-8bdd-bcb883395b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:54.913539 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1799/3611] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:54.915024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa271d-7616-455c-986a-1a96c433171e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:54.916445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-63fa271d-7616-455c-986a-1a96c433171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:54.972680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1813/3612] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:55.000112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caea80d-9cde-49f9-8bdd-bcb883395b3b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:55.001604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4caea80d-9cde-49f9-8bdd-bcb883395b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:55.055139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa271d-7616-455c-986a-1a96c433171e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:55.070586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:55.071478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:55.071752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:55.072024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] PATH_INFO: `/v3/users/c7e94f40f5864945a26f03b2071a2233` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:55.073296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e94f40f5864945a26f03b2071a2233)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:55.076309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:55.138964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caea80d-9cde-49f9-8bdd-bcb883395b3b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:55.149791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:55.150485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:55.152730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:55.153031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:55.162839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e94f40f5864945a26f03b2071a2233'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:55.166849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e94f40f5864945a26f03b2071a2233'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:55.168001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e94f40f5864945a26f03b2071a2233'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:55.178448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:55.181434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:55.203499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e94f40f5864945a26f03b2071a2233'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:55.212590 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1814/3613] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:58:55.229195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e94f40f5864945a26f03b2071a2233'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:55.261662 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1800/3614] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:54 2022] DELETE /identity/v3/users/c7e94f40f5864945a26f03b2071a2233 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:56.215468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:56.217274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:56.242419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fded40-c3cd-41df-969f-a4680881b13f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:56.351399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:56.356362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:56.400102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:56.405304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:56.406668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:56.407872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] PATH_INFO: `/v3/projects/a8c68ae4f3aa48ab8478d0a4019dd481` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:56.411167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c68ae4f3aa48ab8478d0a4019dd481)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:56.415254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:56.553204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a912-29c3-4276-b74b-faa71c601cf7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:56.568203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c68ae4f3aa48ab8478d0a4019dd481', 'request_id': 'req-f8e24bb3-6430-46fa-9a06-926582a5f430'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.594989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c68ae4f3aa48ab8478d0a4019dd481', 'request_id': 'req-f8e24bb3-6430-46fa-9a06-926582a5f430'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.628154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c68ae4f3aa48ab8478d0a4019dd481', 'request_id': 'req-f8e24bb3-6430-46fa-9a06-926582a5f430'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.654070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] The token cache is being invalidate because project a8c68ae4f3aa48ab8478d0a4019dd481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:56.654426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.655242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8e24bb3-6430-46fa-9a06-926582a5f430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.659518 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1815/3615] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:56 2022] DELETE /identity/v3/projects/a8c68ae4f3aa48ab8478d0a4019dd481 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:56.666228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20b03-6e31-4d95-8e87-a3579b3a4e1a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:56.666679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20b03-6e31-4d95-8e87-a3579b3a4e1a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:56.667220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20b03-6e31-4d95-8e87-a3579b3a4e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:56.700403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-28c20b03-6e31-4d95-8e87-a3579b3a4e1a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:56.700403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-28c20b03-6e31-4d95-8e87-a3579b3a4e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:56.701589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:56.702490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:56.702772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:56.703048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] PATH_INFO: `/v3/projects/dde717f283984458842f4df165074ea0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:56.705030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde717f283984458842f4df165074ea0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:56.706725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:56.740171 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1816/3616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:56.749499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2b2b-45de-4af0-9adf-33fa892d5f8f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:56.750184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2b2b-45de-4af0-9adf-33fa892d5f8f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:56.751541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2b2b-45de-4af0-9adf-33fa892d5f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:56.791066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde717f283984458842f4df165074ea0', 'request_id': 'req-94107393-821c-47e5-8296-3eaab67a6eb1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.800236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde717f283984458842f4df165074ea0', 'request_id': 'req-94107393-821c-47e5-8296-3eaab67a6eb1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.825437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-29cd2b2b-45de-4af0-9adf-33fa892d5f8f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:56.826991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-29cd2b2b-45de-4af0-9adf-33fa892d5f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:56.843722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde717f283984458842f4df165074ea0', 'request_id': 'req-94107393-821c-47e5-8296-3eaab67a6eb1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.860585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] The token cache is being invalidate because project dde717f283984458842f4df165074ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:58:56.861189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.862035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94107393-821c-47e5-8296-3eaab67a6eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:56.869598 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1801/3617] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:56 2022] DELETE /identity/v3/projects/dde717f283984458842f4df165074ea0 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:56.871676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cea5fa-4df0-4160-8a24-3c0d14cae7b4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:56.872181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cea5fa-4df0-4160-8a24-3c0d14cae7b4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:56.872640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cea5fa-4df0-4160-8a24-3c0d14cae7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:56.928527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-47cea5fa-4df0-4160-8a24-3c0d14cae7b4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:56.930092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-47cea5fa-4df0-4160-8a24-3c0d14cae7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:56.941149 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1817/3618] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:56.946571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2b2b-45de-4af0-9adf-33fa892d5f8f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:56.971469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1802/3619] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:56.971693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2b2b-45de-4af0-9adf-33fa892d5f8f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:56.973506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15d28-e534-4f7a-b318-ddba226bf720 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:56.974580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15d28-e534-4f7a-b318-ddba226bf720 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:56.975259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15d28-e534-4f7a-b318-ddba226bf720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:56.985636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:56.986462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:56.986852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:56.987252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:56.988245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:56.988690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:56.990530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.005673 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1818/3620] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:57.010746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.022628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-14d15d28-e534-4f7a-b318-ddba226bf720 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:57.026599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8334f-3303-49e6-a248-203f291422b3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.027961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-14d15d28-e534-4f7a-b318-ddba226bf720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:57.035066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2340-bc5e-4b2c-b651-54c8ab14561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.037607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2340-bc5e-4b2c-b651-54c8ab14561a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.038015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2340-bc5e-4b2c-b651-54c8ab14561a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.038468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2340-bc5e-4b2c-b651-54c8ab14561a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.040389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2340-bc5e-4b2c-b651-54c8ab14561a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.048821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2340-bc5e-4b2c-b651-54c8ab14561a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.049032 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1803/3621] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:57.050033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d15d28-e534-4f7a-b318-ddba226bf720 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.076614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d15d28-e534-4f7a-b318-ddba226bf720 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.089653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.091756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.092241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.092637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.094271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:58:57.094735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.097005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.112530 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1819/3622] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:57 2022] POST /identity/v3/projects => generated 397 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:57.116297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2340-bc5e-4b2c-b651-54c8ab14561a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.138983 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1804/3623] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:58:57.141219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.164643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acdc28-50eb-438d-8a1a-766c399e9dcf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.275715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2340-bc5e-4b2c-b651-54c8ab14561a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.288642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162925d6-1574-471d-994e-e7a00934bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.289531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162925d6-1574-471d-994e-e7a00934bf51 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.291270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162925d6-1574-471d-994e-e7a00934bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.291270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162925d6-1574-471d-994e-e7a00934bf51 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.292905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162925d6-1574-471d-994e-e7a00934bf51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.295986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162925d6-1574-471d-994e-e7a00934bf51 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.345605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7116-018b-48da-8234-9167fce76a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.346654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7116-018b-48da-8234-9167fce76a3d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.346929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7116-018b-48da-8234-9167fce76a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.347217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7116-018b-48da-8234-9167fce76a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.348372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d7116-018b-48da-8234-9167fce76a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.349953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d7116-018b-48da-8234-9167fce76a3d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.362119 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1820/3624] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:57 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:57.363491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162925d6-1574-471d-994e-e7a00934bf51 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.386281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162925d6-1574-471d-994e-e7a00934bf51 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.401171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955072a-b20b-45a0-9f82-76a3f4098a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.402490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955072a-b20b-45a0-9f82-76a3f4098a15 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.402737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955072a-b20b-45a0-9f82-76a3f4098a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.403267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955072a-b20b-45a0-9f82-76a3f4098a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.405889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955072a-b20b-45a0-9f82-76a3f4098a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.407990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955072a-b20b-45a0-9f82-76a3f4098a15 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.426065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1821/3625] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:57.428746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955072a-b20b-45a0-9f82-76a3f4098a15 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.432678 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1805/3626] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:58:57 2022] POST /identity/v3/projects => generated 361 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:57.434257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7116-018b-48da-8234-9167fce76a3d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.458836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955072a-b20b-45a0-9f82-76a3f4098a15 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.610732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d890acc-397d-4144-9470-3efe27324e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.613113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890acc-397d-4144-9470-3efe27324e8d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.613528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890acc-397d-4144-9470-3efe27324e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.613920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890acc-397d-4144-9470-3efe27324e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.614778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d890acc-397d-4144-9470-3efe27324e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.620484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d890acc-397d-4144-9470-3efe27324e8d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.636238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7116-018b-48da-8234-9167fce76a3d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.651288 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1822/3627] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:57.653254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d890acc-397d-4144-9470-3efe27324e8d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.662951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d3a9d-56b8-497c-9272-37c6a3cdf3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.663747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d3a9d-56b8-497c-9272-37c6a3cdf3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.664016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d3a9d-56b8-497c-9272-37c6a3cdf3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.664640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d3a9d-56b8-497c-9272-37c6a3cdf3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.665166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d3a9d-56b8-497c-9272-37c6a3cdf3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.672025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d3a9d-56b8-497c-9272-37c6a3cdf3c5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.685706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d890acc-397d-4144-9470-3efe27324e8d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.708136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7f034-2396-45e7-afe4-cd6a663e1941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.709205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f034-2396-45e7-afe4-cd6a663e1941 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.709591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f034-2396-45e7-afe4-cd6a663e1941 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.709973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f034-2396-45e7-afe4-cd6a663e1941 admin admin] PATH_INFO: `/v3/projects/24560083d7dd474c820b48343b65c206/users/67bb649ed4a840b58f2f081adc27ad48/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.742506 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1806/3628] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:58:57 2022] POST /identity/v3/users => generated 281 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:58:57.748626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d3a9d-56b8-497c-9272-37c6a3cdf3c5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.758588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7f034-2396-45e7-afe4-cd6a663e1941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24560083d7dd474c820b48343b65c206, user_id=67bb649ed4a840b58f2f081adc27ad48, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.766963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d3a9d-56b8-497c-9272-37c6a3cdf3c5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.779920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7f034-2396-45e7-afe4-cd6a663e1941 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.784071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df49184-d450-4874-b74a-2714d01c3d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.784899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49184-d450-4874-b74a-2714d01c3d5f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.785057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49184-d450-4874-b74a-2714d01c3d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.785338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49184-d450-4874-b74a-2714d01c3d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.786074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df49184-d450-4874-b74a-2714d01c3d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.787679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df49184-d450-4874-b74a-2714d01c3d5f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:57.834116 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1807/3629] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:57.835918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df49184-d450-4874-b74a-2714d01c3d5f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:57.859703 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1823/3630] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:57 2022] PUT /identity/v3/projects/24560083d7dd474c820b48343b65c206/users/67bb649ed4a840b58f2f081adc27ad48/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:57.862933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f1c20-cab6-4647-a968-f687c936380c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.867129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f1c20-cab6-4647-a968-f687c936380c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.867129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f1c20-cab6-4647-a968-f687c936380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.867411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df49184-d450-4874-b74a-2714d01c3d5f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:57.929628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7e1f1c20-cab6-4647-a968-f687c936380c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:57.935505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7e1f1c20-cab6-4647-a968-f687c936380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:57.992485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2585083-8ba0-4f9e-8d95-9d50dbfc41d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:57.993669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2585083-8ba0-4f9e-8d95-9d50dbfc41d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:57.993961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2585083-8ba0-4f9e-8d95-9d50dbfc41d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:57.994248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2585083-8ba0-4f9e-8d95-9d50dbfc41d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:57.994977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2585083-8ba0-4f9e-8d95-9d50dbfc41d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:57.996675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2585083-8ba0-4f9e-8d95-9d50dbfc41d6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:58.033133 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1808/3631] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:58:58.035307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2585083-8ba0-4f9e-8d95-9d50dbfc41d6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:58.065736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2585083-8ba0-4f9e-8d95-9d50dbfc41d6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:58.079282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7f63f-0820-4bd6-90d2-7a2d33b78bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:58.079941 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1824/3632] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:58:58.080953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7f63f-0820-4bd6-90d2-7a2d33b78bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:58.081531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7f63f-0820-4bd6-90d2-7a2d33b78bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:58.082055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7f63f-0820-4bd6-90d2-7a2d33b78bfd admin admin] PATH_INFO: `/v3/projects/b2e737cedbf544a2b38c10eba095d5f5/users/52db9320c9074af693ed85c0c41cd4d8/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:58.138488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7f63f-0820-4bd6-90d2-7a2d33b78bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e737cedbf544a2b38c10eba095d5f5, user_id=52db9320c9074af693ed85c0c41cd4d8, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:58.145383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f1c20-cab6-4647-a968-f687c936380c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:58.146814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7e1f1c20-cab6-4647-a968-f687c936380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:58.147851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7f63f-0820-4bd6-90d2-7a2d33b78bfd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:58.186338 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1809/3633] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:58:58 2022] PUT /identity/v3/projects/b2e737cedbf544a2b38c10eba095d5f5/users/52db9320c9074af693ed85c0c41cd4d8/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:58.190368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6f09-b426-4ac7-bb5d-482823ec748f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:58.190666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6f09-b426-4ac7-bb5d-482823ec748f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:58.191270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6f09-b426-4ac7-bb5d-482823ec748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:58.233609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-18af6f09-b426-4ac7-bb5d-482823ec748f None None] MFA Rules not processed for user `52db9320c9074af693ed85c0c41cd4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:58.235499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-18af6f09-b426-4ac7-bb5d-482823ec748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:58.371173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f1c20-cab6-4647-a968-f687c936380c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:58.409237 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1810/3634] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:58.415175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b66db-74a5-4054-b94e-dc9aa4016daa None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:58.415469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b66db-74a5-4054-b94e-dc9aa4016daa None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:58.415754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b66db-74a5-4054-b94e-dc9aa4016daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:58.467544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6578-f5da-4ae6-ba05-12254686ca32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:58.469357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6578-f5da-4ae6-ba05-12254686ca32 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:58.470039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6578-f5da-4ae6-ba05-12254686ca32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:58.470549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6578-f5da-4ae6-ba05-12254686ca32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:58.524682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-557b66db-74a5-4054-b94e-dc9aa4016daa None None] MFA Rules not processed for user `52db9320c9074af693ed85c0c41cd4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:58.534255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-557b66db-74a5-4054-b94e-dc9aa4016daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:58.562379 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1811/3635] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:58 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 20:58:58.569470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c294-1168-4f61-bf50-f5a86cfed652 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:58.570092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c294-1168-4f61-bf50-f5a86cfed652 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:58.570619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d6578-f5da-4ae6-ba05-12254686ca32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:58.575140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c294-1168-4f61-bf50-f5a86cfed652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:58.609063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d6578-f5da-4ae6-ba05-12254686ca32 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:58.648998 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1825/3636] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:58:58.650938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f678c294-1168-4f61-bf50-f5a86cfed652 None None] MFA Rules not processed for user `52db9320c9074af693ed85c0c41cd4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:58.653323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f678c294-1168-4f61-bf50-f5a86cfed652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:58.659244 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1812/3637] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:58 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 20:58:58.663641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6578-f5da-4ae6-ba05-12254686ca32 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:58.679773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6578-f5da-4ae6-ba05-12254686ca32 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:58.693858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c523-d4d8-422f-8f85-7a756f7022f6 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52db9320c9074af693ed85c0c41cd4d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2e737cedbf544a2b38c10eba095d5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:58.694464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c523-d4d8-422f-8f85-7a756f7022f6 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:58.694754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c523-d4d8-422f-8f85-7a756f7022f6 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:58.700206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c523-d4d8-422f-8f85-7a756f7022f6 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:58.719145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9c523-d4d8-422f-8f85-7a756f7022f6 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorizing `identity:check_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:58.720949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9c523-d4d8-422f-8f85-7a756f7022f6 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:58.735988 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1826/3638] 10.222.0.30 () {56 vars in 1263 bytes} [Sat Feb 19 20:58:58 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Feb 19 20:58:58.740361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c294-1168-4f61-bf50-f5a86cfed652 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:58.777598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c294-1168-4f61-bf50-f5a86cfed652 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:58.801195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27fdaf-be64-4c83-bf90-33beedf77514 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52db9320c9074af693ed85c0c41cd4d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2e737cedbf544a2b38c10eba095d5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:58.802165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27fdaf-be64-4c83-bf90-33beedf77514 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:58.802562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27fdaf-be64-4c83-bf90-33beedf77514 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:58.802950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27fdaf-be64-4c83-bf90-33beedf77514 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:58.852065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27fdaf-be64-4c83-bf90-33beedf77514 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:58.854790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27fdaf-be64-4c83-bf90-33beedf77514 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:58.866004 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1813/3639] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Feb 19 20:58:58 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:58.903180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c523-d4d8-422f-8f85-7a756f7022f6 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:58.914256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c523-d4d8-422f-8f85-7a756f7022f6 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:58.923945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da367c31-5862-4416-b294-1d04adf5b7c3 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52db9320c9074af693ed85c0c41cd4d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2e737cedbf544a2b38c10eba095d5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:58.924669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367c31-5862-4416-b294-1d04adf5b7c3 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:58.924956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367c31-5862-4416-b294-1d04adf5b7c3 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:58.925236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367c31-5862-4416-b294-1d04adf5b7c3 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:58.938678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da367c31-5862-4416-b294-1d04adf5b7c3 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:58.941068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da367c31-5862-4416-b294-1d04adf5b7c3 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:58.977484 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1827/3640] 10.222.0.30 () {56 vars in 1265 bytes} [Sat Feb 19 20:58:58 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:58.982477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27fdaf-be64-4c83-bf90-33beedf77514 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:58.999861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27fdaf-be64-4c83-bf90-33beedf77514 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:59.006016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e4c4-38da-45de-aea1-4b1dbdcf99bd tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52db9320c9074af693ed85c0c41cd4d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2e737cedbf544a2b38c10eba095d5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:59.006755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e4c4-38da-45de-aea1-4b1dbdcf99bd tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:59.007106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e4c4-38da-45de-aea1-4b1dbdcf99bd tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:59.007448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e4c4-38da-45de-aea1-4b1dbdcf99bd tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:59.009745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57e9e4c4-38da-45de-aea1-4b1dbdcf99bd tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:59.091601 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-57e9e4c4-38da-45de-aea1-4b1dbdcf99bd tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Feb 19 20:58:59.104450 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1814/3641] 10.222.0.30 () {56 vars in 1263 bytes} [Sat Feb 19 20:58:58 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Feb 19 20:58:59.111919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31442e-630c-4c77-815e-7b8452645325 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:59.112812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31442e-630c-4c77-815e-7b8452645325 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:59.113261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31442e-630c-4c77-815e-7b8452645325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:59.148698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ba31442e-630c-4c77-815e-7b8452645325 None None] MFA Rules not processed for user `52db9320c9074af693ed85c0c41cd4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:59.153853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ba31442e-630c-4c77-815e-7b8452645325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:59.161416 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1828/3642] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:59 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 20:58:59.166620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e4c4-38da-45de-aea1-4b1dbdcf99bd tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:59.200152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e4c4-38da-45de-aea1-4b1dbdcf99bd tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:59.208101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df1ea4-a6e1-4d7c-aea3-91adabf826c8 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52db9320c9074af693ed85c0c41cd4d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2e737cedbf544a2b38c10eba095d5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:59.208810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1ea4-a6e1-4d7c-aea3-91adabf826c8 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:59.209100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1ea4-a6e1-4d7c-aea3-91adabf826c8 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:59.209437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1ea4-a6e1-4d7c-aea3-91adabf826c8 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:59.219821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df1ea4-a6e1-4d7c-aea3-91adabf826c8 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:59.222409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df1ea4-a6e1-4d7c-aea3-91adabf826c8 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:59.237410 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1815/3643] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Feb 19 20:58:59 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:59.242316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31442e-630c-4c77-815e-7b8452645325 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:59.269059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31442e-630c-4c77-815e-7b8452645325 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:59.287855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32f740-a44e-4d20-9e57-cbd4a034add7 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52db9320c9074af693ed85c0c41cd4d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2e737cedbf544a2b38c10eba095d5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:59.292674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32f740-a44e-4d20-9e57-cbd4a034add7 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:59.294117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32f740-a44e-4d20-9e57-cbd4a034add7 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:59.297180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32f740-a44e-4d20-9e57-cbd4a034add7 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:59.328750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32f740-a44e-4d20-9e57-cbd4a034add7 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:59.341421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32f740-a44e-4d20-9e57-cbd4a034add7 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:59.392824 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1829/3644] 10.222.0.30 () {56 vars in 1265 bytes} [Sat Feb 19 20:58:59 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:59.397090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df1ea4-a6e1-4d7c-aea3-91adabf826c8 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:59.416774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df1ea4-a6e1-4d7c-aea3-91adabf826c8 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:59.426639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a895-09fd-404c-8004-0a57ebfff110 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52db9320c9074af693ed85c0c41cd4d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2e737cedbf544a2b38c10eba095d5f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:59.427537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a895-09fd-404c-8004-0a57ebfff110 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:59.428056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a895-09fd-404c-8004-0a57ebfff110 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:59.429074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a895-09fd-404c-8004-0a57ebfff110 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:59.432065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4861a895-09fd-404c-8004-0a57ebfff110 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:59.456616 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-4861a895-09fd-404c-8004-0a57ebfff110 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Feb 19 20:58:59.459351 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1816/3645] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Feb 19 20:58:59 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 20:58:59.464269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32f740-a44e-4d20-9e57-cbd4a034add7 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:59.485919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32f740-a44e-4d20-9e57-cbd4a034add7 tempest-TokensV3Test-1792476971 tempest-TokensV3Test-1792476971-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:58:59.494525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:58:59.498171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:59.498692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:59.499212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] PATH_INFO: `/v3/users/52db9320c9074af693ed85c0c41cd4d8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:59.502165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52db9320c9074af693ed85c0c41cd4d8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:58:59.504667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:58:59.629923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52db9320c9074af693ed85c0c41cd4d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:59.646700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52db9320c9074af693ed85c0c41cd4d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:59.682483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52db9320c9074af693ed85c0c41cd4d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:59.683716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52db9320c9074af693ed85c0c41cd4d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:59.689058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52db9320c9074af693ed85c0c41cd4d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:58:59.735780 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1830/3646] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:58:59 2022] DELETE /identity/v3/users/52db9320c9074af693ed85c0c41cd4d8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:58:59.740072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c652-58ae-4247-ae41-9adbc0369725 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:58:59.740600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c652-58ae-4247-ae41-9adbc0369725 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:58:59.740880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c652-58ae-4247-ae41-9adbc0369725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:58:59.784775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fa72c652-58ae-4247-ae41-9adbc0369725 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:58:59.786309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa72c652-58ae-4247-ae41-9adbc0369725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:58:59.912685 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1817/3647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:58:59.969473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:58:59.976118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:00.184487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6b827-099d-4499-b2a1-8de2d9bef629 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:00.196792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16cc9-5433-4336-9251-59417cc2d764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:00.197783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16cc9-5433-4336-9251-59417cc2d764 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:00.198147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16cc9-5433-4336-9251-59417cc2d764 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:00.198500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16cc9-5433-4336-9251-59417cc2d764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:00.212741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16cc9-5433-4336-9251-59417cc2d764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:00.214202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16cc9-5433-4336-9251-59417cc2d764 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:00.247226 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1831/3648] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:01.927121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96781-2c36-4c1c-8b26-e6014daed57c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:01.927690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96781-2c36-4c1c-8b26-e6014daed57c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:01.928252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96781-2c36-4c1c-8b26-e6014daed57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:01.989166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-91d96781-2c36-4c1c-8b26-e6014daed57c None None] MFA Rules not processed for user `67bb649ed4a840b58f2f081adc27ad48`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:01.991793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-91d96781-2c36-4c1c-8b26-e6014daed57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:02.129396 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1818/3649] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:02.134533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47800374-58fb-402e-b608-c89dbbea0d72 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:02.135029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47800374-58fb-402e-b608-c89dbbea0d72 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:02.135029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47800374-58fb-402e-b608-c89dbbea0d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:02.167659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-47800374-58fb-402e-b608-c89dbbea0d72 None None] MFA Rules not processed for user `67bb649ed4a840b58f2f081adc27ad48`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:02.168939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-47800374-58fb-402e-b608-c89dbbea0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:02.187037 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1832/3650] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:02.191460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96781-2c36-4c1c-8b26-e6014daed57c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:02.193387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-91d96781-2c36-4c1c-8b26-e6014daed57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:02.438247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96781-2c36-4c1c-8b26-e6014daed57c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:02.459263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd9c5-fd26-4a54-9bb2-042b948bbea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:02.461230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd9c5-fd26-4a54-9bb2-042b948bbea4 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:02.462864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd9c5-fd26-4a54-9bb2-042b948bbea4 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:02.464126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd9c5-fd26-4a54-9bb2-042b948bbea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:02.487623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcd9c5-fd26-4a54-9bb2-042b948bbea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:02.494844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcd9c5-fd26-4a54-9bb2-042b948bbea4 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:02.517861 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1819/3651] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:02.905995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47800374-58fb-402e-b608-c89dbbea0d72 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:02.908690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-47800374-58fb-402e-b608-c89dbbea0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:02.929175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47800374-58fb-402e-b608-c89dbbea0d72 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:02.938882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:02.940134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:02.941391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:02.941860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] PATH_INFO: `/v3/projects/b2e737cedbf544a2b38c10eba095d5f5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:02.943505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e737cedbf544a2b38c10eba095d5f5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:02.946257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:03.073834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e737cedbf544a2b38c10eba095d5f5', 'request_id': 'req-54b83611-11b1-49e3-802f-0d5b85a7d0ba'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:03.088082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e737cedbf544a2b38c10eba095d5f5', 'request_id': 'req-54b83611-11b1-49e3-802f-0d5b85a7d0ba'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:03.118342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e737cedbf544a2b38c10eba095d5f5', 'request_id': 'req-54b83611-11b1-49e3-802f-0d5b85a7d0ba'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:03.154410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] The token cache is being invalidate because project b2e737cedbf544a2b38c10eba095d5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:03.155109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:03.157058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54b83611-11b1-49e3-802f-0d5b85a7d0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:03.166348 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1833/3652] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:02 2022] DELETE /identity/v3/projects/b2e737cedbf544a2b38c10eba095d5f5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:03.167731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc659-8aa5-4bff-91a4-51655dbc57dd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:03.168234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc659-8aa5-4bff-91a4-51655dbc57dd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:03.168374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc659-8aa5-4bff-91a4-51655dbc57dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:03.213554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b18fc659-8aa5-4bff-91a4-51655dbc57dd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:03.215055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b18fc659-8aa5-4bff-91a4-51655dbc57dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:03.374729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34801-f910-407b-a245-e12632a81be7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:03.375009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34801-f910-407b-a245-e12632a81be7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:03.380150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34801-f910-407b-a245-e12632a81be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:03.402398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1820/3653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:03.455607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-39e34801-f910-407b-a245-e12632a81be7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:03.456866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-39e34801-f910-407b-a245-e12632a81be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:03.488176 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1834/3654] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:59:03.493039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fc659-8aa5-4bff-91a4-51655dbc57dd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:03.504522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fc659-8aa5-4bff-91a4-51655dbc57dd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:03.521201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:03.521877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:03.522161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:03.522890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:03.523135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:03.523441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:03.525143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:03.570130 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1821/3655] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:03.574160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e34801-f910-407b-a245-e12632a81be7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:03.587832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e34801-f910-407b-a245-e12632a81be7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:03.595118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4432235-02f6-4260-8262-0c899aa734c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:03.596019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4432235-02f6-4260-8262-0c899aa734c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:03.596522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4432235-02f6-4260-8262-0c899aa734c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:03.596992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4432235-02f6-4260-8262-0c899aa734c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:03.597875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4432235-02f6-4260-8262-0c899aa734c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:03.600108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4432235-02f6-4260-8262-0c899aa734c4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:03.665613 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1835/3656] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:03 2022] POST /identity/v3/projects => generated 397 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:03.669417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:03.689299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6779b-5e4b-4a1b-a836-1fde71b546d4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:03.798481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72b36c-fc54-4dfa-b11f-da8463eff32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:03.801643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72b36c-fc54-4dfa-b11f-da8463eff32e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:03.803145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72b36c-fc54-4dfa-b11f-da8463eff32e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:03.804178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72b36c-fc54-4dfa-b11f-da8463eff32e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:03.806780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72b36c-fc54-4dfa-b11f-da8463eff32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:03.811488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72b36c-fc54-4dfa-b11f-da8463eff32e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:03.867544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4432235-02f6-4260-8262-0c899aa734c4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:03.868256 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1822/3657] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:03 2022] POST /identity/v3/users => generated 305 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:03.898876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4432235-02f6-4260-8262-0c899aa734c4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:03.930593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e26dd-657f-423e-838a-21cb2b9f1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:03.931739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e26dd-657f-423e-838a-21cb2b9f1cad admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:03.932680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e26dd-657f-423e-838a-21cb2b9f1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:03.933797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e26dd-657f-423e-838a-21cb2b9f1cad admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:03.936267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e26dd-657f-423e-838a-21cb2b9f1cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:03.938968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e26dd-657f-423e-838a-21cb2b9f1cad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:03.983189 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1836/3658] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:03.984294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72b36c-fc54-4dfa-b11f-da8463eff32e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:04.001862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72b36c-fc54-4dfa-b11f-da8463eff32e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:04.014140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e945e-52e1-490c-80e8-ebfee0b951a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:04.016983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e945e-52e1-490c-80e8-ebfee0b951a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:04.017275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e945e-52e1-490c-80e8-ebfee0b951a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:04.017564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e945e-52e1-490c-80e8-ebfee0b951a9 admin admin] PATH_INFO: `/v3/projects/4a1425b07e344b2da76087ade94b14e3/users/2ef41738f7424632a11c969dc9ff042c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:04.052260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e945e-52e1-490c-80e8-ebfee0b951a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1425b07e344b2da76087ade94b14e3, user_id=2ef41738f7424632a11c969dc9ff042c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:04.054889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e945e-52e1-490c-80e8-ebfee0b951a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:04.086576 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1823/3659] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:03 2022] PUT /identity/v3/projects/4a1425b07e344b2da76087ade94b14e3/users/2ef41738f7424632a11c969dc9ff042c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:04.088687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e26dd-657f-423e-838a-21cb2b9f1cad admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:04.110224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e26dd-657f-423e-838a-21cb2b9f1cad admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:04.283665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd7071-4703-477e-aa9f-3724ae97b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:04.284388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd7071-4703-477e-aa9f-3724ae97b012 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:04.284663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd7071-4703-477e-aa9f-3724ae97b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:04.284945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd7071-4703-477e-aa9f-3724ae97b012 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:04.285681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd7071-4703-477e-aa9f-3724ae97b012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:04.287281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd7071-4703-477e-aa9f-3724ae97b012 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:04.309785 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1837/3660] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:04.314391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e945e-52e1-490c-80e8-ebfee0b951a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:04.327436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e945e-52e1-490c-80e8-ebfee0b951a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:04.343827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603df0c7-4a02-4692-8b38-6638d596f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:04.344961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603df0c7-4a02-4692-8b38-6638d596f502 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:04.345559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603df0c7-4a02-4692-8b38-6638d596f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:04.345781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603df0c7-4a02-4692-8b38-6638d596f502 admin admin] PATH_INFO: `/v3/projects/4a1425b07e344b2da76087ade94b14e3/users/2ef41738f7424632a11c969dc9ff042c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:04.348289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603df0c7-4a02-4692-8b38-6638d596f502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1425b07e344b2da76087ade94b14e3, user_id=2ef41738f7424632a11c969dc9ff042c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:04.353807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603df0c7-4a02-4692-8b38-6638d596f502 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:04.392702 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1824/3661] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:04 2022] PUT /identity/v3/projects/4a1425b07e344b2da76087ade94b14e3/users/2ef41738f7424632a11c969dc9ff042c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:04.491512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eda31-f65e-4a6e-94a5-4eaa06c42eaf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:04.492033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eda31-f65e-4a6e-94a5-4eaa06c42eaf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:04.492711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eda31-f65e-4a6e-94a5-4eaa06c42eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:04.558163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6d9eda31-f65e-4a6e-94a5-4eaa06c42eaf None None] MFA Rules not processed for user `2ef41738f7424632a11c969dc9ff042c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:04.561054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6d9eda31-f65e-4a6e-94a5-4eaa06c42eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:04.679982 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1838/3662] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:04.684826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603df0c7-4a02-4692-8b38-6638d596f502 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:04.838304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603df0c7-4a02-4692-8b38-6638d596f502 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:04.847156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669344b-b312-4724-8257-8c52326786c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:04.847581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669344b-b312-4724-8257-8c52326786c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:04.848055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669344b-b312-4724-8257-8c52326786c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:04.848567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669344b-b312-4724-8257-8c52326786c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:04.849648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669344b-b312-4724-8257-8c52326786c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:04.851965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669344b-b312-4724-8257-8c52326786c2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:04.877897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eda31-f65e-4a6e-94a5-4eaa06c42eaf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:04.879528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6d9eda31-f65e-4a6e-94a5-4eaa06c42eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:04.926821 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1825/3663] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:04 2022] POST /identity/v3/projects => generated 397 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:04.937166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eda31-f65e-4a6e-94a5-4eaa06c42eaf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:04.943301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669344b-b312-4724-8257-8c52326786c2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:05.081543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669344b-b312-4724-8257-8c52326786c2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:05.091352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff566a3-b5c7-4e52-82c8-0869db4b9f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:05.094735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff566a3-b5c7-4e52-82c8-0869db4b9f08 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:05.095626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff566a3-b5c7-4e52-82c8-0869db4b9f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:05.096684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff566a3-b5c7-4e52-82c8-0869db4b9f08 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:05.098282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff566a3-b5c7-4e52-82c8-0869db4b9f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:05.101599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff566a3-b5c7-4e52-82c8-0869db4b9f08 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:05.155805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:05.159656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:05.162482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:05.164353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] PATH_INFO: `/v3/users/72ce9a80c4b444259dda1f6a63e6fe49` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:05.165455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ce9a80c4b444259dda1f6a63e6fe49)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:05.170475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:05.174200 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1826/3664] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:04 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:05.179308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff566a3-b5c7-4e52-82c8-0869db4b9f08 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:05.222102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff566a3-b5c7-4e52-82c8-0869db4b9f08 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:05.237226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3decce-f189-476b-a0f6-1cc22aedd68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:05.244979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3decce-f189-476b-a0f6-1cc22aedd68c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:05.247992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3decce-f189-476b-a0f6-1cc22aedd68c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:05.248957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3decce-f189-476b-a0f6-1cc22aedd68c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:05.254169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3decce-f189-476b-a0f6-1cc22aedd68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:05.257145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3decce-f189-476b-a0f6-1cc22aedd68c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:05.273142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ce9a80c4b444259dda1f6a63e6fe49'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:05.289728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1827/3665] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:05.292559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3decce-f189-476b-a0f6-1cc22aedd68c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:05.294773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ce9a80c4b444259dda1f6a63e6fe49'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:05.310871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ce9a80c4b444259dda1f6a63e6fe49'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:05.312835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ce9a80c4b444259dda1f6a63e6fe49'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:05.314364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ce9a80c4b444259dda1f6a63e6fe49'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:05.317616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3decce-f189-476b-a0f6-1cc22aedd68c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:05.337162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231a076-5988-4878-b997-7b1d50f6aa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:05.337767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231a076-5988-4878-b997-7b1d50f6aa6d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:05.338053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231a076-5988-4878-b997-7b1d50f6aa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:05.338334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231a076-5988-4878-b997-7b1d50f6aa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:05.339060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231a076-5988-4878-b997-7b1d50f6aa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:05.340967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231a076-5988-4878-b997-7b1d50f6aa6d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:05.341598 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1839/3666] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:04 2022] DELETE /identity/v3/users/72ce9a80c4b444259dda1f6a63e6fe49 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:05.363876 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1828/3667] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:05.365272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:05.366842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:05.529477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aae24-6154-4bf8-bdf6-5c4c6beb635f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:05.535457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:05.537152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:05.537777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:05.538319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] PATH_INFO: `/v3/projects/a85362182f2348fb94e4107d77527bf9/users/52fc89e954b3436c9b4bd4f6e3dc16a3/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:05.565175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85362182f2348fb94e4107d77527bf9, user_id=52fc89e954b3436c9b4bd4f6e3dc16a3, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:05.568828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:05.602547 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1840/3668] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:05 2022] PUT /identity/v3/projects/a85362182f2348fb94e4107d77527bf9/users/52fc89e954b3436c9b4bd4f6e3dc16a3/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:05.611875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d390e-8f56-465f-8e2f-9805f0d3fbe0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:05.612127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d390e-8f56-465f-8e2f-9805f0d3fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:05.612541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d390e-8f56-465f-8e2f-9805f0d3fbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:05.691458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-185d390e-8f56-465f-8e2f-9805f0d3fbe0 None None] MFA Rules not processed for user `52fc89e954b3436c9b4bd4f6e3dc16a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:05.693346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-185d390e-8f56-465f-8e2f-9805f0d3fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:05.886170 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1829/3669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:05.898927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:05.901263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:06.048010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d390e-8f56-465f-8e2f-9805f0d3fbe0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:06.051596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-185d390e-8f56-465f-8e2f-9805f0d3fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:06.104733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719b43d-c826-46f5-b6b4-167844276ac2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:06.119497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:06.120698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:06.121185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:06.121637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:06.125143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:06.253317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d390e-8f56-465f-8e2f-9805f0d3fbe0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:06.262915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:06.265579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:06.265920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:06.266835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] PATH_INFO: `/v3/projects/a0981190244846a18036aa20dce2dc60` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:06.268904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0981190244846a18036aa20dce2dc60)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:06.272716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:06.299793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:06.308604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:06.335111 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1841/3670] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:06.393073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0981190244846a18036aa20dce2dc60', 'request_id': 'req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.432634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0981190244846a18036aa20dce2dc60', 'request_id': 'req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.450433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0981190244846a18036aa20dce2dc60', 'request_id': 'req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.497669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] The token cache is being invalidate because project a0981190244846a18036aa20dce2dc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:06.497960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.503777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.509239 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1830/3671] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:06 2022] DELETE /identity/v3/projects/a0981190244846a18036aa20dce2dc60 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:06.513817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:06.541883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6cca7-b595-4238-86f0-7effe54b9cac service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:06.708685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:06.709587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:06.709858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:06.710132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] PATH_INFO: `/v3/users/d5d7865cf8614882b58cad856e16d0c4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:06.711541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d7865cf8614882b58cad856e16d0c4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:06.714345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:06.868457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d7865cf8614882b58cad856e16d0c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.904365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d7865cf8614882b58cad856e16d0c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.924775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d7865cf8614882b58cad856e16d0c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.926189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d7865cf8614882b58cad856e16d0c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.926927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2aa0ef8-c9fc-4f06-b2e2-73edbccf0896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d7865cf8614882b58cad856e16d0c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:06.959966 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1842/3672] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:06 2022] DELETE /identity/v3/users/d5d7865cf8614882b58cad856e16d0c4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:07.174111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:07.175705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:07.201159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70d7f-0b8c-4bf1-8438-2316ebf1b92f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:07.346377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:07.347299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:07.347579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:07.348041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] PATH_INFO: `/v3/users/2ef41738f7424632a11c969dc9ff042c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:07.354702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef41738f7424632a11c969dc9ff042c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:07.356891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:07.458858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef41738f7424632a11c969dc9ff042c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:07.460802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef41738f7424632a11c969dc9ff042c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:07.461756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef41738f7424632a11c969dc9ff042c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:07.481613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef41738f7424632a11c969dc9ff042c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:07.496843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef41738f7424632a11c969dc9ff042c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:07.516200 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1831/3673] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:07 2022] DELETE /identity/v3/users/2ef41738f7424632a11c969dc9ff042c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:07.521397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65440e-9cca-417a-8d71-dde4b3141041 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:07.523934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65440e-9cca-417a-8d71-dde4b3141041 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:07.524819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65440e-9cca-417a-8d71-dde4b3141041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:07.552099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cc65440e-9cca-417a-8d71-dde4b3141041 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:07.568699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc65440e-9cca-417a-8d71-dde4b3141041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:07.663192 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1843/3674] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:07.689508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:07.692380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:07.789572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4c0e8-d203-437f-88de-d8c47ef5145c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:07.795480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6c477-8cef-4d25-acfe-3e3aeabb61f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:07.800433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6c477-8cef-4d25-acfe-3e3aeabb61f8 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:07.800433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6c477-8cef-4d25-acfe-3e3aeabb61f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:07.800433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6c477-8cef-4d25-acfe-3e3aeabb61f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:07.835741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6c477-8cef-4d25-acfe-3e3aeabb61f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:07.838806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6c477-8cef-4d25-acfe-3e3aeabb61f8 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:07.871726 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1832/3675] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:07.932654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65440e-9cca-417a-8d71-dde4b3141041 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:07.935060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc65440e-9cca-417a-8d71-dde4b3141041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:07.963502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65440e-9cca-417a-8d71-dde4b3141041 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:07.983124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:07.984279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:07.984620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:07.984884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] PATH_INFO: `/v3/projects/e5c74fd9df6a462e8fdb33768ba14e60` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:07.988843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c74fd9df6a462e8fdb33768ba14e60)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:07.991353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:08.136401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c74fd9df6a462e8fdb33768ba14e60', 'request_id': 'req-f0677860-3a27-40e5-a6a7-96ffdf819703'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:08.145071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c74fd9df6a462e8fdb33768ba14e60', 'request_id': 'req-f0677860-3a27-40e5-a6a7-96ffdf819703'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:08.169078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c74fd9df6a462e8fdb33768ba14e60', 'request_id': 'req-f0677860-3a27-40e5-a6a7-96ffdf819703'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:08.201680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] The token cache is being invalidate because project e5c74fd9df6a462e8fdb33768ba14e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:08.203704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:08.204872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0677860-3a27-40e5-a6a7-96ffdf819703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:08.220635 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1844/3676] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:07 2022] DELETE /identity/v3/projects/e5c74fd9df6a462e8fdb33768ba14e60 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:08.223433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbaa23-2b30-42b5-ab39-037073b89723 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:08.223826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbaa23-2b30-42b5-ab39-037073b89723 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:08.224166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbaa23-2b30-42b5-ab39-037073b89723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:08.253965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0afbaa23-2b30-42b5-ab39-037073b89723 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:08.255713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0afbaa23-2b30-42b5-ab39-037073b89723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:08.350398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1833/3677] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:59:08.358046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43210-1ab5-41b6-8828-2106797b9b94 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:08.358046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43210-1ab5-41b6-8828-2106797b9b94 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:08.358046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43210-1ab5-41b6-8828-2106797b9b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:08.398024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-41d43210-1ab5-41b6-8828-2106797b9b94 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:08.399329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-41d43210-1ab5-41b6-8828-2106797b9b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:08.415051 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1845/3678] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:08.419381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbaa23-2b30-42b5-ab39-037073b89723 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:08.441417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbaa23-2b30-42b5-ab39-037073b89723 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:08.463609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:08.469104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:08.471084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:08.471487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:08.472528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:08.474371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:08.483407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:08.526682 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1834/3679] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:08.527896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d43210-1ab5-41b6-8828-2106797b9b94 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:08.545407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d43210-1ab5-41b6-8828-2106797b9b94 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:08.569562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e044b8b-246b-407f-abfa-0028a5c280a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:08.570244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e044b8b-246b-407f-abfa-0028a5c280a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:08.570525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e044b8b-246b-407f-abfa-0028a5c280a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:08.570805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e044b8b-246b-407f-abfa-0028a5c280a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:08.572249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e044b8b-246b-407f-abfa-0028a5c280a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:08.574537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e044b8b-246b-407f-abfa-0028a5c280a8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:08.655106 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1846/3680] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:08 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:08.657122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:08.672144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e968954-2dab-48f1-abb0-b504b313e2a2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:08.769229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04a73-3723-474c-aec1-c2e61c673ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:08.770326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04a73-3723-474c-aec1-c2e61c673ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:08.771611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04a73-3723-474c-aec1-c2e61c673ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:08.772082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04a73-3723-474c-aec1-c2e61c673ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:08.772998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c04a73-3723-474c-aec1-c2e61c673ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:08.776521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c04a73-3723-474c-aec1-c2e61c673ed9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:08.809646 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1835/3681] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:08 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:08.811710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e044b8b-246b-407f-abfa-0028a5c280a8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:08.828621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e044b8b-246b-407f-abfa-0028a5c280a8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:08.837498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9158de-943b-4b95-8373-f94c1cffda0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:08.838359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9158de-943b-4b95-8373-f94c1cffda0f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:08.838979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9158de-943b-4b95-8373-f94c1cffda0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:08.839253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9158de-943b-4b95-8373-f94c1cffda0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:08.840095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9158de-943b-4b95-8373-f94c1cffda0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:08.844701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9158de-943b-4b95-8373-f94c1cffda0f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:08.881318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04a73-3723-474c-aec1-c2e61c673ed9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:08.892103 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1847/3682] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:59:08.895444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04a73-3723-474c-aec1-c2e61c673ed9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:08.904406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6ae82-9fda-4c0c-b96d-f878d52ff738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:08.905504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6ae82-9fda-4c0c-b96d-f878d52ff738 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:08.906013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6ae82-9fda-4c0c-b96d-f878d52ff738 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:08.906455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6ae82-9fda-4c0c-b96d-f878d52ff738 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:08.907516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6ae82-9fda-4c0c-b96d-f878d52ff738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:08.910619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6ae82-9fda-4c0c-b96d-f878d52ff738 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:08.931730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9158de-943b-4b95-8373-f94c1cffda0f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:08.942417 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1836/3683] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:08.947823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9158de-943b-4b95-8373-f94c1cffda0f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:08.958973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:08.960259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:08.960964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:08.961431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] PATH_INFO: `/v3/projects/46068d17334344098e88ad0cc3e0eebb/users/6d0f3497fc80496499ed3d927823ce0c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:08.988621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46068d17334344098e88ad0cc3e0eebb, user_id=6d0f3497fc80496499ed3d927823ce0c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:08.991614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:09.030167 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1848/3684] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:08 2022] PUT /identity/v3/projects/46068d17334344098e88ad0cc3e0eebb/users/6d0f3497fc80496499ed3d927823ce0c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:09.030960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85245c2a-869e-4a5d-afe1-c194a3e8a28f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:09.031264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85245c2a-869e-4a5d-afe1-c194a3e8a28f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:09.031528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85245c2a-869e-4a5d-afe1-c194a3e8a28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:09.054246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-85245c2a-869e-4a5d-afe1-c194a3e8a28f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:09.056318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-85245c2a-869e-4a5d-afe1-c194a3e8a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:09.200220 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1837/3685] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:09.226105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:09.230743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:09.315082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85245c2a-869e-4a5d-afe1-c194a3e8a28f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:09.317507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-85245c2a-869e-4a5d-afe1-c194a3e8a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:09.341572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85245c2a-869e-4a5d-afe1-c194a3e8a28f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:09.359684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:09.362338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:09.362863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:09.363880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] PATH_INFO: `/v3/projects/4a1425b07e344b2da76087ade94b14e3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:09.370736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1425b07e344b2da76087ade94b14e3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:09.373103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:09.423702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52d58f-2006-4df1-8ff6-1a5c2f34416a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:09.457327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d109-3b8c-43a8-bd17-9ddf510c6ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:09.463996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d109-3b8c-43a8-bd17-9ddf510c6ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:09.465342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d109-3b8c-43a8-bd17-9ddf510c6ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:09.467213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d109-3b8c-43a8-bd17-9ddf510c6ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:09.516310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d109-3b8c-43a8-bd17-9ddf510c6ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:09.517719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1425b07e344b2da76087ade94b14e3', 'request_id': 'req-45dd88ad-8ff9-40e2-8175-bb925916fd26'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:09.520556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d109-3b8c-43a8-bd17-9ddf510c6ec1 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:09.538788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1425b07e344b2da76087ade94b14e3', 'request_id': 'req-45dd88ad-8ff9-40e2-8175-bb925916fd26'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:09.556728 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1849/3686] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:09.567987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1425b07e344b2da76087ade94b14e3', 'request_id': 'req-45dd88ad-8ff9-40e2-8175-bb925916fd26'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:09.608046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] The token cache is being invalidate because project 4a1425b07e344b2da76087ade94b14e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:09.609668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:09.610624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:09.612784 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1838/3687] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:09 2022] DELETE /identity/v3/projects/4a1425b07e344b2da76087ade94b14e3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:09.616536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d109-3b8c-43a8-bd17-9ddf510c6ec1 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:09.631872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d109-3b8c-43a8-bd17-9ddf510c6ec1 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:09.855709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:09.856705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:09.857205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:09.857320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] PATH_INFO: `/v3/users/52fc89e954b3436c9b4bd4f6e3dc16a3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:09.869316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fc89e954b3436c9b4bd4f6e3dc16a3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:09.876274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:10.004140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fc89e954b3436c9b4bd4f6e3dc16a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:10.028426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fc89e954b3436c9b4bd4f6e3dc16a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:10.050022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fc89e954b3436c9b4bd4f6e3dc16a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:10.051031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fc89e954b3436c9b4bd4f6e3dc16a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:10.051917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9bae45b3-c4c6-4e79-8414-f654d6d2cc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fc89e954b3436c9b4bd4f6e3dc16a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:10.074563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1850/3688] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:09 2022] DELETE /identity/v3/users/52fc89e954b3436c9b4bd4f6e3dc16a3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:10.784022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:10.786326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:10.846324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd88ad-8ff9-40e2-8175-bb925916fd26 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:11.062934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:11.064103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:11.064650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:11.065154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] PATH_INFO: `/v3/projects/a85362182f2348fb94e4107d77527bf9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:11.068020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85362182f2348fb94e4107d77527bf9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:11.070523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:11.170266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85362182f2348fb94e4107d77527bf9', 'request_id': 'req-154d3512-5a08-4034-9479-494d72ead645'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:11.180305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85362182f2348fb94e4107d77527bf9', 'request_id': 'req-154d3512-5a08-4034-9479-494d72ead645'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:11.205094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85362182f2348fb94e4107d77527bf9', 'request_id': 'req-154d3512-5a08-4034-9479-494d72ead645'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:11.243278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] The token cache is being invalidate because project a85362182f2348fb94e4107d77527bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:11.243973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:11.246968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154d3512-5a08-4034-9479-494d72ead645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:11.254209 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1839/3689] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:10 2022] DELETE /identity/v3/projects/a85362182f2348fb94e4107d77527bf9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:11.259152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b14497-23d6-44dd-8f68-486f985f759f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:11.259576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b14497-23d6-44dd-8f68-486f985f759f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:11.259713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b14497-23d6-44dd-8f68-486f985f759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:11.304077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a5b14497-23d6-44dd-8f68-486f985f759f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:11.306443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a5b14497-23d6-44dd-8f68-486f985f759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:11.460467 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1851/3690] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:11.461838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf180-fa56-45aa-81e1-aa05d98dfe83 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:11.462299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf180-fa56-45aa-81e1-aa05d98dfe83 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:11.462765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf180-fa56-45aa-81e1-aa05d98dfe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:11.501429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b12bf180-fa56-45aa-81e1-aa05d98dfe83 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:11.502970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b12bf180-fa56-45aa-81e1-aa05d98dfe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:11.522778 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1840/3691] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:11.526785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b14497-23d6-44dd-8f68-486f985f759f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:11.575219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b14497-23d6-44dd-8f68-486f985f759f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:11.595817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:11.597601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:11.597763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:11.598134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:11.599035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:11.601452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:11.602116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:11.625623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1852/3692] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:11.628758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bf180-fa56-45aa-81e1-aa05d98dfe83 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:11.640022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bf180-fa56-45aa-81e1-aa05d98dfe83 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:11.652678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9448ea-13bc-4589-932d-c1283aa49a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:11.653484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9448ea-13bc-4589-932d-c1283aa49a38 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:11.653833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9448ea-13bc-4589-932d-c1283aa49a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:11.654183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9448ea-13bc-4589-932d-c1283aa49a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:11.654976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9448ea-13bc-4589-932d-c1283aa49a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:11.659950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9448ea-13bc-4589-932d-c1283aa49a38 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:11.718425 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1841/3693] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:11 2022] POST /identity/v3/projects => generated 367 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:11.722696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:11.732430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d19e-be7a-4271-aab6-80cdbea6d1dc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:11.867720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324f79d-0e20-4380-b66e-25218f67a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:11.868751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f79d-0e20-4380-b66e-25218f67a9bd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:11.874982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f79d-0e20-4380-b66e-25218f67a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:11.875310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f79d-0e20-4380-b66e-25218f67a9bd admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:11.876063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324f79d-0e20-4380-b66e-25218f67a9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:11.887542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324f79d-0e20-4380-b66e-25218f67a9bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:11.957384 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1853/3694] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:11 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:11.960209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9448ea-13bc-4589-932d-c1283aa49a38 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:11.984300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9448ea-13bc-4589-932d-c1283aa49a38 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:12.001937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c14cf-2273-444f-b9e6-4f3b2994f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:12.002865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c14cf-2273-444f-b9e6-4f3b2994f13d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:12.003337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c14cf-2273-444f-b9e6-4f3b2994f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:12.003811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c14cf-2273-444f-b9e6-4f3b2994f13d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:12.005936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c14cf-2273-444f-b9e6-4f3b2994f13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:12.007832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c14cf-2273-444f-b9e6-4f3b2994f13d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:12.039723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1842/3695] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:12.043480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324f79d-0e20-4380-b66e-25218f67a9bd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:12.068651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324f79d-0e20-4380-b66e-25218f67a9bd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:12.085006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c82a-cb40-4e9f-b1f0-d12676ca5b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:12.086172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c82a-cb40-4e9f-b1f0-d12676ca5b83 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:12.086730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c82a-cb40-4e9f-b1f0-d12676ca5b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:12.088943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c82a-cb40-4e9f-b1f0-d12676ca5b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:12.090063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c82a-cb40-4e9f-b1f0-d12676ca5b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:12.098374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c82a-cb40-4e9f-b1f0-d12676ca5b83 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:12.120580 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1854/3696] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:12.122876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c14cf-2273-444f-b9e6-4f3b2994f13d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:12.140500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c14cf-2273-444f-b9e6-4f3b2994f13d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:12.162612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0cfa4-3ff0-47b2-b506-a7b57eb99df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:12.163550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0cfa4-3ff0-47b2-b506-a7b57eb99df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:12.163839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0cfa4-3ff0-47b2-b506-a7b57eb99df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:12.164123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0cfa4-3ff0-47b2-b506-a7b57eb99df9 admin admin] PATH_INFO: `/v3/projects/da7e5f5745ca402e84e95aa972c411aa/users/ea9be0e55aab4a09bc4a86b8a9941efd/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:12.227539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0cfa4-3ff0-47b2-b506-a7b57eb99df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7e5f5745ca402e84e95aa972c411aa, user_id=ea9be0e55aab4a09bc4a86b8a9941efd, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:12.231013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0cfa4-3ff0-47b2-b506-a7b57eb99df9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:12.255630 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1843/3697] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:12 2022] PUT /identity/v3/projects/da7e5f5745ca402e84e95aa972c411aa/users/ea9be0e55aab4a09bc4a86b8a9941efd/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:12.265804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f308-d071-405e-bc18-598f5d876653 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:12.266632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f308-d071-405e-bc18-598f5d876653 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:12.266827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f308-d071-405e-bc18-598f5d876653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:12.317080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-84d7f308-d071-405e-bc18-598f5d876653 None None] MFA Rules not processed for user `ea9be0e55aab4a09bc4a86b8a9941efd`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:12.319336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-84d7f308-d071-405e-bc18-598f5d876653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:12.499716 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1855/3698] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:12.501126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0cfa4-3ff0-47b2-b506-a7b57eb99df9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:12.608192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede400-b063-4736-8156-2fb926db50ca None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:12.608479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede400-b063-4736-8156-2fb926db50ca None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:12.609212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede400-b063-4736-8156-2fb926db50ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:12.644565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-65ede400-b063-4736-8156-2fb926db50ca None None] MFA Rules not processed for user `6d0f3497fc80496499ed3d927823ce0c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:12.645803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-65ede400-b063-4736-8156-2fb926db50ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:12.789972 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1856/3699] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:12.801129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9094-f690-4d92-b539-ac9ee1607ea3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:12.801518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9094-f690-4d92-b539-ac9ee1607ea3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:12.801877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9094-f690-4d92-b539-ac9ee1607ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:12.832988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0cfa4-3ff0-47b2-b506-a7b57eb99df9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:12.841049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7dfb9094-f690-4d92-b539-ac9ee1607ea3 None None] MFA Rules not processed for user `6d0f3497fc80496499ed3d927823ce0c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:12.842225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7dfb9094-f690-4d92-b539-ac9ee1607ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:12.846182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:12.846990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:12.847303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:12.847589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:12.848373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:12.850717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:12.865058 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1857/3700] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:12.927316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9094-f690-4d92-b539-ac9ee1607ea3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:12.937280 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1844/3701] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:12 2022] POST /identity/v3/projects => generated 369 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:12.952206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9094-f690-4d92-b539-ac9ee1607ea3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:12.985663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:12.988222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:13.179189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5d7d6-9310-4a4e-9397-aeaa41a2c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:13.179883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d7d6-9310-4a4e-9397-aeaa41a2c00c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:13.180166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d7d6-9310-4a4e-9397-aeaa41a2c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:13.180468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d7d6-9310-4a4e-9397-aeaa41a2c00c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:13.181162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5d7d6-9310-4a4e-9397-aeaa41a2c00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:13.195227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5d7d6-9310-4a4e-9397-aeaa41a2c00c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:13.225720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb83ff-cff0-4d15-ace0-8ea3c1265677 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:13.235811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece0e68-04e9-4019-b97b-9e5869d90cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:13.246045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece0e68-04e9-4019-b97b-9e5869d90cf2 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:13.246403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece0e68-04e9-4019-b97b-9e5869d90cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:13.246680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece0e68-04e9-4019-b97b-9e5869d90cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:13.278517 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1858/3702] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:12 2022] POST /identity/v3/users => generated 285 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:13.284562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5d7d6-9310-4a4e-9397-aeaa41a2c00c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:13.303358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5d7d6-9310-4a4e-9397-aeaa41a2c00c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:13.319782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c34fe8-a61b-41a7-8445-5a285246b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:13.320494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34fe8-a61b-41a7-8445-5a285246b7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:13.320777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34fe8-a61b-41a7-8445-5a285246b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:13.321055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34fe8-a61b-41a7-8445-5a285246b7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:13.321781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c34fe8-a61b-41a7-8445-5a285246b7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:13.323373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c34fe8-a61b-41a7-8445-5a285246b7b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:13.383497 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1859/3703] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:13.384970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece0e68-04e9-4019-b97b-9e5869d90cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:13.387740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c34fe8-a61b-41a7-8445-5a285246b7b1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:13.388822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece0e68-04e9-4019-b97b-9e5869d90cf2 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:13.422233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c34fe8-a61b-41a7-8445-5a285246b7b1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:13.425381 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1845/3704] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:59:13.450355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477a207-4eae-48e0-81d7-c4041b022811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:13.453555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a207-4eae-48e0-81d7-c4041b022811 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:13.456675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a207-4eae-48e0-81d7-c4041b022811 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:13.458263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a207-4eae-48e0-81d7-c4041b022811 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:13.460373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477a207-4eae-48e0-81d7-c4041b022811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:13.468535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477a207-4eae-48e0-81d7-c4041b022811 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:13.529463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece0e68-04e9-4019-b97b-9e5869d90cf2 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:13.538672 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1860/3705] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:13.545216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece0e68-04e9-4019-b97b-9e5869d90cf2 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:13.591270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:13.592844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:13.593242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:13.593572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] PATH_INFO: `/v3/projects/e6103a190a0d46d58cad4740b967c133/users/0141c5669489412f8c5ab2f34927f221/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:13.614025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6103a190a0d46d58cad4740b967c133, user_id=0141c5669489412f8c5ab2f34927f221, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:13.617201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:13.644515 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1846/3706] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:13 2022] PUT /identity/v3/projects/e6103a190a0d46d58cad4740b967c133/users/0141c5669489412f8c5ab2f34927f221/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:13.646950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ddaf7-d391-4b57-8a98-3443c1b11423 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:13.647506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ddaf7-d391-4b57-8a98-3443c1b11423 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:13.648019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ddaf7-d391-4b57-8a98-3443c1b11423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:13.695309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f49ddaf7-d391-4b57-8a98-3443c1b11423 None None] MFA Rules not processed for user `0141c5669489412f8c5ab2f34927f221`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:13.696613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f49ddaf7-d391-4b57-8a98-3443c1b11423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:13.846574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1861/3707] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:13.891572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:13.897486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:13.979277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b88f2-5d50-44e4-b435-5410aac0c370 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:13.983126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898486f6-51af-43c4-8b0e-82f656847a6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:13.984545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898486f6-51af-43c4-8b0e-82f656847a6f service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:13.985017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898486f6-51af-43c4-8b0e-82f656847a6f service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:13.985602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898486f6-51af-43c4-8b0e-82f656847a6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:14.067081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898486f6-51af-43c4-8b0e-82f656847a6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:14.067625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898486f6-51af-43c4-8b0e-82f656847a6f service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:14.079466 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1847/3708] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:14.319934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ddaf7-d391-4b57-8a98-3443c1b11423 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:14.346686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ddaf7-d391-4b57-8a98-3443c1b11423 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:14.373311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a79561-789e-4131-bb43-ff7024aa78ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:14.380479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a79561-789e-4131-bb43-ff7024aa78ba service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:14.380793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a79561-789e-4131-bb43-ff7024aa78ba service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:14.381063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a79561-789e-4131-bb43-ff7024aa78ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:14.411528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a79561-789e-4131-bb43-ff7024aa78ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:14.419116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a79561-789e-4131-bb43-ff7024aa78ba service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:14.442896 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1862/3709] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:16.206472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898486f6-51af-43c4-8b0e-82f656847a6f service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:16.291438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898486f6-51af-43c4-8b0e-82f656847a6f service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:16.297307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:16.298867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:16.299316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:16.299779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] PATH_INFO: `/v3/users/ea9be0e55aab4a09bc4a86b8a9941efd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:16.301322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9be0e55aab4a09bc4a86b8a9941efd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:16.303432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:16.391005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9be0e55aab4a09bc4a86b8a9941efd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:16.391959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9be0e55aab4a09bc4a86b8a9941efd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:16.392955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9be0e55aab4a09bc4a86b8a9941efd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:16.419684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9be0e55aab4a09bc4a86b8a9941efd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:16.432507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9be0e55aab4a09bc4a86b8a9941efd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:16.479423 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1848/3710] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:16 2022] DELETE /identity/v3/users/ea9be0e55aab4a09bc4a86b8a9941efd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:16.484943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7227fb-969d-43f3-8893-858f2ec0d476 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:16.487026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7227fb-969d-43f3-8893-858f2ec0d476 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:16.487483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7227fb-969d-43f3-8893-858f2ec0d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:16.520773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2b7227fb-969d-43f3-8893-858f2ec0d476 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:16.523243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2b7227fb-969d-43f3-8893-858f2ec0d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:16.618975 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1863/3711] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:16.630514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:16.632314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:16.729216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e2aff-28ed-4ad6-bb14-b31e655612f8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:16.738747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d9b83-e79e-483c-81f9-7c0a00b31af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:16.739452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9b83-e79e-483c-81f9-7c0a00b31af2 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:16.739875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9b83-e79e-483c-81f9-7c0a00b31af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:16.740150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9b83-e79e-483c-81f9-7c0a00b31af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:16.762958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d9b83-e79e-483c-81f9-7c0a00b31af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:16.767821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d9b83-e79e-483c-81f9-7c0a00b31af2 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:16.783212 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1849/3712] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:17.487242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7227fb-969d-43f3-8893-858f2ec0d476 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:17.489948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2b7227fb-969d-43f3-8893-858f2ec0d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:17.529310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7227fb-969d-43f3-8893-858f2ec0d476 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:17.536789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:17.539664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:17.540157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:17.540798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] PATH_INFO: `/v3/projects/da7e5f5745ca402e84e95aa972c411aa` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:17.543230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7e5f5745ca402e84e95aa972c411aa)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:17.545530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:17.659558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7e5f5745ca402e84e95aa972c411aa', 'request_id': 'req-cd583a88-b0ba-42b5-927e-df7742d0c818'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.667385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7e5f5745ca402e84e95aa972c411aa', 'request_id': 'req-cd583a88-b0ba-42b5-927e-df7742d0c818'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.684145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7e5f5745ca402e84e95aa972c411aa', 'request_id': 'req-cd583a88-b0ba-42b5-927e-df7742d0c818'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.705509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] The token cache is being invalidate because project da7e5f5745ca402e84e95aa972c411aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:17.705951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.706724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.708720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1864/3713] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:17 2022] DELETE /identity/v3/projects/da7e5f5745ca402e84e95aa972c411aa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:17.712587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d9b83-e79e-483c-81f9-7c0a00b31af2 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:17.725751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d9b83-e79e-483c-81f9-7c0a00b31af2 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:17.866142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:17.867336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:17.867775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:17.877554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] PATH_INFO: `/v3/users/0141c5669489412f8c5ab2f34927f221` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:17.881909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0141c5669489412f8c5ab2f34927f221)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:17.892013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:17.968398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0141c5669489412f8c5ab2f34927f221'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.969731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0141c5669489412f8c5ab2f34927f221'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.970405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0141c5669489412f8c5ab2f34927f221'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.986397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0141c5669489412f8c5ab2f34927f221'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:17.995698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50e29546-6c45-41b2-9b69-be4c4c3982c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0141c5669489412f8c5ab2f34927f221'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:18.016809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1850/3714] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:17 2022] DELETE /identity/v3/users/0141c5669489412f8c5ab2f34927f221 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:18.630567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:18.632838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:18.648141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583a88-b0ba-42b5-927e-df7742d0c818 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:18.732774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:18.733793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:18.734076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:18.734350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] PATH_INFO: `/v3/projects/e6103a190a0d46d58cad4740b967c133` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:18.735745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6103a190a0d46d58cad4740b967c133)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:18.737751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:18.831374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6103a190a0d46d58cad4740b967c133', 'request_id': 'req-f14287d6-f146-4c31-8021-095bb365142f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:18.853058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6103a190a0d46d58cad4740b967c133', 'request_id': 'req-f14287d6-f146-4c31-8021-095bb365142f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:18.873750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6103a190a0d46d58cad4740b967c133', 'request_id': 'req-f14287d6-f146-4c31-8021-095bb365142f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:18.893471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] The token cache is being invalidate because project e6103a190a0d46d58cad4740b967c133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:18.894226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:18.895243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f14287d6-f146-4c31-8021-095bb365142f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:18.897288 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1865/3715] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:18 2022] DELETE /identity/v3/projects/e6103a190a0d46d58cad4740b967c133 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:18.903708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2d82-42b4-4d47-9584-9609379d56b2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:18.904211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2d82-42b4-4d47-9584-9609379d56b2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:18.904375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2d82-42b4-4d47-9584-9609379d56b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:18.928814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3bdf2d82-42b4-4d47-9584-9609379d56b2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:18.930448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3bdf2d82-42b4-4d47-9584-9609379d56b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:19.010717 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1851/3716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:19.020629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0dc8d-e275-49c8-852d-4dd47ed9390b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.020922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0dc8d-e275-49c8-852d-4dd47ed9390b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.021202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0dc8d-e275-49c8-852d-4dd47ed9390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.057838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-64f0dc8d-e275-49c8-852d-4dd47ed9390b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:19.059521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-64f0dc8d-e275-49c8-852d-4dd47ed9390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:19.074853 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1866/3717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:19.079287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf2d82-42b4-4d47-9584-9609379d56b2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:19.093820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf2d82-42b4-4d47-9584-9609379d56b2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:19.107962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:19.109445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.109890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.110376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.111775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:19.112544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:19.115811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:19.143272 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1852/3718] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:19.147838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0dc8d-e275-49c8-852d-4dd47ed9390b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:19.168912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0dc8d-e275-49c8-852d-4dd47ed9390b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:19.187827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a363a-5521-4f72-bae4-c84a23868578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:19.188556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a363a-5521-4f72-bae4-c84a23868578 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.192071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a363a-5521-4f72-bae4-c84a23868578 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.192419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a363a-5521-4f72-bae4-c84a23868578 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.193308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a363a-5521-4f72-bae4-c84a23868578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:19.195217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a363a-5521-4f72-bae4-c84a23868578 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:19.230465 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1867/3719] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:19 2022] POST /identity/v3/projects => generated 361 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:19.235346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:19.245526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1633328-9ec3-4ccd-84c9-ca1bf675ef56 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:19.310043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e590a1e-23e0-4d94-a135-3db27c1d3f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:19.311007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e590a1e-23e0-4d94-a135-3db27c1d3f9e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.312058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e590a1e-23e0-4d94-a135-3db27c1d3f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.312719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e590a1e-23e0-4d94-a135-3db27c1d3f9e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.313701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e590a1e-23e0-4d94-a135-3db27c1d3f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:19.316015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e590a1e-23e0-4d94-a135-3db27c1d3f9e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:19.343110 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1853/3720] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:19 2022] POST /identity/v3/users => generated 281 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:19.349093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a363a-5521-4f72-bae4-c84a23868578 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:19.377325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a363a-5521-4f72-bae4-c84a23868578 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:19.385879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1b155-d65a-4c01-bdec-271660950709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:19.387104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b155-d65a-4c01-bdec-271660950709 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.387979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b155-d65a-4c01-bdec-271660950709 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.388454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b155-d65a-4c01-bdec-271660950709 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.389411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1b155-d65a-4c01-bdec-271660950709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:19.392417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1b155-d65a-4c01-bdec-271660950709 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:19.407407 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1868/3721] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:19.411270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e590a1e-23e0-4d94-a135-3db27c1d3f9e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:19.423970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e590a1e-23e0-4d94-a135-3db27c1d3f9e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:19.430694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d35fe-5c1f-4066-988a-18a3139c72ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:19.431426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d35fe-5c1f-4066-988a-18a3139c72ce admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.431909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d35fe-5c1f-4066-988a-18a3139c72ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.432050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d35fe-5c1f-4066-988a-18a3139c72ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.432722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d35fe-5c1f-4066-988a-18a3139c72ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:19.434581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d35fe-5c1f-4066-988a-18a3139c72ce admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:19.453416 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1854/3722] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:19.456436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1b155-d65a-4c01-bdec-271660950709 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:19.466452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1b155-d65a-4c01-bdec-271660950709 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:19.472594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8002f9-69e1-4e15-b374-e3cd0664ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:19.473484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8002f9-69e1-4e15-b374-e3cd0664ddac admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.473771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8002f9-69e1-4e15-b374-e3cd0664ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.475531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8002f9-69e1-4e15-b374-e3cd0664ddac admin admin] PATH_INFO: `/v3/projects/6774b781af5a4c5995774e6476ac73b8/users/8d8b57cb29664d648856e3147e1769f1/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.492521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8002f9-69e1-4e15-b374-e3cd0664ddac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6774b781af5a4c5995774e6476ac73b8, user_id=8d8b57cb29664d648856e3147e1769f1, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:19.495557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8002f9-69e1-4e15-b374-e3cd0664ddac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:19.551518 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1869/3723] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:19 2022] PUT /identity/v3/projects/6774b781af5a4c5995774e6476ac73b8/users/8d8b57cb29664d648856e3147e1769f1/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:19.553435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bf40-47b8-4935-ab0c-7ac369c056c0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.554204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bf40-47b8-4935-ab0c-7ac369c056c0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.554204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bf40-47b8-4935-ab0c-7ac369c056c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.597140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eb21bf40-47b8-4935-ab0c-7ac369c056c0 None None] MFA Rules not processed for user `8d8b57cb29664d648856e3147e1769f1`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:19.599922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb21bf40-47b8-4935-ab0c-7ac369c056c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:19.695879 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1855/3724] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:19.707829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8002f9-69e1-4e15-b374-e3cd0664ddac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:19.810508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8002f9-69e1-4e15-b374-e3cd0664ddac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:19.810886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21bf40-47b8-4935-ab0c-7ac369c056c0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:19.813185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb21bf40-47b8-4935-ab0c-7ac369c056c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:19.826316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:19.827422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.827911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.828638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] PATH_INFO: `/v3/users/8d8b57cb29664d648856e3147e1769f1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.830121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8b57cb29664d648856e3147e1769f1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:19.832290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:19.837689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21bf40-47b8-4935-ab0c-7ac369c056c0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:19.843649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:19.845239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.845890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.846378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] PATH_INFO: `/v3/users/e94820c6c6d04bcbae0e183cb51aa3b1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.848013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94820c6c6d04bcbae0e183cb51aa3b1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:19.850220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:19.900262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8b57cb29664d648856e3147e1769f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.908745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94820c6c6d04bcbae0e183cb51aa3b1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.910069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94820c6c6d04bcbae0e183cb51aa3b1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.910689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94820c6c6d04bcbae0e183cb51aa3b1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.916712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8b57cb29664d648856e3147e1769f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.924252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94820c6c6d04bcbae0e183cb51aa3b1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.926725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8b57cb29664d648856e3147e1769f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.928649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8b57cb29664d648856e3147e1769f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.929788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ecebc64-032a-4da8-8729-2e1bcb405885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8b57cb29664d648856e3147e1769f1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.936948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94820c6c6d04bcbae0e183cb51aa3b1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:19.951187 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1870/3725] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:19 2022] DELETE /identity/v3/users/8d8b57cb29664d648856e3147e1769f1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:19.953957 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1856/3726] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:19 2022] DELETE /identity/v3/users/e94820c6c6d04bcbae0e183cb51aa3b1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:19.955016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6730be-9c65-466e-9cc8-bc62e364cdf6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:19.955374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6730be-9c65-466e-9cc8-bc62e364cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:19.955678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6730be-9c65-466e-9cc8-bc62e364cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:19.976258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7d6730be-9c65-466e-9cc8-bc62e364cdf6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:19.977748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d6730be-9c65-466e-9cc8-bc62e364cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:20.050645 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1871/3727] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:20.066201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:20.067952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:20.138111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ae8fb-1bb2-40ca-9721-b29de79ac49e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:20.143182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf8480-2ee2-4113-9b3b-435bd8c2743a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:20.144372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8480-2ee2-4113-9b3b-435bd8c2743a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.144942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8480-2ee2-4113-9b3b-435bd8c2743a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.145399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8480-2ee2-4113-9b3b-435bd8c2743a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.156007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf8480-2ee2-4113-9b3b-435bd8c2743a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:20.157801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf8480-2ee2-4113-9b3b-435bd8c2743a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:20.169579 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1857/3728] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:20.176303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6730be-9c65-466e-9cc8-bc62e364cdf6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:20.178180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d6730be-9c65-466e-9cc8-bc62e364cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:20.199210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6730be-9c65-466e-9cc8-bc62e364cdf6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:20.205235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:20.206701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.207162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.207622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] PATH_INFO: `/v3/projects/2f4aa3e254e944d4a85f2085a89a921b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.209693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4aa3e254e944d4a85f2085a89a921b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:20.211824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:20.294780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4aa3e254e944d4a85f2085a89a921b', 'request_id': 'req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.300855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4aa3e254e944d4a85f2085a89a921b', 'request_id': 'req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.310551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4aa3e254e944d4a85f2085a89a921b', 'request_id': 'req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.329748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] The token cache is being invalidate because project 2f4aa3e254e944d4a85f2085a89a921b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:20.330190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.332899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-224a5983-f3b8-43c5-8a9e-c77ffa4b8ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.334634 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1872/3729] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:20 2022] DELETE /identity/v3/projects/2f4aa3e254e944d4a85f2085a89a921b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:20.341898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f48d-b84e-4fb1-a869-dc4222398e27 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.342334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f48d-b84e-4fb1-a869-dc4222398e27 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.343375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f48d-b84e-4fb1-a869-dc4222398e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.377265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6524f48d-b84e-4fb1-a869-dc4222398e27 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:20.379195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6524f48d-b84e-4fb1-a869-dc4222398e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:20.493471 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1858/3730] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:20.501775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d97288-541b-44dc-ad79-cc460550e486 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.502106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d97288-541b-44dc-ad79-cc460550e486 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.502374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d97288-541b-44dc-ad79-cc460550e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.534490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-14d97288-541b-44dc-ad79-cc460550e486 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:20.535807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-14d97288-541b-44dc-ad79-cc460550e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:20.549987 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1873/3731] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:20.552129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524f48d-b84e-4fb1-a869-dc4222398e27 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:20.569194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524f48d-b84e-4fb1-a869-dc4222398e27 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:20.589837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:20.593566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.593976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.594176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.594927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:20.595234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:20.604572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:20.627428 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1859/3732] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:59:20.632717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d97288-541b-44dc-ad79-cc460550e486 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:20.647553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d97288-541b-44dc-ad79-cc460550e486 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:20.653100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bae02e-c6fd-43c2-9f6d-a9e005de4a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:20.653812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae02e-c6fd-43c2-9f6d-a9e005de4a58 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.654167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae02e-c6fd-43c2-9f6d-a9e005de4a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.654523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae02e-c6fd-43c2-9f6d-a9e005de4a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.655939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bae02e-c6fd-43c2-9f6d-a9e005de4a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:20.657985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bae02e-c6fd-43c2-9f6d-a9e005de4a58 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:20.679505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:20.681676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:20.700412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73529ea1-3c6e-4f45-9d85-48cfd4573bcb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:20.705095 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1874/3733] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:20 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:20.708678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bae02e-c6fd-43c2-9f6d-a9e005de4a58 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:20.781716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:20.782694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.783022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.783375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] PATH_INFO: `/v3/projects/6774b781af5a4c5995774e6476ac73b8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.785273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6774b781af5a4c5995774e6476ac73b8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:20.787479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:20.795608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bae02e-c6fd-43c2-9f6d-a9e005de4a58 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:20.804057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fef5-22d4-460f-87c3-6923d01877d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:20.804849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fef5-22d4-460f-87c3-6923d01877d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.805385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fef5-22d4-460f-87c3-6923d01877d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.805848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fef5-22d4-460f-87c3-6923d01877d5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.806589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6fef5-22d4-460f-87c3-6923d01877d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:20.809131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6fef5-22d4-460f-87c3-6923d01877d5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:20.831803 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1875/3734] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:20 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:20.835521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fef5-22d4-460f-87c3-6923d01877d5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:20.843246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6774b781af5a4c5995774e6476ac73b8', 'request_id': 'req-01d01b47-4529-4964-8b23-c63c4126c63c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.851284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fef5-22d4-460f-87c3-6923d01877d5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:20.853280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6774b781af5a4c5995774e6476ac73b8', 'request_id': 'req-01d01b47-4529-4964-8b23-c63c4126c63c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.864929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6774b781af5a4c5995774e6476ac73b8', 'request_id': 'req-01d01b47-4529-4964-8b23-c63c4126c63c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.882480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] The token cache is being invalidate because project 6774b781af5a4c5995774e6476ac73b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:20.882765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.884117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01d01b47-4529-4964-8b23-c63c4126c63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:20.886892 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1860/3735] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:20 2022] DELETE /identity/v3/projects/6774b781af5a4c5995774e6476ac73b8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:20.892809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106e4e4-ab14-472d-b236-1e0cd2e366a5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.893112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106e4e4-ab14-472d-b236-1e0cd2e366a5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.895714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106e4e4-ab14-472d-b236-1e0cd2e366a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.919162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6106e4e4-ab14-472d-b236-1e0cd2e366a5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:20.921646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6106e4e4-ab14-472d-b236-1e0cd2e366a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:20.942426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:20.943768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.944206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.946156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.946914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:20.948561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:20.965747 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1876/3736] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:20.966685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:20.970684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:20.986579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012dc34-d7dd-49d6-ac76-006ba93e9ac2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:20.993012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728742-6a34-430c-b820-c43175bf97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:20.993685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728742-6a34-430c-b820-c43175bf97b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:20.993965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728742-6a34-430c-b820-c43175bf97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:20.994513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728742-6a34-430c-b820-c43175bf97b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:20.995242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27728742-6a34-430c-b820-c43175bf97b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:20.997446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27728742-6a34-430c-b820-c43175bf97b4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.013100 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1877/3737] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:21.013957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728742-6a34-430c-b820-c43175bf97b4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.031881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728742-6a34-430c-b820-c43175bf97b4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.046653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30349ea-4812-4f23-81db-bb986c057d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.047847 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1861/3738] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:21.048029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30349ea-4812-4f23-81db-bb986c057d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.048029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30349ea-4812-4f23-81db-bb986c057d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.048029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30349ea-4812-4f23-81db-bb986c057d88 admin admin] PATH_INFO: `/v3/projects/fea74080450a434fb28f53a0a28d5627/users/ae01e28f534446c09c6dfbe2871d36f9/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.048992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3758-b0bf-43b7-ad99-078c93263f67 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.049376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3758-b0bf-43b7-ad99-078c93263f67 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.049744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3758-b0bf-43b7-ad99-078c93263f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.079135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0b2f3758-b0bf-43b7-ad99-078c93263f67 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:21.080487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0b2f3758-b0bf-43b7-ad99-078c93263f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:21.086421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30349ea-4812-4f23-81db-bb986c057d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea74080450a434fb28f53a0a28d5627, user_id=ae01e28f534446c09c6dfbe2871d36f9, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.089430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30349ea-4812-4f23-81db-bb986c057d88 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.092686 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1862/3739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:59:21.099468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3758-b0bf-43b7-ad99-078c93263f67 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.110482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3758-b0bf-43b7-ad99-078c93263f67 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.113436 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1878/3740] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:21 2022] PUT /identity/v3/projects/fea74080450a434fb28f53a0a28d5627/users/ae01e28f534446c09c6dfbe2871d36f9/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:21.118580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a424481-5629-44be-af11-98adfa25509c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.118855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a424481-5629-44be-af11-98adfa25509c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.119426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a424481-5629-44be-af11-98adfa25509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.140856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4a424481-5629-44be-af11-98adfa25509c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:21.149279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4a424481-5629-44be-af11-98adfa25509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:21.182298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.183123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.183403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.183938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.184698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:21.185005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.187249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.200379 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1863/3741] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:21.203973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.214432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77aa6-94f3-4f13-b4ff-aefa1d556d34 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.220412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a16e32-fdce-4250-bd51-3a6515394d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.221076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a16e32-fdce-4250-bd51-3a6515394d3f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.224515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a16e32-fdce-4250-bd51-3a6515394d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.224658 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1879/3742] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:59:21.224756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a16e32-fdce-4250-bd51-3a6515394d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.224756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a16e32-fdce-4250-bd51-3a6515394d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.224756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a16e32-fdce-4250-bd51-3a6515394d3f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.231596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a424481-5629-44be-af11-98adfa25509c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.233283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4a424481-5629-44be-af11-98adfa25509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:21.258820 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1864/3743] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:21 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:21.259602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a16e32-fdce-4250-bd51-3a6515394d3f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.302622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a424481-5629-44be-af11-98adfa25509c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.335208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a16e32-fdce-4250-bd51-3a6515394d3f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.340944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4afce4-330a-49fa-b7f5-05cbcb8448ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.341667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4afce4-330a-49fa-b7f5-05cbcb8448ba admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.341952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4afce4-330a-49fa-b7f5-05cbcb8448ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.342280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4afce4-330a-49fa-b7f5-05cbcb8448ba admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.343584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4afce4-330a-49fa-b7f5-05cbcb8448ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.345665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4afce4-330a-49fa-b7f5-05cbcb8448ba admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.362069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cd8da-15c3-4d58-9fb2-230cd4bce3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.362635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd8da-15c3-4d58-9fb2-230cd4bce3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.362984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd8da-15c3-4d58-9fb2-230cd4bce3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.363320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd8da-15c3-4d58-9fb2-230cd4bce3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.368383 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1865/3744] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:21 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:21.372247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4afce4-330a-49fa-b7f5-05cbcb8448ba admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.377185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cd8da-15c3-4d58-9fb2-230cd4bce3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.378622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cd8da-15c3-4d58-9fb2-230cd4bce3f0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.382538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4afce4-330a-49fa-b7f5-05cbcb8448ba admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.387432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02a47d-3c40-4469-8a7d-8fa54c497d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.388171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a47d-3c40-4469-8a7d-8fa54c497d33 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.388641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a47d-3c40-4469-8a7d-8fa54c497d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.388826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a47d-3c40-4469-8a7d-8fa54c497d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.389574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02a47d-3c40-4469-8a7d-8fa54c497d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.389805 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1880/3745] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:59:21.391226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02a47d-3c40-4469-8a7d-8fa54c497d33 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.404184 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1866/3746] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:59:21.406114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cd8da-15c3-4d58-9fb2-230cd4bce3f0 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.415472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cd8da-15c3-4d58-9fb2-230cd4bce3f0 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.421468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18859437-67a2-4e5b-be09-bc1b0ad6560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.422160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859437-67a2-4e5b-be09-bc1b0ad6560d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.422436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859437-67a2-4e5b-be09-bc1b0ad6560d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.422863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859437-67a2-4e5b-be09-bc1b0ad6560d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.423412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18859437-67a2-4e5b-be09-bc1b0ad6560d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.425200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18859437-67a2-4e5b-be09-bc1b0ad6560d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.436340 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1881/3747] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:21.440665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02a47d-3c40-4469-8a7d-8fa54c497d33 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.452183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02a47d-3c40-4469-8a7d-8fa54c497d33 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.457243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eef8c-5e5d-48b6-88bc-57d9ed50fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.458127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eef8c-5e5d-48b6-88bc-57d9ed50fbe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.458510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eef8c-5e5d-48b6-88bc-57d9ed50fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.458786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eef8c-5e5d-48b6-88bc-57d9ed50fbe1 admin admin] PATH_INFO: `/v3/projects/6c9cabb608ec46cbac49c6d439195860/users/327154d167ed44b4b3fd00e64e6984a2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.475368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eef8c-5e5d-48b6-88bc-57d9ed50fbe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9cabb608ec46cbac49c6d439195860, user_id=327154d167ed44b4b3fd00e64e6984a2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.478537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eef8c-5e5d-48b6-88bc-57d9ed50fbe1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.501739 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1867/3748] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:21 2022] PUT /identity/v3/projects/6c9cabb608ec46cbac49c6d439195860/users/327154d167ed44b4b3fd00e64e6984a2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:21.513236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6035c-e9b4-4f13-b2e3-71d2aa06b110 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.513583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6035c-e9b4-4f13-b2e3-71d2aa06b110 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.513899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6035c-e9b4-4f13-b2e3-71d2aa06b110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.542279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bac6035c-e9b4-4f13-b2e3-71d2aa06b110 None None] MFA Rules not processed for user `327154d167ed44b4b3fd00e64e6984a2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:21.543497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bac6035c-e9b4-4f13-b2e3-71d2aa06b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:21.622295 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1882/3749] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:21.626397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eef8c-5e5d-48b6-88bc-57d9ed50fbe1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.688556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eef8c-5e5d-48b6-88bc-57d9ed50fbe1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.693241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90274c-c28d-4285-b843-9fa0f1967c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.693888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90274c-c28d-4285-b843-9fa0f1967c79 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.694168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90274c-c28d-4285-b843-9fa0f1967c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.694441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90274c-c28d-4285-b843-9fa0f1967c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.695133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90274c-c28d-4285-b843-9fa0f1967c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.697167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90274c-c28d-4285-b843-9fa0f1967c79 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.731546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1868/3750] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:21 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:21.735361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6035c-e9b4-4f13-b2e3-71d2aa06b110 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.749662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6035c-e9b4-4f13-b2e3-71d2aa06b110 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.834439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39b17e-bda6-459f-a816-0d2009623ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.835168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b17e-bda6-459f-a816-0d2009623ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.835442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b17e-bda6-459f-a816-0d2009623ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.835720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b17e-bda6-459f-a816-0d2009623ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.836468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39b17e-bda6-459f-a816-0d2009623ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.838455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39b17e-bda6-459f-a816-0d2009623ee0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.864970 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1883/3751] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:21 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:21.866238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90274c-c28d-4285-b843-9fa0f1967c79 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.878964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90274c-c28d-4285-b843-9fa0f1967c79 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.885043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087f3d5-672e-445a-bb60-1fe0b7a7ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.885706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087f3d5-672e-445a-bb60-1fe0b7a7ea89 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.885985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087f3d5-672e-445a-bb60-1fe0b7a7ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.886258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087f3d5-672e-445a-bb60-1fe0b7a7ea89 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.886978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087f3d5-672e-445a-bb60-1fe0b7a7ea89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.888701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087f3d5-672e-445a-bb60-1fe0b7a7ea89 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:21.905118 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1869/3752] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:21.907113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39b17e-bda6-459f-a816-0d2009623ee0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:21.919834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39b17e-bda6-459f-a816-0d2009623ee0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:21.932061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339f569-fc61-4370-9949-7c440d02b09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:21.933268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f569-fc61-4370-9949-7c440d02b09a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:21.934026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f569-fc61-4370-9949-7c440d02b09a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:21.934376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f569-fc61-4370-9949-7c440d02b09a admin admin] PATH_INFO: `/v3/projects/afb21028bdd74fbeafd2ace9ecbb9b8f/users/f6441b2985c44e6fb790261b8e765a06/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:21.964493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339f569-fc61-4370-9949-7c440d02b09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb21028bdd74fbeafd2ace9ecbb9b8f, user_id=f6441b2985c44e6fb790261b8e765a06, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:21.981315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339f569-fc61-4370-9949-7c440d02b09a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:22.009324 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1884/3753] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:21 2022] PUT /identity/v3/projects/afb21028bdd74fbeafd2ace9ecbb9b8f/users/f6441b2985c44e6fb790261b8e765a06/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:22.011421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087f3d5-672e-445a-bb60-1fe0b7a7ea89 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:22.029054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087f3d5-672e-445a-bb60-1fe0b7a7ea89 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:22.108102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d03c7-d46a-414d-8a1c-60838df72eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:22.109715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d03c7-d46a-414d-8a1c-60838df72eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.110216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d03c7-d46a-414d-8a1c-60838df72eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.110758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d03c7-d46a-414d-8a1c-60838df72eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.111786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d03c7-d46a-414d-8a1c-60838df72eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:22.114049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d03c7-d46a-414d-8a1c-60838df72eb0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:22.133753 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1870/3754] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:22.134003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339f569-fc61-4370-9949-7c440d02b09a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:22.147209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339f569-fc61-4370-9949-7c440d02b09a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:22.151428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4304d65-1438-4000-bc26-ac6508a5275f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.151714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4304d65-1438-4000-bc26-ac6508a5275f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.152924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4304d65-1438-4000-bc26-ac6508a5275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.154666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39214019-6d6c-4b21-a118-09336e8cd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:22.156811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214019-6d6c-4b21-a118-09336e8cd9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.157188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214019-6d6c-4b21-a118-09336e8cd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.158265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214019-6d6c-4b21-a118-09336e8cd9c8 admin admin] PATH_INFO: `/v3/projects/afb21028bdd74fbeafd2ace9ecbb9b8f/users/f6441b2985c44e6fb790261b8e765a06/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.160732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39214019-6d6c-4b21-a118-09336e8cd9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb21028bdd74fbeafd2ace9ecbb9b8f, user_id=f6441b2985c44e6fb790261b8e765a06, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:22.170568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39214019-6d6c-4b21-a118-09336e8cd9c8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:22.194379 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1885/3755] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:22 2022] PUT /identity/v3/projects/afb21028bdd74fbeafd2ace9ecbb9b8f/users/f6441b2985c44e6fb790261b8e765a06/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:22.197322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2da2-f259-49d3-ac25-4baa760bd93d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.197781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2da2-f259-49d3-ac25-4baa760bd93d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.198196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2da2-f259-49d3-ac25-4baa760bd93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.219495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c4304d65-1438-4000-bc26-ac6508a5275f None None] MFA Rules not processed for user `ae01e28f534446c09c6dfbe2871d36f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:22.221280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c4304d65-1438-4000-bc26-ac6508a5275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:22.255113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-07db2da2-f259-49d3-ac25-4baa760bd93d None None] MFA Rules not processed for user `f6441b2985c44e6fb790261b8e765a06`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:22.256478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-07db2da2-f259-49d3-ac25-4baa760bd93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:22.368645 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1871/3756] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:22.373580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1162b-a178-412e-b40f-bfb42abb7ff7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.374019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1162b-a178-412e-b40f-bfb42abb7ff7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.374693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1162b-a178-412e-b40f-bfb42abb7ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.431362 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1886/3757] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:22.436429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-41b1162b-a178-412e-b40f-bfb42abb7ff7 None None] MFA Rules not processed for user `ae01e28f534446c09c6dfbe2871d36f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:22.436871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad41c-e616-4536-a3d9-601957f58322 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.437212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad41c-e616-4536-a3d9-601957f58322 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.437606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad41c-e616-4536-a3d9-601957f58322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.439562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41b1162b-a178-412e-b40f-bfb42abb7ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:22.454244 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1872/3758] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:22.455183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1162b-a178-412e-b40f-bfb42abb7ff7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:22.456728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41b1162b-a178-412e-b40f-bfb42abb7ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:22.500677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a10ad41c-e616-4536-a3d9-601957f58322 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:22.502089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a10ad41c-e616-4536-a3d9-601957f58322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:22.580310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1162b-a178-412e-b40f-bfb42abb7ff7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:22.588710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:22.590004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.590507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.592035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.605039 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1887/3759] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:59:22.614376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:22.616480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:22.620480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ad41c-e616-4536-a3d9-601957f58322 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:22.624029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a10ad41c-e616-4536-a3d9-601957f58322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:22.629515 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1873/3760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:22.738921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:22.741115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:22.830640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ad41c-e616-4536-a3d9-601957f58322 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:22.855016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8c2f7-b776-44b7-a85a-b20a9f7a7d93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:22.856025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8c2f7-b776-44b7-a85a-b20a9f7a7d93 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.861667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8c2f7-b776-44b7-a85a-b20a9f7a7d93 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.862215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8c2f7-b776-44b7-a85a-b20a9f7a7d93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.885790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8c2f7-b776-44b7-a85a-b20a9f7a7d93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:22.888275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8c2f7-b776-44b7-a85a-b20a9f7a7d93 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:22.917595 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1888/3761] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:59:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:22.938451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d135ef-c1d7-4269-9e4e-fe5d0b850fad service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:22.950441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a32dc-98e7-412b-b8e1-f7c78bdf186c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:22.951084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a32dc-98e7-412b-b8e1-f7c78bdf186c service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:22.951454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a32dc-98e7-412b-b8e1-f7c78bdf186c service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:22.951828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a32dc-98e7-412b-b8e1-f7c78bdf186c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:22.971510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a32dc-98e7-412b-b8e1-f7c78bdf186c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:22.973473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a32dc-98e7-412b-b8e1-f7c78bdf186c service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:22.996701 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1874/3762] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:26.355406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8c2f7-b776-44b7-a85a-b20a9f7a7d93 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:26.486386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8c2f7-b776-44b7-a85a-b20a9f7a7d93 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:26.493114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:26.494322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:26.495410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:26.496075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] PATH_INFO: `/v3/users/327154d167ed44b4b3fd00e64e6984a2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:26.498407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327154d167ed44b4b3fd00e64e6984a2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:26.501996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:26.582023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327154d167ed44b4b3fd00e64e6984a2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:26.602896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327154d167ed44b4b3fd00e64e6984a2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:26.618995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327154d167ed44b4b3fd00e64e6984a2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:26.620613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327154d167ed44b4b3fd00e64e6984a2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:26.621960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327154d167ed44b4b3fd00e64e6984a2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:26.637826 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1889/3763] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:26 2022] DELETE /identity/v3/users/327154d167ed44b4b3fd00e64e6984a2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:26.642374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b7c7f-c924-4da1-a74f-4bc5d02214b1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:26.643321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b7c7f-c924-4da1-a74f-4bc5d02214b1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:26.643792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b7c7f-c924-4da1-a74f-4bc5d02214b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:26.670009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-265b7c7f-c924-4da1-a74f-4bc5d02214b1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:26.673162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-265b7c7f-c924-4da1-a74f-4bc5d02214b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:26.838498 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1875/3764] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:59:26.867169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:26.868860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:26.992988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffd49f-6df4-4a06-bb17-efccad57f5c4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:27.002783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:27.003704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:27.004217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:27.004728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:27.018276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:27.032483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:27.062591 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1890/3765] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:27.175046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b15c-7d10-47c9-ac6e-d545b567dfa6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:27.175354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b15c-7d10-47c9-ac6e-d545b567dfa6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:27.175637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b15c-7d10-47c9-ac6e-d545b567dfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:27.210429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a9a0b15c-7d10-47c9-ac6e-d545b567dfa6 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:27.211717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a9a0b15c-7d10-47c9-ac6e-d545b567dfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:27.300344 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1876/3766] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:27.320132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:27.321469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:27.466041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767990-ee43-4e9e-afb3-03577c025f9f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:27.481379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81eef-077e-4937-be9f-d745b0be111c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:27.482234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81eef-077e-4937-be9f-d745b0be111c service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:27.483739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81eef-077e-4937-be9f-d745b0be111c service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:27.484868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81eef-077e-4937-be9f-d745b0be111c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:27.545685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f81eef-077e-4937-be9f-d745b0be111c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:27.545685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f81eef-077e-4937-be9f-d745b0be111c service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:27.545685 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1891/3767] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:59:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:27.805411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0b15c-7d10-47c9-ac6e-d545b567dfa6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:27.807148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a9a0b15c-7d10-47c9-ac6e-d545b567dfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:27.839110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0b15c-7d10-47c9-ac6e-d545b567dfa6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:27.864004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:27.866019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:27.866491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:27.867001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] PATH_INFO: `/v3/projects/6c9cabb608ec46cbac49c6d439195860` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:27.869146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9cabb608ec46cbac49c6d439195860)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:27.876118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:28.015118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9cabb608ec46cbac49c6d439195860', 'request_id': 'req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.028949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9cabb608ec46cbac49c6d439195860', 'request_id': 'req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.047401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9cabb608ec46cbac49c6d439195860', 'request_id': 'req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.069436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] The token cache is being invalidate because project 6c9cabb608ec46cbac49c6d439195860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:28.069784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.070620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.072587 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1877/3768] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:27 2022] DELETE /identity/v3/projects/6c9cabb608ec46cbac49c6d439195860 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:28.077873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81eef-077e-4937-be9f-d745b0be111c service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:28.093916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81eef-077e-4937-be9f-d745b0be111c service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:28.205087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:28.206228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:28.206694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:28.207140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] PATH_INFO: `/v3/users/f6441b2985c44e6fb790261b8e765a06` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:28.208587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6441b2985c44e6fb790261b8e765a06)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:28.210670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:28.271727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6441b2985c44e6fb790261b8e765a06'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.287738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6441b2985c44e6fb790261b8e765a06'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.306893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6441b2985c44e6fb790261b8e765a06'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.307853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6441b2985c44e6fb790261b8e765a06'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.309859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb4bdf1-dc1f-4356-a42a-525e70f22f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6441b2985c44e6fb790261b8e765a06'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:28.326503 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1892/3769] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:28 2022] DELETE /identity/v3/users/f6441b2985c44e6fb790261b8e765a06 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:29.077012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:29.079287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:29.115573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86933-d6e4-46e2-8a1c-0fa74b40ed69 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:29.317826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:29.318618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:29.318965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:29.319237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] PATH_INFO: `/v3/projects/afb21028bdd74fbeafd2ace9ecbb9b8f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:29.321081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb21028bdd74fbeafd2ace9ecbb9b8f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:29.334035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:29.487420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb21028bdd74fbeafd2ace9ecbb9b8f', 'request_id': 'req-a2f47f6a-1b26-4095-89c0-4630c17a392e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:29.501271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb21028bdd74fbeafd2ace9ecbb9b8f', 'request_id': 'req-a2f47f6a-1b26-4095-89c0-4630c17a392e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:29.520114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb21028bdd74fbeafd2ace9ecbb9b8f', 'request_id': 'req-a2f47f6a-1b26-4095-89c0-4630c17a392e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:29.543535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] The token cache is being invalidate because project afb21028bdd74fbeafd2ace9ecbb9b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:29.543788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:29.544573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a2f47f6a-1b26-4095-89c0-4630c17a392e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:29.547267 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1878/3770] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:29 2022] DELETE /identity/v3/projects/afb21028bdd74fbeafd2ace9ecbb9b8f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:29.552069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1f3e-6421-4d7a-b224-543929d6f8de None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:29.552644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1f3e-6421-4d7a-b224-543929d6f8de None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:29.552644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1f3e-6421-4d7a-b224-543929d6f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:29.617195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-557c1f3e-6421-4d7a-b224-543929d6f8de None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:29.620441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-557c1f3e-6421-4d7a-b224-543929d6f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:29.778604 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1893/3771] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:29.786553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716bb7-b0db-4f61-aeb3-4f70f73e8fed None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:29.786964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716bb7-b0db-4f61-aeb3-4f70f73e8fed None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:29.787353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716bb7-b0db-4f61-aeb3-4f70f73e8fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:29.824806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-73716bb7-b0db-4f61-aeb3-4f70f73e8fed None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:29.826121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-73716bb7-b0db-4f61-aeb3-4f70f73e8fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:29.847689 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1879/3772] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:29.848655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1f3e-6421-4d7a-b224-543929d6f8de None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:29.877086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1f3e-6421-4d7a-b224-543929d6f8de None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:29.895276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:29.898173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:29.898648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:29.899111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:29.900016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:29.900583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:29.903601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:29.931440 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1894/3773] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 20:59:29.936897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73716bb7-b0db-4f61-aeb3-4f70f73e8fed None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:29.957575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73716bb7-b0db-4f61-aeb3-4f70f73e8fed None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:29.965088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535535-3f60-400c-a812-1711a1677369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:29.966360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535535-3f60-400c-a812-1711a1677369 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:29.966739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535535-3f60-400c-a812-1711a1677369 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:29.967093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535535-3f60-400c-a812-1711a1677369 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:29.969167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39535535-3f60-400c-a812-1711a1677369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:29.975866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39535535-3f60-400c-a812-1711a1677369 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:30.039361 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1880/3774] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:29 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:30.044236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:30.060724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e25c-e7a5-4fec-a5a7-eb838f990c27 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:30.193929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e11fe-f6f8-4e47-825f-a7ddb1428983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:30.196866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e11fe-f6f8-4e47-825f-a7ddb1428983 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:30.196866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e11fe-f6f8-4e47-825f-a7ddb1428983 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:30.196866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e11fe-f6f8-4e47-825f-a7ddb1428983 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:30.196866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e11fe-f6f8-4e47-825f-a7ddb1428983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:30.198131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e11fe-f6f8-4e47-825f-a7ddb1428983 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:30.241167 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1895/3775] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:30 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:30.245406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535535-3f60-400c-a812-1711a1677369 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:30.259936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535535-3f60-400c-a812-1711a1677369 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:30.272743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3b9e6-b9d5-4086-a069-8d50beaacb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:30.273548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3b9e6-b9d5-4086-a069-8d50beaacb81 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:30.274404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3b9e6-b9d5-4086-a069-8d50beaacb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:30.275891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3b9e6-b9d5-4086-a069-8d50beaacb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:30.276759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3b9e6-b9d5-4086-a069-8d50beaacb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:30.281690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3b9e6-b9d5-4086-a069-8d50beaacb81 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:30.303712 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1881/3776] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:30.307591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e11fe-f6f8-4e47-825f-a7ddb1428983 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:30.323001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e11fe-f6f8-4e47-825f-a7ddb1428983 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:30.331020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cefb11-6d30-4aae-83c8-54246c73ee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:30.332529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cefb11-6d30-4aae-83c8-54246c73ee45 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:30.332928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cefb11-6d30-4aae-83c8-54246c73ee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:30.333305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cefb11-6d30-4aae-83c8-54246c73ee45 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:30.334285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cefb11-6d30-4aae-83c8-54246c73ee45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:30.337981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cefb11-6d30-4aae-83c8-54246c73ee45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:30.363866 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1896/3777] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:30.367817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3b9e6-b9d5-4086-a069-8d50beaacb81 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:30.384956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3b9e6-b9d5-4086-a069-8d50beaacb81 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:30.391693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa149b-8752-4277-966d-c31a54cb9fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:30.393222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa149b-8752-4277-966d-c31a54cb9fde admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:30.393549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa149b-8752-4277-966d-c31a54cb9fde admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:30.393924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa149b-8752-4277-966d-c31a54cb9fde admin admin] PATH_INFO: `/v3/projects/c64539d6f3914439a7b7af9830c31761/users/1fc0230d6c054c58aa4ea107ee8582fd/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:30.416160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa149b-8752-4277-966d-c31a54cb9fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64539d6f3914439a7b7af9830c31761, user_id=1fc0230d6c054c58aa4ea107ee8582fd, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:30.419932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa149b-8752-4277-966d-c31a54cb9fde admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:30.473939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f533a-826b-40bb-b202-b4fe9629cf83 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:30.474391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f533a-826b-40bb-b202-b4fe9629cf83 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:30.474795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f533a-826b-40bb-b202-b4fe9629cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:30.480701 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1882/3778] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:30 2022] PUT /identity/v3/projects/c64539d6f3914439a7b7af9830c31761/users/1fc0230d6c054c58aa4ea107ee8582fd/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:30.525234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c91f533a-826b-40bb-b202-b4fe9629cf83 None None] MFA Rules not processed for user `1fc0230d6c054c58aa4ea107ee8582fd`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:30.529089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c91f533a-826b-40bb-b202-b4fe9629cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:30.621579 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1897/3779] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:30.627275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa149b-8752-4277-966d-c31a54cb9fde admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:30.731659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa149b-8752-4277-966d-c31a54cb9fde admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:30.737377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2c456-f3ed-4156-881d-1e2619b8ed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:30.738176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c456-f3ed-4156-881d-1e2619b8ed74 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:30.738560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c456-f3ed-4156-881d-1e2619b8ed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:30.738925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c456-f3ed-4156-881d-1e2619b8ed74 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:30.739860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2c456-f3ed-4156-881d-1e2619b8ed74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:30.743308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2c456-f3ed-4156-881d-1e2619b8ed74 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:30.796833 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1883/3780] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:30 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:30.801747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f533a-826b-40bb-b202-b4fe9629cf83 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:30.822098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f533a-826b-40bb-b202-b4fe9629cf83 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:30.928049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4b61-a8b3-4c75-aa8f-79e2b9e7db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:30.929382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4b61-a8b3-4c75-aa8f-79e2b9e7db87 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:30.929902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4b61-a8b3-4c75-aa8f-79e2b9e7db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:30.930418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4b61-a8b3-4c75-aa8f-79e2b9e7db87 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:30.931623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4b61-a8b3-4c75-aa8f-79e2b9e7db87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:30.935334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4b61-a8b3-4c75-aa8f-79e2b9e7db87 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:30.993690 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1898/3781] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:30 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:30.997231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2c456-f3ed-4156-881d-1e2619b8ed74 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:31.019393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2c456-f3ed-4156-881d-1e2619b8ed74 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:31.027028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c13d2d-a70b-4a4c-a0f1-ca014006d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:31.032171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13d2d-a70b-4a4c-a0f1-ca014006d735 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:31.034025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13d2d-a70b-4a4c-a0f1-ca014006d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:31.034906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13d2d-a70b-4a4c-a0f1-ca014006d735 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:31.037065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c13d2d-a70b-4a4c-a0f1-ca014006d735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:31.039984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c13d2d-a70b-4a4c-a0f1-ca014006d735 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:31.063367 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1884/3782] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:31.068246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4b61-a8b3-4c75-aa8f-79e2b9e7db87 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:31.081082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4b61-a8b3-4c75-aa8f-79e2b9e7db87 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:31.095085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9923221-5f2d-4594-b26c-2cfcf0c54303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:31.097509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9923221-5f2d-4594-b26c-2cfcf0c54303 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:31.098084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9923221-5f2d-4594-b26c-2cfcf0c54303 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:31.098577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9923221-5f2d-4594-b26c-2cfcf0c54303 admin admin] PATH_INFO: `/v3/projects/8e033fbdac0c42cba361ec2ebc5b511a/users/16ac0599f87c4105a62b2611ec99e416/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:31.130532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9923221-5f2d-4594-b26c-2cfcf0c54303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e033fbdac0c42cba361ec2ebc5b511a, user_id=16ac0599f87c4105a62b2611ec99e416, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:31.134007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9923221-5f2d-4594-b26c-2cfcf0c54303 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:31.161397 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1899/3783] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:31 2022] PUT /identity/v3/projects/8e033fbdac0c42cba361ec2ebc5b511a/users/16ac0599f87c4105a62b2611ec99e416/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:31.164920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c13d2d-a70b-4a4c-a0f1-ca014006d735 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:31.189693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c13d2d-a70b-4a4c-a0f1-ca014006d735 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:31.289654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1279e9-5dbb-4745-9d3e-18b7aac03ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:31.290490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1279e9-5dbb-4745-9d3e-18b7aac03ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:31.290600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1279e9-5dbb-4745-9d3e-18b7aac03ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:31.290988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1279e9-5dbb-4745-9d3e-18b7aac03ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:31.291601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1279e9-5dbb-4745-9d3e-18b7aac03ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:31.293271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1279e9-5dbb-4745-9d3e-18b7aac03ee4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:31.315732 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1885/3784] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:31.319717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9923221-5f2d-4594-b26c-2cfcf0c54303 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:31.331533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9923221-5f2d-4594-b26c-2cfcf0c54303 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:31.343819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:31.344970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:31.345353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:31.345728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] PATH_INFO: `/v3/projects/8e033fbdac0c42cba361ec2ebc5b511a/users/16ac0599f87c4105a62b2611ec99e416/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:31.347967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e033fbdac0c42cba361ec2ebc5b511a, user_id=16ac0599f87c4105a62b2611ec99e416, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:31.351096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:31.368180 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1900/3785] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:31 2022] PUT /identity/v3/projects/8e033fbdac0c42cba361ec2ebc5b511a/users/16ac0599f87c4105a62b2611ec99e416/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:31.378642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f800-75f2-458d-8559-d28cd2cd8ba4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:31.378919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f800-75f2-458d-8559-d28cd2cd8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:31.379205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f800-75f2-458d-8559-d28cd2cd8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:31.418933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7069f800-75f2-458d-8559-d28cd2cd8ba4 None None] MFA Rules not processed for user `16ac0599f87c4105a62b2611ec99e416`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:31.428482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7069f800-75f2-458d-8559-d28cd2cd8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:31.592949 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1886/3786] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:31.600726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:31.602811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:31.691141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5785ef-8de2-42ef-a949-013bf899d24f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:31.708046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8fda1-42b3-4828-affd-dffd2ce2957c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:31.709167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8fda1-42b3-4828-affd-dffd2ce2957c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:31.709687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8fda1-42b3-4828-affd-dffd2ce2957c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:31.710088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8fda1-42b3-4828-affd-dffd2ce2957c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:31.737179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8fda1-42b3-4828-affd-dffd2ce2957c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:31.738770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8fda1-42b3-4828-affd-dffd2ce2957c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:31.760321 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1901/3787] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:34.822296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069f800-75f2-458d-8559-d28cd2cd8ba4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:34.959619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069f800-75f2-458d-8559-d28cd2cd8ba4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:34.976930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:34.979504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:34.982154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:34.982728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] PATH_INFO: `/v3/users/1fc0230d6c054c58aa4ea107ee8582fd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:34.987844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc0230d6c054c58aa4ea107ee8582fd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:34.993833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:35.241955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc0230d6c054c58aa4ea107ee8582fd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:35.242679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc0230d6c054c58aa4ea107ee8582fd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:35.243379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc0230d6c054c58aa4ea107ee8582fd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:35.259117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc0230d6c054c58aa4ea107ee8582fd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:35.276782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc0230d6c054c58aa4ea107ee8582fd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:35.304501 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1887/3788] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:34 2022] DELETE /identity/v3/users/1fc0230d6c054c58aa4ea107ee8582fd => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:35.309571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01af07-8809-4479-82dc-7eee6faf2b54 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:35.310092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01af07-8809-4479-82dc-7eee6faf2b54 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:35.312769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01af07-8809-4479-82dc-7eee6faf2b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:35.338858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6a01af07-8809-4479-82dc-7eee6faf2b54 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:35.338858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6a01af07-8809-4479-82dc-7eee6faf2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:35.440709 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1902/3789] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:35.453953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:35.456050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:35.547743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be754dc-8511-462a-aef2-ce8c4eea327d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:35.551825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfed85-9f01-4e8a-8cc8-e022a67bb6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:35.552544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfed85-9f01-4e8a-8cc8-e022a67bb6ee service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:35.552955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfed85-9f01-4e8a-8cc8-e022a67bb6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:35.553236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfed85-9f01-4e8a-8cc8-e022a67bb6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:35.565371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfed85-9f01-4e8a-8cc8-e022a67bb6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:35.566821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfed85-9f01-4e8a-8cc8-e022a67bb6ee service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:35.585391 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1888/3790] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:36.007168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01af07-8809-4479-82dc-7eee6faf2b54 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:36.015278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6a01af07-8809-4479-82dc-7eee6faf2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:36.053518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01af07-8809-4479-82dc-7eee6faf2b54 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:36.066560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:36.068907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:36.073289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:36.073796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] PATH_INFO: `/v3/projects/c64539d6f3914439a7b7af9830c31761` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:36.075298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64539d6f3914439a7b7af9830c31761)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:36.077950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:36.155627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64539d6f3914439a7b7af9830c31761', 'request_id': 'req-16514f57-eaf7-4cc4-becc-868153637730'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.163139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64539d6f3914439a7b7af9830c31761', 'request_id': 'req-16514f57-eaf7-4cc4-becc-868153637730'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.179722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64539d6f3914439a7b7af9830c31761', 'request_id': 'req-16514f57-eaf7-4cc4-becc-868153637730'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.197659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] The token cache is being invalidate because project c64539d6f3914439a7b7af9830c31761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:36.198044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.198698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.203712 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1903/3791] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:36 2022] DELETE /identity/v3/projects/c64539d6f3914439a7b7af9830c31761 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:36.205238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfed85-9f01-4e8a-8cc8-e022a67bb6ee service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:36.222095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfed85-9f01-4e8a-8cc8-e022a67bb6ee service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:36.345039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:36.345889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:36.346202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:36.346483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] PATH_INFO: `/v3/users/16ac0599f87c4105a62b2611ec99e416` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:36.349406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ac0599f87c4105a62b2611ec99e416)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:36.354168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:36.415374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ac0599f87c4105a62b2611ec99e416'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.416224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ac0599f87c4105a62b2611ec99e416'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.416985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ac0599f87c4105a62b2611ec99e416'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.430904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ac0599f87c4105a62b2611ec99e416'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.444548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8ea30f2-e3e9-482f-95c7-ea8ab62230bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ac0599f87c4105a62b2611ec99e416'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:36.460998 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1889/3792] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:36 2022] DELETE /identity/v3/users/16ac0599f87c4105a62b2611ec99e416 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:36.734387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:36.735892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:36.813648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16514f57-eaf7-4cc4-becc-868153637730 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:37.020201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:37.021700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.022220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:37.022698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] PATH_INFO: `/v3/projects/8e033fbdac0c42cba361ec2ebc5b511a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:37.025611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e033fbdac0c42cba361ec2ebc5b511a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:37.032790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:37.157065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e033fbdac0c42cba361ec2ebc5b511a', 'request_id': 'req-a937ef10-1a18-4be6-aa77-c4795d67ed75'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:37.164043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e033fbdac0c42cba361ec2ebc5b511a', 'request_id': 'req-a937ef10-1a18-4be6-aa77-c4795d67ed75'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:37.174862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e033fbdac0c42cba361ec2ebc5b511a', 'request_id': 'req-a937ef10-1a18-4be6-aa77-c4795d67ed75'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:37.194671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] The token cache is being invalidate because project 8e033fbdac0c42cba361ec2ebc5b511a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:37.195065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:37.195912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a937ef10-1a18-4be6-aa77-c4795d67ed75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:37.201015 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1904/3793] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:36 2022] DELETE /identity/v3/projects/8e033fbdac0c42cba361ec2ebc5b511a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:37.203255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5589b-e073-4cd4-9c94-14755f4a4e3d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.203932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5589b-e073-4cd4-9c94-14755f4a4e3d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:37.204474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5589b-e073-4cd4-9c94-14755f4a4e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:37.271231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4ce5589b-e073-4cd4-9c94-14755f4a4e3d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:37.276216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4ce5589b-e073-4cd4-9c94-14755f4a4e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:37.425859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1890/3794] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:37.435197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098c82-7d15-4dca-b93a-48619696ed07 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.435531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098c82-7d15-4dca-b93a-48619696ed07 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:37.435805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098c82-7d15-4dca-b93a-48619696ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:37.465523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fe098c82-7d15-4dca-b93a-48619696ed07 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:37.468633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe098c82-7d15-4dca-b93a-48619696ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:37.478492 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1905/3795] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:59:37.484377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5589b-e073-4cd4-9c94-14755f4a4e3d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:37.506604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5589b-e073-4cd4-9c94-14755f4a4e3d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:37.520922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:37.521218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.521847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:37.521847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:37.522520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:37.522830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:37.524460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:37.561920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098c82-7d15-4dca-b93a-48619696ed07 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:37.562225 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1891/3796] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:37.575378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098c82-7d15-4dca-b93a-48619696ed07 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:37.581007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0996bd-d309-4fae-9aff-4ce8ae762981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:37.581674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0996bd-d309-4fae-9aff-4ce8ae762981 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.581959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0996bd-d309-4fae-9aff-4ce8ae762981 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:37.582239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0996bd-d309-4fae-9aff-4ce8ae762981 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:37.582935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0996bd-d309-4fae-9aff-4ce8ae762981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:37.585355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0996bd-d309-4fae-9aff-4ce8ae762981 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:37.642492 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1906/3797] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:37 2022] POST /identity/v3/projects => generated 395 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:37.646437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:37.664712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425295a-7761-47ae-a328-6a07bb16a452 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:37.805307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84732454-7bd9-4628-9295-d782d4b3c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:37.806112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732454-7bd9-4628-9295-d782d4b3c839 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.806727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732454-7bd9-4628-9295-d782d4b3c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:37.809078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732454-7bd9-4628-9295-d782d4b3c839 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:37.809932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84732454-7bd9-4628-9295-d782d4b3c839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:37.814185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84732454-7bd9-4628-9295-d782d4b3c839 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:37.859794 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1892/3798] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:37 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:37.864377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0996bd-d309-4fae-9aff-4ce8ae762981 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:37.876423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0996bd-d309-4fae-9aff-4ce8ae762981 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:37.881158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c293-7a45-44a2-b556-0afc9886b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:37.881833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c293-7a45-44a2-b556-0afc9886b327 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.882228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c293-7a45-44a2-b556-0afc9886b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:37.882529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c293-7a45-44a2-b556-0afc9886b327 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:37.883254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c293-7a45-44a2-b556-0afc9886b327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:37.885141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c293-7a45-44a2-b556-0afc9886b327 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:37.908671 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1907/3799] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:59:37.912509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84732454-7bd9-4628-9295-d782d4b3c839 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:37.924607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84732454-7bd9-4628-9295-d782d4b3c839 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:37.937934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e99eb-ea23-4c3f-bef4-9e560dcc795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:37.940613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e99eb-ea23-4c3f-bef4-9e560dcc795e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.941105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e99eb-ea23-4c3f-bef4-9e560dcc795e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:37.941783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e99eb-ea23-4c3f-bef4-9e560dcc795e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:37.943830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e99eb-ea23-4c3f-bef4-9e560dcc795e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:37.947347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e99eb-ea23-4c3f-bef4-9e560dcc795e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:37.969181 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1893/3800] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:37.973243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c293-7a45-44a2-b556-0afc9886b327 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:37.990090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c293-7a45-44a2-b556-0afc9886b327 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:37.997296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:37.999209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:37.999828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:38.000712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] PATH_INFO: `/v3/projects/a0e4c2e796b54b51bda74d8c84f9f815/users/39455355838c47e188c41d39b1502503/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:38.021706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e4c2e796b54b51bda74d8c84f9f815, user_id=39455355838c47e188c41d39b1502503, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:38.024740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:38.053413 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1908/3801] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:37 2022] PUT /identity/v3/projects/a0e4c2e796b54b51bda74d8c84f9f815/users/39455355838c47e188c41d39b1502503/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:38.064719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273b6ba-2340-4bf0-8003-3e1e8366df8f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:38.065269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273b6ba-2340-4bf0-8003-3e1e8366df8f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:38.065733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273b6ba-2340-4bf0-8003-3e1e8366df8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:38.120715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c273b6ba-2340-4bf0-8003-3e1e8366df8f None None] MFA Rules not processed for user `39455355838c47e188c41d39b1502503`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:38.135332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c273b6ba-2340-4bf0-8003-3e1e8366df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:38.270932 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1894/3802] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:38.282890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:38.284685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:38.360715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945dd56-ac70-4e4b-9d74-c138ae23e901 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:38.365266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7788876-5ded-4e97-9e23-80b265af0779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:38.365930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788876-5ded-4e97-9e23-80b265af0779 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:38.366218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788876-5ded-4e97-9e23-80b265af0779 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:38.366500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788876-5ded-4e97-9e23-80b265af0779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:38.377385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7788876-5ded-4e97-9e23-80b265af0779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:38.378789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7788876-5ded-4e97-9e23-80b265af0779 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:38.395793 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1909/3803] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:59:38.566689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273b6ba-2340-4bf0-8003-3e1e8366df8f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:38.570266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c273b6ba-2340-4bf0-8003-3e1e8366df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:38.785468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273b6ba-2340-4bf0-8003-3e1e8366df8f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:38.807623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:38.808540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:38.809077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:38.809395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] PATH_INFO: `/v3/users/0d694f3e8da440a9a1cac8ca2de030e8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:38.820556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d694f3e8da440a9a1cac8ca2de030e8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:38.822484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:38.959755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d694f3e8da440a9a1cac8ca2de030e8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:38.961235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d694f3e8da440a9a1cac8ca2de030e8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:38.963253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d694f3e8da440a9a1cac8ca2de030e8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:39.004158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d694f3e8da440a9a1cac8ca2de030e8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:39.019817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d694f3e8da440a9a1cac8ca2de030e8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:39.046725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1895/3804] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:38 2022] DELETE /identity/v3/users/0d694f3e8da440a9a1cac8ca2de030e8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:39.482974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7788876-5ded-4e97-9e23-80b265af0779 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:39.522502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7788876-5ded-4e97-9e23-80b265af0779 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:39.689430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:39.690739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:39.691375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:39.691841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] PATH_INFO: `/v3/projects/63acbd462dfc418fab3fbeedccacb9c7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:39.693291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63acbd462dfc418fab3fbeedccacb9c7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:39.704967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:39.780924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63acbd462dfc418fab3fbeedccacb9c7', 'request_id': 'req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:39.786933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63acbd462dfc418fab3fbeedccacb9c7', 'request_id': 'req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:39.814710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63acbd462dfc418fab3fbeedccacb9c7', 'request_id': 'req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:39.830815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] The token cache is being invalidate because project 63acbd462dfc418fab3fbeedccacb9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:39.831616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:39.831769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:39.833593 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1910/3805] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:39 2022] DELETE /identity/v3/projects/63acbd462dfc418fab3fbeedccacb9c7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:39.838383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:39.839981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:39.868871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b19187-d18e-4ee6-a8ff-18964ed1125c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:40.029454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:40.029454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:40.029454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:40.029454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] PATH_INFO: `/v3/users/36001b7e02424690a991c6ac7a50adce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:40.030536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36001b7e02424690a991c6ac7a50adce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:40.030536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:40.167662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36001b7e02424690a991c6ac7a50adce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:40.168430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36001b7e02424690a991c6ac7a50adce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:40.169069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36001b7e02424690a991c6ac7a50adce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:40.195932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36001b7e02424690a991c6ac7a50adce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:40.210642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a82c0f1-45ee-4e4e-84a5-a2864afa253e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36001b7e02424690a991c6ac7a50adce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:40.253351 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1896/3806] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:39 2022] DELETE /identity/v3/users/36001b7e02424690a991c6ac7a50adce => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:40.785532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:40.787437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:40.814301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cdf9-27ed-49eb-932f-d8871e669fa6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:40.937996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:40.938878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:40.939172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:40.939452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] PATH_INFO: `/v3/projects/f642268b70be4aae83c2f209575ec73e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:40.940711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f642268b70be4aae83c2f209575ec73e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:40.943810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:41.052401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f642268b70be4aae83c2f209575ec73e', 'request_id': 'req-4334276f-bd01-441e-82da-3f333ea32aed'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:41.063113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f642268b70be4aae83c2f209575ec73e', 'request_id': 'req-4334276f-bd01-441e-82da-3f333ea32aed'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:41.094802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f642268b70be4aae83c2f209575ec73e', 'request_id': 'req-4334276f-bd01-441e-82da-3f333ea32aed'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:41.114950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] The token cache is being invalidate because project f642268b70be4aae83c2f209575ec73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:41.115263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:41.119217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4334276f-bd01-441e-82da-3f333ea32aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:41.125623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1911/3807] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:40 2022] DELETE /identity/v3/projects/f642268b70be4aae83c2f209575ec73e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:41.128122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0afc-be8f-4ba9-8150-d5f6a9c1d466 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:41.128661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0afc-be8f-4ba9-8150-d5f6a9c1d466 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:41.128913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0afc-be8f-4ba9-8150-d5f6a9c1d466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:41.172440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6c7f0afc-be8f-4ba9-8150-d5f6a9c1d466 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:41.173993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6c7f0afc-be8f-4ba9-8150-d5f6a9c1d466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:41.351101 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1897/3808] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:41.359265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775590-49ec-490a-baa9-8376b69c405c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:41.359567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775590-49ec-490a-baa9-8376b69c405c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:41.359832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775590-49ec-490a-baa9-8376b69c405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:41.405714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2e775590-49ec-490a-baa9-8376b69c405c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:41.406949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2e775590-49ec-490a-baa9-8376b69c405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:41.448580 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1912/3809] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:41.455740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0afc-be8f-4ba9-8150-d5f6a9c1d466 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:41.468638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0afc-be8f-4ba9-8150-d5f6a9c1d466 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:41.496301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:41.497780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:41.498258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:41.499330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:41.500252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:41.501372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:41.505149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:41.554660 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1898/3810] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:41.555888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e775590-49ec-490a-baa9-8376b69c405c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:41.567047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e775590-49ec-490a-baa9-8376b69c405c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:41.584108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a60d65-54d4-4372-a21d-f9466df1bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:41.585077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60d65-54d4-4372-a21d-f9466df1bcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:41.586305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60d65-54d4-4372-a21d-f9466df1bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:41.586819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60d65-54d4-4372-a21d-f9466df1bcc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:41.588009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a60d65-54d4-4372-a21d-f9466df1bcc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:41.590798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a60d65-54d4-4372-a21d-f9466df1bcc3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:41.667419 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1913/3811] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:41 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:41.672505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:41.703826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4104803-034c-4408-bf5a-ab1420d5a6d3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:41.911383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0054-1295-47f2-9986-badcf17b2a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:41.912344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0054-1295-47f2-9986-badcf17b2a42 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:41.912630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0054-1295-47f2-9986-badcf17b2a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:41.914779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0054-1295-47f2-9986-badcf17b2a42 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:41.917448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd0054-1295-47f2-9986-badcf17b2a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:41.920155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd0054-1295-47f2-9986-badcf17b2a42 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:41.991132 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1899/3812] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:41 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:41.995690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a60d65-54d4-4372-a21d-f9466df1bcc3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:42.013052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a60d65-54d4-4372-a21d-f9466df1bcc3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:42.045132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9b563-7351-4856-b039-5a1095cadd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:42.046134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9b563-7351-4856-b039-5a1095cadd7e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.046750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9b563-7351-4856-b039-5a1095cadd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.046880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9b563-7351-4856-b039-5a1095cadd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.047616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9b563-7351-4856-b039-5a1095cadd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:42.050566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9b563-7351-4856-b039-5a1095cadd7e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:42.082670 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1914/3813] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:42.087110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0054-1295-47f2-9986-badcf17b2a42 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:42.098954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0054-1295-47f2-9986-badcf17b2a42 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:42.104196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e495b-ee8b-415a-8184-e44ed388bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:42.104957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e495b-ee8b-415a-8184-e44ed388bd89 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.105258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e495b-ee8b-415a-8184-e44ed388bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.105696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e495b-ee8b-415a-8184-e44ed388bd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.107070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e495b-ee8b-415a-8184-e44ed388bd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:42.109268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e495b-ee8b-415a-8184-e44ed388bd89 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:42.120725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1900/3814] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:42.125586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9b563-7351-4856-b039-5a1095cadd7e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:42.137338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9b563-7351-4856-b039-5a1095cadd7e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:42.142835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b7a5-e606-4d90-ad05-46788cfb42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:42.144079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b7a5-e606-4d90-ad05-46788cfb42ce admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.144395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b7a5-e606-4d90-ad05-46788cfb42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.145303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b7a5-e606-4d90-ad05-46788cfb42ce admin admin] PATH_INFO: `/v3/projects/9a3a29b818fd4298b83ec3d042280345/users/a62639457b6045b1b35489e9744a7e7f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.163595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b7a5-e606-4d90-ad05-46788cfb42ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3a29b818fd4298b83ec3d042280345, user_id=a62639457b6045b1b35489e9744a7e7f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:42.171654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b7a5-e606-4d90-ad05-46788cfb42ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:42.194360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1915/3815] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:42 2022] PUT /identity/v3/projects/9a3a29b818fd4298b83ec3d042280345/users/a62639457b6045b1b35489e9744a7e7f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:42.204291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a8828-7701-4979-9627-1bd06e2555b6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.204936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a8828-7701-4979-9627-1bd06e2555b6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.204936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a8828-7701-4979-9627-1bd06e2555b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.242506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8d4a8828-7701-4979-9627-1bd06e2555b6 None None] MFA Rules not processed for user `a62639457b6045b1b35489e9744a7e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:42.243841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8d4a8828-7701-4979-9627-1bd06e2555b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:42.365293 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1901/3816] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:42.373321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b7a5-e606-4d90-ad05-46788cfb42ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:42.545150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b7a5-e606-4d90-ad05-46788cfb42ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:42.560309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f20c9-dfab-4ab9-9540-b610a0cb00ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:42.562474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f20c9-dfab-4ab9-9540-b610a0cb00ed admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.563144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f20c9-dfab-4ab9-9540-b610a0cb00ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.563697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f20c9-dfab-4ab9-9540-b610a0cb00ed admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.564957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f20c9-dfab-4ab9-9540-b610a0cb00ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:42.567678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f20c9-dfab-4ab9-9540-b610a0cb00ed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:42.614492 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1916/3817] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:42 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 20:59:42.618328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a8828-7701-4979-9627-1bd06e2555b6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:42.639219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a8828-7701-4979-9627-1bd06e2555b6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:42.741116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def010d-b0d7-4f3d-ba55-b230715a7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:42.741915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def010d-b0d7-4f3d-ba55-b230715a7333 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.745176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def010d-b0d7-4f3d-ba55-b230715a7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.745176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def010d-b0d7-4f3d-ba55-b230715a7333 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.745176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def010d-b0d7-4f3d-ba55-b230715a7333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:42.750403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def010d-b0d7-4f3d-ba55-b230715a7333 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:42.794526 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1902/3818] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:42 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:42.799430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f20c9-dfab-4ab9-9540-b610a0cb00ed admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:42.817936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f20c9-dfab-4ab9-9540-b610a0cb00ed admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:42.831160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9d447-b481-487b-b7cc-358c1500a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:42.832084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d447-b481-487b-b7cc-358c1500a575 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.832628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d447-b481-487b-b7cc-358c1500a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.833134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d447-b481-487b-b7cc-358c1500a575 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.834084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9d447-b481-487b-b7cc-358c1500a575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:42.837438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9d447-b481-487b-b7cc-358c1500a575 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:42.864459 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1917/3819] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:59:42.866589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def010d-b0d7-4f3d-ba55-b230715a7333 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:42.880259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def010d-b0d7-4f3d-ba55-b230715a7333 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:42.886856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce06a0-6755-4eb4-a67b-64ecf0f0a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:42.887754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce06a0-6755-4eb4-a67b-64ecf0f0a07f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.888210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce06a0-6755-4eb4-a67b-64ecf0f0a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.888565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce06a0-6755-4eb4-a67b-64ecf0f0a07f admin admin] PATH_INFO: `/v3/projects/ccf6e5607eb54d74b5a7d2cfc631bdfa/users/52cae3f79b3543caad8ec879bbcc8344/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.907845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce06a0-6755-4eb4-a67b-64ecf0f0a07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf6e5607eb54d74b5a7d2cfc631bdfa, user_id=52cae3f79b3543caad8ec879bbcc8344, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:42.913030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce06a0-6755-4eb4-a67b-64ecf0f0a07f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:42.953358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100914cc-a468-4739-b27d-9cbc97b0b472 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:42.953634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100914cc-a468-4739-b27d-9cbc97b0b472 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:42.954086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100914cc-a468-4739-b27d-9cbc97b0b472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:42.967050 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1903/3820] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:42 2022] PUT /identity/v3/projects/ccf6e5607eb54d74b5a7d2cfc631bdfa/users/52cae3f79b3543caad8ec879bbcc8344/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:42.968694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce06a0-6755-4eb4-a67b-64ecf0f0a07f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:42.981047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-100914cc-a468-4739-b27d-9cbc97b0b472 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:42.982783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-100914cc-a468-4739-b27d-9cbc97b0b472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:43.093618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce06a0-6755-4eb4-a67b-64ecf0f0a07f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:43.102768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:43.104459 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1918/3821] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:43.105103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:43.105429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:43.105716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:43.106470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:43.108843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:43.124407 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1904/3822] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:43.126936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100914cc-a468-4739-b27d-9cbc97b0b472 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:43.139540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:43.146218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:43.147549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100914cc-a468-4739-b27d-9cbc97b0b472 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:43.161302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7ba3-7c1c-402f-af5c-48f7f43280c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:43.162319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7ba3-7c1c-402f-af5c-48f7f43280c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:43.165076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7ba3-7c1c-402f-af5c-48f7f43280c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:43.166152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7ba3-7c1c-402f-af5c-48f7f43280c8 admin admin] PATH_INFO: `/v3/projects/ccf6e5607eb54d74b5a7d2cfc631bdfa/users/52cae3f79b3543caad8ec879bbcc8344/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:43.170194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb7ba3-7c1c-402f-af5c-48f7f43280c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf6e5607eb54d74b5a7d2cfc631bdfa, user_id=52cae3f79b3543caad8ec879bbcc8344, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:43.173786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb7ba3-7c1c-402f-af5c-48f7f43280c8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:43.188868 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1919/3823] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:43 2022] PUT /identity/v3/projects/ccf6e5607eb54d74b5a7d2cfc631bdfa/users/52cae3f79b3543caad8ec879bbcc8344/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:43.272603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dcf4-d323-40ee-a014-a02b88035abe None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:43.273264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dcf4-d323-40ee-a014-a02b88035abe None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:43.273882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dcf4-d323-40ee-a014-a02b88035abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:43.329861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0f7f-b747-4e3c-bd31-b20b08932639 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:43.331206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5d36dcf4-d323-40ee-a014-a02b88035abe None None] MFA Rules not processed for user `52cae3f79b3543caad8ec879bbcc8344`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:43.332313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5d36dcf4-d323-40ee-a014-a02b88035abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:43.476077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:43.477266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:43.477986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:43.478454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:43.540119 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1920/3824] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:43.622648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:43.624351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:43.635582 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1905/3825] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:59:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:43.690016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36dcf4-d323-40ee-a014-a02b88035abe None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:43.692741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5d36dcf4-d323-40ee-a014-a02b88035abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:43.880971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36dcf4-d323-40ee-a014-a02b88035abe None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:43.894091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f041-98d2-46aa-9286-d7249f2d3a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:43.894765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f041-98d2-46aa-9286-d7249f2d3a42 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:43.895053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f041-98d2-46aa-9286-d7249f2d3a42 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:43.895331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f041-98d2-46aa-9286-d7249f2d3a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:43.908429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f041-98d2-46aa-9286-d7249f2d3a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:43.910551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f041-98d2-46aa-9286-d7249f2d3a42 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:43.942842 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1921/3826] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:44.790702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:44.795991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:44.933230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55590db8-cc7e-4e6e-923b-6034e5efcf89 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:44.940920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:44.942032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:44.942526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:44.942952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] PATH_INFO: `/v3/users/67bb649ed4a840b58f2f081adc27ad48` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:44.944380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bb649ed4a840b58f2f081adc27ad48)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:44.947072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:45.053414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bb649ed4a840b58f2f081adc27ad48'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:45.054299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bb649ed4a840b58f2f081adc27ad48'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:45.054972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bb649ed4a840b58f2f081adc27ad48'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:45.081807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bb649ed4a840b58f2f081adc27ad48'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:45.122035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bb649ed4a840b58f2f081adc27ad48'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:45.152056 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1906/3827] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:44 2022] DELETE /identity/v3/users/67bb649ed4a840b58f2f081adc27ad48 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:45.289820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1afafa-1a43-4a8a-bef0-554b7a10c597 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:45.290689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1afafa-1a43-4a8a-bef0-554b7a10c597 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:45.291138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1afafa-1a43-4a8a-bef0-554b7a10c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:45.316169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cc1afafa-1a43-4a8a-bef0-554b7a10c597 None None] MFA Rules not processed for user `5a3a1e86138d41b991f5e44a1e8ae2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:45.317528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc1afafa-1a43-4a8a-bef0-554b7a10c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:45.542499 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1922/3828] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:45.664985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:45.666334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:45.807466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1afafa-1a43-4a8a-bef0-554b7a10c597 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:45.810360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc1afafa-1a43-4a8a-bef0-554b7a10c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:45.838866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84df205-7424-4fe2-b2f2-2b5ef88fb6b4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:45.849865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:45.850752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:45.851210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:45.851790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] PATH_INFO: `/v3/users/a62639457b6045b1b35489e9744a7e7f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:45.857460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62639457b6045b1b35489e9744a7e7f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:45.860260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:45.987161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62639457b6045b1b35489e9744a7e7f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:45.987887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62639457b6045b1b35489e9744a7e7f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:45.988566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62639457b6045b1b35489e9744a7e7f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:46.015495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1afafa-1a43-4a8a-bef0-554b7a10c597 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:46.021970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62639457b6045b1b35489e9744a7e7f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:46.034500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:46.048154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef9d74da-7deb-411d-8310-334620202f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62639457b6045b1b35489e9744a7e7f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:46.053962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.054514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.054921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] PATH_INFO: `/v3/projects/24560083d7dd474c820b48343b65c206` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.056714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] RBAC: Authorizing `identity:delete_project(project_id=24560083d7dd474c820b48343b65c206)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:46.059678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:46.069867 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1907/3829] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:45 2022] DELETE /identity/v3/users/a62639457b6045b1b35489e9744a7e7f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:46.074913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883ff2-4ded-4098-9f74-c74eed6c2d39 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.075220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883ff2-4ded-4098-9f74-c74eed6c2d39 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.075688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883ff2-4ded-4098-9f74-c74eed6c2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.145172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-67883ff2-4ded-4098-9f74-c74eed6c2d39 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:46.147134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67883ff2-4ded-4098-9f74-c74eed6c2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:46.188846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24560083d7dd474c820b48343b65c206', 'request_id': 'req-8a3b24ec-1164-4f26-beb5-53e1173a535b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:46.205010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24560083d7dd474c820b48343b65c206', 'request_id': 'req-8a3b24ec-1164-4f26-beb5-53e1173a535b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:46.223914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24560083d7dd474c820b48343b65c206', 'request_id': 'req-8a3b24ec-1164-4f26-beb5-53e1173a535b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:46.248849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] The token cache is being invalidate because project 24560083d7dd474c820b48343b65c206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:46.249180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:46.250963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8a3b24ec-1164-4f26-beb5-53e1173a535b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:46.255039 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1923/3830] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:45 2022] DELETE /identity/v3/projects/24560083d7dd474c820b48343b65c206 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:46.261888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9d3-8848-4f2a-b746-7c34702ef6a2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.262189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9d3-8848-4f2a-b746-7c34702ef6a2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.262449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9d3-8848-4f2a-b746-7c34702ef6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.267492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1908/3831] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:46.306458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d668c9d3-8848-4f2a-b746-7c34702ef6a2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:46.308620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d668c9d3-8848-4f2a-b746-7c34702ef6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:46.315727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883ff2-4ded-4098-9f74-c74eed6c2d39 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:46.317222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67883ff2-4ded-4098-9f74-c74eed6c2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:46.415292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1924/3832] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:46.430184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a05b9-4b09-45be-b04c-6e3b62c33374 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.430955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a05b9-4b09-45be-b04c-6e3b62c33374 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.432020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a05b9-4b09-45be-b04c-6e3b62c33374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.446689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883ff2-4ded-4098-9f74-c74eed6c2d39 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:46.484944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dc8a05b9-4b09-45be-b04c-6e3b62c33374 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:46.486304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dc8a05b9-4b09-45be-b04c-6e3b62c33374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:46.499575 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1925/3833] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:46.500873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a05b9-4b09-45be-b04c-6e3b62c33374 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:46.511684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a05b9-4b09-45be-b04c-6e3b62c33374 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:46.519213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:46.520303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.520877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.521385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.522596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:46.523138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:46.525132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:46.543095 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1926/3834] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:46.544621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:46.557258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fed54-c0c8-4409-bc46-4c60c5183bc5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:46.574060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e048-83bd-45eb-9926-4a73b45b300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:46.576155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e048-83bd-45eb-9926-4a73b45b300a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.576620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e048-83bd-45eb-9926-4a73b45b300a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.577008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e048-83bd-45eb-9926-4a73b45b300a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.577130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:46.577800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.578088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.578374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.579477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3e048-83bd-45eb-9926-4a73b45b300a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:46.583955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:46.584713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3e048-83bd-45eb-9926-4a73b45b300a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:46.611901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:46.616976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:46.639535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1909/3835] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:59:46.652578 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1927/3836] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:46 2022] POST /identity/v3/projects => generated 395 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:46.653449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:46.664020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a053-8325-44d1-bb56-4a4609e0951d service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:46.831405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280654f2-f4ed-4fa6-a7b7-415e5635739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:46.832099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280654f2-f4ed-4fa6-a7b7-415e5635739a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.832422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280654f2-f4ed-4fa6-a7b7-415e5635739a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.832701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280654f2-f4ed-4fa6-a7b7-415e5635739a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.833784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280654f2-f4ed-4fa6-a7b7-415e5635739a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:46.835973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280654f2-f4ed-4fa6-a7b7-415e5635739a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:46.891352 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1910/3837] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:46 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:46.894854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e048-83bd-45eb-9926-4a73b45b300a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:46.909736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e048-83bd-45eb-9926-4a73b45b300a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:46.915702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0b86a-bf37-457b-aa68-28c99dc0578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:46.916813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0b86a-bf37-457b-aa68-28c99dc0578e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.917215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0b86a-bf37-457b-aa68-28c99dc0578e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.917610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0b86a-bf37-457b-aa68-28c99dc0578e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.918484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0b86a-bf37-457b-aa68-28c99dc0578e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:46.923326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0b86a-bf37-457b-aa68-28c99dc0578e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:46.951905 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1928/3838] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:46.952279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280654f2-f4ed-4fa6-a7b7-415e5635739a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:46.963413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280654f2-f4ed-4fa6-a7b7-415e5635739a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:46.987648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75269604-b573-4877-aa61-29dd4291ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:46.988372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269604-b573-4877-aa61-29dd4291ecd8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:46.988668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269604-b573-4877-aa61-29dd4291ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:46.988955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75269604-b573-4877-aa61-29dd4291ecd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:46.992767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75269604-b573-4877-aa61-29dd4291ecd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:46.994506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75269604-b573-4877-aa61-29dd4291ecd8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:47.050258 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1911/3839] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 20:59:47.055894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0b86a-bf37-457b-aa68-28c99dc0578e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:47.075478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0b86a-bf37-457b-aa68-28c99dc0578e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:47.088904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9eb60-354e-49e4-bf43-a8e8b443af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:47.093196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9eb60-354e-49e4-bf43-a8e8b443af67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:47.093626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9eb60-354e-49e4-bf43-a8e8b443af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:47.094847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9eb60-354e-49e4-bf43-a8e8b443af67 admin admin] PATH_INFO: `/v3/projects/cfa1bbf981774e87a17d08c92749cac0/users/a26a24d55e0c48ce966a55626b6b89be/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:47.135266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9eb60-354e-49e4-bf43-a8e8b443af67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa1bbf981774e87a17d08c92749cac0, user_id=a26a24d55e0c48ce966a55626b6b89be, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:47.140148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9eb60-354e-49e4-bf43-a8e8b443af67 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:47.172470 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1929/3840] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:47 2022] PUT /identity/v3/projects/cfa1bbf981774e87a17d08c92749cac0/users/a26a24d55e0c48ce966a55626b6b89be/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:47.183014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df7a01-b04e-436f-be6e-220292f5e7e8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:47.183591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df7a01-b04e-436f-be6e-220292f5e7e8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:47.184309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df7a01-b04e-436f-be6e-220292f5e7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:47.242727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c2df7a01-b04e-436f-be6e-220292f5e7e8 None None] MFA Rules not processed for user `a26a24d55e0c48ce966a55626b6b89be`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:47.246561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c2df7a01-b04e-436f-be6e-220292f5e7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:47.421487 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1912/3841] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:47.432759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4bfd-1973-453e-8a81-662dfd1c732e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:47.434270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4bfd-1973-453e-8a81-662dfd1c732e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:47.434732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4bfd-1973-453e-8a81-662dfd1c732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:47.477500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-baca4bfd-1973-453e-8a81-662dfd1c732e None None] MFA Rules not processed for user `a26a24d55e0c48ce966a55626b6b89be`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:47.478805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-baca4bfd-1973-453e-8a81-662dfd1c732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:47.493831 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1930/3842] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:47.512372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df7a01-b04e-436f-be6e-220292f5e7e8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:47.515651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c2df7a01-b04e-436f-be6e-220292f5e7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:47.647913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df7a01-b04e-436f-be6e-220292f5e7e8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:47.659460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c545d3d-9772-4d25-a826-b25eebb5bee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:47.661035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545d3d-9772-4d25-a826-b25eebb5bee6 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:47.661770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545d3d-9772-4d25-a826-b25eebb5bee6 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:47.662379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545d3d-9772-4d25-a826-b25eebb5bee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:47.675284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c545d3d-9772-4d25-a826-b25eebb5bee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:47.679054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c545d3d-9772-4d25-a826-b25eebb5bee6 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:47.700373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1913/3843] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:47.727858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab7ce-c2f4-4139-93c8-2d251d45b05e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:47.728157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab7ce-c2f4-4139-93c8-2d251d45b05e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:47.728469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab7ce-c2f4-4139-93c8-2d251d45b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:47.758746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5feab7ce-c2f4-4139-93c8-2d251d45b05e None None] MFA Rules not processed for user `a26a24d55e0c48ce966a55626b6b89be`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:47.760582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5feab7ce-c2f4-4139-93c8-2d251d45b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:47.778670 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1931/3844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:47.875271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e08f-3450-4b76-97ae-af82672355c5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:47.875558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e08f-3450-4b76-97ae-af82672355c5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:47.876019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e08f-3450-4b76-97ae-af82672355c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:47.907540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9713e08f-3450-4b76-97ae-af82672355c5 None None] MFA Rules not processed for user `a26a24d55e0c48ce966a55626b6b89be`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:47.909875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9713e08f-3450-4b76-97ae-af82672355c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:47.919016 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1914/3845] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:47.960541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a4afd-e425-4a5b-8450-e2564ce21fc7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:47.960914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a4afd-e425-4a5b-8450-e2564ce21fc7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:47.961194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a4afd-e425-4a5b-8450-e2564ce21fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:47.996013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ce0a4afd-e425-4a5b-8450-e2564ce21fc7 None None] MFA Rules not processed for user `a26a24d55e0c48ce966a55626b6b89be`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:47.997427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce0a4afd-e425-4a5b-8450-e2564ce21fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.006521 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1932/3846] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:48.040483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c27a0-d700-475e-97be-d50112e4c59c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:48.040719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c27a0-d700-475e-97be-d50112e4c59c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:48.041104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c27a0-d700-475e-97be-d50112e4c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:48.067654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a4afd-e425-4a5b-8450-e2564ce21fc7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:48.070015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce0a4afd-e425-4a5b-8450-e2564ce21fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.077383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-058c27a0-d700-475e-97be-d50112e4c59c None None] MFA Rules not processed for user `a26a24d55e0c48ce966a55626b6b89be`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:48.085321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-058c27a0-d700-475e-97be-d50112e4c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.099225 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1915/3847] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:48.131130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c27a0-d700-475e-97be-d50112e4c59c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:48.169131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a4afd-e425-4a5b-8450-e2564ce21fc7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:48.175494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:48.176770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:48.177056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:48.177699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] PATH_INFO: `/v3/projects/9a3a29b818fd4298b83ec3d042280345` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:48.178785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3a29b818fd4298b83ec3d042280345)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:48.198159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:48.320418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c27a0-d700-475e-97be-d50112e4c59c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:48.327819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:48.329148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:48.329519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:48.329784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] PATH_INFO: `/v3/users/a26a24d55e0c48ce966a55626b6b89be` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:48.332564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26a24d55e0c48ce966a55626b6b89be)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:48.334929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:48.385308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3a29b818fd4298b83ec3d042280345', 'request_id': 'req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.407405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3a29b818fd4298b83ec3d042280345', 'request_id': 'req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.430406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26a24d55e0c48ce966a55626b6b89be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.432143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26a24d55e0c48ce966a55626b6b89be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.432873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26a24d55e0c48ce966a55626b6b89be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.449814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3a29b818fd4298b83ec3d042280345', 'request_id': 'req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.463501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26a24d55e0c48ce966a55626b6b89be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.472863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-971ec711-bc08-445b-b173-6a5cede33dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26a24d55e0c48ce966a55626b6b89be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.484568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] The token cache is being invalidate because project 9a3a29b818fd4298b83ec3d042280345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:48.485188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.486746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.501222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1933/3848] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:48 2022] DELETE /identity/v3/projects/9a3a29b818fd4298b83ec3d042280345 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:48.506641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:48.508426 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1916/3849] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:48 2022] DELETE /identity/v3/users/a26a24d55e0c48ce966a55626b6b89be => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 20:59:48.509713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.509863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc28ba-bdc5-4d7b-a35d-6060d2fe8270 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:48.510112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc28ba-bdc5-4d7b-a35d-6060d2fe8270 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:48.510395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc28ba-bdc5-4d7b-a35d-6060d2fe8270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:48.532557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0fcc28ba-bdc5-4d7b-a35d-6060d2fe8270 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:48.534397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0fcc28ba-bdc5-4d7b-a35d-6060d2fe8270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.656881 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1917/3850] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:48.669602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc28ba-bdc5-4d7b-a35d-6060d2fe8270 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:48.673202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0fcc28ba-bdc5-4d7b-a35d-6060d2fe8270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.687108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d956d3a-8ee6-46d2-b2a9-96275dbf3dec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:48.699481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:48.705565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:48.707393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:48.708196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] PATH_INFO: `/v3/users/52cae3f79b3543caad8ec879bbcc8344` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:48.715946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=52cae3f79b3543caad8ec879bbcc8344)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:48.721235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:48.802450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52cae3f79b3543caad8ec879bbcc8344'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.804543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc28ba-bdc5-4d7b-a35d-6060d2fe8270 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:48.818774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52cae3f79b3543caad8ec879bbcc8344'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.828289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:48.830044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:48.830573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:48.831334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52cae3f79b3543caad8ec879bbcc8344'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.831764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:48.832016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52cae3f79b3543caad8ec879bbcc8344'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.833919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17f36232-3458-4838-8731-555964dbdccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52cae3f79b3543caad8ec879bbcc8344'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:48.834763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.854502 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1934/3851] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:48 2022] DELETE /identity/v3/users/52cae3f79b3543caad8ec879bbcc8344 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:48.855977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88662ac-78de-4dee-a5fe-a28a61896cb4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:48.856849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88662ac-78de-4dee-a5fe-a28a61896cb4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:48.856849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88662ac-78de-4dee-a5fe-a28a61896cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:48.873798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:48.877705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:48.893731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c88662ac-78de-4dee-a5fe-a28a61896cb4 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:48.895012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c88662ac-78de-4dee-a5fe-a28a61896cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.914279 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1918/3852] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 20:59:48.917663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:48.923150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:48.938324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfaae6-7fb8-4fb5-a14c-aeadc2f2c25d service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:48.994901 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1935/3853] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:49.011163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88662ac-78de-4dee-a5fe-a28a61896cb4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:49.012791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c88662ac-78de-4dee-a5fe-a28a61896cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:49.127312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:49.127961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:49.128245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:49.128544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] PATH_INFO: `/v3/users/6d0f3497fc80496499ed3d927823ce0c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:49.131183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0f3497fc80496499ed3d927823ce0c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:49.136709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:49.223756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88662ac-78de-4dee-a5fe-a28a61896cb4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:49.251303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:49.251857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0f3497fc80496499ed3d927823ce0c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.254484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0f3497fc80496499ed3d927823ce0c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.255688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0f3497fc80496499ed3d927823ce0c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.257130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:49.257130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:49.257424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:49.259791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:49.277158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0f3497fc80496499ed3d927823ce0c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.292546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0f3497fc80496499ed3d927823ce0c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.295946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:49.297456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:49.314124 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1936/3854] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 20:59:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:49.336221 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1919/3855] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:48 2022] DELETE /identity/v3/users/6d0f3497fc80496499ed3d927823ce0c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:49.616666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:49.618290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:49.646383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886337-e513-40a0-8e8c-5842d65c7208 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:49.772470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:49.773482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:49.773842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:49.774194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] PATH_INFO: `/v3/projects/ccf6e5607eb54d74b5a7d2cfc631bdfa` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:49.776440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf6e5607eb54d74b5a7d2cfc631bdfa)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:49.781398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:49.781711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:49.795784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:49.818491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2743f-b173-44ab-b892-da0735c42904 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:49.830847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:49.831745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:49.832012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:49.832861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] PATH_INFO: `/v3/projects/cfa1bbf981774e87a17d08c92749cac0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:49.835950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa1bbf981774e87a17d08c92749cac0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:49.838227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:49.892712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf6e5607eb54d74b5a7d2cfc631bdfa', 'request_id': 'req-b04d7106-6fb6-4738-8072-75b7e88aef84'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.899913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf6e5607eb54d74b5a7d2cfc631bdfa', 'request_id': 'req-b04d7106-6fb6-4738-8072-75b7e88aef84'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.911111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf6e5607eb54d74b5a7d2cfc631bdfa', 'request_id': 'req-b04d7106-6fb6-4738-8072-75b7e88aef84'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.933210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] The token cache is being invalidate because project ccf6e5607eb54d74b5a7d2cfc631bdfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:49.933585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.934584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.937511 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1937/3856] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:49 2022] DELETE /identity/v3/projects/ccf6e5607eb54d74b5a7d2cfc631bdfa => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:49.938515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:49.940176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:49.970025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa1bbf981774e87a17d08c92749cac0', 'request_id': 'req-6da981d0-9384-4864-836c-5e803dbeab4a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:49.993908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa1bbf981774e87a17d08c92749cac0', 'request_id': 'req-6da981d0-9384-4864-836c-5e803dbeab4a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.008166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa1bbf981774e87a17d08c92749cac0', 'request_id': 'req-6da981d0-9384-4864-836c-5e803dbeab4a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.031750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] The token cache is being invalidate because project cfa1bbf981774e87a17d08c92749cac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:50.032050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.032864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6da981d0-9384-4864-836c-5e803dbeab4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.041438 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1920/3857] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:49 2022] DELETE /identity/v3/projects/cfa1bbf981774e87a17d08c92749cac0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:50.043079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b789-8d01-44ab-a27f-43cd3870c1a3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.043420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b789-8d01-44ab-a27f-43cd3870c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.043706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b789-8d01-44ab-a27f-43cd3870c1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.075128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1560b789-8d01-44ab-a27f-43cd3870c1a3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:50.076579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1560b789-8d01-44ab-a27f-43cd3870c1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:50.124591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d7106-6fb6-4738-8072-75b7e88aef84 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:50.187910 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1921/3858] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:50.192159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b08b6-795d-4e71-8607-04286b9d516a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.192475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b08b6-795d-4e71-8607-04286b9d516a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.192845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b08b6-795d-4e71-8607-04286b9d516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.234304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-130b08b6-795d-4e71-8607-04286b9d516a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:50.235616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-130b08b6-795d-4e71-8607-04286b9d516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:50.247868 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1922/3859] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:50.257909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486b562-207e-4fd9-9747-8d6624a1cec8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.258183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486b562-207e-4fd9-9747-8d6624a1cec8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.258461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486b562-207e-4fd9-9747-8d6624a1cec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.281470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f486b562-207e-4fd9-9747-8d6624a1cec8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:50.283251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f486b562-207e-4fd9-9747-8d6624a1cec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:50.290342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:50.291226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.291507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.291785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] PATH_INFO: `/v3/projects/46068d17334344098e88ad0cc3e0eebb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.296392 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1923/3860] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:50.298566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ccc3-3081-420a-82e2-c558ec23708a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.298862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ccc3-3081-420a-82e2-c558ec23708a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.299212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ccc3-3081-420a-82e2-c558ec23708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.299683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46068d17334344098e88ad0cc3e0eebb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:50.301667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:50.339605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e6f6ccc3-3081-420a-82e2-c558ec23708a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:50.340870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e6f6ccc3-3081-420a-82e2-c558ec23708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:50.354929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1924/3861] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:50.361279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6ccc3-3081-420a-82e2-c558ec23708a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:50.381713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6ccc3-3081-420a-82e2-c558ec23708a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:50.392453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:50.395511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.395827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.396109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.397009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:50.397327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:50.400660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:50.423725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1925/3862] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:50.424880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:50.427133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46068d17334344098e88ad0cc3e0eebb', 'request_id': 'req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.439081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0d1c-386d-4d74-8cf3-2698288a639a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:50.439503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46068d17334344098e88ad0cc3e0eebb', 'request_id': 'req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.467010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46068d17334344098e88ad0cc3e0eebb', 'request_id': 'req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.486257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] The token cache is being invalidate because project 46068d17334344098e88ad0cc3e0eebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:50.486671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.488638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:50.495757 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1938/3863] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:49 2022] DELETE /identity/v3/projects/46068d17334344098e88ad0cc3e0eebb => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:50.496693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:50.502584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:50.517195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81f79-f0b1-4884-866d-33c10df8276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:50.517884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81f79-f0b1-4884-866d-33c10df8276e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.518170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81f79-f0b1-4884-866d-33c10df8276e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.518557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81f79-f0b1-4884-866d-33c10df8276e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.519284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd81f79-f0b1-4884-866d-33c10df8276e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:50.519643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd81f79-f0b1-4884-866d-33c10df8276e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:50.521607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd81f79-f0b1-4884-866d-33c10df8276e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:50.545903 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1926/3864] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:50.547205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043d918-95bd-4058-9545-78354824b226 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.547497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043d918-95bd-4058-9545-78354824b226 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.547775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043d918-95bd-4058-9545-78354824b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.571274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6043d918-95bd-4058-9545-78354824b226 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:50.573024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6043d918-95bd-4058-9545-78354824b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:50.586487 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1927/3865] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:50.587442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043d918-95bd-4058-9545-78354824b226 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:50.589747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6043d918-95bd-4058-9545-78354824b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:50.605218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043d918-95bd-4058-9545-78354824b226 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:50.615444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea91d5-376d-44b4-9cd9-74e049a2eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:50.619000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea91d5-376d-44b4-9cd9-74e049a2eef2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.619298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea91d5-376d-44b4-9cd9-74e049a2eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.619575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea91d5-376d-44b4-9cd9-74e049a2eef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.620601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea91d5-376d-44b4-9cd9-74e049a2eef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:50.626376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea91d5-376d-44b4-9cd9-74e049a2eef2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:50.635341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb5e9-3f77-4eb5-9803-6a80f9c51799 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:50.641022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0124240-f139-4676-b4ce-bf4f423ecd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:50.642544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0124240-f139-4676-b4ce-bf4f423ecd95 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.642832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0124240-f139-4676-b4ce-bf4f423ecd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.643116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0124240-f139-4676-b4ce-bf4f423ecd95 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.644891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0124240-f139-4676-b4ce-bf4f423ecd95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:50.647519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0124240-f139-4676-b4ce-bf4f423ecd95 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:50.687656 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1939/3866] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/projects => generated 403 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:50.689391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7970c-868f-44b4-8e44-4ef9f092d10b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.689833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7970c-868f-44b4-8e44-4ef9f092d10b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.690333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7970c-868f-44b4-8e44-4ef9f092d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.704761 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1928/3867] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:50.706682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea91d5-376d-44b4-9cd9-74e049a2eef2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:50.712745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-16e7970c-868f-44b4-8e44-4ef9f092d10b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:50.714189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-16e7970c-868f-44b4-8e44-4ef9f092d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:50.810549 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1940/3868] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:50.812975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7970c-868f-44b4-8e44-4ef9f092d10b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:50.828693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7970c-868f-44b4-8e44-4ef9f092d10b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:50.837142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f841-45f7-4cf6-9271-fd7d2b3a4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:50.837899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f841-45f7-4cf6-9271-fd7d2b3a4d9f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.838205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f841-45f7-4cf6-9271-fd7d2b3a4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.838455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f841-45f7-4cf6-9271-fd7d2b3a4d9f admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.839158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f841-45f7-4cf6-9271-fd7d2b3a4d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:50.841894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f841-45f7-4cf6-9271-fd7d2b3a4d9f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:50.884019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea91d5-376d-44b4-9cd9-74e049a2eef2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:50.914239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da2d62-994f-4288-8c4a-ab13f8a83500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:50.915161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2d62-994f-4288-8c4a-ab13f8a83500 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.916388 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1941/3869] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:50.917558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f841-45f7-4cf6-9271-fd7d2b3a4d9f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:50.917839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2d62-994f-4288-8c4a-ab13f8a83500 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.921670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2d62-994f-4288-8c4a-ab13f8a83500 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.927882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da2d62-994f-4288-8c4a-ab13f8a83500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:50.930411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da2d62-994f-4288-8c4a-ab13f8a83500 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:50.950653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f841-45f7-4cf6-9271-fd7d2b3a4d9f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:50.956015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:50.956741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:50.957023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:50.957831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:50.958689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:50.959134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:50.962670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:50.981133 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1929/3870] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:50 2022] POST /identity/v3/users => generated 302 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:50.982169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da2d62-994f-4288-8c4a-ab13f8a83500 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.002117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da2d62-994f-4288-8c4a-ab13f8a83500 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.003637 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1942/3871] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:51.009503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.013988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa24c-7617-4cef-923f-aca05d5c620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.015465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa24c-7617-4cef-923f-aca05d5c620f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.017667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa24c-7617-4cef-923f-aca05d5c620f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.017667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa24c-7617-4cef-923f-aca05d5c620f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.020545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefa24c-7617-4cef-923f-aca05d5c620f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.022413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefa24c-7617-4cef-923f-aca05d5c620f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.024904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58de9-23f9-41ca-8983-81b0e7533a7f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.032780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9544b-c1ca-4048-9fae-76ad47e845a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.033726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9544b-c1ca-4048-9fae-76ad47e845a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.034298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9544b-c1ca-4048-9fae-76ad47e845a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.034732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9544b-c1ca-4048-9fae-76ad47e845a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.036253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9544b-c1ca-4048-9fae-76ad47e845a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.038230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9544b-c1ca-4048-9fae-76ad47e845a7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.050973 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1930/3872] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:51.051239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa24c-7617-4cef-923f-aca05d5c620f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.062215 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1943/3873] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:51.072322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9544b-c1ca-4048-9fae-76ad47e845a7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.075800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa24c-7617-4cef-923f-aca05d5c620f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.082778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7405d8-ce55-4c4b-ade6-c4e51efec0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.088002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7405d8-ce55-4c4b-ade6-c4e51efec0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.088591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7405d8-ce55-4c4b-ade6-c4e51efec0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.090230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7405d8-ce55-4c4b-ade6-c4e51efec0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.091757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7405d8-ce55-4c4b-ade6-c4e51efec0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.094458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7405d8-ce55-4c4b-ade6-c4e51efec0b7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.097796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9544b-c1ca-4048-9fae-76ad47e845a7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.111140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8fcf7-00a6-4a25-88e4-821ab6f5a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.112016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8fcf7-00a6-4a25-88e4-821ab6f5a59e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.112435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8fcf7-00a6-4a25-88e4-821ab6f5a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.112817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8fcf7-00a6-4a25-88e4-821ab6f5a59e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.113649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8fcf7-00a6-4a25-88e4-821ab6f5a59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.115351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8fcf7-00a6-4a25-88e4-821ab6f5a59e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.137674 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1944/3874] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:51.137674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8fcf7-00a6-4a25-88e4-821ab6f5a59e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.163569 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1931/3875] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:51 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:51.163569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7405d8-ce55-4c4b-ade6-c4e51efec0b7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.164281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8fcf7-00a6-4a25-88e4-821ab6f5a59e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.304026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c7894-ffe0-4ca3-98f2-dee98b81e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.305168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c7894-ffe0-4ca3-98f2-dee98b81e540 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.306507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c7894-ffe0-4ca3-98f2-dee98b81e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.306812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c7894-ffe0-4ca3-98f2-dee98b81e540 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.309564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c7894-ffe0-4ca3-98f2-dee98b81e540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.315048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c7894-ffe0-4ca3-98f2-dee98b81e540 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.346473 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1945/3876] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:51.348904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c7894-ffe0-4ca3-98f2-dee98b81e540 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.380395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c7894-ffe0-4ca3-98f2-dee98b81e540 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.419785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9be2b1-a04a-4673-b032-78fac4810525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.422121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be2b1-a04a-4673-b032-78fac4810525 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.422796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be2b1-a04a-4673-b032-78fac4810525 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.424676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9be2b1-a04a-4673-b032-78fac4810525 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.425611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9be2b1-a04a-4673-b032-78fac4810525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.431570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9be2b1-a04a-4673-b032-78fac4810525 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.472219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7405d8-ce55-4c4b-ade6-c4e51efec0b7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.493397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339effc-0be3-4161-b30c-5a7b24e3a808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.495388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339effc-0be3-4161-b30c-5a7b24e3a808 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.495678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339effc-0be3-4161-b30c-5a7b24e3a808 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.495960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339effc-0be3-4161-b30c-5a7b24e3a808 admin admin] PATH_INFO: `/v3/projects/e4e370ef28034ffbbbee9d2cfd826084/users/fad7207822c04fc289709200d7e2bd2d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.498589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1946/3877] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:51 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:51.504864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9be2b1-a04a-4673-b032-78fac4810525 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.534599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339effc-0be3-4161-b30c-5a7b24e3a808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e370ef28034ffbbbee9d2cfd826084, user_id=fad7207822c04fc289709200d7e2bd2d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.537381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339effc-0be3-4161-b30c-5a7b24e3a808 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.541453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9be2b1-a04a-4673-b032-78fac4810525 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.563169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd38d7-66f1-443b-bc24-ed7417c99111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.565202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd38d7-66f1-443b-bc24-ed7417c99111 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.565773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd38d7-66f1-443b-bc24-ed7417c99111 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.566220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd38d7-66f1-443b-bc24-ed7417c99111 admin admin] PATH_INFO: `/v3/projects/c38523e7590c48c484d9b778e4ac5308/users/05c4b9473d5f4c14a04a9935db78eaa0/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.567975 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1932/3878] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:51 2022] PUT /identity/v3/projects/e4e370ef28034ffbbbee9d2cfd826084/users/fad7207822c04fc289709200d7e2bd2d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:51.568933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339effc-0be3-4161-b30c-5a7b24e3a808 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.587650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd38d7-66f1-443b-bc24-ed7417c99111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38523e7590c48c484d9b778e4ac5308, user_id=05c4b9473d5f4c14a04a9935db78eaa0, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.593010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd38d7-66f1-443b-bc24-ed7417c99111 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.618152 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1947/3879] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:51 2022] PUT /identity/v3/projects/c38523e7590c48c484d9b778e4ac5308/users/05c4b9473d5f4c14a04a9935db78eaa0/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:51.627460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ede4e1-c436-4dfb-b135-45930d3df7f7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.627763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ede4e1-c436-4dfb-b135-45930d3df7f7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.629817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ede4e1-c436-4dfb-b135-45930d3df7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.670076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e0ede4e1-c436-4dfb-b135-45930d3df7f7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:51.673909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e0ede4e1-c436-4dfb-b135-45930d3df7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:51.698458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339effc-0be3-4161-b30c-5a7b24e3a808 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.840307 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1948/3880] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:51.843095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606891f0-7f42-4523-8816-27404b1a988c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.844048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606891f0-7f42-4523-8816-27404b1a988c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.844684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606891f0-7f42-4523-8816-27404b1a988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.853617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a89d70-2dd6-421d-a725-d103ce5a6804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.857334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a89d70-2dd6-421d-a725-d103ce5a6804 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.857334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a89d70-2dd6-421d-a725-d103ce5a6804 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.858350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a89d70-2dd6-421d-a725-d103ce5a6804 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.860967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a89d70-2dd6-421d-a725-d103ce5a6804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.864670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a89d70-2dd6-421d-a725-d103ce5a6804 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.883185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-606891f0-7f42-4523-8816-27404b1a988c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:51.887124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-606891f0-7f42-4523-8816-27404b1a988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:51.891883 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1933/3881] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:51.895668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a89d70-2dd6-421d-a725-d103ce5a6804 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.911141 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1949/3882] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:51.913940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a89d70-2dd6-421d-a725-d103ce5a6804 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:51.916668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606891f0-7f42-4523-8816-27404b1a988c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.921092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-606891f0-7f42-4523-8816-27404b1a988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:51.924068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:51.925160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:51.925694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:51.926395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:51.927290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:51.931412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:51.951254 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1934/3883] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 20:59:51.954414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:51.956970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:52.027648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606891f0-7f42-4523-8816-27404b1a988c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:52.055107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215c235-7f2d-43a8-8bcf-7dd6d3d48c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:52.056203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215c235-7f2d-43a8-8bcf-7dd6d3d48c9e service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:52.057905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215c235-7f2d-43a8-8bcf-7dd6d3d48c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:52.058215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215c235-7f2d-43a8-8bcf-7dd6d3d48c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:52.075486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d19cea-4cdd-4af7-9bab-f0ad03c43ba5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:52.078343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215c235-7f2d-43a8-8bcf-7dd6d3d48c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:52.080127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215c235-7f2d-43a8-8bcf-7dd6d3d48c9e service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:52.084278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c7bc1-f9ce-44c9-88dd-e8f57bb0b9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:52.085284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7bc1-f9ce-44c9-88dd-e8f57bb0b9da service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:52.085570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7bc1-f9ce-44c9-88dd-e8f57bb0b9da service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:52.086767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7bc1-f9ce-44c9-88dd-e8f57bb0b9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:52.100965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c7bc1-f9ce-44c9-88dd-e8f57bb0b9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:52.102417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c7bc1-f9ce-44c9-88dd-e8f57bb0b9da service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:52.116130 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1935/3884] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:52.116741 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1950/3885] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:52.117370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c7bc1-f9ce-44c9-88dd-e8f57bb0b9da service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:52.130837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c7bc1-f9ce-44c9-88dd-e8f57bb0b9da service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:52.149560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e2212-2120-4c94-b8a8-172c121bbbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:52.151252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e2212-2120-4c94-b8a8-172c121bbbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:52.151710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e2212-2120-4c94-b8a8-172c121bbbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:52.152028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e2212-2120-4c94-b8a8-172c121bbbfe admin admin] PATH_INFO: `/v3/projects/c2c91d99923e44a9b49c306044837e9e/users/e6e829f8edf3477dbc070d33ae8a6613/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:52.179670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e2212-2120-4c94-b8a8-172c121bbbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c91d99923e44a9b49c306044837e9e, user_id=e6e829f8edf3477dbc070d33ae8a6613, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:52.183383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e2212-2120-4c94-b8a8-172c121bbbfe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:52.241173 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1936/3886] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 20:59:52 2022] PUT /identity/v3/projects/c2c91d99923e44a9b49c306044837e9e/users/e6e829f8edf3477dbc070d33ae8a6613/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:52.242168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc504-7661-4163-adfa-53b1a1032c80 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:52.242695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc504-7661-4163-adfa-53b1a1032c80 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:52.243823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc504-7661-4163-adfa-53b1a1032c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:52.343313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6e6fc504-7661-4163-adfa-53b1a1032c80 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:52.346826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6e6fc504-7661-4163-adfa-53b1a1032c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:52.495417 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1951/3887] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 20:59:52.531911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e2212-2120-4c94-b8a8-172c121bbbfe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:52.651697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e2212-2120-4c94-b8a8-172c121bbbfe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:52.678371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ffe8-284c-4f13-a2b4-8aee6d61a290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:52.679177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ffe8-284c-4f13-a2b4-8aee6d61a290 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:52.681222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ffe8-284c-4f13-a2b4-8aee6d61a290 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:52.687419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ffe8-284c-4f13-a2b4-8aee6d61a290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:52.716608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79ffe8-284c-4f13-a2b4-8aee6d61a290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:52.719534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79ffe8-284c-4f13-a2b4-8aee6d61a290 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:52.750462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1937/3888] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 20:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:57.500079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc504-7661-4163-adfa-53b1a1032c80 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:57.508474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6e6fc504-7661-4163-adfa-53b1a1032c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:57.551934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc504-7661-4163-adfa-53b1a1032c80 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:57.567219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:57.569072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:57.569349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:57.569627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] PATH_INFO: `/v3/users/ae01e28f534446c09c6dfbe2871d36f9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:57.571041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae01e28f534446c09c6dfbe2871d36f9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:57.573074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:57.679985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae01e28f534446c09c6dfbe2871d36f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:57.705345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae01e28f534446c09c6dfbe2871d36f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:57.736232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae01e28f534446c09c6dfbe2871d36f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:57.737284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae01e28f534446c09c6dfbe2871d36f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:57.738186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-58e789e2-66cd-43e2-a53f-2297cfd8646a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae01e28f534446c09c6dfbe2871d36f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:57.766890 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1952/3889] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:59:57 2022] DELETE /identity/v3/users/ae01e28f534446c09c6dfbe2871d36f9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:58.890169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ffe8-284c-4f13-a2b4-8aee6d61a290 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:58.912200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ffe8-284c-4f13-a2b4-8aee6d61a290 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:59.067216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:59.069257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:59.071599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:59.072071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] PATH_INFO: `/v3/projects/fea74080450a434fb28f53a0a28d5627` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:59.077333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea74080450a434fb28f53a0a28d5627)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:59.079284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:59.208727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea74080450a434fb28f53a0a28d5627', 'request_id': 'req-98b52028-8134-4deb-8d5a-2328a2c1f050'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:59.228572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea74080450a434fb28f53a0a28d5627', 'request_id': 'req-98b52028-8134-4deb-8d5a-2328a2c1f050'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:59.263438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea74080450a434fb28f53a0a28d5627', 'request_id': 'req-98b52028-8134-4deb-8d5a-2328a2c1f050'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:59.277728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] The token cache is being invalidate because project fea74080450a434fb28f53a0a28d5627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 20:59:59.278064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:59.278737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98b52028-8134-4deb-8d5a-2328a2c1f050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 20:59:59.283539 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1938/3890] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:58 2022] DELETE /identity/v3/projects/fea74080450a434fb28f53a0a28d5627 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 20:59:59.291536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336fa1-500c-4b4f-813e-4ca38105cae7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:59.292226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336fa1-500c-4b4f-813e-4ca38105cae7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:59.292226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336fa1-500c-4b4f-813e-4ca38105cae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:59.355670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9e336fa1-500c-4b4f-813e-4ca38105cae7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:59.356969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e336fa1-500c-4b4f-813e-4ca38105cae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:59.548877 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1953/3891] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:59.556225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675b0f-7e4e-4abe-b4c1-be74b4c0a59c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:59.556541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675b0f-7e4e-4abe-b4c1-be74b4c0a59c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:59.556824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675b0f-7e4e-4abe-b4c1-be74b4c0a59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:59.596580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-59675b0f-7e4e-4abe-b4c1-be74b4c0a59c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 20:59:59.600774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-59675b0f-7e4e-4abe-b4c1-be74b4c0a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 20:59:59.631448 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1939/3892] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 20:59:59.633910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e336fa1-500c-4b4f-813e-4ca38105cae7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:59.650396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e336fa1-500c-4b4f-813e-4ca38105cae7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:59.692566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:59.693259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:59.693546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:59.693823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:59.694556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 20:59:59.694866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:59.701316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:59.746499 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1954/3893] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 20:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 20:59:59.751134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59675b0f-7e4e-4abe-b4c1-be74b4c0a59c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:59.762858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59675b0f-7e4e-4abe-b4c1-be74b4c0a59c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 20:59:59.778579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a061f61-3fee-42d5-b79b-680420c1e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 20:59:59.779470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061f61-3fee-42d5-b79b-680420c1e052 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 20:59:59.781327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061f61-3fee-42d5-b79b-680420c1e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 20:59:59.781796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061f61-3fee-42d5-b79b-680420c1e052 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 20:59:59.782698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a061f61-3fee-42d5-b79b-680420c1e052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 20:59:59.784783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a061f61-3fee-42d5-b79b-680420c1e052 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 20:59:59.856790 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1940/3894] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 20:59:59 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 20:59:59.860992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 20:59:59.887995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d337ff6-2fd6-485c-9597-5b1f7e56c845 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:00.058564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474f6d4-5ceb-4892-ac90-83f94ad25a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:00.060569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f6d4-5ceb-4892-ac90-83f94ad25a84 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:00.061716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f6d4-5ceb-4892-ac90-83f94ad25a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:00.062254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474f6d4-5ceb-4892-ac90-83f94ad25a84 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:00.063244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474f6d4-5ceb-4892-ac90-83f94ad25a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:00.065572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474f6d4-5ceb-4892-ac90-83f94ad25a84 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:00.117230 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1955/3895] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 20:59:59 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:00.121393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a061f61-3fee-42d5-b79b-680420c1e052 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:00.136525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a061f61-3fee-42d5-b79b-680420c1e052 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:00.156099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491f1b-b578-46ea-bf42-68b5145425e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:00.157835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491f1b-b578-46ea-bf42-68b5145425e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:00.158379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491f1b-b578-46ea-bf42-68b5145425e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:00.158909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491f1b-b578-46ea-bf42-68b5145425e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:00.160038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3491f1b-b578-46ea-bf42-68b5145425e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:00.161989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3491f1b-b578-46ea-bf42-68b5145425e1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:00.190204 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1941/3896] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:00.193693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474f6d4-5ceb-4892-ac90-83f94ad25a84 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:00.209059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474f6d4-5ceb-4892-ac90-83f94ad25a84 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:00.223097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12daaa-94bb-4773-bd36-fafc03e95d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:00.223939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12daaa-94bb-4773-bd36-fafc03e95d8b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:00.224351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12daaa-94bb-4773-bd36-fafc03e95d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:00.225165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12daaa-94bb-4773-bd36-fafc03e95d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:00.225979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12daaa-94bb-4773-bd36-fafc03e95d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:00.230149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12daaa-94bb-4773-bd36-fafc03e95d8b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:00.252898 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1956/3897] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:00.257080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491f1b-b578-46ea-bf42-68b5145425e1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:00.269559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491f1b-b578-46ea-bf42-68b5145425e1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:00.285488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:00.286998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:00.287398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:00.287920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] PATH_INFO: `/v3/projects/271b093ea9944990883cd9383817983e/users/fc3544bbe8564a81910a988d85ddc169/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:00.323957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] RBAC: Authorizing `identity:create_grant(project_id=271b093ea9944990883cd9383817983e, user_id=fc3544bbe8564a81910a988d85ddc169, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:00.329146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:00.366224 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1942/3898] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:00 2022] PUT /identity/v3/projects/271b093ea9944990883cd9383817983e/users/fc3544bbe8564a81910a988d85ddc169/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:00.381478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789bb17-0e12-45da-bf5c-24b48132cef3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:00.382322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789bb17-0e12-45da-bf5c-24b48132cef3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:00.382786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789bb17-0e12-45da-bf5c-24b48132cef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:00.450865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3789bb17-0e12-45da-bf5c-24b48132cef3 None None] MFA Rules not processed for user `fc3544bbe8564a81910a988d85ddc169`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:00.452870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3789bb17-0e12-45da-bf5c-24b48132cef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:00.616559 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1957/3899] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:00.628268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:00.630103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:00.846975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7874df-9929-4d37-ac56-6865caceb74c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:00.863070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d1574-ff78-49de-8452-df93c739677a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:00.863787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d1574-ff78-49de-8452-df93c739677a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:00.864078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d1574-ff78-49de-8452-df93c739677a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:00.864405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d1574-ff78-49de-8452-df93c739677a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:00.887314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d1574-ff78-49de-8452-df93c739677a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:00.889734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d1574-ff78-49de-8452-df93c739677a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:00.914362 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1943/3900] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:06.780988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ab53-0ba8-4d4a-8535-075731e71f59 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:06.781536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ab53-0ba8-4d4a-8535-075731e71f59 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:06.781536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ab53-0ba8-4d4a-8535-075731e71f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:06.844025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-42f1ab53-0ba8-4d4a-8535-075731e71f59 None None] MFA Rules not processed for user `e6e829f8edf3477dbc070d33ae8a6613`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:06.845587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-42f1ab53-0ba8-4d4a-8535-075731e71f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:07.001811 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1958/3901] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:07.069606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f08dc-4f32-44f6-9c34-f14b2abc581b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:07.070223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f08dc-4f32-44f6-9c34-f14b2abc581b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:07.070223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f08dc-4f32-44f6-9c34-f14b2abc581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:07.113575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-378f08dc-4f32-44f6-9c34-f14b2abc581b None None] MFA Rules not processed for user `e6e829f8edf3477dbc070d33ae8a6613`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:07.116319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-378f08dc-4f32-44f6-9c34-f14b2abc581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:07.184369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1944/3902] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:07.190913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1ab53-0ba8-4d4a-8535-075731e71f59 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:07.192397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-42f1ab53-0ba8-4d4a-8535-075731e71f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:07.226314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1ab53-0ba8-4d4a-8535-075731e71f59 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:07.244921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532241a-7191-47ad-a0c0-02d6d0568d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:07.245213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532241a-7191-47ad-a0c0-02d6d0568d46 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:07.245478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532241a-7191-47ad-a0c0-02d6d0568d46 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:07.245754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532241a-7191-47ad-a0c0-02d6d0568d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:07.264581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532241a-7191-47ad-a0c0-02d6d0568d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:07.266349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532241a-7191-47ad-a0c0-02d6d0568d46 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:07.287790 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1959/3903] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:10.157310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f08dc-4f32-44f6-9c34-f14b2abc581b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:10.316851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3067c-5092-4187-8a15-d0bca286c034 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:10.317802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3067c-5092-4187-8a15-d0bca286c034 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:10.318237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3067c-5092-4187-8a15-d0bca286c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:10.375998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-64e3067c-5092-4187-8a15-d0bca286c034 None None] MFA Rules not processed for user `e6e829f8edf3477dbc070d33ae8a6613`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:10.381295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-64e3067c-5092-4187-8a15-d0bca286c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:10.400875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f08dc-4f32-44f6-9c34-f14b2abc581b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:10.409188 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1960/3904] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:00:10.420966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:10.421851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:10.422409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:10.422629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] PATH_INFO: `/v3/users/fc3544bbe8564a81910a988d85ddc169` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:10.424938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3544bbe8564a81910a988d85ddc169)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:10.428135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:10.548740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3544bbe8564a81910a988d85ddc169'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:10.549481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3544bbe8564a81910a988d85ddc169'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:10.550100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3544bbe8564a81910a988d85ddc169'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:10.577991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3544bbe8564a81910a988d85ddc169'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:10.598131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3544bbe8564a81910a988d85ddc169'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:10.620078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1945/3905] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:10 2022] DELETE /identity/v3/users/fc3544bbe8564a81910a988d85ddc169 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:10.625029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1bec-5b4c-491c-b174-73a7e2865b66 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:10.625680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1bec-5b4c-491c-b174-73a7e2865b66 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:10.626126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1bec-5b4c-491c-b174-73a7e2865b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:10.660910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fdda1bec-5b4c-491c-b174-73a7e2865b66 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:10.662415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fdda1bec-5b4c-491c-b174-73a7e2865b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:10.808671 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1961/3906] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:11.141021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:11.142502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:11.464565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532ac1f-0a9f-4cfc-83ea-57892360530c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:11.493148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bc5ce-a120-4c07-bef7-02001dc61d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:11.493878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc5ce-a120-4c07-bef7-02001dc61d63 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:11.503490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc5ce-a120-4c07-bef7-02001dc61d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:11.503703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc5ce-a120-4c07-bef7-02001dc61d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:11.545239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bc5ce-a120-4c07-bef7-02001dc61d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:11.549363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bc5ce-a120-4c07-bef7-02001dc61d63 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:11.608155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1946/3907] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:12.769067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda1bec-5b4c-491c-b174-73a7e2865b66 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:12.770553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fdda1bec-5b4c-491c-b174-73a7e2865b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:12.789896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda1bec-5b4c-491c-b174-73a7e2865b66 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:12.808822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:12.810026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:12.810308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:12.811217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] PATH_INFO: `/v3/users/39455355838c47e188c41d39b1502503` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:12.817608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39455355838c47e188c41d39b1502503)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:12.820049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:12.955905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39455355838c47e188c41d39b1502503'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:12.980781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39455355838c47e188c41d39b1502503'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:13.006186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39455355838c47e188c41d39b1502503'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:13.007015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39455355838c47e188c41d39b1502503'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:13.007862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39455355838c47e188c41d39b1502503'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:13.087821 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1962/3908] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:12 2022] DELETE /identity/v3/users/39455355838c47e188c41d39b1502503 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:13.093456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99ee2a-bf79-492c-81f3-34ad03f598be None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:13.094023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99ee2a-bf79-492c-81f3-34ad03f598be None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:13.094023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99ee2a-bf79-492c-81f3-34ad03f598be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:13.152532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9f99ee2a-bf79-492c-81f3-34ad03f598be None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:13.165184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f99ee2a-bf79-492c-81f3-34ad03f598be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:13.442157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1947/3909] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:13.484392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:13.485868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:13.738343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671a849-be3c-42f1-af48-f04975ed8b42 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:13.756058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:13.759756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:13.762746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:13.765019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:13.806738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:13.812561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:13.842756 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1963/3910] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:13.894526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99ee2a-bf79-492c-81f3-34ad03f598be None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:13.901441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f99ee2a-bf79-492c-81f3-34ad03f598be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:13.941055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99ee2a-bf79-492c-81f3-34ad03f598be None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:13.980439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:13.981378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:13.981758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:13.982025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] PATH_INFO: `/v3/users/0f88ec14e66c4dafa9aeb5595692a225` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:13.984576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f88ec14e66c4dafa9aeb5595692a225)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:13.988030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:14.241490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f88ec14e66c4dafa9aeb5595692a225'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.242879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f88ec14e66c4dafa9aeb5595692a225'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.243853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f88ec14e66c4dafa9aeb5595692a225'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.266493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f88ec14e66c4dafa9aeb5595692a225'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.283088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ac814448-d676-4531-bf33-da90d1c51332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f88ec14e66c4dafa9aeb5595692a225'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.325415 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1948/3911] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:13 2022] DELETE /identity/v3/users/0f88ec14e66c4dafa9aeb5595692a225 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:14.664522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:14.665819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:14.704821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2250f3-8db4-4de4-9396-6273dcb32564 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:14.794079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:14.795068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:14.795556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:14.796183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] PATH_INFO: `/v3/projects/271b093ea9944990883cd9383817983e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:14.811172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271b093ea9944990883cd9383817983e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:14.813804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:14.883379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271b093ea9944990883cd9383817983e', 'request_id': 'req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.893456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271b093ea9944990883cd9383817983e', 'request_id': 'req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.922450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271b093ea9944990883cd9383817983e', 'request_id': 'req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.954504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] The token cache is being invalidate because project 271b093ea9944990883cd9383817983e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:14.954806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.958442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f6848b7-9a9f-49f9-a77a-9069a8b667f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:14.961715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1964/3912] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:14 2022] DELETE /identity/v3/projects/271b093ea9944990883cd9383817983e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:14.972078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d2c5-c6b7-439d-8bc4-26e1ef289350 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:14.972878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d2c5-c6b7-439d-8bc4-26e1ef289350 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:14.973714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d2c5-c6b7-439d-8bc4-26e1ef289350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:15.036498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-de16d2c5-c6b7-439d-8bc4-26e1ef289350 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:15.037822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-de16d2c5-c6b7-439d-8bc4-26e1ef289350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:15.290909 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1949/3913] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:15.307364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffff59-7492-47ca-bf41-909e5ffc9c7a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:15.307833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffff59-7492-47ca-bf41-909e5ffc9c7a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:15.308454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffff59-7492-47ca-bf41-909e5ffc9c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:15.371998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4cffff59-7492-47ca-bf41-909e5ffc9c7a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:15.379137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4cffff59-7492-47ca-bf41-909e5ffc9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:15.419684 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1965/3914] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:15.420952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d2c5-c6b7-439d-8bc4-26e1ef289350 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:15.440829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d2c5-c6b7-439d-8bc4-26e1ef289350 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:15.459128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:15.460150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:15.460888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:15.461489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:15.462568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:15.463539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:15.469362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:15.523207 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1950/3915] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:15.527642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffff59-7492-47ca-bf41-909e5ffc9c7a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:15.544251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffff59-7492-47ca-bf41-909e5ffc9c7a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:15.564365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6f03-da57-4fc0-9b8f-937dbe987a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:15.567134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6f03-da57-4fc0-9b8f-937dbe987a32 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:15.571288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6f03-da57-4fc0-9b8f-937dbe987a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:15.576002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6f03-da57-4fc0-9b8f-937dbe987a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:15.577099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6f03-da57-4fc0-9b8f-937dbe987a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:15.585841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6f03-da57-4fc0-9b8f-937dbe987a32 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:15.772972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:15.775517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:15.780743 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1966/3916] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:15 2022] POST /identity/v3/projects => generated 367 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:15.781704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6f03-da57-4fc0-9b8f-937dbe987a32 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:15.821491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1584bdf-0024-44b9-bb67-cb57ed131c8e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:16.016629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6f03-da57-4fc0-9b8f-937dbe987a32 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:16.035626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a174b-e95e-4bf9-b7ae-b815683b3be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:16.036626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a174b-e95e-4bf9-b7ae-b815683b3be7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.037149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a174b-e95e-4bf9-b7ae-b815683b3be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.037626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a174b-e95e-4bf9-b7ae-b815683b3be7 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:16.038365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a174b-e95e-4bf9-b7ae-b815683b3be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:16.042591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a174b-e95e-4bf9-b7ae-b815683b3be7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:16.086391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:16.087603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.088203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.089905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] PATH_INFO: `/v3/projects/a0e4c2e796b54b51bda74d8c84f9f815` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:16.091589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e4c2e796b54b51bda74d8c84f9f815)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:16.102326 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1967/3917] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:15 2022] POST /identity/v3/users => generated 284 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:16.102691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:16.106812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a174b-e95e-4bf9-b7ae-b815683b3be7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:16.133318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a174b-e95e-4bf9-b7ae-b815683b3be7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:16.145175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5fe9b-f109-4bfb-95e4-66cdf6548829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:16.147268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5fe9b-f109-4bfb-95e4-66cdf6548829 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.149176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5fe9b-f109-4bfb-95e4-66cdf6548829 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.149671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5fe9b-f109-4bfb-95e4-66cdf6548829 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:16.151954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5fe9b-f109-4bfb-95e4-66cdf6548829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:16.155598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5fe9b-f109-4bfb-95e4-66cdf6548829 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:16.211205 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1968/3918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:16.227174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5fe9b-f109-4bfb-95e4-66cdf6548829 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:16.267596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5fe9b-f109-4bfb-95e4-66cdf6548829 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:16.275073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e4c2e796b54b51bda74d8c84f9f815', 'request_id': 'req-276b884a-ea3a-4e72-8cb2-a64e80048cdb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.289974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e4c2e796b54b51bda74d8c84f9f815', 'request_id': 'req-276b884a-ea3a-4e72-8cb2-a64e80048cdb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.323565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e4c2e796b54b51bda74d8c84f9f815', 'request_id': 'req-276b884a-ea3a-4e72-8cb2-a64e80048cdb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.351982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] The token cache is being invalidate because project a0e4c2e796b54b51bda74d8c84f9f815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:16.352593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.356988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-276b884a-ea3a-4e72-8cb2-a64e80048cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.359790 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1951/3919] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:15 2022] DELETE /identity/v3/projects/a0e4c2e796b54b51bda74d8c84f9f815 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:16.361146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289ece4-6515-4895-92ed-9663b7341731 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.361434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289ece4-6515-4895-92ed-9663b7341731 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.361708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289ece4-6515-4895-92ed-9663b7341731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:16.414059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9289ece4-6515-4895-92ed-9663b7341731 None None] MFA Rules not processed for user `fad7207822c04fc289709200d7e2bd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:16.415300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9289ece4-6515-4895-92ed-9663b7341731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:16.428292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:16.429009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.429294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.429573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:16.432700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:16.434648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:16.465245 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1969/3920] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:16.466367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:16.468306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:16.523803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c6eae-1079-4c2e-97cd-20ea92cd4ab7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:16.543594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:16.545351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.547867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.548438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] PATH_INFO: `/v3/projects/5b11084a5a46488cbb721afa4256a6bd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:16.550676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b11084a5a46488cbb721afa4256a6bd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:16.556788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:16.621802 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1952/3921] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:16.627950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36bc5-e252-4387-b024-e39f97fbd4db None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.628598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36bc5-e252-4387-b024-e39f97fbd4db None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.629076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36bc5-e252-4387-b024-e39f97fbd4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:16.669342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dad36bc5-e252-4387-b024-e39f97fbd4db None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:16.673395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b11084a5a46488cbb721afa4256a6bd', 'request_id': 'req-596627ec-9f1c-4fe6-bff8-add6719252a7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.680816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b11084a5a46488cbb721afa4256a6bd', 'request_id': 'req-596627ec-9f1c-4fe6-bff8-add6719252a7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.682106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dad36bc5-e252-4387-b024-e39f97fbd4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:16.705640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b11084a5a46488cbb721afa4256a6bd', 'request_id': 'req-596627ec-9f1c-4fe6-bff8-add6719252a7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.726348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] The token cache is being invalidate because project 5b11084a5a46488cbb721afa4256a6bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:16.726945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.728106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:16.734471 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1970/3922] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:16 2022] DELETE /identity/v3/projects/5b11084a5a46488cbb721afa4256a6bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:16.735884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:16.740571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:16.819258 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1953/3923] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:16.824022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36bc5-e252-4387-b024-e39f97fbd4db None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:16.826710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dad36bc5-e252-4387-b024-e39f97fbd4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:16.898704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596627ec-9f1c-4fe6-bff8-add6719252a7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:16.908524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea398458-ceaa-4fad-9d8c-ebbb1baf817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:16.910672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398458-ceaa-4fad-9d8c-ebbb1baf817c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.913446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398458-ceaa-4fad-9d8c-ebbb1baf817c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.913968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398458-ceaa-4fad-9d8c-ebbb1baf817c admin admin] PATH_INFO: `/v3/projects/bc97ce0e64714e67a35d1f012eb946cc/users/045f904e52cf49deb98ef9f7c3d79fa7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:16.941249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea398458-ceaa-4fad-9d8c-ebbb1baf817c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc97ce0e64714e67a35d1f012eb946cc, user_id=045f904e52cf49deb98ef9f7c3d79fa7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:16.944455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea398458-ceaa-4fad-9d8c-ebbb1baf817c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:16.981754 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1971/3924] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:16 2022] PUT /identity/v3/projects/bc97ce0e64714e67a35d1f012eb946cc/users/045f904e52cf49deb98ef9f7c3d79fa7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:16.984061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0858-2d71-42dc-9fb4-d8d468ca8b84 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:16.985003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0858-2d71-42dc-9fb4-d8d468ca8b84 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:16.986094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0858-2d71-42dc-9fb4-d8d468ca8b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.030334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-53bc0858-2d71-42dc-9fb4-d8d468ca8b84 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:17.031743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53bc0858-2d71-42dc-9fb4-d8d468ca8b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:17.033338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36bc5-e252-4387-b024-e39f97fbd4db None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.132598 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1972/3925] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:17.139873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de336655-4804-455d-b09b-b2a2124f5d38 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.140436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de336655-4804-455d-b09b-b2a2124f5d38 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.140875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de336655-4804-455d-b09b-b2a2124f5d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.173491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb66a9-81f7-4ba0-b735-cf5b284ecfe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.174939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb66a9-81f7-4ba0-b735-cf5b284ecfe8 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.175423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb66a9-81f7-4ba0-b735-cf5b284ecfe8 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.175896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb66a9-81f7-4ba0-b735-cf5b284ecfe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.178288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0dbb66a9-81f7-4ba0-b735-cf5b284ecfe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:17.201563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-de336655-4804-455d-b09b-b2a2124f5d38 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:17.204206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de336655-4804-455d-b09b-b2a2124f5d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:17.230923 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1973/3926] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:17.230923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa664fcb-f89b-4a1a-97b7-4540fac68e00 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.230923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa664fcb-f89b-4a1a-97b7-4540fac68e00 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.231355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa664fcb-f89b-4a1a-97b7-4540fac68e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.287821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fa664fcb-f89b-4a1a-97b7-4540fac68e00 None None] MFA Rules not processed for user `045f904e52cf49deb98ef9f7c3d79fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:17.291452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fa664fcb-f89b-4a1a-97b7-4540fac68e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:17.303191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb66a9-81f7-4ba0-b735-cf5b284ecfe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.304822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb66a9-81f7-4ba0-b735-cf5b284ecfe8 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:17.328669 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1954/3927] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:17.330337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c78a0-685b-41cc-b2d6-de11f52393f5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.330626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c78a0-685b-41cc-b2d6-de11f52393f5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.330906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c78a0-685b-41cc-b2d6-de11f52393f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.369581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cc6c78a0-685b-41cc-b2d6-de11f52393f5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:17.370809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc6c78a0-685b-41cc-b2d6-de11f52393f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:17.397454 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1955/3928] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:17.398058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c78a0-685b-41cc-b2d6-de11f52393f5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.416745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c78a0-685b-41cc-b2d6-de11f52393f5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.428995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.431065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.431252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.431531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.434805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:17.435646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.439017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:17.443933 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1974/3929] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:17.445014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa664fcb-f89b-4a1a-97b7-4540fac68e00 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.460465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa664fcb-f89b-4a1a-97b7-4540fac68e00 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.461434 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1956/3930] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:17.462625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.466384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.468156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.468647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.469359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.470251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:17.470724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.472562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:17.477131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bc54d-28ec-4351-8923-47a120885c11 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.483554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522967cd-3e75-4ef4-a333-4ea2d96bcf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.484441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522967cd-3e75-4ef4-a333-4ea2d96bcf76 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.484992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522967cd-3e75-4ef4-a333-4ea2d96bcf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.485449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522967cd-3e75-4ef4-a333-4ea2d96bcf76 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.486269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522967cd-3e75-4ef4-a333-4ea2d96bcf76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.488373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522967cd-3e75-4ef4-a333-4ea2d96bcf76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:17.488581 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1975/3931] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:17.489610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.504020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcae93-8586-4601-ab83-3d6aaeb72fef admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.516781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d287a-2f03-4353-922f-1ed0c098d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.517804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d287a-2f03-4353-922f-1ed0c098d2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.518055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d287a-2f03-4353-922f-1ed0c098d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.518318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d287a-2f03-4353-922f-1ed0c098d2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.519260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d287a-2f03-4353-922f-1ed0c098d2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.521256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d287a-2f03-4353-922f-1ed0c098d2e5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:17.543963 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1957/3932] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:17 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:17.543963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522967cd-3e75-4ef4-a333-4ea2d96bcf76 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.581156 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1976/3933] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:17.581866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d287a-2f03-4353-922f-1ed0c098d2e5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.718759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522967cd-3e75-4ef4-a333-4ea2d96bcf76 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.745493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d287a-2f03-4353-922f-1ed0c098d2e5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.751284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1aa15-b678-4cd3-afb0-c0c078cf9672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.752116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1aa15-b678-4cd3-afb0-c0c078cf9672 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.752556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1aa15-b678-4cd3-afb0-c0c078cf9672 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.752961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1aa15-b678-4cd3-afb0-c0c078cf9672 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.754192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1aa15-b678-4cd3-afb0-c0c078cf9672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.756413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1aa15-b678-4cd3-afb0-c0c078cf9672 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:17.801350 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1977/3934] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:17 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:17.803538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1aa15-b678-4cd3-afb0-c0c078cf9672 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.833519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1aa15-b678-4cd3-afb0-c0c078cf9672 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.851338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd30f2b-b1dd-4d14-997d-7a9176b564e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.852748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30f2b-b1dd-4d14-997d-7a9176b564e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.853911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30f2b-b1dd-4d14-997d-7a9176b564e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.855059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30f2b-b1dd-4d14-997d-7a9176b564e9 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.858383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd30f2b-b1dd-4d14-997d-7a9176b564e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.864985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd30f2b-b1dd-4d14-997d-7a9176b564e9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:17.870690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89159b0-cd9c-419a-a3e7-2ca8eeea2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.871726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89159b0-cd9c-419a-a3e7-2ca8eeea2953 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.871953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89159b0-cd9c-419a-a3e7-2ca8eeea2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.872426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89159b0-cd9c-419a-a3e7-2ca8eeea2953 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.874477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89159b0-cd9c-419a-a3e7-2ca8eeea2953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.886426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89159b0-cd9c-419a-a3e7-2ca8eeea2953 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:17.913188 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1978/3935] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:17 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:17.915598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd30f2b-b1dd-4d14-997d-7a9176b564e9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.939033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd30f2b-b1dd-4d14-997d-7a9176b564e9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:17.956539 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1958/3936] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:17 2022] POST /identity/v3/projects => generated 399 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:17.958024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89159b0-cd9c-419a-a3e7-2ca8eeea2953 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:17.963977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ea9a-b2f7-45f0-97c6-63ea3a55cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:17.967948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ea9a-b2f7-45f0-97c6-63ea3a55cf63 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:17.968563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ea9a-b2f7-45f0-97c6-63ea3a55cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:17.969111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ea9a-b2f7-45f0-97c6-63ea3a55cf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:17.970591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517ea9a-b2f7-45f0-97c6-63ea3a55cf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:17.975471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517ea9a-b2f7-45f0-97c6-63ea3a55cf63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.046520 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1979/3937] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:18.047507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ea9a-b2f7-45f0-97c6-63ea3a55cf63 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.091059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ea9a-b2f7-45f0-97c6-63ea3a55cf63 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.155570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89159b0-cd9c-419a-a3e7-2ca8eeea2953 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.173474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c683a-b4c9-4570-bc61-d83ad8521de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.174574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c683a-b4c9-4570-bc61-d83ad8521de2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.175101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c683a-b4c9-4570-bc61-d83ad8521de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.175644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c683a-b4c9-4570-bc61-d83ad8521de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.176741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c683a-b4c9-4570-bc61-d83ad8521de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.182276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c683a-b4c9-4570-bc61-d83ad8521de2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.203072 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1959/3938] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:18.204351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c683a-b4c9-4570-bc61-d83ad8521de2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.221071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c683a-b4c9-4570-bc61-d83ad8521de2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.229573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d501059-8045-4c29-b911-0df082e1c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.230280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d501059-8045-4c29-b911-0df082e1c5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.233470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186919-c4da-4b00-b03a-599f870785f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.233885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d501059-8045-4c29-b911-0df082e1c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.234220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d501059-8045-4c29-b911-0df082e1c5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.235370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186919-c4da-4b00-b03a-599f870785f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.235881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186919-c4da-4b00-b03a-599f870785f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.236416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186919-c4da-4b00-b03a-599f870785f1 admin admin] PATH_INFO: `/v3/projects/c1570e453d9c446dac72d42a29ccf729/users/40dc33d5c81d43498a08d008e46f0501/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.237770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d501059-8045-4c29-b911-0df082e1c5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.244026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d501059-8045-4c29-b911-0df082e1c5c1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.257144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c186919-c4da-4b00-b03a-599f870785f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1570e453d9c446dac72d42a29ccf729, user_id=40dc33d5c81d43498a08d008e46f0501, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.260207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c186919-c4da-4b00-b03a-599f870785f1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.292059 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1960/3939] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:18 2022] PUT /identity/v3/projects/c1570e453d9c446dac72d42a29ccf729/users/40dc33d5c81d43498a08d008e46f0501/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:18.293517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186919-c4da-4b00-b03a-599f870785f1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.302467 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1980/3940] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:18 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:18.304993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d501059-8045-4c29-b911-0df082e1c5c1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.348120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d501059-8045-4c29-b911-0df082e1c5c1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.423447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186919-c4da-4b00-b03a-599f870785f1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.436126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f014af-b692-47f5-b3b7-86bc51a190af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.437321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f014af-b692-47f5-b3b7-86bc51a190af admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.437612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f014af-b692-47f5-b3b7-86bc51a190af admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.437911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f014af-b692-47f5-b3b7-86bc51a190af admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.438614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f014af-b692-47f5-b3b7-86bc51a190af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.443952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f014af-b692-47f5-b3b7-86bc51a190af admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.464708 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1961/3941] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:18.465577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f014af-b692-47f5-b3b7-86bc51a190af admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.479215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f014af-b692-47f5-b3b7-86bc51a190af admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.489519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0f43d-924b-40bf-9708-3d89e9eb6d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.490208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0f43d-924b-40bf-9708-3d89e9eb6d7e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.490494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0f43d-924b-40bf-9708-3d89e9eb6d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.490830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0f43d-924b-40bf-9708-3d89e9eb6d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.491571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0f43d-924b-40bf-9708-3d89e9eb6d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.494419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0f43d-924b-40bf-9708-3d89e9eb6d7e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.495822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c2c4-5aa7-480e-85c3-d3f49e3a8e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.497131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c2c4-5aa7-480e-85c3-d3f49e3a8e27 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.498224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c2c4-5aa7-480e-85c3-d3f49e3a8e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.498995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c2c4-5aa7-480e-85c3-d3f49e3a8e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.500053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c2c4-5aa7-480e-85c3-d3f49e3a8e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.503299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c2c4-5aa7-480e-85c3-d3f49e3a8e27 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.507621 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1962/3942] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:18.508307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0f43d-924b-40bf-9708-3d89e9eb6d7e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.517704 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1981/3943] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:18.518983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c2c4-5aa7-480e-85c3-d3f49e3a8e27 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.536818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0f43d-924b-40bf-9708-3d89e9eb6d7e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.543687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d25d-0916-41ff-b133-9f8d96f03a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.551088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c2c4-5aa7-480e-85c3-d3f49e3a8e27 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.554044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d25d-0916-41ff-b133-9f8d96f03a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.556800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d25d-0916-41ff-b133-9f8d96f03a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.560892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d25d-0916-41ff-b133-9f8d96f03a64 admin admin] PATH_INFO: `/v3/projects/6be548f3d4ea4a9883b15a69b3ee6a00/users/c1228a82f58d4d69b9eff6ab06e91519/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.569560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1cbe8-7fe1-4db6-8488-c3e6c6700bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.570416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1cbe8-7fe1-4db6-8488-c3e6c6700bbb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.570714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1cbe8-7fe1-4db6-8488-c3e6c6700bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.572751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1cbe8-7fe1-4db6-8488-c3e6c6700bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.574070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1cbe8-7fe1-4db6-8488-c3e6c6700bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.576701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1cbe8-7fe1-4db6-8488-c3e6c6700bbb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.598693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1982/3944] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:18.599837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1cbe8-7fe1-4db6-8488-c3e6c6700bbb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.607031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74d25d-0916-41ff-b133-9f8d96f03a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be548f3d4ea4a9883b15a69b3ee6a00, user_id=c1228a82f58d4d69b9eff6ab06e91519, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.611166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74d25d-0916-41ff-b133-9f8d96f03a64 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.623887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1cbe8-7fe1-4db6-8488-c3e6c6700bbb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.634488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792cdd6-280e-4a08-b9ba-807681b6aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:18.636380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792cdd6-280e-4a08-b9ba-807681b6aaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.636380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792cdd6-280e-4a08-b9ba-807681b6aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.636593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792cdd6-280e-4a08-b9ba-807681b6aaa7 admin admin] PATH_INFO: `/v3/projects/c1570e453d9c446dac72d42a29ccf729/users/40dc33d5c81d43498a08d008e46f0501/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.640095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792cdd6-280e-4a08-b9ba-807681b6aaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1570e453d9c446dac72d42a29ccf729, user_id=40dc33d5c81d43498a08d008e46f0501, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:18.642898 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1963/3945] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:18 2022] PUT /identity/v3/projects/6be548f3d4ea4a9883b15a69b3ee6a00/users/c1228a82f58d4d69b9eff6ab06e91519/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:18.643819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792cdd6-280e-4a08-b9ba-807681b6aaa7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:18.645531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d25d-0916-41ff-b133-9f8d96f03a64 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:18.691652 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1983/3946] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:18 2022] PUT /identity/v3/projects/c1570e453d9c446dac72d42a29ccf729/users/40dc33d5c81d43498a08d008e46f0501/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:18.713034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a918-2792-478d-bff4-f51cac9186ad None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.713327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a918-2792-478d-bff4-f51cac9186ad None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.713609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a918-2792-478d-bff4-f51cac9186ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:18.787329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a790a918-2792-478d-bff4-f51cac9186ad None None] MFA Rules not processed for user `c1228a82f58d4d69b9eff6ab06e91519`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:18.788605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a790a918-2792-478d-bff4-f51cac9186ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:18.876214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d25d-0916-41ff-b133-9f8d96f03a64 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:18.969782 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1984/3947] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:18.971195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f20fa-3912-4953-8d32-8aa04c00c33f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:18.975450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f20fa-3912-4953-8d32-8aa04c00c33f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:18.975884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f20fa-3912-4953-8d32-8aa04c00c33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:19.067056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ba6f20fa-3912-4953-8d32-8aa04c00c33f None None] MFA Rules not processed for user `40dc33d5c81d43498a08d008e46f0501`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:19.073634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ba6f20fa-3912-4953-8d32-8aa04c00c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:19.092610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:19.093851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:19.094445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:19.094952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] PATH_INFO: `/v3/projects/a72053a62e744590945ce7fd8a1f33ae/users/7e219f40a5174a76a7ae73622dafbbd9/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:19.123920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72053a62e744590945ce7fd8a1f33ae, user_id=7e219f40a5174a76a7ae73622dafbbd9, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:19.126974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:19.150158 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1964/3948] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:18 2022] PUT /identity/v3/projects/a72053a62e744590945ce7fd8a1f33ae/users/7e219f40a5174a76a7ae73622dafbbd9/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:19.151298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:19.156946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:19.393099 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1985/3949] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:19.395792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35bdc-969e-4ac4-83b3-aec1b238f353 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:19.397412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e3f4-4126-41c9-b823-88e7a4dc2369 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:19.398623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35bdc-969e-4ac4-83b3-aec1b238f353 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:19.398623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35bdc-969e-4ac4-83b3-aec1b238f353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:19.407729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30e147-4280-45b1-bfe1-f61fa82d4802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:19.408844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30e147-4280-45b1-bfe1-f61fa82d4802 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:19.408982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30e147-4280-45b1-bfe1-f61fa82d4802 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:19.409180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30e147-4280-45b1-bfe1-f61fa82d4802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:19.443000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5ec35bdc-969e-4ac4-83b3-aec1b238f353 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:19.444855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5ec35bdc-969e-4ac4-83b3-aec1b238f353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:19.524622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30e147-4280-45b1-bfe1-f61fa82d4802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:19.526094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30e147-4280-45b1-bfe1-f61fa82d4802 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:19.546487 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1965/3950] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:19.547313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30e147-4280-45b1-bfe1-f61fa82d4802 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:19.586985 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1986/3951] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:19.641725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec35bdc-969e-4ac4-83b3-aec1b238f353 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:19.658819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec35bdc-969e-4ac4-83b3-aec1b238f353 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:19.673435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f589b-3a03-479e-8454-86b36c8c6d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:19.674117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f589b-3a03-479e-8454-86b36c8c6d19 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:19.674399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f589b-3a03-479e-8454-86b36c8c6d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:19.674675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f589b-3a03-479e-8454-86b36c8c6d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:19.701939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f589b-3a03-479e-8454-86b36c8c6d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:19.704502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f589b-3a03-479e-8454-86b36c8c6d19 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:19.717522 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1987/3952] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:19.719409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00909-9eb7-47f3-88a2-06ab5077d89a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:19.719728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00909-9eb7-47f3-88a2-06ab5077d89a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:19.720138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00909-9eb7-47f3-88a2-06ab5077d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:19.724293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30e147-4280-45b1-bfe1-f61fa82d4802 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:19.731124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6187c37-bbd9-40cb-acb0-1c8ba8e02078 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:19.732995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6187c37-bbd9-40cb-acb0-1c8ba8e02078 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:19.733615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6187c37-bbd9-40cb-acb0-1c8ba8e02078 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:19.734144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6187c37-bbd9-40cb-acb0-1c8ba8e02078 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:19.735132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6187c37-bbd9-40cb-acb0-1c8ba8e02078 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:19.737422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6187c37-bbd9-40cb-acb0-1c8ba8e02078 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:19.756264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e6a00909-9eb7-47f3-88a2-06ab5077d89a None None] MFA Rules not processed for user `05c4b9473d5f4c14a04a9935db78eaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:19.758575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e6a00909-9eb7-47f3-88a2-06ab5077d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:19.766889 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1966/3953] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:00:19 2022] POST /identity/v3/domains => generated 276 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:19.768464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6187c37-bbd9-40cb-acb0-1c8ba8e02078 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:19.845878 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1988/3954] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:19.903574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6187c37-bbd9-40cb-acb0-1c8ba8e02078 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:19.913694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:19.914625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:19.915224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:19.915604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:19.918308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:19.919606 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:19.919606 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:19.919606 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:19.923864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:19.977809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1967/3955] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:19 2022] POST /identity/v3/groups => generated 281 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:19.978776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a00909-9eb7-47f3-88a2-06ab5077d89a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:19.995440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a00909-9eb7-47f3-88a2-06ab5077d89a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:20.008831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:20.010244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:20.010478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:20.010956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/c9acea0f7deb4c5f86266033b9ec19d2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:20.024931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:update_group(group_id=c9acea0f7deb4c5f86266033b9ec19d2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:20.025978 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:20.025978 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:20.025978 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:20.027177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:20.066136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:20.069120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:20.077075 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1989/3956] 10.222.0.30 () {60 vars in 1246 bytes} [Sat Feb 19 21:00:19 2022] PATCH /identity/v3/groups/c9acea0f7deb4c5f86266033b9ec19d2 => generated 292 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:20.080734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:20.103088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04623d6d-b020-4c0e-af4b-484acbb77b97 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:20.127344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e1c99-6740-4a27-83ed-06ea2e4f8720 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:20.128243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1c99-6740-4a27-83ed-06ea2e4f8720 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:20.128562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1c99-6740-4a27-83ed-06ea2e4f8720 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:20.128841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1c99-6740-4a27-83ed-06ea2e4f8720 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/c9acea0f7deb4c5f86266033b9ec19d2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:20.145191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e1c99-6740-4a27-83ed-06ea2e4f8720 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:get_group(group_id=c9acea0f7deb4c5f86266033b9ec19d2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:20.147156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e1c99-6740-4a27-83ed-06ea2e4f8720 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:20.153006 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1990/3957] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:20 2022] GET /identity/v3/groups/c9acea0f7deb4c5f86266033b9ec19d2 => generated 292 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:20.156743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e1c99-6740-4a27-83ed-06ea2e4f8720 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:20.184861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7a00a-20af-421f-9e98-4ac000e08760 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:20.189131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e1c99-6740-4a27-83ed-06ea2e4f8720 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:20.195560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581f33c-e3d4-4085-8750-319f1ab12c95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:20.196735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f33c-e3d4-4085-8750-319f1ab12c95 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:20.198057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f33c-e3d4-4085-8750-319f1ab12c95 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:20.201712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f33c-e3d4-4085-8750-319f1ab12c95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:20.207753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403ada5-4582-459a-91ed-dbd0773c4b5a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:20.208956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ada5-4582-459a-91ed-dbd0773c4b5a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:20.210023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ada5-4582-459a-91ed-dbd0773c4b5a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:20.210478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ada5-4582-459a-91ed-dbd0773c4b5a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/c9acea0f7deb4c5f86266033b9ec19d2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:20.214418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581f33c-e3d4-4085-8750-319f1ab12c95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:20.218361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581f33c-e3d4-4085-8750-319f1ab12c95 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:20.223744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403ada5-4582-459a-91ed-dbd0773c4b5a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:update_group(group_id=c9acea0f7deb4c5f86266033b9ec19d2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:20.231133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403ada5-4582-459a-91ed-dbd0773c4b5a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:20.254672 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1968/3958] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:00:20.295767 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1991/3959] 10.222.0.30 () {60 vars in 1245 bytes} [Sat Feb 19 21:00:20 2022] PATCH /identity/v3/groups/c9acea0f7deb4c5f86266033b9ec19d2 => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:20.302555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581f33c-e3d4-4085-8750-319f1ab12c95 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:20.328933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581f33c-e3d4-4085-8750-319f1ab12c95 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:20.342712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:20.345142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:20.345576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:20.346060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/c9acea0f7deb4c5f86266033b9ec19d2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:20.355042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c9acea0f7deb4c5f86266033b9ec19d2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:20.356675 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:20.356675 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:20.356675 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:20.358640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:20.506060 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1969/3960] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:00:20 2022] DELETE /identity/v3/groups/c9acea0f7deb4c5f86266033b9ec19d2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:20.511377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403ada5-4582-459a-91ed-dbd0773c4b5a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:20.528649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403ada5-4582-459a-91ed-dbd0773c4b5a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:20.744069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c764-bd73-40e5-895b-8136bff3b979 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:20.747095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c764-bd73-40e5-895b-8136bff3b979 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:20.748832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c764-bd73-40e5-895b-8136bff3b979 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:20.749373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c764-bd73-40e5-895b-8136bff3b979 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:20.752807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64c764-bd73-40e5-895b-8136bff3b979 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:20.756677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64c764-bd73-40e5-895b-8136bff3b979 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:20.806195 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1992/3961] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:20 2022] POST /identity/v3/groups => generated 326 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:20.812895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:20.837384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9998074-d6be-4054-8e0a-c0d1f4196cc4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:20.853487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733e54-0126-4f67-b0f5-4fa61422fd78 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:20.856551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733e54-0126-4f67-b0f5-4fa61422fd78 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:20.856932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733e54-0126-4f67-b0f5-4fa61422fd78 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:20.860133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733e54-0126-4f67-b0f5-4fa61422fd78 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:20.860998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733e54-0126-4f67-b0f5-4fa61422fd78 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:20.864983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733e54-0126-4f67-b0f5-4fa61422fd78 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:20.943811 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1970/3962] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:20 2022] POST /identity/v3/users => generated 323 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:20.945445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c764-bd73-40e5-895b-8136bff3b979 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:20.965174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c764-bd73-40e5-895b-8136bff3b979 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:20.979988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4e976-a595-4252-87eb-81b227269d75 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:20.983308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4e976-a595-4252-87eb-81b227269d75 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:20.983884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4e976-a595-4252-87eb-81b227269d75 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:20.984364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4e976-a595-4252-87eb-81b227269d75 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/7bf78fe3fd394e1da80c6e20fec78451` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:21.055833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4e976-a595-4252-87eb-81b227269d75 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=7bf78fe3fd394e1da80c6e20fec78451)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:21.057267 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-2cf4e976-a595-4252-87eb-81b227269d75 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:21.057267 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:21.057267 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:21.059206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4e976-a595-4252-87eb-81b227269d75 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:21.120620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1993/3963] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Feb 19 21:00:20 2022] PUT /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/7bf78fe3fd394e1da80c6e20fec78451 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:21.124733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733e54-0126-4f67-b0f5-4fa61422fd78 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:21.150378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733e54-0126-4f67-b0f5-4fa61422fd78 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:21.297742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6bc6d-2cec-45e0-b21d-4a065cebd725 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:21.298028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6bc6d-2cec-45e0-b21d-4a065cebd725 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:21.298335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6bc6d-2cec-45e0-b21d-4a065cebd725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:21.349209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18528d-07a4-428b-a039-ba13828f2219 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:21.350238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18528d-07a4-428b-a039-ba13828f2219 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:21.354349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18528d-07a4-428b-a039-ba13828f2219 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:21.355896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18528d-07a4-428b-a039-ba13828f2219 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:21.357135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18528d-07a4-428b-a039-ba13828f2219 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:21.361659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18528d-07a4-428b-a039-ba13828f2219 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:21.369685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a8e6bc6d-2cec-45e0-b21d-4a065cebd725 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:21.379134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a8e6bc6d-2cec-45e0-b21d-4a065cebd725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:21.499257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1971/3964] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:21 2022] POST /identity/v3/users => generated 323 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:21.504012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18528d-07a4-428b-a039-ba13828f2219 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:21.588175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18528d-07a4-428b-a039-ba13828f2219 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:21.614645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:21.615733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:21.616117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:21.616578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/963111031e91416994124404133a005c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:21.684217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=963111031e91416994124404133a005c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:21.687674 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:21.687674 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:21.687674 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:21.690737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:21.691166 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1994/3965] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:00:21.711532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6bc6d-2cec-45e0-b21d-4a065cebd725 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:21.714018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a8e6bc6d-2cec-45e0-b21d-4a065cebd725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:21.832034 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1972/3966] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Feb 19 21:00:21 2022] PUT /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/963111031e91416994124404133a005c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:21.839562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:22.045699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6bc6d-2cec-45e0-b21d-4a065cebd725 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:22.103840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37be4-1a5f-48de-9d60-188d25116ba4 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:22.124733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a45cde-462c-43e8-9cd6-a05caf4b83db tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:22.125477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a45cde-462c-43e8-9cd6-a05caf4b83db tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:22.125770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a45cde-462c-43e8-9cd6-a05caf4b83db tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:22.127241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a45cde-462c-43e8-9cd6-a05caf4b83db tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:22.127984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a45cde-462c-43e8-9cd6-a05caf4b83db tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:22.133887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a45cde-462c-43e8-9cd6-a05caf4b83db tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:22.220442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a917e2f-8bf9-4352-a90b-a9d8fa792492 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:22.222069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a917e2f-8bf9-4352-a90b-a9d8fa792492 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:22.222358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a917e2f-8bf9-4352-a90b-a9d8fa792492 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:22.223935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a917e2f-8bf9-4352-a90b-a9d8fa792492 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:22.244541 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1973/3967] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:21 2022] POST /identity/v3/users => generated 321 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:22.246153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e83f0c-cc60-4269-9e9d-535927275115 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:22.246448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e83f0c-cc60-4269-9e9d-535927275115 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:22.246747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e83f0c-cc60-4269-9e9d-535927275115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:22.357193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-87e83f0c-cc60-4269-9e9d-535927275115 None None] MFA Rules not processed for user `fad7207822c04fc289709200d7e2bd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:22.359800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-87e83f0c-cc60-4269-9e9d-535927275115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:22.391006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a917e2f-8bf9-4352-a90b-a9d8fa792492 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:22.395275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a917e2f-8bf9-4352-a90b-a9d8fa792492 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:22.460983 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1995/3968] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:00:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:00:22.464291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a917e2f-8bf9-4352-a90b-a9d8fa792492 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:22.525821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a917e2f-8bf9-4352-a90b-a9d8fa792492 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:22.531600 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1974/3969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:22.549062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64719-6f4d-442a-ab44-6d1a6407cb7a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:22.551042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64719-6f4d-442a-ab44-6d1a6407cb7a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:22.553017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64719-6f4d-442a-ab44-6d1a6407cb7a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:22.553375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64719-6f4d-442a-ab44-6d1a6407cb7a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/e1a92cc327b64986980fd11d606b2494` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:22.605518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa64719-6f4d-442a-ab44-6d1a6407cb7a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=e1a92cc327b64986980fd11d606b2494)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:22.689402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa64719-6f4d-442a-ab44-6d1a6407cb7a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:22.689402 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1996/3970] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Feb 19 21:00:22 2022] PUT /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/e1a92cc327b64986980fd11d606b2494 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:22.689607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e83f0c-cc60-4269-9e9d-535927275115 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:22.741826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e83f0c-cc60-4269-9e9d-535927275115 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:22.942456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:22.943506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:22.943795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:22.944230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:22.947570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=6eff591f205a43989834c19bb724fdd7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:22.948864 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:22.948864 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:22.948864 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:22.950071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:23.001602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64719-6f4d-442a-ab44-6d1a6407cb7a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:23.015324 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1975/3971] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:00:22 2022] GET /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users => generated 1083 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:23.019324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64719-6f4d-442a-ab44-6d1a6407cb7a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:23.045350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:23.046434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:23.046721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:23.047145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/7bf78fe3fd394e1da80c6e20fec78451` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:23.055303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=7bf78fe3fd394e1da80c6e20fec78451)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:23.056544 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:23.056544 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:23.056544 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:23.057912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:23.116677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1997/3972] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Feb 19 21:00:23 2022] HEAD /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/7bf78fe3fd394e1da80c6e20fec78451 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:23.119873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:23.135555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e6e61-d720-4a40-81de-4c7d63d7f7a5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:23.150620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:23.151721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:23.152151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:23.152665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/7bf78fe3fd394e1da80c6e20fec78451` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:23.165393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=7bf78fe3fd394e1da80c6e20fec78451)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:23.166966 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:23.166966 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:23.166966 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:23.168514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:23.196933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7bf78fe3fd394e1da80c6e20fec78451'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:23.245624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1976/3973] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Feb 19 21:00:23 2022] DELETE /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/7bf78fe3fd394e1da80c6e20fec78451 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:23.249868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:23.277949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4f27-bc28-4450-917f-78598f71d8c6 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:23.596623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fadc1-2e3b-4c11-bdb5-b5c17d03cc04 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:23.599593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fadc1-2e3b-4c11-bdb5-b5c17d03cc04 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:23.600070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fadc1-2e3b-4c11-bdb5-b5c17d03cc04 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:23.600582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fadc1-2e3b-4c11-bdb5-b5c17d03cc04 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/963111031e91416994124404133a005c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:23.602587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fadc1-2e3b-4c11-bdb5-b5c17d03cc04 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=963111031e91416994124404133a005c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:23.605173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fadc1-2e3b-4c11-bdb5-b5c17d03cc04 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:23.627978 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1998/3974] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Feb 19 21:00:23 2022] HEAD /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/963111031e91416994124404133a005c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:23.629356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:23.667748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b984d9-58cc-4b7d-86ae-a9e45dd6a419 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:23.693119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7301998-7b60-456d-98d4-ad0b92721f9a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:23.708040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301998-7b60-456d-98d4-ad0b92721f9a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:23.708475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301998-7b60-456d-98d4-ad0b92721f9a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:23.708838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301998-7b60-456d-98d4-ad0b92721f9a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/963111031e91416994124404133a005c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:23.710919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7301998-7b60-456d-98d4-ad0b92721f9a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=963111031e91416994124404133a005c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:23.713006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7301998-7b60-456d-98d4-ad0b92721f9a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:23.759577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7301998-7b60-456d-98d4-ad0b92721f9a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '963111031e91416994124404133a005c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:23.794088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fadc1-2e3b-4c11-bdb5-b5c17d03cc04 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:23.798833 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1977/3975] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Feb 19 21:00:23 2022] DELETE /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/963111031e91416994124404133a005c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:23.912125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fadc1-2e3b-4c11-bdb5-b5c17d03cc04 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:24.121663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42b982-95db-45c4-aa2e-6727cd5990ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:24.122619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42b982-95db-45c4-aa2e-6727cd5990ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:24.122982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42b982-95db-45c4-aa2e-6727cd5990ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:24.123266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42b982-95db-45c4-aa2e-6727cd5990ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/e1a92cc327b64986980fd11d606b2494` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:24.133730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42b982-95db-45c4-aa2e-6727cd5990ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=e1a92cc327b64986980fd11d606b2494)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:24.139238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42b982-95db-45c4-aa2e-6727cd5990ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:24.184861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87433-eb2b-40d0-9ec5-0ff8b458d431 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:24.185391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87433-eb2b-40d0-9ec5-0ff8b458d431 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:24.185605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87433-eb2b-40d0-9ec5-0ff8b458d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:24.202598 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 1999/3976] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Feb 19 21:00:23 2022] HEAD /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/e1a92cc327b64986980fd11d606b2494 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:24.211186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42b982-95db-45c4-aa2e-6727cd5990ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:24.252445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42b982-95db-45c4-aa2e-6727cd5990ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:24.286039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:24.287182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:24.287606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:24.288048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users/e1a92cc327b64986980fd11d606b2494` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:24.291884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6eff591f205a43989834c19bb724fdd7, user_id=e1a92cc327b64986980fd11d606b2494)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:24.293193 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:24.293193 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:24.293193 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:24.296412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:24.313297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9be87433-eb2b-40d0-9ec5-0ff8b458d431 None None] MFA Rules not processed for user `7e219f40a5174a76a7ae73622dafbbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:24.315483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9be87433-eb2b-40d0-9ec5-0ff8b458d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:24.319144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e1a92cc327b64986980fd11d606b2494'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:24.363076 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2000/3977] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Feb 19 21:00:24 2022] DELETE /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users/e1a92cc327b64986980fd11d606b2494 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:24.368717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:24.604859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1978/3978] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:00:24.605950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be87433-eb2b-40d0-9ec5-0ff8b458d431 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:24.621213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9be87433-eb2b-40d0-9ec5-0ff8b458d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:24.629103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976c69-9f1f-40ee-a713-2bf08711e1d5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:24.654600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa1339-6103-434e-a0bd-9f9961654ebc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:24.655807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1339-6103-434e-a0bd-9f9961654ebc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:24.657343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1339-6103-434e-a0bd-9f9961654ebc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:24.659358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1339-6103-434e-a0bd-9f9961654ebc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:24.666245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa1339-6103-434e-a0bd-9f9961654ebc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=6eff591f205a43989834c19bb724fdd7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:24.668949 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-93aa1339-6103-434e-a0bd-9f9961654ebc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:24.668949 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:24.668949 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:24.673666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa1339-6103-434e-a0bd-9f9961654ebc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:24.722717 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2001/3979] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:00:24 2022] GET /identity/v3/groups/6eff591f205a43989834c19bb724fdd7/users => generated 145 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:00:24.724558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f1df5-ac81-4b05-b91c-79416ce741cd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:24.728447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f1df5-ac81-4b05-b91c-79416ce741cd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:24.728447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f1df5-ac81-4b05-b91c-79416ce741cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:24.769621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b72f1df5-ac81-4b05-b91c-79416ce741cd None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:24.773471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b72f1df5-ac81-4b05-b91c-79416ce741cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:24.875759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be87433-eb2b-40d0-9ec5-0ff8b458d431 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:24.922204 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2002/3980] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:24.924643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b2d56-6fa8-4dd3-9538-1e5129b9f9c9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:24.925108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b2d56-6fa8-4dd3-9538-1e5129b9f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:24.925486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b2d56-6fa8-4dd3-9538-1e5129b9f9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:24.971777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ec1b2d56-6fa8-4dd3-9538-1e5129b9f9c9 None None] MFA Rules not processed for user `7e219f40a5174a76a7ae73622dafbbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:24.974300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec1b2d56-6fa8-4dd3-9538-1e5129b9f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:25.016867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:25.017540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:25.017825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:25.018103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:25.032708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:25.095583 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2003/3981] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:25.096629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b2d56-6fa8-4dd3-9538-1e5129b9f9c9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:25.110566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b2d56-6fa8-4dd3-9538-1e5129b9f9c9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:25.121812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:25.123016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:25.123475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:25.123899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users/e1a92cc327b64986980fd11d606b2494` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:25.126068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1a92cc327b64986980fd11d606b2494)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:25.129348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:25.218603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a92cc327b64986980fd11d606b2494'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.256921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:25.258369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a92cc327b64986980fd11d606b2494'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.259809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:25.287162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a92cc327b64986980fd11d606b2494'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.288301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a92cc327b64986980fd11d606b2494'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.289644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a92cc327b64986980fd11d606b2494'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.290282 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1979/3982] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:25.291226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:25.313011 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2004/3983] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:25 2022] DELETE /identity/v3/users/e1a92cc327b64986980fd11d606b2494 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:25.315357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:25.318667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:25.400133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2e16-ef89-49ac-9f64-0c9f5d52c954 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:25.492705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44731f-fae0-46ea-ae8e-3dadd4247f61 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:25.496394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:25.497418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:25.498907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:25.499416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:25.501844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:25.504844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:25.506263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:25.506263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:25.506263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users/963111031e91416994124404133a005c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:25.512496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=963111031e91416994124404133a005c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:25.514519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:25.598157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:25.604965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:25.617227 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1980/3984] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:00:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:25.618543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963111031e91416994124404133a005c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.644205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963111031e91416994124404133a005c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.683863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963111031e91416994124404133a005c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.686036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963111031e91416994124404133a005c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.686858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963111031e91416994124404133a005c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:25.762079 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2005/3985] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:25 2022] DELETE /identity/v3/users/963111031e91416994124404133a005c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:25.766266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:25.789863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e934ea-2874-4c4b-8571-e447e870925f service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:25.917403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:25.918317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:25.918604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:25.918908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users/7bf78fe3fd394e1da80c6e20fec78451` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:25.920559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7bf78fe3fd394e1da80c6e20fec78451)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:25.922841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:26.039789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf78fe3fd394e1da80c6e20fec78451'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:26.040736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf78fe3fd394e1da80c6e20fec78451'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:26.041472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf78fe3fd394e1da80c6e20fec78451'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:26.074251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf78fe3fd394e1da80c6e20fec78451'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:26.094056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf78fe3fd394e1da80c6e20fec78451'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:26.126302 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1981/3986] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:25 2022] DELETE /identity/v3/users/7bf78fe3fd394e1da80c6e20fec78451 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:26.127556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:26.129169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:26.170862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22310bcc-7efb-4482-8445-6ee83203a4ba tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:26.305577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:26.307567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:26.308207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:26.308678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/6eff591f205a43989834c19bb724fdd7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:26.311909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6eff591f205a43989834c19bb724fdd7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:26.314475 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:26.314475 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:26.314475 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:26.317728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:26.426419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:26.429512 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2006/3987] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:00:26 2022] DELETE /identity/v3/groups/6eff591f205a43989834c19bb724fdd7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:26.430800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:26.508937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2252022-995e-41b1-ae3b-7abdcd625809 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:26.587876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16f560-acc4-47a3-960c-046fb874c8ef tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:26.588855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16f560-acc4-47a3-960c-046fb874c8ef tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:26.589283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16f560-acc4-47a3-960c-046fb874c8ef tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:26.589724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16f560-acc4-47a3-960c-046fb874c8ef tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:26.590569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16f560-acc4-47a3-960c-046fb874c8ef tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:26.593604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16f560-acc4-47a3-960c-046fb874c8ef tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:26.615203 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1982/3988] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:26 2022] POST /identity/v3/groups => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:26.620510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:26.633402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767493-b506-47f6-832d-6e79da7ca362 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:26.660796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05c2ee-ba78-4902-b702-140cef472ae3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:26.661496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05c2ee-ba78-4902-b702-140cef472ae3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:26.664707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05c2ee-ba78-4902-b702-140cef472ae3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:26.665171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05c2ee-ba78-4902-b702-140cef472ae3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:26.666033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05c2ee-ba78-4902-b702-140cef472ae3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:26.668137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05c2ee-ba78-4902-b702-140cef472ae3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:26.709898 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2007/3989] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:26 2022] POST /identity/v3/groups => generated 327 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:26.710623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16f560-acc4-47a3-960c-046fb874c8ef tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:26.722623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16f560-acc4-47a3-960c-046fb874c8ef tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:26.731787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06ae02-55c0-4f56-ad8b-fab922fb31ce tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:26.733687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae02-55c0-4f56-ad8b-fab922fb31ce tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:26.737462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae02-55c0-4f56-ad8b-fab922fb31ce tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:26.738545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae02-55c0-4f56-ad8b-fab922fb31ce tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:26.740234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06ae02-55c0-4f56-ad8b-fab922fb31ce tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:26.746210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06ae02-55c0-4f56-ad8b-fab922fb31ce tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:26.784187 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1983/3990] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:26 2022] POST /identity/v3/groups => generated 327 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:00:26.789047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05c2ee-ba78-4902-b702-140cef472ae3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:26.816130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05c2ee-ba78-4902-b702-140cef472ae3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:26.823978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:26.825117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:26.825451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:26.825808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:26.827379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:26.829372 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:26.829372 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:26.829372 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:26.831271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:26.843718 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2008/3991] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 21:00:26 2022] GET /identity/v3/groups => generated 1491 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:26.848232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06ae02-55c0-4f56-ad8b-fab922fb31ce tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:26.866220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:26.869359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06ae02-55c0-4f56-ad8b-fab922fb31ce tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:26.869870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:26.880473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e44f1-4aaa-402e-b7ee-02fe42fe08ac tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:26.884213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e44f1-4aaa-402e-b7ee-02fe42fe08ac tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:26.887674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e44f1-4aaa-402e-b7ee-02fe42fe08ac tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:26.888514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e44f1-4aaa-402e-b7ee-02fe42fe08ac tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/3470660fc2ec463aa69b31be861bd675` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:26.896186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e44f1-4aaa-402e-b7ee-02fe42fe08ac tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3470660fc2ec463aa69b31be861bd675)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:26.898861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e44f1-4aaa-402e-b7ee-02fe42fe08ac tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:27.011935 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1984/3992] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:00:26 2022] DELETE /identity/v3/groups/3470660fc2ec463aa69b31be861bd675 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:27.018389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e44f1-4aaa-402e-b7ee-02fe42fe08ac tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:27.052473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95200714-0624-4b6c-ba74-50ef821ed30a tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:27.179168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e44f1-4aaa-402e-b7ee-02fe42fe08ac tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:27.179342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:27.179990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:27.180467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:27.181090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:27.186879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:27.203519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64dc62-6b6a-43fd-9118-89b3d6f23ed0 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:27.204438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64dc62-6b6a-43fd-9118-89b3d6f23ed0 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:27.204723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64dc62-6b6a-43fd-9118-89b3d6f23ed0 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:27.205001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64dc62-6b6a-43fd-9118-89b3d6f23ed0 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/de9ec5afdb774e1ebd7b6bbdb01d7ee1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:27.218237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64dc62-6b6a-43fd-9118-89b3d6f23ed0 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=de9ec5afdb774e1ebd7b6bbdb01d7ee1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:27.223938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64dc62-6b6a-43fd-9118-89b3d6f23ed0 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:27.317311 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1985/3993] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:00:27 2022] DELETE /identity/v3/groups/de9ec5afdb774e1ebd7b6bbdb01d7ee1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:27.322100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64dc62-6b6a-43fd-9118-89b3d6f23ed0 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:27.350631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:27.353000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:27.369650 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2009/3994] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:27.448693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64dc62-6b6a-43fd-9118-89b3d6f23ed0 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:27.456147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10db80-c13f-4274-8287-573813d56ba5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:27.457250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10db80-c13f-4274-8287-573813d56ba5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:27.457539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10db80-c13f-4274-8287-573813d56ba5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:27.457855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10db80-c13f-4274-8287-573813d56ba5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/d11ad8c3254b470ebc986b6278d16ddf` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:27.464157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10db80-c13f-4274-8287-573813d56ba5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d11ad8c3254b470ebc986b6278d16ddf)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:27.466903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10db80-c13f-4274-8287-573813d56ba5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:27.544254 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1986/3995] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:00:27 2022] DELETE /identity/v3/groups/d11ad8c3254b470ebc986b6278d16ddf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:27.550977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:27.564254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431fcc-be82-4aa2-a174-1c9cab59da4c service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:27.660919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fa11a-c280-4d3a-865a-808ade9babf3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:27.661615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fa11a-c280-4d3a-865a-808ade9babf3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:27.662194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fa11a-c280-4d3a-865a-808ade9babf3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:27.662492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fa11a-c280-4d3a-865a-808ade9babf3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:27.663200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fa11a-c280-4d3a-865a-808ade9babf3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:27.666954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fa11a-c280-4d3a-865a-808ade9babf3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:27.703740 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2010/3996] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:27 2022] POST /identity/v3/users => generated 321 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:27.704602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10db80-c13f-4274-8287-573813d56ba5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:27.720026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10db80-c13f-4274-8287-573813d56ba5 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:27.734619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:27.735302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:27.735587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:27.735861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:27.736599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:27.738673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:27.771070 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1987/3997] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:27 2022] POST /identity/v3/groups => generated 326 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:00:27.775529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fa11a-c280-4d3a-865a-808ade9babf3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:27.786515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fa11a-c280-4d3a-865a-808ade9babf3 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:27.804477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dedac1-2333-433c-851f-d429075f07df tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:27.805396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dedac1-2333-433c-851f-d429075f07df tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:27.805879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dedac1-2333-433c-851f-d429075f07df tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:27.806166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dedac1-2333-433c-851f-d429075f07df tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/8d587b643bba44e2b2b423a143f31070/users/3b0db27d84934d739c2ebbcd754ece80` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:27.852233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dedac1-2333-433c-851f-d429075f07df tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8d587b643bba44e2b2b423a143f31070, user_id=3b0db27d84934d739c2ebbcd754ece80)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:27.854420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dedac1-2333-433c-851f-d429075f07df tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:27.897488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:27.904911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:27.914029 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2011/3998] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Feb 19 21:00:27 2022] PUT /identity/v3/groups/8d587b643bba44e2b2b423a143f31070/users/3b0db27d84934d739c2ebbcd754ece80 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:27.914676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dedac1-2333-433c-851f-d429075f07df tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:28.023045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd0935-9d5e-4c2c-bb47-9ebd555dc0bc tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:28.074497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dedac1-2333-433c-851f-d429075f07df tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:28.082181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:28.087570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:28.087866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:28.088154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:28.089501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:28.091195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:28.137382 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2012/3999] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:27 2022] POST /identity/v3/groups => generated 327 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:28.141392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:28.148257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:28.220012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:28.220804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:28.221092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:28.221372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:28.223630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:28.320422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12321-331b-4b16-a3cc-ecab8186967b tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:28.330399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:28.331409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:28.331820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:28.333466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:28.339218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:28.347269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:28.349725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:28.367979 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1988/4000] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:28.368924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:28.382134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:28.383951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:28.388955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57dd5e-3449-43f9-a43d-b0d80dddac4e service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:28.397626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb3f0c-7a68-4fb5-9b10-c4d7b27007fd tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:28.399118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3f0c-7a68-4fb5-9b10-c4d7b27007fd tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:28.399118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3f0c-7a68-4fb5-9b10-c4d7b27007fd tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:28.399118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3f0c-7a68-4fb5-9b10-c4d7b27007fd tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/08d260fb8d0249e1ab9a763c2ab2cd78/users/3b0db27d84934d739c2ebbcd754ece80` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:28.404965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2013/4001] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:28.413562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb3f0c-7a68-4fb5-9b10-c4d7b27007fd tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=08d260fb8d0249e1ab9a763c2ab2cd78, user_id=3b0db27d84934d739c2ebbcd754ece80)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:28.432608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb3f0c-7a68-4fb5-9b10-c4d7b27007fd tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:28.520563 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1989/4002] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Feb 19 21:00:28 2022] PUT /identity/v3/groups/08d260fb8d0249e1ab9a763c2ab2cd78/users/3b0db27d84934d739c2ebbcd754ece80 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:28.521126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:28.537636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa855-2143-4f33-8f00-d608cd982d37 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:28.625200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc4bd6-37c1-4e49-8bbb-cbd964e183d1 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:28.626225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc4bd6-37c1-4e49-8bbb-cbd964e183d1 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:28.626513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc4bd6-37c1-4e49-8bbb-cbd964e183d1 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:28.626833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc4bd6-37c1-4e49-8bbb-cbd964e183d1 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users/3b0db27d84934d739c2ebbcd754ece80/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:28.628318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc4bd6-37c1-4e49-8bbb-cbd964e183d1 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=3b0db27d84934d739c2ebbcd754ece80)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:28.630857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc4bd6-37c1-4e49-8bbb-cbd964e183d1 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:28.652534 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2014/4003] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:00:28 2022] GET /identity/v3/users/3b0db27d84934d739c2ebbcd754ece80/groups => generated 839 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:28.654157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb3f0c-7a68-4fb5-9b10-c4d7b27007fd tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:28.697016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb3f0c-7a68-4fb5-9b10-c4d7b27007fd tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:28.724856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c5d41-42a5-4b52-b7ef-36aac72e35d9 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:28.726081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5d41-42a5-4b52-b7ef-36aac72e35d9 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:28.726572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5d41-42a5-4b52-b7ef-36aac72e35d9 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:28.727076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5d41-42a5-4b52-b7ef-36aac72e35d9 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/08d260fb8d0249e1ab9a763c2ab2cd78` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:28.728745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c5d41-42a5-4b52-b7ef-36aac72e35d9 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=08d260fb8d0249e1ab9a763c2ab2cd78)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:28.731065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c5d41-42a5-4b52-b7ef-36aac72e35d9 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:28.818985 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1990/4004] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:00:28 2022] DELETE /identity/v3/groups/08d260fb8d0249e1ab9a763c2ab2cd78 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:28.820458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc4bd6-37c1-4e49-8bbb-cbd964e183d1 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:28.837625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc4bd6-37c1-4e49-8bbb-cbd964e183d1 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:28.911011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28edc-d54a-4c96-97f4-d09ebe0c70bf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:28.912273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28edc-d54a-4c96-97f4-d09ebe0c70bf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:28.912773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28edc-d54a-4c96-97f4-d09ebe0c70bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:28.949795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57996d-71a5-4485-80e5-0593987462c7 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:28.950136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-46d28edc-d54a-4c96-97f4-d09ebe0c70bf None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:28.951849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57996d-71a5-4485-80e5-0593987462c7 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:28.952162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57996d-71a5-4485-80e5-0593987462c7 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:28.952508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57996d-71a5-4485-80e5-0593987462c7 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/groups/8d587b643bba44e2b2b423a143f31070` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:28.952798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-46d28edc-d54a-4c96-97f4-d09ebe0c70bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:28.954140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57996d-71a5-4485-80e5-0593987462c7 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8d587b643bba44e2b2b423a143f31070)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:28.956251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57996d-71a5-4485-80e5-0593987462c7 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:29.035086 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2015/4005] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:00:28 2022] DELETE /identity/v3/groups/8d587b643bba44e2b2b423a143f31070 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:29.043394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57996d-71a5-4485-80e5-0593987462c7 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:29.121651 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1991/4006] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:00:29.122997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28edc-d54a-4c96-97f4-d09ebe0c70bf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:29.124887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-46d28edc-d54a-4c96-97f4-d09ebe0c70bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:29.163045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57996d-71a5-4485-80e5-0593987462c7 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:29.177215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:29.179200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:29.179555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:29.179887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/users/3b0db27d84934d739c2ebbcd754ece80` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:29.183023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3b0db27d84934d739c2ebbcd754ece80)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:29.186796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:29.307945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0db27d84934d739c2ebbcd754ece80'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.329132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28edc-d54a-4c96-97f4-d09ebe0c70bf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:29.343621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0db27d84934d739c2ebbcd754ece80'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.373110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0db27d84934d739c2ebbcd754ece80'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.374323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0db27d84934d739c2ebbcd754ece80'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.375401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0db27d84934d739c2ebbcd754ece80'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.433602 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2016/4007] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:29 2022] DELETE /identity/v3/users/3b0db27d84934d739c2ebbcd754ece80 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:29.436530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:29.443386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:29.518127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:29.518894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:29.519092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:29.519374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:29.521808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:29.575634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d86d5-98fb-4946-b014-10b02147044c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:29.586661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:29.599188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:29.604706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:29.605201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/domains/abad59ec83cd4524bda4593716d195d0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:29.615925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=abad59ec83cd4524bda4593716d195d0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:29.622127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:29.667350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'abad59ec83cd4524bda4593716d195d0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.668437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'abad59ec83cd4524bda4593716d195d0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.678252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:29.680116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:29.710267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'abad59ec83cd4524bda4593716d195d0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.711185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'abad59ec83cd4524bda4593716d195d0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.717734 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1992/4008] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:00:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:29.718232 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2017/4009] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:00:29 2022] PATCH /identity/v3/domains/abad59ec83cd4524bda4593716d195d0 => generated 277 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:29.718921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:29.734993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65350a75-a244-4ce0-b01a-482231ab6b35 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:29.820916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40dc33d5c81d43498a08d008e46f0501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1570e453d9c446dac72d42a29ccf729', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:29.821790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:29.822071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:29.822705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] PATH_INFO: `/v3/domains/abad59ec83cd4524bda4593716d195d0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:29.840799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=abad59ec83cd4524bda4593716d195d0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:29.842772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:29.891347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'abad59ec83cd4524bda4593716d195d0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.897498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'abad59ec83cd4524bda4593716d195d0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.987905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abad59ec83cd4524bda4593716d195d0', 'request_id': 'req-578ad1cb-3783-4203-9fa8-f0af587aab6c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:29.994509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abad59ec83cd4524bda4593716d195d0', 'request_id': 'req-578ad1cb-3783-4203-9fa8-f0af587aab6c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.024016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abad59ec83cd4524bda4593716d195d0', 'request_id': 'req-578ad1cb-3783-4203-9fa8-f0af587aab6c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.056017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] The token cache is being invalidate because project abad59ec83cd4524bda4593716d195d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:30.056873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.057784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.070963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'abad59ec83cd4524bda4593716d195d0', 'request_id': 'req-578ad1cb-3783-4203-9fa8-f0af587aab6c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.083359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'abad59ec83cd4524bda4593716d195d0', 'request_id': 'req-578ad1cb-3783-4203-9fa8-f0af587aab6c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.090698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-578ad1cb-3783-4203-9fa8-f0af587aab6c tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'abad59ec83cd4524bda4593716d195d0', 'request_id': 'req-578ad1cb-3783-4203-9fa8-f0af587aab6c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.104272 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1993/4010] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:00:29 2022] DELETE /identity/v3/domains/abad59ec83cd4524bda4593716d195d0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:30.107992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:30.109520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:30.299356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385540b4-b59d-4ed3-880c-30278c1ad759 tempest-GroupsV3TestJSON-1429821751 tempest-GroupsV3TestJSON-1429821751-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:30.557590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:30.558657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:30.558948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:30.559224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] PATH_INFO: `/v3/users/045f904e52cf49deb98ef9f7c3d79fa7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:30.565213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=045f904e52cf49deb98ef9f7c3d79fa7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:30.567195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:30.721151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045f904e52cf49deb98ef9f7c3d79fa7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.760606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045f904e52cf49deb98ef9f7c3d79fa7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.795698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045f904e52cf49deb98ef9f7c3d79fa7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.796368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045f904e52cf49deb98ef9f7c3d79fa7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.797160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045f904e52cf49deb98ef9f7c3d79fa7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:30.822009 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2018/4011] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:30 2022] DELETE /identity/v3/users/045f904e52cf49deb98ef9f7c3d79fa7 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:30.826391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d779f8-79a8-421f-a90e-08d9a181ca95 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:30.827193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d779f8-79a8-421f-a90e-08d9a181ca95 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:30.827622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d779f8-79a8-421f-a90e-08d9a181ca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:30.886723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d4d779f8-79a8-421f-a90e-08d9a181ca95 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:30.888191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d4d779f8-79a8-421f-a90e-08d9a181ca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:31.025147 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1994/4012] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:31.099542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:31.101082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:31.281082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48a1ed-d6da-4846-80e4-c2d3b67db15a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:31.304240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ebe4-2e2d-4d39-b3e9-6bdcbe193355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:31.308038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ebe4-2e2d-4d39-b3e9-6bdcbe193355 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:31.309829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ebe4-2e2d-4d39-b3e9-6bdcbe193355 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:31.310300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91ebe4-2e2d-4d39-b3e9-6bdcbe193355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:31.324007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91ebe4-2e2d-4d39-b3e9-6bdcbe193355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:31.325667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91ebe4-2e2d-4d39-b3e9-6bdcbe193355 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:31.345796 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2019/4013] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:32.722900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d779f8-79a8-421f-a90e-08d9a181ca95 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:32.724956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d4d779f8-79a8-421f-a90e-08d9a181ca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:32.751375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d779f8-79a8-421f-a90e-08d9a181ca95 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:32.762079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:32.763299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:32.763720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:32.765476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] PATH_INFO: `/v3/users/05c4b9473d5f4c14a04a9935db78eaa0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:32.768145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c4b9473d5f4c14a04a9935db78eaa0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:32.772744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:32.882372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c4b9473d5f4c14a04a9935db78eaa0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:32.884279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c4b9473d5f4c14a04a9935db78eaa0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:32.886634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c4b9473d5f4c14a04a9935db78eaa0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:32.921643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c4b9473d5f4c14a04a9935db78eaa0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:32.937442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c4b9473d5f4c14a04a9935db78eaa0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:32.961305 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1995/4014] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:32 2022] DELETE /identity/v3/users/05c4b9473d5f4c14a04a9935db78eaa0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:33.925821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ebe4-2e2d-4d39-b3e9-6bdcbe193355 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:33.939333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91ebe4-2e2d-4d39-b3e9-6bdcbe193355 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:33.975952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:33.978226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:34.072062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83241a9c-a420-41b2-8c61-70e3b03a7d6b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:34.080295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:34.082174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:34.083573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:34.084180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] PATH_INFO: `/v3/projects/bc97ce0e64714e67a35d1f012eb946cc` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:34.086270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc97ce0e64714e67a35d1f012eb946cc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:34.090430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:34.153683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:34.157697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:34.158116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:34.158439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] PATH_INFO: `/v3/projects/c38523e7590c48c484d9b778e4ac5308` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:34.171112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38523e7590c48c484d9b778e4ac5308)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:34.173461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:34.236594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc97ce0e64714e67a35d1f012eb946cc', 'request_id': 'req-524c977b-12a4-4234-99ae-542a132bd149'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.248263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc97ce0e64714e67a35d1f012eb946cc', 'request_id': 'req-524c977b-12a4-4234-99ae-542a132bd149'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.283406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc97ce0e64714e67a35d1f012eb946cc', 'request_id': 'req-524c977b-12a4-4234-99ae-542a132bd149'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.292785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38523e7590c48c484d9b778e4ac5308', 'request_id': 'req-543a8673-b2a1-4d3d-b703-a7da9efcd356'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.304221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38523e7590c48c484d9b778e4ac5308', 'request_id': 'req-543a8673-b2a1-4d3d-b703-a7da9efcd356'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.323725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] The token cache is being invalidate because project bc97ce0e64714e67a35d1f012eb946cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:34.323948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.325069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.326759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38523e7590c48c484d9b778e4ac5308', 'request_id': 'req-543a8673-b2a1-4d3d-b703-a7da9efcd356'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.328196 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1996/4015] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:33 2022] DELETE /identity/v3/projects/bc97ce0e64714e67a35d1f012eb946cc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:34.332386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:34.334096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:34.360142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] The token cache is being invalidate because project c38523e7590c48c484d9b778e4ac5308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:34.360660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.364044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-543a8673-b2a1-4d3d-b703-a7da9efcd356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.368805 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2020/4016] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:33 2022] DELETE /identity/v3/projects/c38523e7590c48c484d9b778e4ac5308 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:34.376319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760a9c-377b-43a6-8b97-9f6894e3431b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:34.378112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760a9c-377b-43a6-8b97-9f6894e3431b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:34.378808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760a9c-377b-43a6-8b97-9f6894e3431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:34.477457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e1760a9c-377b-43a6-8b97-9f6894e3431b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:34.482716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e1760a9c-377b-43a6-8b97-9f6894e3431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:34.512125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c977b-12a4-4234-99ae-542a132bd149 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:34.663107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:34.664188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:34.664572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:34.664916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] PATH_INFO: `/v3/users/40dc33d5c81d43498a08d008e46f0501` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:34.666246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40dc33d5c81d43498a08d008e46f0501)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:34.669008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:34.680892 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2021/4017] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:34.683413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627099-f0b6-407e-b3c1-a591f4b75080 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:34.683413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627099-f0b6-407e-b3c1-a591f4b75080 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:34.683831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627099-f0b6-407e-b3c1-a591f4b75080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:34.730306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-82627099-f0b6-407e-b3c1-a591f4b75080 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:34.730306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-82627099-f0b6-407e-b3c1-a591f4b75080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:34.749360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2022/4018] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:34.752172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82627099-f0b6-407e-b3c1-a591f4b75080 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:34.768390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40dc33d5c81d43498a08d008e46f0501'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.769282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40dc33d5c81d43498a08d008e46f0501'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.770132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40dc33d5c81d43498a08d008e46f0501'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.774552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82627099-f0b6-407e-b3c1-a591f4b75080 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:34.788672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40dc33d5c81d43498a08d008e46f0501'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.788972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:34.789676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:34.789965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:34.790244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:34.790989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:34.791304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:34.797163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:34.801252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40dc33d5c81d43498a08d008e46f0501'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:34.823538 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1997/4019] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:34 2022] DELETE /identity/v3/users/40dc33d5c81d43498a08d008e46f0501 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:34.832766 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2023/4020] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:34.839086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:34.842176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:34.990632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa15b4-da4c-4a75-9129-23c3eb33cf62 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:34.997532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87983a5d-390f-4106-95f5-0428105f0575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:34.999031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87983a5d-390f-4106-95f5-0428105f0575 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:34.999505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87983a5d-390f-4106-95f5-0428105f0575 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:35.000018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87983a5d-390f-4106-95f5-0428105f0575 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:35.000894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87983a5d-390f-4106-95f5-0428105f0575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:35.003899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87983a5d-390f-4106-95f5-0428105f0575 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:35.047008 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1998/4021] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:34 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:35.051034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:35.065740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d47a9-eb37-484e-a3c4-1143fb3b2d9c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:35.193086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8162bd-adfb-4eff-b4ab-e675ab0eb415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:35.196213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8162bd-adfb-4eff-b4ab-e675ab0eb415 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:35.197704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8162bd-adfb-4eff-b4ab-e675ab0eb415 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:35.198482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8162bd-adfb-4eff-b4ab-e675ab0eb415 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:35.199870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8162bd-adfb-4eff-b4ab-e675ab0eb415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:35.205513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8162bd-adfb-4eff-b4ab-e675ab0eb415 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:35.285766 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2024/4022] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:35 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:35.292467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87983a5d-390f-4106-95f5-0428105f0575 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:35.316657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87983a5d-390f-4106-95f5-0428105f0575 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:35.329466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a419b0-e216-4578-b324-3da248ca6286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:35.331294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a419b0-e216-4578-b324-3da248ca6286 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:35.332592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a419b0-e216-4578-b324-3da248ca6286 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:35.333717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a419b0-e216-4578-b324-3da248ca6286 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:35.335730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a419b0-e216-4578-b324-3da248ca6286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:35.340402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a419b0-e216-4578-b324-3da248ca6286 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:35.369038 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 1999/4023] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:35.370093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8162bd-adfb-4eff-b4ab-e675ab0eb415 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:35.389282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8162bd-adfb-4eff-b4ab-e675ab0eb415 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:35.402947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4a57f-5fa2-4982-84bb-5d4afe1c46b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:35.408530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a57f-5fa2-4982-84bb-5d4afe1c46b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:35.408994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a57f-5fa2-4982-84bb-5d4afe1c46b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:35.409551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a57f-5fa2-4982-84bb-5d4afe1c46b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:35.411542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4a57f-5fa2-4982-84bb-5d4afe1c46b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:35.418909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4a57f-5fa2-4982-84bb-5d4afe1c46b5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:35.438298 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2025/4024] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:35.438546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a419b0-e216-4578-b324-3da248ca6286 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:35.451163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a419b0-e216-4578-b324-3da248ca6286 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:35.456429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:35.457597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:35.458338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:35.458831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] PATH_INFO: `/v3/projects/06bdf3b5a58d4dd7bdb8a4c060271591/users/8a3840a896784f8ba53135b4e0b69ff3/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:35.485012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bdf3b5a58d4dd7bdb8a4c060271591, user_id=8a3840a896784f8ba53135b4e0b69ff3, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:35.488084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:35.529085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537694c-6562-491f-824b-eefb2ae80fd5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:35.529561 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2000/4025] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:35 2022] PUT /identity/v3/projects/06bdf3b5a58d4dd7bdb8a4c060271591/users/8a3840a896784f8ba53135b4e0b69ff3/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:35.529685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537694c-6562-491f-824b-eefb2ae80fd5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:35.529983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537694c-6562-491f-824b-eefb2ae80fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:35.584827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7537694c-6562-491f-824b-eefb2ae80fd5 None None] MFA Rules not processed for user `8a3840a896784f8ba53135b4e0b69ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:35.586285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7537694c-6562-491f-824b-eefb2ae80fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:35.764118 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2026/4026] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:36.164236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:36.166695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:36.245747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537694c-6562-491f-824b-eefb2ae80fd5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:36.249942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7537694c-6562-491f-824b-eefb2ae80fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:36.308035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd93e8-a496-4e92-9227-9e1a97062006 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:36.321184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:36.322046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:36.322465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:36.322878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:36.325248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:36.338682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:36.340469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:36.352744 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2001/4027] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:36.445071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537694c-6562-491f-824b-eefb2ae80fd5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:36.452156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356518a8-f6b9-4e9e-afcc-8328d614e9a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:36.453036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356518a8-f6b9-4e9e-afcc-8328d614e9a1 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:36.453386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356518a8-f6b9-4e9e-afcc-8328d614e9a1 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:36.453737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356518a8-f6b9-4e9e-afcc-8328d614e9a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:36.472612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356518a8-f6b9-4e9e-afcc-8328d614e9a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:36.474373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356518a8-f6b9-4e9e-afcc-8328d614e9a1 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:36.497159 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2027/4028] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:36.585720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:36.587461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:36.750474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a95488-686c-474c-93af-a1733ae94820 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:36.756542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:36.757463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:36.757785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:36.758326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] PATH_INFO: `/v3/projects/c1570e453d9c446dac72d42a29ccf729` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:36.759726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1570e453d9c446dac72d42a29ccf729)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:36.762202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:36.839114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1570e453d9c446dac72d42a29ccf729', 'request_id': 'req-5e321f96-5780-4ad9-bac7-80be1c3b7d04'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:36.846436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1570e453d9c446dac72d42a29ccf729', 'request_id': 'req-5e321f96-5780-4ad9-bac7-80be1c3b7d04'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:36.858588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1570e453d9c446dac72d42a29ccf729', 'request_id': 'req-5e321f96-5780-4ad9-bac7-80be1c3b7d04'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:36.902227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] The token cache is being invalidate because project c1570e453d9c446dac72d42a29ccf729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:36.917802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:36.922273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e321f96-5780-4ad9-bac7-80be1c3b7d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:36.928704 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2002/4029] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:36 2022] DELETE /identity/v3/projects/c1570e453d9c446dac72d42a29ccf729 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:36.932261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1623-9afa-4cb2-8f8a-ef8dcf633d6d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:36.932743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1623-9afa-4cb2-8f8a-ef8dcf633d6d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:36.933561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1623-9afa-4cb2-8f8a-ef8dcf633d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:36.984617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d6ca1623-9afa-4cb2-8f8a-ef8dcf633d6d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:36.986070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d6ca1623-9afa-4cb2-8f8a-ef8dcf633d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:37.153107 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2028/4030] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:37.155032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fce0-81a3-4265-a4d4-b034b9c0adf2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.155315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fce0-81a3-4265-a4d4-b034b9c0adf2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.155616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fce0-81a3-4265-a4d4-b034b9c0adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.194831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0a97fce0-81a3-4265-a4d4-b034b9c0adf2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:37.195978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0a97fce0-81a3-4265-a4d4-b034b9c0adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:37.236900 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2003/4031] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:37.241039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1623-9afa-4cb2-8f8a-ef8dcf633d6d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:37.253577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1623-9afa-4cb2-8f8a-ef8dcf633d6d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:37.260602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:37.261676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.262107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.262525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.264347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:37.265147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:37.266956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:37.284648 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2029/4032] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:37.286278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97fce0-81a3-4265-a4d4-b034b9c0adf2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:37.298473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97fce0-81a3-4265-a4d4-b034b9c0adf2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:37.315585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:37.316270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.316774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.316939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.317636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:37.322344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:37.410289 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2004/4033] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:37 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:37.412073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:37.440379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617006-8ab7-4169-8a25-2f6016e21512 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:37.552187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:37.554131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:37.564097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dd1d3-aa0b-4c60-8256-97dc8df09fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:37.565419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dd1d3-aa0b-4c60-8256-97dc8df09fae admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.565703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dd1d3-aa0b-4c60-8256-97dc8df09fae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.565981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dd1d3-aa0b-4c60-8256-97dc8df09fae admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.566683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dd1d3-aa0b-4c60-8256-97dc8df09fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:37.568820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dd1d3-aa0b-4c60-8256-97dc8df09fae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:37.604041 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2030/4034] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:37 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:37.611521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dd1d3-aa0b-4c60-8256-97dc8df09fae admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:37.641241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dd1d3-aa0b-4c60-8256-97dc8df09fae admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:37.647253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65822afa-142b-49fb-9540-86708d8d1272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:37.648133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822afa-142b-49fb-9540-86708d8d1272 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.648615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822afa-142b-49fb-9540-86708d8d1272 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.649052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822afa-142b-49fb-9540-86708d8d1272 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.650294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65822afa-142b-49fb-9540-86708d8d1272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:37.652126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65822afa-142b-49fb-9540-86708d8d1272 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:37.667100 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2031/4035] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:00:37.668265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65822afa-142b-49fb-9540-86708d8d1272 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:37.681629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65822afa-142b-49fb-9540-86708d8d1272 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:37.693074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5868e84-824e-4d5f-8880-99e90622a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:37.693989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5868e84-824e-4d5f-8880-99e90622a08c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.694368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5868e84-824e-4d5f-8880-99e90622a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.694752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5868e84-824e-4d5f-8880-99e90622a08c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.695596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5868e84-824e-4d5f-8880-99e90622a08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:37.697332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5868e84-824e-4d5f-8880-99e90622a08c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:37.714579 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2032/4036] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:37.715366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5868e84-824e-4d5f-8880-99e90622a08c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:37.728276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5868e84-824e-4d5f-8880-99e90622a08c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:37.734765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62109c56-b83c-4fd5-8c60-d97daf1d0992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:37.736088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109c56-b83c-4fd5-8c60-d97daf1d0992 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.736448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109c56-b83c-4fd5-8c60-d97daf1d0992 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.736826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109c56-b83c-4fd5-8c60-d97daf1d0992 admin admin] PATH_INFO: `/v3/projects/fe224069e2de43d08156848d8ccce74c/users/5eb10c5d1ca64a11bb4d0549ca4dc06c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.756884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62109c56-b83c-4fd5-8c60-d97daf1d0992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe224069e2de43d08156848d8ccce74c, user_id=5eb10c5d1ca64a11bb4d0549ca4dc06c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:37.757403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136ccc7-0e70-43d6-91a4-84d439353896 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:37.759889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62109c56-b83c-4fd5-8c60-d97daf1d0992 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:37.774174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:37.774885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.775228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.775951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.778141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:37.795996 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2033/4037] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:37 2022] PUT /identity/v3/projects/fe224069e2de43d08156848d8ccce74c/users/5eb10c5d1ca64a11bb4d0549ca4dc06c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:37.798723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd117b-fb63-471f-9306-2b82f050af1a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:37.799128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd117b-fb63-471f-9306-2b82f050af1a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:37.799355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:37.799783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd117b-fb63-471f-9306-2b82f050af1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:37.811062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:37.831926 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2005/4038] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:37.858325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6abd117b-fb63-471f-9306-2b82f050af1a None None] MFA Rules not processed for user `5eb10c5d1ca64a11bb4d0549ca4dc06c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:37.859842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6abd117b-fb63-471f-9306-2b82f050af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:37.971273 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2034/4039] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:37.972820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:38.002944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715ac27-014b-4b15-9a08-37855fef389d service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:38.113614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a5929-9275-4450-b25b-c9e4b04f62f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:38.114419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a5929-9275-4450-b25b-c9e4b04f62f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:38.114796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a5929-9275-4450-b25b-c9e4b04f62f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:38.115188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a5929-9275-4450-b25b-c9e4b04f62f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:38.116570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a5929-9275-4450-b25b-c9e4b04f62f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:38.119616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a5929-9275-4450-b25b-c9e4b04f62f0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:38.159066 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2006/4040] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:37 2022] POST /identity/v3/projects => generated 389 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:38.163388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd117b-fb63-471f-9306-2b82f050af1a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:38.175039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd117b-fb63-471f-9306-2b82f050af1a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:38.247234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82fd1-739f-4cb6-9698-6fa733f87180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:38.248796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82fd1-739f-4cb6-9698-6fa733f87180 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:38.249392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82fd1-739f-4cb6-9698-6fa733f87180 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:38.249532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82fd1-739f-4cb6-9698-6fa733f87180 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:38.250334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda82fd1-739f-4cb6-9698-6fa733f87180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:38.252834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda82fd1-739f-4cb6-9698-6fa733f87180 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:38.284023 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2035/4041] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:38 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:38.287744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a5929-9275-4450-b25b-c9e4b04f62f0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:38.318694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a5929-9275-4450-b25b-c9e4b04f62f0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:38.341931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cc13a-64bc-4aa5-b8cb-08dcf4137330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:38.342494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cc13a-64bc-4aa5-b8cb-08dcf4137330 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:38.342792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cc13a-64bc-4aa5-b8cb-08dcf4137330 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:38.343074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cc13a-64bc-4aa5-b8cb-08dcf4137330 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:38.343809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cc13a-64bc-4aa5-b8cb-08dcf4137330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:38.345443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cc13a-64bc-4aa5-b8cb-08dcf4137330 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:38.398060 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2007/4042] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:38.403414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82fd1-739f-4cb6-9698-6fa733f87180 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:38.423175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82fd1-739f-4cb6-9698-6fa733f87180 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:38.441404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b9e03-1373-49d5-91c2-830081658f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:38.442470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b9e03-1373-49d5-91c2-830081658f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:38.442755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b9e03-1373-49d5-91c2-830081658f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:38.443118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b9e03-1373-49d5-91c2-830081658f43 admin admin] PATH_INFO: `/v3/projects/f25cfdf011814f2693d8d1bba532c9fc/users/d85c0d79ddb542088a771da7f231c345/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:38.484629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b9e03-1373-49d5-91c2-830081658f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25cfdf011814f2693d8d1bba532c9fc, user_id=d85c0d79ddb542088a771da7f231c345, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:38.494670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b9e03-1373-49d5-91c2-830081658f43 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:38.531965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2036/4043] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:38 2022] PUT /identity/v3/projects/f25cfdf011814f2693d8d1bba532c9fc/users/d85c0d79ddb542088a771da7f231c345/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:38.533304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cc13a-64bc-4aa5-b8cb-08dcf4137330 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:38.545477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cc13a-64bc-4aa5-b8cb-08dcf4137330 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:38.624079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635d0d9-ed90-4693-ba29-dfffecf807ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:38.625272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d0d9-ed90-4693-ba29-dfffecf807ff admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:38.625822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d0d9-ed90-4693-ba29-dfffecf807ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:38.626682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d0d9-ed90-4693-ba29-dfffecf807ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:38.627599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635d0d9-ed90-4693-ba29-dfffecf807ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:38.630299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635d0d9-ed90-4693-ba29-dfffecf807ff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:38.648681 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2008/4044] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:38.652579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b9e03-1373-49d5-91c2-830081658f43 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:38.666985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b9e03-1373-49d5-91c2-830081658f43 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:38.674587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed070d-2442-47dc-9355-917cd5dc4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:38.675738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed070d-2442-47dc-9355-917cd5dc4eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:38.676021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed070d-2442-47dc-9355-917cd5dc4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:38.676298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed070d-2442-47dc-9355-917cd5dc4eb1 admin admin] PATH_INFO: `/v3/projects/f25cfdf011814f2693d8d1bba532c9fc/users/d85c0d79ddb542088a771da7f231c345/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:38.680021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed070d-2442-47dc-9355-917cd5dc4eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25cfdf011814f2693d8d1bba532c9fc, user_id=d85c0d79ddb542088a771da7f231c345, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:38.683951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed070d-2442-47dc-9355-917cd5dc4eb1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:38.708166 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2037/4045] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:38 2022] PUT /identity/v3/projects/f25cfdf011814f2693d8d1bba532c9fc/users/d85c0d79ddb542088a771da7f231c345/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:38.808622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5d21c-b864-44c6-80ad-8dabd3e6c700 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:38.809040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5d21c-b864-44c6-80ad-8dabd3e6c700 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:38.809417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5d21c-b864-44c6-80ad-8dabd3e6c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:38.864546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-aac5d21c-b864-44c6-80ad-8dabd3e6c700 None None] MFA Rules not processed for user `d85c0d79ddb542088a771da7f231c345`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:38.868303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aac5d21c-b864-44c6-80ad-8dabd3e6c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:39.035992 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2009/4046] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:39.040211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed070d-2442-47dc-9355-917cd5dc4eb1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.059182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed070d-2442-47dc-9355-917cd5dc4eb1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.072933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2c4f-59e2-411e-b72a-8604324de128 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.074861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2c4f-59e2-411e-b72a-8604324de128 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.075235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2c4f-59e2-411e-b72a-8604324de128 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.076664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2c4f-59e2-411e-b72a-8604324de128 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects/fe224069e2de43d08156848d8ccce74c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.078194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2c4f-59e2-411e-b72a-8604324de128 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe224069e2de43d08156848d8ccce74c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.082780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2c4f-59e2-411e-b72a-8604324de128 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.090669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5d21c-b864-44c6-80ad-8dabd3e6c700 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.092113 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2038/4047] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects/fe224069e2de43d08156848d8ccce74c => generated 389 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:39.102808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5d21c-b864-44c6-80ad-8dabd3e6c700 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.115968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081feec-3e50-4a3f-8466-690a21c39471 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.116901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081feec-3e50-4a3f-8466-690a21c39471 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.117335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081feec-3e50-4a3f-8466-690a21c39471 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.117762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081feec-3e50-4a3f-8466-690a21c39471 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.118629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081feec-3e50-4a3f-8466-690a21c39471 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.125587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081feec-3e50-4a3f-8466-690a21c39471 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.167381 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2010/4048] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:00:39 2022] POST /identity/v3/projects => generated 339 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:39.168873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2c4f-59e2-411e-b72a-8604324de128 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.181364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2c4f-59e2-411e-b72a-8604324de128 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.277516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2958e71-fdb9-43fc-b276-fc8ae5ce2d4e tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.278579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2958e71-fdb9-43fc-b276-fc8ae5ce2d4e tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.279693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2958e71-fdb9-43fc-b276-fc8ae5ce2d4e tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.280385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2958e71-fdb9-43fc-b276-fc8ae5ce2d4e tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.281809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2958e71-fdb9-43fc-b276-fc8ae5ce2d4e tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.287232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2958e71-fdb9-43fc-b276-fc8ae5ce2d4e tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.329883 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2039/4049] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects => generated 6219 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:39.331971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081feec-3e50-4a3f-8466-690a21c39471 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.345283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081feec-3e50-4a3f-8466-690a21c39471 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.356363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ce76-33f4-4dd4-9408-09932e19c4d7 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.358038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ce76-33f4-4dd4-9408-09932e19c4d7 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.358596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ce76-33f4-4dd4-9408-09932e19c4d7 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.359101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ce76-33f4-4dd4-9408-09932e19c4d7 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects/fe224069e2de43d08156848d8ccce74c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.361691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943ce76-33f4-4dd4-9408-09932e19c4d7 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe224069e2de43d08156848d8ccce74c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.364034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943ce76-33f4-4dd4-9408-09932e19c4d7 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.373182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2958e71-fdb9-43fc-b276-fc8ae5ce2d4e tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.386685 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2011/4050] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects/fe224069e2de43d08156848d8ccce74c => generated 389 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:39.387052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2958e71-fdb9-43fc-b276-fc8ae5ce2d4e tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.408092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e839d-5a5d-4c27-aa7e-38d6385ad676 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.409244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e839d-5a5d-4c27-aa7e-38d6385ad676 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.410460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e839d-5a5d-4c27-aa7e-38d6385ad676 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.410748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e839d-5a5d-4c27-aa7e-38d6385ad676 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects/c5bf1c727cc44618b186ae868020d003` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.412876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e839d-5a5d-4c27-aa7e-38d6385ad676 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:get_project(project_id=c5bf1c727cc44618b186ae868020d003)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.415590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e839d-5a5d-4c27-aa7e-38d6385ad676 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.418716 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2040/4051] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects/c5bf1c727cc44618b186ae868020d003 => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:39.423559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ce76-33f4-4dd4-9408-09932e19c4d7 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.440323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ce76-33f4-4dd4-9408-09932e19c4d7 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.445399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad3773-14b5-4912-a9c4-14f10eeadd83 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.445991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3773-14b5-4912-a9c4-14f10eeadd83 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.446273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3773-14b5-4912-a9c4-14f10eeadd83 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.448371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3773-14b5-4912-a9c4-14f10eeadd83 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.448992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad3773-14b5-4912-a9c4-14f10eeadd83 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.451898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad3773-14b5-4912-a9c4-14f10eeadd83 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.484755 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2012/4052] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects => generated 6219 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:39.489844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e839d-5a5d-4c27-aa7e-38d6385ad676 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.532875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e839d-5a5d-4c27-aa7e-38d6385ad676 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.548930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.551698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.551907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.554168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.556262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:39.557052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.563239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.605332 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2041/4053] 10.222.0.30 () {58 vars in 1165 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects?domain_id=default => generated 5888 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:39.610118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad3773-14b5-4912-a9c4-14f10eeadd83 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.622000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad3773-14b5-4912-a9c4-14f10eeadd83 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.638914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78b8dd-998c-44b0-b137-a8105f51027f tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.640357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b8dd-998c-44b0-b137-a8105f51027f tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.640647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b8dd-998c-44b0-b137-a8105f51027f tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.640932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b8dd-998c-44b0-b137-a8105f51027f tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.641886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78b8dd-998c-44b0-b137-a8105f51027f tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.644639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78b8dd-998c-44b0-b137-a8105f51027f tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.678840 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2013/4054] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects => generated 6219 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:39.680181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.691409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ed28-611f-45e9-94fa-32395ac8605a tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.719050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.719993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.720523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.720982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.721932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:39.722417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.728856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:39.760971 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2042/4055] 10.222.0.30 () {58 vars in 1165 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects?domain_id=default => generated 5888 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:39.768561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78b8dd-998c-44b0-b137-a8105f51027f tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:39.794195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78b8dd-998c-44b0-b137-a8105f51027f tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:39.809124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43310455-f9a3-47bd-9be8-9ea3e517d612 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:39.810124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310455-f9a3-47bd-9be8-9ea3e517d612 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:39.810860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310455-f9a3-47bd-9be8-9ea3e517d612 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:39.811136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310455-f9a3-47bd-9be8-9ea3e517d612 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:39.812844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43310455-f9a3-47bd-9be8-9ea3e517d612 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:39.817042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43310455-f9a3-47bd-9be8-9ea3e517d612 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:40.020638 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2014/4056] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 21:00:39 2022] GET /identity/v3/projects => generated 6219 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:40.026813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:40.049598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739774-dabf-43c4-893e-a39647d4ab2d tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:40.059348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:40.060957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:40.061245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:40.061565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:40.062941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1033490726) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:40.063258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:40.065432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:40.098563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2043/4057] 10.222.0.30 () {58 vars in 1231 bytes} [Sat Feb 19 21:00:40 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1033490726 => generated 537 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:40.099462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43310455-f9a3-47bd-9be8-9ea3e517d612 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:40.113614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43310455-f9a3-47bd-9be8-9ea3e517d612 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:40.121586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd85c0d79ddb542088a771da7f231c345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25cfdf011814f2693d8d1bba532c9fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:40.123294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:40.124564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:40.125018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] PATH_INFO: `/v3/projects/c5bf1c727cc44618b186ae868020d003` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:40.127151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c5bf1c727cc44618b186ae868020d003)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:40.130992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:40.199842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bf1c727cc44618b186ae868020d003', 'request_id': 'req-be80b8ab-f857-4223-90ba-f866170acca0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.207487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bf1c727cc44618b186ae868020d003', 'request_id': 'req-be80b8ab-f857-4223-90ba-f866170acca0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.224582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bf1c727cc44618b186ae868020d003', 'request_id': 'req-be80b8ab-f857-4223-90ba-f866170acca0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.242051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] The token cache is being invalidate because project c5bf1c727cc44618b186ae868020d003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:40.242389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.243600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be80b8ab-f857-4223-90ba-f866170acca0 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.249103 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2015/4058] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:40 2022] DELETE /identity/v3/projects/c5bf1c727cc44618b186ae868020d003 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:40.250410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:40.252256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:40.347612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74278-fe83-4356-a1a2-b28f6819c733 tempest-ListProjectsStaticTestJSON-1704509868 tempest-ListProjectsStaticTestJSON-1704509868-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:40.461141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:40.462041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:40.462326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:40.462604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] PATH_INFO: `/v3/users/5eb10c5d1ca64a11bb4d0549ca4dc06c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:40.464202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb10c5d1ca64a11bb4d0549ca4dc06c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:40.467006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:40.587311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb10c5d1ca64a11bb4d0549ca4dc06c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.614991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb10c5d1ca64a11bb4d0549ca4dc06c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.640023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb10c5d1ca64a11bb4d0549ca4dc06c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.640213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb10c5d1ca64a11bb4d0549ca4dc06c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.640989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb10c5d1ca64a11bb4d0549ca4dc06c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:40.670181 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2044/4059] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:40 2022] DELETE /identity/v3/users/5eb10c5d1ca64a11bb4d0549ca4dc06c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:40.671648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82e70-9416-424d-ae27-7cc48ca5505d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:40.672091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82e70-9416-424d-ae27-7cc48ca5505d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:40.672184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82e70-9416-424d-ae27-7cc48ca5505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:40.709497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a1c82e70-9416-424d-ae27-7cc48ca5505d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:40.710744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a1c82e70-9416-424d-ae27-7cc48ca5505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:40.851198 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2016/4060] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:40.869543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:40.871692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:41.009956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82711d-28cb-480b-aaa0-a7ffad989d3b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:41.019699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:41.019699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:41.019699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:41.019699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:41.042535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:41.058621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:41.095985 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2045/4061] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:42.014900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c82e70-9416-424d-ae27-7cc48ca5505d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:42.016547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a1c82e70-9416-424d-ae27-7cc48ca5505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:42.036258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c82e70-9416-424d-ae27-7cc48ca5505d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:42.046644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:42.048179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:42.048833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:42.050532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] PATH_INFO: `/v3/projects/fe224069e2de43d08156848d8ccce74c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:42.057837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe224069e2de43d08156848d8ccce74c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:42.060839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:42.128243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe224069e2de43d08156848d8ccce74c', 'request_id': 'req-5757d75a-8732-472a-b78d-043be8a21287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.143090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe224069e2de43d08156848d8ccce74c', 'request_id': 'req-5757d75a-8732-472a-b78d-043be8a21287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.165287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe224069e2de43d08156848d8ccce74c', 'request_id': 'req-5757d75a-8732-472a-b78d-043be8a21287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.192536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] The token cache is being invalidate because project fe224069e2de43d08156848d8ccce74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:42.192832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.194814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:42.196526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:42.215682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.222738 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2017/4062] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:42 2022] DELETE /identity/v3/projects/fe224069e2de43d08156848d8ccce74c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:42.226147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4b290-5d21-40db-b845-129ac7c8b81d service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:42.228398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:42.230390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:42.361184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:42.362958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:42.363465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:42.363973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] PATH_INFO: `/v3/users/5a3a1e86138d41b991f5e44a1e8ae2eb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:42.366861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3a1e86138d41b991f5e44a1e8ae2eb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:42.369222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:42.374581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757d75a-8732-472a-b78d-043be8a21287 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:42.391856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:42.393532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:42.394482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:42.395337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] PATH_INFO: `/v3/users/d85c0d79ddb542088a771da7f231c345` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:42.404593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85c0d79ddb542088a771da7f231c345)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:42.406923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:42.452359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3a1e86138d41b991f5e44a1e8ae2eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.480830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3a1e86138d41b991f5e44a1e8ae2eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.493662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3a1e86138d41b991f5e44a1e8ae2eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.494067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85c0d79ddb542088a771da7f231c345'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.494387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3a1e86138d41b991f5e44a1e8ae2eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.495129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85c0d79ddb542088a771da7f231c345'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.495264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d77d7b1c-363a-4410-baef-71274db68ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3a1e86138d41b991f5e44a1e8ae2eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.495817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85c0d79ddb542088a771da7f231c345'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.510775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85c0d79ddb542088a771da7f231c345'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.517062 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2046/4063] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:42 2022] DELETE /identity/v3/users/5a3a1e86138d41b991f5e44a1e8ae2eb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:42.518410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246c7e-edf8-4d45-ac96-2edd4ef7d721 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:42.518700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246c7e-edf8-4d45-ac96-2edd4ef7d721 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:42.518992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246c7e-edf8-4d45-ac96-2edd4ef7d721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:42.524529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85c0d79ddb542088a771da7f231c345'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:42.542860 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2018/4064] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:42 2022] DELETE /identity/v3/users/d85c0d79ddb542088a771da7f231c345 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:42.560532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2c246c7e-edf8-4d45-ac96-2edd4ef7d721 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:42.562133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2c246c7e-edf8-4d45-ac96-2edd4ef7d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:42.630892 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2047/4065] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:00:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:42.656965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:42.660750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:42.792076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b867b1-6ff9-4074-94cc-92bc1bd6f109 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:42.800625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584080d-c5b2-4f4d-ae3e-e67c9bd63d1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:42.801370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584080d-c5b2-4f4d-ae3e-e67c9bd63d1b service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:42.801816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584080d-c5b2-4f4d-ae3e-e67c9bd63d1b service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:42.802291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584080d-c5b2-4f4d-ae3e-e67c9bd63d1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:42.819542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584080d-c5b2-4f4d-ae3e-e67c9bd63d1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:42.822441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584080d-c5b2-4f4d-ae3e-e67c9bd63d1b service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:42.847374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2019/4066] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:42.889936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c246c7e-edf8-4d45-ac96-2edd4ef7d721 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:42.892559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2c246c7e-edf8-4d45-ac96-2edd4ef7d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:42.993913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c246c7e-edf8-4d45-ac96-2edd4ef7d721 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.007372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.008279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.008592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.008946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] PATH_INFO: `/v3/projects/b959eb07a97740dca63d3cf3d2ed0a63` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.010070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b959eb07a97740dca63d3cf3d2ed0a63)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.012832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.073742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b959eb07a97740dca63d3cf3d2ed0a63', 'request_id': 'req-6c8d2632-8457-48b9-b03c-67ce4901b418'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.079807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b959eb07a97740dca63d3cf3d2ed0a63', 'request_id': 'req-6c8d2632-8457-48b9-b03c-67ce4901b418'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.087873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b959eb07a97740dca63d3cf3d2ed0a63', 'request_id': 'req-6c8d2632-8457-48b9-b03c-67ce4901b418'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.099829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] The token cache is being invalidate because project b959eb07a97740dca63d3cf3d2ed0a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:43.100117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.100776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c8d2632-8457-48b9-b03c-67ce4901b418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.102505 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2048/4067] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:42 2022] DELETE /identity/v3/projects/b959eb07a97740dca63d3cf3d2ed0a63 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:43.107926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4758c-09a6-486d-b0c0-ebd0c96d0ad2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.108397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4758c-09a6-486d-b0c0-ebd0c96d0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.108507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4758c-09a6-486d-b0c0-ebd0c96d0ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.138685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0ae4758c-09a6-486d-b0c0-ebd0c96d0ad2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:43.139930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0ae4758c-09a6-486d-b0c0-ebd0c96d0ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:43.210642 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2020/4068] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:43.219912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6515d8-5376-4b69-8332-6903e6ed6b27 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.219912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6515d8-5376-4b69-8332-6903e6ed6b27 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.219912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6515d8-5376-4b69-8332-6903e6ed6b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.244706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4d6515d8-5376-4b69-8332-6903e6ed6b27 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:43.246224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4d6515d8-5376-4b69-8332-6903e6ed6b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:43.257209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2049/4069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:43.261429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4758c-09a6-486d-b0c0-ebd0c96d0ad2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.265095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6515d8-5376-4b69-8332-6903e6ed6b27 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.267274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4d6515d8-5376-4b69-8332-6903e6ed6b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:43.273743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4758c-09a6-486d-b0c0-ebd0c96d0ad2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.280194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.281155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.281510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.281855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.282979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:43.283482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.285380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.290268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6515d8-5376-4b69-8332-6903e6ed6b27 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.301250 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2021/4070] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:00:43.304953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.310992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.311869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.312150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.312705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] PATH_INFO: `/v3/projects/f25cfdf011814f2693d8d1bba532c9fc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.314794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25cfdf011814f2693d8d1bba532c9fc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.327287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.365140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982cba4-50d9-4250-8f74-9de9f2455a02 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.372093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd94ac0-e7a4-4a0e-a5ee-62c494c8c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.373181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94ac0-e7a4-4a0e-a5ee-62c494c8c0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.373581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94ac0-e7a4-4a0e-a5ee-62c494c8c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.374005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94ac0-e7a4-4a0e-a5ee-62c494c8c0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.375073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd94ac0-e7a4-4a0e-a5ee-62c494c8c0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.377243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd94ac0-e7a4-4a0e-a5ee-62c494c8c0f0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.413551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25cfdf011814f2693d8d1bba532c9fc', 'request_id': 'req-e5db6b59-95c5-405f-82d0-2073c5901c7d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.416870 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2022/4071] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:43.416870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf704-568e-40a7-9f47-3014368bdabb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.416870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf704-568e-40a7-9f47-3014368bdabb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.416870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf704-568e-40a7-9f47-3014368bdabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.420536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25cfdf011814f2693d8d1bba532c9fc', 'request_id': 'req-e5db6b59-95c5-405f-82d0-2073c5901c7d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.429713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25cfdf011814f2693d8d1bba532c9fc', 'request_id': 'req-e5db6b59-95c5-405f-82d0-2073c5901c7d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.442597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-83ecf704-568e-40a7-9f47-3014368bdabb None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:43.443947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-83ecf704-568e-40a7-9f47-3014368bdabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:43.445649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] The token cache is being invalidate because project f25cfdf011814f2693d8d1bba532c9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:43.447582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.449152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:43.453552 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2050/4072] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:43 2022] DELETE /identity/v3/projects/f25cfdf011814f2693d8d1bba532c9fc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:43.454736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.456649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:43.532900 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2023/4073] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:43.534393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b739e-bbf1-45d3-aee2-68707887cde8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.534932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b739e-bbf1-45d3-aee2-68707887cde8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.535567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b739e-bbf1-45d3-aee2-68707887cde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.552912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6b59-95c5-405f-82d0-2073c5901c7d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.572551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2d4b739e-bbf1-45d3-aee2-68707887cde8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:43.573851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2d4b739e-bbf1-45d3-aee2-68707887cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:43.650169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a3fc-cc1b-4e09-af0d-af4d91d3c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.651368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a3fc-cc1b-4e09-af0d-af4d91d3c967 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.651881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a3fc-cc1b-4e09-af0d-af4d91d3c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.652376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a3fc-cc1b-4e09-af0d-af4d91d3c967 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.653268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a3fc-cc1b-4e09-af0d-af4d91d3c967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.657885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a3fc-cc1b-4e09-af0d-af4d91d3c967 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.700492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2024/4074] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:43.700492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b739e-bbf1-45d3-aee2-68707887cde8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.703921 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2051/4075] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:43.705405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991633-f26f-4b48-b301-e1451279e636 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.705702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991633-f26f-4b48-b301-e1451279e636 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.705981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991633-f26f-4b48-b301-e1451279e636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.716413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2d4b739e-bbf1-45d3-aee2-68707887cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:43.730095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f1991633-f26f-4b48-b301-e1451279e636 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:43.731722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f1991633-f26f-4b48-b301-e1451279e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:43.749184 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2052/4076] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:43.750430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991633-f26f-4b48-b301-e1451279e636 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.762989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991633-f26f-4b48-b301-e1451279e636 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.770132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec0403-2078-4cea-8c80-2f6c294432ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.771763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0403-2078-4cea-8c80-2f6c294432ef admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.772402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0403-2078-4cea-8c80-2f6c294432ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.772886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0403-2078-4cea-8c80-2f6c294432ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.773814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec0403-2078-4cea-8c80-2f6c294432ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.775930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec0403-2078-4cea-8c80-2f6c294432ef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.789255 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2053/4077] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:43.790411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec0403-2078-4cea-8c80-2f6c294432ef admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.808037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec0403-2078-4cea-8c80-2f6c294432ef admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.814640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b739e-bbf1-45d3-aee2-68707887cde8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.815674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.816766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.817146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.817936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.818829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:43.819522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.821821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.823824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b3407-4b5c-4a0b-a45a-5beae970e455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.824490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b3407-4b5c-4a0b-a45a-5beae970e455 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.824824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b3407-4b5c-4a0b-a45a-5beae970e455 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.825101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b3407-4b5c-4a0b-a45a-5beae970e455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.838353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b3407-4b5c-4a0b-a45a-5beae970e455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.840310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b3407-4b5c-4a0b-a45a-5beae970e455 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.850877 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2025/4078] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:43.854432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2054/4079] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:43.855351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b3407-4b5c-4a0b-a45a-5beae970e455 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.856379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.868827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b3407-4b5c-4a0b-a45a-5beae970e455 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.877405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc603-973d-42ab-a163-89e69ed3700a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:43.879498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec1a8a-141c-4782-a07d-6e3230409c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.880159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec1a8a-141c-4782-a07d-6e3230409c77 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.880491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec1a8a-141c-4782-a07d-6e3230409c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.881271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec1a8a-141c-4782-a07d-6e3230409c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.881995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec1a8a-141c-4782-a07d-6e3230409c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.889270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f2507-5091-4bae-a958-53bb6bd0028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:43.889423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec1a8a-141c-4782-a07d-6e3230409c77 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.889985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f2507-5091-4bae-a958-53bb6bd0028d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:43.890273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f2507-5091-4bae-a958-53bb6bd0028d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:43.890548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f2507-5091-4bae-a958-53bb6bd0028d admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:43.891242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f2507-5091-4bae-a958-53bb6bd0028d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:43.893372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f2507-5091-4bae-a958-53bb6bd0028d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:43.905545 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2026/4080] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:43.907855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec1a8a-141c-4782-a07d-6e3230409c77 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.925312 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2055/4081] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:43.930003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f2507-5091-4bae-a958-53bb6bd0028d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:43.952367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec1a8a-141c-4782-a07d-6e3230409c77 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:44.032722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f2507-5091-4bae-a958-53bb6bd0028d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:44.040108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279eabb-6088-4346-b253-94cb3440b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:44.040804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279eabb-6088-4346-b253-94cb3440b815 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.041188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279eabb-6088-4346-b253-94cb3440b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.041625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279eabb-6088-4346-b253-94cb3440b815 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.042453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279eabb-6088-4346-b253-94cb3440b815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:44.044679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bae37f-93e4-45f6-9c4b-4bce04da6c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:44.045615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279eabb-6088-4346-b253-94cb3440b815 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:44.046062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bae37f-93e4-45f6-9c4b-4bce04da6c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.046671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bae37f-93e4-45f6-9c4b-4bce04da6c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.047153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bae37f-93e4-45f6-9c4b-4bce04da6c1d admin admin] PATH_INFO: `/v3/projects/9076f1b9076b4cc9a0b043ffe2c918d4/users/7a698f9207094ef5a461a289eaa6dc43/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.077491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bae37f-93e4-45f6-9c4b-4bce04da6c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9076f1b9076b4cc9a0b043ffe2c918d4, user_id=7a698f9207094ef5a461a289eaa6dc43, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:44.080247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bae37f-93e4-45f6-9c4b-4bce04da6c1d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:44.084645 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2056/4082] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:43 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:44.085555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279eabb-6088-4346-b253-94cb3440b815 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:44.110829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279eabb-6088-4346-b253-94cb3440b815 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:44.115953 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2027/4083] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:43 2022] PUT /identity/v3/projects/9076f1b9076b4cc9a0b043ffe2c918d4/users/7a698f9207094ef5a461a289eaa6dc43/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:44.117820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b873-f0ed-4652-998e-28fb671bbb09 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.118179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b873-f0ed-4652-998e-28fb671bbb09 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.118469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b873-f0ed-4652-998e-28fb671bbb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.158276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5d45b873-f0ed-4652-998e-28fb671bbb09 None None] MFA Rules not processed for user `7a698f9207094ef5a461a289eaa6dc43`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:44.159561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5d45b873-f0ed-4652-998e-28fb671bbb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.268946 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2028/4084] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:44.276713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:44.277301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2630dd9-c45f-461e-9d9f-94ac54efc8e5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.277301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2630dd9-c45f-461e-9d9f-94ac54efc8e5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.277495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2630dd9-c45f-461e-9d9f-94ac54efc8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.279481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.279924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.280940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.281823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:44.283643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:44.300968 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2057/4085] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:44.306188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:44.308138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.323172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a6ba-08f1-4c01-a67a-fa413a6d4d86 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:44.324873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c2630dd9-c45f-461e-9d9f-94ac54efc8e5 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:44.326920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c2630dd9-c45f-461e-9d9f-94ac54efc8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.335466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:44.337359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.337628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.337913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] PATH_INFO: `/v3/users/8a3840a896784f8ba53135b4e0b69ff3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.339968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3840a896784f8ba53135b4e0b69ff3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:44.343713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:44.428497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3840a896784f8ba53135b4e0b69ff3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:44.429013 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2029/4086] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:44.429987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2630dd9-c45f-461e-9d9f-94ac54efc8e5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:44.445276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3840a896784f8ba53135b4e0b69ff3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:44.451662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2630dd9-c45f-461e-9d9f-94ac54efc8e5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:44.455629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3840a896784f8ba53135b4e0b69ff3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:44.456770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3840a896784f8ba53135b4e0b69ff3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:44.457512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3840a896784f8ba53135b4e0b69ff3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:44.461520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:44.462806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.463245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.463753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.465274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:44.469150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:44.490548 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2030/4087] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:44.491560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:44.493554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.496734 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2058/4088] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:44 2022] DELETE /identity/v3/users/8a3840a896784f8ba53135b4e0b69ff3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:44.498470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:44.500761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.595822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d7c44-f27b-44bb-bb7c-b5c8a615e70f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:44.603702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4423-8cf5-4448-a1e4-cea315a6f1b4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:44.610395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:44.611063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.611350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.611920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.613651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.683742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02384afc-7bb6-4a2f-b35a-73f178ca1d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:44.685709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02384afc-7bb6-4a2f-b35a-73f178ca1d58 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.686280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02384afc-7bb6-4a2f-b35a-73f178ca1d58 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.686701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02384afc-7bb6-4a2f-b35a-73f178ca1d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.688999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-02384afc-7bb6-4a2f-b35a-73f178ca1d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.704781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:44.707554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:44.722766 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2059/4089] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:00:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:44.723447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:44.725336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.764023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02384afc-7bb6-4a2f-b35a-73f178ca1d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:44.765925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02384afc-7bb6-4a2f-b35a-73f178ca1d58 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:44.781950 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2031/4090] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:44.782943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f50d-fcc2-429f-853c-e0b2455c32d5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.783394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f50d-fcc2-429f-853c-e0b2455c32d5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.783678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f50d-fcc2-429f-853c-e0b2455c32d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:44.814038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b5e5f50d-fcc2-429f-853c-e0b2455c32d5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:44.815933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b5e5f50d-fcc2-429f-853c-e0b2455c32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.908345 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2032/4091] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:44.923712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f50d-fcc2-429f-853c-e0b2455c32d5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:44.925570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b5e5f50d-fcc2-429f-853c-e0b2455c32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:44.977584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ee43-a23a-49dc-8cc7-bc026843e7a8 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:44.993054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:44.993956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:44.994236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:44.994538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] PATH_INFO: `/v3/projects/e93a9beabf3f413a97af1554514a7537/users/40187586652e496ca9607f3a5c3de70f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.039679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93a9beabf3f413a97af1554514a7537, user_id=40187586652e496ca9607f3a5c3de70f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.042419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.045953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f50d-fcc2-429f-853c-e0b2455c32d5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.063814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9ef19-7dcc-4bf6-b36d-c4b2bcd6d8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.064550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9ef19-7dcc-4bf6-b36d-c4b2bcd6d8ba service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.065000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9ef19-7dcc-4bf6-b36d-c4b2bcd6d8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.065285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9ef19-7dcc-4bf6-b36d-c4b2bcd6d8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.077757 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2060/4092] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:44 2022] PUT /identity/v3/projects/e93a9beabf3f413a97af1554514a7537/users/40187586652e496ca9607f3a5c3de70f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:45.079705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.081795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:45.094431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9ef19-7dcc-4bf6-b36d-c4b2bcd6d8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.096021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9ef19-7dcc-4bf6-b36d-c4b2bcd6d8ba service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.122002 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2033/4093] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:45.123872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8eb6-9a2d-459b-873e-5fbfbab9e5c0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.124302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8eb6-9a2d-459b-873e-5fbfbab9e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.124609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8eb6-9a2d-459b-873e-5fbfbab9e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.165335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-97bb8eb6-9a2d-459b-873e-5fbfbab9e5c0 None None] MFA Rules not processed for user `40187586652e496ca9607f3a5c3de70f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:45.167993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-97bb8eb6-9a2d-459b-873e-5fbfbab9e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:45.209745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ed940-4514-481c-bb21-bd97ba5b0f2f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.225814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.226842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.227031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.227259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] PATH_INFO: `/v3/users/5228f69460a3451c90e6254f5c6b6eeb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.229395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5228f69460a3451c90e6254f5c6b6eeb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.232675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.291860 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2034/4094] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:45.295764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb8eb6-9a2d-459b-873e-5fbfbab9e5c0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.319407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb8eb6-9a2d-459b-873e-5fbfbab9e5c0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.320607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5228f69460a3451c90e6254f5c6b6eeb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.325402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.327224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.327988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.328527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.329498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.331509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.364805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5228f69460a3451c90e6254f5c6b6eeb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.385390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5228f69460a3451c90e6254f5c6b6eeb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.386153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5228f69460a3451c90e6254f5c6b6eeb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.387341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1ce537e-07ac-4bfa-8511-ee4b2b3729a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5228f69460a3451c90e6254f5c6b6eeb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.395541 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2035/4095] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:45 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:45.400291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.402133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:45.411062 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2061/4096] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:45 2022] DELETE /identity/v3/users/5228f69460a3451c90e6254f5c6b6eeb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:45.416505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905609-e474-4d0f-b764-50848728ec7b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.416798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905609-e474-4d0f-b764-50848728ec7b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.417083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905609-e474-4d0f-b764-50848728ec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.439245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-93905609-e474-4d0f-b764-50848728ec7b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:45.440608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-93905609-e474-4d0f-b764-50848728ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:45.529826 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2062/4097] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:45.530307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a1b1e-5ecb-42b8-9b2b-b095e0a6fd2f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.536159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575228e6-bd10-4c21-b48f-94057c447ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.536908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575228e6-bd10-4c21-b48f-94057c447ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.537173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575228e6-bd10-4c21-b48f-94057c447ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.537453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575228e6-bd10-4c21-b48f-94057c447ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.538150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575228e6-bd10-4c21-b48f-94057c447ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.539417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905609-e474-4d0f-b764-50848728ec7b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.541762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-93905609-e474-4d0f-b764-50848728ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:45.547675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575228e6-bd10-4c21-b48f-94057c447ff5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.577093 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2036/4098] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:45 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:45.580227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575228e6-bd10-4c21-b48f-94057c447ff5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.591915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575228e6-bd10-4c21-b48f-94057c447ff5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.597353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ac716-73f7-4415-85ec-7f9dfb7dc71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.598016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ac716-73f7-4415-85ec-7f9dfb7dc71b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.598369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ac716-73f7-4415-85ec-7f9dfb7dc71b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.598718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ac716-73f7-4415-85ec-7f9dfb7dc71b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.599646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ac716-73f7-4415-85ec-7f9dfb7dc71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.601423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ac716-73f7-4415-85ec-7f9dfb7dc71b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.613393 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2037/4099] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:00:45.617523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ac716-73f7-4415-85ec-7f9dfb7dc71b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.628623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ac716-73f7-4415-85ec-7f9dfb7dc71b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.634013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912f34-0a9e-4e25-9da2-be8acc1751cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.635045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912f34-0a9e-4e25-9da2-be8acc1751cb admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.635429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912f34-0a9e-4e25-9da2-be8acc1751cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.635807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912f34-0a9e-4e25-9da2-be8acc1751cb admin admin] PATH_INFO: `/v3/projects/c125523d7f4642d7abd0b70eae302199/users/dbb44adc010645e3855fccff7976455c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.657246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905609-e474-4d0f-b764-50848728ec7b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.664767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49912f34-0a9e-4e25-9da2-be8acc1751cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c125523d7f4642d7abd0b70eae302199, user_id=dbb44adc010645e3855fccff7976455c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.668533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49912f34-0a9e-4e25-9da2-be8acc1751cb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.668852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.670040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.670815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.670815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.697050 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2038/4100] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:45 2022] PUT /identity/v3/projects/c125523d7f4642d7abd0b70eae302199/users/dbb44adc010645e3855fccff7976455c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:45.698100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912f34-0a9e-4e25-9da2-be8acc1751cb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.702897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.711532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.722021 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2063/4101] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:00:45.780351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912f34-0a9e-4e25-9da2-be8acc1751cb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.788285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe5ed-67c1-4a74-b9a1-7e178cc158e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.789251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe5ed-67c1-4a74-b9a1-7e178cc158e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.789585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe5ed-67c1-4a74-b9a1-7e178cc158e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.789868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe5ed-67c1-4a74-b9a1-7e178cc158e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.790597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fe5ed-67c1-4a74-b9a1-7e178cc158e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.792472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fe5ed-67c1-4a74-b9a1-7e178cc158e3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.802982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.804963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:45.810724 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2039/4102] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:45.814480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe5ed-67c1-4a74-b9a1-7e178cc158e3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.824485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88eba2-166c-45b1-871b-cccd379c775f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.824655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe5ed-67c1-4a74-b9a1-7e178cc158e3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:45.829961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f59e-92d4-430f-80e0-0fe0dddb1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.830850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f59e-92d4-430f-80e0-0fe0dddb1e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.831096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:45.831222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f59e-92d4-430f-80e0-0fe0dddb1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.831390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f59e-92d4-430f-80e0-0fe0dddb1e27 admin admin] PATH_INFO: `/v3/projects/c125523d7f4642d7abd0b70eae302199/users/dbb44adc010645e3855fccff7976455c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.832209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.832624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.833131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] PATH_INFO: `/v3/users/7a698f9207094ef5a461a289eaa6dc43` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.834067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860f59e-92d4-430f-80e0-0fe0dddb1e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c125523d7f4642d7abd0b70eae302199, user_id=dbb44adc010645e3855fccff7976455c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.835033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a698f9207094ef5a461a289eaa6dc43)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:45.837468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.840166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860f59e-92d4-430f-80e0-0fe0dddb1e27 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:45.856265 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2040/4103] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:45 2022] PUT /identity/v3/projects/c125523d7f4642d7abd0b70eae302199/users/dbb44adc010645e3855fccff7976455c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:45.870642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc81b-c24f-4a18-a589-91a6f2ff90f9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.870642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc81b-c24f-4a18-a589-91a6f2ff90f9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.870642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc81b-c24f-4a18-a589-91a6f2ff90f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:45.902082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c8abc81b-c24f-4a18-a589-91a6f2ff90f9 None None] MFA Rules not processed for user `dbb44adc010645e3855fccff7976455c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:45.903400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c8abc81b-c24f-4a18-a589-91a6f2ff90f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:45.911533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a698f9207094ef5a461a289eaa6dc43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.926048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a698f9207094ef5a461a289eaa6dc43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.935836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a698f9207094ef5a461a289eaa6dc43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.936538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a698f9207094ef5a461a289eaa6dc43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.937166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a698f9207094ef5a461a289eaa6dc43'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:45.951554 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2064/4104] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:45 2022] DELETE /identity/v3/users/7a698f9207094ef5a461a289eaa6dc43 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:45.952448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:45.953826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:45.999677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2041/4105] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:00:45.999677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a09b4b-b49f-448e-92b9-be34af2296f2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:45.999677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a09b4b-b49f-448e-92b9-be34af2296f2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:45.999677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a09b4b-b49f-448e-92b9-be34af2296f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.017590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-39a09b4b-b49f-448e-92b9-be34af2296f2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:46.019608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-39a09b4b-b49f-448e-92b9-be34af2296f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.034743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0952c-8d81-40c6-8deb-34c1d9249fa3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.041403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.042673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.042673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.042894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] PATH_INFO: `/v3/projects/06bdf3b5a58d4dd7bdb8a4c060271591` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.044069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bdf3b5a58d4dd7bdb8a4c060271591)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.046636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.089745 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2042/4106] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:46.093412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a09b4b-b49f-448e-92b9-be34af2296f2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.102623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bdf3b5a58d4dd7bdb8a4c060271591', 'request_id': 'req-7588e206-cd7d-4bc8-8293-4f2de656367b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.109793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bdf3b5a58d4dd7bdb8a4c060271591', 'request_id': 'req-7588e206-cd7d-4bc8-8293-4f2de656367b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.125366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bdf3b5a58d4dd7bdb8a4c060271591', 'request_id': 'req-7588e206-cd7d-4bc8-8293-4f2de656367b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.137744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] The token cache is being invalidate because project 06bdf3b5a58d4dd7bdb8a4c060271591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:46.138147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.138870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.140653 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2065/4107] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:45 2022] DELETE /identity/v3/projects/06bdf3b5a58d4dd7bdb8a4c060271591 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:46.141654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.143021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.177742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a09b4b-b49f-448e-92b9-be34af2296f2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.242953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e206-cd7d-4bc8-8293-4f2de656367b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.248000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.248840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.249121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.249522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.251686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.258109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22271af-0604-4187-bdaa-ade107c349a6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.258845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22271af-0604-4187-bdaa-ade107c349a6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.259133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22271af-0604-4187-bdaa-ade107c349a6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.259417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22271af-0604-4187-bdaa-ade107c349a6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.260289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22271af-0604-4187-bdaa-ade107c349a6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.261757 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-e22271af-0604-4187-bdaa-ade107c349a6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:46.261757 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:46.261757 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:46.262889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22271af-0604-4187-bdaa-ade107c349a6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.304716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2043/4108] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/roles => generated 234 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:46.306054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5fed-d5bf-4cb2-b840-45f84726501b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.306340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5fed-d5bf-4cb2-b840-45f84726501b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.306620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5fed-d5bf-4cb2-b840-45f84726501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.330933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3f6a5fed-d5bf-4cb2-b840-45f84726501b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:46.332504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3f6a5fed-d5bf-4cb2-b840-45f84726501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.343100 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2044/4109] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:46.350818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.350818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.356877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a5fed-d5bf-4cb2-b840-45f84726501b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.359520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3f6a5fed-d5bf-4cb2-b840-45f84726501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.366292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2066/4110] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:46.367786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.369672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.377401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a5fed-d5bf-4cb2-b840-45f84726501b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.384131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.385250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.385541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.385816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] PATH_INFO: `/v3/projects/ba0a055a14bb46128600e77140b79b10` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.387078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0a055a14bb46128600e77140b79b10)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.389870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.394861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19473af3-f7d7-41b7-a5a1-b1ece12b2907 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.401236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636589e-44e2-4f3a-b775-9278bf1172b6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.402098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636589e-44e2-4f3a-b775-9278bf1172b6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.402536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636589e-44e2-4f3a-b775-9278bf1172b6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.403171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636589e-44e2-4f3a-b775-9278bf1172b6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.404482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636589e-44e2-4f3a-b775-9278bf1172b6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.407826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636589e-44e2-4f3a-b775-9278bf1172b6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.431670 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2067/4111] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/roles => generated 235 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:46.433686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a90a53-0b30-4bea-bbdb-00cf8498831b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.434145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a90a53-0b30-4bea-bbdb-00cf8498831b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.435089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a90a53-0b30-4bea-bbdb-00cf8498831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.464894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-17a90a53-0b30-4bea-bbdb-00cf8498831b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:46.466535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-17a90a53-0b30-4bea-bbdb-00cf8498831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.467888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0a055a14bb46128600e77140b79b10', 'request_id': 'req-9f987580-f34b-4c69-a917-85f50b9138b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.482999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0a055a14bb46128600e77140b79b10', 'request_id': 'req-9f987580-f34b-4c69-a917-85f50b9138b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.494712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0a055a14bb46128600e77140b79b10', 'request_id': 'req-9f987580-f34b-4c69-a917-85f50b9138b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.518725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] The token cache is being invalidate because project ba0a055a14bb46128600e77140b79b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:46.519072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.519763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:46.521411 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2045/4112] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:46 2022] DELETE /identity/v3/projects/ba0a055a14bb46128600e77140b79b10 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:46.522225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.523535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.583698 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2068/4113] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:46.583698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba193f-ae55-47f9-ad9e-c9ab4d05537d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.583978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba193f-ae55-47f9-ad9e-c9ab4d05537d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.584455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba193f-ae55-47f9-ad9e-c9ab4d05537d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.611549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b5ba193f-ae55-47f9-ad9e-c9ab4d05537d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:46.613080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b5ba193f-ae55-47f9-ad9e-c9ab4d05537d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.620532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f987580-f34b-4c69-a917-85f50b9138b3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.632089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabaacc-2aaf-45d8-8c51-f0d22c02e286 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.632089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabaacc-2aaf-45d8-8c51-f0d22c02e286 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.632089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabaacc-2aaf-45d8-8c51-f0d22c02e286 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.632478 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2069/4114] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:46.632554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabaacc-2aaf-45d8-8c51-f0d22c02e286 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.632554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabaacc-2aaf-45d8-8c51-f0d22c02e286 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.632692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba193f-ae55-47f9-ad9e-c9ab4d05537d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.632763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabaacc-2aaf-45d8-8c51-f0d22c02e286 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.646582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba193f-ae55-47f9-ad9e-c9ab4d05537d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.652225 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2046/4115] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/roles => generated 234 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:46.655752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f0d9-001c-4a01-9232-f6654e18d6b4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.656045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f0d9-001c-4a01-9232-f6654e18d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.656323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f0d9-001c-4a01-9232-f6654e18d6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.662199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.662821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.663136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.663378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.664109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:46.665186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.666821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.680044 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2070/4116] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:46.680902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.692633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3765f0d9-001c-4a01-9232-f6654e18d6b4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:46.694792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3765f0d9-001c-4a01-9232-f6654e18d6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.705257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0630-15e2-4785-a389-2d981d23932b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.716502 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2047/4117] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:46.718283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2045-b232-4273-ad6c-2601540ce107 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.719133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2045-b232-4273-ad6c-2601540ce107 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.719614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2045-b232-4273-ad6c-2601540ce107 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.719845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2045-b232-4273-ad6c-2601540ce107 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.720641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde2045-b232-4273-ad6c-2601540ce107 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.721666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765f0d9-001c-4a01-9232-f6654e18d6b4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.722391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde2045-b232-4273-ad6c-2601540ce107 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.734364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765f0d9-001c-4a01-9232-f6654e18d6b4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.740769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849a8ec-a417-4ad8-8e1e-a5f550945d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.741438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849a8ec-a417-4ad8-8e1e-a5f550945d5c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.741719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849a8ec-a417-4ad8-8e1e-a5f550945d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.742174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849a8ec-a417-4ad8-8e1e-a5f550945d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.742864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849a8ec-a417-4ad8-8e1e-a5f550945d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.745008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849a8ec-a417-4ad8-8e1e-a5f550945d5c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.753063 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2071/4118] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/domains => generated 277 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:46.754097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2045-b232-4273-ad6c-2601540ce107 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.780576 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2048/4119] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:46.781583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849a8ec-a417-4ad8-8e1e-a5f550945d5c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.846690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2045-b232-4273-ad6c-2601540ce107 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.894860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849a8ec-a417-4ad8-8e1e-a5f550945d5c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:46.900565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80444b35-3258-43d3-b2c1-1a7cf1d43c9a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.901436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80444b35-3258-43d3-b2c1-1a7cf1d43c9a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.902493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80444b35-3258-43d3-b2c1-1a7cf1d43c9a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.902951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80444b35-3258-43d3-b2c1-1a7cf1d43c9a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.904699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80444b35-3258-43d3-b2c1-1a7cf1d43c9a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.907624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80444b35-3258-43d3-b2c1-1a7cf1d43c9a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.920987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:46.940731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:46.942049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:46.943578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:46.946709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:46.947195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:46.950157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:46.968532 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2049/4120] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/projects => generated 400 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:46.968532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80444b35-3258-43d3-b2c1-1a7cf1d43c9a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.976189 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2072/4121] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:46.977321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:46.979471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:46.994103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4d91-081a-44f8-b3b0-ac3565d95d5b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.088155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.090836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.091229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.093646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] PATH_INFO: `/v3/projects/9076f1b9076b4cc9a0b043ffe2c918d4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.095207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9076f1b9076b4cc9a0b043ffe2c918d4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.096356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80444b35-3258-43d3-b2c1-1a7cf1d43c9a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.098430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.102245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8264-ddb4-4d73-96ca-47d728361641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.102997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8264-ddb4-4d73-96ca-47d728361641 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.103353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8264-ddb4-4d73-96ca-47d728361641 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.103705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8264-ddb4-4d73-96ca-47d728361641 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.104508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d8264-ddb4-4d73-96ca-47d728361641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.106754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d8264-ddb4-4d73-96ca-47d728361641 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.149638 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2050/4122] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:46 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:47.150637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8264-ddb4-4d73-96ca-47d728361641 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.159003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9076f1b9076b4cc9a0b043ffe2c918d4', 'request_id': 'req-1690c08f-4099-472c-8a47-3a4b8f4a345f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:47.171359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9076f1b9076b4cc9a0b043ffe2c918d4', 'request_id': 'req-1690c08f-4099-472c-8a47-3a4b8f4a345f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:47.185512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9076f1b9076b4cc9a0b043ffe2c918d4', 'request_id': 'req-1690c08f-4099-472c-8a47-3a4b8f4a345f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:47.206678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] The token cache is being invalidate because project 9076f1b9076b4cc9a0b043ffe2c918d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:47.207136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:47.207921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:47.213589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2073/4123] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:46 2022] DELETE /identity/v3/projects/9076f1b9076b4cc9a0b043ffe2c918d4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:47.213589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.215061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:47.234891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8264-ddb4-4d73-96ca-47d728361641 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.310404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.311849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.312248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.312668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/groups` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.313848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.321670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.323520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c08f-4099-472c-8a47-3a4b8f4a345f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.343181 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2051/4124] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/groups => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:47.344352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.345994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5a8f7-e6b7-4aa5-98b7-2a01f8231dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.346759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a8f7-e6b7-4aa5-98b7-2a01f8231dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.347147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a8f7-e6b7-4aa5-98b7-2a01f8231dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.347400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a8f7-e6b7-4aa5-98b7-2a01f8231dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.348369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5a8f7-e6b7-4aa5-98b7-2a01f8231dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.349053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:47.351442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5a8f7-e6b7-4aa5-98b7-2a01f8231dc9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.378072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cb0fe-bb67-451a-8b20-ef7133d271a2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.389900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.393963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.393963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.393963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.393963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.394764 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2074/4125] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:47.396480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a89c-fd6a-4079-81b6-d12d299cd8bd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.397242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.397547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a89c-fd6a-4079-81b6-d12d299cd8bd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.397973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a89c-fd6a-4079-81b6-d12d299cd8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.421020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3296a89c-fd6a-4079-81b6-d12d299cd8bd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:47.422570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3296a89c-fd6a-4079-81b6-d12d299cd8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:47.425189 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2052/4126] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:47 2022] GET /identity/v3/roles => generated 2096 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:47.426511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.428404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:47.452648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601348de-f314-4f03-ac34-4ecef76bc6ef admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.508600 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2075/4127] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:47.509608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296a89c-fd6a-4079-81b6-d12d299cd8bd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.520126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296a89c-fd6a-4079-81b6-d12d299cd8bd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.525573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9e71a-f183-4071-9cae-fd3a4512c7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.526463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e71a-f183-4071-9cae-fd3a4512c7db admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.526895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e71a-f183-4071-9cae-fd3a4512c7db admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.527308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e71a-f183-4071-9cae-fd3a4512c7db admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.528143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9e71a-f183-4071-9cae-fd3a4512c7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.530815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9e71a-f183-4071-9cae-fd3a4512c7db admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.560881 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2076/4128] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/users => generated 281 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:47.561967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9e71a-f183-4071-9cae-fd3a4512c7db admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.584126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c0fea-7723-4dad-9882-2dd438b33b2b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.584869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c0fea-7723-4dad-9882-2dd438b33b2b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.585159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c0fea-7723-4dad-9882-2dd438b33b2b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.585444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c0fea-7723-4dad-9882-2dd438b33b2b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.589057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9e71a-f183-4071-9cae-fd3a4512c7db admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.590230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c0fea-7723-4dad-9882-2dd438b33b2b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.593063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c0fea-7723-4dad-9882-2dd438b33b2b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.600377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01706005-390a-423d-b4d8-54a224ae25f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.600932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706005-390a-423d-b4d8-54a224ae25f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.601217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706005-390a-423d-b4d8-54a224ae25f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.601494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706005-390a-423d-b4d8-54a224ae25f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.602710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01706005-390a-423d-b4d8-54a224ae25f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.604067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01706005-390a-423d-b4d8-54a224ae25f5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.622566 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2077/4129] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:47 2022] GET /identity/v3/roles => generated 2096 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:47.623935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcef094-7057-4a72-9c22-9a9714fc2ddc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.624236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcef094-7057-4a72-9c22-9a9714fc2ddc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.624603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcef094-7057-4a72-9c22-9a9714fc2ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.640203 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2053/4130] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/roles => generated 234 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:47.640203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c0fea-7723-4dad-9882-2dd438b33b2b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.664101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c0fea-7723-4dad-9882-2dd438b33b2b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.675136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4bcef094-7057-4a72-9c22-9a9714fc2ddc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:47.676781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4bcef094-7057-4a72-9c22-9a9714fc2ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:47.678506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480c128-ac3a-4829-a5b1-7483183a4353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.679364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480c128-ac3a-4829-a5b1-7483183a4353 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.679652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480c128-ac3a-4829-a5b1-7483183a4353 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.679930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480c128-ac3a-4829-a5b1-7483183a4353 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.680767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480c128-ac3a-4829-a5b1-7483183a4353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.682404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480c128-ac3a-4829-a5b1-7483183a4353 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.692591 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2078/4131] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:47.696844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcef094-7057-4a72-9c22-9a9714fc2ddc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.701792 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2054/4132] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:47 2022] GET /identity/v3/roles => generated 2321 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:47.705851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480c128-ac3a-4829-a5b1-7483183a4353 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.717201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcef094-7057-4a72-9c22-9a9714fc2ddc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.724159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c524c15-257e-4ec9-9e8e-b7cb44d3cf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.724321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480c128-ac3a-4829-a5b1-7483183a4353 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.725615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c524c15-257e-4ec9-9e8e-b7cb44d3cf3c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.726124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c524c15-257e-4ec9-9e8e-b7cb44d3cf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.726597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c524c15-257e-4ec9-9e8e-b7cb44d3cf3c admin admin] PATH_INFO: `/v3/projects/7a57a217d29940808b9813a1ce1e8979/users/c3fa3f1b8d3344a299ee5dcf6073f159/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.729687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0433-408a-44d2-bc77-1192d8850b24 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.731031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0433-408a-44d2-bc77-1192d8850b24 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.731031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0433-408a-44d2-bc77-1192d8850b24 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.731227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0433-408a-44d2-bc77-1192d8850b24 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.732636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0433-408a-44d2-bc77-1192d8850b24 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.734650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0433-408a-44d2-bc77-1192d8850b24 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.745575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c524c15-257e-4ec9-9e8e-b7cb44d3cf3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a57a217d29940808b9813a1ce1e8979, user_id=c3fa3f1b8d3344a299ee5dcf6073f159, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.750643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c524c15-257e-4ec9-9e8e-b7cb44d3cf3c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.770476 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2055/4133] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/users => generated 442 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:47.779987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0433-408a-44d2-bc77-1192d8850b24 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.786037 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2079/4134] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:47 2022] PUT /identity/v3/projects/7a57a217d29940808b9813a1ce1e8979/users/c3fa3f1b8d3344a299ee5dcf6073f159/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:47.787079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c524c15-257e-4ec9-9e8e-b7cb44d3cf3c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.801132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0433-408a-44d2-bc77-1192d8850b24 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.891138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.891920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.892271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.892754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.893494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:47.893977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.895647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.896270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c524c15-257e-4ec9-9e8e-b7cb44d3cf3c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:47.901792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4cca-70dd-4a46-85d8-2a5edd32fb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:47.902472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4cca-70dd-4a46-85d8-2a5edd32fb89 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.902765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4cca-70dd-4a46-85d8-2a5edd32fb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.903094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4cca-70dd-4a46-85d8-2a5edd32fb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.904012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b4cca-70dd-4a46-85d8-2a5edd32fb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:47.905678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b4cca-70dd-4a46-85d8-2a5edd32fb89 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:47.910381 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2056/4135] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:47.914596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:47.920542 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2080/4136] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:47 2022] GET /identity/v3/roles => generated 2321 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:47.920542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728a46-869a-403a-9bfe-e7c25c65d92a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:47.920542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728a46-869a-403a-9bfe-e7c25c65d92a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:47.920542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728a46-869a-403a-9bfe-e7c25c65d92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:47.970467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1d728a46-869a-403a-9bfe-e7c25c65d92a None None] MFA Rules not processed for user `c3fa3f1b8d3344a299ee5dcf6073f159`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:47.971815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1d728a46-869a-403a-9bfe-e7c25c65d92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:48.010801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072464e9-105b-4f04-b88e-cfd2bc5b340a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.018121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.018939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.019346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.020538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.020538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.021863 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:48.021863 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:48.021863 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:48.022758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.047835 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2057/4137] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/roles => generated 269 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:48.049463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.056164 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2081/4138] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:48.062037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728a46-869a-403a-9bfe-e7c25c65d92a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.066687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64222e-26bf-427b-883a-7de58b393690 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.073467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728a46-869a-403a-9bfe-e7c25c65d92a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.074588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.075331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.076367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.076756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.077658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.079723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.080387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffeeb3-4b6d-4799-af98-90365de562be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.081519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffeeb3-4b6d-4799-af98-90365de562be admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.082093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffeeb3-4b6d-4799-af98-90365de562be admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.082570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffeeb3-4b6d-4799-af98-90365de562be admin admin] PATH_INFO: `/v3/projects/501b9a0931384c428494886fdfdb29cf/users/ee451cde194a478386128fef8e219c39/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.099659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffeeb3-4b6d-4799-af98-90365de562be admin admin] RBAC: Authorizing `identity:create_grant(project_id=501b9a0931384c428494886fdfdb29cf, user_id=ee451cde194a478386128fef8e219c39, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.104846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffeeb3-4b6d-4799-af98-90365de562be admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.124374 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2082/4139] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:48 2022] PUT /identity/v3/projects/501b9a0931384c428494886fdfdb29cf/users/ee451cde194a478386128fef8e219c39/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:48.124547 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2058/4140] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:48 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:48.125511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffeeb3-4b6d-4799-af98-90365de562be admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.125616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.129756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:48.223902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffeeb3-4b6d-4799-af98-90365de562be admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.243123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5da5b-81f5-4784-8302-42be2debec7d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.251148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf8104-2b5d-4e08-8d76-ab0ebdb0713b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.254156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8104-2b5d-4e08-8d76-ab0ebdb0713b service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.254156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8104-2b5d-4e08-8d76-ab0ebdb0713b service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.254383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8104-2b5d-4e08-8d76-ab0ebdb0713b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.337473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf8104-2b5d-4e08-8d76-ab0ebdb0713b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.339828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf8104-2b5d-4e08-8d76-ab0ebdb0713b service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.353472 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2059/4141] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:48.354660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf8104-2b5d-4e08-8d76-ab0ebdb0713b service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.364356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d85ce-ab97-441c-a02c-2bee448147a8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.365298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d85ce-ab97-441c-a02c-2bee448147a8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.369202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d85ce-ab97-441c-a02c-2bee448147a8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.369523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d85ce-ab97-441c-a02c-2bee448147a8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/229fc5313d544f6e9d7cd4f425e31f05` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.408184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d85ce-ab97-441c-a02c-2bee448147a8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=229fc5313d544f6e9d7cd4f425e31f05)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.410906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d85ce-ab97-441c-a02c-2bee448147a8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.454809 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2083/4142] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:48 2022] PUT /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/229fc5313d544f6e9d7cd4f425e31f05 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:48.459204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465ccae-987a-48f8-8beb-42e5d9bb8222 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.459496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465ccae-987a-48f8-8beb-42e5d9bb8222 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.459779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465ccae-987a-48f8-8beb-42e5d9bb8222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.502376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3465ccae-987a-48f8-8beb-42e5d9bb8222 None None] MFA Rules not processed for user `ee451cde194a478386128fef8e219c39`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:48.504228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3465ccae-987a-48f8-8beb-42e5d9bb8222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:48.507428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf8104-2b5d-4e08-8d76-ab0ebdb0713b service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.596979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6076ab-3fa1-4cc8-8f4e-7011a8066d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.597784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6076ab-3fa1-4cc8-8f4e-7011a8066d41 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.598130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6076ab-3fa1-4cc8-8f4e-7011a8066d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.598479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6076ab-3fa1-4cc8-8f4e-7011a8066d41 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.599369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6076ab-3fa1-4cc8-8f4e-7011a8066d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.601505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6076ab-3fa1-4cc8-8f4e-7011a8066d41 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.606069 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2084/4143] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:48.607801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465ccae-987a-48f8-8beb-42e5d9bb8222 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.624415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465ccae-987a-48f8-8beb-42e5d9bb8222 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.631482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.636992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.637919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.641228 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2060/4144] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:48 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:48.643031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] PATH_INFO: `/v3/users/c3fa3f1b8d3344a299ee5dcf6073f159` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.644200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6076ab-3fa1-4cc8-8f4e-7011a8066d41 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.645665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fa3f1b8d3344a299ee5dcf6073f159)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.650077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.730453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6076ab-3fa1-4cc8-8f4e-7011a8066d41 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.733435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fa3f1b8d3344a299ee5dcf6073f159'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:48.735770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.736453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.736736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.737031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.737822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Adding query filter params (scope.project.id=7b522b67b26f44c4a4672ed68c0d144d, user.id=bd2a6c563e4d4a53885101afd31dc1bc) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:48.738133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.740157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.748850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fa3f1b8d3344a299ee5dcf6073f159'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:48.757374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fa3f1b8d3344a299ee5dcf6073f159'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:48.758134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fa3f1b8d3344a299ee5dcf6073f159'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:48.762099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fa3f1b8d3344a299ee5dcf6073f159'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:48.777429 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2085/4145] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:48 2022] DELETE /identity/v3/users/c3fa3f1b8d3344a299ee5dcf6073f159 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:48.777429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.777429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:48.796399 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2061/4146] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:00:48 2022] GET /identity/v3/role_assignments?scope.project.id=7b522b67b26f44c4a4672ed68c0d144d&user.id=bd2a6c563e4d4a53885101afd31dc1bc&effective => generated 228 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:48.797399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.800721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:48.815881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c3b6b-df03-4779-8363-62d70ce6bec1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.866991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e334a96-b07e-4f5c-8ae3-287c76a18781 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:48.874229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.874890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.875206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.875463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.877365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:48.877928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685cd0-d00b-46ce-b434-d6372bb38e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:48.878803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685cd0-d00b-46ce-b434-d6372bb38e95 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.879279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685cd0-d00b-46ce-b434-d6372bb38e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.879728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685cd0-d00b-46ce-b434-d6372bb38e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.880790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93685cd0-d00b-46ce-b434-d6372bb38e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.882591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93685cd0-d00b-46ce-b434-d6372bb38e95 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.899152 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2062/4147] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:48 2022] GET /identity/v3/roles => generated 2321 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:48.900518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc192573-fed7-4189-ab1d-18b3e11d820a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:48.900814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc192573-fed7-4189-ab1d-18b3e11d820a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:48.901096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc192573-fed7-4189-ab1d-18b3e11d820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:48.919598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cc192573-fed7-4189-ab1d-18b3e11d820a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:48.920858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc192573-fed7-4189-ab1d-18b3e11d820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:48.928668 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2063/4148] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:48.929554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc192573-fed7-4189-ab1d-18b3e11d820a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.934989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc192573-fed7-4189-ab1d-18b3e11d820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:48.968557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:48.970437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:48.981056 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2086/4149] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:48.981953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:48.999130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9f715-1b8b-4af9-8cd0-e46d550f055e service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.009932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.011157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.011157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.011466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.013547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.014631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.032771 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2087/4150] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:48 2022] GET /identity/v3/roles => generated 2321 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:49.033540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:49.035368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.066524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc192573-fed7-4189-ab1d-18b3e11d820a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.071600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.073101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.073385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.073666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/229fc5313d544f6e9d7cd4f425e31f05` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.077615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=229fc5313d544f6e9d7cd4f425e31f05)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.078693 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:49.078693 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:49.078693 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:49.081870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.089240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role 229fc5313d544f6e9d7cd4f425e31f05 was removed from user bd2a6c563e4d4a53885101afd31dc1bc on project 7b522b67b26f44c4a4672ed68c0d144d. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:49.089535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.090270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.110844 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2064/4151] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Feb 19 21:00:48 2022] DELETE /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/229fc5313d544f6e9d7cd4f425e31f05 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:49.111406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:49.115755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.128429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aeca00-4817-4932-93c9-a17ae612cf8a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.197469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c189-40e9-451c-8d4f-8b4408bd2524 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.200166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.200898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.201184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.201502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.203025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.203291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.203948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.204307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.205838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] PATH_INFO: `/v3/projects/25f76e9ca2f54ad98c30b0dc6351be5c/users/9596b0d7c4a1461db4bbe63e2524f0e1/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.219512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.221346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f76e9ca2f54ad98c30b0dc6351be5c, user_id=9596b0d7c4a1461db4bbe63e2524f0e1, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.221594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.224012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.233278 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2088/4152] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:49.234249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:49.235707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.240846 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2065/4153] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:49 2022] PUT /identity/v3/projects/25f76e9ca2f54ad98c30b0dc6351be5c/users/9596b0d7c4a1461db4bbe63e2524f0e1/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:49.241594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:49.252604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.258524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217684b3-cef6-458b-8fdc-ebb063eb026a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.319055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1a2a-150c-45c7-9320-1889f5afec59 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.322085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.322995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.323866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.323971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.324395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] PATH_INFO: `/v3/users/ee451cde194a478386128fef8e219c39` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.324761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.325041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.325313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/229fc5313d544f6e9d7cd4f425e31f05` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.325775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee451cde194a478386128fef8e219c39)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.326770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=229fc5313d544f6e9d7cd4f425e31f05)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.327711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.327809 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:49.327809 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:49.327809 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:49.328783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.381207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role 229fc5313d544f6e9d7cd4f425e31f05 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:49.381593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.381700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee451cde194a478386128fef8e219c39'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.382660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b876533b-2d7e-4333-aab5-e174b5738310 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.384770 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2066/4154] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:49 2022] DELETE /identity/v3/roles/229fc5313d544f6e9d7cd4f425e31f05 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:49.386057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db404e-2ebc-45b7-a4dc-4f975f2778ba None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.386340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db404e-2ebc-45b7-a4dc-4f975f2778ba None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.386617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db404e-2ebc-45b7-a4dc-4f975f2778ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.400563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee451cde194a478386128fef8e219c39'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.411234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee451cde194a478386128fef8e219c39'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.412082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee451cde194a478386128fef8e219c39'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.413080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee451cde194a478386128fef8e219c39'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:49.425434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-61db404e-2ebc-45b7-a4dc-4f975f2778ba None None] MFA Rules not processed for user `9596b0d7c4a1461db4bbe63e2524f0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:49.426525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-61db404e-2ebc-45b7-a4dc-4f975f2778ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.428419 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2089/4155] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:49 2022] DELETE /identity/v3/users/ee451cde194a478386128fef8e219c39 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:49.429751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:49.432349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.523576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4c732-118d-40f2-b8a5-aeaf70917763 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.531332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68146c-8aec-4cdb-ab85-460a9eaa2b22 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.532599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68146c-8aec-4cdb-ab85-460a9eaa2b22 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.532886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68146c-8aec-4cdb-ab85-460a9eaa2b22 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.533172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68146c-8aec-4cdb-ab85-460a9eaa2b22 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/e676d43af97749f39748f410ed0834e7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.536186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68146c-8aec-4cdb-ab85-460a9eaa2b22 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=e676d43af97749f39748f410ed0834e7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.539068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68146c-8aec-4cdb-ab85-460a9eaa2b22 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.546242 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2067/4156] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:49.548440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1507ee-4737-4be2-8d70-e1b9c66a241b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.548822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1507ee-4737-4be2-8d70-e1b9c66a241b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.549133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1507ee-4737-4be2-8d70-e1b9c66a241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.561024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2090/4157] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:49 2022] PUT /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/e676d43af97749f39748f410ed0834e7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:49.562515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983faad-7981-4593-b9b1-99471d53d7ef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.562782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983faad-7981-4593-b9b1-99471d53d7ef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.563134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983faad-7981-4593-b9b1-99471d53d7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.583064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a983faad-7981-4593-b9b1-99471d53d7ef None None] MFA Rules not processed for user `9596b0d7c4a1461db4bbe63e2524f0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:49.584253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a983faad-7981-4593-b9b1-99471d53d7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.593487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-da1507ee-4737-4be2-8d70-e1b9c66a241b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:49.594822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-da1507ee-4737-4be2-8d70-e1b9c66a241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.660397 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2091/4158] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:49.660397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983faad-7981-4593-b9b1-99471d53d7ef None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:49.680666 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2068/4159] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:49.681308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1507ee-4737-4be2-8d70-e1b9c66a241b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:49.682640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-da1507ee-4737-4be2-8d70-e1b9c66a241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.762882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983faad-7981-4593-b9b1-99471d53d7ef None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.767883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.768815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.769785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.770091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.772160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.773027 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:49.773027 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:49.773027 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:49.774081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.811448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1507ee-4737-4be2-8d70-e1b9c66a241b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.828546 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2092/4160] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:00:49 2022] PUT /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 520 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:49.829687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:49.831763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:49.881616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f3b18-9ec7-4476-9854-ad70a492e67d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.882435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f3b18-9ec7-4476-9854-ad70a492e67d service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.882723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f3b18-9ec7-4476-9854-ad70a492e67d service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.883005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f3b18-9ec7-4476-9854-ad70a492e67d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.921647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1605c4-0f0c-4d09-9bdd-c8432484bf0a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:49.928042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:49.928748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:49.929033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:49.929312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:49.958172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f3b18-9ec7-4476-9854-ad70a492e67d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:49.963074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f3b18-9ec7-4476-9854-ad70a492e67d service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:49.982612 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2069/4161] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:49.983446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f3b18-9ec7-4476-9854-ad70a492e67d service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.082334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.083823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.100817 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2093/4162] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:50.103186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.106221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:50.124613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7835a48-ebb1-48a5-a640-4b490a02ac9a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:50.129933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:50.130814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.131095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.131374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] PATH_INFO: `/v3/projects/7a57a217d29940808b9813a1ce1e8979` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.132619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a57a217d29940808b9813a1ce1e8979)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.134719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.144620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f3b18-9ec7-4476-9854-ad70a492e67d service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:50.158333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:50.159408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.160685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.161130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.162189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Adding query filter params (scope.project.id=7b522b67b26f44c4a4672ed68c0d144d, user.id=bd2a6c563e4d4a53885101afd31dc1bc) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:50.163198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.165861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.227336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a57a217d29940808b9813a1ce1e8979', 'request_id': 'req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:50.234504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a57a217d29940808b9813a1ce1e8979', 'request_id': 'req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:50.240714 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2070/4163] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:00:49 2022] GET /identity/v3/role_assignments?scope.project.id=7b522b67b26f44c4a4672ed68c0d144d&user.id=bd2a6c563e4d4a53885101afd31dc1bc&effective => generated 1061 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:50.244050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.248324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a57a217d29940808b9813a1ce1e8979', 'request_id': 'req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:50.262002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1324c-82a7-4355-a004-65ca1e54ffba tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:50.272361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] The token cache is being invalidate because project 7a57a217d29940808b9813a1ce1e8979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:50.272990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:50.273360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0c3f20d0-4178-43e3-a1d1-7a0a628b92d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:50.281475 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2094/4164] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:50 2022] DELETE /identity/v3/projects/7a57a217d29940808b9813a1ce1e8979 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:50.283047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19eae-e461-4f11-a116-fe84bad88637 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.283698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19eae-e461-4f11-a116-fe84bad88637 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.284047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19eae-e461-4f11-a116-fe84bad88637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.313368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-89a19eae-e461-4f11-a116-fe84bad88637 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:50.314612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-89a19eae-e461-4f11-a116-fe84bad88637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:50.378692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:50.380129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.380685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.381203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.386234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.387624 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:50.387624 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:50.387624 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:50.389703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.424688 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2071/4165] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:00:50 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:50.427232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.428568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:50.439783 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2095/4166] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:50.448070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472695-5032-4160-afd6-da5e6b685c9a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.448909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472695-5032-4160-afd6-da5e6b685c9a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.449136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472695-5032-4160-afd6-da5e6b685c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.477619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-74472695-5032-4160-afd6-da5e6b685c9a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:50.479508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-74472695-5032-4160-afd6-da5e6b685c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:50.545690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5861ff-c5a8-41d9-a9d7-80adc7246d81 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:50.552304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:50.552876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.553138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.553464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.554405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Adding query filter params (scope.project.id=7b522b67b26f44c4a4672ed68c0d144d, user.id=bd2a6c563e4d4a53885101afd31dc1bc) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:50.554725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.557322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.580188 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2096/4167] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:50.585473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74472695-5032-4160-afd6-da5e6b685c9a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.596420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74472695-5032-4160-afd6-da5e6b685c9a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:50.602734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:50.603418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.603733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.603977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.604883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:50.605196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.607442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.626589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2097/4168] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:50.627501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.647800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b3a4-b6a9-40b0-aa66-58aeb354473e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:50.652063 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2072/4169] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:00:50 2022] GET /identity/v3/role_assignments?scope.project.id=7b522b67b26f44c4a4672ed68c0d144d&user.id=bd2a6c563e4d4a53885101afd31dc1bc&effective => generated 577 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:50.655013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954d6a0-7db6-446c-97d1-0641bfafb058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:50.656640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954d6a0-7db6-446c-97d1-0641bfafb058 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.656796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.657098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954d6a0-7db6-446c-97d1-0641bfafb058 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.657397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954d6a0-7db6-446c-97d1-0641bfafb058 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.658220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954d6a0-7db6-446c-97d1-0641bfafb058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.664366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954d6a0-7db6-446c-97d1-0641bfafb058 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.668298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805c0c5-cb94-4312-a646-102ff956a28e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:50.674165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:50.675300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.675691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.676040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.677914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.679803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.713282 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2098/4170] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:50 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:50.715257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954d6a0-7db6-446c-97d1-0641bfafb058 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.718365 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] e676d43af97749f39748f410ed0834e7 does not imply 0998fa60481a42b58102ffd1391957da.: keystone.exception.ImpliedRoleNotFound: e676d43af97749f39748f410ed0834e7 does not imply 0998fa60481a42b58102ffd1391957da. Feb 19 21:00:50.720954 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2073/4171] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:00:50 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 137 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:00:50.725364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.758018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f7f1-c240-424f-b50f-d42b3610e01d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:50.833771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:50.835007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:50.835398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:50.835709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/e676d43af97749f39748f410ed0834e7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:50.846065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=e676d43af97749f39748f410ed0834e7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:50.850592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:50.881834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role e676d43af97749f39748f410ed0834e7 was removed from user bd2a6c563e4d4a53885101afd31dc1bc on project 7b522b67b26f44c4a4672ed68c0d144d. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:50.882139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:50.884897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:50.925280 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2074/4172] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Feb 19 21:00:50 2022] DELETE /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/e676d43af97749f39748f410ed0834e7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:50.937492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:50.945931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:50.971626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954d6a0-7db6-446c-97d1-0641bfafb058 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.052319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec77f-2024-4aac-aa5c-ddd88b7a5436 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.057753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf015-7b4d-4e9f-ad0b-f2544e783749 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.058866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf015-7b4d-4e9f-ad0b-f2544e783749 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.058990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf015-7b4d-4e9f-ad0b-f2544e783749 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.059499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf015-7b4d-4e9f-ad0b-f2544e783749 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.061131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bf015-7b4d-4e9f-ad0b-f2544e783749 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.064466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bf015-7b4d-4e9f-ad0b-f2544e783749 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.090799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.092587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.092587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.092760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.093354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.095758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.100055 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2075/4173] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:50 2022] POST /identity/v3/roles => generated 271 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:51.109419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf015-7b4d-4e9f-ad0b-f2544e783749 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.127968 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2099/4174] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:50 2022] POST /identity/v3/users => generated 288 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:51.131936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.133412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf015-7b4d-4e9f-ad0b-f2544e783749 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.134283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:51.139719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.140739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.141105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.141462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.142240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Adding query filter params (domain_id=d55891560cda4991b7d8bbccc5a740cc) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:51.142576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.143890 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:51.143890 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:51.143890 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:51.144966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.158324 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2076/4175] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Feb 19 21:00:51 2022] GET /identity/v3/roles?domain_id=d55891560cda4991b7d8bbccc5a740cc => generated 408 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:51.160448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.163211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513a6c7-54e2-4447-be6b-1ff1635bb0f1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.163340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:51.178602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.179986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.179986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.179986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] PATH_INFO: `/v3/projects/501b9a0931384c428494886fdfdb29cf` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.180480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197bc2b-77fe-4309-9eb5-5c8da5ffe24c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.181503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501b9a0931384c428494886fdfdb29cf)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.183658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.190834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d24895-e173-44cd-b639-d12a258d8710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.192404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d24895-e173-44cd-b639-d12a258d8710 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.192904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d24895-e173-44cd-b639-d12a258d8710 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.193208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d24895-e173-44cd-b639-d12a258d8710 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.194088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d24895-e173-44cd-b639-d12a258d8710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.196655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d24895-e173-44cd-b639-d12a258d8710 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.213243 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2077/4176] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:51 2022] GET /identity/v3/roles => generated 2321 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:51.214870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d24895-e173-44cd-b639-d12a258d8710 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.228922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d24895-e173-44cd-b639-d12a258d8710 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.235231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.236291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.236624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.236906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/99a659cc175f45e2972c589e8b1a89dd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.238613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=99a659cc175f45e2972c589e8b1a89dd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.240623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.251277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501b9a0931384c428494886fdfdb29cf', 'request_id': 'req-5f26a826-50c8-4914-b19b-bd55b1702f63'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:51.257203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501b9a0931384c428494886fdfdb29cf', 'request_id': 'req-5f26a826-50c8-4914-b19b-bd55b1702f63'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:51.271951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501b9a0931384c428494886fdfdb29cf', 'request_id': 'req-5f26a826-50c8-4914-b19b-bd55b1702f63'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:51.316820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] The token cache is being invalidate because project 501b9a0931384c428494886fdfdb29cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:51.317663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:51.318583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:51.320206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role 99a659cc175f45e2972c589e8b1a89dd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:51.320739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:51.321828 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2100/4177] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:51 2022] DELETE /identity/v3/projects/501b9a0931384c428494886fdfdb29cf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:51.323109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.323727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3748bfc7-7ee3-4883-baa4-3c4f105a56bb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:51.329312 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2078/4178] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:51 2022] DELETE /identity/v3/roles/99a659cc175f45e2972c589e8b1a89dd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:51.333817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf5ed-df8d-4ac5-bb3a-7f1811195f70 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.334351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf5ed-df8d-4ac5-bb3a-7f1811195f70 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.334729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf5ed-df8d-4ac5-bb3a-7f1811195f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.338056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:51.365073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-20bcf5ed-df8d-4ac5-bb3a-7f1811195f70 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:51.366661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-20bcf5ed-df8d-4ac5-bb3a-7f1811195f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:51.496251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a826-50c8-4914-b19b-bd55b1702f63 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.503176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbd8af-68f5-4d19-ad5a-c8ff32f2025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.503970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbd8af-68f5-4d19-ad5a-c8ff32f2025e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.504259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbd8af-68f5-4d19-ad5a-c8ff32f2025e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.504622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbd8af-68f5-4d19-ad5a-c8ff32f2025e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.505356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbd8af-68f5-4d19-ad5a-c8ff32f2025e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.507563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbd8af-68f5-4d19-ad5a-c8ff32f2025e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.510154 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2079/4179] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:51.511553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcf5ed-df8d-4ac5-bb3a-7f1811195f70 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.513865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-20bcf5ed-df8d-4ac5-bb3a-7f1811195f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:51.523080 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2101/4180] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:51 2022] GET /identity/v3/roles => generated 2321 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:51.524716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec149c-5dea-403c-a50f-49f88f5364ef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.525016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec149c-5dea-403c-a50f-49f88f5364ef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.525301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec149c-5dea-403c-a50f-49f88f5364ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.551783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-22ec149c-5dea-403c-a50f-49f88f5364ef None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:51.553939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-22ec149c-5dea-403c-a50f-49f88f5364ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:51.565968 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2102/4181] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:51.567827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec149c-5dea-403c-a50f-49f88f5364ef None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.570913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-22ec149c-5dea-403c-a50f-49f88f5364ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:51.594006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec149c-5dea-403c-a50f-49f88f5364ef None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.599115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c870c8-310e-4412-95dd-a9c6656bddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.600017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c870c8-310e-4412-95dd-a9c6656bddef admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.600505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c870c8-310e-4412-95dd-a9c6656bddef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.600930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c870c8-310e-4412-95dd-a9c6656bddef admin admin] PATH_INFO: `/v3/projects/0a67095fabac457da3239e727c92e4ab/users/71f534f513ef45d29629b913de461f23/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.612274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcf5ed-df8d-4ac5-bb3a-7f1811195f70 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.618324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.619169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.619447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.619810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.620784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Adding query filter params (domain_id=d55891560cda4991b7d8bbccc5a740cc) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:51.621169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.623133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.631040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2080/4182] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Feb 19 21:00:51 2022] GET /identity/v3/roles?domain_id=d55891560cda4991b7d8bbccc5a740cc => generated 148 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:51.632157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.633563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c870c8-310e-4412-95dd-a9c6656bddef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a67095fabac457da3239e727c92e4ab, user_id=71f534f513ef45d29629b913de461f23, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.637056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c870c8-310e-4412-95dd-a9c6656bddef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.647254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7bae9-ef4f-4c09-bcdf-c0a57a06ca6e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.654494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52168040-ac11-419b-9ce7-db997fbae7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.655315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168040-ac11-419b-9ce7-db997fbae7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.655915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168040-ac11-419b-9ce7-db997fbae7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.656355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168040-ac11-419b-9ce7-db997fbae7f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.657165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52168040-ac11-419b-9ce7-db997fbae7f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:51.657546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52168040-ac11-419b-9ce7-db997fbae7f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.659544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52168040-ac11-419b-9ce7-db997fbae7f9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.659991 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2103/4183] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:51 2022] PUT /identity/v3/projects/0a67095fabac457da3239e727c92e4ab/users/71f534f513ef45d29629b913de461f23/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:51.676369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c870c8-310e-4412-95dd-a9c6656bddef admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.678710 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2081/4184] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:51.680429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12afd0-238c-4d19-a3c8-07d916396186 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.681109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12afd0-238c-4d19-a3c8-07d916396186 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.681293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12afd0-238c-4d19-a3c8-07d916396186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.729637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0e12afd0-238c-4d19-a3c8-07d916396186 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:51.731079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0e12afd0-238c-4d19-a3c8-07d916396186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:51.808885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c870c8-310e-4412-95dd-a9c6656bddef admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.816574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca6ea2-d3ce-4928-9db5-abcf9a86690f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.818068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6ea2-d3ce-4928-9db5-abcf9a86690f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.818713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6ea2-d3ce-4928-9db5-abcf9a86690f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.819204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6ea2-d3ce-4928-9db5-abcf9a86690f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/99a659cc175f45e2972c589e8b1a89dd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.833675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca6ea2-d3ce-4928-9db5-abcf9a86690f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:00:51.846856 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-30ca6ea2-d3ce-4928-9db5-abcf9a86690f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Could not find role: 99a659cc175f45e2972c589e8b1a89dd.: keystone.exception.RoleNotFound: Could not find role: 99a659cc175f45e2972c589e8b1a89dd. Feb 19 21:00:51.849376 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2104/4185] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:51 2022] DELETE /identity/v3/roles/99a659cc175f45e2972c589e8b1a89dd => generated 110 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:00:51.850328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca6ea2-d3ce-4928-9db5-abcf9a86690f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.871545 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2082/4186] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:51.871545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12afd0-238c-4d19-a3c8-07d916396186 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.883027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12afd0-238c-4d19-a3c8-07d916396186 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:51.889867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3c6d8-3af4-4b1c-b2e5-2a4134c36618 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:51.891719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c6d8-3af4-4b1c-b2e5-2a4134c36618 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:51.892108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c6d8-3af4-4b1c-b2e5-2a4134c36618 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:51.892499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c6d8-3af4-4b1c-b2e5-2a4134c36618 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:51.905788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3c6d8-3af4-4b1c-b2e5-2a4134c36618 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d55891560cda4991b7d8bbccc5a740cc, group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:51.909960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3c6d8-3af4-4b1c-b2e5-2a4134c36618 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:51.930583 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2083/4187] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:51 2022] PUT /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:51.935262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3c6d8-3af4-4b1c-b2e5-2a4134c36618 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:51.955205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca6ea2-d3ce-4928-9db5-abcf9a86690f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.010843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3c6d8-3af4-4b1c-b2e5-2a4134c36618 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.016214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.017146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.017396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.017675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc/groups/e77c0625d60f422dab460e89e6b6edb2/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.019443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=d55891560cda4991b7d8bbccc5a740cc, group_id=e77c0625d60f422dab460e89e6b6edb2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.020506 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:52.020506 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:52.020506 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:52.022310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.024461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615cb4-a3fd-4d09-be7d-f1349dd4bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.025402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615cb4-a3fd-4d09-be7d-f1349dd4bae1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.025863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615cb4-a3fd-4d09-be7d-f1349dd4bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.026260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615cb4-a3fd-4d09-be7d-f1349dd4bae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.026953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71615cb4-a3fd-4d09-be7d-f1349dd4bae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.029781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71615cb4-a3fd-4d09-be7d-f1349dd4bae1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.038861 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2084/4188] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Feb 19 21:00:51 2022] GET /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc/groups/e77c0625d60f422dab460e89e6b6edb2/roles => generated 409 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:00:52.039537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.041420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:52.060697 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2105/4189] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:51 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:52.061825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615cb4-a3fd-4d09-be7d-f1349dd4bae1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.114598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44264601-9104-479f-a218-6ee89ec423d1 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.128454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615cb4-a3fd-4d09-be7d-f1349dd4bae1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.134451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.135516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.135811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.136089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.138909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=d55891560cda4991b7d8bbccc5a740cc, group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.139931 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:52.139931 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:52.139931 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:52.141853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.152441 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2106/4190] 10.222.0.30 () {58 vars in 1464 bytes} [Sat Feb 19 21:00:52 2022] HEAD /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:52.155194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.175579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36f6a-ce9e-4df4-9c14-027f10f5b03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.177163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36f6a-ce9e-4df4-9c14-027f10f5b03f service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.177163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36f6a-ce9e-4df4-9c14-027f10f5b03f service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.177163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36f6a-ce9e-4df4-9c14-027f10f5b03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.223882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73856ae8-6e44-426f-b890-a59aee555797 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.229475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9ea59-b0a2-4f9b-9afd-beeff3665759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.230162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ea59-b0a2-4f9b-9afd-beeff3665759 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.230447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ea59-b0a2-4f9b-9afd-beeff3665759 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.230914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ea59-b0a2-4f9b-9afd-beeff3665759 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.231613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9ea59-b0a2-4f9b-9afd-beeff3665759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.234233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9ea59-b0a2-4f9b-9afd-beeff3665759 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.250605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b36f6a-ce9e-4df4-9c14-027f10f5b03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.252218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b36f6a-ce9e-4df4-9c14-027f10f5b03f service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.267427 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2085/4191] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:52.269094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36f6a-ce9e-4df4-9c14-027f10f5b03f service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.274832 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2107/4192] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:52 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:52.276126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9ea59-b0a2-4f9b-9afd-beeff3665759 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.282143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36f6a-ce9e-4df4-9c14-027f10f5b03f service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.288658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.290036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.290036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.291479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.293909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d55891560cda4991b7d8bbccc5a740cc, group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.297774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.298710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9ea59-b0a2-4f9b-9afd-beeff3665759 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.304311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role b54ade9579134389a0c05c4b9795ab12 was removed from group e77c0625d60f422dab460e89e6b6edb2 on domain d55891560cda4991b7d8bbccc5a740cc. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:52.304637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:52.305392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:52.312109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.312866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.313148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.313418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.314325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.315981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.334643 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2086/4193] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Feb 19 21:00:52 2022] DELETE /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:52.337236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.339618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:52.349853 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2108/4194] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:52 2022] GET /identity/v3/roles => generated 2321 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:52.353884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.358679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:52.384412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ae4ef-de5b-43d0-880e-f5c57e6bee4c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.501026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6feaa-c728-429a-97a6-f2d4ff3e4d8b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.512287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae737-90c6-473e-9500-99891586814d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.515045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae737-90c6-473e-9500-99891586814d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.516496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae737-90c6-473e-9500-99891586814d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.516936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae737-90c6-473e-9500-99891586814d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.521176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae737-90c6-473e-9500-99891586814d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.524850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae737-90c6-473e-9500-99891586814d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.535215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba5ad-cae4-4176-965c-493456708b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.536603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba5ad-cae4-4176-965c-493456708b40 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.537061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba5ad-cae4-4176-965c-493456708b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.537533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ba5ad-cae4-4176-965c-493456708b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.538687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ba5ad-cae4-4176-965c-493456708b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.540586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ba5ad-cae4-4176-965c-493456708b40 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.554426 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2109/4195] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:52 2022] GET /identity/v3/roles => generated 2321 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:00:52.559543 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2087/4196] 10.222.0.30 () {60 vars in 1485 bytes} [Sat Feb 19 21:00:52 2022] PUT /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:52.559942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba5ad-cae4-4176-965c-493456708b40 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.561082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae737-90c6-473e-9500-99891586814d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.569241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ba5ad-cae4-4176-965c-493456708b40 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.665954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae737-90c6-473e-9500-99891586814d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.671956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82f9c5-36e0-4c96-b62b-9822db67cbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.672545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d579-78f0-481e-9858-37b1f426c21f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.673091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82f9c5-36e0-4c96-b62b-9822db67cbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.673381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82f9c5-36e0-4c96-b62b-9822db67cbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.673657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82f9c5-36e0-4c96-b62b-9822db67cbfa admin admin] PATH_INFO: `/v3/projects/4aca9e397c334bb997f450e919088286/users/a36b20fc4b8b4b71aea23626d52cefa9/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.675315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d579-78f0-481e-9858-37b1f426c21f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.675924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d579-78f0-481e-9858-37b1f426c21f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.676356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d579-78f0-481e-9858-37b1f426c21f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/groups/e77c0625d60f422dab460e89e6b6edb2/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.680398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7d579-78f0-481e-9858-37b1f426c21f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_grants(project_id=7b522b67b26f44c4a4672ed68c0d144d, group_id=e77c0625d60f422dab460e89e6b6edb2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.683515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7d579-78f0-481e-9858-37b1f426c21f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.706473 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2088/4197] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Feb 19 21:00:52 2022] GET /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/groups/e77c0625d60f422dab460e89e6b6edb2/roles => generated 410 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:52.706596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82f9c5-36e0-4c96-b62b-9822db67cbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aca9e397c334bb997f450e919088286, user_id=a36b20fc4b8b4b71aea23626d52cefa9, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.709757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82f9c5-36e0-4c96-b62b-9822db67cbfa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.713313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d579-78f0-481e-9858-37b1f426c21f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:52.726368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d579-78f0-481e-9858-37b1f426c21f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:52.744385 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2110/4198] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:52 2022] PUT /identity/v3/projects/4aca9e397c334bb997f450e919088286/users/a36b20fc4b8b4b71aea23626d52cefa9/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:52.746080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0c44-ac07-413c-a6d5-0e51f5051441 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.746374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0c44-ac07-413c-a6d5-0e51f5051441 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.746661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0c44-ac07-413c-a6d5-0e51f5051441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.777512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-37fb0c44-ac07-413c-a6d5-0e51f5051441 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:52.779778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37fb0c44-ac07-413c-a6d5-0e51f5051441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:52.817856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8cadc-9a7c-40c8-a9c2-33c988b6e044 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:52.819459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8cadc-9a7c-40c8-a9c2-33c988b6e044 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.819752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8cadc-9a7c-40c8-a9c2-33c988b6e044 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.820035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8cadc-9a7c-40c8-a9c2-33c988b6e044 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/groups/e77c0625d60f422dab460e89e6b6edb2/users/bd2a6c563e4d4a53885101afd31dc1bc` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.822754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8cadc-9a7c-40c8-a9c2-33c988b6e044 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e77c0625d60f422dab460e89e6b6edb2, user_id=bd2a6c563e4d4a53885101afd31dc1bc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:52.825665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8cadc-9a7c-40c8-a9c2-33c988b6e044 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:52.864677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2089/4199] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Feb 19 21:00:52 2022] PUT /identity/v3/groups/e77c0625d60f422dab460e89e6b6edb2/users/bd2a6c563e4d4a53885101afd31dc1bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:52.866810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ee4a7-6c31-45c4-8958-e71a022b7569 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:52.867122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ee4a7-6c31-45c4-8958-e71a022b7569 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:52.867388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ee4a7-6c31-45c4-8958-e71a022b7569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:52.871949 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2111/4200] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:00:52.910730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-641ee4a7-6c31-45c4-8958-e71a022b7569 None None] MFA Rules not processed for user `bd2a6c563e4d4a53885101afd31dc1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:52.911979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-641ee4a7-6c31-45c4-8958-e71a022b7569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:53.020279 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2090/4201] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:53.022204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb0c44-ac07-413c-a6d5-0e51f5051441 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.022596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ee4a7-6c31-45c4-8958-e71a022b7569 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.024267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37fb0c44-ac07-413c-a6d5-0e51f5051441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:53.156650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ee4a7-6c31-45c4-8958-e71a022b7569 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.166314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.167249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.167564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.168604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.177703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:check_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.177703 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:53.177703 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:53.177703 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:53.179333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.193738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb0c44-ac07-413c-a6d5-0e51f5051441 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.195767 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2091/4202] 10.222.0.30 () {58 vars in 1467 bytes} [Sat Feb 19 21:00:53 2022] HEAD /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:53.197794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.213092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc124-7ed4-4663-a690-6432fc64de36 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.218733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.219622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.219912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.220197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.223079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.225713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.231540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role b54ade9579134389a0c05c4b9795ab12 was removed from group e77c0625d60f422dab460e89e6b6edb2 on project 7b522b67b26f44c4a4672ed68c0d144d. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:53.232757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:53.233700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:53.251296 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2092/4203] 10.222.0.30 () {58 vars in 1469 bytes} [Sat Feb 19 21:00:53 2022] DELETE /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:53.252506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.254480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:53.267654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.268305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.268631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.268901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.270636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:53.324198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402c93-6aa0-4c26-b739-eb75f4a8b301 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.331935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.332870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.333609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.334037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] PATH_INFO: `/v3/users/7e219f40a5174a76a7ae73622dafbbd9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.337348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e219f40a5174a76a7ae73622dafbbd9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.341778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.353188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.357249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.381396 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2112/4204] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:53.382419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.385200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:53.402246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9be4-62d5-43c0-a20f-bb2396547844 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.447468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e219f40a5174a76a7ae73622dafbbd9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:53.449278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e219f40a5174a76a7ae73622dafbbd9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:53.451026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e219f40a5174a76a7ae73622dafbbd9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:53.482824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e219f40a5174a76a7ae73622dafbbd9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:53.500237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e219f40a5174a76a7ae73622dafbbd9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:53.505684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.508897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.509555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.510209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/groups/e77c0625d60f422dab460e89e6b6edb2/users/bd2a6c563e4d4a53885101afd31dc1bc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.512490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=e77c0625d60f422dab460e89e6b6edb2, user_id=bd2a6c563e4d4a53885101afd31dc1bc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.515597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.534215 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2093/4205] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:53 2022] DELETE /identity/v3/users/7e219f40a5174a76a7ae73622dafbbd9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:53.537011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bd2a6c563e4d4a53885101afd31dc1bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:53.561097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.561310 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2113/4206] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Feb 19 21:00:53 2022] DELETE /identity/v3/groups/e77c0625d60f422dab460e89e6b6edb2/users/bd2a6c563e4d4a53885101afd31dc1bc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:53.561394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:53.645899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7bb3-1c78-4ed2-a292-d5f5d535c2d8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.761611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.763645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.765319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.765911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/system/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.775849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.780742 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:53.780742 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:53.780742 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:53.783020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.803330 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2094/4207] 10.222.0.30 () {60 vars in 1380 bytes} [Sat Feb 19 21:00:53 2022] PUT /identity/v3/system/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:53.810157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.844665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32ba1-a093-464b-9a27-2791879f460b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.854227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.856166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.856631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.857673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/system/groups/e77c0625d60f422dab460e89e6b6edb2/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.863154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=e77c0625d60f422dab460e89e6b6edb2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.864674 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:53.864674 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:53.864674 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:53.865900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.886965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2114/4208] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:00:53 2022] GET /identity/v3/system/groups/e77c0625d60f422dab460e89e6b6edb2/roles => generated 375 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:53.887892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.899610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab45b9-ae37-46cc-a829-4f038ef71251 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.905095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.905959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.906627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.906627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/system/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.908517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.909469 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:53.909469 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:00:53.909469 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:00:53.910404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.917652 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2095/4209] 10.222.0.30 () {58 vars in 1362 bytes} [Sat Feb 19 21:00:53 2022] HEAD /identity/v3/system/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:53.922424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.933729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c27fb-0cf2-4243-86fe-d95717ea330f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:53.941159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:53.942544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:53.942840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:53.943123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/system/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:53.946289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=e77c0625d60f422dab460e89e6b6edb2, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:53.947342 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:53.947342 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:53.947342 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:53.948946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:53.969511 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2115/4210] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Feb 19 21:00:53 2022] DELETE /identity/v3/system/groups/e77c0625d60f422dab460e89e6b6edb2/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:53.971335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:53.994066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ddd56-1975-4101-8e36-2c72532aa31a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:54.002178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019c21c-4c51-4812-9b45-30e889a6dfdb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:54.003430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019c21c-4c51-4812-9b45-30e889a6dfdb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:54.003900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019c21c-4c51-4812-9b45-30e889a6dfdb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:54.004432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019c21c-4c51-4812-9b45-30e889a6dfdb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:54.007373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019c21c-4c51-4812-9b45-30e889a6dfdb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d55891560cda4991b7d8bbccc5a740cc, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:54.011091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019c21c-4c51-4812-9b45-30e889a6dfdb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:54.034232 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2096/4211] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Feb 19 21:00:53 2022] PUT /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:54.036045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:54.053954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6787b-fb82-4284-8e17-f7401d817b7a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:54.168631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:54.171049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:54.171824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:54.172314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc/users/bd2a6c563e4d4a53885101afd31dc1bc/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:54.177034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=d55891560cda4991b7d8bbccc5a740cc, user_id=bd2a6c563e4d4a53885101afd31dc1bc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:54.180417 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:54.180417 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:54.180417 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:54.185465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:54.215110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019c21c-4c51-4812-9b45-30e889a6dfdb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:54.227844 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2116/4212] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Feb 19 21:00:54 2022] GET /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc/users/bd2a6c563e4d4a53885101afd31dc1bc/roles => generated 408 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:00:54.233003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019c21c-4c51-4812-9b45-30e889a6dfdb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:54.243005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:54.243888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:54.244175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:54.244619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:54.249287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=d55891560cda4991b7d8bbccc5a740cc, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:54.253076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:54.269331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:54.270114 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2097/4213] 10.222.0.30 () {58 vars in 1461 bytes} [Sat Feb 19 21:00:54 2022] HEAD /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:54.283631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e03545-8f0c-47f5-b09e-42aaf84d7eb2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:54.293809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:54.295309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:54.295603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:54.295941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:54.299893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d55891560cda4991b7d8bbccc5a740cc, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:54.301155 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:54.301155 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:54.301155 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:54.304511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:54.315209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role b54ade9579134389a0c05c4b9795ab12 was removed from user bd2a6c563e4d4a53885101afd31dc1bc on domain d55891560cda4991b7d8bbccc5a740cc. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:54.315597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:54.316269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:54.365501 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2117/4214] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 21:00:54 2022] DELETE /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:54.366910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:54.376006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:54.408560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468396dd-4486-4c34-bcdd-50fccf43f0fb tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:54.440546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:54.443001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:54.524014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:54.526442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:54.527009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:54.527639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:54.531095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:54.534769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:54.583529 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2098/4215] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:54 2022] PUT /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:54.585132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:54.593215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:54.641888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9313-ea2e-47b7-b478-2d1eb66f25c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:54.769609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3526b84-d399-4ad6-a2f3-da077550f5cd tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:54.784358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:54.785349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:54.785635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:54.785916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] PATH_INFO: `/v3/users/c1228a82f58d4d69b9eff6ab06e91519` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:54.787733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1228a82f58d4d69b9eff6ab06e91519)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:54.789834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:54.792818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:54.793824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:54.794425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:54.797864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] PATH_INFO: `/v3/projects/a72053a62e744590945ce7fd8a1f33ae` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:54.799653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72053a62e744590945ce7fd8a1f33ae)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:54.801715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:54.924723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1228a82f58d4d69b9eff6ab06e91519'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:54.926599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1228a82f58d4d69b9eff6ab06e91519'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:54.928487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1228a82f58d4d69b9eff6ab06e91519'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:54.960012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72053a62e744590945ce7fd8a1f33ae', 'request_id': 'req-f7a29105-a250-4f03-8e88-34ddf8f557af'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:54.969819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1228a82f58d4d69b9eff6ab06e91519'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:54.980465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72053a62e744590945ce7fd8a1f33ae', 'request_id': 'req-f7a29105-a250-4f03-8e88-34ddf8f557af'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:54.996297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1228a82f58d4d69b9eff6ab06e91519'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:55.011886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72053a62e744590945ce7fd8a1f33ae', 'request_id': 'req-f7a29105-a250-4f03-8e88-34ddf8f557af'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:55.030952 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2099/4216] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:54 2022] DELETE /identity/v3/users/c1228a82f58d4d69b9eff6ab06e91519 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:55.032179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.032867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] The token cache is being invalidate because project a72053a62e744590945ce7fd8a1f33ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:55.034895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:55.036219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7a29105-a250-4f03-8e88-34ddf8f557af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:55.043485 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2118/4217] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:54 2022] DELETE /identity/v3/projects/a72053a62e744590945ce7fd8a1f33ae => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:55.043485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c6bc-9119-4ac0-9947-9bd6cc6954ac None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.044742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c6bc-9119-4ac0-9947-9bd6cc6954ac None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.044860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c6bc-9119-4ac0-9947-9bd6cc6954ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.045213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:55.085221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0451c6bc-9119-4ac0-9947-9bd6cc6954ac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:55.086495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0451c6bc-9119-4ac0-9947-9bd6cc6954ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:55.205528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8180df-c248-4164-956f-dc10683a3a73 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.218750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2a6b6-75e0-43b5-997e-89dc44f37fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.219937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2a6b6-75e0-43b5-997e-89dc44f37fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.220480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2a6b6-75e0-43b5-997e-89dc44f37fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.220725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2a6b6-75e0-43b5-997e-89dc44f37fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.223650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2a6b6-75e0-43b5-997e-89dc44f37fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_grants(project_id=7b522b67b26f44c4a4672ed68c0d144d, user_id=bd2a6c563e4d4a53885101afd31dc1bc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.229558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2a6b6-75e0-43b5-997e-89dc44f37fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.249736 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2100/4218] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Feb 19 21:00:55 2022] GET /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles => generated 409 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:55.257318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b137-a043-411e-8925-b3d623616768 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.258584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b137-a043-411e-8925-b3d623616768 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.259141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b137-a043-411e-8925-b3d623616768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.269345 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2119/4219] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:55.271444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451c6bc-9119-4ac0-9947-9bd6cc6954ac None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.273766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0451c6bc-9119-4ac0-9947-9bd6cc6954ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:55.293528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451c6bc-9119-4ac0-9947-9bd6cc6954ac None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.300974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.302307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.302749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.303263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.307709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:check_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.312462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.320246 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2120/4220] 10.222.0.30 () {58 vars in 1464 bytes} [Sat Feb 19 21:00:55 2022] HEAD /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:55.321405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.326793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:55.327203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fe15b137-a043-411e-8925-b3d623616768 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:55.329976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fe15b137-a043-411e-8925-b3d623616768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:55.352201 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2101/4221] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:55.372566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b137-a043-411e-8925-b3d623616768 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.429122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b137-a043-411e-8925-b3d623616768 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.464533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.467641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.469999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.470396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.473761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7b522b67b26f44c4a4672ed68c0d144d, user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.477520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.487608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da58484-3e4c-41a6-bf2f-37803a50d4c0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.497865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role b54ade9579134389a0c05c4b9795ab12 was removed from user bd2a6c563e4d4a53885101afd31dc1bc on project 7b522b67b26f44c4a4672ed68c0d144d. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:55.498556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:55.499374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9be7213-ff46-439e-9aa3-7fe61ca90c53 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:55.500208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.500974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.501316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.501604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.506161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:55.540188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.541769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.544060 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2102/4222] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Feb 19 21:00:55 2022] DELETE /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:55.558057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0866d-9572-42bc-8939-7bff6bffc1f8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.558696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0866d-9572-42bc-8939-7bff6bffc1f8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.561859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0866d-9572-42bc-8939-7bff6bffc1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.567742 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2121/4223] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:55.568682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.575332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:55.613234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-41b0866d-9572-42bc-8939-7bff6bffc1f8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:55.615328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41b0866d-9572-42bc-8939-7bff6bffc1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:55.633532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4882af-4f75-463e-96c0-6a4f48e2afe7 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.774081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.775620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.775913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.776195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/system/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.785969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.787033 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:55.787033 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:55.787033 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:55.787980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.803967 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2103/4224] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:55.804949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0866d-9572-42bc-8939-7bff6bffc1f8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.808218 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2122/4225] 10.222.0.30 () {60 vars in 1377 bytes} [Sat Feb 19 21:00:55 2022] PUT /identity/v3/system/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:55.812999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.821578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0866d-9572-42bc-8939-7bff6bffc1f8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.830342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898c7f-0714-4bcc-bde5-ede245a11619 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.830542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.831060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.831449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.831817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.832777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:55.833172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.835417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.842493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.843319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.843611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.843896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/system/users/bd2a6c563e4d4a53885101afd31dc1bc/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.845189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=bd2a6c563e4d4a53885101afd31dc1bc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.846226 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:55.846226 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:55.846226 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:55.847131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.852696 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2104/4226] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:55.858193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.872066 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2123/4227] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 21:00:55 2022] GET /identity/v3/system/users/bd2a6c563e4d4a53885101afd31dc1bc/roles => generated 374 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:00:55.873520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.877944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14433707-a24e-451c-b434-be82001050e0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.891868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ed504-9872-407b-8f2d-c8674492c17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.892929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ed504-9872-407b-8f2d-c8674492c17b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.894146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ed504-9872-407b-8f2d-c8674492c17b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.894431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ed504-9872-407b-8f2d-c8674492c17b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.895242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f24acf-185e-4bf2-a1d7-9a2d4a263985 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.897989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ed504-9872-407b-8f2d-c8674492c17b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.906145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ed504-9872-407b-8f2d-c8674492c17b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.907014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.907924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.908214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.908543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/system/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.921300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.922369 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:55.922369 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:55.922369 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:55.923280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.930180 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2124/4228] 10.222.0.30 () {58 vars in 1359 bytes} [Sat Feb 19 21:00:55 2022] HEAD /identity/v3/system/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:55.934016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:55.954535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af161-6c56-4902-aa23-2d58e9f8ddec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:55.969681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:55.970827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:55.971101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:55.971528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/system/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:55.986388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=bd2a6c563e4d4a53885101afd31dc1bc, role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:55.988784 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:55.988784 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:55.988784 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:55.990484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:55.991966 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2105/4229] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:55 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:56.002125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ed504-9872-407b-8f2d-c8674492c17b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.007620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2125/4230] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Feb 19 21:00:55 2022] DELETE /identity/v3/system/users/bd2a6c563e4d4a53885101afd31dc1bc/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:56.012379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.037068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844c31-f561-4838-94fd-20b197dc2fb6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.099177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ed504-9872-407b-8f2d-c8674492c17b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.130548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24716-59fa-4b47-8c46-50da0c280291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.131289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24716-59fa-4b47-8c46-50da0c280291 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.131577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24716-59fa-4b47-8c46-50da0c280291 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.132314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24716-59fa-4b47-8c46-50da0c280291 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.146441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24716-59fa-4b47-8c46-50da0c280291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.153404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24716-59fa-4b47-8c46-50da0c280291 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.177310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.177805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.178098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.178386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.179153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.180188 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:56.180188 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:56.180188 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:56.189589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.217691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2106/4231] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:55 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:56.220466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24716-59fa-4b47-8c46-50da0c280291 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.226120 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2126/4232] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:00:56 2022] POST /identity/v3/roles => generated 270 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:00:56.227363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.250384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24716-59fa-4b47-8c46-50da0c280291 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.250934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871204db-b58c-4030-9e1b-a8098de90fe6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.262252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc346f6-bcf3-4b08-bb19-8bd5bf67024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.263916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc346f6-bcf3-4b08-bb19-8bd5bf67024a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.264208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc346f6-bcf3-4b08-bb19-8bd5bf67024a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.264518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc346f6-bcf3-4b08-bb19-8bd5bf67024a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.267328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc346f6-bcf3-4b08-bb19-8bd5bf67024a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.270484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc346f6-bcf3-4b08-bb19-8bd5bf67024a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.273538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b843c-16a6-4582-be72-ad0a7cb781a0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.274718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b843c-16a6-4582-be72-ad0a7cb781a0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.275131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b843c-16a6-4582-be72-ad0a7cb781a0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.275496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b843c-16a6-4582-be72-ad0a7cb781a0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.276276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b843c-16a6-4582-be72-ad0a7cb781a0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.278078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b843c-16a6-4582-be72-ad0a7cb781a0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.296817 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2107/4233] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:56 2022] GET /identity/v3/roles => generated 2321 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:56.298128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc346f6-bcf3-4b08-bb19-8bd5bf67024a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.312204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc346f6-bcf3-4b08-bb19-8bd5bf67024a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.321483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f4210-30a4-4690-a7aa-e331f15b4a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.322144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f4210-30a4-4690-a7aa-e331f15b4a68 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.322429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f4210-30a4-4690-a7aa-e331f15b4a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.322775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f4210-30a4-4690-a7aa-e331f15b4a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.324472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f4210-30a4-4690-a7aa-e331f15b4a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.327400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f4210-30a4-4690-a7aa-e331f15b4a68 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.327501 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2127/4234] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:00:56 2022] POST /identity/v3/roles => generated 270 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:56.332303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b843c-16a6-4582-be72-ad0a7cb781a0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.344564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b843c-16a6-4582-be72-ad0a7cb781a0 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.354086 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2108/4235] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:56 2022] GET /identity/v3/roles => generated 2321 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:56.355520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f4210-30a4-4690-a7aa-e331f15b4a68 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.359319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa58b2-a92c-4c33-b177-20ddc29cbb03 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.362026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa58b2-a92c-4c33-b177-20ddc29cbb03 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.362574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa58b2-a92c-4c33-b177-20ddc29cbb03 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.363315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa58b2-a92c-4c33-b177-20ddc29cbb03 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/6d785734304b4ef3a4a161210678d580` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.372797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa58b2-a92c-4c33-b177-20ddc29cbb03 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f4d75bb11f9e48e7bf31a7da22a054e4, implied_role_id=6d785734304b4ef3a4a161210678d580)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.373000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f4210-30a4-4690-a7aa-e331f15b4a68 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.375803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa58b2-a92c-4c33-b177-20ddc29cbb03 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.384295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c2db0-da2a-486f-ab8b-670b91ac2c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.387208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c2db0-da2a-486f-ab8b-670b91ac2c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.387511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c2db0-da2a-486f-ab8b-670b91ac2c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.387835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c2db0-da2a-486f-ab8b-670b91ac2c6d admin admin] PATH_INFO: `/v3/projects/65cfeab9ddf04555a7e2fdb0ee8ebc42/users/9569b0a569a745e797618d42bad7c795/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.419184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c2db0-da2a-486f-ab8b-670b91ac2c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cfeab9ddf04555a7e2fdb0ee8ebc42, user_id=9569b0a569a745e797618d42bad7c795, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.420624 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2128/4236] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:00:56 2022] PUT /identity/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/6d785734304b4ef3a4a161210678d580 => generated 531 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:00:56.425149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa58b2-a92c-4c33-b177-20ddc29cbb03 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.430746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c2db0-da2a-486f-ab8b-670b91ac2c6d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.455596 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2109/4237] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:56 2022] PUT /identity/v3/projects/65cfeab9ddf04555a7e2fdb0ee8ebc42/users/9569b0a569a745e797618d42bad7c795/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:56.459923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749819-60bb-44fc-b82d-3c9b92292537 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.459923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749819-60bb-44fc-b82d-3c9b92292537 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.459923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749819-60bb-44fc-b82d-3c9b92292537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.490310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-26749819-60bb-44fc-b82d-3c9b92292537 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:56.493012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-26749819-60bb-44fc-b82d-3c9b92292537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:56.540521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa58b2-a92c-4c33-b177-20ddc29cbb03 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.604830 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2110/4238] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:56.629092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eb3c0-75ad-4756-a623-39d044469771 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.629921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eb3c0-75ad-4756-a623-39d044469771 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.631125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eb3c0-75ad-4756-a623-39d044469771 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.631125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eb3c0-75ad-4756-a623-39d044469771 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.631709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eb3c0-75ad-4756-a623-39d044469771 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.633491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eb3c0-75ad-4756-a623-39d044469771 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.644039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26749819-60bb-44fc-b82d-3c9b92292537 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.647608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-26749819-60bb-44fc-b82d-3c9b92292537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:56.687685 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2129/4239] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:00:56 2022] POST /identity/v3/domains => generated 277 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:00:56.689396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eb3c0-75ad-4756-a623-39d044469771 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.803362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26749819-60bb-44fc-b82d-3c9b92292537 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.832125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eb3c0-75ad-4756-a623-39d044469771 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.842678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9d12a-a54a-4b85-ae1a-41476048a5ee tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.843577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d12a-a54a-4b85-ae1a-41476048a5ee tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.844173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d12a-a54a-4b85-ae1a-41476048a5ee tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.844743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d12a-a54a-4b85-ae1a-41476048a5ee tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.845890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9d12a-a54a-4b85-ae1a-41476048a5ee tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.851589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9d12a-a54a-4b85-ae1a-41476048a5ee tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.888503 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2130/4240] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:00:56 2022] POST /identity/v3/roles => generated 268 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:56.889678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9d12a-a54a-4b85-ae1a-41476048a5ee tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:56.906075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9d12a-a54a-4b85-ae1a-41476048a5ee tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:56.916088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6442f-4e0e-4915-9a34-065e8e509225 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.917327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6442f-4e0e-4915-9a34-065e8e509225 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.918636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6442f-4e0e-4915-9a34-065e8e509225 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.919083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6442f-4e0e-4915-9a34-065e8e509225 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/fe77704b5152411090095f494e72914f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.926213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6442f-4e0e-4915-9a34-065e8e509225 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f4d75bb11f9e48e7bf31a7da22a054e4, implied_role_id=fe77704b5152411090095f494e72914f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:56.929509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6442f-4e0e-4915-9a34-065e8e509225 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:56.932080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:56.932842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:56.933040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:56.933318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:56.984617 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2131/4241] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:00:56 2022] PUT /identity/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/fe77704b5152411090095f494e72914f => generated 529 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:56.987600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6442f-4e0e-4915-9a34-065e8e509225 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:57.051324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:57.053118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:57.072000 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2111/4242] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:57.129435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:57.131350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:57.155976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1785b-91a1-4b61-a51a-60fb0efeb18a service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:57.339179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:57.339993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:57.340284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:57.340588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] PATH_INFO: `/v3/projects/6be548f3d4ea4a9883b15a69b3ee6a00` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:57.346405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be548f3d4ea4a9883b15a69b3ee6a00)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:57.348419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:57.402327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6442f-4e0e-4915-9a34-065e8e509225 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:57.412065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d25c0b-fcdc-4128-ad7e-8020b348def6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:57.414247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25c0b-fcdc-4128-ad7e-8020b348def6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:57.416652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25c0b-fcdc-4128-ad7e-8020b348def6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:57.417199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25c0b-fcdc-4128-ad7e-8020b348def6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:57.421113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d25c0b-fcdc-4128-ad7e-8020b348def6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f4d75bb11f9e48e7bf31a7da22a054e4, implied_role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:57.424857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d25c0b-fcdc-4128-ad7e-8020b348def6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:57.463638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be548f3d4ea4a9883b15a69b3ee6a00', 'request_id': 'req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:57.470724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be548f3d4ea4a9883b15a69b3ee6a00', 'request_id': 'req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:57.475847 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2132/4243] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:00:56 2022] PUT /identity/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/b54ade9579134389a0c05c4b9795ab12 => generated 525 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:57.479675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d25c0b-fcdc-4128-ad7e-8020b348def6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:57.485778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be548f3d4ea4a9883b15a69b3ee6a00', 'request_id': 'req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:57.514242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] The token cache is being invalidate because project 6be548f3d4ea4a9883b15a69b3ee6a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:57.514971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:57.517586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-505b6125-fcd8-43f6-bb0d-5eb8ff70eb36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:57.521759 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2112/4244] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:57 2022] DELETE /identity/v3/projects/6be548f3d4ea4a9883b15a69b3ee6a00 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:57.526415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4464da-1317-44ad-84c7-7fba871aaa4a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:57.526763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4464da-1317-44ad-84c7-7fba871aaa4a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:57.527050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4464da-1317-44ad-84c7-7fba871aaa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:57.576705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7e4464da-1317-44ad-84c7-7fba871aaa4a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:57.578105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7e4464da-1317-44ad-84c7-7fba871aaa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:57.588623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d25c0b-fcdc-4128-ad7e-8020b348def6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:57.595711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:57.596619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:57.596966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:57.597422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/b54ade9579134389a0c05c4b9795ab12/implies/f4d75bb11f9e48e7bf31a7da22a054e4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:57.599189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b54ade9579134389a0c05c4b9795ab12, implied_role_id=f4d75bb11f9e48e7bf31a7da22a054e4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:57.601516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:57.639306 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] f4d75bb11f9e48e7bf31a7da22a054e4 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: f4d75bb11f9e48e7bf31a7da22a054e4 cannot be an implied roles. Feb 19 21:00:57.643916 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2133/4245] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:00:57 2022] PUT /identity/v3/roles/b54ade9579134389a0c05c4b9795ab12/implies/f4d75bb11f9e48e7bf31a7da22a054e4 => generated 116 bytes in 165 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:00:57.645213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:57.647326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:57.682292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4566b-26f5-477b-9e31-e025570ff208 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:57.701912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:57.703022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:57.703387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:57.703758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:57.706828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f4d75bb11f9e48e7bf31a7da22a054e4, implied_role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:57.708015 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:57.708015 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:57.708015 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:57.709425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:57.739401 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2134/4246] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:00:57 2022] DELETE /identity/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:57.743836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:57.761760 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2113/4247] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:00:57.770573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e1e0-4a11-4020-92b3-95823fcea9bf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:57.771211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e1e0-4a11-4020-92b3-95823fcea9bf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:57.771709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e1e0-4a11-4020-92b3-95823fcea9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:57.818260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3e44e1e0-4a11-4020-92b3-95823fcea9bf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:57.822406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3e44e1e0-4a11-4020-92b3-95823fcea9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:57.880850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70cab7-e78b-4276-8452-535b78c77a83 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:57.910860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c9c61-f033-494c-8822-5fd83aaaf1cf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:57.911550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c9c61-f033-494c-8822-5fd83aaaf1cf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:57.911848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c9c61-f033-494c-8822-5fd83aaaf1cf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:57.921782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c9c61-f033-494c-8822-5fd83aaaf1cf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/fe77704b5152411090095f494e72914f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:57.931630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c9c61-f033-494c-8822-5fd83aaaf1cf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f4d75bb11f9e48e7bf31a7da22a054e4, implied_role_id=fe77704b5152411090095f494e72914f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:57.933759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c9c61-f033-494c-8822-5fd83aaaf1cf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:57.958380 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2135/4248] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:00:57 2022] DELETE /identity/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/fe77704b5152411090095f494e72914f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:57.987436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c9c61-f033-494c-8822-5fd83aaaf1cf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:58.017669 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2114/4249] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:58.019985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44e1e0-4a11-4020-92b3-95823fcea9bf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:58.054003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44e1e0-4a11-4020-92b3-95823fcea9bf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:58.178326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c9c61-f033-494c-8822-5fd83aaaf1cf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:58.221013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:58.222385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:58.222990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:58.223490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/fe77704b5152411090095f494e72914f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:58.226411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=fe77704b5152411090095f494e72914f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:58.231217 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:58.231217 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:00:58.231217 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:00:58.235233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:58.266613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:58.267350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:58.269379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:58.269676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:58.272287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:00:58.274753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:58.276896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:58.302975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role fe77704b5152411090095f494e72914f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:58.305495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:58.307298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:58.311744 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2115/4250] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:58.312684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:58.314739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:58.318596 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2136/4251] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:57 2022] DELETE /identity/v3/roles/fe77704b5152411090095f494e72914f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:58.320927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:58.326462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:58.339574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfaccc-0cd4-412d-9b09-7bdbf726499d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:58.462914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:58.463593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:58.463875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:58.465338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:58.465338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:58.467926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:58.484491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166495-f49d-48d7-84c0-298316c31e40 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:58.489840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:58.491519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:58.492157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:58.492861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/37c03c8e7e7642f582b26bacf720b1ab` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:58.506965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=37c03c8e7e7642f582b26bacf720b1ab)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:58.509035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:58.537738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:58.539136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:58.550840 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2116/4252] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:00:58 2022] POST /identity/v3/projects => generated 353 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:58.551730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:58.554935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:58.578111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:58.582727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:58.594145 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2137/4253] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:00:58 2022] PATCH /identity/v3/domains/37c03c8e7e7642f582b26bacf720b1ab => generated 278 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:00:58.597508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:58.599639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:58.714116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e5edb-6f47-499f-b486-4f6660df69e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:58.723259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:58.724428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:58.724883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:58.725323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:58.726193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:58.734802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:58.749482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97f08a-8551-4c85-91d2-9e77831b8f8c tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:58.785138 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2117/4254] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:00:58 2022] POST /identity/v3/users => generated 277 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:00:58.789636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:58.792119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:58.819854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7921de-e478-48e3-8a23-268a678ffe67 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:58.839526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644999-4ede-4aac-a36f-7f92f1050414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:58.842072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644999-4ede-4aac-a36f-7f92f1050414 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:58.842466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644999-4ede-4aac-a36f-7f92f1050414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:58.842854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644999-4ede-4aac-a36f-7f92f1050414 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:58.845670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644999-4ede-4aac-a36f-7f92f1050414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:58.852546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644999-4ede-4aac-a36f-7f92f1050414 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:58.882681 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2118/4255] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:58 2022] GET /identity/v3/roles => generated 2321 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:58.886294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644999-4ede-4aac-a36f-7f92f1050414 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:58.901442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:58.902770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:58.903136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:58.903417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/37c03c8e7e7642f582b26bacf720b1ab` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:58.910568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644999-4ede-4aac-a36f-7f92f1050414 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:58.928485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab065d-bcb3-4779-a141-b9f09042978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:58.929255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab065d-bcb3-4779-a141-b9f09042978c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:58.929633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab065d-bcb3-4779-a141-b9f09042978c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:58.931729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab065d-bcb3-4779-a141-b9f09042978c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:58.937266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab065d-bcb3-4779-a141-b9f09042978c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:58.938811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab065d-bcb3-4779-a141-b9f09042978c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:58.939401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=37c03c8e7e7642f582b26bacf720b1ab)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:58.946112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:58.977814 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2119/4256] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:58 2022] GET /identity/v3/roles => generated 2321 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:00:58.978766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab065d-bcb3-4779-a141-b9f09042978c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:59.008794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab065d-bcb3-4779-a141-b9f09042978c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:59.017336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b1a7e-b33d-4a22-894c-931eee9d1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:59.020352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1a7e-b33d-4a22-894c-931eee9d1978 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:59.020885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1a7e-b33d-4a22-894c-931eee9d1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:59.021420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1a7e-b33d-4a22-894c-931eee9d1978 admin admin] PATH_INFO: `/v3/projects/2ef7ec9ec0c34144a73b7671b20ae803/users/9d1b515b8aa240c8912f19a5a5a74dca/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:59.024900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.028690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.058001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b1a7e-b33d-4a22-894c-931eee9d1978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef7ec9ec0c34144a73b7671b20ae803, user_id=9d1b515b8aa240c8912f19a5a5a74dca, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:59.062443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b1a7e-b33d-4a22-894c-931eee9d1978 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:59.087749 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2120/4257] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:00:58 2022] PUT /identity/v3/projects/2ef7ec9ec0c34144a73b7671b20ae803/users/9d1b515b8aa240c8912f19a5a5a74dca/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:59.099138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d78ae-87dd-4b29-877c-228a0811bf0e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:59.099327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d78ae-87dd-4b29-877c-228a0811bf0e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:59.099595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d78ae-87dd-4b29-877c-228a0811bf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:59.134900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab', 'request_id': 'req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.146348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab', 'request_id': 'req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.158941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab', 'request_id': 'req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.167678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d12d78ae-87dd-4b29-877c-228a0811bf0e None None] MFA Rules not processed for user `9d1b515b8aa240c8912f19a5a5a74dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:00:59.173890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d12d78ae-87dd-4b29-877c-228a0811bf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:59.179061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] The token cache is being invalidate because project 37c03c8e7e7642f582b26bacf720b1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:59.179486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.180396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.191033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab', 'request_id': 'req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.194736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab', 'request_id': 'req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.195762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '37c03c8e7e7642f582b26bacf720b1ab', 'request_id': 'req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.206187 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2138/4258] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:00:58 2022] DELETE /identity/v3/domains/37c03c8e7e7642f582b26bacf720b1ab => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:59.207521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:59.210114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:59.340909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5d11d-4b2d-4bf2-9f5d-17e4430b3c47 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:59.347964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a186-db44-4c28-9e6c-22b11110634f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:59.348972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a186-db44-4c28-9e6c-22b11110634f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:59.351005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a186-db44-4c28-9e6c-22b11110634f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:59.351297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a186-db44-4c28-9e6c-22b11110634f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/6d785734304b4ef3a4a161210678d580` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:59.355814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3a186-db44-4c28-9e6c-22b11110634f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f4d75bb11f9e48e7bf31a7da22a054e4, implied_role_id=6d785734304b4ef3a4a161210678d580)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:59.358724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3a186-db44-4c28-9e6c-22b11110634f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:59.390237 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2139/4259] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:00:59 2022] DELETE /identity/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4/implies/6d785734304b4ef3a4a161210678d580 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:59.391552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a186-db44-4c28-9e6c-22b11110634f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:59.402335 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2121/4260] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:00:59.453719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d78ae-87dd-4b29-877c-228a0811bf0e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:59.455759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d12d78ae-87dd-4b29-877c-228a0811bf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:59.542958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a186-db44-4c28-9e6c-22b11110634f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:59.553801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:59.554899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:59.556115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:59.556598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/6d785734304b4ef3a4a161210678d580` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:59.562962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6d785734304b4ef3a4a161210678d580)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:59.566612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:59.633305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d78ae-87dd-4b29-877c-228a0811bf0e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:59.653344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role 6d785734304b4ef3a4a161210678d580 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:59.653760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.654351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.660080 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2140/4261] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:59 2022] DELETE /identity/v3/roles/6d785734304b4ef3a4a161210678d580 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:00:59.661187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:59.664258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:59.707592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:59.708682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:59.709997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:59.710285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:59.712464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:00:59.789937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:59.793949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:59.816029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec13351-f7d4-4752-ae3f-09f3ee7d3d6d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:00:59.817337 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2122/4262] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:00:59.825223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:00:59.826154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:00:59.826496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:00:59.826837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:00:59.828437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f4d75bb11f9e48e7bf31a7da22a054e4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:00:59.830858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:00:59.889594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role f4d75bb11f9e48e7bf31a7da22a054e4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:00:59.889902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.896799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:00:59.898909 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2141/4263] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:00:59 2022] DELETE /identity/v3/roles/f4d75bb11f9e48e7bf31a7da22a054e4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:00:59.904469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:00:59.917303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c48fa0-3e09-4ce7-bb82-99b0b6deefa8 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.042050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.043069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.043435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.043795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.046634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.047824 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:00.047824 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:01:00.047824 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:01:00.048881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.087481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.089173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:00.095216 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2123/4264] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:00:59 2022] PUT /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 520 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:00.114909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8b5d-88c7-4d56-8e75-e6c86abad042 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.191662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.192965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.193349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.193746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.195773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.196969 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:00.196969 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:01:00.196969 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:01:00.198688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.199821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.201326 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:00.201326 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:01:00.201326 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:01:00.202457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.210410 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2142/4265] 10.222.0.30 () {58 vars in 1344 bytes} [Sat Feb 19 21:01:00 2022] HEAD /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:00.216224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.236944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedeb09-c613-4550-b703-4f86da8da306 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.248157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.250601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.250957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.251247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.253549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.254713 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:00.254713 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:01:00.254713 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:01:00.256819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.270571 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2124/4266] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Feb 19 21:01:00 2022] GET /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 520 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:00.270908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.281776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f97cc-1e0b-495c-b05f-ae202c9318a7 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.286899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbc627-24b0-470e-b4f3-37eefc4466d4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.287903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbc627-24b0-470e-b4f3-37eefc4466d4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.288281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbc627-24b0-470e-b4f3-37eefc4466d4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.288677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbc627-24b0-470e-b4f3-37eefc4466d4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.290509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbc627-24b0-470e-b4f3-37eefc4466d4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.292182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbc627-24b0-470e-b4f3-37eefc4466d4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.306701 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2143/4267] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:01:00 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:00.311684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.328233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca767-2632-4085-b908-d731f34ad5dc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.408963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.410339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.410623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.410917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.412824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.414766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.433633 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] e676d43af97749f39748f410ed0834e7 does not imply 0998fa60481a42b58102ffd1391957da.: keystone.exception.ImpliedRoleNotFound: e676d43af97749f39748f410ed0834e7 does not imply 0998fa60481a42b58102ffd1391957da. Feb 19 21:01:00.436946 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2125/4268] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Feb 19 21:01:00 2022] GET /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 137 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:01:00.440696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbc627-24b0-470e-b4f3-37eefc4466d4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.454120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbc627-24b0-470e-b4f3-37eefc4466d4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.461375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.462386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.462739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.463088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.465404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.468280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.497579 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] e676d43af97749f39748f410ed0834e7 does not imply 0998fa60481a42b58102ffd1391957da.: keystone.exception.ImpliedRoleNotFound: e676d43af97749f39748f410ed0834e7 does not imply 0998fa60481a42b58102ffd1391957da. Feb 19 21:01:00.504679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.515510 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2144/4269] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:01:00 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 137 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:01:00.522825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6c3f-931f-46a5-a601-665c1a0f77f5 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.528117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd2c2f-3fdf-4f58-87a4-68d046d03029 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.529789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd2c2f-3fdf-4f58-87a4-68d046d03029 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.530149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd2c2f-3fdf-4f58-87a4-68d046d03029 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.530443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd2c2f-3fdf-4f58-87a4-68d046d03029 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.534681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd2c2f-3fdf-4f58-87a4-68d046d03029 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.536468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd2c2f-3fdf-4f58-87a4-68d046d03029 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.569241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2126/4270] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:01:00 2022] PUT /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 520 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:00.577306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.595980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8631e-4962-4b5d-aa36-da7314f582c4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.671511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa964f4-2036-4291-b994-5e7fc8f3e848 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.672037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa964f4-2036-4291-b994-5e7fc8f3e848 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.672442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd5c51-a0b2-4c7f-89ad-2c887026be28 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.672591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa964f4-2036-4291-b994-5e7fc8f3e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.673598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd5c51-a0b2-4c7f-89ad-2c887026be28 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.673998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd5c51-a0b2-4c7f-89ad-2c887026be28 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.674361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd5c51-a0b2-4c7f-89ad-2c887026be28 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/227a96de647d4ad29e710244e039a81a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.676219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd5c51-a0b2-4c7f-89ad-2c887026be28 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=227a96de647d4ad29e710244e039a81a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.677953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd5c51-a0b2-4c7f-89ad-2c887026be28 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.720617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0fa964f4-2036-4291-b994-5e7fc8f3e848 None None] MFA Rules not processed for user `9569b0a569a745e797618d42bad7c795`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:00.722209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0fa964f4-2036-4291-b994-5e7fc8f3e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:00.728863 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2145/4271] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:01:00 2022] PUT /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/227a96de647d4ad29e710244e039a81a => generated 519 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:00.728863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd5c51-a0b2-4c7f-89ad-2c887026be28 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.835819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd5c51-a0b2-4c7f-89ad-2c887026be28 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:00.843134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:00.844447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:00.844940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:00.845474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/227a96de647d4ad29e710244e039a81a/implies/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:00.847679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=227a96de647d4ad29e710244e039a81a, implied_role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:00.849819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:00.853247 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2127/4272] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:00.889144 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2146/4273] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:01:00 2022] PUT /identity/v3/roles/227a96de647d4ad29e710244e039a81a/implies/b54ade9579134389a0c05c4b9795ab12 => generated 519 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:00.890801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa964f4-2036-4291-b994-5e7fc8f3e848 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:00.905657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa964f4-2036-4291-b994-5e7fc8f3e848 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.014415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.016595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:01.050058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.050859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.051249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.051633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.052419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.053560 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:01.053560 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:01:01.053560 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:01:01.054686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.085170 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2128/4274] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:01:00 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:01.087508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.104000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf0a33-f4cb-4e63-9996-5791c568ddf6 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.122335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dbe69-a688-44fc-a6c0-3a211575434e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.122335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dbe69-a688-44fc-a6c0-3a211575434e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.122335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dbe69-a688-44fc-a6c0-3a211575434e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.122749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dbe69-a688-44fc-a6c0-3a211575434e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/227a96de647d4ad29e710244e039a81a/implies/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.128587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dbe69-a688-44fc-a6c0-3a211575434e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=227a96de647d4ad29e710244e039a81a, implied_role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.131611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dbe69-a688-44fc-a6c0-3a211575434e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.148727 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2129/4275] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:01:01 2022] DELETE /identity/v3/roles/227a96de647d4ad29e710244e039a81a/implies/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:01.151404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dbe69-a688-44fc-a6c0-3a211575434e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.203583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e872e3-daae-49ea-b125-ac92bab12817 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.250164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dbe69-a688-44fc-a6c0-3a211575434e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.255799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd58d7-8d49-439f-ac6f-c89547cc401a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.256874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd58d7-8d49-439f-ac6f-c89547cc401a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.257064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd58d7-8d49-439f-ac6f-c89547cc401a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.257389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd58d7-8d49-439f-ac6f-c89547cc401a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/227a96de647d4ad29e710244e039a81a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.259840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd58d7-8d49-439f-ac6f-c89547cc401a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=227a96de647d4ad29e710244e039a81a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.262085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd58d7-8d49-439f-ac6f-c89547cc401a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.274142 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2130/4276] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:01:01 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/227a96de647d4ad29e710244e039a81a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:01.279886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd58d7-8d49-439f-ac6f-c89547cc401a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.287390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96113486-b9fa-4775-a62e-76585007538c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.288506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96113486-b9fa-4775-a62e-76585007538c service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.288824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96113486-b9fa-4775-a62e-76585007538c service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.289773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96113486-b9fa-4775-a62e-76585007538c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.363265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd58d7-8d49-439f-ac6f-c89547cc401a tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.363483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96113486-b9fa-4775-a62e-76585007538c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.365607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96113486-b9fa-4775-a62e-76585007538c service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.369009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3ea5c-a8b2-4c7b-ad09-f206f65a2d04 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.370230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ea5c-a8b2-4c7b-ad09-f206f65a2d04 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.370516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ea5c-a8b2-4c7b-ad09-f206f65a2d04 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.370915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ea5c-a8b2-4c7b-ad09-f206f65a2d04 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.373975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3ea5c-a8b2-4c7b-ad09-f206f65a2d04 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.376154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3ea5c-a8b2-4c7b-ad09-f206f65a2d04 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.386360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2147/4277] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:01.405760 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2131/4278] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:01:01 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:01.405958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96113486-b9fa-4775-a62e-76585007538c service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.427562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96113486-b9fa-4775-a62e-76585007538c service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.523994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8ecc0-cd0b-4a61-8808-54c10e93af07 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.524718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ecc0-cd0b-4a61-8808-54c10e93af07 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.525003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ecc0-cd0b-4a61-8808-54c10e93af07 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.525283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ecc0-cd0b-4a61-8808-54c10e93af07 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.527274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8ecc0-cd0b-4a61-8808-54c10e93af07 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.530105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8ecc0-cd0b-4a61-8808-54c10e93af07 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.553595 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2148/4279] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:01 2022] GET /identity/v3/roles => generated 2321 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:01.555198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3ea5c-a8b2-4c7b-ad09-f206f65a2d04 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.574848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3ea5c-a8b2-4c7b-ad09-f206f65a2d04 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.580159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c5ce3-9855-4b84-9a4f-7ce223b05400 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.580961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5ce3-9855-4b84-9a4f-7ce223b05400 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.581371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5ce3-9855-4b84-9a4f-7ce223b05400 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.581779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5ce3-9855-4b84-9a4f-7ce223b05400 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.582598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c5ce3-9855-4b84-9a4f-7ce223b05400 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.584340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c5ce3-9855-4b84-9a4f-7ce223b05400 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.602769 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2132/4280] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:01:01 2022] POST /identity/v3/roles => generated 234 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:01.607391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8ecc0-cd0b-4a61-8808-54c10e93af07 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.620499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8ecc0-cd0b-4a61-8808-54c10e93af07 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.636118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.637218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.637487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.637766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/154adedbcfc541edb1301a97ce6d48ce` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.642528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:update_role(role_id=154adedbcfc541edb1301a97ce6d48ce)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.643553 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:01.643553 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:01:01.643553 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:01:01.644460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.690586 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2149/4281] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Feb 19 21:01:01 2022] PATCH /identity/v3/roles/154adedbcfc541edb1301a97ce6d48ce => generated 238 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:01.692513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c5ce3-9855-4b84-9a4f-7ce223b05400 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.714704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c5ce3-9855-4b84-9a4f-7ce223b05400 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.721994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cadf78-aa34-496c-af2c-ed8c53beeaad tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.723001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cadf78-aa34-496c-af2c-ed8c53beeaad tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.723283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cadf78-aa34-496c-af2c-ed8c53beeaad tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.724208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cadf78-aa34-496c-af2c-ed8c53beeaad tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/154adedbcfc541edb1301a97ce6d48ce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.746728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cadf78-aa34-496c-af2c-ed8c53beeaad tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:get_role(role_id=154adedbcfc541edb1301a97ce6d48ce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.748392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cadf78-aa34-496c-af2c-ed8c53beeaad tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.750966 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2133/4282] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:01:01 2022] GET /identity/v3/roles/154adedbcfc541edb1301a97ce6d48ce => generated 238 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:01:01.754259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.768378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94bc88-634e-4777-83bb-474c70c89bec tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.785764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.786681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.787131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.788422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.790189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.795029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.839222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2150/4283] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:01 2022] GET /identity/v3/roles => generated 2550 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:01.843738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cadf78-aa34-496c-af2c-ed8c53beeaad tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.859079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cadf78-aa34-496c-af2c-ed8c53beeaad tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:01.865645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:01.866795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:01.867251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:01.867701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/154adedbcfc541edb1301a97ce6d48ce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:01.870284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=154adedbcfc541edb1301a97ce6d48ce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:01.871317 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:01.871317 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:01:01.871317 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:01:01.872757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:01.924962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role 154adedbcfc541edb1301a97ce6d48ce has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:01.925233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:01.925914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:01.928514 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2134/4284] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:01 2022] DELETE /identity/v3/roles/154adedbcfc541edb1301a97ce6d48ce => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:01.933672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:01.936795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:01.958881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25e1ee-c5eb-4817-8b7e-848a4bf3c1bf tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:02.053757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1976b-6d60-4243-9bcb-aefe98e0ecf4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:02.054949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1976b-6d60-4243-9bcb-aefe98e0ecf4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:02.055440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1976b-6d60-4243-9bcb-aefe98e0ecf4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:02.056044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1976b-6d60-4243-9bcb-aefe98e0ecf4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:02.059610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1976b-6d60-4243-9bcb-aefe98e0ecf4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:02.062088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1976b-6d60-4243-9bcb-aefe98e0ecf4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:02.100755 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2151/4285] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:01:01 2022] PUT /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 520 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:02.106079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:02.133672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289598f1-58ea-48e9-bd7b-55ca0d855e70 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:02.233661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc89a62-4a24-4a77-91ac-166242f16c1d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:02.234669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc89a62-4a24-4a77-91ac-166242f16c1d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:02.235001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc89a62-4a24-4a77-91ac-166242f16c1d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:02.235288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc89a62-4a24-4a77-91ac-166242f16c1d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/227a96de647d4ad29e710244e039a81a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:02.238259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc89a62-4a24-4a77-91ac-166242f16c1d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=227a96de647d4ad29e710244e039a81a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:02.241611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc89a62-4a24-4a77-91ac-166242f16c1d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:02.280839 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2135/4286] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:01:02 2022] PUT /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/227a96de647d4ad29e710244e039a81a => generated 519 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:02.285299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1976b-6d60-4243-9bcb-aefe98e0ecf4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:02.298466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1976b-6d60-4243-9bcb-aefe98e0ecf4 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:02.428864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96027544-1f74-4b9a-a340-bab7d7399466 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:02.429824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96027544-1f74-4b9a-a340-bab7d7399466 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:02.430109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96027544-1f74-4b9a-a340-bab7d7399466 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:02.430675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96027544-1f74-4b9a-a340-bab7d7399466 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/227a96de647d4ad29e710244e039a81a/implies/b54ade9579134389a0c05c4b9795ab12` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:02.432945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96027544-1f74-4b9a-a340-bab7d7399466 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=227a96de647d4ad29e710244e039a81a, implied_role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:02.434802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96027544-1f74-4b9a-a340-bab7d7399466 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:02.472583 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2152/4287] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Feb 19 21:01:02 2022] PUT /identity/v3/roles/227a96de647d4ad29e710244e039a81a/implies/b54ade9579134389a0c05c4b9795ab12 => generated 519 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:02.477281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc89a62-4a24-4a77-91ac-166242f16c1d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:02.492260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc89a62-4a24-4a77-91ac-166242f16c1d tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:02.577619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:02.578943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:02.579449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:02.579913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/227a96de647d4ad29e710244e039a81a/implies` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:02.582178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=227a96de647d4ad29e710244e039a81a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:02.583700 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:02.583700 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:01:02.583700 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:01:02.585496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:02.606007 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2136/4288] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:01:02 2022] GET /identity/v3/roles/227a96de647d4ad29e710244e039a81a/implies => generated 488 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:02.607371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96027544-1f74-4b9a-a340-bab7d7399466 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:02.624874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96027544-1f74-4b9a-a340-bab7d7399466 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:02.639026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:02.640111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:02.641232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:02.641601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:02.644756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e676d43af97749f39748f410ed0834e7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:02.648078 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:02.648078 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:01:02.648078 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:01:02.649119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:02.665631 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2153/4289] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:01:02 2022] GET /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies => generated 659 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:02.671200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:02.689302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b9ccb-6de2-4bdb-91f7-e3d90c87d7d8 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:02.707619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c437b5-d9d7-426e-b37d-ad8953177b66 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:02.708736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c437b5-d9d7-426e-b37d-ad8953177b66 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:02.709029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c437b5-d9d7-426e-b37d-ad8953177b66 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:02.709374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c437b5-d9d7-426e-b37d-ad8953177b66 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/227a96de647d4ad29e710244e039a81a/implies/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:02.713631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c437b5-d9d7-426e-b37d-ad8953177b66 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=227a96de647d4ad29e710244e039a81a, implied_role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:02.717901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c437b5-d9d7-426e-b37d-ad8953177b66 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:02.745669 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2137/4290] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:01:02 2022] DELETE /identity/v3/roles/227a96de647d4ad29e710244e039a81a/implies/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:02.746763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:02.757328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b851a-bfa1-4fb6-82a2-573649d69380 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:02.880852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8f6e7-2e24-4389-aaf3-e3e0e851dcbc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:02.881903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f6e7-2e24-4389-aaf3-e3e0e851dcbc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:02.882255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f6e7-2e24-4389-aaf3-e3e0e851dcbc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:02.882601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f6e7-2e24-4389-aaf3-e3e0e851dcbc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/227a96de647d4ad29e710244e039a81a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:02.894955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8f6e7-2e24-4389-aaf3-e3e0e851dcbc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=227a96de647d4ad29e710244e039a81a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:02.900732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8f6e7-2e24-4389-aaf3-e3e0e851dcbc tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:02.923161 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2154/4291] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:01:02 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/227a96de647d4ad29e710244e039a81a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:02.924823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c437b5-d9d7-426e-b37d-ad8953177b66 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:02.957885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c437b5-d9d7-426e-b37d-ad8953177b66 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:03.120078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562c58c-6333-47f4-91e8-921b6a967441 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:03.121339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562c58c-6333-47f4-91e8-921b6a967441 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:03.127596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562c58c-6333-47f4-91e8-921b6a967441 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:03.128279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562c58c-6333-47f4-91e8-921b6a967441 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:03.130124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ca3c-d865-491b-8923-5f3f088a030f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:03.130439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ca3c-d865-491b-8923-5f3f088a030f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:03.130716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ca3c-d865-491b-8923-5f3f088a030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:03.134242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562c58c-6333-47f4-91e8-921b6a967441 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e676d43af97749f39748f410ed0834e7, implied_role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:03.136271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562c58c-6333-47f4-91e8-921b6a967441 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:03.168318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8de9ca3c-d865-491b-8923-5f3f088a030f None None] MFA Rules not processed for user `9569b0a569a745e797618d42bad7c795`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:03.171716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8de9ca3c-d865-491b-8923-5f3f088a030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:03.172392 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2138/4292] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Feb 19 21:01:02 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7/implies/0998fa60481a42b58102ffd1391957da => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:03.177542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562c58c-6333-47f4-91e8-921b6a967441 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:03.322235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562c58c-6333-47f4-91e8-921b6a967441 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:03.331629 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2155/4293] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:01:03.339098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:03.344491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:03.344793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:03.345068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/37c03c8e7e7642f582b26bacf720b1ab` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:03.360185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:01:03.387109 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Could not find domain: 37c03c8e7e7642f582b26bacf720b1ab.: keystone.exception.DomainNotFound: Could not find domain: 37c03c8e7e7642f582b26bacf720b1ab. Feb 19 21:01:03.392471 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2139/4294] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:03 2022] PATCH /identity/v3/domains/37c03c8e7e7642f582b26bacf720b1ab => generated 112 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:01:03.394163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9ca3c-d865-491b-8923-5f3f088a030f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:03.426819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9ca3c-d865-491b-8923-5f3f088a030f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:03.433997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:03.435758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:03.436272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:03.436724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/users/bd2a6c563e4d4a53885101afd31dc1bc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:03.440271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd2a6c563e4d4a53885101afd31dc1bc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:03.444095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:03.506934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2a6c563e4d4a53885101afd31dc1bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:03.525126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2a6c563e4d4a53885101afd31dc1bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:03.547485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2a6c563e4d4a53885101afd31dc1bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:03.547984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2a6c563e4d4a53885101afd31dc1bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:03.548733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2a6c563e4d4a53885101afd31dc1bc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:03.589723 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2156/4295] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:03 2022] DELETE /identity/v3/users/bd2a6c563e4d4a53885101afd31dc1bc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:03.594805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:03.596788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:03.623610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6d71d-38ce-414a-8236-3e927b0d8cf2 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:03.805381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:03.806458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:03.806745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:03.807020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/b54ade9579134389a0c05c4b9795ab12` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:03.812061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b54ade9579134389a0c05c4b9795ab12)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:03.813779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:03.890880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role b54ade9579134389a0c05c4b9795ab12 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:03.891216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:03.891915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:03.895198 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2140/4296] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:03 2022] DELETE /identity/v3/roles/b54ade9579134389a0c05c4b9795ab12 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:03.899655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:03.914427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd972-698a-4a5f-be45-b5caece1daff tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:04.072168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:04.073098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:04.073458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:04.073877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/groups/e77c0625d60f422dab460e89e6b6edb2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:04.076280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e77c0625d60f422dab460e89e6b6edb2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:04.078894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:04.180065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2157/4297] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:01:03 2022] DELETE /identity/v3/groups/e77c0625d60f422dab460e89e6b6edb2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:04.186540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:04.188445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:04.212106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235b22-e24d-442a-861e-26ffff0f0a01 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:04.340487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:04.345062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:04.345350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:04.345627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/projects/7b522b67b26f44c4a4672ed68c0d144d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:04.348691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7b522b67b26f44c4a4672ed68c0d144d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:04.355426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:04.517273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b522b67b26f44c4a4672ed68c0d144d', 'request_id': 'req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.526498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b522b67b26f44c4a4672ed68c0d144d', 'request_id': 'req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.540179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b522b67b26f44c4a4672ed68c0d144d', 'request_id': 'req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.568698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] The token cache is being invalidate because project 7b522b67b26f44c4a4672ed68c0d144d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:04.570083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.571476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.578125 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2141/4298] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:04 2022] DELETE /identity/v3/projects/7b522b67b26f44c4a4672ed68c0d144d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:04.578591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:04.580515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:04.601935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb5f11-8d6b-4475-b1f5-209f5a52098b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:04.741486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:04.742600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:04.743044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:04.743476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:04.745174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d55891560cda4991b7d8bbccc5a740cc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:04.752249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:04.796687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.798784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.864579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.865170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:04.873904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:04.874441 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2158/4299] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:04 2022] PATCH /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc => generated 278 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:04.884977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ceb09-a91f-4d9a-a252-ca7ac3fe6e6b tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:04.977164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:04.981296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:04.982045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:04.982830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/domains/d55891560cda4991b7d8bbccc5a740cc` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:05.020804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d55891560cda4991b7d8bbccc5a740cc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:05.022462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:05.094187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.105468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.214200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc', 'request_id': 'req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.227163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc', 'request_id': 'req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.249713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc', 'request_id': 'req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.270290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] The token cache is being invalidate because project d55891560cda4991b7d8bbccc5a740cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:05.270608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.273289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.291256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc', 'request_id': 'req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.292198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc', 'request_id': 'req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.300137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd55891560cda4991b7d8bbccc5a740cc', 'request_id': 'req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.314909 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2142/4300] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:01:04 2022] DELETE /identity/v3/domains/d55891560cda4991b7d8bbccc5a740cc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:05.318784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:05.320415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:05.342500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04dcc9-ac8c-4d28-a6df-ae3db1419305 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:05.509064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:05.510358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:05.510839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:05.511320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/227a96de647d4ad29e710244e039a81a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:05.517122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=227a96de647d4ad29e710244e039a81a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:05.519266 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:05.519266 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:01:05.519266 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:01:05.520730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:05.605994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role 227a96de647d4ad29e710244e039a81a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:05.606631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.607610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.611929 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2159/4301] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:05 2022] DELETE /identity/v3/roles/227a96de647d4ad29e710244e039a81a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:05.615704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:05.617603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:05.646363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c93136-9b05-4b9e-a4d4-869e56ccfa0e tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:05.744241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:05.745134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:05.745418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:05.745698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/0998fa60481a42b58102ffd1391957da` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:05.750940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0998fa60481a42b58102ffd1391957da)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:05.761612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:05.841882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role 0998fa60481a42b58102ffd1391957da has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:05.842483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.844448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:05.849535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2143/4302] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:05 2022] DELETE /identity/v3/roles/0998fa60481a42b58102ffd1391957da => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:05.850782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:05.852540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:05.883951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bec34e-1f67-455b-820e-0ce3af8f178f tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:06.059630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb44adc010645e3855fccff7976455c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c125523d7f4642d7abd0b70eae302199', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:06.061449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:06.062014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:06.063254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] PATH_INFO: `/v3/roles/e676d43af97749f39748f410ed0834e7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:06.073575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e676d43af97749f39748f410ed0834e7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:06.076395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:06.209624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invalidating the token cache because role e676d43af97749f39748f410ed0834e7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:06.210090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:06.211807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd0d2aa4-a30f-4797-ad90-45acd8532fab tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:06.216823 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2160/4303] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:05 2022] DELETE /identity/v3/roles/e676d43af97749f39748f410ed0834e7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:06.221216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:06.225682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:06.407418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb1c5d-47ae-4d50-b158-cbd339a27793 tempest-RolesV3TestJSON-298128132 tempest-RolesV3TestJSON-298128132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:06.551408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:06.552296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:06.552605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:06.552886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] PATH_INFO: `/v3/users/40187586652e496ca9607f3a5c3de70f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:06.556224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40187586652e496ca9607f3a5c3de70f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:06.559100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:06.718301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40187586652e496ca9607f3a5c3de70f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:06.720104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40187586652e496ca9607f3a5c3de70f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:06.722514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40187586652e496ca9607f3a5c3de70f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:06.770190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40187586652e496ca9607f3a5c3de70f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:06.783226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40187586652e496ca9607f3a5c3de70f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:06.802877 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2144/4304] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:06 2022] DELETE /identity/v3/users/40187586652e496ca9607f3a5c3de70f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:06.807476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee04e0-70af-48bb-a072-34217137a890 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:06.807968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee04e0-70af-48bb-a072-34217137a890 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:06.808064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee04e0-70af-48bb-a072-34217137a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:06.869935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-66ee04e0-70af-48bb-a072-34217137a890 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:06.871430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-66ee04e0-70af-48bb-a072-34217137a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:07.019709 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2161/4305] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:07.038862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:07.041654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:07.137397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c0fa-c9d6-4004-ac25-e8435b725f43 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:07.137734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c0fa-c9d6-4004-ac25-e8435b725f43 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:07.140957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c0fa-c9d6-4004-ac25-e8435b725f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:07.198234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8369c0fa-c9d6-4004-ac25-e8435b725f43 None None] MFA Rules not processed for user `a36b20fc4b8b4b71aea23626d52cefa9`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:07.202012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8369c0fa-c9d6-4004-ac25-e8435b725f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:07.213597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb92519-be15-4165-9b8b-6cf0aab2bcd0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:07.219901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:07.222562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:07.223149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:07.223149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:07.249509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:07.251481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:07.279222 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2145/4306] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:07.289751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:07.298172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:07.317092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a3d0-4fd9-457a-8056-b9b823d32c01 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:07.322931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:07.324019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:07.325263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:07.325962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] PATH_INFO: `/v3/users/9d1b515b8aa240c8912f19a5a5a74dca` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:07.327602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1b515b8aa240c8912f19a5a5a74dca)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:07.333415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:07.350209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2162/4307] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:01:07.418054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1b515b8aa240c8912f19a5a5a74dca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:07.419017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1b515b8aa240c8912f19a5a5a74dca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:07.420684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1b515b8aa240c8912f19a5a5a74dca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:07.441459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1b515b8aa240c8912f19a5a5a74dca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:07.456192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1b515b8aa240c8912f19a5a5a74dca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:07.486656 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2146/4308] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:07 2022] DELETE /identity/v3/users/9d1b515b8aa240c8912f19a5a5a74dca => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:07.488614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed590bbd-263f-4ec8-bc7b-09a2ae98a9ee None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:07.488908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed590bbd-263f-4ec8-bc7b-09a2ae98a9ee None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:07.489211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed590bbd-263f-4ec8-bc7b-09a2ae98a9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:07.527091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ed590bbd-263f-4ec8-bc7b-09a2ae98a9ee None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:07.530460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ed590bbd-263f-4ec8-bc7b-09a2ae98a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:07.615756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:07.620030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:07.698258 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2163/4309] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:07.736601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed590bbd-263f-4ec8-bc7b-09a2ae98a9ee None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:07.738416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ed590bbd-263f-4ec8-bc7b-09a2ae98a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:07.920365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9f3f-e2b3-4831-9b13-666647cbdf99 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:07.934327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:07.935986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:07.936107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:07.936430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:07.944477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:07.957981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed590bbd-263f-4ec8-bc7b-09a2ae98a9ee None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:07.969566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:07.969947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:07.970236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:07.970513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:07.995245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:08.003229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:08.027399 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2164/4310] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:01:08.077079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:08.086795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:08.113111 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2147/4311] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:08.578952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:08.580452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:08.611006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399958eb-9586-496f-8d2c-5e54e7090a4c service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:08.626315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:08.628673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:08.628973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:08.629261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] PATH_INFO: `/v3/projects/e93a9beabf3f413a97af1554514a7537` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:08.636132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93a9beabf3f413a97af1554514a7537)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:08.638145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:08.784709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93a9beabf3f413a97af1554514a7537', 'request_id': 'req-28c920fb-b529-412f-bb4a-f50ef943544d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:08.793222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93a9beabf3f413a97af1554514a7537', 'request_id': 'req-28c920fb-b529-412f-bb4a-f50ef943544d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:08.809318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93a9beabf3f413a97af1554514a7537', 'request_id': 'req-28c920fb-b529-412f-bb4a-f50ef943544d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:08.830242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] The token cache is being invalidate because project e93a9beabf3f413a97af1554514a7537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:08.830869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:08.832371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:08.834916 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2165/4312] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:08 2022] DELETE /identity/v3/projects/e93a9beabf3f413a97af1554514a7537 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:08.839754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:08.856577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47da995-471d-48bb-9da5-1a9b0f87365a service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:08.859443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:08.861636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:09.056770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:09.057668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:09.065898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:09.066509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] PATH_INFO: `/v3/users/dbb44adc010645e3855fccff7976455c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:09.072058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb44adc010645e3855fccff7976455c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:09.082147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c920fb-b529-412f-bb4a-f50ef943544d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:09.082669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:09.098918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:09.101093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:09.101403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:09.101688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] PATH_INFO: `/v3/projects/2ef7ec9ec0c34144a73b7671b20ae803` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:09.106593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef7ec9ec0c34144a73b7671b20ae803)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:09.111845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:09.269595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb44adc010645e3855fccff7976455c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.273429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb44adc010645e3855fccff7976455c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.274721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb44adc010645e3855fccff7976455c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.312831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb44adc010645e3855fccff7976455c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.318018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef7ec9ec0c34144a73b7671b20ae803', 'request_id': 'req-2b860567-7017-4c45-83b9-873583fd9aaa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.341656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef7ec9ec0c34144a73b7671b20ae803', 'request_id': 'req-2b860567-7017-4c45-83b9-873583fd9aaa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.344136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04b45361-e402-4011-9546-07f53dd9eac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb44adc010645e3855fccff7976455c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.389952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef7ec9ec0c34144a73b7671b20ae803', 'request_id': 'req-2b860567-7017-4c45-83b9-873583fd9aaa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.405154 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2148/4313] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:08 2022] DELETE /identity/v3/users/dbb44adc010645e3855fccff7976455c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:09.418296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] The token cache is being invalidate because project 2ef7ec9ec0c34144a73b7671b20ae803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:09.418585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.422239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:09.438619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebd93-e09a-4866-80c6-a8c914e01232 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:09.439593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebd93-e09a-4866-80c6-a8c914e01232 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:09.439593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebd93-e09a-4866-80c6-a8c914e01232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:09.456188 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2166/4314] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:08 2022] DELETE /identity/v3/projects/2ef7ec9ec0c34144a73b7671b20ae803 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:09.483918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-91eebd93-e09a-4866-80c6-a8c914e01232 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:09.485908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-91eebd93-e09a-4866-80c6-a8c914e01232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:09.533341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:09.534783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:09.691202 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2149/4315] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:09.693352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22371-a334-427b-89af-a5ed9576d999 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:09.693649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22371-a334-427b-89af-a5ed9576d999 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:09.696507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22371-a334-427b-89af-a5ed9576d999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:09.750182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5ba22371-a334-427b-89af-a5ed9576d999 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:09.754952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5ba22371-a334-427b-89af-a5ed9576d999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:09.787658 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2150/4316] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:09.793640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba22371-a334-427b-89af-a5ed9576d999 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:09.798209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b860567-7017-4c45-83b9-873583fd9aaa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:09.807854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba22371-a334-427b-89af-a5ed9576d999 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:09.818367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:09.819063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:09.819347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:09.819628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:09.822206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:01:09.822518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:09.824516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:09.847464 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2151/4317] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:09.848545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:09.861664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c162-af22-4a5a-adb4-6eac7e97a8e7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:09.868967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db547b35-f727-45ba-a74d-7e47fd71f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:09.869935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db547b35-f727-45ba-a74d-7e47fd71f266 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:09.870294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db547b35-f727-45ba-a74d-7e47fd71f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:09.870695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db547b35-f727-45ba-a74d-7e47fd71f266 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:09.871459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db547b35-f727-45ba-a74d-7e47fd71f266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:09.875233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db547b35-f727-45ba-a74d-7e47fd71f266 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:09.927731 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2152/4318] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:09 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:09.932700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db547b35-f727-45ba-a74d-7e47fd71f266 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:09.947330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31ea50-2853-491d-966a-b46061769003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:09.948006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ea50-2853-491d-966a-b46061769003 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:09.948289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ea50-2853-491d-966a-b46061769003 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:09.948596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ea50-2853-491d-966a-b46061769003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:09.956216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-da31ea50-2853-491d-966a-b46061769003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:09.993293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31ea50-2853-491d-966a-b46061769003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:09.994979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31ea50-2853-491d-966a-b46061769003 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:10.020424 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2167/4319] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:10.111659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fd94-3079-4c4b-b941-91e827556fc1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.112239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fd94-3079-4c4b-b941-91e827556fc1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.112239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fd94-3079-4c4b-b941-91e827556fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.157469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db547b35-f727-45ba-a74d-7e47fd71f266 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:10.174582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b6d60-dc77-4c92-a167-5ae87d7bfbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:10.175428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b6d60-dc77-4c92-a167-5ae87d7bfbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.175708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b6d60-dc77-4c92-a167-5ae87d7bfbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.175992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b6d60-dc77-4c92-a167-5ae87d7bfbb1 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.176720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b6d60-dc77-4c92-a167-5ae87d7bfbb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:10.179979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b6d60-dc77-4c92-a167-5ae87d7bfbb1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:10.200226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f365fd94-3079-4c4b-b941-91e827556fc1 None None] MFA Rules not processed for user `71f534f513ef45d29629b913de461f23`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:10.204080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f365fd94-3079-4c4b-b941-91e827556fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:10.235951 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2153/4320] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:09 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:10.239955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b6d60-dc77-4c92-a167-5ae87d7bfbb1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:10.276217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b6d60-dc77-4c92-a167-5ae87d7bfbb1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:10.301913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4d46a-f97b-4099-b281-e16d6ce265b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:10.302516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d46a-f97b-4099-b281-e16d6ce265b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.302796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d46a-f97b-4099-b281-e16d6ce265b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.303070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d46a-f97b-4099-b281-e16d6ce265b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.304253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4d46a-f97b-4099-b281-e16d6ce265b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:10.321455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4d46a-f97b-4099-b281-e16d6ce265b7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:10.348693 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2154/4321] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:10.351093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4d46a-f97b-4099-b281-e16d6ce265b7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:10.369177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4d46a-f97b-4099-b281-e16d6ce265b7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:10.390288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:10.390980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.391258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.398998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.400556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:10.402244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:10.410617 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2168/4322] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:10.411841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365fd94-3079-4c4b-b941-91e827556fc1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:10.417202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f365fd94-3079-4c4b-b941-91e827556fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:10.448552 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2155/4323] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:10.456425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:10.460404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:10.579926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365fd94-3079-4c4b-b941-91e827556fc1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:10.585371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0264c75-19b5-4d57-8ba2-217b677559b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:10.586645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264c75-19b5-4d57-8ba2-217b677559b0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.587125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264c75-19b5-4d57-8ba2-217b677559b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.587453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264c75-19b5-4d57-8ba2-217b677559b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.609503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d0264c75-19b5-4d57-8ba2-217b677559b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:10.636923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0264c75-19b5-4d57-8ba2-217b677559b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:10.637082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169039c-4a6b-4bb3-88bc-14d2d7d129a0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:10.638462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0264c75-19b5-4d57-8ba2-217b677559b0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:10.655738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805adc9-5339-469b-850b-e0a2c5b49217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:10.656565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805adc9-5339-469b-850b-e0a2c5b49217 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.656938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805adc9-5339-469b-850b-e0a2c5b49217 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.657282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805adc9-5339-469b-850b-e0a2c5b49217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.660517 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2169/4324] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:10.662793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6794-83e8-4590-a272-685f89849f00 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.663091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6794-83e8-4590-a272-685f89849f00 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.664542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6794-83e8-4590-a272-685f89849f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.678109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805adc9-5339-469b-850b-e0a2c5b49217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:10.679618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805adc9-5339-469b-850b-e0a2c5b49217 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:10.708982 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2156/4325] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:10.709990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805adc9-5339-469b-850b-e0a2c5b49217 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:10.738261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805adc9-5339-469b-850b-e0a2c5b49217 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:10.746135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b3c9d-46c9-4bbf-be5d-33992096541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:10.747785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3c9d-46c9-4bbf-be5d-33992096541d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.748137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3c9d-46c9-4bbf-be5d-33992096541d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.748651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3c9d-46c9-4bbf-be5d-33992096541d admin admin] PATH_INFO: `/v3/projects/bcf6b982471a4960a675ea363f491589/users/a1f91543f7cf469a8b4b3ec80cc1e483/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.749907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8e0e6794-83e8-4590-a272-685f89849f00 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:10.752115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8e0e6794-83e8-4590-a272-685f89849f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:10.780834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b3c9d-46c9-4bbf-be5d-33992096541d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf6b982471a4960a675ea363f491589, user_id=a1f91543f7cf469a8b4b3ec80cc1e483, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:10.783495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b3c9d-46c9-4bbf-be5d-33992096541d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:10.815865 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2157/4326] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:10 2022] PUT /identity/v3/projects/bcf6b982471a4960a675ea363f491589/users/a1f91543f7cf469a8b4b3ec80cc1e483/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:10.885146 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2170/4327] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:10.919690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e93a-5bf8-4d76-8930-c9b588adaba8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:10.920178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e93a-5bf8-4d76-8930-c9b588adaba8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:10.920259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e93a-5bf8-4d76-8930-c9b588adaba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:10.931933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6794-83e8-4590-a272-685f89849f00 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:10.933380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8e0e6794-83e8-4590-a272-685f89849f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:11.017214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-78a6e93a-5bf8-4d76-8930-c9b588adaba8 None None] MFA Rules not processed for user `a1f91543f7cf469a8b4b3ec80cc1e483`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:11.018819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-78a6e93a-5bf8-4d76-8930-c9b588adaba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:11.103539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6794-83e8-4590-a272-685f89849f00 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:11.196581 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2158/4328] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:11.197672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e93a-5bf8-4d76-8930-c9b588adaba8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:11.199446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-78a6e93a-5bf8-4d76-8930-c9b588adaba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:11.263676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f48a8d-5993-4f0f-9e37-265b8c572916 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:11.264358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f48a8d-5993-4f0f-9e37-265b8c572916 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:11.264665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f48a8d-5993-4f0f-9e37-265b8c572916 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:11.264941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f48a8d-5993-4f0f-9e37-265b8c572916 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:11.349564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e93a-5bf8-4d76-8930-c9b588adaba8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:11.362356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:11.363394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:11.363679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:11.373578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] PATH_INFO: `/v3/projects/c125523d7f4642d7abd0b70eae302199` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:11.375386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c125523d7f4642d7abd0b70eae302199)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:11.377493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:11.425768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f48a8d-5993-4f0f-9e37-265b8c572916 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:11.432749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f48a8d-5993-4f0f-9e37-265b8c572916 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:11.486570 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2171/4329] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:01:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:01:11.495987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c125523d7f4642d7abd0b70eae302199', 'request_id': 'req-ec139105-1519-48e2-8283-19552122ca16'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:11.500655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f48a8d-5993-4f0f-9e37-265b8c572916 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:11.529170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c125523d7f4642d7abd0b70eae302199', 'request_id': 'req-ec139105-1519-48e2-8283-19552122ca16'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:11.562739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c125523d7f4642d7abd0b70eae302199', 'request_id': 'req-ec139105-1519-48e2-8283-19552122ca16'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:11.613954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f48a8d-5993-4f0f-9e37-265b8c572916 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:11.631620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] The token cache is being invalidate because project c125523d7f4642d7abd0b70eae302199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:11.631942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:11.635057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec139105-1519-48e2-8283-19552122ca16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:11.663575 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2159/4330] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:11 2022] DELETE /identity/v3/projects/c125523d7f4642d7abd0b70eae302199 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:11.665240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325d4e-1030-49f2-b195-bd4721d5e069 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:11.665525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325d4e-1030-49f2-b195-bd4721d5e069 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:11.665814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325d4e-1030-49f2-b195-bd4721d5e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:11.684657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f399b2c-45cb-4af1-9235-a01f282bf4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:11.685567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399b2c-45cb-4af1-9235-a01f282bf4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:11.685850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399b2c-45cb-4af1-9235-a01f282bf4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:11.686126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399b2c-45cb-4af1-9235-a01f282bf4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:11.692286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5f399b2c-45cb-4af1-9235-a01f282bf4f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:11.718029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9c325d4e-1030-49f2-b195-bd4721d5e069 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:11.719295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9c325d4e-1030-49f2-b195-bd4721d5e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:11.860954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f399b2c-45cb-4af1-9235-a01f282bf4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:11.868823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f399b2c-45cb-4af1-9235-a01f282bf4f4 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:11.911703 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2172/4331] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:11.912761 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2160/4332] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:01:11.920888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e92b3-6886-4b59-aec9-4b4d98b05ac1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:11.921178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e92b3-6886-4b59-aec9-4b4d98b05ac1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:11.921455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e92b3-6886-4b59-aec9-4b4d98b05ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:11.950534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c325d4e-1030-49f2-b195-bd4721d5e069 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:11.951994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9c325d4e-1030-49f2-b195-bd4721d5e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:11.962235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9f8e92b3-6886-4b59-aec9-4b4d98b05ac1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:11.963771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9f8e92b3-6886-4b59-aec9-4b4d98b05ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:11.980956 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2173/4333] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:11.982414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e92b3-6886-4b59-aec9-4b4d98b05ac1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:11.982951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c325d4e-1030-49f2-b195-bd4721d5e069 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:12.008282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:12.009208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.009493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.009768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] PATH_INFO: `/v3/users/a1f91543f7cf469a8b4b3ec80cc1e483` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.011649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e92b3-6886-4b59-aec9-4b4d98b05ac1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:12.017297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f91543f7cf469a8b4b3ec80cc1e483)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:12.019182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:12.032049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:12.032767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.033046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.033316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.034199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:01:12.034508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:12.036103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:12.078150 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2174/4334] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:12.083212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:12.106429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285cd2-de62-4522-b5fd-9f0ea4304cf9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:12.116915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:12.117644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.117925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.118196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.119330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:12.123170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:12.152911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f91543f7cf469a8b4b3ec80cc1e483'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:12.155358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f91543f7cf469a8b4b3ec80cc1e483'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:12.156609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f91543f7cf469a8b4b3ec80cc1e483'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:12.181226 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2175/4335] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:12 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:12.185549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:12.191292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:12.233403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f91543f7cf469a8b4b3ec80cc1e483'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:12.261588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8599ba3-bb72-4114-a8c0-ad6ad83d410c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f91543f7cf469a8b4b3ec80cc1e483'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:12.281987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2161/4336] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:11 2022] DELETE /identity/v3/users/a1f91543f7cf469a8b4b3ec80cc1e483 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:12.303468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057fd97-c684-4fe2-9253-8aa5af173a4a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.303776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057fd97-c684-4fe2-9253-8aa5af173a4a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.311318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057fd97-c684-4fe2-9253-8aa5af173a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.339776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4057fd97-c684-4fe2-9253-8aa5af173a4a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:12.342830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4057fd97-c684-4fe2-9253-8aa5af173a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:12.370498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbbdbd-f4a5-4d43-a0de-0323bca78140 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:12.502807 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2162/4337] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:12.513988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057fd97-c684-4fe2-9253-8aa5af173a4a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:12.515680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4057fd97-c684-4fe2-9253-8aa5af173a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:12.561290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd8b13-bb92-422f-9558-a83f7b2be017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:12.562325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd8b13-bb92-422f-9558-a83f7b2be017 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.562794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd8b13-bb92-422f-9558-a83f7b2be017 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.563647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd8b13-bb92-422f-9558-a83f7b2be017 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.564655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd8b13-bb92-422f-9558-a83f7b2be017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:12.566925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd8b13-bb92-422f-9558-a83f7b2be017 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:12.629135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2176/4338] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:12 2022] POST /identity/v3/users => generated 285 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:12.632961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd8b13-bb92-422f-9558-a83f7b2be017 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:12.661975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd8b13-bb92-422f-9558-a83f7b2be017 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:12.663786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057fd97-c684-4fe2-9253-8aa5af173a4a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:12.676071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d90be-8e2b-4c04-b2d8-6ed5b3625d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:12.678053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d90be-8e2b-4c04-b2d8-6ed5b3625d88 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.678348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d90be-8e2b-4c04-b2d8-6ed5b3625d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.678724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d90be-8e2b-4c04-b2d8-6ed5b3625d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.681013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807bf2c-9f6f-4b62-9e89-f2e8c7c2191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:12.681699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807bf2c-9f6f-4b62-9e89-f2e8c7c2191c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.681983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807bf2c-9f6f-4b62-9e89-f2e8c7c2191c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.682266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807bf2c-9f6f-4b62-9e89-f2e8c7c2191c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.683000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807bf2c-9f6f-4b62-9e89-f2e8c7c2191c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:12.685469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807bf2c-9f6f-4b62-9e89-f2e8c7c2191c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:12.709246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d90be-8e2b-4c04-b2d8-6ed5b3625d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:12.710712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d90be-8e2b-4c04-b2d8-6ed5b3625d88 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:12.741706 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2177/4339] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:12.742704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807bf2c-9f6f-4b62-9e89-f2e8c7c2191c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:12.746751 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2163/4340] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:01:12.779434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807bf2c-9f6f-4b62-9e89-f2e8c7c2191c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:12.809060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccee03-bb94-4de4-83ab-8bd05443f2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:12.810614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccee03-bb94-4de4-83ab-8bd05443f2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.810890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccee03-bb94-4de4-83ab-8bd05443f2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.811227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccee03-bb94-4de4-83ab-8bd05443f2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.811875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccee03-bb94-4de4-83ab-8bd05443f2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:12.813509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccee03-bb94-4de4-83ab-8bd05443f2f1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:12.855527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d90be-8e2b-4c04-b2d8-6ed5b3625d88 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:12.859575 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2178/4341] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:12.876828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d90be-8e2b-4c04-b2d8-6ed5b3625d88 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:12.892447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535210-65fe-4415-947f-4f626cc86bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:12.894409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535210-65fe-4415-947f-4f626cc86bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:12.895290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535210-65fe-4415-947f-4f626cc86bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:12.895677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535210-65fe-4415-947f-4f626cc86bfa admin admin] PATH_INFO: `/v3/projects/504c84b5a97741d4b89437a16260d379/users/589fbcfa5ed0488a8abcb6ea07bcf408/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:12.942529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67535210-65fe-4415-947f-4f626cc86bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=504c84b5a97741d4b89437a16260d379, user_id=589fbcfa5ed0488a8abcb6ea07bcf408, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:12.947865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67535210-65fe-4415-947f-4f626cc86bfa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:12.994975 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2164/4342] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:12 2022] PUT /identity/v3/projects/504c84b5a97741d4b89437a16260d379/users/589fbcfa5ed0488a8abcb6ea07bcf408/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:13.006853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01cf9f-fe53-4faa-a3df-e46763467b31 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:13.007171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01cf9f-fe53-4faa-a3df-e46763467b31 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:13.007420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01cf9f-fe53-4faa-a3df-e46763467b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:13.124509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6c01cf9f-fe53-4faa-a3df-e46763467b31 None None] MFA Rules not processed for user `589fbcfa5ed0488a8abcb6ea07bcf408`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:13.127722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6c01cf9f-fe53-4faa-a3df-e46763467b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:13.303076 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2179/4343] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:13.315326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535210-65fe-4415-947f-4f626cc86bfa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:13.505580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535210-65fe-4415-947f-4f626cc86bfa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:13.524998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dd660-1280-41c8-a6d8-28ac133ed9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:13.525678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dd660-1280-41c8-a6d8-28ac133ed9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:13.525961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dd660-1280-41c8-a6d8-28ac133ed9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:13.526237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dd660-1280-41c8-a6d8-28ac133ed9e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:13.526935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dd660-1280-41c8-a6d8-28ac133ed9e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:13.529535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dd660-1280-41c8-a6d8-28ac133ed9e1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:13.598960 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2165/4344] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:13 2022] POST /identity/v3/projects => generated 369 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:13.600654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01cf9f-fe53-4faa-a3df-e46763467b31 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:13.621022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01cf9f-fe53-4faa-a3df-e46763467b31 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:13.774732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba68dd3-3f15-4287-87e7-9853b55b5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:13.775619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68dd3-3f15-4287-87e7-9853b55b5bef admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:13.776009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68dd3-3f15-4287-87e7-9853b55b5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:13.776420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68dd3-3f15-4287-87e7-9853b55b5bef admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:13.785628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba68dd3-3f15-4287-87e7-9853b55b5bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:13.791864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba68dd3-3f15-4287-87e7-9853b55b5bef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:13.835316 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2180/4345] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:13 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:13.838933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dd660-1280-41c8-a6d8-28ac133ed9e1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:13.852834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dd660-1280-41c8-a6d8-28ac133ed9e1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:13.872652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e478a-776e-4d8b-8c6c-a408aed3e4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:13.873346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e478a-776e-4d8b-8c6c-a408aed3e4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:13.873624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e478a-776e-4d8b-8c6c-a408aed3e4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:13.873892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e478a-776e-4d8b-8c6c-a408aed3e4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:13.874617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e478a-776e-4d8b-8c6c-a408aed3e4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:13.876219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e478a-776e-4d8b-8c6c-a408aed3e4b1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:13.923230 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2166/4346] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:13.927146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba68dd3-3f15-4287-87e7-9853b55b5bef admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:13.947004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba68dd3-3f15-4287-87e7-9853b55b5bef admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:13.969084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:13.970222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:13.970708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:13.971182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] PATH_INFO: `/v3/projects/2d2bf54b29ee43898f581fbaf1208e1e/users/7fe4c901ea8b488da07c7a7118b56206/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.014059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2bf54b29ee43898f581fbaf1208e1e, user_id=7fe4c901ea8b488da07c7a7118b56206, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:14.024493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:14.074284 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2181/4347] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:13 2022] PUT /identity/v3/projects/2d2bf54b29ee43898f581fbaf1208e1e/users/7fe4c901ea8b488da07c7a7118b56206/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:14.078515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e478a-776e-4d8b-8c6c-a408aed3e4b1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:14.089609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:14.093175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:14.100864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e478a-776e-4d8b-8c6c-a408aed3e4b1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:14.242444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f733e-5ffb-43ba-a143-186f5f71f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:14.243625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f733e-5ffb-43ba-a143-186f5f71f5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:14.244550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f733e-5ffb-43ba-a143-186f5f71f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:14.244991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f733e-5ffb-43ba-a143-186f5f71f5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.246363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f733e-5ffb-43ba-a143-186f5f71f5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:14.248586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f733e-5ffb-43ba-a143-186f5f71f5f7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:14.261535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2167/4348] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:01:14.267712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f733e-5ffb-43ba-a143-186f5f71f5f7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:14.289151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450430b5-922c-4bd5-8123-f9d490324156 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:14.300311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f733e-5ffb-43ba-a143-186f5f71f5f7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:14.307185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba274dc-1c1e-4dac-89c1-61c2ac73f978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:14.308466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba274dc-1c1e-4dac-89c1-61c2ac73f978 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:14.308899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba274dc-1c1e-4dac-89c1-61c2ac73f978 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:14.309048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:14.309510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba274dc-1c1e-4dac-89c1-61c2ac73f978 admin admin] PATH_INFO: `/v3/projects/2d2bf54b29ee43898f581fbaf1208e1e/users/7fe4c901ea8b488da07c7a7118b56206/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.310895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:14.312656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:14.312656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] PATH_INFO: `/v3/projects/bcf6b982471a4960a675ea363f491589` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.313580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf6b982471a4960a675ea363f491589)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:14.314550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba274dc-1c1e-4dac-89c1-61c2ac73f978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2bf54b29ee43898f581fbaf1208e1e, user_id=7fe4c901ea8b488da07c7a7118b56206, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:14.317440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:14.317831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba274dc-1c1e-4dac-89c1-61c2ac73f978 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:14.336062 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2168/4349] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:14 2022] PUT /identity/v3/projects/2d2bf54b29ee43898f581fbaf1208e1e/users/7fe4c901ea8b488da07c7a7118b56206/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:14.346573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f0f1-f421-412c-8d44-1076a00df8a2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:14.346932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f0f1-f421-412c-8d44-1076a00df8a2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:14.347445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f0f1-f421-412c-8d44-1076a00df8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.431178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4843f0f1-f421-412c-8d44-1076a00df8a2 None None] MFA Rules not processed for user `7fe4c901ea8b488da07c7a7118b56206`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:14.434099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4843f0f1-f421-412c-8d44-1076a00df8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:14.487905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf6b982471a4960a675ea363f491589', 'request_id': 'req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:14.511267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf6b982471a4960a675ea363f491589', 'request_id': 'req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:14.534465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf6b982471a4960a675ea363f491589', 'request_id': 'req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:14.552482 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2169/4350] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:14.554168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f0f1-f421-412c-8d44-1076a00df8a2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:14.558982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] The token cache is being invalidate because project bcf6b982471a4960a675ea363f491589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:14.559275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:14.561633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-75b10042-151f-4ac2-bd8e-ad5e6a8f0f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:14.576393 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2182/4351] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:14 2022] DELETE /identity/v3/projects/bcf6b982471a4960a675ea363f491589 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:14.578752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146115ed-827d-4c03-8673-3ca96cee9e9d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:14.579050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146115ed-827d-4c03-8673-3ca96cee9e9d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:14.579418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146115ed-827d-4c03-8673-3ca96cee9e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.617164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-146115ed-827d-4c03-8673-3ca96cee9e9d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:14.618401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-146115ed-827d-4c03-8673-3ca96cee9e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:14.708986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f0f1-f421-412c-8d44-1076a00df8a2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:14.727642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:14.728346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:14.728634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:14.728910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.729610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:14.739943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:14.797491 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2183/4352] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:14.800285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1dda-f18b-4690-931d-41dca581735c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:14.802638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1dda-f18b-4690-931d-41dca581735c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:14.802947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1dda-f18b-4690-931d-41dca581735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.824730 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2170/4353] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:14 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:14.826367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:14.830678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:14.849777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-899e1dda-f18b-4690-931d-41dca581735c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:14.852034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-899e1dda-f18b-4690-931d-41dca581735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:14.958804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a195d6-fb7e-408c-821e-1244786e1442 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:14.969727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d3112-f381-4dd8-a37a-ded971645f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:14.973544 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2184/4354] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:14.973900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d3112-f381-4dd8-a37a-ded971645f2b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:14.977263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d3112-f381-4dd8-a37a-ded971645f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:14.977563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d3112-f381-4dd8-a37a-ded971645f2b admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:14.978311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d3112-f381-4dd8-a37a-ded971645f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:14.979689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e1dda-f18b-4690-931d-41dca581735c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:14.984356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d3112-f381-4dd8-a37a-ded971645f2b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:14.998974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e1dda-f18b-4690-931d-41dca581735c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.010385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.011691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.012029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.012308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.013293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:01:15.013602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.015326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.030110 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2171/4355] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:14 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:15.034074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d3112-f381-4dd8-a37a-ded971645f2b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.063211 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2185/4356] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:15.063305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d3112-f381-4dd8-a37a-ded971645f2b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.064918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.070526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a3664-0948-41aa-9d56-2c7a382be82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.071216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3664-0948-41aa-9d56-2c7a382be82c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.071500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3664-0948-41aa-9d56-2c7a382be82c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.073321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3664-0948-41aa-9d56-2c7a382be82c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.076648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a3664-0948-41aa-9d56-2c7a382be82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.078308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a3664-0948-41aa-9d56-2c7a382be82c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.080415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895fbb-c413-4705-a6a9-86686cfe17c6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.089650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4ecc6-9335-4b7a-93c6-69cafd9f66ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.091749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4ecc6-9335-4b7a-93c6-69cafd9f66ac admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.092007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4ecc6-9335-4b7a-93c6-69cafd9f66ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.092487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4ecc6-9335-4b7a-93c6-69cafd9f66ac admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.094313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4ecc6-9335-4b7a-93c6-69cafd9f66ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.096543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4ecc6-9335-4b7a-93c6-69cafd9f66ac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.102856 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2172/4357] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:01:15.105967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a3664-0948-41aa-9d56-2c7a382be82c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.126061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a3664-0948-41aa-9d56-2c7a382be82c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.136853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe2b1-3e4b-41d6-a56c-f4527e9ab476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.138086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe2b1-3e4b-41d6-a56c-f4527e9ab476 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.138378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe2b1-3e4b-41d6-a56c-f4527e9ab476 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.138914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe2b1-3e4b-41d6-a56c-f4527e9ab476 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.139705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe2b1-3e4b-41d6-a56c-f4527e9ab476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.141598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe2b1-3e4b-41d6-a56c-f4527e9ab476 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.158693 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2186/4358] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:15 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:15.159721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4ecc6-9335-4b7a-93c6-69cafd9f66ac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.180993 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2173/4359] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:15.184722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe2b1-3e4b-41d6-a56c-f4527e9ab476 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.209824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe2b1-3e4b-41d6-a56c-f4527e9ab476 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.296440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4ecc6-9335-4b7a-93c6-69cafd9f66ac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.306797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe176035-2a8d-442b-9006-e9a5209b8128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.307016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176035-2a8d-442b-9006-e9a5209b8128 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.307284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176035-2a8d-442b-9006-e9a5209b8128 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.307555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176035-2a8d-442b-9006-e9a5209b8128 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.308249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe176035-2a8d-442b-9006-e9a5209b8128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.313819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe176035-2a8d-442b-9006-e9a5209b8128 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.337360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814780c-3706-4627-90bd-f7820d2fa0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.339005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814780c-3706-4627-90bd-f7820d2fa0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.339381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814780c-3706-4627-90bd-f7820d2fa0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.339711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814780c-3706-4627-90bd-f7820d2fa0b6 admin admin] PATH_INFO: `/v3/projects/2680cca2b23e4a9ea144d05b11df6593/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.356468 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2187/4360] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:15 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:15.363045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe176035-2a8d-442b-9006-e9a5209b8128 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.389293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814780c-3706-4627-90bd-f7820d2fa0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2680cca2b23e4a9ea144d05b11df6593, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.393066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe176035-2a8d-442b-9006-e9a5209b8128 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.396586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814780c-3706-4627-90bd-f7820d2fa0b6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.404815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4922395-1105-4e22-8928-783f8909b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.405497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922395-1105-4e22-8928-783f8909b5fd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.406744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922395-1105-4e22-8928-783f8909b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.406744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922395-1105-4e22-8928-783f8909b5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.407760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4922395-1105-4e22-8928-783f8909b5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.409281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4922395-1105-4e22-8928-783f8909b5fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.428463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2174/4361] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:15 2022] PUT /identity/v3/projects/2680cca2b23e4a9ea144d05b11df6593/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:15.432874 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2188/4362] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:15.437545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814780c-3706-4627-90bd-f7820d2fa0b6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.446859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36eb36-3668-418d-bee1-2a2ac1eec208 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.447296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36eb36-3668-418d-bee1-2a2ac1eec208 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.448529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36eb36-3668-418d-bee1-2a2ac1eec208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.519443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2c36eb36-3668-418d-bee1-2a2ac1eec208 None None] MFA Rules not processed for user `3a1ef332cc464b409a56d4bc6a4a5e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:15.523755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2c36eb36-3668-418d-bee1-2a2ac1eec208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:15.590289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814780c-3706-4627-90bd-f7820d2fa0b6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.602971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a28ef-6da9-4875-acd5-e6dfbbb28dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.603647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a28ef-6da9-4875-acd5-e6dfbbb28dec admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.606058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a28ef-6da9-4875-acd5-e6dfbbb28dec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.607993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a28ef-6da9-4875-acd5-e6dfbbb28dec admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.608515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a28ef-6da9-4875-acd5-e6dfbbb28dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.612777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a28ef-6da9-4875-acd5-e6dfbbb28dec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.682480 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2175/4363] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:15.684147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a28ef-6da9-4875-acd5-e6dfbbb28dec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.751172 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2189/4364] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:15.756201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36eb36-3668-418d-bee1-2a2ac1eec208 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:15.761442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2c36eb36-3668-418d-bee1-2a2ac1eec208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:15.773471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a28ef-6da9-4875-acd5-e6dfbbb28dec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.791864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577be6d-b078-442a-babf-720e88a5dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:15.792992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577be6d-b078-442a-babf-720e88a5dca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.793305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577be6d-b078-442a-babf-720e88a5dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.793743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577be6d-b078-442a-babf-720e88a5dca2 admin admin] PATH_INFO: `/v3/projects/ba041742875449b6bf85e4a2e86cd8c0/users/ebd6259c46a34175ba713c970bcbfabb/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.841986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577be6d-b078-442a-babf-720e88a5dca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba041742875449b6bf85e4a2e86cd8c0, user_id=ebd6259c46a34175ba713c970bcbfabb, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:15.849285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577be6d-b078-442a-babf-720e88a5dca2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:15.893401 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2176/4365] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:15 2022] PUT /identity/v3/projects/ba041742875449b6bf85e4a2e86cd8c0/users/ebd6259c46a34175ba713c970bcbfabb/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:15.904926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4652-a732-497b-aad6-7a323ad7da16 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:15.906760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4652-a732-497b-aad6-7a323ad7da16 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:15.907087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4652-a732-497b-aad6-7a323ad7da16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:15.929075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36eb36-3668-418d-bee1-2a2ac1eec208 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:15.991262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6d2f4652-a732-497b-aad6-7a323ad7da16 None None] MFA Rules not processed for user `ebd6259c46a34175ba713c970bcbfabb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:15.994999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6d2f4652-a732-497b-aad6-7a323ad7da16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:16.029235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b794829-4379-45f6-884f-623c17cc5a25 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:16.035021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794829-4379-45f6-884f-623c17cc5a25 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:16.035395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794829-4379-45f6-884f-623c17cc5a25 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:16.035970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794829-4379-45f6-884f-623c17cc5a25 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:16.037386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b794829-4379-45f6-884f-623c17cc5a25 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:16.039427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b794829-4379-45f6-884f-623c17cc5a25 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:16.067667 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2190/4366] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:01:15 2022] POST /identity/v3/domains => generated 276 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:16.069637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b794829-4379-45f6-884f-623c17cc5a25 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:16.194605 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2177/4367] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:01:16.198225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4652-a732-497b-aad6-7a323ad7da16 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:16.235640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b794829-4379-45f6-884f-623c17cc5a25 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:16.260823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea5a4d-165a-40bb-984c-da05cc2a9346 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:16.265680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5a4d-165a-40bb-984c-da05cc2a9346 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:16.267277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5a4d-165a-40bb-984c-da05cc2a9346 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:16.267664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5a4d-165a-40bb-984c-da05cc2a9346 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:16.271071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea5a4d-165a-40bb-984c-da05cc2a9346 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:16.272908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea5a4d-165a-40bb-984c-da05cc2a9346 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:16.330529 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2191/4368] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:01:16 2022] POST /identity/v3/roles => generated 239 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:16.332209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea5a4d-165a-40bb-984c-da05cc2a9346 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:16.370621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea5a4d-165a-40bb-984c-da05cc2a9346 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:16.393809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8bead-6dfe-4f99-95f9-29d746aeb6eb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:16.395852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8bead-6dfe-4f99-95f9-29d746aeb6eb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:16.396142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8bead-6dfe-4f99-95f9-29d746aeb6eb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:16.396566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8bead-6dfe-4f99-95f9-29d746aeb6eb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/7525503584b44ab1ad4bb120da0e4956/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/f6b7cd4cf38b4334a0a784209a70afe4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:16.414923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4652-a732-497b-aad6-7a323ad7da16 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:16.452652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8bead-6dfe-4f99-95f9-29d746aeb6eb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7525503584b44ab1ad4bb120da0e4956, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a, role_id=f6b7cd4cf38b4334a0a784209a70afe4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:16.461276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8bead-6dfe-4f99-95f9-29d746aeb6eb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:16.561959 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2192/4369] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Feb 19 21:01:16 2022] PUT /identity/v3/domains/7525503584b44ab1ad4bb120da0e4956/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/f6b7cd4cf38b4334a0a784209a70afe4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:16.563615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8bead-6dfe-4f99-95f9-29d746aeb6eb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:16.571677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f68ea-612d-4d3d-bc07-2ad3bfba3d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:16.573756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f68ea-612d-4d3d-bc07-2ad3bfba3d96 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:16.574460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f68ea-612d-4d3d-bc07-2ad3bfba3d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:16.575214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f68ea-612d-4d3d-bc07-2ad3bfba3d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:16.577522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f68ea-612d-4d3d-bc07-2ad3bfba3d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:16.591204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f68ea-612d-4d3d-bc07-2ad3bfba3d96 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:16.676709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2178/4370] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:16 2022] POST /identity/v3/projects => generated 371 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:16.677783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f68ea-612d-4d3d-bc07-2ad3bfba3d96 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:16.835016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8bead-6dfe-4f99-95f9-29d746aeb6eb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:16.849689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f68ea-612d-4d3d-bc07-2ad3bfba3d96 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:16.864197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e0c52-9de4-4ed6-b87d-55155e7bc7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:16.865104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e0c52-9de4-4ed6-b87d-55155e7bc7cd admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:16.865488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e0c52-9de4-4ed6-b87d-55155e7bc7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:16.865885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e0c52-9de4-4ed6-b87d-55155e7bc7cd admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:16.866855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e0c52-9de4-4ed6-b87d-55155e7bc7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:16.869082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e0c52-9de4-4ed6-b87d-55155e7bc7cd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:16.908304 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2179/4371] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:16 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:16.918811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e0c52-9de4-4ed6-b87d-55155e7bc7cd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:16.938229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e0c52-9de4-4ed6-b87d-55155e7bc7cd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:16.970332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022cf57-021c-493c-ae2d-58065989d25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:16.971386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022cf57-021c-493c-ae2d-58065989d25b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:16.971896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022cf57-021c-493c-ae2d-58065989d25b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:16.972482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022cf57-021c-493c-ae2d-58065989d25b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:16.973455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022cf57-021c-493c-ae2d-58065989d25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:16.975455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022cf57-021c-493c-ae2d-58065989d25b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:16.994994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2dedc-96b2-4899-92c3-6383ba2ad1fa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:16.995693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2dedc-96b2-4899-92c3-6383ba2ad1fa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:16.995982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2dedc-96b2-4899-92c3-6383ba2ad1fa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:16.996269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2dedc-96b2-4899-92c3-6383ba2ad1fa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:16.997738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2dedc-96b2-4899-92c3-6383ba2ad1fa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:16.999989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2dedc-96b2-4899-92c3-6383ba2ad1fa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:17.005091 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2180/4372] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:16 2022] GET /identity/v3/roles => generated 1650 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:17.006565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022cf57-021c-493c-ae2d-58065989d25b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:17.034891 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2193/4373] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:01:16 2022] POST /identity/v3/domains => generated 277 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:17.038565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2dedc-96b2-4899-92c3-6383ba2ad1fa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:17.048996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022cf57-021c-493c-ae2d-58065989d25b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:17.195698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe0095-8416-4aa1-9025-c034336e00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:17.196355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe0095-8416-4aa1-9025-c034336e00ac admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:17.197731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe0095-8416-4aa1-9025-c034336e00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:17.197731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe0095-8416-4aa1-9025-c034336e00ac admin admin] PATH_INFO: `/v3/projects/f46023a8f2ac44c597b9f8af6f4becd3/users/ab8d5749523042ecad426659a5b4ffc8/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:17.229557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2dedc-96b2-4899-92c3-6383ba2ad1fa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:17.235102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0eed6-7346-4c72-b64d-f386e87bf730 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:17.236135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0eed6-7346-4c72-b64d-f386e87bf730 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:17.236646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe0095-8416-4aa1-9025-c034336e00ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46023a8f2ac44c597b9f8af6f4becd3, user_id=ab8d5749523042ecad426659a5b4ffc8, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:17.236947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0eed6-7346-4c72-b64d-f386e87bf730 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:17.237448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0eed6-7346-4c72-b64d-f386e87bf730 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:17.238417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0eed6-7346-4c72-b64d-f386e87bf730 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:17.240065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe0095-8416-4aa1-9025-c034336e00ac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:17.242088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0eed6-7346-4c72-b64d-f386e87bf730 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:17.271932 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2181/4374] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:17 2022] PUT /identity/v3/projects/f46023a8f2ac44c597b9f8af6f4becd3/users/ab8d5749523042ecad426659a5b4ffc8/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:17.276480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe0095-8416-4aa1-9025-c034336e00ac admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:17.283004 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2194/4375] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:01:17 2022] POST /identity/v3/roles => generated 239 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:17.286619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0eed6-7346-4c72-b64d-f386e87bf730 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:17.319579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0eed6-7346-4c72-b64d-f386e87bf730 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:17.401306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe0095-8416-4aa1-9025-c034336e00ac admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:17.412381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291b284-2ec5-4aba-8e2c-94b088a229f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:17.413177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b284-2ec5-4aba-8e2c-94b088a229f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:17.413372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b284-2ec5-4aba-8e2c-94b088a229f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:17.413638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b284-2ec5-4aba-8e2c-94b088a229f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:17.426506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291b284-2ec5-4aba-8e2c-94b088a229f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:17.432207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291b284-2ec5-4aba-8e2c-94b088a229f4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:17.468586 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2182/4376] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:17 2022] GET /identity/v3/roles => generated 1880 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:17.469519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291b284-2ec5-4aba-8e2c-94b088a229f4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:17.481855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc3705-39e7-477d-b1cc-5854e4d2d643 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:17.483059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc3705-39e7-477d-b1cc-5854e4d2d643 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:17.483367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc3705-39e7-477d-b1cc-5854e4d2d643 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:17.483670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc3705-39e7-477d-b1cc-5854e4d2d643 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:17.484612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc3705-39e7-477d-b1cc-5854e4d2d643 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:17.490172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc3705-39e7-477d-b1cc-5854e4d2d643 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:17.492229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291b284-2ec5-4aba-8e2c-94b088a229f4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:17.506024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4642e-b1a4-4735-bf14-f3910959fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:17.507239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4642e-b1a4-4735-bf14-f3910959fba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:17.507239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4642e-b1a4-4735-bf14-f3910959fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:17.507466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4642e-b1a4-4735-bf14-f3910959fba9 admin admin] PATH_INFO: `/v3/projects/f46023a8f2ac44c597b9f8af6f4becd3/users/ab8d5749523042ecad426659a5b4ffc8/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:17.513308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4642e-b1a4-4735-bf14-f3910959fba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46023a8f2ac44c597b9f8af6f4becd3, user_id=ab8d5749523042ecad426659a5b4ffc8, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:17.516101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4642e-b1a4-4735-bf14-f3910959fba9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:17.543362 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2183/4377] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:17 2022] PUT /identity/v3/projects/f46023a8f2ac44c597b9f8af6f4becd3/users/ab8d5749523042ecad426659a5b4ffc8/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:17.553818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a793370-b284-4fc3-8521-2f42f73ac7eb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:17.554770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a793370-b284-4fc3-8521-2f42f73ac7eb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:17.554770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a793370-b284-4fc3-8521-2f42f73ac7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:17.585670 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2195/4378] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:01:17 2022] POST /identity/v3/groups => generated 324 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:17.594572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc3705-39e7-477d-b1cc-5854e4d2d643 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:17.605507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc3705-39e7-477d-b1cc-5854e4d2d643 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:17.642760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8a793370-b284-4fc3-8521-2f42f73ac7eb None None] MFA Rules not processed for user `ab8d5749523042ecad426659a5b4ffc8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:17.646786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a793370-b284-4fc3-8521-2f42f73ac7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:17.684512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0167c5-541b-42db-81aa-625bf778185b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:17.686308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0167c5-541b-42db-81aa-625bf778185b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:17.686592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0167c5-541b-42db-81aa-625bf778185b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:17.686868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0167c5-541b-42db-81aa-625bf778185b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/groups/57ceb2523073491ab487aa756b6974cc/users/3a1ef332cc464b409a56d4bc6a4a5e2a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:17.705538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0167c5-541b-42db-81aa-625bf778185b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=57ceb2523073491ab487aa756b6974cc, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:17.707488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0167c5-541b-42db-81aa-625bf778185b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:17.793574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2196/4379] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Feb 19 21:01:17 2022] PUT /identity/v3/groups/57ceb2523073491ab487aa756b6974cc/users/3a1ef332cc464b409a56d4bc6a4a5e2a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:17.799621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0167c5-541b-42db-81aa-625bf778185b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:17.866236 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2184/4380] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:17.887273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a793370-b284-4fc3-8521-2f42f73ac7eb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:17.891312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a793370-b284-4fc3-8521-2f42f73ac7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:17.971425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0167c5-541b-42db-81aa-625bf778185b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:17.986434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373cefe-8a4f-4848-bf0b-4db4c17af68b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:17.988105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373cefe-8a4f-4848-bf0b-4db4c17af68b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:17.989602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373cefe-8a4f-4848-bf0b-4db4c17af68b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:17.989962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373cefe-8a4f-4848-bf0b-4db4c17af68b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/35edfc5ed58145b6888492ff1bc91e9a/groups/57ceb2523073491ab487aa756b6974cc/roles/f2402fdbf8a84d17b2862439517c7ab1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:17.998735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373cefe-8a4f-4848-bf0b-4db4c17af68b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=35edfc5ed58145b6888492ff1bc91e9a, group_id=57ceb2523073491ab487aa756b6974cc, role_id=f2402fdbf8a84d17b2862439517c7ab1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:18.006050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373cefe-8a4f-4848-bf0b-4db4c17af68b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:18.061360 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2197/4381] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:17 2022] PUT /identity/v3/domains/35edfc5ed58145b6888492ff1bc91e9a/groups/57ceb2523073491ab487aa756b6974cc/roles/f2402fdbf8a84d17b2862439517c7ab1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:18.066881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373cefe-8a4f-4848-bf0b-4db4c17af68b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:18.104687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a793370-b284-4fc3-8521-2f42f73ac7eb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:18.241512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373cefe-8a4f-4848-bf0b-4db4c17af68b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:18.262185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc027d5-0274-4ca4-bb22-6f3758627dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:18.263712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc027d5-0274-4ca4-bb22-6f3758627dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:18.264073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc027d5-0274-4ca4-bb22-6f3758627dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:18.264384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2b64-0046-4609-914f-114c63729b16 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:18.265035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc027d5-0274-4ca4-bb22-6f3758627dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:18.265806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2b64-0046-4609-914f-114c63729b16 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:18.266099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2b64-0046-4609-914f-114c63729b16 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:18.269640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b2b64-0046-4609-914f-114c63729b16 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:18.272954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b2b64-0046-4609-914f-114c63729b16 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:18.277408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b2b64-0046-4609-914f-114c63729b16 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:18.333246 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2198/4382] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:01:18 2022] POST /identity/v3/domains => generated 276 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:18.334526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2b64-0046-4609-914f-114c63729b16 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:18.390297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc027d5-0274-4ca4-bb22-6f3758627dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:18.399859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc027d5-0274-4ca4-bb22-6f3758627dc0 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:18.413248 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2185/4383] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:01:18.619433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b2b64-0046-4609-914f-114c63729b16 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:18.646686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef51da-194a-47f1-b717-35847f92443b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:18.647395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef51da-194a-47f1-b717-35847f92443b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:18.647686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef51da-194a-47f1-b717-35847f92443b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:18.648256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef51da-194a-47f1-b717-35847f92443b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:18.648765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef51da-194a-47f1-b717-35847f92443b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:18.650404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef51da-194a-47f1-b717-35847f92443b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:18.690820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2199/4384] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:01:18 2022] POST /identity/v3/roles => generated 240 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:18.706276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc027d5-0274-4ca4-bb22-6f3758627dc0 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:18.739212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc027d5-0274-4ca4-bb22-6f3758627dc0 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:18.754287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727faa11-17b8-42b8-a09b-47459dd01a6c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:18.755589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727faa11-17b8-42b8-a09b-47459dd01a6c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:18.757135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727faa11-17b8-42b8-a09b-47459dd01a6c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:18.757712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727faa11-17b8-42b8-a09b-47459dd01a6c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/384b35703b2741cd91477698e361c6aa/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/e041267bcd9c4e30be5139f6b0a32186` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:18.782324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727faa11-17b8-42b8-a09b-47459dd01a6c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=384b35703b2741cd91477698e361c6aa, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a, role_id=e041267bcd9c4e30be5139f6b0a32186)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:18.785209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727faa11-17b8-42b8-a09b-47459dd01a6c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:18.829469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2186/4385] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Feb 19 21:01:18 2022] PUT /identity/v3/domains/384b35703b2741cd91477698e361c6aa/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/e041267bcd9c4e30be5139f6b0a32186 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:18.831136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef51da-194a-47f1-b717-35847f92443b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:18.864149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef51da-194a-47f1-b717-35847f92443b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:19.021372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b93aea-dc54-4aa3-9a5b-7f16b659d159 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:19.022236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93aea-dc54-4aa3-9a5b-7f16b659d159 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:19.024098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93aea-dc54-4aa3-9a5b-7f16b659d159 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:19.025235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93aea-dc54-4aa3-9a5b-7f16b659d159 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:19.027685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b93aea-dc54-4aa3-9a5b-7f16b659d159 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:19.031828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b93aea-dc54-4aa3-9a5b-7f16b659d159 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:19.082237 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2200/4386] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:01:18 2022] POST /identity/v3/domains => generated 276 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:19.086074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727faa11-17b8-42b8-a09b-47459dd01a6c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:19.116206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727faa11-17b8-42b8-a09b-47459dd01a6c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:19.217749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90a404-d78d-42ee-9a8e-42ae122628cd tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:19.218506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90a404-d78d-42ee-9a8e-42ae122628cd tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:19.218860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90a404-d78d-42ee-9a8e-42ae122628cd tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:19.219204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90a404-d78d-42ee-9a8e-42ae122628cd tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:19.220116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90a404-d78d-42ee-9a8e-42ae122628cd tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:19.236284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90a404-d78d-42ee-9a8e-42ae122628cd tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:19.272740 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2187/4387] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:01:19 2022] POST /identity/v3/roles => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:19.276875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b93aea-dc54-4aa3-9a5b-7f16b659d159 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:19.288828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b93aea-dc54-4aa3-9a5b-7f16b659d159 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:19.308115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea90bfa-1af8-434b-a36a-aa5db0b6775e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:19.308115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea90bfa-1af8-434b-a36a-aa5db0b6775e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:19.308115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea90bfa-1af8-434b-a36a-aa5db0b6775e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:19.310308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea90bfa-1af8-434b-a36a-aa5db0b6775e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:19.310308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea90bfa-1af8-434b-a36a-aa5db0b6775e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:19.311304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985795-a683-4387-9d91-af5e0709f881 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:19.311492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985795-a683-4387-9d91-af5e0709f881 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:19.311746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985795-a683-4387-9d91-af5e0709f881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:19.323398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea90bfa-1af8-434b-a36a-aa5db0b6775e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:19.378334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eb985795-a683-4387-9d91-af5e0709f881 None None] MFA Rules not processed for user `a36b20fc4b8b4b71aea23626d52cefa9`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:19.386911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb985795-a683-4387-9d91-af5e0709f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:19.459115 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2201/4388] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:01:19 2022] POST /identity/v3/groups => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:19.459115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea90bfa-1af8-434b-a36a-aa5db0b6775e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:19.547889 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2188/4389] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:19.549135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985795-a683-4387-9d91-af5e0709f881 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:19.580933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985795-a683-4387-9d91-af5e0709f881 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:19.593515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946e1c9-92d8-4f07-8c15-ef6754f5d9cb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:19.596361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e1c9-92d8-4f07-8c15-ef6754f5d9cb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:19.596925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e1c9-92d8-4f07-8c15-ef6754f5d9cb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:19.597343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e1c9-92d8-4f07-8c15-ef6754f5d9cb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/groups/871569d295f24e93b6ef41df5955b52c/users/3a1ef332cc464b409a56d4bc6a4a5e2a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:19.609943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946e1c9-92d8-4f07-8c15-ef6754f5d9cb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=871569d295f24e93b6ef41df5955b52c, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:19.612501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea90bfa-1af8-434b-a36a-aa5db0b6775e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:19.614655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946e1c9-92d8-4f07-8c15-ef6754f5d9cb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:19.621454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:19.622493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:19.623149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:19.623449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] PATH_INFO: `/v3/users/ebd6259c46a34175ba713c970bcbfabb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:19.626107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd6259c46a34175ba713c970bcbfabb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:19.626770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:19.716462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2189/4390] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Feb 19 21:01:19 2022] PUT /identity/v3/groups/871569d295f24e93b6ef41df5955b52c/users/3a1ef332cc464b409a56d4bc6a4a5e2a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:19.720797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946e1c9-92d8-4f07-8c15-ef6754f5d9cb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:19.781204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd6259c46a34175ba713c970bcbfabb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:19.805684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd6259c46a34175ba713c970bcbfabb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:19.834230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd6259c46a34175ba713c970bcbfabb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:19.834887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd6259c46a34175ba713c970bcbfabb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:19.835517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b801cad6-b1ff-4f6e-a161-30fd6e4fae4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd6259c46a34175ba713c970bcbfabb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:19.861388 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2202/4391] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:19 2022] DELETE /identity/v3/users/ebd6259c46a34175ba713c970bcbfabb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:19.869532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9d38-d614-49cf-952c-4fe7416c5ef9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:19.869532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9d38-d614-49cf-952c-4fe7416c5ef9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:19.869784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9d38-d614-49cf-952c-4fe7416c5ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:19.903287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f6ad9d38-d614-49cf-952c-4fe7416c5ef9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:19.908722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f6ad9d38-d614-49cf-952c-4fe7416c5ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:19.976072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946e1c9-92d8-4f07-8c15-ef6754f5d9cb tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:20.100771 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2203/4392] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:20.160463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9d38-d614-49cf-952c-4fe7416c5ef9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:20.162564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f6ad9d38-d614-49cf-952c-4fe7416c5ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:20.179792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:20.185604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:20.186118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:20.196199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/50574d7940864c96b89a8fe1cec9b719/groups/871569d295f24e93b6ef41df5955b52c/roles/ce155a8baffa435f9d091acf1bbccf29` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:20.196199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=50574d7940864c96b89a8fe1cec9b719, group_id=871569d295f24e93b6ef41df5955b52c, role_id=ce155a8baffa435f9d091acf1bbccf29)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:20.196199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:20.226380 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2190/4393] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:19 2022] PUT /identity/v3/domains/50574d7940864c96b89a8fe1cec9b719/groups/871569d295f24e93b6ef41df5955b52c/roles/ce155a8baffa435f9d091acf1bbccf29 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:20.230826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:20.233602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:20.351501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9d38-d614-49cf-952c-4fe7416c5ef9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:20.454379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd938-2ccf-4ef4-9e3d-6e60e234d163 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:20.469270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1ef332cc464b409a56d4bc6a4a5e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2680cca2b23e4a9ea144d05b11df6593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:20.472532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:20.473173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:20.474207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] PATH_INFO: `/v3/auth/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:20.476270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:20.478779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:20.596191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606829b-41c7-41e2-ae6d-ae89d2b1ce97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:20.598509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606829b-41c7-41e2-ae6d-ae89d2b1ce97 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:20.600136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606829b-41c7-41e2-ae6d-ae89d2b1ce97 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:20.600784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606829b-41c7-41e2-ae6d-ae89d2b1ce97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:20.709870 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2191/4394] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 21:01:20 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:01:20.710860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:20.718509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:20.760624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606829b-41c7-41e2-ae6d-ae89d2b1ce97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:20.762141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606829b-41c7-41e2-ae6d-ae89d2b1ce97 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:20.790611 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2204/4395] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:20.871584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8430-32d1-4605-b6ac-6e9bad7536e1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:20.871860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8430-32d1-4605-b6ac-6e9bad7536e1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:20.873946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8430-32d1-4605-b6ac-6e9bad7536e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:20.927515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-db6f8430-32d1-4605-b6ac-6e9bad7536e1 None None] MFA Rules not processed for user `71f534f513ef45d29629b913de461f23`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:20.930272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-db6f8430-32d1-4605-b6ac-6e9bad7536e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:21.022547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9948dce-cf9b-4f72-80a6-7e1102be9c81 tempest-TokensV3TestJSON-2104849031 tempest-TokensV3TestJSON-2104849031-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:21.041017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:21.042250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:21.042536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:21.043430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/50574d7940864c96b89a8fe1cec9b719/groups/871569d295f24e93b6ef41df5955b52c/roles/ce155a8baffa435f9d091acf1bbccf29` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:21.049210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=50574d7940864c96b89a8fe1cec9b719, group_id=871569d295f24e93b6ef41df5955b52c, role_id=ce155a8baffa435f9d091acf1bbccf29)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:21.051487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:21.064514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role ce155a8baffa435f9d091acf1bbccf29 was removed from group 871569d295f24e93b6ef41df5955b52c on domain 50574d7940864c96b89a8fe1cec9b719. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:21.064810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:21.067689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:21.102283 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2192/4396] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Feb 19 21:01:20 2022] DELETE /identity/v3/domains/50574d7940864c96b89a8fe1cec9b719/groups/871569d295f24e93b6ef41df5955b52c/roles/ce155a8baffa435f9d091acf1bbccf29 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:21.106903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:21.110324 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2205/4397] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:01:21.110829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:21.269806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b63bc5-c0ee-4b70-a28d-5c804c1f576e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:21.285293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:21.286063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:21.286356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:21.287031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/groups/871569d295f24e93b6ef41df5955b52c/users/3a1ef332cc464b409a56d4bc6a4a5e2a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:21.289303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=871569d295f24e93b6ef41df5955b52c, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:21.297807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:21.327614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3a1ef332cc464b409a56d4bc6a4a5e2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:21.367534 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2193/4398] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Feb 19 21:01:21 2022] DELETE /identity/v3/groups/871569d295f24e93b6ef41df5955b52c/users/3a1ef332cc464b409a56d4bc6a4a5e2a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:21.372639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8430-32d1-4605-b6ac-6e9bad7536e1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:21.417819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8430-32d1-4605-b6ac-6e9bad7536e1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:21.503058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:21.504541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:21.505059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:21.505587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/groups/871569d295f24e93b6ef41df5955b52c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:21.506892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_group(group_id=871569d295f24e93b6ef41df5955b52c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:21.508851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:21.611121 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2206/4399] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:01:21 2022] DELETE /identity/v3/groups/871569d295f24e93b6ef41df5955b52c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:21.615523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:21.634407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57237e-ba11-4463-9203-dba0b49367c2 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:21.730636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:21.732036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:21.732354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:21.732675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles/ce155a8baffa435f9d091acf1bbccf29` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:21.735145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ce155a8baffa435f9d091acf1bbccf29)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:21.737380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:21.804832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role ce155a8baffa435f9d091acf1bbccf29 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:21.806886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:21.808112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:21.814056 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2194/4400] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:21 2022] DELETE /identity/v3/roles/ce155a8baffa435f9d091acf1bbccf29 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:21.818662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:21.821934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:21.857759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9506d-2bd4-454c-8fcf-358dabb8afef tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:22.021383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:22.031217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:22.074221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:22.076641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:22.077090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:22.077423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/50574d7940864c96b89a8fe1cec9b719` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:22.078964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=50574d7940864c96b89a8fe1cec9b719)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:22.081935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:22.106386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '50574d7940864c96b89a8fe1cec9b719'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.108574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '50574d7940864c96b89a8fe1cec9b719'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.202272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '50574d7940864c96b89a8fe1cec9b719'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.203882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '50574d7940864c96b89a8fe1cec9b719'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.209441 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2207/4401] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:21 2022] PATCH /identity/v3/domains/50574d7940864c96b89a8fe1cec9b719 => generated 277 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:22.215178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:22.219014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:22.243820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10cab-57ce-4c6f-add9-9d5f5f9a89d4 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:22.407516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:22.408971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:22.411271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:22.411271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] PATH_INFO: `/v3/projects/ba041742875449b6bf85e4a2e86cd8c0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:22.411271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba041742875449b6bf85e4a2e86cd8c0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:22.415602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:22.428065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992dd23-9e89-4ff8-981c-06c1dab0ec32 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:22.451490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:22.452631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:22.452771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:22.452959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/50574d7940864c96b89a8fe1cec9b719` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:22.476534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=50574d7940864c96b89a8fe1cec9b719)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:22.478124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:22.528414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '50574d7940864c96b89a8fe1cec9b719'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.541149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '50574d7940864c96b89a8fe1cec9b719'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.609301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba041742875449b6bf85e4a2e86cd8c0', 'request_id': 'req-9cdd6806-7dd8-4d48-aa47-9828596cce9b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.627446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50574d7940864c96b89a8fe1cec9b719', 'request_id': 'req-36724aa4-2e4e-450d-ba95-f050c3827690'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.628273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba041742875449b6bf85e4a2e86cd8c0', 'request_id': 'req-9cdd6806-7dd8-4d48-aa47-9828596cce9b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.635702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50574d7940864c96b89a8fe1cec9b719', 'request_id': 'req-36724aa4-2e4e-450d-ba95-f050c3827690'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.656265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba041742875449b6bf85e4a2e86cd8c0', 'request_id': 'req-9cdd6806-7dd8-4d48-aa47-9828596cce9b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.670767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50574d7940864c96b89a8fe1cec9b719', 'request_id': 'req-36724aa4-2e4e-450d-ba95-f050c3827690'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.689192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] The token cache is being invalidate because project 50574d7940864c96b89a8fe1cec9b719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:22.689568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.690262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.701506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] The token cache is being invalidate because project ba041742875449b6bf85e4a2e86cd8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:22.701506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.701506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.703767 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2195/4402] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:22 2022] DELETE /identity/v3/projects/ba041742875449b6bf85e4a2e86cd8c0 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:22.704711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:22.706315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:22.716271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '50574d7940864c96b89a8fe1cec9b719', 'request_id': 'req-36724aa4-2e4e-450d-ba95-f050c3827690'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.732853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '50574d7940864c96b89a8fe1cec9b719', 'request_id': 'req-36724aa4-2e4e-450d-ba95-f050c3827690'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.735602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '50574d7940864c96b89a8fe1cec9b719', 'request_id': 'req-36724aa4-2e4e-450d-ba95-f050c3827690'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.748096 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2208/4403] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:01:22 2022] DELETE /identity/v3/domains/50574d7940864c96b89a8fe1cec9b719 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:22.752962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:22.755247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:22.836460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd6806-7dd8-4d48-aa47-9828596cce9b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:22.879990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36724aa4-2e4e-450d-ba95-f050c3827690 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:22.885518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:22.886538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:22.886941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:22.887321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/384b35703b2741cd91477698e361c6aa/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/e041267bcd9c4e30be5139f6b0a32186` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:22.890618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=384b35703b2741cd91477698e361c6aa, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a, role_id=e041267bcd9c4e30be5139f6b0a32186)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:22.893769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:22.900698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role e041267bcd9c4e30be5139f6b0a32186 was removed from user 3a1ef332cc464b409a56d4bc6a4a5e2a on domain 384b35703b2741cd91477698e361c6aa. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:22.901143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.901991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:22.936368 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2209/4404] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 21:01:22 2022] DELETE /identity/v3/domains/384b35703b2741cd91477698e361c6aa/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/e041267bcd9c4e30be5139f6b0a32186 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:22.939447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:22.941862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:22.993535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:22.994489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:22.994732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:22.994956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] PATH_INFO: `/v3/users/ab8d5749523042ecad426659a5b4ffc8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:23.009450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8d5749523042ecad426659a5b4ffc8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:23.011440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:23.050907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab8112-3db3-4834-a650-42a8d6de89a0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:23.061396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:23.062385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:23.062662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:23.063130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles/e041267bcd9c4e30be5139f6b0a32186` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:23.064819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e041267bcd9c4e30be5139f6b0a32186)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:23.070495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:23.134383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8d5749523042ecad426659a5b4ffc8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.135831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8d5749523042ecad426659a5b4ffc8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.137610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8d5749523042ecad426659a5b4ffc8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.151619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role e041267bcd9c4e30be5139f6b0a32186 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:23.151969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.153035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.155275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8d5749523042ecad426659a5b4ffc8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.156358 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2210/4405] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:22 2022] DELETE /identity/v3/roles/e041267bcd9c4e30be5139f6b0a32186 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:23.160670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:23.163941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:23.180228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8d5749523042ecad426659a5b4ffc8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.209081 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2196/4406] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:22 2022] DELETE /identity/v3/users/ab8d5749523042ecad426659a5b4ffc8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:23.253618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:23.255426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:23.344158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cbda9-e612-433b-966a-22574c3a89ff admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:23.352877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:23.353714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:23.354043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:23.354324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:23.358595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:23.380081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336399-92eb-4ce5-91a5-004c930ba2ac tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:23.395647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:23.400099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:23.466310 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2197/4407] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:23.594944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:23.599947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:23.600630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:23.600812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/384b35703b2741cd91477698e361c6aa` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:23.604184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=384b35703b2741cd91477698e361c6aa)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:23.614918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:23.668537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '384b35703b2741cd91477698e361c6aa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.670375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '384b35703b2741cd91477698e361c6aa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.743724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '384b35703b2741cd91477698e361c6aa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.749251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '384b35703b2741cd91477698e361c6aa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:23.760161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:23.761020 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2211/4408] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:23 2022] PATCH /identity/v3/domains/384b35703b2741cd91477698e361c6aa => generated 277 bytes in 601 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:01:23.779028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c3a8-d209-4fb3-992e-757fa73ffe32 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:23.936236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:23.937625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:23.937625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:23.937880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/384b35703b2741cd91477698e361c6aa` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:23.962761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=384b35703b2741cd91477698e361c6aa)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:23.965300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:24.014115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:24.015820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.046422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '384b35703b2741cd91477698e361c6aa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.050804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '384b35703b2741cd91477698e361c6aa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.111616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fefda9-ca11-4515-bf0f-aece12adb077 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:24.141101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384b35703b2741cd91477698e361c6aa', 'request_id': 'req-f22558b7-6e5f-4931-899b-9fcb4e9e8038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.154283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384b35703b2741cd91477698e361c6aa', 'request_id': 'req-f22558b7-6e5f-4931-899b-9fcb4e9e8038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.165797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384b35703b2741cd91477698e361c6aa', 'request_id': 'req-f22558b7-6e5f-4931-899b-9fcb4e9e8038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.184387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] The token cache is being invalidate because project 384b35703b2741cd91477698e361c6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:24.185509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.186274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.189108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:24.190145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:24.190846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:24.191279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] PATH_INFO: `/v3/projects/f46023a8f2ac44c597b9f8af6f4becd3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:24.192704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46023a8f2ac44c597b9f8af6f4becd3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:24.194813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:24.210650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '384b35703b2741cd91477698e361c6aa', 'request_id': 'req-f22558b7-6e5f-4931-899b-9fcb4e9e8038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.212546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '384b35703b2741cd91477698e361c6aa', 'request_id': 'req-f22558b7-6e5f-4931-899b-9fcb4e9e8038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.217229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f22558b7-6e5f-4931-899b-9fcb4e9e8038 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '384b35703b2741cd91477698e361c6aa', 'request_id': 'req-f22558b7-6e5f-4931-899b-9fcb4e9e8038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.231178 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2198/4409] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:01:23 2022] DELETE /identity/v3/domains/384b35703b2741cd91477698e361c6aa => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:24.234077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93230-0125-4f4d-84c7-b8a0c942066c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:24.234385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93230-0125-4f4d-84c7-b8a0c942066c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:24.234706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93230-0125-4f4d-84c7-b8a0c942066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:24.259332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46023a8f2ac44c597b9f8af6f4becd3', 'request_id': 'req-363595a5-27e1-479e-9eb6-f0d79d85b667'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.262263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-54e93230-0125-4f4d-84c7-b8a0c942066c None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:24.264465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-54e93230-0125-4f4d-84c7-b8a0c942066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.266733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46023a8f2ac44c597b9f8af6f4becd3', 'request_id': 'req-363595a5-27e1-479e-9eb6-f0d79d85b667'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.280723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46023a8f2ac44c597b9f8af6f4becd3', 'request_id': 'req-363595a5-27e1-479e-9eb6-f0d79d85b667'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.297443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] The token cache is being invalidate because project f46023a8f2ac44c597b9f8af6f4becd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:24.297639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.298310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.299885 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2212/4410] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:24 2022] DELETE /identity/v3/projects/f46023a8f2ac44c597b9f8af6f4becd3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:24.305201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:24.306586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.371455 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2199/4411] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:24.381225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6dfb-7a7f-4e9d-acf2-d51e9647b747 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:24.381940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6dfb-7a7f-4e9d-acf2-d51e9647b747 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:24.382513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6dfb-7a7f-4e9d-acf2-d51e9647b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:24.409866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363595a5-27e1-479e-9eb6-f0d79d85b667 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:24.417912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a65f6dfb-7a7f-4e9d-acf2-d51e9647b747 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:24.419619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:24.420569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:24.420866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:24.421286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a65f6dfb-7a7f-4e9d-acf2-d51e9647b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.421728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/35edfc5ed58145b6888492ff1bc91e9a/groups/57ceb2523073491ab487aa756b6974cc/roles/f2402fdbf8a84d17b2862439517c7ab1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:24.424729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=35edfc5ed58145b6888492ff1bc91e9a, group_id=57ceb2523073491ab487aa756b6974cc, role_id=f2402fdbf8a84d17b2862439517c7ab1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:24.428033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:24.445135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role f2402fdbf8a84d17b2862439517c7ab1 was removed from group 57ceb2523073491ab487aa756b6974cc on domain 35edfc5ed58145b6888492ff1bc91e9a. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:24.445445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.446214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.475281 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2213/4412] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Feb 19 21:01:24 2022] DELETE /identity/v3/domains/35edfc5ed58145b6888492ff1bc91e9a/groups/57ceb2523073491ab487aa756b6974cc/roles/f2402fdbf8a84d17b2862439517c7ab1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:24.475281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:24.475281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.518846 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2200/4413] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:24.521951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6dfb-7a7f-4e9d-acf2-d51e9647b747 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:24.523891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a65f6dfb-7a7f-4e9d-acf2-d51e9647b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.542890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6dfb-7a7f-4e9d-acf2-d51e9647b747 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:24.569885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e13a4-1a1f-4840-a8c8-125578a4f1ce tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:24.586214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:24.586883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:24.587225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:24.587514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:24.593566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.638331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfcaa1-e131-4f25-9bd1-8dd7239f67ad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:24.639378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcaa1-e131-4f25-9bd1-8dd7239f67ad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:24.639671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcaa1-e131-4f25-9bd1-8dd7239f67ad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:24.639952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcaa1-e131-4f25-9bd1-8dd7239f67ad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/groups/57ceb2523073491ab487aa756b6974cc/users/3a1ef332cc464b409a56d4bc6a4a5e2a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:24.642894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfcaa1-e131-4f25-9bd1-8dd7239f67ad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=57ceb2523073491ab487aa756b6974cc, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:24.648943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfcaa1-e131-4f25-9bd1-8dd7239f67ad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:24.677732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30dfcaa1-e131-4f25-9bd1-8dd7239f67ad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3a1ef332cc464b409a56d4bc6a4a5e2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:24.714005 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2201/4414] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Feb 19 21:01:24 2022] DELETE /identity/v3/groups/57ceb2523073491ab487aa756b6974cc/users/3a1ef332cc464b409a56d4bc6a4a5e2a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:24.714005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d3cb6-1fcf-4a68-a73d-af37a811fd00 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:24.714005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d3cb6-1fcf-4a68-a73d-af37a811fd00 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:24.714005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d3cb6-1fcf-4a68-a73d-af37a811fd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:24.742279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:24.744527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:24.755659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-523d3cb6-1fcf-4a68-a73d-af37a811fd00 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:24.760154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-523d3cb6-1fcf-4a68-a73d-af37a811fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.769880 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2214/4415] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:01:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:24.770808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:24.774463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:24.887264 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2202/4416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:24.888902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d3cb6-1fcf-4a68-a73d-af37a811fd00 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:24.936071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb786-e60f-4adf-82bd-bf28e429ccbd service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:25.056435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:25.056873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:25.057158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:25.057438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:25.059827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:25.087050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d3cb6-1fcf-4a68-a73d-af37a811fd00 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:25.095714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:25.099126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:25.100171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcf958-0014-4624-b355-a34d373ca84d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:25.101291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcf958-0014-4624-b355-a34d373ca84d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:25.101787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcf958-0014-4624-b355-a34d373ca84d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:25.102432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcf958-0014-4624-b355-a34d373ca84d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/groups/57ceb2523073491ab487aa756b6974cc` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:25.110573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcf958-0014-4624-b355-a34d373ca84d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_group(group_id=57ceb2523073491ab487aa756b6974cc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:25.115916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcf958-0014-4624-b355-a34d373ca84d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:25.130318 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2215/4417] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:25.131089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:25.145891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b5b5e-07ab-4163-b13f-20378631c5c4 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:25.157118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:25.157803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:25.158087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:25.158364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:25.159094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:01:25.159406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:25.161055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:25.192952 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2216/4418] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:25.196108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:25.218555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afa438-8f77-4be0-bea4-7ab860e473bc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:25.220839 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2203/4419] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:01:24 2022] DELETE /identity/v3/groups/57ceb2523073491ab487aa756b6974cc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:25.224995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcf958-0014-4624-b355-a34d373ca84d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:25.387761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa213-4c82-45bd-93a5-cd7f64d83521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:25.388632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa213-4c82-45bd-93a5-cd7f64d83521 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:25.389002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa213-4c82-45bd-93a5-cd7f64d83521 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:25.389352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa213-4c82-45bd-93a5-cd7f64d83521 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:25.390322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fa213-4c82-45bd-93a5-cd7f64d83521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:25.399774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fa213-4c82-45bd-93a5-cd7f64d83521 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:25.469986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcf958-0014-4624-b355-a34d373ca84d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:25.472474 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2217/4420] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:25 2022] POST /identity/v3/projects => generated 357 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:25.477222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa213-4c82-45bd-93a5-cd7f64d83521 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:25.646881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa213-4c82-45bd-93a5-cd7f64d83521 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:25.655034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ad75-cf09-4de6-8987-1057f76d62b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:25.655845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ad75-cf09-4de6-8987-1057f76d62b8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:25.656236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ad75-cf09-4de6-8987-1057f76d62b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:25.656879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ad75-cf09-4de6-8987-1057f76d62b8 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:25.657578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3ad75-cf09-4de6-8987-1057f76d62b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:25.659627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:25.660212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3ad75-cf09-4de6-8987-1057f76d62b8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:25.660521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:25.660805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:25.661083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles/f2402fdbf8a84d17b2862439517c7ab1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:25.667052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f2402fdbf8a84d17b2862439517c7ab1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:25.669625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:25.743331 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2218/4421] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:25 2022] POST /identity/v3/users => generated 279 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:25.746097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ad75-cf09-4de6-8987-1057f76d62b8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:25.763171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ad75-cf09-4de6-8987-1057f76d62b8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:25.775040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:25.775845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:25.776179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:25.777719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:25.781236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:25.785133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:25.788684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role f2402fdbf8a84d17b2862439517c7ab1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:25.788980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:25.790719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:25.802202 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2204/4422] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:25 2022] DELETE /identity/v3/roles/f2402fdbf8a84d17b2862439517c7ab1 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:25.809019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:25.815010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:25.825404 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2219/4423] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:25 2022] GET /identity/v3/roles => generated 1650 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:25.829308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:25.832728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:25.853008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666e19-c8be-47e4-aaf3-946d8f8666a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:25.977166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0d48-ed82-4838-a3d9-257660a80f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:25.978006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0d48-ed82-4838-a3d9-257660a80f5e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:25.978382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0d48-ed82-4838-a3d9-257660a80f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:25.978774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0d48-ed82-4838-a3d9-257660a80f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:25.979668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e0d48-ed82-4838-a3d9-257660a80f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:25.982372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e0d48-ed82-4838-a3d9-257660a80f5e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:26.002463 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2220/4424] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:25 2022] GET /identity/v3/roles => generated 1650 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:26.005700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0d48-ed82-4838-a3d9-257660a80f5e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:26.035588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0d48-ed82-4838-a3d9-257660a80f5e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:26.060534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de452bd3-b985-47ba-b856-f9d9deff13e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:26.061462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de452bd3-b985-47ba-b856-f9d9deff13e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:26.061744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de452bd3-b985-47ba-b856-f9d9deff13e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:26.062025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de452bd3-b985-47ba-b856-f9d9deff13e6 admin admin] PATH_INFO: `/v3/projects/dbdfeb34bdf0400096db0350a674adfe/users/0660e4c1032c4ecaa6b12a41260818b2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:26.094207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495a282-4217-4872-8570-ff4595b7b8a6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:26.104695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de452bd3-b985-47ba-b856-f9d9deff13e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdfeb34bdf0400096db0350a674adfe, user_id=0660e4c1032c4ecaa6b12a41260818b2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:26.109378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:26.110357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:26.110652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:26.110931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/35edfc5ed58145b6888492ff1bc91e9a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:26.113777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=35edfc5ed58145b6888492ff1bc91e9a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:26.114210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de452bd3-b985-47ba-b856-f9d9deff13e6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:26.117583 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:26.117583 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:01:26.117583 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:01:26.120215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:26.161707 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2221/4425] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:26 2022] PUT /identity/v3/projects/dbdfeb34bdf0400096db0350a674adfe/users/0660e4c1032c4ecaa6b12a41260818b2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:26.166440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ba5f-44ff-4e73-a930-502428ed2ba1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:26.166743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ba5f-44ff-4e73-a930-502428ed2ba1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:26.167067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ba5f-44ff-4e73-a930-502428ed2ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:26.192132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:26.193163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:26.232717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-89d8ba5f-44ff-4e73-a930-502428ed2ba1 None None] MFA Rules not processed for user `0660e4c1032c4ecaa6b12a41260818b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:26.234005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-89d8ba5f-44ff-4e73-a930-502428ed2ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:26.283488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:26.284722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:26.293197 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2205/4426] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:25 2022] PATCH /identity/v3/domains/35edfc5ed58145b6888492ff1bc91e9a => generated 278 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:26.294488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:26.298252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:26.428681 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2222/4427] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:26.437592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ba5f-44ff-4e73-a930-502428ed2ba1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:26.439534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-89d8ba5f-44ff-4e73-a930-502428ed2ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:26.572967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73426f7e-3b46-4f18-8f04-df1a77cb0787 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:26.589724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:26.596384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:26.597721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:26.598026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/35edfc5ed58145b6888492ff1bc91e9a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:26.672294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=35edfc5ed58145b6888492ff1bc91e9a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:26.678474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:26.720610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ba5f-44ff-4e73-a930-502428ed2ba1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:26.745379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e46133-0d7a-4cb0-8c9e-71917e4f92d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:26.748040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46133-0d7a-4cb0-8c9e-71917e4f92d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:26.748527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46133-0d7a-4cb0-8c9e-71917e4f92d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:26.748868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46133-0d7a-4cb0-8c9e-71917e4f92d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:26.750549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e46133-0d7a-4cb0-8c9e-71917e4f92d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:26.776014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e46133-0d7a-4cb0-8c9e-71917e4f92d4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:26.798526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:26.818416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:26.874317 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2223/4428] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:26 2022] POST /identity/v3/projects => generated 357 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:26.896145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e46133-0d7a-4cb0-8c9e-71917e4f92d4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:27.060518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a', 'request_id': 'req-2f89241e-976f-4783-8726-7c395998a31d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.087505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a', 'request_id': 'req-2f89241e-976f-4783-8726-7c395998a31d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.110333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a', 'request_id': 'req-2f89241e-976f-4783-8726-7c395998a31d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.144258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] The token cache is being invalidate because project 35edfc5ed58145b6888492ff1bc91e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:27.144907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e46133-0d7a-4cb0-8c9e-71917e4f92d4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:27.147566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.149161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.164954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a', 'request_id': 'req-2f89241e-976f-4783-8726-7c395998a31d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.166001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a', 'request_id': 'req-2f89241e-976f-4783-8726-7c395998a31d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.170382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '35edfc5ed58145b6888492ff1bc91e9a', 'request_id': 'req-2f89241e-976f-4783-8726-7c395998a31d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.181795 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2206/4429] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:01:26 2022] DELETE /identity/v3/domains/35edfc5ed58145b6888492ff1bc91e9a => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:27.183393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:27.185660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:27.334407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:27.334407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:27.334407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:27.334407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:27.334866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:27.336492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:27.428008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2224/4430] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:26 2022] POST /identity/v3/users => generated 285 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:27.429239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:27.441501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:27.448301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89241e-976f-4783-8726-7c395998a31d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:27.459086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:27.461977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:27.462965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:27.463473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/7525503584b44ab1ad4bb120da0e4956/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/f6b7cd4cf38b4334a0a784209a70afe4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:27.467168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7525503584b44ab1ad4bb120da0e4956, user_id=3a1ef332cc464b409a56d4bc6a4a5e2a, role_id=f6b7cd4cf38b4334a0a784209a70afe4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:27.472362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:27.500586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role f6b7cd4cf38b4334a0a784209a70afe4 was removed from user 3a1ef332cc464b409a56d4bc6a4a5e2a on domain 7525503584b44ab1ad4bb120da0e4956. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:27.502154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.504279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe10e1-201a-4478-bc9b-a5252185cf99 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:27.518405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.525097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:27.526493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:27.527188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:27.527188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:27.528900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:27.530865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:27.570333 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2225/4431] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:27 2022] GET /identity/v3/roles => generated 1650 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:27.571629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:27.574665 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2207/4432] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 21:01:27 2022] DELETE /identity/v3/domains/7525503584b44ab1ad4bb120da0e4956/users/3a1ef332cc464b409a56d4bc6a4a5e2a/roles/f6b7cd4cf38b4334a0a784209a70afe4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:27.576427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:27.586805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:27.589806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:27.617826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ee834-9fc5-4d70-ad1e-a6e5c9a517fd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:27.758876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98497-6c18-4368-91bc-a530d54defde tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:27.782949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:27.797817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:27.808837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee30c8-908d-4956-b0b1-6ccecfee9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:27.810604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:27.810890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee30c8-908d-4956-b0b1-6ccecfee9ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:27.811183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee30c8-908d-4956-b0b1-6ccecfee9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:27.811464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee30c8-908d-4956-b0b1-6ccecfee9ad3 admin admin] PATH_INFO: `/v3/projects/bb0ce5514cc846e4872178f8739e517e/users/001c28f26eff4003bf8f8aef1c59e1e7/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:27.811822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles/f6b7cd4cf38b4334a0a784209a70afe4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:27.816269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f6b7cd4cf38b4334a0a784209a70afe4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:27.820291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:27.874472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee30c8-908d-4956-b0b1-6ccecfee9ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0ce5514cc846e4872178f8739e517e, user_id=001c28f26eff4003bf8f8aef1c59e1e7, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:27.882412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee30c8-908d-4956-b0b1-6ccecfee9ad3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:27.943006 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2226/4433] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:27 2022] PUT /identity/v3/projects/bb0ce5514cc846e4872178f8739e517e/users/001c28f26eff4003bf8f8aef1c59e1e7/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:27.946483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee30c8-908d-4956-b0b1-6ccecfee9ad3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:27.985352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role f6b7cd4cf38b4334a0a784209a70afe4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:27.985662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.986364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:27.994809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2208/4434] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:27 2022] DELETE /identity/v3/roles/f6b7cd4cf38b4334a0a784209a70afe4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:27.999002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:28.003717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:28.200937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee30c8-908d-4956-b0b1-6ccecfee9ad3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:28.208872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777258-6ba8-4c3c-9b77-7ea116c6f446 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:28.235174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:28.239872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:28.240289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:28.241310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/7525503584b44ab1ad4bb120da0e4956` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:28.248144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7525503584b44ab1ad4bb120da0e4956)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:28.249950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:28.285928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:28.286958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:28.287249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:28.287534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:28.291388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:28.300972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:28.333695 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2227/4435] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:28.338675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:28.344238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:28.383784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acc7b0-bf5b-453c-b949-590b0c46185c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:28.394218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7525503584b44ab1ad4bb120da0e4956'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:28.396828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7525503584b44ab1ad4bb120da0e4956'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:28.402373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd472fc5-b2d4-4da3-b77c-ba3d0798f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:28.403816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472fc5-b2d4-4da3-b77c-ba3d0798f486 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:28.404101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472fc5-b2d4-4da3-b77c-ba3d0798f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:28.404404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472fc5-b2d4-4da3-b77c-ba3d0798f486 admin admin] PATH_INFO: `/v3/projects/bb0ce5514cc846e4872178f8739e517e/users/001c28f26eff4003bf8f8aef1c59e1e7/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:28.414039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd472fc5-b2d4-4da3-b77c-ba3d0798f486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0ce5514cc846e4872178f8739e517e, user_id=001c28f26eff4003bf8f8aef1c59e1e7, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:28.426221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd472fc5-b2d4-4da3-b77c-ba3d0798f486 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:28.468258 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2228/4436] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:28 2022] PUT /identity/v3/projects/bb0ce5514cc846e4872178f8739e517e/users/001c28f26eff4003bf8f8aef1c59e1e7/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:28.480080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e38-ebf6-44f9-943e-ef240a442d42 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:28.480303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e38-ebf6-44f9-943e-ef240a442d42 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:28.480595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e38-ebf6-44f9-943e-ef240a442d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:28.484354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7525503584b44ab1ad4bb120da0e4956'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:28.488706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7525503584b44ab1ad4bb120da0e4956'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:28.504613 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2209/4437] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:27 2022] PATCH /identity/v3/domains/7525503584b44ab1ad4bb120da0e4956 => generated 277 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:28.509542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:28.513084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:28.590432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0c999e38-ebf6-44f9-943e-ef240a442d42 None None] MFA Rules not processed for user `001c28f26eff4003bf8f8aef1c59e1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:28.592589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0c999e38-ebf6-44f9-943e-ef240a442d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:28.777140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2229/4438] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:28.778389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999e38-ebf6-44f9-943e-ef240a442d42 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:28.781497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0c999e38-ebf6-44f9-943e-ef240a442d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:28.816431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97f995-7338-4f63-941f-698d092627af tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:28.961161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999e38-ebf6-44f9-943e-ef240a442d42 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:28.978528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5fe7-eb07-4b01-8060-40276f980449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:28.978528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5fe7-eb07-4b01-8060-40276f980449 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:28.978528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5fe7-eb07-4b01-8060-40276f980449 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:28.978931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5fe7-eb07-4b01-8060-40276f980449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:29.009591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f5fe7-eb07-4b01-8060-40276f980449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:29.013613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f5fe7-eb07-4b01-8060-40276f980449 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:29.043574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:29.045312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:29.045600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:29.045881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/7525503584b44ab1ad4bb120da0e4956` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:29.051064 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2230/4439] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:29.080996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7525503584b44ab1ad4bb120da0e4956)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:29.088889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:29.156966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7525503584b44ab1ad4bb120da0e4956'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.165975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7525503584b44ab1ad4bb120da0e4956'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.170026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5fe7-eb07-4b01-8060-40276f980449 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:29.183469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5fe7-eb07-4b01-8060-40276f980449 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:29.188799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:29.189670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:29.190116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:29.190921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:29.193702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:29.331984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7525503584b44ab1ad4bb120da0e4956', 'request_id': 'req-dcea349c-dc1c-498c-bc2c-84b4910a600d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.347290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7525503584b44ab1ad4bb120da0e4956', 'request_id': 'req-dcea349c-dc1c-498c-bc2c-84b4910a600d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.367383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7525503584b44ab1ad4bb120da0e4956', 'request_id': 'req-dcea349c-dc1c-498c-bc2c-84b4910a600d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.387985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] The token cache is being invalidate because project 7525503584b44ab1ad4bb120da0e4956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:29.388439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.389281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.401077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7525503584b44ab1ad4bb120da0e4956', 'request_id': 'req-dcea349c-dc1c-498c-bc2c-84b4910a600d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.401985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7525503584b44ab1ad4bb120da0e4956', 'request_id': 'req-dcea349c-dc1c-498c-bc2c-84b4910a600d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.406297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7525503584b44ab1ad4bb120da0e4956', 'request_id': 'req-dcea349c-dc1c-498c-bc2c-84b4910a600d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:29.415839 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2210/4440] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:01:28 2022] DELETE /identity/v3/domains/7525503584b44ab1ad4bb120da0e4956 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:29.432839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:29.432839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:29.515797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:29.515797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:29.561865 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2231/4441] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:01:29.569607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea349c-dc1c-498c-bc2c-84b4910a600d tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:29.576792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa138e6-a287-46a4-9521-4066171a43b7 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:29.578037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa138e6-a287-46a4-9521-4066171a43b7 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:29.578725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa138e6-a287-46a4-9521-4066171a43b7 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:29.579455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa138e6-a287-46a4-9521-4066171a43b7 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:29.580927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa138e6-a287-46a4-9521-4066171a43b7 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:29.585247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa138e6-a287-46a4-9521-4066171a43b7 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:29.599575 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2211/4442] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:01:29.604587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:29.625599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879c9da-5451-49de-bb6e-c5cf71769ce2 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:29.649429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e7e9-40d8-48ea-a575-615b2f8a9b36 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:29.651135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e7e9-40d8-48ea-a575-615b2f8a9b36 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:29.654131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e7e9-40d8-48ea-a575-615b2f8a9b36 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:29.654529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e7e9-40d8-48ea-a575-615b2f8a9b36 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects/504c84b5a97741d4b89437a16260d379/users/7fe4c901ea8b488da07c7a7118b56206/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:29.663431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3e7e9-40d8-48ea-a575-615b2f8a9b36 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_grant(project_id=504c84b5a97741d4b89437a16260d379, user_id=7fe4c901ea8b488da07c7a7118b56206, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:29.670449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3e7e9-40d8-48ea-a575-615b2f8a9b36 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:29.708998 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2232/4443] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:29 2022] PUT /identity/v3/projects/504c84b5a97741d4b89437a16260d379/users/7fe4c901ea8b488da07c7a7118b56206/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:29.713248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa138e6-a287-46a4-9521-4066171a43b7 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:29.729209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa138e6-a287-46a4-9521-4066171a43b7 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:29.893849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:29.894922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:29.895606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:29.896108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:29.897158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:29.901317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:30.003305 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2212/4444] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:01:29 2022] GET /identity/v3/auth/projects => generated 828 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:30.007401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e7e9-40d8-48ea-a575-615b2f8a9b36 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:30.025277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e7e9-40d8-48ea-a575-615b2f8a9b36 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:30.050067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:30.051473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:30.051871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:30.052796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects/504c84b5a97741d4b89437a16260d379/users/7fe4c901ea8b488da07c7a7118b56206/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:30.063528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=504c84b5a97741d4b89437a16260d379, user_id=7fe4c901ea8b488da07c7a7118b56206, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:30.071117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:30.090045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role bafeb2a265a54d848f2281c61dd3eaec was removed from user 7fe4c901ea8b488da07c7a7118b56206 on project 504c84b5a97741d4b89437a16260d379. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:30.092769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:30.096877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:30.132536 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2233/4445] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Feb 19 21:01:30 2022] DELETE /identity/v3/projects/504c84b5a97741d4b89437a16260d379/users/7fe4c901ea8b488da07c7a7118b56206/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:30.139648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:30.142086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:30.166490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1a26d-842b-4e9f-a5c3-c9d442b56e5a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:30.388203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f9879-baaa-479d-ab8c-ab0daab3fa5b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:30.389536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f9879-baaa-479d-ab8c-ab0daab3fa5b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:30.389816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f9879-baaa-479d-ab8c-ab0daab3fa5b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:30.390093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f9879-baaa-479d-ab8c-ab0daab3fa5b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:30.390813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f9879-baaa-479d-ab8c-ab0daab3fa5b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:30.405659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f9879-baaa-479d-ab8c-ab0daab3fa5b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:30.441989 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2213/4446] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:30 2022] POST /identity/v3/users => generated 323 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:30.446901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:30.471003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1be6b5-58a9-4b79-a63e-91337a4fd19e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:30.511087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efaa0a-4f44-4d78-bdae-b50a1431fcf0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:30.511913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efaa0a-4f44-4d78-bdae-b50a1431fcf0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:30.512306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efaa0a-4f44-4d78-bdae-b50a1431fcf0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:30.513290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efaa0a-4f44-4d78-bdae-b50a1431fcf0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:30.514133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efaa0a-4f44-4d78-bdae-b50a1431fcf0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:30.516166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efaa0a-4f44-4d78-bdae-b50a1431fcf0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:30.578701 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2234/4447] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:30 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:30.583121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f9879-baaa-479d-ab8c-ab0daab3fa5b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:30.609217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f9879-baaa-479d-ab8c-ab0daab3fa5b tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:30.798148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba844a-59c2-4d7b-97a5-79fcf279dcaa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:30.798849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba844a-59c2-4d7b-97a5-79fcf279dcaa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:30.799136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba844a-59c2-4d7b-97a5-79fcf279dcaa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:30.799419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba844a-59c2-4d7b-97a5-79fcf279dcaa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:30.800123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba844a-59c2-4d7b-97a5-79fcf279dcaa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:30.806428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba844a-59c2-4d7b-97a5-79fcf279dcaa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:30.931527 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2214/4448] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:30 2022] POST /identity/v3/projects => generated 362 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:30.933857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efaa0a-4f44-4d78-bdae-b50a1431fcf0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:30.951046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efaa0a-4f44-4d78-bdae-b50a1431fcf0 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:31.113174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61eb739-04cd-4288-8fba-106863013dd1 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:31.119097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eb739-04cd-4288-8fba-106863013dd1 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:31.119939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eb739-04cd-4288-8fba-106863013dd1 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:31.119939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eb739-04cd-4288-8fba-106863013dd1 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:31.123862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61eb739-04cd-4288-8fba-106863013dd1 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:31.125656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61eb739-04cd-4288-8fba-106863013dd1 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:31.167552 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2235/4449] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:01:30 2022] POST /identity/v3/roles => generated 239 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:31.172435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba844a-59c2-4d7b-97a5-79fcf279dcaa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:31.190498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba844a-59c2-4d7b-97a5-79fcf279dcaa tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:31.226930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589e4c8-cb59-434f-8f77-0b8f7f72c398 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:31.229531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589e4c8-cb59-434f-8f77-0b8f7f72c398 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:31.230793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589e4c8-cb59-434f-8f77-0b8f7f72c398 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:31.234733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589e4c8-cb59-434f-8f77-0b8f7f72c398 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects/cbe0250978784578b7b5b059432c4d80/users/8b0a5c60482d4a558fda9f08aedddd38/roles/e50e7945ed85449284aca770c3af80f9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:31.284842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589e4c8-cb59-434f-8f77-0b8f7f72c398 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cbe0250978784578b7b5b059432c4d80, user_id=8b0a5c60482d4a558fda9f08aedddd38, role_id=e50e7945ed85449284aca770c3af80f9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:31.289625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589e4c8-cb59-434f-8f77-0b8f7f72c398 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:31.329594 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2215/4450] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:31 2022] PUT /identity/v3/projects/cbe0250978784578b7b5b059432c4d80/users/8b0a5c60482d4a558fda9f08aedddd38/roles/e50e7945ed85449284aca770c3af80f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:31.333740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61eb739-04cd-4288-8fba-106863013dd1 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:31.351288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61eb739-04cd-4288-8fba-106863013dd1 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:31.707119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf1e08-865a-4f19-88a6-8da738ddbb1a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:31.708039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1e08-865a-4f19-88a6-8da738ddbb1a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:31.708323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1e08-865a-4f19-88a6-8da738ddbb1a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:31.708625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1e08-865a-4f19-88a6-8da738ddbb1a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects/f1a9d238bfda40359aed4ca25780d30d/users/8b0a5c60482d4a558fda9f08aedddd38/roles/e50e7945ed85449284aca770c3af80f9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:31.747838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf1e08-865a-4f19-88a6-8da738ddbb1a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f1a9d238bfda40359aed4ca25780d30d, user_id=8b0a5c60482d4a558fda9f08aedddd38, role_id=e50e7945ed85449284aca770c3af80f9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:31.747838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf1e08-865a-4f19-88a6-8da738ddbb1a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:31.769976 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2236/4451] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:31 2022] PUT /identity/v3/projects/f1a9d238bfda40359aed4ca25780d30d/users/8b0a5c60482d4a558fda9f08aedddd38/roles/e50e7945ed85449284aca770c3af80f9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:31.775265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1e36-4a33-4d89-933c-6619e6aab2d1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:31.777024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1e36-4a33-4d89-933c-6619e6aab2d1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:31.777466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1e36-4a33-4d89-933c-6619e6aab2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:31.866164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-800b1e36-4a33-4d89-933c-6619e6aab2d1 None None] MFA Rules not processed for user `8b0a5c60482d4a558fda9f08aedddd38`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:31.873527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-800b1e36-4a33-4d89-933c-6619e6aab2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:31.892017 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2216/4452] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:31 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:01:31.894627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae5d13-a28f-41f4-987c-f036cbdcfe23 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:31.894919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae5d13-a28f-41f4-987c-f036cbdcfe23 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:31.895207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae5d13-a28f-41f4-987c-f036cbdcfe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:31.927031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-37ae5d13-a28f-41f4-987c-f036cbdcfe23 None None] MFA Rules not processed for user `8b0a5c60482d4a558fda9f08aedddd38`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:31.931338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37ae5d13-a28f-41f4-987c-f036cbdcfe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:32.189797 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2237/4453] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Feb 19 21:01:32.194515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1e36-4a33-4d89-933c-6619e6aab2d1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:32.304962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1e36-4a33-4d89-933c-6619e6aab2d1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:32.312603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b933d0-ac28-472d-9689-31c88c52d12c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:32.313351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b933d0-ac28-472d-9689-31c88c52d12c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:32.313675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b933d0-ac28-472d-9689-31c88c52d12c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:32.313966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b933d0-ac28-472d-9689-31c88c52d12c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:32.325048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b933d0-ac28-472d-9689-31c88c52d12c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:32.327286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b933d0-ac28-472d-9689-31c88c52d12c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:32.382361 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2217/4454] 10.222.0.30 () {56 vars in 1307 bytes} [Sat Feb 19 21:01:32 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:32.385035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62834-9acd-4223-9bb9-2ed6834a5563 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:32.385728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62834-9acd-4223-9bb9-2ed6834a5563 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:32.386795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62834-9acd-4223-9bb9-2ed6834a5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:32.400423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8db62834-9acd-4223-9bb9-2ed6834a5563 None None] MFA Rules not processed for user `8b0a5c60482d4a558fda9f08aedddd38`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:32.419146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8db62834-9acd-4223-9bb9-2ed6834a5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:32.542978 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2238/4455] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3214 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Feb 19 21:01:32.547637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b933d0-ac28-472d-9689-31c88c52d12c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:32.569182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b933d0-ac28-472d-9689-31c88c52d12c tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:32.586624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:32.587772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:32.596425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:32.596914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/roles/e50e7945ed85449284aca770c3af80f9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:32.602561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e50e7945ed85449284aca770c3af80f9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:32.613142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:32.752842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invalidating the token cache because role e50e7945ed85449284aca770c3af80f9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:32.753450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:32.754402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:32.757283 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2218/4456] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:32 2022] DELETE /identity/v3/roles/e50e7945ed85449284aca770c3af80f9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:32.761638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62834-9acd-4223-9bb9-2ed6834a5563 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:32.792912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62834-9acd-4223-9bb9-2ed6834a5563 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:32.974101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:32.975556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:32.977089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:32.978633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects/f1a9d238bfda40359aed4ca25780d30d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:32.983919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1a9d238bfda40359aed4ca25780d30d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:32.991604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:33.171632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a9d238bfda40359aed4ca25780d30d', 'request_id': 'req-16d09d5c-2733-4670-9a2e-b4637a214b68'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.203416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a9d238bfda40359aed4ca25780d30d', 'request_id': 'req-16d09d5c-2733-4670-9a2e-b4637a214b68'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.257658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a9d238bfda40359aed4ca25780d30d', 'request_id': 'req-16d09d5c-2733-4670-9a2e-b4637a214b68'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.324958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] The token cache is being invalidate because project f1a9d238bfda40359aed4ca25780d30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:33.325343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.331269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.343510 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2239/4457] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:32 2022] DELETE /identity/v3/projects/f1a9d238bfda40359aed4ca25780d30d => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:33.347599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:33.351626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:33.385356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89836d6-85dc-487e-ac9d-9fc62d62004e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:33.590108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:33.591570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:33.591913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:33.592408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects/f1a9d238bfda40359aed4ca25780d30d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:33.603281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1a9d238bfda40359aed4ca25780d30d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:33.605594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:33.628351 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Could not find project: f1a9d238bfda40359aed4ca25780d30d.: keystone.exception.ProjectNotFound: Could not find project: f1a9d238bfda40359aed4ca25780d30d. Feb 19 21:01:33.630370 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2219/4458] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:33 2022] DELETE /identity/v3/projects/f1a9d238bfda40359aed4ca25780d30d => generated 113 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:01:33.634437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:33.635923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:33.663633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09d5c-2733-4670-9a2e-b4637a214b68 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:33.689552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:33.689552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:33.689552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:33.689960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/projects/cbe0250978784578b7b5b059432c4d80` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:33.691351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cbe0250978784578b7b5b059432c4d80)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:33.707007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:33.857652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe0250978784578b7b5b059432c4d80', 'request_id': 'req-1b651eea-6a2d-4edf-b253-3e92d94b0f75'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.869127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe0250978784578b7b5b059432c4d80', 'request_id': 'req-1b651eea-6a2d-4edf-b253-3e92d94b0f75'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.887103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe0250978784578b7b5b059432c4d80', 'request_id': 'req-1b651eea-6a2d-4edf-b253-3e92d94b0f75'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.910323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] The token cache is being invalidate because project cbe0250978784578b7b5b059432c4d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:33.910992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.914163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:33.921906 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2240/4459] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:33 2022] DELETE /identity/v3/projects/cbe0250978784578b7b5b059432c4d80 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:33.926400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:33.928419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:34.010994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b316b-d41b-459f-9957-b71ad15b0ae6 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:34.201894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:34.203382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:34.203894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:34.204461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/users/8b0a5c60482d4a558fda9f08aedddd38` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:34.206353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8b0a5c60482d4a558fda9f08aedddd38)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:34.213994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:34.280685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0a5c60482d4a558fda9f08aedddd38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:34.281789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0a5c60482d4a558fda9f08aedddd38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:34.282630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0a5c60482d4a558fda9f08aedddd38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:34.317389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0a5c60482d4a558fda9f08aedddd38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:34.338020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0a5c60482d4a558fda9f08aedddd38'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:34.369863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2220/4460] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:33 2022] DELETE /identity/v3/users/8b0a5c60482d4a558fda9f08aedddd38 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:34.379454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:34.394371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b651eea-6a2d-4edf-b253-3e92d94b0f75 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:34.490137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c84cc-25c6-457e-aba8-d69bac90df7a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:34.491294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c84cc-25c6-457e-aba8-d69bac90df7a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:34.491699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c84cc-25c6-457e-aba8-d69bac90df7a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:34.492345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c84cc-25c6-457e-aba8-d69bac90df7a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/50574d7940864c96b89a8fe1cec9b719` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:34.507646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c84cc-25c6-457e-aba8-d69bac90df7a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:01:34.518331 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-492c84cc-25c6-457e-aba8-d69bac90df7a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Could not find domain: 50574d7940864c96b89a8fe1cec9b719.: keystone.exception.DomainNotFound: Could not find domain: 50574d7940864c96b89a8fe1cec9b719. Feb 19 21:01:34.520046 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2241/4461] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:34 2022] PATCH /identity/v3/domains/50574d7940864c96b89a8fe1cec9b719 => generated 112 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:01:34.523861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:34.525568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:34.553587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b23a18-5148-4836-83a0-91f16ddeea0f tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:34.573157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6d8fe-41fa-4315-964c-d92609a93f7e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:34.574175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d8fe-41fa-4315-964c-d92609a93f7e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:34.574574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d8fe-41fa-4315-964c-d92609a93f7e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:34.575591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d8fe-41fa-4315-964c-d92609a93f7e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/384b35703b2741cd91477698e361c6aa` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:34.598104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6d8fe-41fa-4315-964c-d92609a93f7e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:01:34.618970 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-8be6d8fe-41fa-4315-964c-d92609a93f7e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Could not find domain: 384b35703b2741cd91477698e361c6aa.: keystone.exception.DomainNotFound: Could not find domain: 384b35703b2741cd91477698e361c6aa. Feb 19 21:01:34.624058 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2221/4462] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:34 2022] PATCH /identity/v3/domains/384b35703b2741cd91477698e361c6aa => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:01:34.627171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c84cc-25c6-457e-aba8-d69bac90df7a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:34.646739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c84cc-25c6-457e-aba8-d69bac90df7a tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:34.675319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:34.676202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:34.676605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:34.676876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/35edfc5ed58145b6888492ff1bc91e9a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:34.704195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:01:34.749086 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Could not find domain: 35edfc5ed58145b6888492ff1bc91e9a.: keystone.exception.DomainNotFound: Could not find domain: 35edfc5ed58145b6888492ff1bc91e9a. Feb 19 21:01:34.753838 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2242/4463] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:34 2022] PATCH /identity/v3/domains/35edfc5ed58145b6888492ff1bc91e9a => generated 112 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:01:34.757771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6d8fe-41fa-4315-964c-d92609a93f7e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:34.785948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6d8fe-41fa-4315-964c-d92609a93f7e tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:34.811716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d9e8-a10f-4683-9c74-bfcb4e74bfad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe4c901ea8b488da07c7a7118b56206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d2bf54b29ee43898f581fbaf1208e1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:34.812625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d9e8-a10f-4683-9c74-bfcb4e74bfad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:34.812910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d9e8-a10f-4683-9c74-bfcb4e74bfad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:34.813191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d9e8-a10f-4683-9c74-bfcb4e74bfad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] PATH_INFO: `/v3/domains/7525503584b44ab1ad4bb120da0e4956` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:34.850086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97d9e8-a10f-4683-9c74-bfcb4e74bfad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:01:34.877205 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-bd97d9e8-a10f-4683-9c74-bfcb4e74bfad tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Could not find domain: 7525503584b44ab1ad4bb120da0e4956.: keystone.exception.DomainNotFound: Could not find domain: 7525503584b44ab1ad4bb120da0e4956. Feb 19 21:01:34.885030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:34.886971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:34.909845 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2222/4464] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:01:34 2022] PATCH /identity/v3/domains/7525503584b44ab1ad4bb120da0e4956 => generated 112 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:01:35.064644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543bcd1-ce60-4bad-a552-fe832d230991 tempest-TokensV3TestJSON-1794852647 tempest-TokensV3TestJSON-1794852647-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:35.072722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:35.073800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:35.074338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:35.074863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] PATH_INFO: `/v3/users/589fbcfa5ed0488a8abcb6ea07bcf408` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:35.077875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=589fbcfa5ed0488a8abcb6ea07bcf408)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:35.081488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:35.205415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589fbcfa5ed0488a8abcb6ea07bcf408'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:35.228776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589fbcfa5ed0488a8abcb6ea07bcf408'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:35.248810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589fbcfa5ed0488a8abcb6ea07bcf408'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:35.249918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589fbcfa5ed0488a8abcb6ea07bcf408'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:35.250884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589fbcfa5ed0488a8abcb6ea07bcf408'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:35.278097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c955-a3f4-4cf0-9c3b-2c00325d4938 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:35.278805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c955-a3f4-4cf0-9c3b-2c00325d4938 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:35.279301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747c955-a3f4-4cf0-9c3b-2c00325d4938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:35.280950 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2243/4465] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:34 2022] DELETE /identity/v3/users/589fbcfa5ed0488a8abcb6ea07bcf408 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:35.305300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5747c955-a3f4-4cf0-9c3b-2c00325d4938 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:35.309070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5747c955-a3f4-4cf0-9c3b-2c00325d4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:35.416658 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2223/4466] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:35.423300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:35.424952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:35.542050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd72d-c622-47be-83b3-cf8c8d8083ba admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:35.553715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d78ef-afc7-48bc-95da-aeacbb74823a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:35.554310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d78ef-afc7-48bc-95da-aeacbb74823a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:35.554601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d78ef-afc7-48bc-95da-aeacbb74823a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:35.554886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d78ef-afc7-48bc-95da-aeacbb74823a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:35.572809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d78ef-afc7-48bc-95da-aeacbb74823a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:35.574816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d78ef-afc7-48bc-95da-aeacbb74823a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:35.601465 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2244/4467] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:36.826609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747c955-a3f4-4cf0-9c3b-2c00325d4938 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:36.829588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5747c955-a3f4-4cf0-9c3b-2c00325d4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:36.854268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747c955-a3f4-4cf0-9c3b-2c00325d4938 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:36.883674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:36.884746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:36.885101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:36.885451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] PATH_INFO: `/v3/projects/504c84b5a97741d4b89437a16260d379` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:36.889484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] RBAC: Authorizing `identity:delete_project(project_id=504c84b5a97741d4b89437a16260d379)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:36.891709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:37.010185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504c84b5a97741d4b89437a16260d379', 'request_id': 'req-449a478d-0b42-4740-9ac5-cc599c06656b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.018043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504c84b5a97741d4b89437a16260d379', 'request_id': 'req-449a478d-0b42-4740-9ac5-cc599c06656b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.036103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504c84b5a97741d4b89437a16260d379', 'request_id': 'req-449a478d-0b42-4740-9ac5-cc599c06656b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.068380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] The token cache is being invalidate because project 504c84b5a97741d4b89437a16260d379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:37.069071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.070666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.076816 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2224/4468] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:36 2022] DELETE /identity/v3/projects/504c84b5a97741d4b89437a16260d379 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:37.078493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d78ef-afc7-48bc-95da-aeacbb74823a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:37.099873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d78ef-afc7-48bc-95da-aeacbb74823a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:37.282519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:37.283680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:37.283973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:37.284261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] PATH_INFO: `/v3/users/7fe4c901ea8b488da07c7a7118b56206` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:37.304918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe4c901ea8b488da07c7a7118b56206)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:37.307615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:37.447231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe4c901ea8b488da07c7a7118b56206'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.506786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe4c901ea8b488da07c7a7118b56206'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.530471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe4c901ea8b488da07c7a7118b56206'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.531112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe4c901ea8b488da07c7a7118b56206'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.535530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe4c901ea8b488da07c7a7118b56206'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:37.554083 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2245/4469] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:37 2022] DELETE /identity/v3/users/7fe4c901ea8b488da07c7a7118b56206 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:38.276791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:38.281310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:38.438320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a478d-0b42-4740-9ac5-cc599c06656b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:38.643972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:38.645568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:38.650898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:38.651532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:38.662267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:38.717425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:38.719430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:38.749212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:38.751237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:38.764630 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2225/4470] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:38.980207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eec7ac-7454-4d70-a5ad-2cd0bac04c29 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:38.988560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:38.989954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:38.991722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:38.992176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] PATH_INFO: `/v3/projects/2d2bf54b29ee43898f581fbaf1208e1e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:38.994415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2bf54b29ee43898f581fbaf1208e1e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:38.997155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:39.114642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2bf54b29ee43898f581fbaf1208e1e', 'request_id': 'req-56a9d96c-f549-40ab-ac1e-44f8444560a4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.121856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2bf54b29ee43898f581fbaf1208e1e', 'request_id': 'req-56a9d96c-f549-40ab-ac1e-44f8444560a4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.162699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2bf54b29ee43898f581fbaf1208e1e', 'request_id': 'req-56a9d96c-f549-40ab-ac1e-44f8444560a4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.194281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] The token cache is being invalidate because project 2d2bf54b29ee43898f581fbaf1208e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:39.194635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.195989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.199131 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2246/4471] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:38 2022] DELETE /identity/v3/projects/2d2bf54b29ee43898f581fbaf1208e1e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:39.203558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:39.219492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec8724-7884-453e-8162-4dcfbb669e6a service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:39.463850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:39.464756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:39.465042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:39.465319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] PATH_INFO: `/v3/users/3a1ef332cc464b409a56d4bc6a4a5e2a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:39.468976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1ef332cc464b409a56d4bc6a4a5e2a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:39.470936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:39.635211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1ef332cc464b409a56d4bc6a4a5e2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.636577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1ef332cc464b409a56d4bc6a4a5e2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.637993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1ef332cc464b409a56d4bc6a4a5e2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.676823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1ef332cc464b409a56d4bc6a4a5e2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.700416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5f4e08c1-9a3f-41bb-a59c-e8863bfd84ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1ef332cc464b409a56d4bc6a4a5e2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:39.728810 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2226/4472] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:39 2022] DELETE /identity/v3/users/3a1ef332cc464b409a56d4bc6a4a5e2a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:41.084769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:41.086262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:41.127065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9d96c-f549-40ab-ac1e-44f8444560a4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:41.347419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:41.353569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:41.354715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:41.355171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] PATH_INFO: `/v3/projects/2680cca2b23e4a9ea144d05b11df6593` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:41.358962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2680cca2b23e4a9ea144d05b11df6593)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:41.362034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:41.490712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2680cca2b23e4a9ea144d05b11df6593', 'request_id': 'req-5512770f-2fd8-4d71-88fe-75ec6b9f869a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:41.516914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2680cca2b23e4a9ea144d05b11df6593', 'request_id': 'req-5512770f-2fd8-4d71-88fe-75ec6b9f869a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:41.536622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2680cca2b23e4a9ea144d05b11df6593', 'request_id': 'req-5512770f-2fd8-4d71-88fe-75ec6b9f869a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:41.582477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] The token cache is being invalidate because project 2680cca2b23e4a9ea144d05b11df6593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:41.582786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:41.586988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5512770f-2fd8-4d71-88fe-75ec6b9f869a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:41.593133 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2247/4473] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:41 2022] DELETE /identity/v3/projects/2680cca2b23e4a9ea144d05b11df6593 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:41.599209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3721-d55a-4fc4-9c2c-056d6ddd3a37 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:41.599731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3721-d55a-4fc4-9c2c-056d6ddd3a37 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:41.599825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3721-d55a-4fc4-9c2c-056d6ddd3a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:41.643164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0bcd3721-d55a-4fc4-9c2c-056d6ddd3a37 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:41.646274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0bcd3721-d55a-4fc4-9c2c-056d6ddd3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:41.797616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2227/4474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:41.806230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cacc02-c6cb-40af-8339-1f046248bbc5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:41.806767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cacc02-c6cb-40af-8339-1f046248bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:41.807200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cacc02-c6cb-40af-8339-1f046248bbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:41.866087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-53cacc02-c6cb-40af-8339-1f046248bbc5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:41.867584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53cacc02-c6cb-40af-8339-1f046248bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:41.881917 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2248/4475] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:41.886562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3721-d55a-4fc4-9c2c-056d6ddd3a37 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:41.923369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3721-d55a-4fc4-9c2c-056d6ddd3a37 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:41.952991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:41.954176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:41.954644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:41.955136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:41.956082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:01:41.956802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:41.958749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:42.004120 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2228/4476] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:42.008705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cacc02-c6cb-40af-8339-1f046248bbc5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:42.024169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cacc02-c6cb-40af-8339-1f046248bbc5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:42.035168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a23169-6531-443e-b25c-71eba493380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:42.036171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23169-6531-443e-b25c-71eba493380b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:42.039454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23169-6531-443e-b25c-71eba493380b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:42.039996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23169-6531-443e-b25c-71eba493380b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:42.041292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a23169-6531-443e-b25c-71eba493380b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:42.052743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a23169-6531-443e-b25c-71eba493380b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:42.094790 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2249/4477] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:42 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:42.099090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:42.115967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3907e-3aae-4c29-a0d3-70d3e7f06763 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:42.287447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98b56c-6cc2-4af1-b48e-6db0de55a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:42.288469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98b56c-6cc2-4af1-b48e-6db0de55a951 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:42.289137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98b56c-6cc2-4af1-b48e-6db0de55a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:42.289706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98b56c-6cc2-4af1-b48e-6db0de55a951 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:42.290764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98b56c-6cc2-4af1-b48e-6db0de55a951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:42.294132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98b56c-6cc2-4af1-b48e-6db0de55a951 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:42.330785 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2229/4478] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:42 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:42.336872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a23169-6531-443e-b25c-71eba493380b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:42.360847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a23169-6531-443e-b25c-71eba493380b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:42.375251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82a0ea-9b88-4e28-9c24-e0d67cf52557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:42.386634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a0ea-9b88-4e28-9c24-e0d67cf52557 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:42.386634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a0ea-9b88-4e28-9c24-e0d67cf52557 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:42.386634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a0ea-9b88-4e28-9c24-e0d67cf52557 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:42.386634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82a0ea-9b88-4e28-9c24-e0d67cf52557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:42.388146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82a0ea-9b88-4e28-9c24-e0d67cf52557 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:42.432206 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2250/4479] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:42.436696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98b56c-6cc2-4af1-b48e-6db0de55a951 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:42.453185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98b56c-6cc2-4af1-b48e-6db0de55a951 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:42.465227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee071-64b3-459b-a33f-43b9ac610efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:42.466293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee071-64b3-459b-a33f-43b9ac610efe admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:42.467613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee071-64b3-459b-a33f-43b9ac610efe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:42.468660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee071-64b3-459b-a33f-43b9ac610efe admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:42.471508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee071-64b3-459b-a33f-43b9ac610efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:42.474204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee071-64b3-459b-a33f-43b9ac610efe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:42.504725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2230/4480] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:42.506430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82a0ea-9b88-4e28-9c24-e0d67cf52557 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:42.523510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82a0ea-9b88-4e28-9c24-e0d67cf52557 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:42.535576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe53c2-ddb5-4278-8b31-cc40b911e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:42.536705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe53c2-ddb5-4278-8b31-cc40b911e792 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:42.537086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe53c2-ddb5-4278-8b31-cc40b911e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:42.537578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe53c2-ddb5-4278-8b31-cc40b911e792 admin admin] PATH_INFO: `/v3/projects/bc330b34251d4b1a8da0d8cfc99da679/users/016376c584034ae6854444a1a8782616/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:42.578313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe53c2-ddb5-4278-8b31-cc40b911e792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc330b34251d4b1a8da0d8cfc99da679, user_id=016376c584034ae6854444a1a8782616, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:42.590301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe53c2-ddb5-4278-8b31-cc40b911e792 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:42.617898 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2251/4481] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:42 2022] PUT /identity/v3/projects/bc330b34251d4b1a8da0d8cfc99da679/users/016376c584034ae6854444a1a8782616/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:42.629411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9489a8-704e-4975-a71e-e84a7eadb075 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:42.629952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9489a8-704e-4975-a71e-e84a7eadb075 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:42.630382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9489a8-704e-4975-a71e-e84a7eadb075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:42.687002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3c9489a8-704e-4975-a71e-e84a7eadb075 None None] MFA Rules not processed for user `016376c584034ae6854444a1a8782616`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:42.688662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3c9489a8-704e-4975-a71e-e84a7eadb075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:42.828584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe53c2-ddb5-4278-8b31-cc40b911e792 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:42.831920 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2231/4482] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:42.918128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe53c2-ddb5-4278-8b31-cc40b911e792 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:42.928278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bb381-29b9-459c-93a3-1b027348d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:42.929461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb381-29b9-459c-93a3-1b027348d5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:42.931677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb381-29b9-459c-93a3-1b027348d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:42.932115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb381-29b9-459c-93a3-1b027348d5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:42.932868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bb381-29b9-459c-93a3-1b027348d5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:42.935204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bb381-29b9-459c-93a3-1b027348d5f1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:43.009339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9489a8-704e-4975-a71e-e84a7eadb075 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:43.010067 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2252/4483] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:42 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:43.026193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9489a8-704e-4975-a71e-e84a7eadb075 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:43.250818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8bf43-aff5-4e70-a7bb-8f85d9524f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:43.255889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bf43-aff5-4e70-a7bb-8f85d9524f88 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:43.256453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bf43-aff5-4e70-a7bb-8f85d9524f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:43.257175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bf43-aff5-4e70-a7bb-8f85d9524f88 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:43.261656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8bf43-aff5-4e70-a7bb-8f85d9524f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:43.266688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8bf43-aff5-4e70-a7bb-8f85d9524f88 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:43.331259 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2232/4484] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:43 2022] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:43.332732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bb381-29b9-459c-93a3-1b027348d5f1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:43.353020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bb381-29b9-459c-93a3-1b027348d5f1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:43.373098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b9a1-2e4b-4c4d-b34c-502c20a9f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:43.374035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b9a1-2e4b-4c4d-b34c-502c20a9f6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:43.374498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b9a1-2e4b-4c4d-b34c-502c20a9f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:43.374946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b9a1-2e4b-4c4d-b34c-502c20a9f6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:43.376007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b9a1-2e4b-4c4d-b34c-502c20a9f6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:43.377817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b9a1-2e4b-4c4d-b34c-502c20a9f6d2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:43.393965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2253/4485] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:43.395118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8bf43-aff5-4e70-a7bb-8f85d9524f88 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:43.415489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8bf43-aff5-4e70-a7bb-8f85d9524f88 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:43.443768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb13a0-032d-4f51-a434-932774c1c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:43.444476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb13a0-032d-4f51-a434-932774c1c96e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:43.444758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb13a0-032d-4f51-a434-932774c1c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:43.445034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb13a0-032d-4f51-a434-932774c1c96e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:43.445757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb13a0-032d-4f51-a434-932774c1c96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:43.447357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb13a0-032d-4f51-a434-932774c1c96e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:43.478033 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2233/4486] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:43.479291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b9a1-2e4b-4c4d-b34c-502c20a9f6d2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:43.493636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b9a1-2e4b-4c4d-b34c-502c20a9f6d2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:43.506136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115fb35-565c-4225-987f-f1abbfdc65b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:43.507227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115fb35-565c-4225-987f-f1abbfdc65b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:43.507679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115fb35-565c-4225-987f-f1abbfdc65b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:43.507964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115fb35-565c-4225-987f-f1abbfdc65b9 admin admin] PATH_INFO: `/v3/projects/172c0f8c12664912a2189247d2efa1e4/users/6ea9f1eb82b54aa3b50bd5d87bbf6527/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:43.542707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115fb35-565c-4225-987f-f1abbfdc65b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172c0f8c12664912a2189247d2efa1e4, user_id=6ea9f1eb82b54aa3b50bd5d87bbf6527, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:43.550213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115fb35-565c-4225-987f-f1abbfdc65b9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:43.592680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2254/4487] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:43 2022] PUT /identity/v3/projects/172c0f8c12664912a2189247d2efa1e4/users/6ea9f1eb82b54aa3b50bd5d87bbf6527/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:43.596745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98399-528e-41be-84a8-dfeb0a8835fd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:43.597159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98399-528e-41be-84a8-dfeb0a8835fd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:43.597539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98399-528e-41be-84a8-dfeb0a8835fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:43.701445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-13e98399-528e-41be-84a8-dfeb0a8835fd None None] MFA Rules not processed for user `6ea9f1eb82b54aa3b50bd5d87bbf6527`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:43.703563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-13e98399-528e-41be-84a8-dfeb0a8835fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:43.895539 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2234/4488] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:43.900518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115fb35-565c-4225-987f-f1abbfdc65b9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:44.166703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115fb35-565c-4225-987f-f1abbfdc65b9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:44.187292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0427d8-0955-4f78-8144-c46d686e3fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:44.192428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0427d8-0955-4f78-8144-c46d686e3fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:44.192580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0427d8-0955-4f78-8144-c46d686e3fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:44.192841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0427d8-0955-4f78-8144-c46d686e3fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:44.193583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0427d8-0955-4f78-8144-c46d686e3fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:44.195591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0427d8-0955-4f78-8144-c46d686e3fc4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:44.256101 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2255/4489] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:43 2022] POST /identity/v3/projects => generated 381 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:44.257392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e98399-528e-41be-84a8-dfeb0a8835fd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:44.279591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e98399-528e-41be-84a8-dfeb0a8835fd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:44.470844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3d9cb-323c-4e13-8817-90c16f671f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:44.472141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3d9cb-323c-4e13-8817-90c16f671f16 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:44.472771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3d9cb-323c-4e13-8817-90c16f671f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:44.473147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3d9cb-323c-4e13-8817-90c16f671f16 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:44.474612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3d9cb-323c-4e13-8817-90c16f671f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:44.478653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3d9cb-323c-4e13-8817-90c16f671f16 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:44.525609 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2235/4490] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:44 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:44.529427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0427d8-0955-4f78-8144-c46d686e3fc4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:44.545486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0427d8-0955-4f78-8144-c46d686e3fc4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:44.563167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:44.564158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:44.564878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:44.565315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:44.566217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:44.568660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:44.595647 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2256/4491] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:01:44.600297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3d9cb-323c-4e13-8817-90c16f671f16 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:44.612577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:44.616133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:44.616853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3d9cb-323c-4e13-8817-90c16f671f16 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:44.641667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee1d22-0b33-4955-812e-fea192678f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:44.643178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1d22-0b33-4955-812e-fea192678f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:44.643463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1d22-0b33-4955-812e-fea192678f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:44.643745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1d22-0b33-4955-812e-fea192678f50 admin admin] PATH_INFO: `/v3/projects/6ea2a5563e7547cdbcb8034291d96f81/users/d1138283573b4ef5b6086d589dc1c342/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:44.651380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49124947-1f4e-4162-926e-322fc3764736 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:44.677134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:44.680292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:44.681052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:44.681670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] PATH_INFO: `/v3/users/9569b0a569a745e797618d42bad7c795` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:44.683867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9569b0a569a745e797618d42bad7c795)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:44.687367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:44.687697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee1d22-0b33-4955-812e-fea192678f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea2a5563e7547cdbcb8034291d96f81, user_id=d1138283573b4ef5b6086d589dc1c342, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:44.697013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee1d22-0b33-4955-812e-fea192678f50 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:44.750607 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2236/4492] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:44 2022] PUT /identity/v3/projects/6ea2a5563e7547cdbcb8034291d96f81/users/d1138283573b4ef5b6086d589dc1c342/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:44.752240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee1d22-0b33-4955-812e-fea192678f50 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:44.875084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9569b0a569a745e797618d42bad7c795'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:44.889062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9569b0a569a745e797618d42bad7c795'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:44.902951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9569b0a569a745e797618d42bad7c795'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:44.904190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9569b0a569a745e797618d42bad7c795'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:44.904904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9569b0a569a745e797618d42bad7c795'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:44.906583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee1d22-0b33-4955-812e-fea192678f50 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:44.917229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4430a-7470-494f-9ab8-d89eef20c7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:44.919492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4430a-7470-494f-9ab8-d89eef20c7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:44.920015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4430a-7470-494f-9ab8-d89eef20c7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:44.922051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4430a-7470-494f-9ab8-d89eef20c7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:44.923634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4430a-7470-494f-9ab8-d89eef20c7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:44.927120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4430a-7470-494f-9ab8-d89eef20c7c9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:44.931149 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2257/4493] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:44 2022] DELETE /identity/v3/users/9569b0a569a745e797618d42bad7c795 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:44.960191 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2237/4494] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:44.964851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:44.970273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:45.088754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dba43-bb2f-4dd2-a490-cdbf59ca0961 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:45.098764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:45.101043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:45.101558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:45.102060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] PATH_INFO: `/v3/projects/6ea2a5563e7547cdbcb8034291d96f81/users/d1138283573b4ef5b6086d589dc1c342/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:45.104546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea2a5563e7547cdbcb8034291d96f81, user_id=d1138283573b4ef5b6086d589dc1c342, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:45.107674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:45.120656 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2258/4495] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:44 2022] PUT /identity/v3/projects/6ea2a5563e7547cdbcb8034291d96f81/users/d1138283573b4ef5b6086d589dc1c342/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:45.131397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407eb7c-53ca-4011-b4e2-d1ccd8a2aaf2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:45.131689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407eb7c-53ca-4011-b4e2-d1ccd8a2aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:45.131974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407eb7c-53ca-4011-b4e2-d1ccd8a2aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:45.206469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1407eb7c-53ca-4011-b4e2-d1ccd8a2aaf2 None None] MFA Rules not processed for user `d1138283573b4ef5b6086d589dc1c342`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:45.207773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1407eb7c-53ca-4011-b4e2-d1ccd8a2aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:45.340738 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2238/4496] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:45.500103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:45.505429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:45.511639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407eb7c-53ca-4011-b4e2-d1ccd8a2aaf2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:45.520302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1407eb7c-53ca-4011-b4e2-d1ccd8a2aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:45.666772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e4b1-9846-4ec6-a2e5-4103592b5f29 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:45.671897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64959fc3-7e9f-4496-b52d-79cefe9f733c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:45.672941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959fc3-7e9f-4496-b52d-79cefe9f733c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:45.674275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959fc3-7e9f-4496-b52d-79cefe9f733c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:45.674904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959fc3-7e9f-4496-b52d-79cefe9f733c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:45.678419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-64959fc3-7e9f-4496-b52d-79cefe9f733c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:45.791823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64959fc3-7e9f-4496-b52d-79cefe9f733c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:45.794435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64959fc3-7e9f-4496-b52d-79cefe9f733c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:45.818168 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2259/4497] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:45.818620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407eb7c-53ca-4011-b4e2-d1ccd8a2aaf2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:45.841621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:45.842438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:45.842719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:45.842996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] PATH_INFO: `/v3/projects/65cfeab9ddf04555a7e2fdb0ee8ebc42` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:45.846532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cfeab9ddf04555a7e2fdb0ee8ebc42)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:45.849612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:45.967349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'request_id': 'req-fdc91b46-5044-4f2b-ab55-620eff2fabf8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:45.975173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'request_id': 'req-fdc91b46-5044-4f2b-ab55-620eff2fabf8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:45.986609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'request_id': 'req-fdc91b46-5044-4f2b-ab55-620eff2fabf8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:46.004555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] The token cache is being invalidate because project 65cfeab9ddf04555a7e2fdb0ee8ebc42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:46.005093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:46.006191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fdc91b46-5044-4f2b-ab55-620eff2fabf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:46.008286 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2239/4498] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:45 2022] DELETE /identity/v3/projects/65cfeab9ddf04555a7e2fdb0ee8ebc42 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:46.013699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de3f0-c216-4df3-bf92-f6ab16656ded None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.014199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de3f0-c216-4df3-bf92-f6ab16656ded None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.014475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017de3f0-c216-4df3-bf92-f6ab16656ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.052753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-017de3f0-c216-4df3-bf92-f6ab16656ded None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:46.054343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-017de3f0-c216-4df3-bf92-f6ab16656ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:46.214827 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2260/4499] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:46.223676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab428-7966-4a73-8168-12efe0ebd6b1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.223962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab428-7966-4a73-8168-12efe0ebd6b1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.224240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab428-7966-4a73-8168-12efe0ebd6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.258668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-79dab428-7966-4a73-8168-12efe0ebd6b1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:46.260054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-79dab428-7966-4a73-8168-12efe0ebd6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:46.272462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2240/4500] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:01:46.273570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017de3f0-c216-4df3-bf92-f6ab16656ded None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:46.290238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017de3f0-c216-4df3-bf92-f6ab16656ded None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:46.297649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:46.298586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.299154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.299590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.300580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:01:46.301053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:46.303279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:46.330361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dab428-7966-4a73-8168-12efe0ebd6b1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:46.342882 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2261/4501] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:01:46.343338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dab428-7966-4a73-8168-12efe0ebd6b1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:46.349342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fd46d-7538-445f-96b4-7168f8f5f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:46.350393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fd46d-7538-445f-96b4-7168f8f5f4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.350714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fd46d-7538-445f-96b4-7168f8f5f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.354187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fd46d-7538-445f-96b4-7168f8f5f4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.355224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fd46d-7538-445f-96b4-7168f8f5f4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:46.358127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fd46d-7538-445f-96b4-7168f8f5f4a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:46.411907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:46.417136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2241/4502] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:46 2022] POST /identity/v3/projects => generated 395 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:46.426886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5884b-654f-46cc-9eae-0045ad20be22 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:46.537803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a84e0-ea35-4876-a60b-1f0b64ad0c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:46.538846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a84e0-ea35-4876-a60b-1f0b64ad0c5d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.539337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a84e0-ea35-4876-a60b-1f0b64ad0c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.540478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a84e0-ea35-4876-a60b-1f0b64ad0c5d admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.541670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a84e0-ea35-4876-a60b-1f0b64ad0c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:46.544479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a84e0-ea35-4876-a60b-1f0b64ad0c5d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:46.580226 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2262/4503] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:46 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:46.581747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fd46d-7538-445f-96b4-7168f8f5f4a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:46.614717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fd46d-7538-445f-96b4-7168f8f5f4a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:46.630110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba021a49-973f-42fc-8ac6-2b0e2a33d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:46.632637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba021a49-973f-42fc-8ac6-2b0e2a33d930 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.633216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba021a49-973f-42fc-8ac6-2b0e2a33d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.633718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba021a49-973f-42fc-8ac6-2b0e2a33d930 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.634551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba021a49-973f-42fc-8ac6-2b0e2a33d930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:46.638577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba021a49-973f-42fc-8ac6-2b0e2a33d930 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:46.674177 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2242/4504] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:46.680598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a84e0-ea35-4876-a60b-1f0b64ad0c5d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:46.703057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a84e0-ea35-4876-a60b-1f0b64ad0c5d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:46.715448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a7de1-bdbd-4c0e-8049-7a9884630410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:46.720412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7de1-bdbd-4c0e-8049-7a9884630410 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.721598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7de1-bdbd-4c0e-8049-7a9884630410 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.722226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7de1-bdbd-4c0e-8049-7a9884630410 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.723108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a7de1-bdbd-4c0e-8049-7a9884630410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:46.725954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a7de1-bdbd-4c0e-8049-7a9884630410 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:46.761295 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2263/4505] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:46.762430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba021a49-973f-42fc-8ac6-2b0e2a33d930 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:46.779137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba021a49-973f-42fc-8ac6-2b0e2a33d930 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:46.792211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:46.794518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.796341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.796924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] PATH_INFO: `/v3/projects/c03769052a6d4b21ad5a0dc4ce5e15fd/users/0f073c8403c445029976989a1848060f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.815452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03769052a6d4b21ad5a0dc4ce5e15fd, user_id=0f073c8403c445029976989a1848060f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:46.822723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:46.853132 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2243/4506] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:46 2022] PUT /identity/v3/projects/c03769052a6d4b21ad5a0dc4ce5e15fd/users/0f073c8403c445029976989a1848060f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:46.860190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da0db0-b1f4-43cc-8757-675f7265669f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:46.860911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da0db0-b1f4-43cc-8757-675f7265669f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:46.861343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da0db0-b1f4-43cc-8757-675f7265669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:46.891172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-29da0db0-b1f4-43cc-8757-675f7265669f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:46.892844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-29da0db0-b1f4-43cc-8757-675f7265669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:47.027563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2264/4507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:01:47.036365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:47.038932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:47.125753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c25de-be88-4a69-9629-2c04d9075b78 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:47.131196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:47.132071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:47.132632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:47.133042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:47.144629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:47.146417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:47.157709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2244/4508] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:49.870558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81f4b-5c1c-4cba-90fc-42cf3098a841 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:49.871365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81f4b-5c1c-4cba-90fc-42cf3098a841 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:49.872283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81f4b-5c1c-4cba-90fc-42cf3098a841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:49.905085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-38e81f4b-5c1c-4cba-90fc-42cf3098a841 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:49.907392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38e81f4b-5c1c-4cba-90fc-42cf3098a841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:50.016560 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2265/4509] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:50.043483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:50.048286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:50.216048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057d2ed-b496-465b-9e98-e5d9d1957276 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:50.225269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bc5ea-6ee2-4036-855f-23ae1b3ee5d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:50.226908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc5ea-6ee2-4036-855f-23ae1b3ee5d6 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:50.227163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc5ea-6ee2-4036-855f-23ae1b3ee5d6 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:50.227499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc5ea-6ee2-4036-855f-23ae1b3ee5d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:50.235078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e81f4b-5c1c-4cba-90fc-42cf3098a841 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:50.237007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38e81f4b-5c1c-4cba-90fc-42cf3098a841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:50.249268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bc5ea-6ee2-4036-855f-23ae1b3ee5d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:50.251004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bc5ea-6ee2-4036-855f-23ae1b3ee5d6 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:50.256943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e81f4b-5c1c-4cba-90fc-42cf3098a841 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:50.265277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:50.265479 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2245/4510] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:01:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:50.266654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:50.266948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:50.267661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] PATH_INFO: `/v3/users/0660e4c1032c4ecaa6b12a41260818b2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:50.270564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0660e4c1032c4ecaa6b12a41260818b2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:50.273161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:50.384240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0660e4c1032c4ecaa6b12a41260818b2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:50.430590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0660e4c1032c4ecaa6b12a41260818b2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:50.459689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0660e4c1032c4ecaa6b12a41260818b2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:50.461856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0660e4c1032c4ecaa6b12a41260818b2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:50.462872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0660e4c1032c4ecaa6b12a41260818b2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:50.514986 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2266/4511] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:50 2022] DELETE /identity/v3/users/0660e4c1032c4ecaa6b12a41260818b2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:50.517290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9b5f-3a94-4777-96b6-09e028e21ed8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:50.517965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9b5f-3a94-4777-96b6-09e028e21ed8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:50.518246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9b5f-3a94-4777-96b6-09e028e21ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:50.553245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9cbd9b5f-3a94-4777-96b6-09e028e21ed8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:50.554491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9cbd9b5f-3a94-4777-96b6-09e028e21ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:50.708841 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2246/4512] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:50.766377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:50.769582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:50.878833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52526a3-a383-4cd1-8ade-395750c3b58f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:50.888222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c412-6eb4-4df6-af5e-263d096a2086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:50.890085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c412-6eb4-4df6-af5e-263d096a2086 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:50.890425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c412-6eb4-4df6-af5e-263d096a2086 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:50.890709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c412-6eb4-4df6-af5e-263d096a2086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:50.917087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581c412-6eb4-4df6-af5e-263d096a2086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:50.919805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581c412-6eb4-4df6-af5e-263d096a2086 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:50.934978 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2267/4513] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:52.089311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9b5f-3a94-4777-96b6-09e028e21ed8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:52.091500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9cbd9b5f-3a94-4777-96b6-09e028e21ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:52.111303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9b5f-3a94-4777-96b6-09e028e21ed8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:52.118646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:52.119807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:52.120094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:52.120440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] PATH_INFO: `/v3/projects/dbdfeb34bdf0400096db0350a674adfe` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:52.137800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbdfeb34bdf0400096db0350a674adfe)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:52.147937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:52.256980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbdfeb34bdf0400096db0350a674adfe', 'request_id': 'req-51f5b500-678d-4085-87b9-e97c2503202c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.267348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbdfeb34bdf0400096db0350a674adfe', 'request_id': 'req-51f5b500-678d-4085-87b9-e97c2503202c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.284653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbdfeb34bdf0400096db0350a674adfe', 'request_id': 'req-51f5b500-678d-4085-87b9-e97c2503202c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.308314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] The token cache is being invalidate because project dbdfeb34bdf0400096db0350a674adfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:52.309073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.310816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.318786 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2247/4514] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:52 2022] DELETE /identity/v3/projects/dbdfeb34bdf0400096db0350a674adfe => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:52.320113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c412-6eb4-4df6-af5e-263d096a2086 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:52.352737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c412-6eb4-4df6-af5e-263d096a2086 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:52.444281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:52.446178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:52.446615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:52.447430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] PATH_INFO: `/v3/users/001c28f26eff4003bf8f8aef1c59e1e7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:52.449024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=001c28f26eff4003bf8f8aef1c59e1e7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:52.452618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:52.554753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001c28f26eff4003bf8f8aef1c59e1e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.581511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001c28f26eff4003bf8f8aef1c59e1e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.596678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001c28f26eff4003bf8f8aef1c59e1e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.598959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001c28f26eff4003bf8f8aef1c59e1e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.599731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e90ac35f-6db4-4a6c-881b-7fad61242d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001c28f26eff4003bf8f8aef1c59e1e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:52.633529 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2268/4515] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:01:52 2022] DELETE /identity/v3/users/001c28f26eff4003bf8f8aef1c59e1e7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:01:53.453850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:53.455223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:53.479520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5b500-678d-4085-87b9-e97c2503202c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:53.624598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:53.625755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:53.626189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:53.626656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] PATH_INFO: `/v3/projects/bb0ce5514cc846e4872178f8739e517e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:53.630242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0ce5514cc846e4872178f8739e517e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:53.634672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:53.735386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0ce5514cc846e4872178f8739e517e', 'request_id': 'req-626c48c1-8c41-4660-b5c3-595729d39fcf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:53.750805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0ce5514cc846e4872178f8739e517e', 'request_id': 'req-626c48c1-8c41-4660-b5c3-595729d39fcf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:53.760162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0ce5514cc846e4872178f8739e517e', 'request_id': 'req-626c48c1-8c41-4660-b5c3-595729d39fcf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:53.780083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] The token cache is being invalidate because project bb0ce5514cc846e4872178f8739e517e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:01:53.780413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:53.781098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-626c48c1-8c41-4660-b5c3-595729d39fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:01:53.783054 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2248/4516] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:53 2022] DELETE /identity/v3/projects/bb0ce5514cc846e4872178f8739e517e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:53.789154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34ff3f-0ce4-4096-b09d-ba042dce90c5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:53.789712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34ff3f-0ce4-4096-b09d-ba042dce90c5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:53.789809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34ff3f-0ce4-4096-b09d-ba042dce90c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:53.834209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6e34ff3f-0ce4-4096-b09d-ba042dce90c5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:53.836599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6e34ff3f-0ce4-4096-b09d-ba042dce90c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:54.029077 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2269/4517] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:54.032076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f7dc-25a7-4e3f-abdc-fce9027c32c2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.032531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f7dc-25a7-4e3f-abdc-fce9027c32c2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.032929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f7dc-25a7-4e3f-abdc-fce9027c32c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.076193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-23d6f7dc-25a7-4e3f-abdc-fce9027c32c2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:54.077610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-23d6f7dc-25a7-4e3f-abdc-fce9027c32c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:54.096355 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2249/4518] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:54.101087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34ff3f-0ce4-4096-b09d-ba042dce90c5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:54.123936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34ff3f-0ce4-4096-b09d-ba042dce90c5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:54.142501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:54.143822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.143822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.143962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.144685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:01:54.144993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:54.146611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:54.156750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db020893-a5ea-4fe2-9808-447ffdf76f85 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.157346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db020893-a5ea-4fe2-9808-447ffdf76f85 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.157826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db020893-a5ea-4fe2-9808-447ffdf76f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.165449 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2270/4519] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:01:54.170172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:54.185873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a999-c641-4b8d-90ee-b75492775788 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:54.212912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32540b53-f691-4242-8b5c-4c16949a6c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:54.213034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-db020893-a5ea-4fe2-9808-447ffdf76f85 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:54.213893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540b53-f691-4242-8b5c-4c16949a6c5d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.214481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-db020893-a5ea-4fe2-9808-447ffdf76f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:54.214894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540b53-f691-4242-8b5c-4c16949a6c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.215248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540b53-f691-4242-8b5c-4c16949a6c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.218427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32540b53-f691-4242-8b5c-4c16949a6c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:54.223987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32540b53-f691-4242-8b5c-4c16949a6c5d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:54.289209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2271/4520] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:01:54 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:01:54.293264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32540b53-f691-4242-8b5c-4c16949a6c5d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:54.354234 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2250/4521] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:01:54.367936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db020893-a5ea-4fe2-9808-447ffdf76f85 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:54.369857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-db020893-a5ea-4fe2-9808-447ffdf76f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:54.479034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32540b53-f691-4242-8b5c-4c16949a6c5d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:54.493805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f8dff-7c89-4eca-92a9-a1158f834177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:54.496167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f8dff-7c89-4eca-92a9-a1158f834177 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.497133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f8dff-7c89-4eca-92a9-a1158f834177 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.497646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f8dff-7c89-4eca-92a9-a1158f834177 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.498747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f8dff-7c89-4eca-92a9-a1158f834177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:54.502436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f8dff-7c89-4eca-92a9-a1158f834177 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:54.537297 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2272/4522] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:01:54 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:01:54.544800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f8dff-7c89-4eca-92a9-a1158f834177 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:54.552843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db020893-a5ea-4fe2-9808-447ffdf76f85 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:54.560484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f8dff-7c89-4eca-92a9-a1158f834177 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:54.571265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158bb1c-1e7f-4c66-97bc-a86f9a9322bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:54.572212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158bb1c-1e7f-4c66-97bc-a86f9a9322bf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.572768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158bb1c-1e7f-4c66-97bc-a86f9a9322bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.573118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158bb1c-1e7f-4c66-97bc-a86f9a9322bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.574275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158bb1c-1e7f-4c66-97bc-a86f9a9322bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:54.577568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158bb1c-1e7f-4c66-97bc-a86f9a9322bf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:54.611608 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2273/4523] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:54.614530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158bb1c-1e7f-4c66-97bc-a86f9a9322bf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:54.673709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69c155-785d-4484-a9fc-03cc22486655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:54.674681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c155-785d-4484-a9fc-03cc22486655 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.675324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c155-785d-4484-a9fc-03cc22486655 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.675697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c155-785d-4484-a9fc-03cc22486655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.679710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158bb1c-1e7f-4c66-97bc-a86f9a9322bf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:54.715138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ee4ce-c8ca-4ea4-89b2-9346efe5ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:54.716387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee4ce-c8ca-4ea4-89b2-9346efe5ee75 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.716675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee4ce-c8ca-4ea4-89b2-9346efe5ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.716959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee4ce-c8ca-4ea4-89b2-9346efe5ee75 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.717683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ee4ce-c8ca-4ea4-89b2-9346efe5ee75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:54.741766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ee4ce-c8ca-4ea4-89b2-9346efe5ee75 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:54.782734 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2274/4524] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:01:54.788014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ee4ce-c8ca-4ea4-89b2-9346efe5ee75 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:54.830680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ee4ce-c8ca-4ea4-89b2-9346efe5ee75 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:54.854403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:54.855053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69c155-785d-4484-a9fc-03cc22486655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:54.855304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.855587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.856413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] PATH_INFO: `/v3/projects/c3e2bd0a55e44ee2802a7b95678c9d60/users/bb812b1b093045b1aaa3ce9e3334ff4d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:54.857962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69c155-785d-4484-a9fc-03cc22486655 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:54.887713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2251/4525] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:01:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:54.889265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e2bd0a55e44ee2802a7b95678c9d60, user_id=bb812b1b093045b1aaa3ce9e3334ff4d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:54.892135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:54.932999 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2275/4526] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:01:54 2022] PUT /identity/v3/projects/c3e2bd0a55e44ee2802a7b95678c9d60/users/bb812b1b093045b1aaa3ce9e3334ff4d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:01:54.938957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee085c-c0f3-4e3c-bfdb-6438f3f1bc25 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:54.939476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee085c-c0f3-4e3c-bfdb-6438f3f1bc25 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:54.939957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee085c-c0f3-4e3c-bfdb-6438f3f1bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:55.009054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8eee085c-c0f3-4e3c-bfdb-6438f3f1bc25 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:55.018383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8eee085c-c0f3-4e3c-bfdb-6438f3f1bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:55.130174 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2252/4527] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:55.143121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:55.145638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:55.289078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07873818-2157-43fb-8402-66b3f9685b17 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:55.297916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:55.298651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:55.298942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:55.299221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:55.311685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:55.314569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:55.327426 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2276/4528] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:58.066501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9356f-1d71-4fad-932a-a192d8248175 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:58.067349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9356f-1d71-4fad-932a-a192d8248175 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:58.067865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9356f-1d71-4fad-932a-a192d8248175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:58.149357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d8a9356f-1d71-4fad-932a-a192d8248175 None None] MFA Rules not processed for user `bb812b1b093045b1aaa3ce9e3334ff4d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:58.150612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d8a9356f-1d71-4fad-932a-a192d8248175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:58.313624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2253/4529] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:58.336747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:58.338157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:58.522695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370fd4a-4d68-4685-98ff-908a4b9acd96 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:58.531775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a057c7-2a8c-42ef-9edc-60b35baee3b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:58.532578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a057c7-2a8c-42ef-9edc-60b35baee3b4 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:58.532759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a057c7-2a8c-42ef-9edc-60b35baee3b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:58.533037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a057c7-2a8c-42ef-9edc-60b35baee3b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:58.551108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a057c7-2a8c-42ef-9edc-60b35baee3b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:58.552607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a057c7-2a8c-42ef-9edc-60b35baee3b4 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:58.575966 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2277/4530] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:01:59.238821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189e992-6644-46b7-9de3-64c18b2c1cea None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:59.239317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189e992-6644-46b7-9de3-64c18b2c1cea None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:59.239411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189e992-6644-46b7-9de3-64c18b2c1cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:59.320640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b189e992-6644-46b7-9de3-64c18b2c1cea None None] MFA Rules not processed for user `0f073c8403c445029976989a1848060f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:59.321923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b189e992-6644-46b7-9de3-64c18b2c1cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:59.368197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a057c7-2a8c-42ef-9edc-60b35baee3b4 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:59.410739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a057c7-2a8c-42ef-9edc-60b35baee3b4 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:59.440280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc227398-9ae2-4250-8efd-0b7f0c7771db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:59.442416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227398-9ae2-4250-8efd-0b7f0c7771db service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:59.445318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227398-9ae2-4250-8efd-0b7f0c7771db service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:59.448619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227398-9ae2-4250-8efd-0b7f0c7771db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:59.458239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fc227398-9ae2-4250-8efd-0b7f0c7771db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:59.546397 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2254/4531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:59.556160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ab60-a785-4351-9be4-82854e39a411 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:59.556825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ab60-a785-4351-9be4-82854e39a411 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:59.557339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ab60-a785-4351-9be4-82854e39a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:59.597469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5939ab60-a785-4351-9be4-82854e39a411 None None] MFA Rules not processed for user `0f073c8403c445029976989a1848060f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:01:59.598964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5939ab60-a785-4351-9be4-82854e39a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:59.624193 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2255/4532] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:01:59.639478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939ab60-a785-4351-9be4-82854e39a411 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:01:59.643742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5939ab60-a785-4351-9be4-82854e39a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:01:59.764030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc227398-9ae2-4250-8efd-0b7f0c7771db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:59.770416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc227398-9ae2-4250-8efd-0b7f0c7771db service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:59.799846 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2278/4533] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:01:59.836716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939ab60-a785-4351-9be4-82854e39a411 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:01:59.856433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbfb11-dc18-404e-b7fd-851a986c5400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:01:59.857622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbfb11-dc18-404e-b7fd-851a986c5400 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:01:59.858152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbfb11-dc18-404e-b7fd-851a986c5400 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:01:59.859311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbfb11-dc18-404e-b7fd-851a986c5400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:01:59.900321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbfb11-dc18-404e-b7fd-851a986c5400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:01:59.902054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbfb11-dc18-404e-b7fd-851a986c5400 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:01:59.929718 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2256/4534] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:01:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:00.321837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a2e1-5e9e-4168-82ac-a6b1a4a918cd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:00.323008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a2e1-5e9e-4168-82ac-a6b1a4a918cd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:00.323451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a2e1-5e9e-4168-82ac-a6b1a4a918cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:00.342392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4982a2e1-5e9e-4168-82ac-a6b1a4a918cd None None] MFA Rules not processed for user `bb812b1b093045b1aaa3ce9e3334ff4d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:00.343916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4982a2e1-5e9e-4168-82ac-a6b1a4a918cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:00.355239 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2279/4535] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:02:04.275516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8599-1db5-4529-b592-fd10981c97a1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:04.276130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8599-1db5-4529-b592-fd10981c97a1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:04.276130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8599-1db5-4529-b592-fd10981c97a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:04.463720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9c6b8599-1db5-4529-b592-fd10981c97a1 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:04.465045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9c6b8599-1db5-4529-b592-fd10981c97a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:04.614497 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2257/4536] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:04.637541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a2e1-5e9e-4168-82ac-a6b1a4a918cd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:04.791832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a2e1-5e9e-4168-82ac-a6b1a4a918cd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:04.805055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f78df2-d066-4cbf-a085-53b40802975e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:04.805994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78df2-d066-4cbf-a085-53b40802975e service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:04.806425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78df2-d066-4cbf-a085-53b40802975e service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:04.811722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78df2-d066-4cbf-a085-53b40802975e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:04.823963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f78df2-d066-4cbf-a085-53b40802975e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:04.826795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f78df2-d066-4cbf-a085-53b40802975e service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:04.841819 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2280/4537] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:02:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:13.243775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8599-1db5-4529-b592-fd10981c97a1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:13.245664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9c6b8599-1db5-4529-b592-fd10981c97a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:13.280625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8599-1db5-4529-b592-fd10981c97a1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:13.294395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:13.295061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:13.295346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:13.295625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:13.297713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:13.411114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:13.413444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:13.430561 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2258/4538] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:02:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:25.003505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847dc7-5a58-4b88-9eab-7c978cc582de None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:25.004059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847dc7-5a58-4b88-9eab-7c978cc582de None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:25.004059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847dc7-5a58-4b88-9eab-7c978cc582de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:25.024308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-51847dc7-5a58-4b88-9eab-7c978cc582de None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:25.025794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-51847dc7-5a58-4b88-9eab-7c978cc582de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:25.035089 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2281/4539] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:25.049166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:25.067176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659faa68-c48c-49ba-9d71-173061b7ebeb service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:25.072986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5c145-634e-406d-8d44-d3174ca1c6f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:25.074068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5c145-634e-406d-8d44-d3174ca1c6f1 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:25.074307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5c145-634e-406d-8d44-d3174ca1c6f1 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:25.074676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5c145-634e-406d-8d44-d3174ca1c6f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:25.085650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5c145-634e-406d-8d44-d3174ca1c6f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:25.087390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5c145-634e-406d-8d44-d3174ca1c6f1 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:25.098374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2259/4540] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:02:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:27.018334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6d30-8163-40b6-9867-a037b9af0ab9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:27.018904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6d30-8163-40b6-9867-a037b9af0ab9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:27.018904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6d30-8163-40b6-9867-a037b9af0ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:27.048897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ee5b6d30-8163-40b6-9867-a037b9af0ab9 None None] MFA Rules not processed for user `71f534f513ef45d29629b913de461f23`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:27.050133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ee5b6d30-8163-40b6-9867-a037b9af0ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:27.146525 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2282/4541] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:29.374151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255a6a1-5c1b-4635-b8d1-8f7a96545d0e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:29.375054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255a6a1-5c1b-4635-b8d1-8f7a96545d0e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:29.375290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255a6a1-5c1b-4635-b8d1-8f7a96545d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:29.419300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8255a6a1-5c1b-4635-b8d1-8f7a96545d0e None None] MFA Rules not processed for user `bb812b1b093045b1aaa3ce9e3334ff4d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:29.420563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8255a6a1-5c1b-4635-b8d1-8f7a96545d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:29.439757 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2260/4542] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:02:31.654069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5b0f-1a5f-45b3-9e29-f7901d81520c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:31.654069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5b0f-1a5f-45b3-9e29-f7901d81520c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:31.654069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5b0f-1a5f-45b3-9e29-f7901d81520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:31.701121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-682a5b0f-1a5f-45b3-9e29-f7901d81520c None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:31.705727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-682a5b0f-1a5f-45b3-9e29-f7901d81520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:31.754435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255a6a1-5c1b-4635-b8d1-8f7a96545d0e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:31.768449 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2283/4543] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:31.773669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255a6a1-5c1b-4635-b8d1-8f7a96545d0e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:31.781854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fbdc3-2342-48f0-a4b8-b3c6cb6c3668 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:31.783059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fbdc3-2342-48f0-a4b8-b3c6cb6c3668 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:31.783484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fbdc3-2342-48f0-a4b8-b3c6cb6c3668 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:31.783979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fbdc3-2342-48f0-a4b8-b3c6cb6c3668 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:31.797493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fbdc3-2342-48f0-a4b8-b3c6cb6c3668 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:31.801139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fbdc3-2342-48f0-a4b8-b3c6cb6c3668 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:31.826599 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2261/4544] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:02:33.249625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5b0f-1a5f-45b3-9e29-f7901d81520c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:33.251500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-682a5b0f-1a5f-45b3-9e29-f7901d81520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:33.283099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5b0f-1a5f-45b3-9e29-f7901d81520c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:33.295109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:33.296737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:33.304825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:33.305143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] PATH_INFO: `/v3/users/9596b0d7c4a1461db4bbe63e2524f0e1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:33.307014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9596b0d7c4a1461db4bbe63e2524f0e1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:33.311577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:33.443247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9596b0d7c4a1461db4bbe63e2524f0e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:33.495255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9596b0d7c4a1461db4bbe63e2524f0e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:33.522361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9596b0d7c4a1461db4bbe63e2524f0e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:33.523386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9596b0d7c4a1461db4bbe63e2524f0e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:33.525622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9596b0d7c4a1461db4bbe63e2524f0e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:33.547983 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2284/4545] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:02:33 2022] DELETE /identity/v3/users/9596b0d7c4a1461db4bbe63e2524f0e1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:33.552578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6d13c-38df-416c-b697-9d8c6354e176 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:33.553066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6d13c-38df-416c-b697-9d8c6354e176 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:33.553172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6d13c-38df-416c-b697-9d8c6354e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:33.589410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eda6d13c-38df-416c-b697-9d8c6354e176 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:33.593090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eda6d13c-38df-416c-b697-9d8c6354e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:33.743985 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2262/4546] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:33.905544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:33.907393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:34.066692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb691-1900-4995-a2ed-177cc72d3e84 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:34.092411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfa094-7121-4a6e-98a3-2225c1938e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:34.093382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa094-7121-4a6e-98a3-2225c1938e20 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:34.093818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa094-7121-4a6e-98a3-2225c1938e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:34.094233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa094-7121-4a6e-98a3-2225c1938e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:34.123711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfa094-7121-4a6e-98a3-2225c1938e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:34.125212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfa094-7121-4a6e-98a3-2225c1938e20 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:34.164922 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2285/4547] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:34.901155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6d13c-38df-416c-b697-9d8c6354e176 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:34.904080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eda6d13c-38df-416c-b697-9d8c6354e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:34.930971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6d13c-38df-416c-b697-9d8c6354e176 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:34.939461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:34.940680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:34.941144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:34.941603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] PATH_INFO: `/v3/projects/25f76e9ca2f54ad98c30b0dc6351be5c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:34.943109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f76e9ca2f54ad98c30b0dc6351be5c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:34.950849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:35.119195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f76e9ca2f54ad98c30b0dc6351be5c', 'request_id': 'req-bc12345e-24af-4ac1-96c4-85657de82897'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.134193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f76e9ca2f54ad98c30b0dc6351be5c', 'request_id': 'req-bc12345e-24af-4ac1-96c4-85657de82897'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.162282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f76e9ca2f54ad98c30b0dc6351be5c', 'request_id': 'req-bc12345e-24af-4ac1-96c4-85657de82897'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.184251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] The token cache is being invalidate because project 25f76e9ca2f54ad98c30b0dc6351be5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:02:35.193490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.194630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.196933 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2263/4548] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:34 2022] DELETE /identity/v3/projects/25f76e9ca2f54ad98c30b0dc6351be5c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:35.202539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20bcd0-e858-47a9-8121-28c6f9089e10 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.204052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20bcd0-e858-47a9-8121-28c6f9089e10 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.204597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20bcd0-e858-47a9-8121-28c6f9089e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.228480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1b20bcd0-e858-47a9-8121-28c6f9089e10 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:35.230354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1b20bcd0-e858-47a9-8121-28c6f9089e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:35.325594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:35.327344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:35.351951 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2286/4549] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:35.352697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12345e-24af-4ac1-96c4-85657de82897 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:35.358206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f227c30-3eb1-42f6-b2a7-88eb26db4a6f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.358842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f227c30-3eb1-42f6-b2a7-88eb26db4a6f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.359332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f227c30-3eb1-42f6-b2a7-88eb26db4a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.369490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:35.371769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.372888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.374708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] PATH_INFO: `/v3/users/016376c584034ae6854444a1a8782616` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.380812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=016376c584034ae6854444a1a8782616)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:35.384548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:35.416967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2f227c30-3eb1-42f6-b2a7-88eb26db4a6f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:35.419287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2f227c30-3eb1-42f6-b2a7-88eb26db4a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:35.446231 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2287/4550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:35.450881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f227c30-3eb1-42f6-b2a7-88eb26db4a6f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:35.467573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f227c30-3eb1-42f6-b2a7-88eb26db4a6f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:35.473063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:35.474287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.474944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.475443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.476723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:02:35.477275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:35.480799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:35.496195 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2288/4551] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:02:35.501060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:35.502414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016376c584034ae6854444a1a8782616'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.504916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016376c584034ae6854444a1a8782616'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.507305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016376c584034ae6854444a1a8782616'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.526191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeee683-b8c6-426d-90f2-b2e1c956434c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:35.536301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016376c584034ae6854444a1a8782616'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.540960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:35.542110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.543683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.544675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.548053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:35.550375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:35.565217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c58f5157-8eae-479f-b2e6-dcd0fa90f988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016376c584034ae6854444a1a8782616'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:35.592830 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2264/4552] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:02:35 2022] DELETE /identity/v3/users/016376c584034ae6854444a1a8782616 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:35.597621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade488b-b254-4615-9ad2-22524f0426f0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.598743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade488b-b254-4615-9ad2-22524f0426f0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.599133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade488b-b254-4615-9ad2-22524f0426f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.626807 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2289/4553] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:02:35 2022] POST /identity/v3/projects => generated 399 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:35.630781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:35.635287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:35.643086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bade488b-b254-4615-9ad2-22524f0426f0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:35.647558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bade488b-b254-4615-9ad2-22524f0426f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:35.783961 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2265/4554] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:35.810346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade488b-b254-4615-9ad2-22524f0426f0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:35.815826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bade488b-b254-4615-9ad2-22524f0426f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:35.828450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8df8e7-6107-4c40-80fa-cf252998a642 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:35.836688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6e5f-2f3e-4c34-bbc9-80b38d9a0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:35.837593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6e5f-2f3e-4c34-bbc9-80b38d9a0c60 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.837982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6e5f-2f3e-4c34-bbc9-80b38d9a0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.838361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6e5f-2f3e-4c34-bbc9-80b38d9a0c60 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.839684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf6e5f-2f3e-4c34-bbc9-80b38d9a0c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:35.842577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf6e5f-2f3e-4c34-bbc9-80b38d9a0c60 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:35.883914 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2290/4555] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:02:35 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:35.885617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6e5f-2f3e-4c34-bbc9-80b38d9a0c60 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:35.902019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6e5f-2f3e-4c34-bbc9-80b38d9a0c60 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:35.909912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594aa5-f593-4caa-85cf-63b11e8984b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:35.910691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594aa5-f593-4caa-85cf-63b11e8984b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.911053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594aa5-f593-4caa-85cf-63b11e8984b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.911404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594aa5-f593-4caa-85cf-63b11e8984b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.912270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594aa5-f593-4caa-85cf-63b11e8984b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:35.914545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade488b-b254-4615-9ad2-22524f0426f0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:35.917025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594aa5-f593-4caa-85cf-63b11e8984b8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:35.933291 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2291/4556] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:02:35.934433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df213c-be1c-49c0-b719-7d76dd93c6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:35.934433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df213c-be1c-49c0-b719-7d76dd93c6be service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.934433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df213c-be1c-49c0-b719-7d76dd93c6be service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.934433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df213c-be1c-49c0-b719-7d76dd93c6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.936790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594aa5-f593-4caa-85cf-63b11e8984b8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:35.947122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df213c-be1c-49c0-b719-7d76dd93c6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:35.948998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df213c-be1c-49c0-b719-7d76dd93c6be service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:35.953027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594aa5-f593-4caa-85cf-63b11e8984b8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:35.960695 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2266/4557] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:35.963151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1431bf-8d23-4c83-bdfb-9188b53a967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:35.963876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1431bf-8d23-4c83-bdfb-9188b53a967c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:35.964244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1431bf-8d23-4c83-bdfb-9188b53a967c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:35.964883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1431bf-8d23-4c83-bdfb-9188b53a967c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:35.967100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1431bf-8d23-4c83-bdfb-9188b53a967c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:35.969775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1431bf-8d23-4c83-bdfb-9188b53a967c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:35.991528 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2292/4558] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:02:35.997713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df213c-be1c-49c0-b719-7d76dd93c6be service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:36.011047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df213c-be1c-49c0-b719-7d76dd93c6be service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:36.020237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5585b92-55cb-40ca-923b-89a7c546db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:36.023161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5585b92-55cb-40ca-923b-89a7c546db54 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:36.023683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5585b92-55cb-40ca-923b-89a7c546db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:36.024164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5585b92-55cb-40ca-923b-89a7c546db54 admin admin] PATH_INFO: `/v3/projects/8d34faf6add7400690171f1d097d5f2c/users/5b13848e363e44b9927525ca9ca6fe81/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:36.069766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5585b92-55cb-40ca-923b-89a7c546db54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d34faf6add7400690171f1d097d5f2c, user_id=5b13848e363e44b9927525ca9ca6fe81, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:36.078839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5585b92-55cb-40ca-923b-89a7c546db54 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:36.103502 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2267/4559] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:02:35 2022] PUT /identity/v3/projects/8d34faf6add7400690171f1d097d5f2c/users/5b13848e363e44b9927525ca9ca6fe81/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:36.110088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7bca5-5a20-40ef-ad32-db328acf49c6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:36.110601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7bca5-5a20-40ef-ad32-db328acf49c6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:36.111294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7bca5-5a20-40ef-ad32-db328acf49c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:36.165538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-08e7bca5-5a20-40ef-ad32-db328acf49c6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:36.169102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-08e7bca5-5a20-40ef-ad32-db328acf49c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:36.309460 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2293/4560] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:36.340959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5585b92-55cb-40ca-923b-89a7c546db54 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:36.472593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5585b92-55cb-40ca-923b-89a7c546db54 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:36.477396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0778d1-5eae-4bac-89c5-e2cd1d505364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:36.478072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0778d1-5eae-4bac-89c5-e2cd1d505364 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:36.479711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0778d1-5eae-4bac-89c5-e2cd1d505364 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:36.479990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0778d1-5eae-4bac-89c5-e2cd1d505364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:36.492123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0778d1-5eae-4bac-89c5-e2cd1d505364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:36.493882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0778d1-5eae-4bac-89c5-e2cd1d505364 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:36.507412 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2268/4561] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:36.731673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7bca5-5a20-40ef-ad32-db328acf49c6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:36.734206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-08e7bca5-5a20-40ef-ad32-db328acf49c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:36.799743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7bca5-5a20-40ef-ad32-db328acf49c6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:36.804865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:36.809047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:36.809047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:36.809047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] PATH_INFO: `/v3/projects/bc330b34251d4b1a8da0d8cfc99da679` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:36.838707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc330b34251d4b1a8da0d8cfc99da679)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:36.841547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:36.979538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc330b34251d4b1a8da0d8cfc99da679', 'request_id': 'req-781bccb9-1421-4404-8c6c-a8c724715966'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.005216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc330b34251d4b1a8da0d8cfc99da679', 'request_id': 'req-781bccb9-1421-4404-8c6c-a8c724715966'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.027774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc330b34251d4b1a8da0d8cfc99da679', 'request_id': 'req-781bccb9-1421-4404-8c6c-a8c724715966'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.065191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] The token cache is being invalidate because project bc330b34251d4b1a8da0d8cfc99da679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:02:37.065942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.066820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.073165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2294/4562] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:36 2022] DELETE /identity/v3/projects/bc330b34251d4b1a8da0d8cfc99da679 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:37.073446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0778d1-5eae-4bac-89c5-e2cd1d505364 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:37.088495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0778d1-5eae-4bac-89c5-e2cd1d505364 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:37.351688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:37.352605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:37.352894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:37.353216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] PATH_INFO: `/v3/users/6ea9f1eb82b54aa3b50bd5d87bbf6527` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:37.361905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea9f1eb82b54aa3b50bd5d87bbf6527)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:37.363887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:37.494310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea9f1eb82b54aa3b50bd5d87bbf6527'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.495089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea9f1eb82b54aa3b50bd5d87bbf6527'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.495930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea9f1eb82b54aa3b50bd5d87bbf6527'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.510139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea9f1eb82b54aa3b50bd5d87bbf6527'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.526214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea9f1eb82b54aa3b50bd5d87bbf6527'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:37.546576 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2269/4563] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:02:37 2022] DELETE /identity/v3/users/6ea9f1eb82b54aa3b50bd5d87bbf6527 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:02:38.475263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:38.476998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:38.510030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bccb9-1421-4404-8c6c-a8c724715966 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:38.665288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:38.666482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:38.667459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:38.668779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] PATH_INFO: `/v3/projects/172c0f8c12664912a2189247d2efa1e4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:38.673488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172c0f8c12664912a2189247d2efa1e4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:38.676990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:38.785881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172c0f8c12664912a2189247d2efa1e4', 'request_id': 'req-e4a855f3-11a7-477a-9e91-3e398d277e34'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:38.799042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172c0f8c12664912a2189247d2efa1e4', 'request_id': 'req-e4a855f3-11a7-477a-9e91-3e398d277e34'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:38.833759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172c0f8c12664912a2189247d2efa1e4', 'request_id': 'req-e4a855f3-11a7-477a-9e91-3e398d277e34'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:38.879090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] The token cache is being invalidate because project 172c0f8c12664912a2189247d2efa1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:02:38.879468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:38.880147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4a855f3-11a7-477a-9e91-3e398d277e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:38.885851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2295/4564] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:38 2022] DELETE /identity/v3/projects/172c0f8c12664912a2189247d2efa1e4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:38.891181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:38.893126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:38.920528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a092f-6c01-4642-b500-89490e7a8c6a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:39.057484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:39.059797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:39.060252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:39.060834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] PATH_INFO: `/v3/users/d1138283573b4ef5b6086d589dc1c342` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:39.064264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1138283573b4ef5b6086d589dc1c342)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:39.067275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:39.156436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1138283573b4ef5b6086d589dc1c342'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:39.157187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1138283573b4ef5b6086d589dc1c342'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:39.158360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1138283573b4ef5b6086d589dc1c342'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:39.179050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1138283573b4ef5b6086d589dc1c342'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:39.195250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc72bbe3-0a16-4dc5-8def-931fe1016405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1138283573b4ef5b6086d589dc1c342'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:39.224964 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2270/4565] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:02:38 2022] DELETE /identity/v3/users/d1138283573b4ef5b6086d589dc1c342 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:39.588888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5fc8-a0b5-419e-8e8c-07345cb7ab6e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:39.590843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5fc8-a0b5-419e-8e8c-07345cb7ab6e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:39.591302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5fc8-a0b5-419e-8e8c-07345cb7ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:39.654812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f36e5fc8-a0b5-419e-8e8c-07345cb7ab6e None None] MFA Rules not processed for user `5b13848e363e44b9927525ca9ca6fe81`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:39.656296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f36e5fc8-a0b5-419e-8e8c-07345cb7ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:39.855929 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2296/4566] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:39.867017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed659-925a-45e2-be84-fe030f65b725 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:39.867765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed659-925a-45e2-be84-fe030f65b725 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:39.868413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed659-925a-45e2-be84-fe030f65b725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:39.907053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ae6ed659-925a-45e2-be84-fe030f65b725 None None] MFA Rules not processed for user `5b13848e363e44b9927525ca9ca6fe81`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:39.909266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae6ed659-925a-45e2-be84-fe030f65b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:39.931149 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2271/4567] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:40.492587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e5fc8-a0b5-419e-8e8c-07345cb7ab6e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:40.494975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f36e5fc8-a0b5-419e-8e8c-07345cb7ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:40.671947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e5fc8-a0b5-419e-8e8c-07345cb7ab6e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:40.685528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774688f-26ae-4cdd-abd1-4da726298de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:40.686859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774688f-26ae-4cdd-abd1-4da726298de7 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:40.687382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774688f-26ae-4cdd-abd1-4da726298de7 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:40.687898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774688f-26ae-4cdd-abd1-4da726298de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:40.707839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774688f-26ae-4cdd-abd1-4da726298de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:40.711409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774688f-26ae-4cdd-abd1-4da726298de7 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:40.726263 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2297/4568] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:40.840921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed659-925a-45e2-be84-fe030f65b725 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:40.843056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae6ed659-925a-45e2-be84-fe030f65b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:40.954180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed659-925a-45e2-be84-fe030f65b725 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:40.962689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:40.964007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:40.964641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:40.965096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] PATH_INFO: `/v3/projects/6ea2a5563e7547cdbcb8034291d96f81` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:40.967105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea2a5563e7547cdbcb8034291d96f81)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:40.971120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:41.054535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea2a5563e7547cdbcb8034291d96f81', 'request_id': 'req-ef810be3-328f-4f2a-af57-547395a702fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:41.061618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea2a5563e7547cdbcb8034291d96f81', 'request_id': 'req-ef810be3-328f-4f2a-af57-547395a702fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:41.077604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea2a5563e7547cdbcb8034291d96f81', 'request_id': 'req-ef810be3-328f-4f2a-af57-547395a702fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:41.099967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] The token cache is being invalidate because project 6ea2a5563e7547cdbcb8034291d96f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:02:41.100595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:41.101941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ef810be3-328f-4f2a-af57-547395a702fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:41.104480 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2272/4569] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:40 2022] DELETE /identity/v3/projects/6ea2a5563e7547cdbcb8034291d96f81 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:41.110896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecceb-5989-455f-8339-e1f8eaef8841 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.111263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecceb-5989-455f-8339-e1f8eaef8841 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.111557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecceb-5989-455f-8339-e1f8eaef8841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:41.145682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e8aecceb-5989-455f-8339-e1f8eaef8841 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:41.147694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e8aecceb-5989-455f-8339-e1f8eaef8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:41.242729 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2298/4570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:41.254816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef71860-2b48-4be6-9a7e-de615846d6bc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.255317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef71860-2b48-4be6-9a7e-de615846d6bc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.256070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef71860-2b48-4be6-9a7e-de615846d6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:41.340159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fef71860-2b48-4be6-9a7e-de615846d6bc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:41.344136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fef71860-2b48-4be6-9a7e-de615846d6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:41.362253 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2273/4571] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:41.366454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aecceb-5989-455f-8339-e1f8eaef8841 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:41.381484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aecceb-5989-455f-8339-e1f8eaef8841 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:41.389198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:41.389894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.390167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.390641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:41.391766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:02:41.392241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:41.394821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:41.411484 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2299/4572] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:02:41.416480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef71860-2b48-4be6-9a7e-de615846d6bc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:41.439991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef71860-2b48-4be6-9a7e-de615846d6bc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:41.452813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c88b45-2851-4b9f-b007-e129592105e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:41.453675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c88b45-2851-4b9f-b007-e129592105e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.454371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c88b45-2851-4b9f-b007-e129592105e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.454506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c88b45-2851-4b9f-b007-e129592105e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:41.456295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c88b45-2851-4b9f-b007-e129592105e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:41.459807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c88b45-2851-4b9f-b007-e129592105e9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:41.517800 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2274/4573] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:02:41 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:41.519755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:41.534987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fa8a-4e67-479f-bb3a-95e0ebed60e9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:41.647313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33eef-357e-4aa3-bda6-859131f81c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:41.648419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33eef-357e-4aa3-bda6-859131f81c2b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.648908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33eef-357e-4aa3-bda6-859131f81c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.654377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33eef-357e-4aa3-bda6-859131f81c2b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:41.655365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33eef-357e-4aa3-bda6-859131f81c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:41.657498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33eef-357e-4aa3-bda6-859131f81c2b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:41.694180 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2300/4574] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:02:41 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:41.698352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c88b45-2851-4b9f-b007-e129592105e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:41.730996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c88b45-2851-4b9f-b007-e129592105e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:41.739256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1852ed-d94c-4b57-8c59-78333da59e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:41.739939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1852ed-d94c-4b57-8c59-78333da59e68 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.740217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1852ed-d94c-4b57-8c59-78333da59e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.740687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1852ed-d94c-4b57-8c59-78333da59e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:41.741818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1852ed-d94c-4b57-8c59-78333da59e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:41.744120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1852ed-d94c-4b57-8c59-78333da59e68 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:41.767081 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2275/4575] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:02:41.768280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33eef-357e-4aa3-bda6-859131f81c2b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:41.787100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33eef-357e-4aa3-bda6-859131f81c2b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:41.797403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0eaa-7b8d-4dfa-bb6f-e627b6e49a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:41.798389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0eaa-7b8d-4dfa-bb6f-e627b6e49a94 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.798885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0eaa-7b8d-4dfa-bb6f-e627b6e49a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.799351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0eaa-7b8d-4dfa-bb6f-e627b6e49a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:41.800297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0eaa-7b8d-4dfa-bb6f-e627b6e49a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:41.802382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0eaa-7b8d-4dfa-bb6f-e627b6e49a94 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:41.815959 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2301/4576] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:02:41.825563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1852ed-d94c-4b57-8c59-78333da59e68 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:41.842332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1852ed-d94c-4b57-8c59-78333da59e68 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:41.855093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc0eb-b41f-4cac-b5b7-c24ac50d39e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:41.857835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc0eb-b41f-4cac-b5b7-c24ac50d39e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.858135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc0eb-b41f-4cac-b5b7-c24ac50d39e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.858403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc0eb-b41f-4cac-b5b7-c24ac50d39e0 admin admin] PATH_INFO: `/v3/projects/dca190e2b34a4e1385bcad7a39532d1f/users/5e04000b207b44b08c7fda62f078ce64/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:41.883404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bc0eb-b41f-4cac-b5b7-c24ac50d39e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca190e2b34a4e1385bcad7a39532d1f, user_id=5e04000b207b44b08c7fda62f078ce64, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:41.890273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bc0eb-b41f-4cac-b5b7-c24ac50d39e0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:41.915024 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2276/4577] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:02:41 2022] PUT /identity/v3/projects/dca190e2b34a4e1385bcad7a39532d1f/users/5e04000b207b44b08c7fda62f078ce64/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:41.932097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ba44-5a22-4348-81a8-395aa17ed248 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:41.933270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ba44-5a22-4348-81a8-395aa17ed248 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:41.933852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ba44-5a22-4348-81a8-395aa17ed248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:42.003698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e377ba44-5a22-4348-81a8-395aa17ed248 None None] MFA Rules not processed for user `5e04000b207b44b08c7fda62f078ce64`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:42.005314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e377ba44-5a22-4348-81a8-395aa17ed248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:42.135543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc0eb-b41f-4cac-b5b7-c24ac50d39e0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:42.136117 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2302/4578] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:42.245473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc0eb-b41f-4cac-b5b7-c24ac50d39e0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:42.265510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5ee7f-9d02-40ab-8d4a-ec6dec36e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:42.266774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5ee7f-9d02-40ab-8d4a-ec6dec36e146 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:42.267584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5ee7f-9d02-40ab-8d4a-ec6dec36e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:42.268289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5ee7f-9d02-40ab-8d4a-ec6dec36e146 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:42.269484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5ee7f-9d02-40ab-8d4a-ec6dec36e146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:42.272312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5ee7f-9d02-40ab-8d4a-ec6dec36e146 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:42.316359 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2277/4579] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:02:42 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:42.321232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377ba44-5a22-4348-81a8-395aa17ed248 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:42.346567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377ba44-5a22-4348-81a8-395aa17ed248 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:42.532011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a8c1-1138-4b1b-a827-763c0c3e3ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:42.532736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a8c1-1138-4b1b-a827-763c0c3e3ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:42.533023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a8c1-1138-4b1b-a827-763c0c3e3ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:42.533808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a8c1-1138-4b1b-a827-763c0c3e3ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:42.534272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444a8c1-1138-4b1b-a827-763c0c3e3ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:42.536052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444a8c1-1138-4b1b-a827-763c0c3e3ca6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:42.588913 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2303/4580] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:02:42 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:42.593046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5ee7f-9d02-40ab-8d4a-ec6dec36e146 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:42.629714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5ee7f-9d02-40ab-8d4a-ec6dec36e146 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:42.645978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3ee2-7eab-4878-9fea-99423779c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:42.646715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3ee2-7eab-4878-9fea-99423779c904 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:42.646982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3ee2-7eab-4878-9fea-99423779c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:42.647254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3ee2-7eab-4878-9fea-99423779c904 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:42.648170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d3ee2-7eab-4878-9fea-99423779c904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:42.649834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d3ee2-7eab-4878-9fea-99423779c904 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:42.699458 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2278/4581] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:02:42.700857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a8c1-1138-4b1b-a827-763c0c3e3ca6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:42.713799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a8c1-1138-4b1b-a827-763c0c3e3ca6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:42.720765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664aeeff-3d68-4da0-bf2b-d1cc4a5f3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:42.721750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aeeff-3d68-4da0-bf2b-d1cc4a5f3c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:42.722384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aeeff-3d68-4da0-bf2b-d1cc4a5f3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:42.723410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aeeff-3d68-4da0-bf2b-d1cc4a5f3c8c admin admin] PATH_INFO: `/v3/projects/4734ba4f7b12417c96dc7434a7568a48/users/69cd7c5960104cdfadb35bc8ba667eca/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:42.765671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664aeeff-3d68-4da0-bf2b-d1cc4a5f3c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4734ba4f7b12417c96dc7434a7568a48, user_id=69cd7c5960104cdfadb35bc8ba667eca, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:42.769100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664aeeff-3d68-4da0-bf2b-d1cc4a5f3c8c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:42.793277 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2304/4582] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:02:42 2022] PUT /identity/v3/projects/4734ba4f7b12417c96dc7434a7568a48/users/69cd7c5960104cdfadb35bc8ba667eca/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:02:42.797368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3ee2-7eab-4878-9fea-99423779c904 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:42.815923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3ee2-7eab-4878-9fea-99423779c904 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:42.937656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b91ffd-50c8-452a-8c0b-8bb0bc04cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:42.939341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91ffd-50c8-452a-8c0b-8bb0bc04cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:42.939874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91ffd-50c8-452a-8c0b-8bb0bc04cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:42.940477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91ffd-50c8-452a-8c0b-8bb0bc04cf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:42.942508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b91ffd-50c8-452a-8c0b-8bb0bc04cf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:42.947596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b91ffd-50c8-452a-8c0b-8bb0bc04cf66 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:42.967372 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2279/4583] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:02:42.971946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664aeeff-3d68-4da0-bf2b-d1cc4a5f3c8c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:42.992821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664aeeff-3d68-4da0-bf2b-d1cc4a5f3c8c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:43.006362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e722-1224-4baf-a57c-e009bc335e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:43.012799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e722-1224-4baf-a57c-e009bc335e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:43.013085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e722-1224-4baf-a57c-e009bc335e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:43.013599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e722-1224-4baf-a57c-e009bc335e48 admin admin] PATH_INFO: `/v3/projects/4734ba4f7b12417c96dc7434a7568a48/users/69cd7c5960104cdfadb35bc8ba667eca/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:43.016848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e722-1224-4baf-a57c-e009bc335e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4734ba4f7b12417c96dc7434a7568a48, user_id=69cd7c5960104cdfadb35bc8ba667eca, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:43.021309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e722-1224-4baf-a57c-e009bc335e48 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:43.057854 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2305/4584] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:02:42 2022] PUT /identity/v3/projects/4734ba4f7b12417c96dc7434a7568a48/users/69cd7c5960104cdfadb35bc8ba667eca/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:43.070615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d350-e745-4aa9-aa56-d0e7da535384 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:43.070968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d350-e745-4aa9-aa56-d0e7da535384 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:43.071165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d350-e745-4aa9-aa56-d0e7da535384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:43.121641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8436d350-e745-4aa9-aa56-d0e7da535384 None None] MFA Rules not processed for user `69cd7c5960104cdfadb35bc8ba667eca`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:43.126636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8436d350-e745-4aa9-aa56-d0e7da535384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:43.217155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2280/4585] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:43.223052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e722-1224-4baf-a57c-e009bc335e48 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:43.244681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e722-1224-4baf-a57c-e009bc335e48 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:43.265269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69cd7c5960104cdfadb35bc8ba667eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4734ba4f7b12417c96dc7434a7568a48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:43.266708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:43.267069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:43.267742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:43.269632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:02:43.269928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:43.272620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:43.291111 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2306/4586] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:02:43.296100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d350-e745-4aa9-aa56-d0e7da535384 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:43.324504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d350-e745-4aa9-aa56-d0e7da535384 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:43.336824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69cd7c5960104cdfadb35bc8ba667eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4734ba4f7b12417c96dc7434a7568a48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:43.340740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:43.341268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:43.342625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:43.343941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:43.346740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:43.415173 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2281/4587] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:02:43 2022] POST /identity/v3/projects => generated 349 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:43.419899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:43.439331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d672f6-ce7d-43d2-ab5b-205a449ed01e tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:43.566320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69cd7c5960104cdfadb35bc8ba667eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4734ba4f7b12417c96dc7434a7568a48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:43.567267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:43.567715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:43.567898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:43.569291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:02:43.569873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:43.571419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:43.592464 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2307/4588] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:02:43.604040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:43.607234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:43.771153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093339-990d-4047-ba21-faa5871b4907 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:43.779072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f219c67-fd14-4503-a980-726768f242a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:43.779072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219c67-fd14-4503-a980-726768f242a3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:43.779503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219c67-fd14-4503-a980-726768f242a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:43.779720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219c67-fd14-4503-a980-726768f242a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:43.795325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f219c67-fd14-4503-a980-726768f242a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:43.797511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f219c67-fd14-4503-a980-726768f242a3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:43.836819 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2282/4589] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:49.531412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:49.609235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c6320-d529-4781-b881-d9f75828dcb8 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:49.609235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69cd7c5960104cdfadb35bc8ba667eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4734ba4f7b12417c96dc7434a7568a48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:49.609235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:49.609494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:49.609494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] PATH_INFO: `/v3/projects/434867c053464d71a0849ce15c12d97f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:49.611311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Authorizing `identity:delete_project(project_id=434867c053464d71a0849ce15c12d97f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:49.614103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:49.779056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434867c053464d71a0849ce15c12d97f', 'request_id': 'req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:49.789472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434867c053464d71a0849ce15c12d97f', 'request_id': 'req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:49.806384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434867c053464d71a0849ce15c12d97f', 'request_id': 'req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:49.822991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] The token cache is being invalidate because project 434867c053464d71a0849ce15c12d97f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:02:49.823369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:49.824188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f8edcd3-8456-42f8-9aa4-db91eace6cf7 tempest-QuotasNegativeTest-2086357187 tempest-QuotasNegativeTest-2086357187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:49.830816 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2308/4590] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:49 2022] DELETE /identity/v3/projects/434867c053464d71a0849ce15c12d97f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:49.831904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f219c67-fd14-4503-a980-726768f242a3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:50.014979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f219c67-fd14-4503-a980-726768f242a3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:50.315108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:50.320078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:50.321523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:50.322042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] PATH_INFO: `/v3/users/5e04000b207b44b08c7fda62f078ce64` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:50.329558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e04000b207b44b08c7fda62f078ce64)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:50.340614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:50.501367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e04000b207b44b08c7fda62f078ce64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:50.507269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e04000b207b44b08c7fda62f078ce64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:50.512617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e04000b207b44b08c7fda62f078ce64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:50.556090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e04000b207b44b08c7fda62f078ce64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:50.599873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e04000b207b44b08c7fda62f078ce64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:50.633841 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2283/4591] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:02:49 2022] DELETE /identity/v3/users/5e04000b207b44b08c7fda62f078ce64 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:50.638663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a503-54b5-45e7-9835-e5f8d7baee12 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:50.639213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a503-54b5-45e7-9835-e5f8d7baee12 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:50.639213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a503-54b5-45e7-9835-e5f8d7baee12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:50.673147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4259a503-54b5-45e7-9835-e5f8d7baee12 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:50.674690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4259a503-54b5-45e7-9835-e5f8d7baee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:50.925348 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2309/4592] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:50.938130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:50.939633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:51.038776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced7390-289c-42ec-a61b-47244e77c58f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:51.048369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd455e4-7fd2-4e33-b1cd-18afb8e50785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:51.049533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd455e4-7fd2-4e33-b1cd-18afb8e50785 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:51.049847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd455e4-7fd2-4e33-b1cd-18afb8e50785 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:51.050098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd455e4-7fd2-4e33-b1cd-18afb8e50785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:51.067284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd455e4-7fd2-4e33-b1cd-18afb8e50785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:51.069294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd455e4-7fd2-4e33-b1cd-18afb8e50785 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:51.080791 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2284/4593] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:51.542016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259a503-54b5-45e7-9835-e5f8d7baee12 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:51.544516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4259a503-54b5-45e7-9835-e5f8d7baee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:51.558098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259a503-54b5-45e7-9835-e5f8d7baee12 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:51.573570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:51.574735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:51.575106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:51.575331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] PATH_INFO: `/v3/projects/dca190e2b34a4e1385bcad7a39532d1f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:51.577585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca190e2b34a4e1385bcad7a39532d1f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:51.581805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:51.690273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca190e2b34a4e1385bcad7a39532d1f', 'request_id': 'req-6a019d02-1362-4706-9334-2b82f6918897'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:51.705256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca190e2b34a4e1385bcad7a39532d1f', 'request_id': 'req-6a019d02-1362-4706-9334-2b82f6918897'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:51.716998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca190e2b34a4e1385bcad7a39532d1f', 'request_id': 'req-6a019d02-1362-4706-9334-2b82f6918897'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:51.738857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] The token cache is being invalidate because project dca190e2b34a4e1385bcad7a39532d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:02:51.739595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:51.740476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6a019d02-1362-4706-9334-2b82f6918897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:51.743708 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2310/4594] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:51 2022] DELETE /identity/v3/projects/dca190e2b34a4e1385bcad7a39532d1f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:51.748133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd455e4-7fd2-4e33-b1cd-18afb8e50785 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:51.763302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd455e4-7fd2-4e33-b1cd-18afb8e50785 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:51.865894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:51.868798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:51.869337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:51.869662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] PATH_INFO: `/v3/users/69cd7c5960104cdfadb35bc8ba667eca` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:51.871350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cd7c5960104cdfadb35bc8ba667eca)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:51.875629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:51.963662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cd7c5960104cdfadb35bc8ba667eca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:51.967126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cd7c5960104cdfadb35bc8ba667eca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:51.967938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cd7c5960104cdfadb35bc8ba667eca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:51.988563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cd7c5960104cdfadb35bc8ba667eca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:52.017050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cd7c5960104cdfadb35bc8ba667eca'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:52.050638 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2285/4595] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:02:51 2022] DELETE /identity/v3/users/69cd7c5960104cdfadb35bc8ba667eca => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:52.235907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1bf1-e159-4dfb-9566-1aa1ab19e7db None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:52.236125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1bf1-e159-4dfb-9566-1aa1ab19e7db None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:52.236375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1bf1-e159-4dfb-9566-1aa1ab19e7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:52.287465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3bde1bf1-e159-4dfb-9566-1aa1ab19e7db None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:52.288935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3bde1bf1-e159-4dfb-9566-1aa1ab19e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:52.427774 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2311/4596] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:02:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:52.455824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:52.457299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:52.609964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde1bf1-e159-4dfb-9566-1aa1ab19e7db None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:52.612320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3bde1bf1-e159-4dfb-9566-1aa1ab19e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:52.618856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0c803-a5a4-4d1e-9eb0-05e93870b4f8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:52.629781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923c27-01f3-4f83-b537-2c331aa042f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:52.630650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923c27-01f3-4f83-b537-2c331aa042f6 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:52.631333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923c27-01f3-4f83-b537-2c331aa042f6 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:52.631491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923c27-01f3-4f83-b537-2c331aa042f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:52.651258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa923c27-01f3-4f83-b537-2c331aa042f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:52.653504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa923c27-01f3-4f83-b537-2c331aa042f6 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:52.670911 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2286/4597] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:02:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:52.826135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde1bf1-e159-4dfb-9566-1aa1ab19e7db None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:52.835470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:52.836937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:52.837397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:52.837750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] PATH_INFO: `/v3/projects/4734ba4f7b12417c96dc7434a7568a48` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:52.840196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4734ba4f7b12417c96dc7434a7568a48)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:52.845848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:52.958001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4734ba4f7b12417c96dc7434a7568a48', 'request_id': 'req-a6960072-0acd-4d60-88ff-02da0cb724c5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:52.973915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4734ba4f7b12417c96dc7434a7568a48', 'request_id': 'req-a6960072-0acd-4d60-88ff-02da0cb724c5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:52.988067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4734ba4f7b12417c96dc7434a7568a48', 'request_id': 'req-a6960072-0acd-4d60-88ff-02da0cb724c5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:53.013907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] The token cache is being invalidate because project 4734ba4f7b12417c96dc7434a7568a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:02:53.013907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:53.014629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6960072-0acd-4d60-88ff-02da0cb724c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:02:53.022486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c9c7-1985-4926-81e6-e746e5a117a8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.023120 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2312/4598] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:52 2022] DELETE /identity/v3/projects/4734ba4f7b12417c96dc7434a7568a48 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:02:53.023583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c9c7-1985-4926-81e6-e746e5a117a8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.023873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c9c7-1985-4926-81e6-e746e5a117a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.047987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1a41c9c7-1985-4926-81e6-e746e5a117a8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:53.049464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1a41c9c7-1985-4926-81e6-e746e5a117a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:53.183120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337917c-14c5-4d5d-bfc7-abea14bdd5f6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.183993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337917c-14c5-4d5d-bfc7-abea14bdd5f6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.184282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337917c-14c5-4d5d-bfc7-abea14bdd5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.189062 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2287/4599] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:02:53.208094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6337917c-14c5-4d5d-bfc7-abea14bdd5f6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:53.209391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6337917c-14c5-4d5d-bfc7-abea14bdd5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:53.218790 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2313/4600] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:53.223234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41c9c7-1985-4926-81e6-e746e5a117a8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:53.235196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41c9c7-1985-4926-81e6-e746e5a117a8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:53.240906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:53.241582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.241873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.242491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.242928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:02:53.243457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:53.245343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:53.263309 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2288/4601] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:02:53.264839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337917c-14c5-4d5d-bfc7-abea14bdd5f6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:53.276588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337917c-14c5-4d5d-bfc7-abea14bdd5f6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:53.282918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99cbb5-b62c-4b48-9aad-4820cd34a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:53.283685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99cbb5-b62c-4b48-9aad-4820cd34a25a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.284038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99cbb5-b62c-4b48-9aad-4820cd34a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.284488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99cbb5-b62c-4b48-9aad-4820cd34a25a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.285310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99cbb5-b62c-4b48-9aad-4820cd34a25a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:53.287474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99cbb5-b62c-4b48-9aad-4820cd34a25a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:53.318357 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2314/4602] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:02:53 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:53.322979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:53.334793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab2cb-ddde-4e91-a09f-24b447a00217 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:53.422892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da6cbb-a2f5-44d5-b539-c2c7259bb3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:53.423561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da6cbb-a2f5-44d5-b539-c2c7259bb3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.423817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da6cbb-a2f5-44d5-b539-c2c7259bb3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.424146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da6cbb-a2f5-44d5-b539-c2c7259bb3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.425294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da6cbb-a2f5-44d5-b539-c2c7259bb3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:53.428163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da6cbb-a2f5-44d5-b539-c2c7259bb3f7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:53.457826 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2289/4603] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:02:53 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:02:53.461639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99cbb5-b62c-4b48-9aad-4820cd34a25a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:53.476698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99cbb5-b62c-4b48-9aad-4820cd34a25a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:53.483896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf399-8ab1-433c-96d6-a8a89be7a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:53.484921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf399-8ab1-433c-96d6-a8a89be7a01e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.485481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf399-8ab1-433c-96d6-a8a89be7a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.486153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf399-8ab1-433c-96d6-a8a89be7a01e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.486872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bf399-8ab1-433c-96d6-a8a89be7a01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:53.488524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bf399-8ab1-433c-96d6-a8a89be7a01e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:53.508432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2315/4604] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:02:53.511677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da6cbb-a2f5-44d5-b539-c2c7259bb3f7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:53.525267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da6cbb-a2f5-44d5-b539-c2c7259bb3f7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:53.532053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795d0c5-1eab-48bd-99c4-1cde488dda99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:53.533382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d0c5-1eab-48bd-99c4-1cde488dda99 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.533997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d0c5-1eab-48bd-99c4-1cde488dda99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.534467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d0c5-1eab-48bd-99c4-1cde488dda99 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.535513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795d0c5-1eab-48bd-99c4-1cde488dda99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:53.537359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795d0c5-1eab-48bd-99c4-1cde488dda99 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:53.555827 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2290/4605] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:02:53.561104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf399-8ab1-433c-96d6-a8a89be7a01e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:53.574876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf399-8ab1-433c-96d6-a8a89be7a01e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:53.581681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:53.582715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.582993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.583265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] PATH_INFO: `/v3/projects/000c587782714bfe845d97c17cab4331/users/5441ab51e710490293543742a8e1f287/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.605630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000c587782714bfe845d97c17cab4331, user_id=5441ab51e710490293543742a8e1f287, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:53.608741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:53.630123 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2316/4606] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:02:53 2022] PUT /identity/v3/projects/000c587782714bfe845d97c17cab4331/users/5441ab51e710490293543742a8e1f287/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:02:53.641692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ff39-0dab-4514-8bdc-cb3e04dd92a1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.642290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ff39-0dab-4514-8bdc-cb3e04dd92a1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.642570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ff39-0dab-4514-8bdc-cb3e04dd92a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.679698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7087ff39-0dab-4514-8bdc-cb3e04dd92a1 None None] MFA Rules not processed for user `5441ab51e710490293543742a8e1f287`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:53.681584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7087ff39-0dab-4514-8bdc-cb3e04dd92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:53.825656 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2291/4607] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:53.841116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:53.844871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:53.945096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681c78f-3b0a-4ecb-aa42-8b82615cca45 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:53.949862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:53.950524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:53.950841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:53.951077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:53.963324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:53.965200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:53.977333 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2317/4608] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:02:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:02:54.693038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3794e-6ffb-4b30-8450-42ba6c1c0d5b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:54.696801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3794e-6ffb-4b30-8450-42ba6c1c0d5b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:54.698132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3794e-6ffb-4b30-8450-42ba6c1c0d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:54.735094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e0e3794e-6ffb-4b30-8450-42ba6c1c0d5b None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:54.736659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e0e3794e-6ffb-4b30-8450-42ba6c1c0d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:54.903152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:54.903783 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2292/4609] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:02:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:54.906687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:55.016212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899742f-b494-490f-96b7-9dc7b568d7b5 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:55.024454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c075-5d91-4bc4-8bb8-0c889e87c1ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:55.025437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c075-5d91-4bc4-8bb8-0c889e87c1ca service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:55.025989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c075-5d91-4bc4-8bb8-0c889e87c1ca service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:55.027862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c075-5d91-4bc4-8bb8-0c889e87c1ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:55.040774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713c075-5d91-4bc4-8bb8-0c889e87c1ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:55.042895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713c075-5d91-4bc4-8bb8-0c889e87c1ca service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:55.060570 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2318/4610] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:02:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:55.577513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8493fa6-bba2-4185-84f5-39ea41268db2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:55.577840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8493fa6-bba2-4185-84f5-39ea41268db2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:55.578153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8493fa6-bba2-4185-84f5-39ea41268db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:55.607637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a8493fa6-bba2-4185-84f5-39ea41268db2 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:02:55.609230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a8493fa6-bba2-4185-84f5-39ea41268db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:02:55.644925 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2293/4611] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:02:55.663591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c075-5d91-4bc4-8bb8-0c889e87c1ca service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:02:55.679939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c075-5d91-4bc4-8bb8-0c889e87c1ca service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:02:55.687448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626712c-d1be-44f7-86f5-065fe0aaaf6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:02:55.688702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626712c-d1be-44f7-86f5-065fe0aaaf6a service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:02:55.689430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626712c-d1be-44f7-86f5-065fe0aaaf6a service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:02:55.689914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626712c-d1be-44f7-86f5-065fe0aaaf6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:02:55.703776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626712c-d1be-44f7-86f5-065fe0aaaf6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:02:55.708580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626712c-d1be-44f7-86f5-065fe0aaaf6a service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:02:55.726148 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2319/4612] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:02:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:00.408092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bba1-dc27-4ec2-8cd2-36808081b874 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:00.408727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bba1-dc27-4ec2-8cd2-36808081b874 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:00.408727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bba1-dc27-4ec2-8cd2-36808081b874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:00.464588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3604bba1-dc27-4ec2-8cd2-36808081b874 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:00.473743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3604bba1-dc27-4ec2-8cd2-36808081b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:00.510051 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2294/4613] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:00.560309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626712c-d1be-44f7-86f5-065fe0aaaf6a service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:00.579497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626712c-d1be-44f7-86f5-065fe0aaaf6a service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:00.586678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617d9e4-2206-46f1-8fab-962f391aa22b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:00.587907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617d9e4-2206-46f1-8fab-962f391aa22b service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:00.588469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617d9e4-2206-46f1-8fab-962f391aa22b service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:00.588937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617d9e4-2206-46f1-8fab-962f391aa22b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:00.602757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617d9e4-2206-46f1-8fab-962f391aa22b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:00.606503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617d9e4-2206-46f1-8fab-962f391aa22b service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:00.630309 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2320/4614] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:03:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:01.232438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bba1-dc27-4ec2-8cd2-36808081b874 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:01.234426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3604bba1-dc27-4ec2-8cd2-36808081b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:01.419298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bba1-dc27-4ec2-8cd2-36808081b874 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:01.430401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:01.432460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:01.433020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:01.433479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] PATH_INFO: `/v3/users/e6e829f8edf3477dbc070d33ae8a6613` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:01.435949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e829f8edf3477dbc070d33ae8a6613)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:01.441746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:01.551117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e829f8edf3477dbc070d33ae8a6613'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:01.552668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e829f8edf3477dbc070d33ae8a6613'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:01.554347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e829f8edf3477dbc070d33ae8a6613'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:01.576540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e829f8edf3477dbc070d33ae8a6613'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:01.589742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-401d874f-1fd3-4bda-88f6-a60b381e2a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e829f8edf3477dbc070d33ae8a6613'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:01.658374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2295/4615] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:03:01 2022] DELETE /identity/v3/users/e6e829f8edf3477dbc070d33ae8a6613 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:02.664880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617d9e4-2206-46f1-8fab-962f391aa22b service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:02.686351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617d9e4-2206-46f1-8fab-962f391aa22b service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:02.875751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:02.878970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:02.879197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:02.879518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] PATH_INFO: `/v3/projects/c2c91d99923e44a9b49c306044837e9e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:02.881822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c91d99923e44a9b49c306044837e9e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:02.885101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:02.987037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c91d99923e44a9b49c306044837e9e', 'request_id': 'req-e2d8efda-7a16-4763-bb2f-3c31817029ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:03.011397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c91d99923e44a9b49c306044837e9e', 'request_id': 'req-e2d8efda-7a16-4763-bb2f-3c31817029ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:03.023789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c91d99923e44a9b49c306044837e9e', 'request_id': 'req-e2d8efda-7a16-4763-bb2f-3c31817029ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:03.045564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] The token cache is being invalidate because project c2c91d99923e44a9b49c306044837e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:03:03.045980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:03.047609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2d8efda-7a16-4763-bb2f-3c31817029ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:03.053850 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2321/4616] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:03:02 2022] DELETE /identity/v3/projects/c2c91d99923e44a9b49c306044837e9e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:03.060943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006af4-4afe-4be5-af5f-e5eb36fb1e26 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:03.061788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006af4-4afe-4be5-af5f-e5eb36fb1e26 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:03.061788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006af4-4afe-4be5-af5f-e5eb36fb1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:03.089791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-23006af4-4afe-4be5-af5f-e5eb36fb1e26 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:03.091382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-23006af4-4afe-4be5-af5f-e5eb36fb1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:03.164772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2296/4617] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:03.176145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969435db-7f41-4328-ab50-61d52ba118f5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:03.176688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969435db-7f41-4328-ab50-61d52ba118f5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:03.176782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969435db-7f41-4328-ab50-61d52ba118f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:03.279693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-969435db-7f41-4328-ab50-61d52ba118f5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:03.296309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-969435db-7f41-4328-ab50-61d52ba118f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:03.356671 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2322/4618] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:03.358339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23006af4-4afe-4be5-af5f-e5eb36fb1e26 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:03.375205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23006af4-4afe-4be5-af5f-e5eb36fb1e26 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:03.402244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:03.410433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:03.411251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:03.411791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:03.415382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:03:03.415988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:03.423456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:03.475340 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2297/4619] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:03:03.478826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969435db-7f41-4328-ab50-61d52ba118f5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:03.489624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969435db-7f41-4328-ab50-61d52ba118f5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:03.495200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e37989-11ca-4986-b0c7-71161ed5e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:03.495919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37989-11ca-4986-b0c7-71161ed5e3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:03.496192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37989-11ca-4986-b0c7-71161ed5e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:03.496633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37989-11ca-4986-b0c7-71161ed5e3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:03.497440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e37989-11ca-4986-b0c7-71161ed5e3a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:03.499762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e37989-11ca-4986-b0c7-71161ed5e3a8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:03.574238 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2323/4620] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:03:03 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:03.576496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:03.614070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfee75-8325-4c54-8930-5ca1eb571b50 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:03.793926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e2b51-cf69-4d97-be11-6108684ff5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:03.795091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2b51-cf69-4d97-be11-6108684ff5df admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:03.795538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2b51-cf69-4d97-be11-6108684ff5df admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:03.795963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2b51-cf69-4d97-be11-6108684ff5df admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:03.797023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e2b51-cf69-4d97-be11-6108684ff5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:03.799424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e2b51-cf69-4d97-be11-6108684ff5df admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:03.848287 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2298/4621] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:03:03 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:03.851038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e37989-11ca-4986-b0c7-71161ed5e3a8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:03.862481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e37989-11ca-4986-b0c7-71161ed5e3a8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:03.871256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30304aae-4aa9-44ce-9257-5711734ffbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:03.872991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304aae-4aa9-44ce-9257-5711734ffbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:03.874427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304aae-4aa9-44ce-9257-5711734ffbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:03.875089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304aae-4aa9-44ce-9257-5711734ffbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:03.876155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30304aae-4aa9-44ce-9257-5711734ffbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:03.878101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30304aae-4aa9-44ce-9257-5711734ffbf8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:03.899300 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2324/4622] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:03.903666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e2b51-cf69-4d97-be11-6108684ff5df admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:03.927092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e2b51-cf69-4d97-be11-6108684ff5df admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:03.932286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72c688-23c2-4d19-94c1-96ace996aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:03.933295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72c688-23c2-4d19-94c1-96ace996aaab admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:03.933646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72c688-23c2-4d19-94c1-96ace996aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:03.933932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72c688-23c2-4d19-94c1-96ace996aaab admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:03.934671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72c688-23c2-4d19-94c1-96ace996aaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:03.936430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72c688-23c2-4d19-94c1-96ace996aaab admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:03.971429 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2299/4623] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:03:03.974151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30304aae-4aa9-44ce-9257-5711734ffbf8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:03.993370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30304aae-4aa9-44ce-9257-5711734ffbf8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:04.007458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:04.008400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:04.008686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:04.008967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] PATH_INFO: `/v3/projects/61ad9ca9c0944ba68443aaa71a10eb19/users/a388edbf88ba4749b3abb2a42b750757/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:04.042436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ad9ca9c0944ba68443aaa71a10eb19, user_id=a388edbf88ba4749b3abb2a42b750757, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:04.045226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:04.082766 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2325/4624] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:03:03 2022] PUT /identity/v3/projects/61ad9ca9c0944ba68443aaa71a10eb19/users/a388edbf88ba4749b3abb2a42b750757/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:04.088168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660cab8-dcaf-492c-b7b0-9f5386283c81 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:04.088774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660cab8-dcaf-492c-b7b0-9f5386283c81 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:04.088774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660cab8-dcaf-492c-b7b0-9f5386283c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:04.129086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5660cab8-dcaf-492c-b7b0-9f5386283c81 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:04.132874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5660cab8-dcaf-492c-b7b0-9f5386283c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:04.342886 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2300/4625] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:04.493556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:04.495706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:04.648527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e178f-eb37-4d82-ba41-936b87761ee7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:04.668180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75905f26-2c4c-47b8-8138-f5d4c5004c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:04.669418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905f26-2c4c-47b8-8138-f5d4c5004c1b service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:04.669855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905f26-2c4c-47b8-8138-f5d4c5004c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:04.670015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905f26-2c4c-47b8-8138-f5d4c5004c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:04.713260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75905f26-2c4c-47b8-8138-f5d4c5004c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:04.715507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75905f26-2c4c-47b8-8138-f5d4c5004c1b service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:04.751320 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2326/4626] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:10.130999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660cab8-dcaf-492c-b7b0-9f5386283c81 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:10.134378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5660cab8-dcaf-492c-b7b0-9f5386283c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:10.197069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660cab8-dcaf-492c-b7b0-9f5386283c81 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:10.231645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:10.237237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:10.237557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:10.237972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] PATH_INFO: `/v3/users/5441ab51e710490293543742a8e1f287` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:10.244860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5441ab51e710490293543742a8e1f287)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:10.255035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:10.396717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5441ab51e710490293543742a8e1f287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:10.398650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5441ab51e710490293543742a8e1f287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:10.403694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5441ab51e710490293543742a8e1f287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:10.455418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5441ab51e710490293543742a8e1f287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:10.486571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5441ab51e710490293543742a8e1f287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:10.537117 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2301/4627] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:03:10 2022] DELETE /identity/v3/users/5441ab51e710490293543742a8e1f287 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:10.539980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b82-9723-471f-92e3-cbf07a3c1bf1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:10.540941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b82-9723-471f-92e3-cbf07a3c1bf1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:10.541464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b82-9723-471f-92e3-cbf07a3c1bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:10.605641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-49b93b82-9723-471f-92e3-cbf07a3c1bf1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:10.609003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-49b93b82-9723-471f-92e3-cbf07a3c1bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:10.758378 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2327/4628] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:10.798623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:10.800676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:11.065596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e5e8c-7af1-40c7-826d-d6d9d9082285 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:11.076781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:11.082176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:11.082609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:11.082998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:11.110852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:11.112577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:11.138624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2302/4629] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:11.253501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93b82-9723-471f-92e3-cbf07a3c1bf1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:11.256177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-49b93b82-9723-471f-92e3-cbf07a3c1bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:11.528532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93b82-9723-471f-92e3-cbf07a3c1bf1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:11.541093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca089362-d203-49b9-be71-366e3335dd08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:11.544667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089362-d203-49b9-be71-366e3335dd08 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:11.545481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089362-d203-49b9-be71-366e3335dd08 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:11.545940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089362-d203-49b9-be71-366e3335dd08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:11.552426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ca089362-d203-49b9-be71-366e3335dd08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:11.574577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089362-d203-49b9-be71-366e3335dd08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:11.576742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089362-d203-49b9-be71-366e3335dd08 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:11.600511 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2328/4630] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:12.966964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:12.968738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:12.996157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ef36e-4ae6-4cb0-bfcc-c1242dedc75f service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:13.016299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:13.021554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:13.024251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:13.029126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] PATH_INFO: `/v3/projects/000c587782714bfe845d97c17cab4331` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:13.035070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000c587782714bfe845d97c17cab4331)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:13.044818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:13.227570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000c587782714bfe845d97c17cab4331', 'request_id': 'req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:13.234349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000c587782714bfe845d97c17cab4331', 'request_id': 'req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:13.248391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000c587782714bfe845d97c17cab4331', 'request_id': 'req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:13.279373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] The token cache is being invalidate because project 000c587782714bfe845d97c17cab4331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:03:13.281126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:13.282078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2904b25f-955d-4ae5-ad04-0fcc2d8fc732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:13.285734 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2303/4631] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:03:12 2022] DELETE /identity/v3/projects/000c587782714bfe845d97c17cab4331 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:03:13.291137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb1181-4abf-495e-9d29-d76be29d0d41 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:13.292609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb1181-4abf-495e-9d29-d76be29d0d41 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:13.293084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb1181-4abf-495e-9d29-d76be29d0d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:13.332477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cadb1181-4abf-495e-9d29-d76be29d0d41 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:13.336077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cadb1181-4abf-495e-9d29-d76be29d0d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:13.528028 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2329/4632] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:13.544557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29023183-a0b2-4ce6-80fb-d9bf8300b205 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:13.545737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29023183-a0b2-4ce6-80fb-d9bf8300b205 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:13.546635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29023183-a0b2-4ce6-80fb-d9bf8300b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:13.612287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-29023183-a0b2-4ce6-80fb-d9bf8300b205 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:13.617498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-29023183-a0b2-4ce6-80fb-d9bf8300b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:13.642476 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2304/4633] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:13.646563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb1181-4abf-495e-9d29-d76be29d0d41 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:13.673504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb1181-4abf-495e-9d29-d76be29d0d41 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:13.686899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:13.691332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:13.691861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:13.694087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:13.696301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:03:13.696843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:13.700483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:13.742415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2330/4634] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:03:13.747234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29023183-a0b2-4ce6-80fb-d9bf8300b205 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:13.767931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29023183-a0b2-4ce6-80fb-d9bf8300b205 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:13.789524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d12a49-33f1-4b95-8796-35ab609f404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:13.790232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12a49-33f1-4b95-8796-35ab609f404c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:13.790512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12a49-33f1-4b95-8796-35ab609f404c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:13.795379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12a49-33f1-4b95-8796-35ab609f404c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:13.801913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d12a49-33f1-4b95-8796-35ab609f404c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:13.807862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d12a49-33f1-4b95-8796-35ab609f404c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:13.849330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:13.852567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:13.946338 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2305/4635] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:03:13 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:03:13.952492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d12a49-33f1-4b95-8796-35ab609f404c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:14.080461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e012f-4708-4ed0-b5f6-d2582aa2a757 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:14.240312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d12a49-33f1-4b95-8796-35ab609f404c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:14.263559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:14.263559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:14.263559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:14.263559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:14.264163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:14.278789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a58f6-7f49-481f-944c-773077938bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:14.279954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a58f6-7f49-481f-944c-773077938bea admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:14.280920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a58f6-7f49-481f-944c-773077938bea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:14.282162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a58f6-7f49-481f-944c-773077938bea admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:14.285171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a58f6-7f49-481f-944c-773077938bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:14.290473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a58f6-7f49-481f-944c-773077938bea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:14.313604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:14.317263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:14.347329 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2331/4636] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:03:14.443183 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2306/4637] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:03:13 2022] POST /identity/v3/users => generated 284 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:14.443434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:14.463796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4f781-e2e5-4484-a745-de061486f1dd service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:14.482844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb6f8-432b-49c5-82c2-e3f0203f1827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:14.484845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb6f8-432b-49c5-82c2-e3f0203f1827 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:14.485113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb6f8-432b-49c5-82c2-e3f0203f1827 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:14.485597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb6f8-432b-49c5-82c2-e3f0203f1827 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:14.486685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb6f8-432b-49c5-82c2-e3f0203f1827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:14.490883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb6f8-432b-49c5-82c2-e3f0203f1827 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:14.520323 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2332/4638] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:14.525180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a58f6-7f49-481f-944c-773077938bea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:14.580261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a58f6-7f49-481f-944c-773077938bea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:14.631196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b3e49-55e8-4823-a03a-b7def6116f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:14.631903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b3e49-55e8-4823-a03a-b7def6116f65 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:14.632703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b3e49-55e8-4823-a03a-b7def6116f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:14.632703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b3e49-55e8-4823-a03a-b7def6116f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:14.633174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b3e49-55e8-4823-a03a-b7def6116f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:14.634819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b3e49-55e8-4823-a03a-b7def6116f65 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:14.667431 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2307/4639] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:14.668399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb6f8-432b-49c5-82c2-e3f0203f1827 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:14.689512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb6f8-432b-49c5-82c2-e3f0203f1827 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:14.708458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:14.711316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:14.712064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:14.712801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] PATH_INFO: `/v3/projects/d4ad4a1daffa4cddbbf1e5aefea5a975/users/4aa9ffdd3b0344229f99fdb852aad379/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:14.755181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ad4a1daffa4cddbbf1e5aefea5a975, user_id=4aa9ffdd3b0344229f99fdb852aad379, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:14.763357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:14.795267 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2333/4640] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:03:14 2022] PUT /identity/v3/projects/d4ad4a1daffa4cddbbf1e5aefea5a975/users/4aa9ffdd3b0344229f99fdb852aad379/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:14.810780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3686088-9674-46c7-af56-8375ff6aad66 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:14.810780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3686088-9674-46c7-af56-8375ff6aad66 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:14.810780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3686088-9674-46c7-af56-8375ff6aad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:14.903000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c3686088-9674-46c7-af56-8375ff6aad66 None None] MFA Rules not processed for user `4aa9ffdd3b0344229f99fdb852aad379`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:14.911477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c3686088-9674-46c7-af56-8375ff6aad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:15.146786 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2308/4641] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:15.219540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:15.221442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:15.368795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4bd3-006f-42ff-8963-2d45b54a05ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:15.376060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ea91c-aed5-47d4-aa6e-67c87597a3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:15.377339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea91c-aed5-47d4-aa6e-67c87597a3bc service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:15.378068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea91c-aed5-47d4-aa6e-67c87597a3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:15.378562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea91c-aed5-47d4-aa6e-67c87597a3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:15.398629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ea91c-aed5-47d4-aa6e-67c87597a3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:15.401047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ea91c-aed5-47d4-aa6e-67c87597a3bc service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:15.416034 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2334/4642] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:17.343169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7068af2-50f0-4a95-94c2-c8fdfa65f8b4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:17.344200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7068af2-50f0-4a95-94c2-c8fdfa65f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:17.344882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7068af2-50f0-4a95-94c2-c8fdfa65f8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:17.402983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c7068af2-50f0-4a95-94c2-c8fdfa65f8b4 None None] MFA Rules not processed for user `fad7207822c04fc289709200d7e2bd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:17.419640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c7068af2-50f0-4a95-94c2-c8fdfa65f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:17.699197 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2309/4643] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:03:22.598001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1953c-e20f-49ea-8f80-0b57a602a413 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:22.599117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1953c-e20f-49ea-8f80-0b57a602a413 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:22.599863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1953c-e20f-49ea-8f80-0b57a602a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:22.693134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f2e1953c-e20f-49ea-8f80-0b57a602a413 None None] MFA Rules not processed for user `a388edbf88ba4749b3abb2a42b750757`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:22.695489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f2e1953c-e20f-49ea-8f80-0b57a602a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:22.782098 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2335/4644] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:24.813721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7068af2-50f0-4a95-94c2-c8fdfa65f8b4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:24.815454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c7068af2-50f0-4a95-94c2-c8fdfa65f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:25.036516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7068af2-50f0-4a95-94c2-c8fdfa65f8b4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:25.051573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d612f-fbcd-42dd-9e29-4fd15689ffb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:25.053216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d612f-fbcd-42dd-9e29-4fd15689ffb2 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:25.055424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d612f-fbcd-42dd-9e29-4fd15689ffb2 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:25.056117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d612f-fbcd-42dd-9e29-4fd15689ffb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:25.082926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d612f-fbcd-42dd-9e29-4fd15689ffb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:25.085248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d612f-fbcd-42dd-9e29-4fd15689ffb2 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:25.144414 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2310/4645] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:36.110733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc403e8-dbee-48ff-a917-6c08450008ea None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:36.111358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc403e8-dbee-48ff-a917-6c08450008ea None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:36.111358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc403e8-dbee-48ff-a917-6c08450008ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:36.127763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e9f5-9af2-46f0-a731-5f110208382f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:36.129481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e9f5-9af2-46f0-a731-5f110208382f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:36.131271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e9f5-9af2-46f0-a731-5f110208382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:36.160736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1dc403e8-dbee-48ff-a917-6c08450008ea None None] MFA Rules not processed for user `5b13848e363e44b9927525ca9ca6fe81`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:36.162702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1dc403e8-dbee-48ff-a917-6c08450008ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:36.204137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e062e9f5-9af2-46f0-a731-5f110208382f None None] MFA Rules not processed for user `a388edbf88ba4749b3abb2a42b750757`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:36.210049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e062e9f5-9af2-46f0-a731-5f110208382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:36.240270 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2311/4646] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:36.307950 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2336/4647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:45.321201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a529-ac36-495b-8ddd-0b2d6c371dd2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:45.321948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a529-ac36-495b-8ddd-0b2d6c371dd2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:45.321948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a529-ac36-495b-8ddd-0b2d6c371dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:45.366877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c875a529-ac36-495b-8ddd-0b2d6c371dd2 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:45.368542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c875a529-ac36-495b-8ddd-0b2d6c371dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:45.493996 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2312/4648] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:45.511018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc403e8-dbee-48ff-a917-6c08450008ea None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:45.515232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1dc403e8-dbee-48ff-a917-6c08450008ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:45.652004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc403e8-dbee-48ff-a917-6c08450008ea None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:45.659379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea7acb-786a-4043-917e-8824454a421e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:45.661233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7acb-786a-4043-917e-8824454a421e service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:45.661866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7acb-786a-4043-917e-8824454a421e service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:45.662317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7acb-786a-4043-917e-8824454a421e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:45.680795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea7acb-786a-4043-917e-8824454a421e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:45.683663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea7acb-786a-4043-917e-8824454a421e service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:45.699402 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2337/4649] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:03:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:48.716146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875a529-ac36-495b-8ddd-0b2d6c371dd2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:48.719120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c875a529-ac36-495b-8ddd-0b2d6c371dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:48.860704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875a529-ac36-495b-8ddd-0b2d6c371dd2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:48.873516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:48.874646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:48.875107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:48.875537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] PATH_INFO: `/v3/users/71f534f513ef45d29629b913de461f23` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:48.880587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f534f513ef45d29629b913de461f23)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:48.882940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:48.956032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f534f513ef45d29629b913de461f23'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:48.956793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f534f513ef45d29629b913de461f23'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:48.957601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f534f513ef45d29629b913de461f23'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:48.971733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f534f513ef45d29629b913de461f23'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:48.981127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f534f513ef45d29629b913de461f23'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:49.023084 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2313/4650] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:03:48 2022] DELETE /identity/v3/users/71f534f513ef45d29629b913de461f23 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:50.065296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea7acb-786a-4043-917e-8824454a421e service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:50.096163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea7acb-786a-4043-917e-8824454a421e service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:50.100794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:50.103090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:50.267081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c6ce2-c1e3-4267-8ea5-caea1a9c2ef9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:50.281466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:50.282357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:50.282632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:50.283113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] PATH_INFO: `/v3/users/bb812b1b093045b1aaa3ce9e3334ff4d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:50.284784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb812b1b093045b1aaa3ce9e3334ff4d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:50.287144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:50.289612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:50.291041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:50.293645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:50.294166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] PATH_INFO: `/v3/projects/0a67095fabac457da3239e727c92e4ab` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:50.298098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a67095fabac457da3239e727c92e4ab)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:50.300320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:50.435894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a67095fabac457da3239e727c92e4ab', 'request_id': 'req-90628016-3f63-43ea-b67b-7877f9ea2993'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.439963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb812b1b093045b1aaa3ce9e3334ff4d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.440830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb812b1b093045b1aaa3ce9e3334ff4d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.441606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb812b1b093045b1aaa3ce9e3334ff4d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.455650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb812b1b093045b1aaa3ce9e3334ff4d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.459368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a67095fabac457da3239e727c92e4ab', 'request_id': 'req-90628016-3f63-43ea-b67b-7877f9ea2993'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.469879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a9b3f2cd-540d-45ad-a8f5-d0227c6a43df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb812b1b093045b1aaa3ce9e3334ff4d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.482863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a67095fabac457da3239e727c92e4ab', 'request_id': 'req-90628016-3f63-43ea-b67b-7877f9ea2993'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.507859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2314/4651] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:03:50 2022] DELETE /identity/v3/users/bb812b1b093045b1aaa3ce9e3334ff4d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:50.515280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] The token cache is being invalidate because project 0a67095fabac457da3239e727c92e4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:03:50.515578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.516252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-90628016-3f63-43ea-b67b-7877f9ea2993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:50.518024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2338/4652] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:03:50 2022] DELETE /identity/v3/projects/0a67095fabac457da3239e727c92e4ab => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:50.523400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935ae56-3864-4385-9e3e-d9f2d26076ef None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:50.524178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935ae56-3864-4385-9e3e-d9f2d26076ef None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:50.524529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935ae56-3864-4385-9e3e-d9f2d26076ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:50.551117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7935ae56-3864-4385-9e3e-d9f2d26076ef None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:50.552462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7935ae56-3864-4385-9e3e-d9f2d26076ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:50.626584 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2315/4653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:50.634257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32049dcc-44fb-42fc-9a18-84102582f2ef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:50.634551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32049dcc-44fb-42fc-9a18-84102582f2ef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:50.634835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32049dcc-44fb-42fc-9a18-84102582f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:50.657241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-32049dcc-44fb-42fc-9a18-84102582f2ef None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:50.659338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-32049dcc-44fb-42fc-9a18-84102582f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:50.681236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935ae56-3864-4385-9e3e-d9f2d26076ef None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:50.693261 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2339/4654] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:50.700782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935ae56-3864-4385-9e3e-d9f2d26076ef None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:50.713156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:50.717968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:50.718277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:50.718565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:50.719319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:03:50.719638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:50.721323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:50.750992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32049dcc-44fb-42fc-9a18-84102582f2ef None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:50.764690 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2316/4655] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:03:50.769572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32049dcc-44fb-42fc-9a18-84102582f2ef None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:50.778849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc944b-28a5-4013-b2ea-eb85ce00eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:50.779855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc944b-28a5-4013-b2ea-eb85ce00eb07 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:50.780455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc944b-28a5-4013-b2ea-eb85ce00eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:50.781302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc944b-28a5-4013-b2ea-eb85ce00eb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:50.782251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc944b-28a5-4013-b2ea-eb85ce00eb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:50.784585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc944b-28a5-4013-b2ea-eb85ce00eb07 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:50.837173 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2340/4656] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:03:50 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:50.841905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:50.864166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b847437-58b9-44a7-8af2-df769c32d338 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:50.995765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2f70-d4fa-4083-9f1b-31c609bd52fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:50.996762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2f70-d4fa-4083-9f1b-31c609bd52fe admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:50.997053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2f70-d4fa-4083-9f1b-31c609bd52fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:50.997520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2f70-d4fa-4083-9f1b-31c609bd52fe admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:50.998283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2f70-d4fa-4083-9f1b-31c609bd52fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:51.000597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2f70-d4fa-4083-9f1b-31c609bd52fe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:51.033376 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2317/4657] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:03:50 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:51.036374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc944b-28a5-4013-b2ea-eb85ce00eb07 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:51.049871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc944b-28a5-4013-b2ea-eb85ce00eb07 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:51.056271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291792-b1d5-40e3-8131-13c4be0ff962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:51.057954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291792-b1d5-40e3-8131-13c4be0ff962 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:51.057954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291792-b1d5-40e3-8131-13c4be0ff962 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:51.058368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291792-b1d5-40e3-8131-13c4be0ff962 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:51.059162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f291792-b1d5-40e3-8131-13c4be0ff962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:51.061014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f291792-b1d5-40e3-8131-13c4be0ff962 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:51.079072 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2341/4658] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:51.080405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2f70-d4fa-4083-9f1b-31c609bd52fe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:51.094501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2f70-d4fa-4083-9f1b-31c609bd52fe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:51.103422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f110e8-d6f0-439f-b31d-80a6eec782f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:51.104585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f110e8-d6f0-439f-b31d-80a6eec782f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:51.105359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f110e8-d6f0-439f-b31d-80a6eec782f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:51.106433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f110e8-d6f0-439f-b31d-80a6eec782f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:51.108241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f110e8-d6f0-439f-b31d-80a6eec782f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:51.112303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f110e8-d6f0-439f-b31d-80a6eec782f4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:51.129251 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2318/4659] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:51.133301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291792-b1d5-40e3-8131-13c4be0ff962 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:51.153810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291792-b1d5-40e3-8131-13c4be0ff962 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:51.161351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:51.162424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:51.162801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:51.163202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] PATH_INFO: `/v3/projects/3a8136be2d0a4abb81e8038390855add/users/88188e2c8b6043c0a884ebc8f2663bee/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:51.186596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8136be2d0a4abb81e8038390855add, user_id=88188e2c8b6043c0a884ebc8f2663bee, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:51.191408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:51.217132 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2342/4660] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:03:51 2022] PUT /identity/v3/projects/3a8136be2d0a4abb81e8038390855add/users/88188e2c8b6043c0a884ebc8f2663bee/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:03:51.219806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae2e7-d043-4f6a-a435-a50640c0d511 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:51.227502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae2e7-d043-4f6a-a435-a50640c0d511 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:51.227785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ae2e7-d043-4f6a-a435-a50640c0d511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:51.300320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f33ae2e7-d043-4f6a-a435-a50640c0d511 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:51.303708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f33ae2e7-d043-4f6a-a435-a50640c0d511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:51.447254 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2319/4661] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:51.471879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:51.477612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:51.616274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ae2e7-d043-4f6a-a435-a50640c0d511 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:51.619128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f33ae2e7-d043-4f6a-a435-a50640c0d511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:51.628709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd3909-c9fb-464c-a2eb-2669b2f6fa48 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:51.634315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d9cef-6e2e-4b51-98f9-5f999cf4dac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:51.635908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9cef-6e2e-4b51-98f9-5f999cf4dac3 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:51.636389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9cef-6e2e-4b51-98f9-5f999cf4dac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:51.636852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9cef-6e2e-4b51-98f9-5f999cf4dac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:51.646648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ae2e7-d043-4f6a-a435-a50640c0d511 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:51.650323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:51.651757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:51.652635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:51.653087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] PATH_INFO: `/v3/projects/c3e2bd0a55e44ee2802a7b95678c9d60` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:51.654925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e2bd0a55e44ee2802a7b95678c9d60)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:51.657611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d9cef-6e2e-4b51-98f9-5f999cf4dac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:51.658453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:51.659400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d9cef-6e2e-4b51-98f9-5f999cf4dac3 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:51.686432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2343/4662] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:51.765729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'request_id': 'req-0b377e1d-e2fa-4730-bcf5-da5327175883'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:51.773591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'request_id': 'req-0b377e1d-e2fa-4730-bcf5-da5327175883'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:51.785743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'request_id': 'req-0b377e1d-e2fa-4730-bcf5-da5327175883'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:51.806281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] The token cache is being invalidate because project c3e2bd0a55e44ee2802a7b95678c9d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:03:51.806625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:51.808092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0b377e1d-e2fa-4730-bcf5-da5327175883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:51.814563 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2320/4663] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:03:51 2022] DELETE /identity/v3/projects/c3e2bd0a55e44ee2802a7b95678c9d60 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:51.819258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a2f01-da3c-407f-ab33-d3e39e158f72 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:51.819558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a2f01-da3c-407f-ab33-d3e39e158f72 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:51.819846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a2f01-da3c-407f-ab33-d3e39e158f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:51.845850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f85a2f01-da3c-407f-ab33-d3e39e158f72 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:51.848117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f85a2f01-da3c-407f-ab33-d3e39e158f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:51.944115 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2344/4664] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:51.951658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa1574-8a08-47b4-b360-71235a170a37 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:51.952288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa1574-8a08-47b4-b360-71235a170a37 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:51.952821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa1574-8a08-47b4-b360-71235a170a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:51.978792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-43fa1574-8a08-47b4-b360-71235a170a37 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:51.980685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-43fa1574-8a08-47b4-b360-71235a170a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:51.994112 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2321/4665] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:51.999708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a2f01-da3c-407f-ab33-d3e39e158f72 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:52.018520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a2f01-da3c-407f-ab33-d3e39e158f72 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:52.036680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:52.037401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.037736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.038318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.039014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:03:52.040416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:52.043126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:52.058170 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2345/4666] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:03:52.062348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa1574-8a08-47b4-b360-71235a170a37 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:52.077539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa1574-8a08-47b4-b360-71235a170a37 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:52.085135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:52.086270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.086768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.087868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.090833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:52.093743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:52.144134 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2322/4667] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:03:52 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:52.148250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:52.164889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836f89-cabc-453a-90f2-deabb9df9548 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:52.216199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:52.218279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:52.326667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f08c3-b618-4c07-8017-fde936f88855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:52.327763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f08c3-b618-4c07-8017-fde936f88855 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.331828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f08c3-b618-4c07-8017-fde936f88855 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.332567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f08c3-b618-4c07-8017-fde936f88855 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.333526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f08c3-b618-4c07-8017-fde936f88855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:52.335998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f08c3-b618-4c07-8017-fde936f88855 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:52.388447 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2346/4668] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:03:52 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:52.390385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f08c3-b618-4c07-8017-fde936f88855 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:52.422187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a44a8-fea5-4971-aa37-1ed3d2053efa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:52.434904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:52.435806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.436096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.436383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] PATH_INFO: `/v3/users/a36b20fc4b8b4b71aea23626d52cefa9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.439473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36b20fc4b8b4b71aea23626d52cefa9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:52.440933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f08c3-b618-4c07-8017-fde936f88855 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:52.445470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:52.454630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6aad1-8b9a-42cd-999c-2d8d777f21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:52.455339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6aad1-8b9a-42cd-999c-2d8d777f21f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.455625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6aad1-8b9a-42cd-999c-2d8d777f21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.455905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6aad1-8b9a-42cd-999c-2d8d777f21f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.456852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6aad1-8b9a-42cd-999c-2d8d777f21f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:52.458630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6aad1-8b9a-42cd-999c-2d8d777f21f4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:52.486630 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2347/4669] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:52.492345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6aad1-8b9a-42cd-999c-2d8d777f21f4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:52.521971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6aad1-8b9a-42cd-999c-2d8d777f21f4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:52.545500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:52.546088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.546451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.546701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.547440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:52.549118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:52.560374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36b20fc4b8b4b71aea23626d52cefa9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:52.562467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36b20fc4b8b4b71aea23626d52cefa9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:52.563152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36b20fc4b8b4b71aea23626d52cefa9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:52.574215 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2348/4670] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:52.578212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:52.580994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:52.599607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36b20fc4b8b4b71aea23626d52cefa9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:52.608990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cb0b7-d47d-4e04-a550-7e5dd7f93b8d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:52.614746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bdee5154-8c9a-42be-a348-32561ad8d28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36b20fc4b8b4b71aea23626d52cefa9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:52.627277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:52.629204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.629676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.630611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] PATH_INFO: `/v3/projects/ba9b396737a34280bdc448a2b0df5a7e/users/0edf621841d44514b6082172d15af2a7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.649758 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2323/4671] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:03:52 2022] DELETE /identity/v3/users/a36b20fc4b8b4b71aea23626d52cefa9 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:52.659924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9b396737a34280bdc448a2b0df5a7e, user_id=0edf621841d44514b6082172d15af2a7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:52.662874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:52.702221 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2349/4672] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:03:52 2022] PUT /identity/v3/projects/ba9b396737a34280bdc448a2b0df5a7e/users/0edf621841d44514b6082172d15af2a7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:52.710725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec167-7d3b-48b4-98ca-68411522e517 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.711462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec167-7d3b-48b4-98ca-68411522e517 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.711881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec167-7d3b-48b4-98ca-68411522e517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.752395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-975ec167-7d3b-48b4-98ca-68411522e517 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:52.755047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-975ec167-7d3b-48b4-98ca-68411522e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:52.852528 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2324/4673] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:52.879768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:52.881669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:52.968148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b5e5d-c8ce-43b6-9536-dc1553ad15ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:52.973717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6edded-1f70-419b-afa8-a001f2e302ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:52.974722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6edded-1f70-419b-afa8-a001f2e302ba service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:52.975199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6edded-1f70-419b-afa8-a001f2e302ba service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:52.975855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6edded-1f70-419b-afa8-a001f2e302ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:52.989517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6edded-1f70-419b-afa8-a001f2e302ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:52.993110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6edded-1f70-419b-afa8-a001f2e302ba service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:53.013021 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2350/4674] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:53.387089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ec167-7d3b-48b4-98ca-68411522e517 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:53.392521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-975ec167-7d3b-48b4-98ca-68411522e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:53.420647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ec167-7d3b-48b4-98ca-68411522e517 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:53.430263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:53.431480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:53.431874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:53.432883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] PATH_INFO: `/v3/projects/4aca9e397c334bb997f450e919088286` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:53.435148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aca9e397c334bb997f450e919088286)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:53.438160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:53.530687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aca9e397c334bb997f450e919088286', 'request_id': 'req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:53.545062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aca9e397c334bb997f450e919088286', 'request_id': 'req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:53.556417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aca9e397c334bb997f450e919088286', 'request_id': 'req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:53.570312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] The token cache is being invalidate because project 4aca9e397c334bb997f450e919088286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:03:53.570860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:53.571696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6c7dd18-98db-4cde-ab4d-27dbe37a7458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:53.573856 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2325/4675] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:03:53 2022] DELETE /identity/v3/projects/4aca9e397c334bb997f450e919088286 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:53.579048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba90c1-7766-415d-8f58-b0083776e23b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:53.580317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba90c1-7766-415d-8f58-b0083776e23b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:53.580792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba90c1-7766-415d-8f58-b0083776e23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:53.621512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f2ba90c1-7766-415d-8f58-b0083776e23b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:53.622759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f2ba90c1-7766-415d-8f58-b0083776e23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:53.735979 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2351/4676] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:53.745496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f672-ae53-416b-baa6-5e6eeb2717e1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:53.745951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f672-ae53-416b-baa6-5e6eeb2717e1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:53.746382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f672-ae53-416b-baa6-5e6eeb2717e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:53.771233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bc27f672-ae53-416b-baa6-5e6eeb2717e1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:53.772615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bc27f672-ae53-416b-baa6-5e6eeb2717e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:53.786283 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2326/4677] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:53.787299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba90c1-7766-415d-8f58-b0083776e23b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:53.809369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba90c1-7766-415d-8f58-b0083776e23b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:53.826980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:53.830443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:53.831000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:53.832204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:53.833494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:03:53.836217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:53.840252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:53.892678 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2352/4678] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:03:53.894380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f672-ae53-416b-baa6-5e6eeb2717e1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:53.907905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f672-ae53-416b-baa6-5e6eeb2717e1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:53.928586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a719-0a2a-4d71-8918-a265be846fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:53.929290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a719-0a2a-4d71-8918-a265be846fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:53.929580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a719-0a2a-4d71-8918-a265be846fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:53.929866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a719-0a2a-4d71-8918-a265be846fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:53.930581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03a719-0a2a-4d71-8918-a265be846fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:53.933389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03a719-0a2a-4d71-8918-a265be846fb8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:53.993112 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2327/4679] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:03:53 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:53.997762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:54.024440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b88ef-8528-4243-9000-151e77a2a70b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:54.207465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e768af-8a18-4c67-875c-977b28569658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:54.208159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e768af-8a18-4c67-875c-977b28569658 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:54.208483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e768af-8a18-4c67-875c-977b28569658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:54.208768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e768af-8a18-4c67-875c-977b28569658 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:54.209904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e768af-8a18-4c67-875c-977b28569658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:54.212142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e768af-8a18-4c67-875c-977b28569658 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:54.244465 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2353/4680] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:03:53 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:54.245896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a719-0a2a-4d71-8918-a265be846fb8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:54.272478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a719-0a2a-4d71-8918-a265be846fb8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:54.283085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a49f6c-e1f2-4241-9b37-7761718d09b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:54.284283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a49f6c-e1f2-4241-9b37-7761718d09b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:54.284609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a49f6c-e1f2-4241-9b37-7761718d09b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:54.284884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a49f6c-e1f2-4241-9b37-7761718d09b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:54.286520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a49f6c-e1f2-4241-9b37-7761718d09b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:54.287231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a49f6c-e1f2-4241-9b37-7761718d09b5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:54.305554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2328/4681] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:03:54.307008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e768af-8a18-4c67-875c-977b28569658 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:54.321962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e768af-8a18-4c67-875c-977b28569658 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:54.336423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca96701-a295-4875-a88a-8cbabad1a554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:54.337303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96701-a295-4875-a88a-8cbabad1a554 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:54.337778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96701-a295-4875-a88a-8cbabad1a554 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:54.338256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96701-a295-4875-a88a-8cbabad1a554 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:54.341368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca96701-a295-4875-a88a-8cbabad1a554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:54.343511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca96701-a295-4875-a88a-8cbabad1a554 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:54.374596 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2354/4682] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:54.374903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a49f6c-e1f2-4241-9b37-7761718d09b5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:54.388501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a49f6c-e1f2-4241-9b37-7761718d09b5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:54.396906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:54.398270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:54.399268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:54.399822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] PATH_INFO: `/v3/projects/6e59ada015584cc6b980ae55cedc2103/users/59ce7bfa9c454b3389ec787812495827/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:54.424019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e59ada015584cc6b980ae55cedc2103, user_id=59ce7bfa9c454b3389ec787812495827, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:54.427197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:54.468754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdabe-58d0-4a40-b549-8d445f394295 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:54.470705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdabe-58d0-4a40-b549-8d445f394295 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:54.471202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdabe-58d0-4a40-b549-8d445f394295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:54.478357 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2329/4683] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:03:54 2022] PUT /identity/v3/projects/6e59ada015584cc6b980ae55cedc2103/users/59ce7bfa9c454b3389ec787812495827/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:03:54.505388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-56ffdabe-58d0-4a40-b549-8d445f394295 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:54.507097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-56ffdabe-58d0-4a40-b549-8d445f394295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:54.612453 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2355/4684] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:54.668384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:54.671285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:54.784862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781541fd-ad24-43fb-a243-01ab44c07149 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:54.790974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a104d-f739-4ebc-bf78-8e1bb7c3a19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:54.792465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a104d-f739-4ebc-bf78-8e1bb7c3a19b service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:54.792935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a104d-f739-4ebc-bf78-8e1bb7c3a19b service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:54.793371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a104d-f739-4ebc-bf78-8e1bb7c3a19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:54.808846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a104d-f739-4ebc-bf78-8e1bb7c3a19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:54.811690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a104d-f739-4ebc-bf78-8e1bb7c3a19b service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:54.831107 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2330/4685] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:55.084576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34065-e124-4feb-9bac-6fb508d8bdb4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:55.085228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34065-e124-4feb-9bac-6fb508d8bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:55.085834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34065-e124-4feb-9bac-6fb508d8bdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:55.170784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-45e34065-e124-4feb-9bac-6fb508d8bdb4 None None] MFA Rules not processed for user `88188e2c8b6043c0a884ebc8f2663bee`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:55.172368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-45e34065-e124-4feb-9bac-6fb508d8bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:55.380371 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2356/4686] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:55.396611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e2553-192b-4b96-91c4-18164f1e86b1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:55.397666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e2553-192b-4b96-91c4-18164f1e86b1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:55.398338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e2553-192b-4b96-91c4-18164f1e86b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:55.427544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-273e2553-192b-4b96-91c4-18164f1e86b1 None None] MFA Rules not processed for user `88188e2c8b6043c0a884ebc8f2663bee`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:55.429180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-273e2553-192b-4b96-91c4-18164f1e86b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:55.440128 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2331/4687] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:55.451526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34065-e124-4feb-9bac-6fb508d8bdb4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:55.453507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-45e34065-e124-4feb-9bac-6fb508d8bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:55.567470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34065-e124-4feb-9bac-6fb508d8bdb4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:55.573979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:55.575324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:55.575324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:55.575543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:55.585625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:55.587401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:55.599726 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2357/4688] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:56.215303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c89b5-f815-4b27-ac5c-2e0e1b5ca11a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:56.215761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c89b5-f815-4b27-ac5c-2e0e1b5ca11a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:56.216107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c89b5-f815-4b27-ac5c-2e0e1b5ca11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:56.250872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eb8c89b5-f815-4b27-ac5c-2e0e1b5ca11a None None] MFA Rules not processed for user `0edf621841d44514b6082172d15af2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:56.253193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb8c89b5-f815-4b27-ac5c-2e0e1b5ca11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:56.350957 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2332/4689] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:56.359515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:56.361480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:56.523719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046cc3f-6fc2-48e8-b6f5-2a9aa3857864 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:56.545960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cf238-7888-445a-af54-65ce59c50546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:56.546856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cf238-7888-445a-af54-65ce59c50546 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:56.547304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cf238-7888-445a-af54-65ce59c50546 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:56.548274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cf238-7888-445a-af54-65ce59c50546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:56.597086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cf238-7888-445a-af54-65ce59c50546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:56.602225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cf238-7888-445a-af54-65ce59c50546 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:56.672229 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2358/4690] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:03:57.767154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c89b5-f815-4b27-ac5c-2e0e1b5ca11a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:57.769977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb8c89b5-f815-4b27-ac5c-2e0e1b5ca11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:57.808483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c89b5-f815-4b27-ac5c-2e0e1b5ca11a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:57.818909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:57.819820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:57.821213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:57.821466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] PATH_INFO: `/v3/users/0f073c8403c445029976989a1848060f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:57.823443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f073c8403c445029976989a1848060f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:57.825942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:57.895107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f073c8403c445029976989a1848060f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:57.896314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f073c8403c445029976989a1848060f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:57.897297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f073c8403c445029976989a1848060f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:57.922455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f073c8403c445029976989a1848060f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:57.945163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8531fcd4-e408-48fd-ac4d-e08cd310972b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f073c8403c445029976989a1848060f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:57.978276 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2333/4691] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:03:57 2022] DELETE /identity/v3/users/0f073c8403c445029976989a1848060f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:58.266265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cf238-7888-445a-af54-65ce59c50546 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:58.289217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cf238-7888-445a-af54-65ce59c50546 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:58.393998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:58.395685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:58.396194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:58.396908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] PATH_INFO: `/v3/projects/c03769052a6d4b21ad5a0dc4ce5e15fd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:58.398795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03769052a6d4b21ad5a0dc4ce5e15fd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:58.405197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:58.507472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'request_id': 'req-b66f35a9-b2c8-4c03-b802-e34494f345b2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:58.526829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'request_id': 'req-b66f35a9-b2c8-4c03-b802-e34494f345b2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:58.540561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'request_id': 'req-b66f35a9-b2c8-4c03-b802-e34494f345b2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:58.555817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] The token cache is being invalidate because project c03769052a6d4b21ad5a0dc4ce5e15fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:03:58.556262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:58.558046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b66f35a9-b2c8-4c03-b802-e34494f345b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:03:58.560086 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2359/4692] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:03:58 2022] DELETE /identity/v3/projects/c03769052a6d4b21ad5a0dc4ce5e15fd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:03:58.565225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6adf99-83e8-417c-8f61-602841fe4362 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:58.565517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6adf99-83e8-417c-8f61-602841fe4362 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:58.566311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6adf99-83e8-417c-8f61-602841fe4362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:58.589245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-be6adf99-83e8-417c-8f61-602841fe4362 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:58.591421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-be6adf99-83e8-417c-8f61-602841fe4362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:58.767105 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2334/4693] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:58.775660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739edf0-a253-4714-a5a5-03467299fd0b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:58.776012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739edf0-a253-4714-a5a5-03467299fd0b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:58.776228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739edf0-a253-4714-a5a5-03467299fd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:58.810905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a739edf0-a253-4714-a5a5-03467299fd0b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:58.813283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a739edf0-a253-4714-a5a5-03467299fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:58.825683 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2360/4694] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:03:58.829840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6adf99-83e8-417c-8f61-602841fe4362 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:58.841886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6adf99-83e8-417c-8f61-602841fe4362 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:58.849316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:58.850381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:58.850933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:58.851629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:58.852657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:03:58.854479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:58.859528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:58.876779 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2335/4695] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:03:58.878724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739edf0-a253-4714-a5a5-03467299fd0b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:58.892954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739edf0-a253-4714-a5a5-03467299fd0b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:58.902358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0cf6-e544-4bc7-89e0-f9a7218126cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:58.903339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0cf6-e544-4bc7-89e0-f9a7218126cf admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:58.903632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0cf6-e544-4bc7-89e0-f9a7218126cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:58.904395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0cf6-e544-4bc7-89e0-f9a7218126cf admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:58.905370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb0cf6-e544-4bc7-89e0-f9a7218126cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:58.907792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb0cf6-e544-4bc7-89e0-f9a7218126cf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:58.982534 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2361/4696] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:03:58 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:03:58.987014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:59.000510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed71d4c-2510-474f-9bc6-dadfd80eebc5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:59.150446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa9f0-dca3-49a1-8e95-f09e76df99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:59.151148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa9f0-dca3-49a1-8e95-f09e76df99af admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:59.151432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa9f0-dca3-49a1-8e95-f09e76df99af admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:59.151705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa9f0-dca3-49a1-8e95-f09e76df99af admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:59.153596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfa9f0-dca3-49a1-8e95-f09e76df99af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:59.160166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfa9f0-dca3-49a1-8e95-f09e76df99af admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:59.229691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2336/4697] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:03:58 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:03:59.235577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0cf6-e544-4bc7-89e0-f9a7218126cf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:59.253355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0cf6-e544-4bc7-89e0-f9a7218126cf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:59.265612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837c99-08b2-4029-88e8-a2b3cbd77e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:59.273994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837c99-08b2-4029-88e8-a2b3cbd77e29 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:59.279784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837c99-08b2-4029-88e8-a2b3cbd77e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:59.280895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837c99-08b2-4029-88e8-a2b3cbd77e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:59.285261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1837c99-08b2-4029-88e8-a2b3cbd77e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:59.288306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1837c99-08b2-4029-88e8-a2b3cbd77e29 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:59.329960 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2362/4698] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:59.334309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa9f0-dca3-49a1-8e95-f09e76df99af admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:59.351200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa9f0-dca3-49a1-8e95-f09e76df99af admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:59.358847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64366c4c-33f5-4cb0-9a64-f973082755ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:59.359548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366c4c-33f5-4cb0-9a64-f973082755ef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:59.360672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366c4c-33f5-4cb0-9a64-f973082755ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:59.360969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366c4c-33f5-4cb0-9a64-f973082755ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:59.361736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64366c4c-33f5-4cb0-9a64-f973082755ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:59.363460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64366c4c-33f5-4cb0-9a64-f973082755ef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:59.385617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837c99-08b2-4029-88e8-a2b3cbd77e29 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:59.390039 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2337/4699] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:03:59.404652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837c99-08b2-4029-88e8-a2b3cbd77e29 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:59.414758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:59.416009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:59.417182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:59.417707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] PATH_INFO: `/v3/projects/5ee065d1c70940cd8caadd525737c593/users/e36bd5d716db4dba866a1bcd880accb8/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:59.444765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee065d1c70940cd8caadd525737c593, user_id=e36bd5d716db4dba866a1bcd880accb8, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:59.449752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:59.493322 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2363/4700] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:03:59 2022] PUT /identity/v3/projects/5ee065d1c70940cd8caadd525737c593/users/e36bd5d716db4dba866a1bcd880accb8/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:03:59.497289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17990-5d7d-4966-a4a3-27d16366ba27 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:59.497845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17990-5d7d-4966-a4a3-27d16366ba27 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:59.498976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17990-5d7d-4966-a4a3-27d16366ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:59.532458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9fd17990-5d7d-4966-a4a3-27d16366ba27 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:03:59.534450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9fd17990-5d7d-4966-a4a3-27d16366ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:59.688024 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2338/4701] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:03:59.756715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:03:59.761053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:03:59.863529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5aef1-4c87-43d7-958e-9b1e5d27f9ae admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:03:59.898298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61b177-65ed-4056-906e-4eb489754eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:03:59.898938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61b177-65ed-4056-906e-4eb489754eeb service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:03:59.902149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61b177-65ed-4056-906e-4eb489754eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:03:59.902473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61b177-65ed-4056-906e-4eb489754eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:03:59.937019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61b177-65ed-4056-906e-4eb489754eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:03:59.939038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61b177-65ed-4056-906e-4eb489754eeb service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:03:59.981029 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2364/4702] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:04:02.304147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066efe4f-ba87-4d61-85ee-7aa5bc0a0b7c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:02.304688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066efe4f-ba87-4d61-85ee-7aa5bc0a0b7c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:02.304820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066efe4f-ba87-4d61-85ee-7aa5bc0a0b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:02.358171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-066efe4f-ba87-4d61-85ee-7aa5bc0a0b7c None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:02.363439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-066efe4f-ba87-4d61-85ee-7aa5bc0a0b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:02.445794 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2339/4703] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:02.458618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e9bf-8939-4493-a205-68f0f484d7d1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:02.459683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e9bf-8939-4493-a205-68f0f484d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:02.460188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e9bf-8939-4493-a205-68f0f484d7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:02.505612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1e35e9bf-8939-4493-a205-68f0f484d7d1 None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:02.506868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e35e9bf-8939-4493-a205-68f0f484d7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:02.515778 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2365/4704] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:02.959159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066efe4f-ba87-4d61-85ee-7aa5bc0a0b7c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:02.961056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-066efe4f-ba87-4d61-85ee-7aa5bc0a0b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:03.165840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066efe4f-ba87-4d61-85ee-7aa5bc0a0b7c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:03.176920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:03.177600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:03.177882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:03.178155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:03.200053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:03.201740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:03.228930 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2340/4705] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:04:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:04:10.085093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9bdd-dcc7-4c23-b220-464e60dd2283 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:10.085600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9bdd-dcc7-4c23-b220-464e60dd2283 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:10.085822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9bdd-dcc7-4c23-b220-464e60dd2283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:10.152073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a3ff9bdd-dcc7-4c23-b220-464e60dd2283 None None] MFA Rules not processed for user `59ce7bfa9c454b3389ec787812495827`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:10.155173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a3ff9bdd-dcc7-4c23-b220-464e60dd2283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:10.258851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2366/4706] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:10.267342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:10.269023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:10.298106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce8ab8-a617-44d6-aec7-cc9f530bce86 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:10.315189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91586b28-d1b2-406d-bd72-102bdf68b0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:10.316099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586b28-d1b2-406d-bd72-102bdf68b0f4 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:10.316568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586b28-d1b2-406d-bd72-102bdf68b0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:10.317224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586b28-d1b2-406d-bd72-102bdf68b0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:10.329459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91586b28-d1b2-406d-bd72-102bdf68b0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:10.331437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91586b28-d1b2-406d-bd72-102bdf68b0f4 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:10.346248 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2341/4707] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:04:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:04:19.247118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fccb0-bc22-4e77-8010-630fae9859fb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:19.247694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fccb0-bc22-4e77-8010-630fae9859fb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:19.247694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fccb0-bc22-4e77-8010-630fae9859fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:19.289480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-184fccb0-bc22-4e77-8010-630fae9859fb None None] MFA Rules not processed for user `59ce7bfa9c454b3389ec787812495827`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:19.290766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-184fccb0-bc22-4e77-8010-630fae9859fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:19.314644 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2367/4708] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:22.746780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b9c3-b3ba-4cc0-9a0b-aa54015bbfde None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:22.747267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b9c3-b3ba-4cc0-9a0b-aa54015bbfde None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:22.747267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b9c3-b3ba-4cc0-9a0b-aa54015bbfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:22.806699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ef60b9c3-b3ba-4cc0-9a0b-aa54015bbfde None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:22.808375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ef60b9c3-b3ba-4cc0-9a0b-aa54015bbfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:22.830073 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2342/4709] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:25.187336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a077e2f-a58c-40bd-8d4c-a76d69218186 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:25.188817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a077e2f-a58c-40bd-8d4c-a76d69218186 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:25.188817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a077e2f-a58c-40bd-8d4c-a76d69218186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:25.221617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7a077e2f-a58c-40bd-8d4c-a76d69218186 None None] MFA Rules not processed for user `5b13848e363e44b9927525ca9ca6fe81`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:25.228703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7a077e2f-a58c-40bd-8d4c-a76d69218186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:25.405959 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2368/4710] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:26.321931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0cbc-94f2-4333-9522-857fbeb663b6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:26.322945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0cbc-94f2-4333-9522-857fbeb663b6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:26.323467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0cbc-94f2-4333-9522-857fbeb663b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:26.355501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f17e0cbc-94f2-4333-9522-857fbeb663b6 None None] MFA Rules not processed for user `fad7207822c04fc289709200d7e2bd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:26.356880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f17e0cbc-94f2-4333-9522-857fbeb663b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:26.430307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a077e2f-a58c-40bd-8d4c-a76d69218186 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:26.433649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7a077e2f-a58c-40bd-8d4c-a76d69218186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:26.460247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a077e2f-a58c-40bd-8d4c-a76d69218186 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:26.461135 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2343/4711] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:26.470501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:26.472492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:26.472990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:26.473611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] PATH_INFO: `/v3/users/88188e2c8b6043c0a884ebc8f2663bee` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:26.475577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88188e2c8b6043c0a884ebc8f2663bee)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:26.477919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:26.567982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e14f8-1782-48a8-a49b-0486d90e468b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:26.568706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e14f8-1782-48a8-a49b-0486d90e468b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:26.569410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e14f8-1782-48a8-a49b-0486d90e468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:26.585469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88188e2c8b6043c0a884ebc8f2663bee'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:26.597786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-422e14f8-1782-48a8-a49b-0486d90e468b None None] MFA Rules not processed for user `0edf621841d44514b6082172d15af2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:26.599183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88188e2c8b6043c0a884ebc8f2663bee'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:26.599960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-422e14f8-1782-48a8-a49b-0486d90e468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:26.609521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88188e2c8b6043c0a884ebc8f2663bee'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:26.610617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88188e2c8b6043c0a884ebc8f2663bee'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:26.611614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88188e2c8b6043c0a884ebc8f2663bee'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:26.640122 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2369/4712] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:04:26 2022] DELETE /identity/v3/users/88188e2c8b6043c0a884ebc8f2663bee => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:04:26.717191 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2344/4713] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:27.445250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:27.448585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:27.575671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac894d9-5575-4eac-a826-d20979a78b42 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:27.582564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:27.583731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:27.584166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:27.584653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] PATH_INFO: `/v3/projects/3a8136be2d0a4abb81e8038390855add` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:27.586759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8136be2d0a4abb81e8038390855add)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:27.589985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:27.660237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8136be2d0a4abb81e8038390855add', 'request_id': 'req-e440f525-74f7-4121-8614-83c02b06ffbf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:27.670449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8136be2d0a4abb81e8038390855add', 'request_id': 'req-e440f525-74f7-4121-8614-83c02b06ffbf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:27.686574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8136be2d0a4abb81e8038390855add', 'request_id': 'req-e440f525-74f7-4121-8614-83c02b06ffbf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:27.711643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] The token cache is being invalidate because project 3a8136be2d0a4abb81e8038390855add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:04:27.712090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:27.713552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e440f525-74f7-4121-8614-83c02b06ffbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:27.716202 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2370/4714] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:04:27 2022] DELETE /identity/v3/projects/3a8136be2d0a4abb81e8038390855add => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:04:27.723738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92226ec6-89a3-47e8-a67c-7c859e190de3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:27.724283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92226ec6-89a3-47e8-a67c-7c859e190de3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:27.724419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92226ec6-89a3-47e8-a67c-7c859e190de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:27.752862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-92226ec6-89a3-47e8-a67c-7c859e190de3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:27.754188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-92226ec6-89a3-47e8-a67c-7c859e190de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:27.830559 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2345/4715] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:27.838594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221263c-c2e5-4e9b-afab-2ab26822902e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:27.838881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221263c-c2e5-4e9b-afab-2ab26822902e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:27.839191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221263c-c2e5-4e9b-afab-2ab26822902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:27.859310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2221263c-c2e5-4e9b-afab-2ab26822902e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:27.860905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2221263c-c2e5-4e9b-afab-2ab26822902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:27.873898 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2371/4716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:27.878606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92226ec6-89a3-47e8-a67c-7c859e190de3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:27.891251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92226ec6-89a3-47e8-a67c-7c859e190de3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:27.898793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:27.899755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:27.900927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:27.901421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:27.902645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:04:27.903215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:27.905427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:27.921148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2346/4717] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:04:27.924998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221263c-c2e5-4e9b-afab-2ab26822902e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:27.936927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221263c-c2e5-4e9b-afab-2ab26822902e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:27.948052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8231-c250-4aa3-b968-9cdb5b9e75b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:27.949239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8231-c250-4aa3-b968-9cdb5b9e75b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:27.949912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8231-c250-4aa3-b968-9cdb5b9e75b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:27.950569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8231-c250-4aa3-b968-9cdb5b9e75b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:27.951576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a8231-c250-4aa3-b968-9cdb5b9e75b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:27.954404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a8231-c250-4aa3-b968-9cdb5b9e75b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:28.008069 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2372/4718] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:04:27 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:04:28.013167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:28.024978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f21f3-e435-436a-b1cc-1072b7bb4cde admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:28.129568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8185afe-b78d-43c6-b1b5-5f7cbd5c4b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:28.130273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8185afe-b78d-43c6-b1b5-5f7cbd5c4b79 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:28.130742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8185afe-b78d-43c6-b1b5-5f7cbd5c4b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:28.131371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8185afe-b78d-43c6-b1b5-5f7cbd5c4b79 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:28.133089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8185afe-b78d-43c6-b1b5-5f7cbd5c4b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:28.135816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8185afe-b78d-43c6-b1b5-5f7cbd5c4b79 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:28.165625 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2347/4719] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:04:28 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:04:28.171994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8231-c250-4aa3-b968-9cdb5b9e75b7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:28.187489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8231-c250-4aa3-b968-9cdb5b9e75b7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:28.196243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc16d-5f07-4d60-a228-72b7d8d7f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:28.198128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc16d-5f07-4d60-a228-72b7d8d7f593 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:28.198956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc16d-5f07-4d60-a228-72b7d8d7f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:28.199480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc16d-5f07-4d60-a228-72b7d8d7f593 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:28.200651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcc16d-5f07-4d60-a228-72b7d8d7f593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:28.202936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcc16d-5f07-4d60-a228-72b7d8d7f593 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:28.222472 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2373/4720] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:04:28.226924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8185afe-b78d-43c6-b1b5-5f7cbd5c4b79 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:28.238128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8185afe-b78d-43c6-b1b5-5f7cbd5c4b79 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:28.244739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65228fd5-2e76-41c3-a948-17bddcd0c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:28.246073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65228fd5-2e76-41c3-a948-17bddcd0c202 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:28.246575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65228fd5-2e76-41c3-a948-17bddcd0c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:28.247017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65228fd5-2e76-41c3-a948-17bddcd0c202 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:28.247963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65228fd5-2e76-41c3-a948-17bddcd0c202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:28.249877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65228fd5-2e76-41c3-a948-17bddcd0c202 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:28.263151 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2348/4721] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:04:28.266976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc16d-5f07-4d60-a228-72b7d8d7f593 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:28.278586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc16d-5f07-4d60-a228-72b7d8d7f593 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:28.284108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03eb48b-5f96-425d-aaa6-95a38fa482b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:28.285462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eb48b-5f96-425d-aaa6-95a38fa482b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:28.285967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eb48b-5f96-425d-aaa6-95a38fa482b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:28.286460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eb48b-5f96-425d-aaa6-95a38fa482b8 admin admin] PATH_INFO: `/v3/projects/6192b12536cf4040bfcaac0f1bbdc8bf/users/27b29d136ead4a40b9c81787b96c567f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:28.304893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03eb48b-5f96-425d-aaa6-95a38fa482b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6192b12536cf4040bfcaac0f1bbdc8bf, user_id=27b29d136ead4a40b9c81787b96c567f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:28.309761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03eb48b-5f96-425d-aaa6-95a38fa482b8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:28.330206 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2374/4722] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:04:28 2022] PUT /identity/v3/projects/6192b12536cf4040bfcaac0f1bbdc8bf/users/27b29d136ead4a40b9c81787b96c567f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:04:28.341101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9334a1-f1ff-44ad-ad3e-9c3939a3825a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:28.341630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9334a1-f1ff-44ad-ad3e-9c3939a3825a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:28.342223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9334a1-f1ff-44ad-ad3e-9c3939a3825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:28.376307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3a9334a1-f1ff-44ad-ad3e-9c3939a3825a None None] MFA Rules not processed for user `27b29d136ead4a40b9c81787b96c567f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:28.378686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3a9334a1-f1ff-44ad-ad3e-9c3939a3825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:28.540375 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2349/4723] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:28.544977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c971d2-24a6-4bae-a108-dea58145abe7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:28.545907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c971d2-24a6-4bae-a108-dea58145abe7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:28.546370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c971d2-24a6-4bae-a108-dea58145abe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:28.582534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e6c971d2-24a6-4bae-a108-dea58145abe7 None None] MFA Rules not processed for user `27b29d136ead4a40b9c81787b96c567f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:28.587254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e6c971d2-24a6-4bae-a108-dea58145abe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:28.608691 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2375/4724] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:29.024267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9334a1-f1ff-44ad-ad3e-9c3939a3825a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:29.026565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3a9334a1-f1ff-44ad-ad3e-9c3939a3825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:29.174491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9334a1-f1ff-44ad-ad3e-9c3939a3825a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:29.185697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd31f3-ad14-40bc-b897-bc4c974d27ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:29.187178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd31f3-ad14-40bc-b897-bc4c974d27ea service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:29.188506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd31f3-ad14-40bc-b897-bc4c974d27ea service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:29.188914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd31f3-ad14-40bc-b897-bc4c974d27ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:29.201987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd31f3-ad14-40bc-b897-bc4c974d27ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:29.203732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd31f3-ad14-40bc-b897-bc4c974d27ea service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:29.233929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2350/4725] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:04:47.987437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b213a0-52d8-4521-9451-1bbf2344547d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:47.988698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b213a0-52d8-4521-9451-1bbf2344547d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:47.988997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b213a0-52d8-4521-9451-1bbf2344547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:48.030524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e6b213a0-52d8-4521-9451-1bbf2344547d None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:48.031806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e6b213a0-52d8-4521-9451-1bbf2344547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:48.171095 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2376/4726] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:48.928875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a42af-177a-4605-83e0-c5f5b648f33f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:48.929947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a42af-177a-4605-83e0-c5f5b648f33f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:48.930469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a42af-177a-4605-83e0-c5f5b648f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:48.971923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e11a42af-177a-4605-83e0-c5f5b648f33f None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:48.974365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e11a42af-177a-4605-83e0-c5f5b648f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:49.078165 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2351/4727] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:49.187043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b213a0-52d8-4521-9451-1bbf2344547d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:49.190020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e6b213a0-52d8-4521-9451-1bbf2344547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:49.341241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b213a0-52d8-4521-9451-1bbf2344547d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:49.349190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:49.350466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:49.350798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:49.351091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:49.368665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:49.370297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:49.386228 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2377/4728] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:04:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:04:51.114268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7e163-2fa2-4003-aa96-6483aa1e0d41 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:51.115198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7e163-2fa2-4003-aa96-6483aa1e0d41 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:51.115656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7e163-2fa2-4003-aa96-6483aa1e0d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:51.173446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-78b7e163-2fa2-4003-aa96-6483aa1e0d41 None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:51.187181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-78b7e163-2fa2-4003-aa96-6483aa1e0d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:51.236063 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2352/4729] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:54.091758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:54.094390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:54.211348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66238eb-49b1-43b4-90de-6e82b95be351 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:54.217014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:54.219041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:54.219216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:54.219378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] PATH_INFO: `/v3/users/5b13848e363e44b9927525ca9ca6fe81` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:54.221354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b13848e363e44b9927525ca9ca6fe81)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:54.223382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:54.339075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b13848e363e44b9927525ca9ca6fe81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:54.377406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b13848e363e44b9927525ca9ca6fe81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:54.398177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b13848e363e44b9927525ca9ca6fe81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:54.399237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b13848e363e44b9927525ca9ca6fe81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:54.400992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-328af97e-d830-46df-bf6c-c591740c583a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b13848e363e44b9927525ca9ca6fe81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:54.432233 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2378/4730] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:04:54 2022] DELETE /identity/v3/users/5b13848e363e44b9927525ca9ca6fe81 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:04:54.782086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7e163-2fa2-4003-aa96-6483aa1e0d41 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:54.802403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7e163-2fa2-4003-aa96-6483aa1e0d41 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:55.059525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:55.067907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:55.070769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:55.072133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] PATH_INFO: `/v3/projects/8d34faf6add7400690171f1d097d5f2c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:55.074548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d34faf6add7400690171f1d097d5f2c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:55.077481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:55.245238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d34faf6add7400690171f1d097d5f2c', 'request_id': 'req-ba34c83d-955a-45bc-aceb-a42f6459640a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:55.290781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d34faf6add7400690171f1d097d5f2c', 'request_id': 'req-ba34c83d-955a-45bc-aceb-a42f6459640a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:55.294059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950400-5e58-4d23-abd8-fe969aa92b19 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:55.295154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950400-5e58-4d23-abd8-fe969aa92b19 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:55.295696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950400-5e58-4d23-abd8-fe969aa92b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:55.323159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d34faf6add7400690171f1d097d5f2c', 'request_id': 'req-ba34c83d-955a-45bc-aceb-a42f6459640a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:55.324279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8f950400-5e58-4d23-abd8-fe969aa92b19 None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:55.325926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8f950400-5e58-4d23-abd8-fe969aa92b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:55.369448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] The token cache is being invalidate because project 8d34faf6add7400690171f1d097d5f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:04:55.369672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:55.371325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba34c83d-955a-45bc-aceb-a42f6459640a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:04:55.375605 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2353/4731] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:04:54 2022] DELETE /identity/v3/projects/8d34faf6add7400690171f1d097d5f2c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:04:55.380674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc59c-eb9e-4284-84a9-ad1cf55ba412 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:55.381034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc59c-eb9e-4284-84a9-ad1cf55ba412 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:55.381528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc59c-eb9e-4284-84a9-ad1cf55ba412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:55.414584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f3bfc59c-eb9e-4284-84a9-ad1cf55ba412 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:55.417896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f3bfc59c-eb9e-4284-84a9-ad1cf55ba412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:55.441545 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2379/4732] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:55.519959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521098b-911b-4968-ad37-57e4271c4583 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:55.520244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521098b-911b-4968-ad37-57e4271c4583 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:55.520758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521098b-911b-4968-ad37-57e4271c4583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:55.523189 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2354/4733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:04:55.548080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4521098b-911b-4968-ad37-57e4271c4583 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:55.549622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4521098b-911b-4968-ad37-57e4271c4583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:55.576636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfc59c-eb9e-4284-84a9-ad1cf55ba412 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:55.586619 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2380/4734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:04:55.589795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfc59c-eb9e-4284-84a9-ad1cf55ba412 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:55.595670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:55.597468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:55.597927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:55.598359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:55.599323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:04:55.599803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:55.601681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:55.621584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521098b-911b-4968-ad37-57e4271c4583 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:55.643036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521098b-911b-4968-ad37-57e4271c4583 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:55.644586 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2355/4735] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:04:55.675872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e65a35-aff9-4baa-8189-c00e05402232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:55.676652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65a35-aff9-4baa-8189-c00e05402232 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:55.676946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65a35-aff9-4baa-8189-c00e05402232 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:55.677174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65a35-aff9-4baa-8189-c00e05402232 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:55.678086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e65a35-aff9-4baa-8189-c00e05402232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:55.684679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e65a35-aff9-4baa-8189-c00e05402232 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:55.752205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:55.761967 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2381/4736] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:04:55 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:04:55.764690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7d55b-4148-467a-b374-9fa317d7ac2b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:55.842909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287371f-7b72-4f75-8d3c-3f2b5c33c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:55.844628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287371f-7b72-4f75-8d3c-3f2b5c33c2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:55.845108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287371f-7b72-4f75-8d3c-3f2b5c33c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:55.845756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287371f-7b72-4f75-8d3c-3f2b5c33c2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:55.847479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287371f-7b72-4f75-8d3c-3f2b5c33c2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:55.849771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287371f-7b72-4f75-8d3c-3f2b5c33c2a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:55.883662 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2356/4737] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:04:55 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:04:55.889663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e65a35-aff9-4baa-8189-c00e05402232 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:55.908797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e65a35-aff9-4baa-8189-c00e05402232 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:55.928784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07eb76-7af5-4f58-be89-c11bb569af8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:55.930164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07eb76-7af5-4f58-be89-c11bb569af8e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:55.930255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07eb76-7af5-4f58-be89-c11bb569af8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:55.930756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07eb76-7af5-4f58-be89-c11bb569af8e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:55.932014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07eb76-7af5-4f58-be89-c11bb569af8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:55.937196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07eb76-7af5-4f58-be89-c11bb569af8e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:55.983904 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2382/4738] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:04:55.985295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287371f-7b72-4f75-8d3c-3f2b5c33c2a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:56.011659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287371f-7b72-4f75-8d3c-3f2b5c33c2a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:56.021087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117feca-4e13-4af5-a2bd-484267210840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:56.022026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117feca-4e13-4af5-a2bd-484267210840 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:56.022316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117feca-4e13-4af5-a2bd-484267210840 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:56.024322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117feca-4e13-4af5-a2bd-484267210840 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:56.026430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117feca-4e13-4af5-a2bd-484267210840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:56.028501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117feca-4e13-4af5-a2bd-484267210840 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:56.061675 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2357/4739] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:04:56.072004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07eb76-7af5-4f58-be89-c11bb569af8e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:56.097439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07eb76-7af5-4f58-be89-c11bb569af8e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:56.108098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:56.109220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:56.109616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:56.110026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] PATH_INFO: `/v3/projects/25861ce7a94945b2a98e2cde62848ea1/users/b9f72dd7f6af40e79886293faf083b94/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:56.208018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25861ce7a94945b2a98e2cde62848ea1, user_id=b9f72dd7f6af40e79886293faf083b94, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:56.213466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:56.259486 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2383/4740] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:04:56 2022] PUT /identity/v3/projects/25861ce7a94945b2a98e2cde62848ea1/users/b9f72dd7f6af40e79886293faf083b94/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:04:56.265701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edcb1-bbc6-4c0f-848f-eed24f67c2cf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:56.266183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edcb1-bbc6-4c0f-848f-eed24f67c2cf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:56.266676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5edcb1-bbc6-4c0f-848f-eed24f67c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:56.290357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3d5edcb1-bbc6-4c0f-848f-eed24f67c2cf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:56.292638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3d5edcb1-bbc6-4c0f-848f-eed24f67c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:56.383303 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2358/4741] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:56.394899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:56.397854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:56.583443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23d506-e386-411c-9b69-2d9f83c406d0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:56.593584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d857ff-e1b7-4d4a-9b00-ec42068592d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:56.595178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d857ff-e1b7-4d4a-9b00-ec42068592d6 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:56.595629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d857ff-e1b7-4d4a-9b00-ec42068592d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:56.596084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d857ff-e1b7-4d4a-9b00-ec42068592d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:56.625343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d857ff-e1b7-4d4a-9b00-ec42068592d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:56.640471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d857ff-e1b7-4d4a-9b00-ec42068592d6 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:56.659961 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2384/4742] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:04:57.143567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259eb86-9290-44d3-bfd0-fba70159ef9d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:57.144546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259eb86-9290-44d3-bfd0-fba70159ef9d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:57.145736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259eb86-9290-44d3-bfd0-fba70159ef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:57.176802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d259eb86-9290-44d3-bfd0-fba70159ef9d None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:57.179386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d259eb86-9290-44d3-bfd0-fba70159ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:57.299214 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2359/4743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:04:58.518809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d4e2-1208-4731-9379-7722e1d462fb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:58.520248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d4e2-1208-4731-9379-7722e1d462fb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:58.521375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d4e2-1208-4731-9379-7722e1d462fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:58.559545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8dc5d4e2-1208-4731-9379-7722e1d462fb None None] MFA Rules not processed for user `b9f72dd7f6af40e79886293faf083b94`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:58.561008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8dc5d4e2-1208-4731-9379-7722e1d462fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:58.564820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fc6dd-116e-49fc-a90f-d0022f37e456 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:58.565783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fc6dd-116e-49fc-a90f-d0022f37e456 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:58.566248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fc6dd-116e-49fc-a90f-d0022f37e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:58.591972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-456fc6dd-116e-49fc-a90f-d0022f37e456 None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:58.594903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-456fc6dd-116e-49fc-a90f-d0022f37e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:58.612643 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2360/4744] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:04:58.674697 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2385/4745] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:04:58.687755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fc6dd-116e-49fc-a90f-d0022f37e456 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:04:58.689997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-456fc6dd-116e-49fc-a90f-d0022f37e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:58.852638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fc6dd-116e-49fc-a90f-d0022f37e456 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:04:58.863125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce703b7-10a0-40b0-9a32-e4607caca505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:04:58.864142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce703b7-10a0-40b0-9a32-e4607caca505 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:58.864639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce703b7-10a0-40b0-9a32-e4607caca505 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:58.865078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce703b7-10a0-40b0-9a32-e4607caca505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:58.876852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce703b7-10a0-40b0-9a32-e4607caca505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:04:58.879677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce703b7-10a0-40b0-9a32-e4607caca505 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:04:58.895737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2361/4746] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:04:59.870845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9ffa-eded-4ab2-92c1-1e76fd5d9fdd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:04:59.871445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9ffa-eded-4ab2-92c1-1e76fd5d9fdd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:04:59.871445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9ffa-eded-4ab2-92c1-1e76fd5d9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:04:59.941342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bd9f9ffa-eded-4ab2-92c1-1e76fd5d9fdd None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:04:59.948756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bd9f9ffa-eded-4ab2-92c1-1e76fd5d9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:04:59.972965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2386/4747] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:05:00.909245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524190-89c1-4a71-a100-b77e0a9930bb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:00.910129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524190-89c1-4a71-a100-b77e0a9930bb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:00.910458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524190-89c1-4a71-a100-b77e0a9930bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:00.945607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9c524190-89c1-4a71-a100-b77e0a9930bb None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:00.947391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9c524190-89c1-4a71-a100-b77e0a9930bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:00.959766 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2362/4748] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:05:02.327265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29094af-1b94-4af4-bd68-ac68906f2308 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:02.328173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29094af-1b94-4af4-bd68-ac68906f2308 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:02.328678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29094af-1b94-4af4-bd68-ac68906f2308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:02.405117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e29094af-1b94-4af4-bd68-ac68906f2308 None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:02.411746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e29094af-1b94-4af4-bd68-ac68906f2308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:02.441303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2387/4749] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:04.337851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1266-1f03-4f16-a4a6-7bdb63ed13be None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:04.338444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1266-1f03-4f16-a4a6-7bdb63ed13be None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:04.338444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1266-1f03-4f16-a4a6-7bdb63ed13be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:04.378807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e9df1266-1f03-4f16-a4a6-7bdb63ed13be None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:04.380496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e9df1266-1f03-4f16-a4a6-7bdb63ed13be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:04.406807 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2363/4750] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:07.367997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506ca2-3737-4d5e-a1ad-a0689953072e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:07.369020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506ca2-3737-4d5e-a1ad-a0689953072e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:07.369481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506ca2-3737-4d5e-a1ad-a0689953072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:07.409375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3e506ca2-3737-4d5e-a1ad-a0689953072e None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:07.410990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3e506ca2-3737-4d5e-a1ad-a0689953072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:07.426750 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2388/4751] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:17.004476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df1266-1f03-4f16-a4a6-7bdb63ed13be None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:17.023543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df1266-1f03-4f16-a4a6-7bdb63ed13be None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:17.031997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:17.032983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:17.033314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:17.033533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:17.036609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:17.134332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:17.137570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:17.151737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2364/4752] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:17.408624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e506ca2-3737-4d5e-a1ad-a0689953072e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:17.434417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e506ca2-3737-4d5e-a1ad-a0689953072e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:17.442715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:17.443625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:17.443917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:17.444196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] PATH_INFO: `/v3/users/b9f72dd7f6af40e79886293faf083b94` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:17.445574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f72dd7f6af40e79886293faf083b94)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:17.448298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:17.506601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f72dd7f6af40e79886293faf083b94'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:17.520568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f72dd7f6af40e79886293faf083b94'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:17.533356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f72dd7f6af40e79886293faf083b94'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:17.534272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f72dd7f6af40e79886293faf083b94'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:17.534724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f72dd7f6af40e79886293faf083b94'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:17.557394 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2389/4753] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:05:17 2022] DELETE /identity/v3/users/b9f72dd7f6af40e79886293faf083b94 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:05:17.767255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:17.768998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:17.791974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f7eb-e41c-403f-8bed-d6a8fa59f490 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:17.800702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:17.802404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:17.952174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:17.953709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:17.954438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:17.954834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] PATH_INFO: `/v3/users/27b29d136ead4a40b9c81787b96c567f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:17.956436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b29d136ead4a40b9c81787b96c567f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:17.958524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:17.963488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ea420-d482-411d-85ac-8efd02380722 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:17.992934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:17.994988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:17.995472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:17.995978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] PATH_INFO: `/v3/projects/25861ce7a94945b2a98e2cde62848ea1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:17.998250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25861ce7a94945b2a98e2cde62848ea1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:18.005565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:18.090611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b29d136ead4a40b9c81787b96c567f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.098737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b29d136ead4a40b9c81787b96c567f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.099668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b29d136ead4a40b9c81787b96c567f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.103285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25861ce7a94945b2a98e2cde62848ea1', 'request_id': 'req-2d4a7bc8-353e-4146-9591-4df6210eef96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.111717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25861ce7a94945b2a98e2cde62848ea1', 'request_id': 'req-2d4a7bc8-353e-4146-9591-4df6210eef96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.130931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b29d136ead4a40b9c81787b96c567f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.137673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25861ce7a94945b2a98e2cde62848ea1', 'request_id': 'req-2d4a7bc8-353e-4146-9591-4df6210eef96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.147489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b29d136ead4a40b9c81787b96c567f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.171758 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2365/4754] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:05:17 2022] DELETE /identity/v3/users/27b29d136ead4a40b9c81787b96c567f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:05:18.172755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:18.174308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:18.180938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] The token cache is being invalidate because project 25861ce7a94945b2a98e2cde62848ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:05:18.181309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.182394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2d4a7bc8-353e-4146-9591-4df6210eef96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:18.185571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2390/4755] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:05:17 2022] DELETE /identity/v3/projects/25861ce7a94945b2a98e2cde62848ea1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:05:18.187566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d867cd-9876-40c4-8eb1-be5faf7f5cd1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.187922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d867cd-9876-40c4-8eb1-be5faf7f5cd1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.189014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d867cd-9876-40c4-8eb1-be5faf7f5cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.248136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-60d867cd-9876-40c4-8eb1-be5faf7f5cd1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:18.249630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-60d867cd-9876-40c4-8eb1-be5faf7f5cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:18.326193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e9a53-1ba7-41c8-aa2c-bea141082d45 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:18.335978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:18.335978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.336599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.337670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.362390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:18.395598 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2391/4756] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:18.397143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab7ec5-b92c-4470-b6ea-bcd189cd67fb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.397437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab7ec5-b92c-4470-b6ea-bcd189cd67fb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.397715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab7ec5-b92c-4470-b6ea-bcd189cd67fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.432044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3cab7ec5-b92c-4470-b6ea-bcd189cd67fb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:18.434659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3cab7ec5-b92c-4470-b6ea-bcd189cd67fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:18.453820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2392/4757] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:18.459275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3be9f-9435-4d10-aa7d-1abae676a1e4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.460910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3be9f-9435-4d10-aa7d-1abae676a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.462361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3be9f-9435-4d10-aa7d-1abae676a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.497910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-63a3be9f-9435-4d10-aa7d-1abae676a1e4 None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:18.499159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-63a3be9f-9435-4d10-aa7d-1abae676a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:18.504762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:18.506872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:18.525271 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2366/4758] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:18.526150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:18.527502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:18.641205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a6601-466f-4974-b208-421bc882e091 service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:18.647959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db202-6ac0-488f-a151-c77a3d4297cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:18.649136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db202-6ac0-488f-a151-c77a3d4297cd service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.650247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db202-6ac0-488f-a151-c77a3d4297cd service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.650738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db202-6ac0-488f-a151-c77a3d4297cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.678451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db202-6ac0-488f-a151-c77a3d4297cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:18.679929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db202-6ac0-488f-a151-c77a3d4297cd service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:18.696613 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2367/4759] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:18.699029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c5de-e61c-4558-a303-02dc2fd239f3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.699509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c5de-e61c-4558-a303-02dc2fd239f3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.699957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c5de-e61c-4558-a303-02dc2fd239f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.703841 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2393/4760] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:18.706630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3be9f-9435-4d10-aa7d-1abae676a1e4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:18.752362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3be9f-9435-4d10-aa7d-1abae676a1e4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:18.767754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:18.768850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.769304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.769769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.777751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:18.780717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4ee1c5de-e61c-4558-a303-02dc2fd239f3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:18.783794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4ee1c5de-e61c-4558-a303-02dc2fd239f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:18.823549 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2368/4761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:18.825313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c5de-e61c-4558-a303-02dc2fd239f3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:18.828833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:18.831605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:18.861276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c5de-e61c-4558-a303-02dc2fd239f3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:18.875490 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2394/4762] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:18.879240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:18.880568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.881033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.881498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.883645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:05:18.884861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:18.887910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:18.919231 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2369/4763] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:05:18.920829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:18.940029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29aa07-76fd-45ae-83cc-497fb352ad16 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:18.946941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ae19-1dec-445a-b47b-e2522f482398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:18.947780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ae19-1dec-445a-b47b-e2522f482398 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:18.948130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ae19-1dec-445a-b47b-e2522f482398 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:18.948506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ae19-1dec-445a-b47b-e2522f482398 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:18.949412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25ae19-1dec-445a-b47b-e2522f482398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:18.951736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25ae19-1dec-445a-b47b-e2522f482398 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:19.010801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2395/4764] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:05:18 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:05:19.015307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:19.054039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5306-7d53-45c2-8586-3da20ae00251 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:19.223170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28247-1d73-49bb-ae4a-88b502d05b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:19.225072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28247-1d73-49bb-ae4a-88b502d05b24 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:19.227336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28247-1d73-49bb-ae4a-88b502d05b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:19.231459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28247-1d73-49bb-ae4a-88b502d05b24 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:19.232526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28247-1d73-49bb-ae4a-88b502d05b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:19.235413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28247-1d73-49bb-ae4a-88b502d05b24 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:19.270807 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2370/4765] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:05:19 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:05:19.275827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ae19-1dec-445a-b47b-e2522f482398 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:19.288809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ae19-1dec-445a-b47b-e2522f482398 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:19.299772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce0c15-f2fb-464c-8fb9-f7bf3b918fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:19.300436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce0c15-f2fb-464c-8fb9-f7bf3b918fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:19.300726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce0c15-f2fb-464c-8fb9-f7bf3b918fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:19.301114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce0c15-f2fb-464c-8fb9-f7bf3b918fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:19.301872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce0c15-f2fb-464c-8fb9-f7bf3b918fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:19.304104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce0c15-f2fb-464c-8fb9-f7bf3b918fd3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:19.323924 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2396/4766] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:05:19.325614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28247-1d73-49bb-ae4a-88b502d05b24 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:19.349101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28247-1d73-49bb-ae4a-88b502d05b24 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:19.355012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:19.356264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:19.356264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:19.356642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:19.357414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:19.359812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:19.377835 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2371/4767] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:05:19.378831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce0c15-f2fb-464c-8fb9-f7bf3b918fd3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:19.396867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:19.406827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:19.411804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce0c15-f2fb-464c-8fb9-f7bf3b918fd3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:19.432086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee203e3d-aa1c-4bc9-a915-a9f6e7de6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:19.438741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203e3d-aa1c-4bc9-a915-a9f6e7de6314 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:19.443706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203e3d-aa1c-4bc9-a915-a9f6e7de6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:19.445795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203e3d-aa1c-4bc9-a915-a9f6e7de6314 admin admin] PATH_INFO: `/v3/projects/3e16b1ae38144c3ba7d8cb99e46eea10/users/2ff7364263f04529910770039084fb7f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:19.471059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee203e3d-aa1c-4bc9-a915-a9f6e7de6314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e16b1ae38144c3ba7d8cb99e46eea10, user_id=2ff7364263f04529910770039084fb7f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:19.476237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee203e3d-aa1c-4bc9-a915-a9f6e7de6314 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:19.511878 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2397/4768] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:05:19 2022] PUT /identity/v3/projects/3e16b1ae38144c3ba7d8cb99e46eea10/users/2ff7364263f04529910770039084fb7f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:05:19.517434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4102ba-02c4-48ac-a314-5f9c1b491de6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:19.518089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4102ba-02c4-48ac-a314-5f9c1b491de6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:19.518379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38e638-514f-44b1-b184-b72ea3fcd835 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:19.518929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4102ba-02c4-48ac-a314-5f9c1b491de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:19.573612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dd4102ba-02c4-48ac-a314-5f9c1b491de6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:19.579018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd4102ba-02c4-48ac-a314-5f9c1b491de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:19.770923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:19.774388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:19.774388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:19.774388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:19.784886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:19.848020 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2398/4769] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:19.849395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4102ba-02c4-48ac-a314-5f9c1b491de6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:19.852323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd4102ba-02c4-48ac-a314-5f9c1b491de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:19.867095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4102ba-02c4-48ac-a314-5f9c1b491de6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:19.878391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:19.880193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:19.880937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:19.881481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] PATH_INFO: `/v3/projects/6192b12536cf4040bfcaac0f1bbdc8bf` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:19.883391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6192b12536cf4040bfcaac0f1bbdc8bf)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:19.886565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:19.969276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6192b12536cf4040bfcaac0f1bbdc8bf', 'request_id': 'req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:19.977497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6192b12536cf4040bfcaac0f1bbdc8bf', 'request_id': 'req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:19.991180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6192b12536cf4040bfcaac0f1bbdc8bf', 'request_id': 'req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:19.998393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.001008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.016836 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2372/4770] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:20.018025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:20.019496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] The token cache is being invalidate because project 6192b12536cf4040bfcaac0f1bbdc8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:05:20.020763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:20.021528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f7eaf16-742b-4b71-ac1a-d7d3bb426a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:20.023923 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2399/4771] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:05:19 2022] DELETE /identity/v3/projects/6192b12536cf4040bfcaac0f1bbdc8bf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:05:20.027263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de2c3-61d6-4a08-a81c-c664261788cc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.027263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de2c3-61d6-4a08-a81c-c664261788cc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.027263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de2c3-61d6-4a08-a81c-c664261788cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.033303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0308bd8-4df0-4556-bffa-48c95eb5c7a0 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:20.057767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f91de2c3-61d6-4a08-a81c-c664261788cc None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:20.059614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f91de2c3-61d6-4a08-a81c-c664261788cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:20.109511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeeb58c-e334-41b4-9d0f-8a98f2fd2a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:20.110366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeeb58c-e334-41b4-9d0f-8a98f2fd2a5e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.110653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeeb58c-e334-41b4-9d0f-8a98f2fd2a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.110932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeeb58c-e334-41b4-9d0f-8a98f2fd2a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.113873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-caeeb58c-e334-41b4-9d0f-8a98f2fd2a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:20.167071 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2400/4772] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:20.168966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009687-74fd-43e8-91cc-8ba2b64cd4f6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.169467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009687-74fd-43e8-91cc-8ba2b64cd4f6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.169938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009687-74fd-43e8-91cc-8ba2b64cd4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.200454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b4009687-74fd-43e8-91cc-8ba2b64cd4f6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:20.202310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b4009687-74fd-43e8-91cc-8ba2b64cd4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:20.265399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeeb58c-e334-41b4-9d0f-8a98f2fd2a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.266832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeeb58c-e334-41b4-9d0f-8a98f2fd2a5e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.305682 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2373/4773] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:20.318577 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2401/4774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:20.327180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cf473-1eeb-44a2-a043-e96e2b732823 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.327566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cf473-1eeb-44a2-a043-e96e2b732823 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.327776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cf473-1eeb-44a2-a043-e96e2b732823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.352801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-122cf473-1eeb-44a2-a043-e96e2b732823 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:20.354202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-122cf473-1eeb-44a2-a043-e96e2b732823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:20.370741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009687-74fd-43e8-91cc-8ba2b64cd4f6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:20.378273 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2374/4775] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:20.382312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009687-74fd-43e8-91cc-8ba2b64cd4f6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:20.410335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:20.411884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.412435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.412873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.414407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:05:20.414832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.417391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.439973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cf473-1eeb-44a2-a043-e96e2b732823 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:20.450841 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2402/4776] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:05:20.454431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cf473-1eeb-44a2-a043-e96e2b732823 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:20.473519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:20.474823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.475845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.476472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.478149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.480563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.529075 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2375/4777] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:05:20 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:05:20.530348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:20.554014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db077-3006-4b92-8463-42b93a4c6fc9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:20.568792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:20.570902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:20.657749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31547195-0075-40ea-824c-c7626e408344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:20.658886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547195-0075-40ea-824c-c7626e408344 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.659414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547195-0075-40ea-824c-c7626e408344 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.660497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547195-0075-40ea-824c-c7626e408344 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.661531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31547195-0075-40ea-824c-c7626e408344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.664423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31547195-0075-40ea-824c-c7626e408344 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.701101 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2403/4778] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:05:20 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:05:20.705589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31547195-0075-40ea-824c-c7626e408344 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:20.721695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31547195-0075-40ea-824c-c7626e408344 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:20.731033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306d32-c34e-4eca-be84-ef1fcf52712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:20.732052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306d32-c34e-4eca-be84-ef1fcf52712d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.732527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306d32-c34e-4eca-be84-ef1fcf52712d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.733906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08526a8-84a9-4084-978a-ff41e487e4f7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:20.734207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306d32-c34e-4eca-be84-ef1fcf52712d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.735173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306d32-c34e-4eca-be84-ef1fcf52712d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.737379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306d32-c34e-4eca-be84-ef1fcf52712d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.751708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:20.753208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.754199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2404/4779] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:05:20.758133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.759574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] PATH_INFO: `/v3/users/4aa9ffdd3b0344229f99fdb852aad379` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.761477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306d32-c34e-4eca-be84-ef1fcf52712d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:20.762249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa9ffdd3b0344229f99fdb852aad379)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.765768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.793297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306d32-c34e-4eca-be84-ef1fcf52712d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:20.807738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7132d-c532-4992-8b19-27e0e62e96dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:20.809028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7132d-c532-4992-8b19-27e0e62e96dd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.809500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7132d-c532-4992-8b19-27e0e62e96dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.810077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7132d-c532-4992-8b19-27e0e62e96dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.811433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7132d-c532-4992-8b19-27e0e62e96dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.813853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7132d-c532-4992-8b19-27e0e62e96dd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.856475 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2405/4780] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:05:20.861960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7132d-c532-4992-8b19-27e0e62e96dd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:20.877474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa9ffdd3b0344229f99fdb852aad379'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:20.889017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7132d-c532-4992-8b19-27e0e62e96dd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:20.890392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa9ffdd3b0344229f99fdb852aad379'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:20.893815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa9ffdd3b0344229f99fdb852aad379'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:20.904608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd53b3-38b0-4d32-8bc1-fde778d27734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:20.907468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd53b3-38b0-4d32-8bc1-fde778d27734 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.908313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd53b3-38b0-4d32-8bc1-fde778d27734 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.908943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd53b3-38b0-4d32-8bc1-fde778d27734 admin admin] PATH_INFO: `/v3/projects/4d93cb84ab944db3aab11aab00da2f0d/users/282749d6d46245f4ad639dc22f789e1a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:20.942193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd53b3-38b0-4d32-8bc1-fde778d27734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d93cb84ab944db3aab11aab00da2f0d, user_id=282749d6d46245f4ad639dc22f789e1a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:20.947583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd53b3-38b0-4d32-8bc1-fde778d27734 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:20.956808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa9ffdd3b0344229f99fdb852aad379'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:20.973572 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2406/4781] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:05:20 2022] PUT /identity/v3/projects/4d93cb84ab944db3aab11aab00da2f0d/users/282749d6d46245f4ad639dc22f789e1a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:05:20.978007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a4b509e2-82ea-4b11-bb92-e8b3c0119ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa9ffdd3b0344229f99fdb852aad379'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:20.981179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653834e-e8c6-45f1-a15c-da420b0c4d20 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:20.981568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653834e-e8c6-45f1-a15c-da420b0c4d20 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:20.981831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653834e-e8c6-45f1-a15c-da420b0c4d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:21.019597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8653834e-e8c6-45f1-a15c-da420b0c4d20 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:21.025082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8653834e-e8c6-45f1-a15c-da420b0c4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:21.029197 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2376/4782] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:05:20 2022] DELETE /identity/v3/users/4aa9ffdd3b0344229f99fdb852aad379 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:05:21.035939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a647cf-70a1-43bf-97b8-a315663c9d6d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:21.036520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a647cf-70a1-43bf-97b8-a315663c9d6d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:21.037056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a647cf-70a1-43bf-97b8-a315663c9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:21.079657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-17a647cf-70a1-43bf-97b8-a315663c9d6d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:21.082600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-17a647cf-70a1-43bf-97b8-a315663c9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:21.219183 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2407/4783] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:05:21.251429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653834e-e8c6-45f1-a15c-da420b0c4d20 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:21.256912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8653834e-e8c6-45f1-a15c-da420b0c4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:21.304440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2377/4784] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:05:21.341150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a647cf-70a1-43bf-97b8-a315663c9d6d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:21.347953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-17a647cf-70a1-43bf-97b8-a315663c9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:21.386515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653834e-e8c6-45f1-a15c-da420b0c4d20 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:21.391519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:21.392449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:21.392794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:21.393079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:21.406904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:21.408432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:21.424017 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2408/4785] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:21.492018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a647cf-70a1-43bf-97b8-a315663c9d6d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:21.497448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258d0a-d00d-4a8a-a557-7d8684f93401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:21.498132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258d0a-d00d-4a8a-a557-7d8684f93401 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:21.498409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258d0a-d00d-4a8a-a557-7d8684f93401 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:21.499068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258d0a-d00d-4a8a-a557-7d8684f93401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:21.512455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258d0a-d00d-4a8a-a557-7d8684f93401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:21.514236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258d0a-d00d-4a8a-a557-7d8684f93401 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:21.528607 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2378/4786] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:21.958937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:21.961180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:22.025225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8b4f5-403d-4889-8790-c032d73cae4b service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:22.068080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:22.069927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:22.070610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:22.072903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] PATH_INFO: `/v3/projects/d4ad4a1daffa4cddbbf1e5aefea5a975` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:22.077437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ad4a1daffa4cddbbf1e5aefea5a975)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:22.085259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:22.143527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c97e-1cd8-4f18-afa7-64554b2440a8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:22.143992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c97e-1cd8-4f18-afa7-64554b2440a8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:22.146274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c97e-1cd8-4f18-afa7-64554b2440a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:22.266681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7a92c97e-1cd8-4f18-afa7-64554b2440a8 None None] MFA Rules not processed for user `2ff7364263f04529910770039084fb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:22.268826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a92c97e-1cd8-4f18-afa7-64554b2440a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:22.281982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ad4a1daffa4cddbbf1e5aefea5a975', 'request_id': 'req-956ca93d-9b27-4b5b-842e-642d931b5bbc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:22.300140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ad4a1daffa4cddbbf1e5aefea5a975', 'request_id': 'req-956ca93d-9b27-4b5b-842e-642d931b5bbc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:22.324700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ad4a1daffa4cddbbf1e5aefea5a975', 'request_id': 'req-956ca93d-9b27-4b5b-842e-642d931b5bbc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:22.347544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] The token cache is being invalidate because project d4ad4a1daffa4cddbbf1e5aefea5a975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:05:22.347671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:22.353821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-956ca93d-9b27-4b5b-842e-642d931b5bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:05:22.355800 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2409/4787] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:05:21 2022] DELETE /identity/v3/projects/d4ad4a1daffa4cddbbf1e5aefea5a975 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:05:22.365627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884df05d-6623-4c43-beb6-3c0affacfaad None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:22.365872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884df05d-6623-4c43-beb6-3c0affacfaad None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:22.366683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884df05d-6623-4c43-beb6-3c0affacfaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:22.420380 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2379/4788] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:05:22.420936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-884df05d-6623-4c43-beb6-3c0affacfaad None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:22.421876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-884df05d-6623-4c43-beb6-3c0affacfaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:22.558146 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2410/4789] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:22.565848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61c77e-db2c-441d-8e55-aac755b95c06 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:22.566356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61c77e-db2c-441d-8e55-aac755b95c06 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:22.566666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61c77e-db2c-441d-8e55-aac755b95c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:22.609321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fa61c77e-db2c-441d-8e55-aac755b95c06 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:22.610594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa61c77e-db2c-441d-8e55-aac755b95c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:22.631898 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2380/4790] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:22.633148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884df05d-6623-4c43-beb6-3c0affacfaad None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:22.651013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884df05d-6623-4c43-beb6-3c0affacfaad None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:22.657661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a717052-0f18-44f6-894d-75fe8cd93b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:22.658563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a717052-0f18-44f6-894d-75fe8cd93b68 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:22.658944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a717052-0f18-44f6-894d-75fe8cd93b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:22.659492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a717052-0f18-44f6-894d-75fe8cd93b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:22.660867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a717052-0f18-44f6-894d-75fe8cd93b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:05:22.662365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a717052-0f18-44f6-894d-75fe8cd93b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:22.664322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a717052-0f18-44f6-894d-75fe8cd93b68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:22.696408 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2411/4791] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:05:22.699703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61c77e-db2c-441d-8e55-aac755b95c06 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:22.723834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61c77e-db2c-441d-8e55-aac755b95c06 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:22.749868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:22.752616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:22.757193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:22.758347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:22.760658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:22.764443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedafd3-e360-400f-8cb8-34a4b0ffef67 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:22.764443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedafd3-e360-400f-8cb8-34a4b0ffef67 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:22.764692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedafd3-e360-400f-8cb8-34a4b0ffef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:22.771413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:22.802594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cdedafd3-e360-400f-8cb8-34a4b0ffef67 None None] MFA Rules not processed for user `282749d6d46245f4ad639dc22f789e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:22.803930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cdedafd3-e360-400f-8cb8-34a4b0ffef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:22.839411 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2381/4792] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:05:22 2022] POST /identity/v3/projects => generated 359 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:05:22.840553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:22.845447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:22.912796 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2412/4793] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:05:22.913633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedafd3-e360-400f-8cb8-34a4b0ffef67 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:22.927768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedafd3-e360-400f-8cb8-34a4b0ffef67 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.045147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.046043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.046336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.046621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.047823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.050732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.056591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bcfcc-8052-4e55-b471-f7ceb723789c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.074248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af730a-cbf8-4f9d-a6a2-9627b54e163b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.075046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af730a-cbf8-4f9d-a6a2-9627b54e163b service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.075223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af730a-cbf8-4f9d-a6a2-9627b54e163b service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.075546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af730a-cbf8-4f9d-a6a2-9627b54e163b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.108204 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2413/4794] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:05:22 2022] POST /identity/v3/users => generated 280 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:05:23.126682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.133636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:23.168475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9e5e-e366-4643-8f81-df001da10078 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.177345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f313-368f-4b90-ae92-63db238ef1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.178528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f313-368f-4b90-ae92-63db238ef1bd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.178963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f313-368f-4b90-ae92-63db238ef1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.181154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f313-368f-4b90-ae92-63db238ef1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.185668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f313-368f-4b90-ae92-63db238ef1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.189585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f313-368f-4b90-ae92-63db238ef1bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.252080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af730a-cbf8-4f9d-a6a2-9627b54e163b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.253616 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2414/4795] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:05:23 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:05:23.254655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f313-368f-4b90-ae92-63db238ef1bd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.256146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af730a-cbf8-4f9d-a6a2-9627b54e163b service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.284373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2382/4796] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:23.286417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af730a-cbf8-4f9d-a6a2-9627b54e163b service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.328269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af730a-cbf8-4f9d-a6a2-9627b54e163b service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.404739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f313-368f-4b90-ae92-63db238ef1bd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.430188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9801cc-a647-4241-97dc-caa48f9f95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.431389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9801cc-a647-4241-97dc-caa48f9f95bd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.431679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9801cc-a647-4241-97dc-caa48f9f95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.431963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9801cc-a647-4241-97dc-caa48f9f95bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.432750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9801cc-a647-4241-97dc-caa48f9f95bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.434462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9801cc-a647-4241-97dc-caa48f9f95bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.455120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c383717-461b-48a7-b7a8-1702ff725248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.456974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c383717-461b-48a7-b7a8-1702ff725248 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.457542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c383717-461b-48a7-b7a8-1702ff725248 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.458047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c383717-461b-48a7-b7a8-1702ff725248 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.458987 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2415/4797] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:05:23.462785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9801cc-a647-4241-97dc-caa48f9f95bd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.463013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c383717-461b-48a7-b7a8-1702ff725248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.465676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c383717-461b-48a7-b7a8-1702ff725248 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.484809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9801cc-a647-4241-97dc-caa48f9f95bd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.498863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2383/4798] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:05:23 2022] POST /identity/v3/users => generated 303 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:05:23.503352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c383717-461b-48a7-b7a8-1702ff725248 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.503563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c06c6-fcab-4b5a-bcae-191a491c062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.504173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c06c6-fcab-4b5a-bcae-191a491c062e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.504961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c06c6-fcab-4b5a-bcae-191a491c062e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.504961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c06c6-fcab-4b5a-bcae-191a491c062e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.505636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c06c6-fcab-4b5a-bcae-191a491c062e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.507421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c06c6-fcab-4b5a-bcae-191a491c062e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.520437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c383717-461b-48a7-b7a8-1702ff725248 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.526409 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2416/4799] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:05:23.526971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b97a6-9963-4981-82db-c16d23e0ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.527663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b97a6-9963-4981-82db-c16d23e0ccb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.527944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b97a6-9963-4981-82db-c16d23e0ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.528226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b97a6-9963-4981-82db-c16d23e0ccb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.529392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b97a6-9963-4981-82db-c16d23e0ccb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.531562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b97a6-9963-4981-82db-c16d23e0ccb4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.532479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c06c6-fcab-4b5a-bcae-191a491c062e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.561426 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2384/4800] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:05:23.561886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c06c6-fcab-4b5a-bcae-191a491c062e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.568687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b97a6-9963-4981-82db-c16d23e0ccb4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.569065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2682e-b1ec-41cd-aafd-c557b15c289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.570257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2682e-b1ec-41cd-aafd-c557b15c289d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.570520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2682e-b1ec-41cd-aafd-c557b15c289d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.571019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2682e-b1ec-41cd-aafd-c557b15c289d admin admin] PATH_INFO: `/v3/projects/9d72316bcd0440d482839e842e71771e/users/73e0f6e46efc4d18b151fc2acfe6484d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.597029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b97a6-9963-4981-82db-c16d23e0ccb4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.607516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b13d-28c5-49e1-b3d0-62ebd7bcbbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.608362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b13d-28c5-49e1-b3d0-62ebd7bcbbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.608842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b13d-28c5-49e1-b3d0-62ebd7bcbbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.609297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b13d-28c5-49e1-b3d0-62ebd7bcbbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.610482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4b13d-28c5-49e1-b3d0-62ebd7bcbbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.613267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2682e-b1ec-41cd-aafd-c557b15c289d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d72316bcd0440d482839e842e71771e, user_id=73e0f6e46efc4d18b151fc2acfe6484d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.613992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4b13d-28c5-49e1-b3d0-62ebd7bcbbf4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.622615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2682e-b1ec-41cd-aafd-c557b15c289d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.634073 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2385/4801] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:05:23.640636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b13d-28c5-49e1-b3d0-62ebd7bcbbf4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.648373 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2417/4802] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:05:23 2022] PUT /identity/v3/projects/9d72316bcd0440d482839e842e71771e/users/73e0f6e46efc4d18b151fc2acfe6484d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:05:23.653095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b13d-28c5-49e1-b3d0-62ebd7bcbbf4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:23.662408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3f065-ec95-428c-82a6-fab65a18f8a3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.663107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3f065-ec95-428c-82a6-fab65a18f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.663618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3f065-ec95-428c-82a6-fab65a18f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.720609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3cc3f065-ec95-428c-82a6-fab65a18f8a3 None None] MFA Rules not processed for user `73e0f6e46efc4d18b151fc2acfe6484d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:23.722055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3cc3f065-ec95-428c-82a6-fab65a18f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:23.782852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fe44f-b374-4866-a3c6-07b55fae8d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:23.787239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fe44f-b374-4866-a3c6-07b55fae8d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.787899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fe44f-b374-4866-a3c6-07b55fae8d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.788500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fe44f-b374-4866-a3c6-07b55fae8d40 admin admin] PATH_INFO: `/v3/projects/51b7d0b4475c407b9be59882bebdc39c/users/6794a3b7cfde4917a03cec02475eaedd/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.827877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fe44f-b374-4866-a3c6-07b55fae8d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b7d0b4475c407b9be59882bebdc39c, user_id=6794a3b7cfde4917a03cec02475eaedd, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:23.830609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fe44f-b374-4866-a3c6-07b55fae8d40 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:23.862419 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2386/4803] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:05:23 2022] PUT /identity/v3/projects/51b7d0b4475c407b9be59882bebdc39c/users/6794a3b7cfde4917a03cec02475eaedd/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:05:23.864814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1835-256c-4868-892a-88e55483a61f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:23.865379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1835-256c-4868-892a-88e55483a61f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:23.865851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1835-256c-4868-892a-88e55483a61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:23.880486 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2418/4804] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:23.898820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-561b1835-256c-4868-892a-88e55483a61f None None] MFA Rules not processed for user `2ff7364263f04529910770039084fb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:23.901259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-561b1835-256c-4868-892a-88e55483a61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:23.977970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3f065-ec95-428c-82a6-fab65a18f8a3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:23.985197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3cc3f065-ec95-428c-82a6-fab65a18f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:23.996783 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2387/4805] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:24.080303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b1835-256c-4868-892a-88e55483a61f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:24.083799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-561b1835-256c-4868-892a-88e55483a61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:24.102547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3f065-ec95-428c-82a6-fab65a18f8a3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:24.184256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d20ab-6514-4d32-95a5-6262dab095e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:24.185342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d20ab-6514-4d32-95a5-6262dab095e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:24.185881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d20ab-6514-4d32-95a5-6262dab095e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:24.186335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d20ab-6514-4d32-95a5-6262dab095e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:24.206129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b1835-256c-4868-892a-88e55483a61f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:24.228227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2995df-2535-4602-976b-0b66f5fcbfaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:24.234245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2995df-2535-4602-976b-0b66f5fcbfaa service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:24.234528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2995df-2535-4602-976b-0b66f5fcbfaa service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:24.234810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2995df-2535-4602-976b-0b66f5fcbfaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:24.241387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0f2995df-2535-4602-976b-0b66f5fcbfaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:24.327847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d20ab-6514-4d32-95a5-6262dab095e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:24.330404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d20ab-6514-4d32-95a5-6262dab095e9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:24.352199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2419/4806] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:05:24.428740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2995df-2535-4602-976b-0b66f5fcbfaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:24.432302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2995df-2535-4602-976b-0b66f5fcbfaa service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:24.460850 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2388/4807] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:05:25.894126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefec41-742f-4579-9100-9d8d6a1ab7f2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:25.894600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefec41-742f-4579-9100-9d8d6a1ab7f2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:25.894722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefec41-742f-4579-9100-9d8d6a1ab7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:25.955957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fbefec41-742f-4579-9100-9d8d6a1ab7f2 None None] MFA Rules not processed for user `6794a3b7cfde4917a03cec02475eaedd`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:25.957265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fbefec41-742f-4579-9100-9d8d6a1ab7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:26.182616 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2420/4808] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:05:26.194035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ff598-1ed4-4156-ac9f-21b82fc3ce23 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:26.195751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ff598-1ed4-4156-ac9f-21b82fc3ce23 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:26.196406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ff598-1ed4-4156-ac9f-21b82fc3ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:26.237201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-224ff598-1ed4-4156-ac9f-21b82fc3ce23 None None] MFA Rules not processed for user `282749d6d46245f4ad639dc22f789e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:26.240589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefec41-742f-4579-9100-9d8d6a1ab7f2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:26.241675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-224ff598-1ed4-4156-ac9f-21b82fc3ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:26.264738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefec41-742f-4579-9100-9d8d6a1ab7f2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:26.270638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:26.272111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:26.273907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:26.274258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:26.278256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:26.327408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:26.329746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:26.381316 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2421/4809] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:05:26.407841 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2389/4810] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:26.983842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:26.985516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:27.016366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39a772-27d5-4093-a97d-a41a4299ca95 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:27.023939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0940f98-689d-4ff3-8d20-1091c37d2cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:27.024975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940f98-689d-4ff3-8d20-1091c37d2cc8 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:27.025472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940f98-689d-4ff3-8d20-1091c37d2cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:27.026345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940f98-689d-4ff3-8d20-1091c37d2cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:27.062694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940f98-689d-4ff3-8d20-1091c37d2cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:27.069059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940f98-689d-4ff3-8d20-1091c37d2cc8 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:27.099496 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2422/4811] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:28.957144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ff598-1ed4-4156-ac9f-21b82fc3ce23 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:28.959227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-224ff598-1ed4-4156-ac9f-21b82fc3ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:29.098017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ff598-1ed4-4156-ac9f-21b82fc3ce23 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:29.111248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:29.112454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:29.112744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:29.113025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:29.119697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:29.148190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:29.151758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:29.167976 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2390/4812] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:05:30.593045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b403-d4d9-45f8-a022-15165bedf72b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:30.593591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b403-d4d9-45f8-a022-15165bedf72b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:30.594037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b403-d4d9-45f8-a022-15165bedf72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:30.623304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9958b403-d4d9-45f8-a022-15165bedf72b None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:30.626735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9958b403-d4d9-45f8-a022-15165bedf72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:30.792499 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2423/4813] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:30.810418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:30.812910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:31.021714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73459f-cc39-485f-adfc-6d24625392ec service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:31.028885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428869c-224b-447a-8aac-227d71732271 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:31.029792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428869c-224b-447a-8aac-227d71732271 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:31.030248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428869c-224b-447a-8aac-227d71732271 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:31.030853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428869c-224b-447a-8aac-227d71732271 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:31.045885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428869c-224b-447a-8aac-227d71732271 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:31.051075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428869c-224b-447a-8aac-227d71732271 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:31.096709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2391/4814] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:05:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:35.411205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958b403-d4d9-45f8-a022-15165bedf72b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:35.425640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958b403-d4d9-45f8-a022-15165bedf72b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:35.443393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f04bf-1cdf-4463-9c90-9df8e0f3a6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:35.444076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f04bf-1cdf-4463-9c90-9df8e0f3a6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:35.444389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f04bf-1cdf-4463-9c90-9df8e0f3a6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:35.444733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f04bf-1cdf-4463-9c90-9df8e0f3a6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:35.447304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-788f04bf-1cdf-4463-9c90-9df8e0f3a6d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:35.469320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f04bf-1cdf-4463-9c90-9df8e0f3a6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:35.476832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f04bf-1cdf-4463-9c90-9df8e0f3a6d2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:35.499577 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2424/4815] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:44.167718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428869c-224b-447a-8aac-227d71732271 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:44.182831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428869c-224b-447a-8aac-227d71732271 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:44.192185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eea34d-13a1-49a9-a820-9b3f02a64f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:44.193206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eea34d-13a1-49a9-a820-9b3f02a64f0a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:44.193686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eea34d-13a1-49a9-a820-9b3f02a64f0a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:44.194175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eea34d-13a1-49a9-a820-9b3f02a64f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:44.197134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-62eea34d-13a1-49a9-a820-9b3f02a64f0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:44.214849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eea34d-13a1-49a9-a820-9b3f02a64f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:44.217241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eea34d-13a1-49a9-a820-9b3f02a64f0a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:44.242947 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2392/4816] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:05:46.647767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c60e-9fde-4d4e-9d8c-e98c593f2c4f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:46.649487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c60e-9fde-4d4e-9d8c-e98c593f2c4f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:46.649993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c60e-9fde-4d4e-9d8c-e98c593f2c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:46.673026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0f95c60e-9fde-4d4e-9d8c-e98c593f2c4f None None] MFA Rules not processed for user `e36bd5d716db4dba866a1bcd880accb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:46.674982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f95c60e-9fde-4d4e-9d8c-e98c593f2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:46.799554 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2425/4817] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:53.731860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb166a7-5e96-41ef-95d7-3636f1081b11 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:53.732451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb166a7-5e96-41ef-95d7-3636f1081b11 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:53.732451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb166a7-5e96-41ef-95d7-3636f1081b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:53.756073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ceb166a7-5e96-41ef-95d7-3636f1081b11 None None] MFA Rules not processed for user `2ff7364263f04529910770039084fb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:53.759392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ceb166a7-5e96-41ef-95d7-3636f1081b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:53.768401 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2393/4818] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:05:55.519132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95c60e-9fde-4d4e-9d8c-e98c593f2c4f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:55.538772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95c60e-9fde-4d4e-9d8c-e98c593f2c4f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:55.547030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c37254-f4bd-42cd-8ef3-fa15d6032356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:55.547844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37254-f4bd-42cd-8ef3-fa15d6032356 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:55.548888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37254-f4bd-42cd-8ef3-fa15d6032356 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:55.549268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37254-f4bd-42cd-8ef3-fa15d6032356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:55.563026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c37254-f4bd-42cd-8ef3-fa15d6032356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:55.565065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c37254-f4bd-42cd-8ef3-fa15d6032356 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:55.578275 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2426/4819] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:05:55 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:05:58.004047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf65022-a74d-47dc-b6fc-bfddd8d20f3d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:58.004790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf65022-a74d-47dc-b6fc-bfddd8d20f3d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:58.004790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf65022-a74d-47dc-b6fc-bfddd8d20f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:58.032451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4cf65022-a74d-47dc-b6fc-bfddd8d20f3d None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:05:58.034089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4cf65022-a74d-47dc-b6fc-bfddd8d20f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:05:58.045511 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2394/4820] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:05:58.083598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c37254-f4bd-42cd-8ef3-fa15d6032356 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:05:58.102206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c37254-f4bd-42cd-8ef3-fa15d6032356 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:05:58.120144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f36a39-b555-48b7-a3f2-39f587b14686 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:05:58.120849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f36a39-b555-48b7-a3f2-39f587b14686 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:05:58.121136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f36a39-b555-48b7-a3f2-39f587b14686 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:05:58.121434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f36a39-b555-48b7-a3f2-39f587b14686 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:05:58.135585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f36a39-b555-48b7-a3f2-39f587b14686 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:05:58.138598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f36a39-b555-48b7-a3f2-39f587b14686 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:05:58.156795 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2427/4821] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:02.389663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf65022-a74d-47dc-b6fc-bfddd8d20f3d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:02.496802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf65022-a74d-47dc-b6fc-bfddd8d20f3d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:02.504577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:02.505665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:02.506035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:02.506491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] PATH_INFO: `/v3/users/282749d6d46245f4ad639dc22f789e1a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:02.508088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282749d6d46245f4ad639dc22f789e1a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:02.511457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:02.581179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282749d6d46245f4ad639dc22f789e1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:02.582151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282749d6d46245f4ad639dc22f789e1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:02.583262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282749d6d46245f4ad639dc22f789e1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:02.611410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282749d6d46245f4ad639dc22f789e1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:02.638940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282749d6d46245f4ad639dc22f789e1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:02.668400 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2395/4822] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:06:02 2022] DELETE /identity/v3/users/282749d6d46245f4ad639dc22f789e1a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:06:02.905770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f36a39-b555-48b7-a3f2-39f587b14686 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:02.924894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f36a39-b555-48b7-a3f2-39f587b14686 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:03.040843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:03.042072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:03.042535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:03.042817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] PATH_INFO: `/v3/projects/4d93cb84ab944db3aab11aab00da2f0d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:03.044142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d93cb84ab944db3aab11aab00da2f0d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:03.046802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:03.110719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d93cb84ab944db3aab11aab00da2f0d', 'request_id': 'req-2561eb36-ab06-44b6-96d1-1e7689a39548'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.122302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d93cb84ab944db3aab11aab00da2f0d', 'request_id': 'req-2561eb36-ab06-44b6-96d1-1e7689a39548'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.140026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d93cb84ab944db3aab11aab00da2f0d', 'request_id': 'req-2561eb36-ab06-44b6-96d1-1e7689a39548'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.157058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] The token cache is being invalidate because project 4d93cb84ab944db3aab11aab00da2f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:06:03.157346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.158059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.159773 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2428/4823] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:06:02 2022] DELETE /identity/v3/projects/4d93cb84ab944db3aab11aab00da2f0d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:06:03.164022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:03.166468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:03.183787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c197-39ca-4796-ac53-679f27cef641 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:03.263546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:03.264449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:03.264728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:03.265000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] PATH_INFO: `/v3/users/6794a3b7cfde4917a03cec02475eaedd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:03.266291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6794a3b7cfde4917a03cec02475eaedd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:03.268217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:03.322298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6794a3b7cfde4917a03cec02475eaedd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.324542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6794a3b7cfde4917a03cec02475eaedd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.325814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6794a3b7cfde4917a03cec02475eaedd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.344025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6794a3b7cfde4917a03cec02475eaedd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.355704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7b5774c4-6973-4de7-89a5-12dc115ad0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6794a3b7cfde4917a03cec02475eaedd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.369101 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2396/4824] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:06:03 2022] DELETE /identity/v3/users/6794a3b7cfde4917a03cec02475eaedd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:06:03.596379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:03.598667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:03.626373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561eb36-ab06-44b6-96d1-1e7689a39548 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:03.763269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:03.764239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:03.764704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:03.765002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] PATH_INFO: `/v3/projects/51b7d0b4475c407b9be59882bebdc39c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:03.766778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b7d0b4475c407b9be59882bebdc39c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:03.768814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:03.843886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b7d0b4475c407b9be59882bebdc39c', 'request_id': 'req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.856369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b7d0b4475c407b9be59882bebdc39c', 'request_id': 'req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.869367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b7d0b4475c407b9be59882bebdc39c', 'request_id': 'req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.883815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] The token cache is being invalidate because project 51b7d0b4475c407b9be59882bebdc39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:06:03.884142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.885074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f0d102f3-ebcf-4d1b-9f0d-380b288828c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:03.888538 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2429/4825] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:06:03 2022] DELETE /identity/v3/projects/51b7d0b4475c407b9be59882bebdc39c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:06:03.892700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431366bb-1cf9-4715-9b5f-43c9295184f1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:03.893251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431366bb-1cf9-4715-9b5f-43c9295184f1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:03.893353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431366bb-1cf9-4715-9b5f-43c9295184f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:03.916613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-431366bb-1cf9-4715-9b5f-43c9295184f1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:03.918567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-431366bb-1cf9-4715-9b5f-43c9295184f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:03.989394 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2397/4826] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:03.998300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966232-502b-4ead-9625-e3622418b7da None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:03.998846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966232-502b-4ead-9625-e3622418b7da None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:03.998846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966232-502b-4ead-9625-e3622418b7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.018687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-42966232-502b-4ead-9625-e3622418b7da None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:04.020373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-42966232-502b-4ead-9625-e3622418b7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:04.029645 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2430/4827] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:04.035243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431366bb-1cf9-4715-9b5f-43c9295184f1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:04.047274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431366bb-1cf9-4715-9b5f-43c9295184f1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:04.052678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:04.053447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:04.053942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:04.054251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.055077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:06:04.055401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:04.057110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:04.070436 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2398/4828] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:06:04.075641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966232-502b-4ead-9625-e3622418b7da None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:04.087638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966232-502b-4ead-9625-e3622418b7da None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:04.092939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26f72-4df8-4254-91c5-20d23038aec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:04.093614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f72-4df8-4254-91c5-20d23038aec7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:04.094003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f72-4df8-4254-91c5-20d23038aec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:04.094306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f72-4df8-4254-91c5-20d23038aec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.095150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c26f72-4df8-4254-91c5-20d23038aec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:04.097109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c26f72-4df8-4254-91c5-20d23038aec7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:04.132157 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2431/4829] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:06:04 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:06:04.133870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:04.146201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48523cfc-85b9-4327-8805-1da316c5ab86 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:04.214165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79b4c8-74b8-47b6-abaf-25fad4f0bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:04.214831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79b4c8-74b8-47b6-abaf-25fad4f0bd5c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:04.215107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79b4c8-74b8-47b6-abaf-25fad4f0bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:04.215388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79b4c8-74b8-47b6-abaf-25fad4f0bd5c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.216141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79b4c8-74b8-47b6-abaf-25fad4f0bd5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:04.218220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79b4c8-74b8-47b6-abaf-25fad4f0bd5c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:04.243157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2399/4830] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:06:04 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:06:04.247951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26f72-4df8-4254-91c5-20d23038aec7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:04.262763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26f72-4df8-4254-91c5-20d23038aec7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:04.271257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277e2e6-b869-4dc0-ad05-baf05851a3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:04.272286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277e2e6-b869-4dc0-ad05-baf05851a3fa admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:04.272762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277e2e6-b869-4dc0-ad05-baf05851a3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:04.273279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277e2e6-b869-4dc0-ad05-baf05851a3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.274792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277e2e6-b869-4dc0-ad05-baf05851a3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:04.276723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277e2e6-b869-4dc0-ad05-baf05851a3fa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:04.288730 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2432/4831] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:06:04.295076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79b4c8-74b8-47b6-abaf-25fad4f0bd5c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:04.307132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79b4c8-74b8-47b6-abaf-25fad4f0bd5c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:04.315802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089232ab-30b3-4409-9d94-ba39dd2359b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:04.316526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089232ab-30b3-4409-9d94-ba39dd2359b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:04.316977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089232ab-30b3-4409-9d94-ba39dd2359b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:04.317122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089232ab-30b3-4409-9d94-ba39dd2359b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.317863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089232ab-30b3-4409-9d94-ba39dd2359b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:04.319576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089232ab-30b3-4409-9d94-ba39dd2359b4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:04.334096 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2400/4832] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:06:04.335312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277e2e6-b869-4dc0-ad05-baf05851a3fa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:04.347433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277e2e6-b869-4dc0-ad05-baf05851a3fa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:04.355267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:04.356418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:04.356852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:04.357274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] PATH_INFO: `/v3/projects/adecc012aca243138d03c189f5623f73/users/7132cae4ebd549d491f5d0dcf83394ed/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.376503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adecc012aca243138d03c189f5623f73, user_id=7132cae4ebd549d491f5d0dcf83394ed, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:04.381254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:04.403523 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2433/4833] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:06:04 2022] PUT /identity/v3/projects/adecc012aca243138d03c189f5623f73/users/7132cae4ebd549d491f5d0dcf83394ed/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:06:04.409388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdbaf5-29b5-4932-b049-5aa4c0602ea0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:04.409751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdbaf5-29b5-4932-b049-5aa4c0602ea0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:04.410386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdbaf5-29b5-4932-b049-5aa4c0602ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.441537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-99bdbaf5-29b5-4932-b049-5aa4c0602ea0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:04.443380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-99bdbaf5-29b5-4932-b049-5aa4c0602ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:04.525995 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2401/4834] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:04.545420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:04.548834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:04.639438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c96a1-1e07-46a8-b3f5-4afe5a47b6a0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:04.646774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:04.647462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:04.647754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:04.648041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:04.659681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:04.661195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:04.677941 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2434/4835] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:10.676061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f077a7-5dd7-4a8c-9c99-0b38abf2ed14 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:10.677541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f077a7-5dd7-4a8c-9c99-0b38abf2ed14 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:10.677813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f077a7-5dd7-4a8c-9c99-0b38abf2ed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:10.723035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-49f077a7-5dd7-4a8c-9c99-0b38abf2ed14 None None] MFA Rules not processed for user `7132cae4ebd549d491f5d0dcf83394ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:10.730163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-49f077a7-5dd7-4a8c-9c99-0b38abf2ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:10.818444 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2402/4836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:11.015421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:11.019094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:11.177065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da798de0-2912-451f-bf83-1b1a96c44b15 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:11.186491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:11.188510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:11.188876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:11.189481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:11.202488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:11.204116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:11.224556 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2435/4837] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:13.573869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246444-911c-498a-a9e0-253878821358 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:13.574458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246444-911c-498a-a9e0-253878821358 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:13.574458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07246444-911c-498a-a9e0-253878821358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:13.619770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-07246444-911c-498a-a9e0-253878821358 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:13.621404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-07246444-911c-498a-a9e0-253878821358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:13.751431 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2403/4838] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:13.768556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:13.770175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:13.928445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804c5d-b041-4067-a141-3ec0e6019296 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:13.938408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ec8d5-3310-4a46-a5e9-951835f51461 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:13.939594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec8d5-3310-4a46-a5e9-951835f51461 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:13.940055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec8d5-3310-4a46-a5e9-951835f51461 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:13.940524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec8d5-3310-4a46-a5e9-951835f51461 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:13.958088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ec8d5-3310-4a46-a5e9-951835f51461 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:13.960061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ec8d5-3310-4a46-a5e9-951835f51461 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:13.988724 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2436/4839] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:06:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:14.396476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475433d7-634e-4428-a37c-b18e99a3ba6e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:14.396902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475433d7-634e-4428-a37c-b18e99a3ba6e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:14.397462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475433d7-634e-4428-a37c-b18e99a3ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:14.442080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-475433d7-634e-4428-a37c-b18e99a3ba6e None None] MFA Rules not processed for user `7132cae4ebd549d491f5d0dcf83394ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:14.443486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-475433d7-634e-4428-a37c-b18e99a3ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:14.460463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2404/4840] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:16.406813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ec8d5-3310-4a46-a5e9-951835f51461 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:16.429874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ec8d5-3310-4a46-a5e9-951835f51461 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:16.449963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:16.453951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:16.453951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:16.454253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:16.460753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:16.531761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:16.537403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:16.613206 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2437/4841] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:22.122829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475433d7-634e-4428-a37c-b18e99a3ba6e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:22.124907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-475433d7-634e-4428-a37c-b18e99a3ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:22.141138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475433d7-634e-4428-a37c-b18e99a3ba6e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:22.145248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:22.149235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:22.152970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:22.153484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:22.159211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:22.190172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:22.193221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:22.235136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2405/4842] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:06:28.901563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:28.903528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:28.925235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9f71-72b7-4353-8635-f5fe902c3d29 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:28.938369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:28.939743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:28.940668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:28.941389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] PATH_INFO: `/v3/users/59ce7bfa9c454b3389ec787812495827` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:28.946663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ce7bfa9c454b3389ec787812495827)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:28.949392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:29.030808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ce7bfa9c454b3389ec787812495827'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.046751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ce7bfa9c454b3389ec787812495827'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.065578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ce7bfa9c454b3389ec787812495827'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.066461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ce7bfa9c454b3389ec787812495827'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.067174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-64df009c-565e-41e4-b62b-2454ded1fd84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ce7bfa9c454b3389ec787812495827'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.087799 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2438/4843] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:06:28 2022] DELETE /identity/v3/users/59ce7bfa9c454b3389ec787812495827 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:06:29.333567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:29.351140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a963-2242-428f-9e9e-dcbef8e616fe service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:29.530458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:29.532276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:29.532926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:29.533430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] PATH_INFO: `/v3/projects/6e59ada015584cc6b980ae55cedc2103` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:29.538444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e59ada015584cc6b980ae55cedc2103)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:29.550975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:29.647366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e59ada015584cc6b980ae55cedc2103', 'request_id': 'req-c6739db8-5acf-4335-8c87-9f28b59615e2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.670323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e59ada015584cc6b980ae55cedc2103', 'request_id': 'req-c6739db8-5acf-4335-8c87-9f28b59615e2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.691555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e59ada015584cc6b980ae55cedc2103', 'request_id': 'req-c6739db8-5acf-4335-8c87-9f28b59615e2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.718824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] The token cache is being invalidate because project 6e59ada015584cc6b980ae55cedc2103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:06:29.719167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.720223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6739db8-5acf-4335-8c87-9f28b59615e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:29.723091 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2406/4844] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:06:29 2022] DELETE /identity/v3/projects/6e59ada015584cc6b980ae55cedc2103 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:06:29.730392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fa02f-9bcf-4153-ac75-14f28d38f46d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:29.730822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fa02f-9bcf-4153-ac75-14f28d38f46d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:29.731215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fa02f-9bcf-4153-ac75-14f28d38f46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:29.755271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-616fa02f-9bcf-4153-ac75-14f28d38f46d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:29.756567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-616fa02f-9bcf-4153-ac75-14f28d38f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:29.850865 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2439/4845] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:29.860735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3712-5f02-4483-8dbb-e06e72b72efe None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:29.861096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3712-5f02-4483-8dbb-e06e72b72efe None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:29.861292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c3712-5f02-4483-8dbb-e06e72b72efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:29.896157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a06c3712-5f02-4483-8dbb-e06e72b72efe None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:29.897381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a06c3712-5f02-4483-8dbb-e06e72b72efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:29.912968 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2407/4846] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:29.913904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fa02f-9bcf-4153-ac75-14f28d38f46d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:29.925686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fa02f-9bcf-4153-ac75-14f28d38f46d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:29.931961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:29.933020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:29.934729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:29.935299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:29.935791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:06:29.936269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:29.938249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:29.953190 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2440/4847] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:06:29.957966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3712-5f02-4483-8dbb-e06e72b72efe None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:29.975987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c3712-5f02-4483-8dbb-e06e72b72efe None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:29.988220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff0ea-e6fe-4b7e-8859-6a4b4e8037c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:29.989197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff0ea-e6fe-4b7e-8859-6a4b4e8037c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:29.990086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff0ea-e6fe-4b7e-8859-6a4b4e8037c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:29.990521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff0ea-e6fe-4b7e-8859-6a4b4e8037c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:29.991405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ff0ea-e6fe-4b7e-8859-6a4b4e8037c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:29.994233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ff0ea-e6fe-4b7e-8859-6a4b4e8037c2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:30.043300 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2408/4848] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:06:29 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:06:30.044866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:30.061069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e8bb-1ec2-43a6-8e92-b408c6c6805b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:30.141449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0576a-ef33-4114-b6db-9920b4c4ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:30.142565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0576a-ef33-4114-b6db-9920b4c4ca81 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:30.143122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0576a-ef33-4114-b6db-9920b4c4ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:30.143683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0576a-ef33-4114-b6db-9920b4c4ca81 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:30.144661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0576a-ef33-4114-b6db-9920b4c4ca81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:30.147179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0576a-ef33-4114-b6db-9920b4c4ca81 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:30.173783 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2441/4849] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:06:30 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:06:30.177640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff0ea-e6fe-4b7e-8859-6a4b4e8037c2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:30.193193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff0ea-e6fe-4b7e-8859-6a4b4e8037c2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:30.207672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003855-aed1-4191-96d1-d848f0f04033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:30.208410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003855-aed1-4191-96d1-d848f0f04033 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:30.208773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003855-aed1-4191-96d1-d848f0f04033 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:30.208945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003855-aed1-4191-96d1-d848f0f04033 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:30.210232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f003855-aed1-4191-96d1-d848f0f04033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:30.226093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f003855-aed1-4191-96d1-d848f0f04033 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:30.259713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2409/4850] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:06:30.264163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0576a-ef33-4114-b6db-9920b4c4ca81 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:30.281113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0576a-ef33-4114-b6db-9920b4c4ca81 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:30.299799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e1cdc-970c-441d-844c-045a90483e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:30.300828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e1cdc-970c-441d-844c-045a90483e4a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:30.301961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e1cdc-970c-441d-844c-045a90483e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:30.302438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e1cdc-970c-441d-844c-045a90483e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:30.305599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e1cdc-970c-441d-844c-045a90483e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:30.307456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e1cdc-970c-441d-844c-045a90483e4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:30.320787 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2442/4851] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:06:30.325225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003855-aed1-4191-96d1-d848f0f04033 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:30.336795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003855-aed1-4191-96d1-d848f0f04033 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:30.343666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:30.345151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:30.345750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:30.346444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] PATH_INFO: `/v3/projects/e5f81dcc5d52473ab53817e20df04cd9/users/20246495a35b4762be5b2ad98f537377/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:30.368942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f81dcc5d52473ab53817e20df04cd9, user_id=20246495a35b4762be5b2ad98f537377, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:30.372001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:30.396412 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2410/4852] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:06:30 2022] PUT /identity/v3/projects/e5f81dcc5d52473ab53817e20df04cd9/users/20246495a35b4762be5b2ad98f537377/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:06:30.402007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6c32-8f3d-4c2f-af9b-af3f42041108 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:30.403693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6c32-8f3d-4c2f-af9b-af3f42041108 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:30.404380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6c32-8f3d-4c2f-af9b-af3f42041108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:30.429886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-534f6c32-8f3d-4c2f-af9b-af3f42041108 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:30.432508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-534f6c32-8f3d-4c2f-af9b-af3f42041108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:30.506779 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2443/4853] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:06:30.518341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:30.520827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:30.644640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c301-1f87-4651-aa63-79270bd69c5f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:30.654920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1be60-064b-47d5-8ced-01124d04fa7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:30.654920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1be60-064b-47d5-8ced-01124d04fa7c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:30.654920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1be60-064b-47d5-8ced-01124d04fa7c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:30.654920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1be60-064b-47d5-8ced-01124d04fa7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:30.667776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1be60-064b-47d5-8ced-01124d04fa7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:30.669469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1be60-064b-47d5-8ced-01124d04fa7c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:30.696735 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2411/4854] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:31.973047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178b5b7-9238-47bc-bf3d-5c235e3c3ca9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:31.973582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178b5b7-9238-47bc-bf3d-5c235e3c3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:31.973819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178b5b7-9238-47bc-bf3d-5c235e3c3ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:32.073849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8178b5b7-9238-47bc-bf3d-5c235e3c3ca9 None None] MFA Rules not processed for user `20246495a35b4762be5b2ad98f537377`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:32.076288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8178b5b7-9238-47bc-bf3d-5c235e3c3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:32.259118 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2444/4855] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:32.272721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a283435-4a99-4712-921c-7c50e7d5f214 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:32.274420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a283435-4a99-4712-921c-7c50e7d5f214 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:32.274866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a283435-4a99-4712-921c-7c50e7d5f214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:32.301399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7a283435-4a99-4712-921c-7c50e7d5f214 None None] MFA Rules not processed for user `20246495a35b4762be5b2ad98f537377`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:32.303049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a283435-4a99-4712-921c-7c50e7d5f214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:32.330047 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2412/4856] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:32.350765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178b5b7-9238-47bc-bf3d-5c235e3c3ca9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:32.354795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8178b5b7-9238-47bc-bf3d-5c235e3c3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:32.497117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178b5b7-9238-47bc-bf3d-5c235e3c3ca9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:32.505572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:32.506990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:32.507405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:32.507817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:32.528561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:32.530514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:32.543051 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2445/4857] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:33.454164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a283435-4a99-4712-921c-7c50e7d5f214 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:33.454164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a283435-4a99-4712-921c-7c50e7d5f214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:33.471918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a283435-4a99-4712-921c-7c50e7d5f214 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:33.476082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:33.478829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:33.478990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:33.479252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:33.482739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:33.503429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:33.505509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:33.522970 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2413/4858] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:43.949393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:43.951916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:43.973951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05644ac-ffc6-4f44-b78f-a980b6bf3de9 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:43.982285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:43.983125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:43.983513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:43.983887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:43.986545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:44.011556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:44.013640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:44.030376 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2446/4859] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:45.319660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:45.336004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dfd04-6afb-45da-8ee1-cbd2c2793c5d service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:45.343524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:45.344623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:45.345124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:45.345608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:45.348825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:45.364117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:45.365952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:45.379802 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2414/4860] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:45.940940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:45.946101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:45.981269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20f2f8-2d3a-4406-b0ce-dfcf42ae5868 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:45.987021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:45.988055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:45.988480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:45.988960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] PATH_INFO: `/v3/users/2ff7364263f04529910770039084fb7f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:45.990762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff7364263f04529910770039084fb7f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:45.993635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:46.083282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff7364263f04529910770039084fb7f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.122785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff7364263f04529910770039084fb7f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.156223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff7364263f04529910770039084fb7f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.157172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff7364263f04529910770039084fb7f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.158730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-524add22-a989-47ad-ae9e-862c9712d763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff7364263f04529910770039084fb7f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.217802 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2447/4861] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:06:45 2022] DELETE /identity/v3/users/2ff7364263f04529910770039084fb7f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:06:46.485794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:46.513843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa611-16fa-4684-a584-6c8cad7fa739 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:46.657287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:46.658497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:46.659000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:46.659536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] PATH_INFO: `/v3/projects/3e16b1ae38144c3ba7d8cb99e46eea10` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:46.661322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e16b1ae38144c3ba7d8cb99e46eea10)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:46.665128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:46.773837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e16b1ae38144c3ba7d8cb99e46eea10', 'request_id': 'req-d9d06fff-2699-4265-a434-994418de5707'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.781943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e16b1ae38144c3ba7d8cb99e46eea10', 'request_id': 'req-d9d06fff-2699-4265-a434-994418de5707'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.794337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e16b1ae38144c3ba7d8cb99e46eea10', 'request_id': 'req-d9d06fff-2699-4265-a434-994418de5707'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.817443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] The token cache is being invalidate because project 3e16b1ae38144c3ba7d8cb99e46eea10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:06:46.817996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.820279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d9d06fff-2699-4265-a434-994418de5707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:06:46.822393 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2415/4862] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:06:46 2022] DELETE /identity/v3/projects/3e16b1ae38144c3ba7d8cb99e46eea10 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:06:46.828260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f4d7-8b5e-4ae7-b057-33c89d189b9a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:46.828698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f4d7-8b5e-4ae7-b057-33c89d189b9a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:46.829230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f4d7-8b5e-4ae7-b057-33c89d189b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:46.864416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1510f4d7-8b5e-4ae7-b057-33c89d189b9a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:46.866514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1510f4d7-8b5e-4ae7-b057-33c89d189b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:46.988927 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2448/4863] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:46.990340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13d30-714a-4073-a3ea-b0c1f93b4d81 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:46.990800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13d30-714a-4073-a3ea-b0c1f93b4d81 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:46.991291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13d30-714a-4073-a3ea-b0c1f93b4d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:47.050226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1da13d30-714a-4073-a3ea-b0c1f93b4d81 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:47.051488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1da13d30-714a-4073-a3ea-b0c1f93b4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:47.065623 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2416/4864] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:47.071323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f4d7-8b5e-4ae7-b057-33c89d189b9a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:47.083597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f4d7-8b5e-4ae7-b057-33c89d189b9a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:47.089974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:47.091355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:47.094304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:47.094864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:47.095969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:06:47.097359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:47.099766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:47.123512 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2449/4865] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:06:47.127145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da13d30-714a-4073-a3ea-b0c1f93b4d81 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:47.138294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da13d30-714a-4073-a3ea-b0c1f93b4d81 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:47.143952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeedec-bb52-42a6-a8e1-ba44c64d3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:47.145140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeedec-bb52-42a6-a8e1-ba44c64d3e43 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:47.145891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeedec-bb52-42a6-a8e1-ba44c64d3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:47.146530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeedec-bb52-42a6-a8e1-ba44c64d3e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:47.148242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeedec-bb52-42a6-a8e1-ba44c64d3e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:47.151754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeedec-bb52-42a6-a8e1-ba44c64d3e43 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:47.200219 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2417/4866] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:06:47 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:06:47.204111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:47.219962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995618b8-2f87-4090-ae3d-49d334094af9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:47.376796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e499f17-7baf-4c4b-8cd1-a9720a0d2860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:47.378423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e499f17-7baf-4c4b-8cd1-a9720a0d2860 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:47.378993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e499f17-7baf-4c4b-8cd1-a9720a0d2860 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:47.381657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e499f17-7baf-4c4b-8cd1-a9720a0d2860 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:47.383324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e499f17-7baf-4c4b-8cd1-a9720a0d2860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:47.386693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e499f17-7baf-4c4b-8cd1-a9720a0d2860 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:47.428884 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2450/4867] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:06:47 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:06:47.433318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeedec-bb52-42a6-a8e1-ba44c64d3e43 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:47.456303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeedec-bb52-42a6-a8e1-ba44c64d3e43 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:47.465110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a48cf2-e52a-436a-adeb-b61c3f3eb1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:47.466524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48cf2-e52a-436a-adeb-b61c3f3eb1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:47.466985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48cf2-e52a-436a-adeb-b61c3f3eb1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:47.477811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48cf2-e52a-436a-adeb-b61c3f3eb1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:47.480604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a48cf2-e52a-436a-adeb-b61c3f3eb1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:47.485286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a48cf2-e52a-436a-adeb-b61c3f3eb1a7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:47.499764 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2418/4868] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:06:47.503666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e499f17-7baf-4c4b-8cd1-a9720a0d2860 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:47.521017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e499f17-7baf-4c4b-8cd1-a9720a0d2860 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:47.531801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae540-625e-4922-b2f5-c6f27a885eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:47.532863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae540-625e-4922-b2f5-c6f27a885eda admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:47.533373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae540-625e-4922-b2f5-c6f27a885eda admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:47.533959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae540-625e-4922-b2f5-c6f27a885eda admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:47.535646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ae540-625e-4922-b2f5-c6f27a885eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:47.538004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ae540-625e-4922-b2f5-c6f27a885eda admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:47.567421 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2451/4869] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:06:47.570284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a48cf2-e52a-436a-adeb-b61c3f3eb1a7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:47.597773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a48cf2-e52a-436a-adeb-b61c3f3eb1a7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:47.610682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:47.614247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:47.614616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:47.614976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] PATH_INFO: `/v3/projects/f260ed47c5994487a4cc293c33dae3ea/users/2ee3e5caf3e44b21b66cf9ad197e5999/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:47.654006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f260ed47c5994487a4cc293c33dae3ea, user_id=2ee3e5caf3e44b21b66cf9ad197e5999, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:47.661742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:47.718237 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2419/4870] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:06:47 2022] PUT /identity/v3/projects/f260ed47c5994487a4cc293c33dae3ea/users/2ee3e5caf3e44b21b66cf9ad197e5999/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:06:47.723454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e31f22-1352-4a27-91d7-afbdb4225218 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:47.724000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e31f22-1352-4a27-91d7-afbdb4225218 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:47.724289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e31f22-1352-4a27-91d7-afbdb4225218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:47.748018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f4e31f22-1352-4a27-91d7-afbdb4225218 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:47.749590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f4e31f22-1352-4a27-91d7-afbdb4225218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:47.876564 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2452/4871] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:47.888369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:47.895151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:47.993986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71da21-8ac3-40fd-aaab-aa0a0c37f5c7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:48.002182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:48.008181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:48.008696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:48.009151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:48.031551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:48.033206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:48.048565 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2420/4872] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:06:49.224642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b9fc-510b-45f7-9285-d27d8ac9a62e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:49.225652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b9fc-510b-45f7-9285-d27d8ac9a62e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:49.226679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b9fc-510b-45f7-9285-d27d8ac9a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:49.285218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e624b9fc-510b-45f7-9285-d27d8ac9a62e None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:49.287139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e624b9fc-510b-45f7-9285-d27d8ac9a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:49.388362 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2453/4873] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:49.409620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:06:49.411731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:49.556462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd9d9b-5c30-4058-b6a4-0c6a8f28e715 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:06:49.567753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ebefb-347a-416d-a40d-6a5c9d3f17c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:06:49.570030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ebefb-347a-416d-a40d-6a5c9d3f17c9 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:49.571781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ebefb-347a-416d-a40d-6a5c9d3f17c9 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:49.573306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ebefb-347a-416d-a40d-6a5c9d3f17c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:49.626834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ebefb-347a-416d-a40d-6a5c9d3f17c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:06:49.629431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ebefb-347a-416d-a40d-6a5c9d3f17c9 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:06:49.647518 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2421/4874] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:06:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:50.450684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6465a47-55e6-4d1f-a1cc-0579ee920f81 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:50.451234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6465a47-55e6-4d1f-a1cc-0579ee920f81 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:50.451379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6465a47-55e6-4d1f-a1cc-0579ee920f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:50.494379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d6465a47-55e6-4d1f-a1cc-0579ee920f81 None None] MFA Rules not processed for user `0edf621841d44514b6082172d15af2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:50.495633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d6465a47-55e6-4d1f-a1cc-0579ee920f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:50.626570 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2454/4875] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:06:56.659565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe329c-ff1e-4843-8c88-b4126f1a2f92 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:06:56.659983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe329c-ff1e-4843-8c88-b4126f1a2f92 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:06:56.660100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe329c-ff1e-4843-8c88-b4126f1a2f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:06:56.721680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-97fe329c-ff1e-4843-8c88-b4126f1a2f92 None None] MFA Rules not processed for user `20246495a35b4762be5b2ad98f537377`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:06:56.725603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-97fe329c-ff1e-4843-8c88-b4126f1a2f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:06:56.970334 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2422/4876] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:07.282764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34663b-922a-4262-9166-b60768a1b936 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:07.284199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34663b-922a-4262-9166-b60768a1b936 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:07.284777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34663b-922a-4262-9166-b60768a1b936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:07.409826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fc34663b-922a-4262-9166-b60768a1b936 None None] MFA Rules not processed for user `2ee3e5caf3e44b21b66cf9ad197e5999`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:07.415556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fc34663b-922a-4262-9166-b60768a1b936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:07.518499 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2455/4877] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:07.522964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe329c-ff1e-4843-8c88-b4126f1a2f92 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:07.539898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe329c-ff1e-4843-8c88-b4126f1a2f92 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:07.547734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9624d8-5abe-4159-ac8c-52a338e5c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:07.549321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9624d8-5abe-4159-ac8c-52a338e5c9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:07.549773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9624d8-5abe-4159-ac8c-52a338e5c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:07.550234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9624d8-5abe-4159-ac8c-52a338e5c9a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:07.551312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9624d8-5abe-4159-ac8c-52a338e5c9a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:07.553734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9624d8-5abe-4159-ac8c-52a338e5c9a4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:07.606541 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2423/4878] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:07 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:07.611274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34663b-922a-4262-9166-b60768a1b936 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:07.626198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34663b-922a-4262-9166-b60768a1b936 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:07.771421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466dfc3-cb2a-445f-bd02-42d70bf0f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:07.772421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dfc3-cb2a-445f-bd02-42d70bf0f327 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:07.773441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dfc3-cb2a-445f-bd02-42d70bf0f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:07.773906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dfc3-cb2a-445f-bd02-42d70bf0f327 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:07.774790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466dfc3-cb2a-445f-bd02-42d70bf0f327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:07.777658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466dfc3-cb2a-445f-bd02-42d70bf0f327 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:07.825843 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2456/4879] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:07:07 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:07.827565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9624d8-5abe-4159-ac8c-52a338e5c9a4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:07.848561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9624d8-5abe-4159-ac8c-52a338e5c9a4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:07.868917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc68b4-29b7-4258-8fb8-b54ea4413f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:07.869618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc68b4-29b7-4258-8fb8-b54ea4413f9f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:07.875958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc68b4-29b7-4258-8fb8-b54ea4413f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:07.876374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc68b4-29b7-4258-8fb8-b54ea4413f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:07.877189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc68b4-29b7-4258-8fb8-b54ea4413f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:07.883600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc68b4-29b7-4258-8fb8-b54ea4413f9f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:07.915998 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2424/4880] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:07.920569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466dfc3-cb2a-445f-bd02-42d70bf0f327 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:07.937366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466dfc3-cb2a-445f-bd02-42d70bf0f327 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:07.954283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45065-c7d9-46a4-9b6c-b59ab03c87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:07.955855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45065-c7d9-46a4-9b6c-b59ab03c87bd admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:07.956313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45065-c7d9-46a4-9b6c-b59ab03c87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:07.956625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45065-c7d9-46a4-9b6c-b59ab03c87bd admin admin] PATH_INFO: `/v3/projects/2eb68cf3f53d44348dc921e15fd8fb0d/users/a73996b5997a4daf83a013ceee247542/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:08.002072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f45065-c7d9-46a4-9b6c-b59ab03c87bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb68cf3f53d44348dc921e15fd8fb0d, user_id=a73996b5997a4daf83a013ceee247542, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:08.009336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f45065-c7d9-46a4-9b6c-b59ab03c87bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:08.046224 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2457/4881] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:07 2022] PUT /identity/v3/projects/2eb68cf3f53d44348dc921e15fd8fb0d/users/a73996b5997a4daf83a013ceee247542/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:08.049488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc68b4-29b7-4258-8fb8-b54ea4413f9f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:08.080700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc68b4-29b7-4258-8fb8-b54ea4413f9f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:08.240867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d33b48-5365-4362-abaa-295e660aeda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:08.243241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33b48-5365-4362-abaa-295e660aeda9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:08.245335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33b48-5365-4362-abaa-295e660aeda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:08.245993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33b48-5365-4362-abaa-295e660aeda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:08.251461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d33b48-5365-4362-abaa-295e660aeda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:08.256163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d33b48-5365-4362-abaa-295e660aeda9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:08.312554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2425/4882] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:08.313578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45065-c7d9-46a4-9b6c-b59ab03c87bd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:08.336939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45065-c7d9-46a4-9b6c-b59ab03c87bd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:08.364933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586adf9-660f-431d-a642-99de641bf79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:08.367886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586adf9-660f-431d-a642-99de641bf79a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:08.371647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586adf9-660f-431d-a642-99de641bf79a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:08.372642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586adf9-660f-431d-a642-99de641bf79a admin admin] PATH_INFO: `/v3/projects/2eb68cf3f53d44348dc921e15fd8fb0d/users/a73996b5997a4daf83a013ceee247542/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:08.385376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586adf9-660f-431d-a642-99de641bf79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb68cf3f53d44348dc921e15fd8fb0d, user_id=a73996b5997a4daf83a013ceee247542, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:08.390207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586adf9-660f-431d-a642-99de641bf79a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:08.425525 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2458/4883] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:08 2022] PUT /identity/v3/projects/2eb68cf3f53d44348dc921e15fd8fb0d/users/a73996b5997a4daf83a013ceee247542/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:09.378996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4e17-9eae-4e6b-b42b-f056a3faabdb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:09.379571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4e17-9eae-4e6b-b42b-f056a3faabdb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:09.379571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4e17-9eae-4e6b-b42b-f056a3faabdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:09.406613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-265f4e17-9eae-4e6b-b42b-f056a3faabdb None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:09.409013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-265f4e17-9eae-4e6b-b42b-f056a3faabdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:09.572145 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2426/4884] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:09.624381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586adf9-660f-431d-a642-99de641bf79a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:09.768745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586adf9-660f-431d-a642-99de641bf79a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:09.782560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:09.783390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:09.783746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:09.784096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:09.803658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:09.806433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:09.827042 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2459/4885] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:07:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:22.446899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1da285-7a55-42b4-bf9d-4382a5f4a3d3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:22.447629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1da285-7a55-42b4-bf9d-4382a5f4a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:22.447629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1da285-7a55-42b4-bf9d-4382a5f4a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:22.513627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4b1da285-7a55-42b4-bf9d-4382a5f4a3d3 None None] MFA Rules not processed for user `a73996b5997a4daf83a013ceee247542`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:22.514975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4b1da285-7a55-42b4-bf9d-4382a5f4a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:22.631849 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2427/4886] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:22.643986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:22.646501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:22.762753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63303490-6705-43c2-843c-3b5c3283a1f5 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:22.771933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239d9a5-fb20-4ff7-9d15-f39c94b43ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:22.776815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239d9a5-fb20-4ff7-9d15-f39c94b43ccd service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:22.777320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239d9a5-fb20-4ff7-9d15-f39c94b43ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:22.777785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239d9a5-fb20-4ff7-9d15-f39c94b43ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:22.881267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239d9a5-fb20-4ff7-9d15-f39c94b43ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:22.884149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239d9a5-fb20-4ff7-9d15-f39c94b43ccd service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:22.917201 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2460/4887] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:07:32.052215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd1ccb-4392-4884-9a36-6df74675c4b5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:32.052868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd1ccb-4392-4884-9a36-6df74675c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:32.053005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd1ccb-4392-4884-9a36-6df74675c4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:32.075653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dacd1ccb-4392-4884-9a36-6df74675c4b5 None None] MFA Rules not processed for user `a388edbf88ba4749b3abb2a42b750757`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:32.077073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dacd1ccb-4392-4884-9a36-6df74675c4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:32.161836 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2428/4888] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:36.736789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ea76-2528-4486-ab82-4336c8a6045e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:36.739702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ea76-2528-4486-ab82-4336c8a6045e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:36.740285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ea76-2528-4486-ab82-4336c8a6045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:36.765740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8439ea76-2528-4486-ab82-4336c8a6045e None None] MFA Rules not processed for user `20246495a35b4762be5b2ad98f537377`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:36.768643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8439ea76-2528-4486-ab82-4336c8a6045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:36.883345 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2461/4889] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:39.262905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98669083-c2fa-4a10-88a7-3dc1aa09eadb None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:39.263437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98669083-c2fa-4a10-88a7-3dc1aa09eadb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:39.263437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98669083-c2fa-4a10-88a7-3dc1aa09eadb None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:39.265634 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2429/4890] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:07:39.281161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee82ee-55d1-48ca-9aec-698dee95d7a5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:39.282827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee82ee-55d1-48ca-9aec-698dee95d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:39.283329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee82ee-55d1-48ca-9aec-698dee95d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:39.386235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-90ee82ee-55d1-48ca-9aec-698dee95d7a5 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:39.387835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-90ee82ee-55d1-48ca-9aec-698dee95d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:39.547835 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2462/4891] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:39.593528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98669083-c2fa-4a10-88a7-3dc1aa09eadb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:39.599518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-98669083-c2fa-4a10-88a7-3dc1aa09eadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:39.650204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98669083-c2fa-4a10-88a7-3dc1aa09eadb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:39.659860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:39.661508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:39.661954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:39.663266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:39.679220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:39.683136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:39.704461 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2430/4892] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:07:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:07:39.921212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211762d-c6e5-4ac1-888d-cbb6e78ef3df None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:39.922259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211762d-c6e5-4ac1-888d-cbb6e78ef3df None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:39.923932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211762d-c6e5-4ac1-888d-cbb6e78ef3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:39.964718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d211762d-c6e5-4ac1-888d-cbb6e78ef3df None None] MFA Rules not processed for user `20246495a35b4762be5b2ad98f537377`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:39.973870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d211762d-c6e5-4ac1-888d-cbb6e78ef3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:40.013384 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2463/4893] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:41.484852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:41.487643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:41.678684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7127-efae-4bb9-a3ac-a2d507f86637 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:41.687217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:41.688118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:41.688424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:41.688887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] PATH_INFO: `/v3/users/e36bd5d716db4dba866a1bcd880accb8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:41.690972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36bd5d716db4dba866a1bcd880accb8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:41.694445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:41.833738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36bd5d716db4dba866a1bcd880accb8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:41.834803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36bd5d716db4dba866a1bcd880accb8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:41.837105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36bd5d716db4dba866a1bcd880accb8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:41.868724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36bd5d716db4dba866a1bcd880accb8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:41.890133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a210f93-75dc-4f76-a070-858c98574107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36bd5d716db4dba866a1bcd880accb8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:41.936239 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2431/4894] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:07:41 2022] DELETE /identity/v3/users/e36bd5d716db4dba866a1bcd880accb8 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:42.974034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211762d-c6e5-4ac1-888d-cbb6e78ef3df None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:42.989784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211762d-c6e5-4ac1-888d-cbb6e78ef3df None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:43.083017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:43.084542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.085748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.086253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] PATH_INFO: `/v3/projects/5ee065d1c70940cd8caadd525737c593` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.088955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee065d1c70940cd8caadd525737c593)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:43.092122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:43.158379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee065d1c70940cd8caadd525737c593', 'request_id': 'req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:43.164898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee065d1c70940cd8caadd525737c593', 'request_id': 'req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:43.174628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee065d1c70940cd8caadd525737c593', 'request_id': 'req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:43.189848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] The token cache is being invalidate because project 5ee065d1c70940cd8caadd525737c593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:07:43.190694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:43.191581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c50e1f7-bb10-481b-8810-cb3c5398ed0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:43.193852 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2464/4895] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:07:42 2022] DELETE /identity/v3/projects/5ee065d1c70940cd8caadd525737c593 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:43.200173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b202a3-e273-46f5-bfee-9a40b4b9beff None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.200746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b202a3-e273-46f5-bfee-9a40b4b9beff None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.200746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b202a3-e273-46f5-bfee-9a40b4b9beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.226051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-71b202a3-e273-46f5-bfee-9a40b4b9beff None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:43.230519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71b202a3-e273-46f5-bfee-9a40b4b9beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:43.309353 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2432/4896] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:43.322313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052327ad-de56-469b-9d12-dd0078272306 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.322999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052327ad-de56-469b-9d12-dd0078272306 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.323283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052327ad-de56-469b-9d12-dd0078272306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.349569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-052327ad-de56-469b-9d12-dd0078272306 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:43.351003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-052327ad-de56-469b-9d12-dd0078272306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:43.360580 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2465/4897] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:43.364866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b202a3-e273-46f5-bfee-9a40b4b9beff None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:43.379251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b202a3-e273-46f5-bfee-9a40b4b9beff None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:43.390641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:43.391550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.392583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.393526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.394538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:07:43.395066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:43.397038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:43.412721 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2433/4898] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:07:43.417306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052327ad-de56-469b-9d12-dd0078272306 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:43.443819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052327ad-de56-469b-9d12-dd0078272306 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:43.450608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7b0f-e1da-4de8-a3f5-1e2b2e1923f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:43.452860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7b0f-e1da-4de8-a3f5-1e2b2e1923f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.453161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7b0f-e1da-4de8-a3f5-1e2b2e1923f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.453743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7b0f-e1da-4de8-a3f5-1e2b2e1923f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.454680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a7b0f-e1da-4de8-a3f5-1e2b2e1923f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:43.456973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a7b0f-e1da-4de8-a3f5-1e2b2e1923f3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:43.509622 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2466/4899] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:43 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:43.513946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:43.544585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddeeff-53c2-4bdb-b6ec-9b6babf11592 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:43.644620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d6424-dce5-4bcb-9246-2f428ec2f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:43.645307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6424-dce5-4bcb-9246-2f428ec2f8ba admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.645597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6424-dce5-4bcb-9246-2f428ec2f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.645920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6424-dce5-4bcb-9246-2f428ec2f8ba admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.646679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d6424-dce5-4bcb-9246-2f428ec2f8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:43.649732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d6424-dce5-4bcb-9246-2f428ec2f8ba admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:43.685836 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2434/4900] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:07:43 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:43.691526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7b0f-e1da-4de8-a3f5-1e2b2e1923f3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:43.724814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7b0f-e1da-4de8-a3f5-1e2b2e1923f3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:43.749082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4862678-e1a7-41ab-aae3-82f6fa782ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:43.749808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862678-e1a7-41ab-aae3-82f6fa782ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.750097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862678-e1a7-41ab-aae3-82f6fa782ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.750379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862678-e1a7-41ab-aae3-82f6fa782ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.751116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4862678-e1a7-41ab-aae3-82f6fa782ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:43.752900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4862678-e1a7-41ab-aae3-82f6fa782ab2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:43.767627 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2467/4901] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:43.772378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d6424-dce5-4bcb-9246-2f428ec2f8ba admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:43.790343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d6424-dce5-4bcb-9246-2f428ec2f8ba admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:43.801567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad869a8-f263-4392-93db-fc688705b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:43.803160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad869a8-f263-4392-93db-fc688705b3ea admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.805096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad869a8-f263-4392-93db-fc688705b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.805698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad869a8-f263-4392-93db-fc688705b3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.808371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad869a8-f263-4392-93db-fc688705b3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:43.812569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad869a8-f263-4392-93db-fc688705b3ea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:43.834691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2435/4902] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:43.839879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4862678-e1a7-41ab-aae3-82f6fa782ab2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:43.855976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4862678-e1a7-41ab-aae3-82f6fa782ab2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:43.861837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:43.862890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.863314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.863602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] PATH_INFO: `/v3/projects/b5a5b2f0972548da9895d596ad42cd99/users/5df1abd3e9294b6791706ef730fdabde/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.892477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a5b2f0972548da9895d596ad42cd99, user_id=5df1abd3e9294b6791706ef730fdabde, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:43.897172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:43.930857 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2468/4903] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:43 2022] PUT /identity/v3/projects/b5a5b2f0972548da9895d596ad42cd99/users/5df1abd3e9294b6791706ef730fdabde/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:43.939869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c971-dcf8-4541-bd11-b78336c6e2a7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:43.940692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c971-dcf8-4541-bd11-b78336c6e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:43.941202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c971-dcf8-4541-bd11-b78336c6e2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:43.975745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9295c971-dcf8-4541-bd11-b78336c6e2a7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:43.978607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9295c971-dcf8-4541-bd11-b78336c6e2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:44.095927 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2436/4904] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:44.102696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:44.104995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:44.109810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295c971-dcf8-4541-bd11-b78336c6e2a7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:44.111255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9295c971-dcf8-4541-bd11-b78336c6e2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:44.119608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecc895-8dce-4336-9eee-5236f8a0421c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:44.125792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:44.126819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:44.127043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:44.127347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] PATH_INFO: `/v3/users/73e0f6e46efc4d18b151fc2acfe6484d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:44.128899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e0f6e46efc4d18b151fc2acfe6484d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:44.130914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:44.184632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295c971-dcf8-4541-bd11-b78336c6e2a7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:44.189173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c301e9-1bab-4f00-a03a-009f91ce7dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:44.190038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c301e9-1bab-4f00-a03a-009f91ce7dfd service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:44.190643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c301e9-1bab-4f00-a03a-009f91ce7dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:44.191004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c301e9-1bab-4f00-a03a-009f91ce7dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:44.204159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e0f6e46efc4d18b151fc2acfe6484d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.204281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c301e9-1bab-4f00-a03a-009f91ce7dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:44.205800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c301e9-1bab-4f00-a03a-009f91ce7dfd service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:44.218038 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2437/4905] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:07:44.221921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e0f6e46efc4d18b151fc2acfe6484d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.246724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e0f6e46efc4d18b151fc2acfe6484d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.247669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e0f6e46efc4d18b151fc2acfe6484d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.248735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e0f6e46efc4d18b151fc2acfe6484d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.265990 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2469/4906] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:07:44 2022] DELETE /identity/v3/users/73e0f6e46efc4d18b151fc2acfe6484d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:44.270595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99582-1087-4f5c-9fb0-49e6df2694ca None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:44.270882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99582-1087-4f5c-9fb0-49e6df2694ca None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:44.271161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99582-1087-4f5c-9fb0-49e6df2694ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:44.289952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-59a99582-1087-4f5c-9fb0-49e6df2694ca None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:44.291342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-59a99582-1087-4f5c-9fb0-49e6df2694ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:44.359139 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2438/4907] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:07:44.369724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:44.371178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:44.460624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046adc-a885-4a30-bcaf-6e577fa81ddf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:44.465230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca236fc1-d383-4a46-a981-18447e145efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:44.466064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236fc1-d383-4a46-a981-18447e145efc service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:44.466448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236fc1-d383-4a46-a981-18447e145efc service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:44.466792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236fc1-d383-4a46-a981-18447e145efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:44.494583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca236fc1-d383-4a46-a981-18447e145efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:44.496504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca236fc1-d383-4a46-a981-18447e145efc service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:44.511213 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2470/4908] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:07:44.737148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99582-1087-4f5c-9fb0-49e6df2694ca None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:44.742922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-59a99582-1087-4f5c-9fb0-49e6df2694ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:44.781169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99582-1087-4f5c-9fb0-49e6df2694ca None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:44.789712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:44.790690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:44.790971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:44.791260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] PATH_INFO: `/v3/projects/9d72316bcd0440d482839e842e71771e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:44.793121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d72316bcd0440d482839e842e71771e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:44.796672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:44.870682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d72316bcd0440d482839e842e71771e', 'request_id': 'req-d75eb81e-61fe-4158-a3c9-7c8615569e2b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.877713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d72316bcd0440d482839e842e71771e', 'request_id': 'req-d75eb81e-61fe-4158-a3c9-7c8615569e2b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.887680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d72316bcd0440d482839e842e71771e', 'request_id': 'req-d75eb81e-61fe-4158-a3c9-7c8615569e2b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.907357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] The token cache is being invalidate because project 9d72316bcd0440d482839e842e71771e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:07:44.907751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.908498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d75eb81e-61fe-4158-a3c9-7c8615569e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:44.910105 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2439/4909] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:07:44 2022] DELETE /identity/v3/projects/9d72316bcd0440d482839e842e71771e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:44.920894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c206d-9d3e-48a9-b12b-b8084d59e386 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:44.921285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c206d-9d3e-48a9-b12b-b8084d59e386 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:44.921646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c206d-9d3e-48a9-b12b-b8084d59e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:44.945293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-880c206d-9d3e-48a9-b12b-b8084d59e386 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:44.946525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-880c206d-9d3e-48a9-b12b-b8084d59e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:45.010679 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2471/4910] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:45.019069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f425-fa3b-45f7-bec1-658f6c24355b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.019580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f425-fa3b-45f7-bec1-658f6c24355b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.020065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f425-fa3b-45f7-bec1-658f6c24355b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.042433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a753f425-fa3b-45f7-bec1-658f6c24355b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:45.044053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a753f425-fa3b-45f7-bec1-658f6c24355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:45.052048 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2440/4911] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:07:45.056773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c206d-9d3e-48a9-b12b-b8084d59e386 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:45.067351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c206d-9d3e-48a9-b12b-b8084d59e386 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:45.072624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:45.073416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.073708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.073988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.074844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:07:45.075162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:45.076804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:45.092880 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2472/4912] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:07:45.094178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f425-fa3b-45f7-bec1-658f6c24355b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:45.103944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f425-fa3b-45f7-bec1-658f6c24355b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:45.108895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbfc6b-e4d8-4077-8008-3ca73ffdba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:45.109550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbfc6b-e4d8-4077-8008-3ca73ffdba7a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.109829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbfc6b-e4d8-4077-8008-3ca73ffdba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.110102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbfc6b-e4d8-4077-8008-3ca73ffdba7a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.110781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbfc6b-e4d8-4077-8008-3ca73ffdba7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:45.112714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbfc6b-e4d8-4077-8008-3ca73ffdba7a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:45.140872 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2441/4913] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:45 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:07:45.145384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:45.155472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851f328-f5ca-4dce-9380-c46ea95bda10 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:45.216042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0f97a-f9d5-4464-bb38-892183cc6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:45.216767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f97a-f9d5-4464-bb38-892183cc6baa admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.217054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f97a-f9d5-4464-bb38-892183cc6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.217335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f97a-f9d5-4464-bb38-892183cc6baa admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.218043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0f97a-f9d5-4464-bb38-892183cc6baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:45.219974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0f97a-f9d5-4464-bb38-892183cc6baa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:45.242897 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2473/4914] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:07:45 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:45.247802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbfc6b-e4d8-4077-8008-3ca73ffdba7a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:45.260158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbfc6b-e4d8-4077-8008-3ca73ffdba7a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:45.266661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91552949-dfe8-4c8c-b4c8-7a4bff0e611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:45.267512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552949-dfe8-4c8c-b4c8-7a4bff0e611b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.268104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552949-dfe8-4c8c-b4c8-7a4bff0e611b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.269051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552949-dfe8-4c8c-b4c8-7a4bff0e611b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.269865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91552949-dfe8-4c8c-b4c8-7a4bff0e611b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:45.273219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91552949-dfe8-4c8c-b4c8-7a4bff0e611b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:45.287238 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2442/4915] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:45.292178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0f97a-f9d5-4464-bb38-892183cc6baa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:45.303531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0f97a-f9d5-4464-bb38-892183cc6baa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:45.308377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bdae2-1bad-409d-be66-c4bbd4425470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:45.309085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bdae2-1bad-409d-be66-c4bbd4425470 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.309375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bdae2-1bad-409d-be66-c4bbd4425470 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.309662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bdae2-1bad-409d-be66-c4bbd4425470 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.310387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bdae2-1bad-409d-be66-c4bbd4425470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:45.311975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bdae2-1bad-409d-be66-c4bbd4425470 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:45.322850 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2474/4916] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:07:45.327405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91552949-dfe8-4c8c-b4c8-7a4bff0e611b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:45.340200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91552949-dfe8-4c8c-b4c8-7a4bff0e611b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:45.345534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:45.346418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.346703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.346978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] PATH_INFO: `/v3/projects/bb8a3c6073ff4deca9e6c75ece698405/users/7fb0e17a60d44a8ab4114bea43e4a829/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.362412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8a3c6073ff4deca9e6c75ece698405, user_id=7fb0e17a60d44a8ab4114bea43e4a829, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:45.365125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:45.381377 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2443/4917] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:45 2022] PUT /identity/v3/projects/bb8a3c6073ff4deca9e6c75ece698405/users/7fb0e17a60d44a8ab4114bea43e4a829/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:45.392740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec774d-1419-425d-8082-303e27ca88ac None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.393155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec774d-1419-425d-8082-303e27ca88ac None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.393524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec774d-1419-425d-8082-303e27ca88ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.433225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-54ec774d-1419-425d-8082-303e27ca88ac None None] MFA Rules not processed for user `7fb0e17a60d44a8ab4114bea43e4a829`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:45.434926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-54ec774d-1419-425d-8082-303e27ca88ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:45.525127 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2475/4918] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:07:45.534718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:45.536776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:45.628760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e76dc-2bee-405a-ad24-eb91395ccbbb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:45.635358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aae2e-efec-45c4-bfe7-7e0e729e4a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:45.636190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aae2e-efec-45c4-bfe7-7e0e729e4a90 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.636657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aae2e-efec-45c4-bfe7-7e0e729e4a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.637090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aae2e-efec-45c4-bfe7-7e0e729e4a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.648109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aae2e-efec-45c4-bfe7-7e0e729e4a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:45.649884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aae2e-efec-45c4-bfe7-7e0e729e4a90 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:45.661150 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2444/4919] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:07:45.887109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c929b2-bf76-42af-9532-63d98d1fc8ef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.887405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c929b2-bf76-42af-9532-63d98d1fc8ef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.887673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c929b2-bf76-42af-9532-63d98d1fc8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:45.907004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-37c929b2-bf76-42af-9532-63d98d1fc8ef None None] MFA Rules not processed for user `2ee3e5caf3e44b21b66cf9ad197e5999`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:45.908448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37c929b2-bf76-42af-9532-63d98d1fc8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:45.973519 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2476/4920] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:45.984604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f5d94-750e-40eb-9846-c46d5cdec521 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:45.984890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f5d94-750e-40eb-9846-c46d5cdec521 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:45.985373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f5d94-750e-40eb-9846-c46d5cdec521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:46.004319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f05f5d94-750e-40eb-9846-c46d5cdec521 None None] MFA Rules not processed for user `2ee3e5caf3e44b21b66cf9ad197e5999`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:46.005909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f05f5d94-750e-40eb-9846-c46d5cdec521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:46.016059 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2445/4921] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:46.277398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e16457-3857-4a4e-a38e-1309a5a2446c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:46.278431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e16457-3857-4a4e-a38e-1309a5a2446c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:46.278725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e16457-3857-4a4e-a38e-1309a5a2446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:46.315955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-69e16457-3857-4a4e-a38e-1309a5a2446c None None] MFA Rules not processed for user `5df1abd3e9294b6791706ef730fdabde`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:46.317824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69e16457-3857-4a4e-a38e-1309a5a2446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:46.395115 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2477/4922] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:47.581895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f5d94-750e-40eb-9846-c46d5cdec521 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:47.585083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f05f5d94-750e-40eb-9846-c46d5cdec521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:47.697145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f5d94-750e-40eb-9846-c46d5cdec521 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:47.708682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:47.711057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:47.711804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:47.712361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] PATH_INFO: `/v3/users/5df1abd3e9294b6791706ef730fdabde` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:47.714503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df1abd3e9294b6791706ef730fdabde)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:47.716954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:47.805522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df1abd3e9294b6791706ef730fdabde'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:47.806808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df1abd3e9294b6791706ef730fdabde'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:47.807697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df1abd3e9294b6791706ef730fdabde'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:47.825781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df1abd3e9294b6791706ef730fdabde'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:47.844841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1db7aded-dbed-4ba1-9138-0cc7c0488aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df1abd3e9294b6791706ef730fdabde'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:47.866861 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2446/4923] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:07:47 2022] DELETE /identity/v3/users/5df1abd3e9294b6791706ef730fdabde => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:48.320276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e16457-3857-4a4e-a38e-1309a5a2446c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:48.340743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e16457-3857-4a4e-a38e-1309a5a2446c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:48.483309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:48.484168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:48.484487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:48.484959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] PATH_INFO: `/v3/projects/b5a5b2f0972548da9895d596ad42cd99` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:48.486479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a5b2f0972548da9895d596ad42cd99)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:48.489030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:48.560223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a5b2f0972548da9895d596ad42cd99', 'request_id': 'req-f9d5019f-fb84-454a-833e-ac5ad28d5219'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:48.567602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a5b2f0972548da9895d596ad42cd99', 'request_id': 'req-f9d5019f-fb84-454a-833e-ac5ad28d5219'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:48.582411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a5b2f0972548da9895d596ad42cd99', 'request_id': 'req-f9d5019f-fb84-454a-833e-ac5ad28d5219'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:48.603200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] The token cache is being invalidate because project b5a5b2f0972548da9895d596ad42cd99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:07:48.604695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:48.606498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f9d5019f-fb84-454a-833e-ac5ad28d5219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:48.609820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2478/4924] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:07:48 2022] DELETE /identity/v3/projects/b5a5b2f0972548da9895d596ad42cd99 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:48.622827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8d24-7cbc-46ef-bee0-ebead7647471 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:48.624293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8d24-7cbc-46ef-bee0-ebead7647471 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:48.624975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8d24-7cbc-46ef-bee0-ebead7647471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:48.652726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-494b8d24-7cbc-46ef-bee0-ebead7647471 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:48.655972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-494b8d24-7cbc-46ef-bee0-ebead7647471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:48.791864 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2447/4925] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:48.794473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85e89-b364-421a-828e-cb427da19d4f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:48.794769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85e89-b364-421a-828e-cb427da19d4f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:48.795048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85e89-b364-421a-828e-cb427da19d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:48.830057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-79c85e89-b364-421a-828e-cb427da19d4f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:48.831959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-79c85e89-b364-421a-828e-cb427da19d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:48.851681 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2479/4926] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:48.852936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b8d24-7cbc-46ef-bee0-ebead7647471 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:48.867381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b8d24-7cbc-46ef-bee0-ebead7647471 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:48.873627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:48.874788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:48.875444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:48.875964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:48.877252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:07:48.877949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:48.880259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:48.908096 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2448/4927] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:07:48.908912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c85e89-b364-421a-828e-cb427da19d4f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:48.920042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c85e89-b364-421a-828e-cb427da19d4f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:48.927987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b67d03-b258-41d7-a718-a3f9aacd796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:48.928776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b67d03-b258-41d7-a718-a3f9aacd796f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:48.929154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b67d03-b258-41d7-a718-a3f9aacd796f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:48.929320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b67d03-b258-41d7-a718-a3f9aacd796f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:48.930051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b67d03-b258-41d7-a718-a3f9aacd796f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:48.932100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b67d03-b258-41d7-a718-a3f9aacd796f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:48.987815 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2480/4928] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:48 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:07:48.989274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:49.002086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c259410-201e-4b0e-8614-b9824379d1c4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:49.126646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cd8c7-adb0-4142-9ff3-e6073465ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:49.126646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd8c7-adb0-4142-9ff3-e6073465ee24 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:49.126646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd8c7-adb0-4142-9ff3-e6073465ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:49.127380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd8c7-adb0-4142-9ff3-e6073465ee24 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:49.127869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cd8c7-adb0-4142-9ff3-e6073465ee24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:49.130222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cd8c7-adb0-4142-9ff3-e6073465ee24 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:49.169507 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2449/4929] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:07:48 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:07:49.172541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b67d03-b258-41d7-a718-a3f9aacd796f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:49.200302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b67d03-b258-41d7-a718-a3f9aacd796f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:49.211671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f27192-0a11-4530-8c58-03a482164dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:49.214428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27192-0a11-4530-8c58-03a482164dbb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:49.214994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27192-0a11-4530-8c58-03a482164dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:49.217589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27192-0a11-4530-8c58-03a482164dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:49.218877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f27192-0a11-4530-8c58-03a482164dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:49.223938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f27192-0a11-4530-8c58-03a482164dbb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:49.254645 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2481/4930] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:49.257847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cd8c7-adb0-4142-9ff3-e6073465ee24 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:49.307751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cd8c7-adb0-4142-9ff3-e6073465ee24 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:49.315612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e325700-1b46-403b-9394-8506f497608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:49.316819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325700-1b46-403b-9394-8506f497608d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:49.317331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325700-1b46-403b-9394-8506f497608d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:49.318001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325700-1b46-403b-9394-8506f497608d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:49.319543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325700-1b46-403b-9394-8506f497608d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:49.321669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325700-1b46-403b-9394-8506f497608d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:49.339015 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2450/4931] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:49.344245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f27192-0a11-4530-8c58-03a482164dbb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:49.355895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f27192-0a11-4530-8c58-03a482164dbb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:49.363434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61b810-89e9-48e9-8894-7735ed835001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:49.364988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61b810-89e9-48e9-8894-7735ed835001 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:49.364988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61b810-89e9-48e9-8894-7735ed835001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:49.364988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61b810-89e9-48e9-8894-7735ed835001 admin admin] PATH_INFO: `/v3/projects/59c362ec92fd4b278b32e11ce944d0ee/users/4840a05670f4466da6ee9c4047779582/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:49.383088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61b810-89e9-48e9-8894-7735ed835001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c362ec92fd4b278b32e11ce944d0ee, user_id=4840a05670f4466da6ee9c4047779582, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:49.385918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61b810-89e9-48e9-8894-7735ed835001 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:49.404212 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2482/4932] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:49 2022] PUT /identity/v3/projects/59c362ec92fd4b278b32e11ce944d0ee/users/4840a05670f4466da6ee9c4047779582/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:49.417048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c124-14dc-4b85-b363-b7b7fecd1f52 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:49.417370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c124-14dc-4b85-b363-b7b7fecd1f52 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:49.417604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c124-14dc-4b85-b363-b7b7fecd1f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:49.456118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fc33c124-14dc-4b85-b363-b7b7fecd1f52 None None] MFA Rules not processed for user `4840a05670f4466da6ee9c4047779582`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:49.458821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fc33c124-14dc-4b85-b363-b7b7fecd1f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:49.556240 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2451/4933] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:49.561909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61b810-89e9-48e9-8894-7735ed835001 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:49.686795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61b810-89e9-48e9-8894-7735ed835001 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:49.695341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f562db-c629-45a9-8c61-3531a2368836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:49.696657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f562db-c629-45a9-8c61-3531a2368836 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:49.696657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f562db-c629-45a9-8c61-3531a2368836 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:49.696657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f562db-c629-45a9-8c61-3531a2368836 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:49.700365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f562db-c629-45a9-8c61-3531a2368836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:49.701997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f562db-c629-45a9-8c61-3531a2368836 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:49.756422 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2483/4934] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:49 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:49.761974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33c124-14dc-4b85-b363-b7b7fecd1f52 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:49.784086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33c124-14dc-4b85-b363-b7b7fecd1f52 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:49.897492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3376-d1e6-4b14-9cb0-f0bc0600f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:49.898489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3376-d1e6-4b14-9cb0-f0bc0600f86a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:49.898908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3376-d1e6-4b14-9cb0-f0bc0600f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:49.899323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3376-d1e6-4b14-9cb0-f0bc0600f86a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:49.900692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3376-d1e6-4b14-9cb0-f0bc0600f86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:49.903797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3376-d1e6-4b14-9cb0-f0bc0600f86a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:49.943521 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2452/4935] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:07:49 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:49.947930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f562db-c629-45a9-8c61-3531a2368836 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:49.960865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f562db-c629-45a9-8c61-3531a2368836 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:49.967096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa97bc-28a6-45a6-b1cc-370d5bd890a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:49.968106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa97bc-28a6-45a6-b1cc-370d5bd890a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:49.968106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa97bc-28a6-45a6-b1cc-370d5bd890a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:49.968507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa97bc-28a6-45a6-b1cc-370d5bd890a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:49.969751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa97bc-28a6-45a6-b1cc-370d5bd890a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:49.971108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa97bc-28a6-45a6-b1cc-370d5bd890a0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:49.985653 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2484/4936] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:49.990099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3376-d1e6-4b14-9cb0-f0bc0600f86a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:50.004205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3376-d1e6-4b14-9cb0-f0bc0600f86a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:50.010515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4d69-5832-4449-a36a-d79f3db9ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:50.011507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4d69-5832-4449-a36a-d79f3db9ee07 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.011809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4d69-5832-4449-a36a-d79f3db9ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.012151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4d69-5832-4449-a36a-d79f3db9ee07 admin admin] PATH_INFO: `/v3/projects/94db5917c83e49f1a122bfbb32980d5e/users/2bb73cebc67b4428a76d80c3d2160dc0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.041013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d4d69-5832-4449-a36a-d79f3db9ee07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94db5917c83e49f1a122bfbb32980d5e, user_id=2bb73cebc67b4428a76d80c3d2160dc0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:50.044378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d4d69-5832-4449-a36a-d79f3db9ee07 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:50.068641 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2453/4937] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:49 2022] PUT /identity/v3/projects/94db5917c83e49f1a122bfbb32980d5e/users/2bb73cebc67b4428a76d80c3d2160dc0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:50.073716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa97bc-28a6-45a6-b1cc-370d5bd890a0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:50.091985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa97bc-28a6-45a6-b1cc-370d5bd890a0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:50.194976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0218-3d27-4c80-99b7-851d2f484a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:50.196220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0218-3d27-4c80-99b7-851d2f484a44 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.196894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0218-3d27-4c80-99b7-851d2f484a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.197563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0218-3d27-4c80-99b7-851d2f484a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.199108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0218-3d27-4c80-99b7-851d2f484a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:50.203274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0218-3d27-4c80-99b7-851d2f484a44 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:50.222772 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2485/4938] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:50.229203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4d69-5832-4449-a36a-d79f3db9ee07 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:50.245712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d4d69-5832-4449-a36a-d79f3db9ee07 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:50.257306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d7bda-03ac-45c6-91f6-eaae2a67df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:50.259444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d7bda-03ac-45c6-91f6-eaae2a67df74 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.260059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d7bda-03ac-45c6-91f6-eaae2a67df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.260675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d7bda-03ac-45c6-91f6-eaae2a67df74 admin admin] PATH_INFO: `/v3/projects/94db5917c83e49f1a122bfbb32980d5e/users/2bb73cebc67b4428a76d80c3d2160dc0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.263817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d7bda-03ac-45c6-91f6-eaae2a67df74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94db5917c83e49f1a122bfbb32980d5e, user_id=2bb73cebc67b4428a76d80c3d2160dc0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:50.269296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d7bda-03ac-45c6-91f6-eaae2a67df74 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:50.292155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2454/4939] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:50 2022] PUT /identity/v3/projects/94db5917c83e49f1a122bfbb32980d5e/users/2bb73cebc67b4428a76d80c3d2160dc0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:50.295612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8df65a-c642-4395-8381-3a9f5ff407b7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.295903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8df65a-c642-4395-8381-3a9f5ff407b7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.296415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8df65a-c642-4395-8381-3a9f5ff407b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.331121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8d8df65a-c642-4395-8381-3a9f5ff407b7 None None] MFA Rules not processed for user `2bb73cebc67b4428a76d80c3d2160dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:50.334030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8d8df65a-c642-4395-8381-3a9f5ff407b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:50.471313 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2486/4940] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:50.478654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d7bda-03ac-45c6-91f6-eaae2a67df74 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:50.494218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d7bda-03ac-45c6-91f6-eaae2a67df74 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:50.499688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669aca49-4f89-4a80-99cd-f20999dfaac1 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:50.500422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aca49-4f89-4a80-99cd-f20999dfaac1 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.500713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aca49-4f89-4a80-99cd-f20999dfaac1 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.500991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aca49-4f89-4a80-99cd-f20999dfaac1 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.502621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669aca49-4f89-4a80-99cd-f20999dfaac1 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:50.504374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669aca49-4f89-4a80-99cd-f20999dfaac1 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:50.540667 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2455/4941] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:07:50 2022] POST /identity/v3/domains => generated 246 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:50.542019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8df65a-c642-4395-8381-3a9f5ff407b7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:50.554309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8df65a-c642-4395-8381-3a9f5ff407b7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:50.659895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf8d8-5ec7-4205-bfcb-dfbfa8347acc tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:50.660628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf8d8-5ec7-4205-bfcb-dfbfa8347acc tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.661078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf8d8-5ec7-4205-bfcb-dfbfa8347acc tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.661374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf8d8-5ec7-4205-bfcb-dfbfa8347acc tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.662105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf8d8-5ec7-4205-bfcb-dfbfa8347acc tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:50.665332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf8d8-5ec7-4205-bfcb-dfbfa8347acc tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:50.719168 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2487/4942] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:50 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:50.720740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669aca49-4f89-4a80-99cd-f20999dfaac1 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:50.740468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669aca49-4f89-4a80-99cd-f20999dfaac1 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:50.837532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a73153-6657-429c-891e-27fe975378e8 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:50.838216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a73153-6657-429c-891e-27fe975378e8 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.838520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a73153-6657-429c-891e-27fe975378e8 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.838805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a73153-6657-429c-891e-27fe975378e8 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.839528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a73153-6657-429c-891e-27fe975378e8 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:50.841866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a73153-6657-429c-891e-27fe975378e8 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:50.870785 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2456/4943] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:07:50 2022] POST /identity/v3/users => generated 348 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:50.873482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf8d8-5ec7-4205-bfcb-dfbfa8347acc tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:50.890969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf8d8-5ec7-4205-bfcb-dfbfa8347acc tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:50.896637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350149ce-e4dd-4150-bc81-ab62ee7a7d63 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:50.897595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350149ce-e4dd-4150-bc81-ab62ee7a7d63 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.899321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350149ce-e4dd-4150-bc81-ab62ee7a7d63 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.899321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350149ce-e4dd-4150-bc81-ab62ee7a7d63 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.899321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350149ce-e4dd-4150-bc81-ab62ee7a7d63 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:50.900881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350149ce-e4dd-4150-bc81-ab62ee7a7d63 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:50.914078 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2488/4944] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:50.918476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a73153-6657-429c-891e-27fe975378e8 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:50.929364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a73153-6657-429c-891e-27fe975378e8 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:50.935178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24277c70-e69c-4fb1-a94b-c56c0f5ce9fe tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:50.936154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277c70-e69c-4fb1-a94b-c56c0f5ce9fe tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.936536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277c70-e69c-4fb1-a94b-c56c0f5ce9fe tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.936871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277c70-e69c-4fb1-a94b-c56c0f5ce9fe tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/projects/aa4c5f61886e463eab0ebdb5cada3faa/users/0096a65f48f242dcba8301d9cbb76773/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:50.954798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24277c70-e69c-4fb1-a94b-c56c0f5ce9fe tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa4c5f61886e463eab0ebdb5cada3faa, user_id=0096a65f48f242dcba8301d9cbb76773, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:50.957556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24277c70-e69c-4fb1-a94b-c56c0f5ce9fe tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:50.974906 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2457/4945] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:50 2022] PUT /identity/v3/projects/aa4c5f61886e463eab0ebdb5cada3faa/users/0096a65f48f242dcba8301d9cbb76773/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:50.982163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b94f-f14c-438b-9bb6-17a81575b606 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:50.982626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b94f-f14c-438b-9bb6-17a81575b606 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:50.983129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b94f-f14c-438b-9bb6-17a81575b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:51.139277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6860b94f-f14c-438b-9bb6-17a81575b606 None None] MFA Rules not processed for user `0096a65f48f242dcba8301d9cbb76773`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:51.141327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6860b94f-f14c-438b-9bb6-17a81575b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:51.168003 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2489/4946] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:51.170656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ec41-4777-4fbe-a4ca-63ed16b5f988 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:51.172116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ec41-4777-4fbe-a4ca-63ed16b5f988 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:51.172321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ec41-4777-4fbe-a4ca-63ed16b5f988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:51.193736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2d10ec41-4777-4fbe-a4ca-63ed16b5f988 None None] MFA Rules not processed for user `0096a65f48f242dcba8301d9cbb76773`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:51.195459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2d10ec41-4777-4fbe-a4ca-63ed16b5f988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:51.208931 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2458/4947] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:51.211423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860b94f-f14c-438b-9bb6-17a81575b606 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:51.222690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860b94f-f14c-438b-9bb6-17a81575b606 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:51.233109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903751ad-bea5-45ce-b2b8-b05f395cb7f8 tempest-test_project-1906055225 tempest-user-1366464800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0096a65f48f242dcba8301d9cbb76773', 'user_domain_id': '07ea6310a54543b0afa15db215c780cf', 'system_scope': None, 'project_id': 'aa4c5f61886e463eab0ebdb5cada3faa', 'project_domain_id': '07ea6310a54543b0afa15db215c780cf', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:51.236721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903751ad-bea5-45ce-b2b8-b05f395cb7f8 tempest-test_project-1906055225 tempest-user-1366464800] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:51.236987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903751ad-bea5-45ce-b2b8-b05f395cb7f8 tempest-test_project-1906055225 tempest-user-1366464800] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:51.237275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903751ad-bea5-45ce-b2b8-b05f395cb7f8 tempest-test_project-1906055225 tempest-user-1366464800] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:51.261717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903751ad-bea5-45ce-b2b8-b05f395cb7f8 tempest-test_project-1906055225 tempest-user-1366464800] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:51.263714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903751ad-bea5-45ce-b2b8-b05f395cb7f8 tempest-test_project-1906055225 tempest-user-1366464800] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:51.277839 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2490/4948] 10.222.0.30 () {56 vars in 1283 bytes} [Sat Feb 19 21:07:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:07:51.283070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ec41-4777-4fbe-a4ca-63ed16b5f988 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:51.377633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ec41-4777-4fbe-a4ca-63ed16b5f988 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:51.384696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:51.386176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:51.386660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:51.387143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/users/0096a65f48f242dcba8301d9cbb76773` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:51.389052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0096a65f48f242dcba8301d9cbb76773)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:51.393101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:51.471707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0096a65f48f242dcba8301d9cbb76773'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.472769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0096a65f48f242dcba8301d9cbb76773'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.473543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0096a65f48f242dcba8301d9cbb76773'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.489767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0096a65f48f242dcba8301d9cbb76773'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.499164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0096a65f48f242dcba8301d9cbb76773'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.516317 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2459/4949] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:07:51 2022] DELETE /identity/v3/users/0096a65f48f242dcba8301d9cbb76773 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:51.521685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903751ad-bea5-45ce-b2b8-b05f395cb7f8 tempest-test_project-1906055225 tempest-user-1366464800] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:51.540033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903751ad-bea5-45ce-b2b8-b05f395cb7f8 tempest-test_project-1906055225 tempest-user-1366464800] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:51.655260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:51.657546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:51.658257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:51.659072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/projects/aa4c5f61886e463eab0ebdb5cada3faa` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:51.661231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa4c5f61886e463eab0ebdb5cada3faa)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:51.664266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:51.760215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4c5f61886e463eab0ebdb5cada3faa', 'request_id': 'req-143abeb2-5461-41cb-a0fc-013d552cff0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.782178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4c5f61886e463eab0ebdb5cada3faa', 'request_id': 'req-143abeb2-5461-41cb-a0fc-013d552cff0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.799961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4c5f61886e463eab0ebdb5cada3faa', 'request_id': 'req-143abeb2-5461-41cb-a0fc-013d552cff0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.818460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] The token cache is being invalidate because project aa4c5f61886e463eab0ebdb5cada3faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:07:51.819134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.820520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:51.824646 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2491/4950] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:07:51 2022] DELETE /identity/v3/projects/aa4c5f61886e463eab0ebdb5cada3faa => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:51.827124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:51.831595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:51.864122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f0026-57fd-4694-98eb-b0eebaa2b83e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:51.997045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:51.998853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:51.999236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:51.999659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/domains/07ea6310a54543b0afa15db215c780cf` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:52.002376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=07ea6310a54543b0afa15db215c780cf)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:52.004426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:52.032124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '07ea6310a54543b0afa15db215c780cf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.033129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '07ea6310a54543b0afa15db215c780cf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.075152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '07ea6310a54543b0afa15db215c780cf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.075940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32ffbd97-2d3d-4d95-b697-99325f947112 tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '07ea6310a54543b0afa15db215c780cf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.083895 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2460/4951] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:07:51 2022] PATCH /identity/v3/domains/07ea6310a54543b0afa15db215c780cf => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:07:52.086053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:52.088685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:52.112917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abeb2-5461-41cb-a0fc-013d552cff0e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:52.249533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b406c-24b9-4f62-ad4d-ca5069dfaa3a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:52.250065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b406c-24b9-4f62-ad4d-ca5069dfaa3a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:52.250817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b406c-24b9-4f62-ad4d-ca5069dfaa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:52.268862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bb73cebc67b4428a76d80c3d2160dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94db5917c83e49f1a122bfbb32980d5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:52.269754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:52.270038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:52.270314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] PATH_INFO: `/v3/domains/07ea6310a54543b0afa15db215c780cf` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:52.275212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-761b406c-24b9-4f62-ad4d-ca5069dfaa3a None None] MFA Rules not processed for user `fad7207822c04fc289709200d7e2bd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:52.277195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-761b406c-24b9-4f62-ad4d-ca5069dfaa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:52.293773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=07ea6310a54543b0afa15db215c780cf)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:52.295409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:52.349564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '07ea6310a54543b0afa15db215c780cf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.366944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '07ea6310a54543b0afa15db215c780cf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.377677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2461/4952] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:07:52.464875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ea6310a54543b0afa15db215c780cf', 'request_id': 'req-81428862-f111-42dd-b5dd-8afbd0deb07e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.471712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ea6310a54543b0afa15db215c780cf', 'request_id': 'req-81428862-f111-42dd-b5dd-8afbd0deb07e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.484370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ea6310a54543b0afa15db215c780cf', 'request_id': 'req-81428862-f111-42dd-b5dd-8afbd0deb07e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.517073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] The token cache is being invalidate because project 07ea6310a54543b0afa15db215c780cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:07:52.518088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.519064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.532543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '07ea6310a54543b0afa15db215c780cf', 'request_id': 'req-81428862-f111-42dd-b5dd-8afbd0deb07e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.538388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '07ea6310a54543b0afa15db215c780cf', 'request_id': 'req-81428862-f111-42dd-b5dd-8afbd0deb07e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.539519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81428862-f111-42dd-b5dd-8afbd0deb07e tempest-TestDefaultProjectId-387812869 tempest-TestDefaultProjectId-387812869-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '07ea6310a54543b0afa15db215c780cf', 'request_id': 'req-81428862-f111-42dd-b5dd-8afbd0deb07e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.548021 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2492/4953] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:07:52 2022] DELETE /identity/v3/domains/07ea6310a54543b0afa15db215c780cf => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:52.557473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b406c-24b9-4f62-ad4d-ca5069dfaa3a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:52.559954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-761b406c-24b9-4f62-ad4d-ca5069dfaa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:52.677263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b406c-24b9-4f62-ad4d-ca5069dfaa3a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:52.791510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:52.792618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:52.793862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:52.793862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] PATH_INFO: `/v3/users/4840a05670f4466da6ee9c4047779582` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:52.794888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4840a05670f4466da6ee9c4047779582)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:52.798259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:52.881902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4840a05670f4466da6ee9c4047779582'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.883143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4840a05670f4466da6ee9c4047779582'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.884605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4840a05670f4466da6ee9c4047779582'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.928711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4840a05670f4466da6ee9c4047779582'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:52.951329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4840a05670f4466da6ee9c4047779582'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:53.002250 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2462/4954] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:07:52 2022] DELETE /identity/v3/users/4840a05670f4466da6ee9c4047779582 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:53.009449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46460274-8493-481d-9b6e-18da2c5fdeb4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:53.010005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46460274-8493-481d-9b6e-18da2c5fdeb4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:53.010540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46460274-8493-481d-9b6e-18da2c5fdeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:53.064365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-46460274-8493-481d-9b6e-18da2c5fdeb4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:53.065152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-46460274-8493-481d-9b6e-18da2c5fdeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:53.257802 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2493/4955] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:53.276600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:53.279454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:53.417894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55be30-c489-4e40-8e38-23b96d71be59 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:53.421893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb717e-1643-4ebb-afa1-ce1bc82c89b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:53.422704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb717e-1643-4ebb-afa1-ce1bc82c89b0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:53.422988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb717e-1643-4ebb-afa1-ce1bc82c89b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:53.423265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb717e-1643-4ebb-afa1-ce1bc82c89b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:53.446395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb717e-1643-4ebb-afa1-ce1bc82c89b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:53.452092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb717e-1643-4ebb-afa1-ce1bc82c89b0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:53.475476 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2463/4956] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:07:54.074814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46460274-8493-481d-9b6e-18da2c5fdeb4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:54.077764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-46460274-8493-481d-9b6e-18da2c5fdeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:54.104731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46460274-8493-481d-9b6e-18da2c5fdeb4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:54.132912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:54.134178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:54.134715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:54.135225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] PATH_INFO: `/v3/projects/59c362ec92fd4b278b32e11ce944d0ee` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:54.137247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c362ec92fd4b278b32e11ce944d0ee)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:54.140873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:54.221948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c362ec92fd4b278b32e11ce944d0ee', 'request_id': 'req-664a2e17-73d7-4d39-bf30-21f95687aadf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.230402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c362ec92fd4b278b32e11ce944d0ee', 'request_id': 'req-664a2e17-73d7-4d39-bf30-21f95687aadf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.240667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c362ec92fd4b278b32e11ce944d0ee', 'request_id': 'req-664a2e17-73d7-4d39-bf30-21f95687aadf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.257559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] The token cache is being invalidate because project 59c362ec92fd4b278b32e11ce944d0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:07:54.258393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.259265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.262628 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2494/4957] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:07:54 2022] DELETE /identity/v3/projects/59c362ec92fd4b278b32e11ce944d0ee => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:54.266627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb717e-1643-4ebb-afa1-ce1bc82c89b0 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:54.279752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb717e-1643-4ebb-afa1-ce1bc82c89b0 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:54.430255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:54.431147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:54.431430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:54.431702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] PATH_INFO: `/v3/users/2bb73cebc67b4428a76d80c3d2160dc0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:54.433257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb73cebc67b4428a76d80c3d2160dc0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:54.439852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:54.538024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb73cebc67b4428a76d80c3d2160dc0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.538705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb73cebc67b4428a76d80c3d2160dc0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.539326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb73cebc67b4428a76d80c3d2160dc0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.563745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb73cebc67b4428a76d80c3d2160dc0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.583169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9822088d-0eb0-4b50-a94e-841f11f55c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb73cebc67b4428a76d80c3d2160dc0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:54.612769 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2464/4958] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:07:54 2022] DELETE /identity/v3/users/2bb73cebc67b4428a76d80c3d2160dc0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:55.101442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:55.103150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:55.133573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a2e17-73d7-4d39-bf30-21f95687aadf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:55.349869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:55.351295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:55.352715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:55.353013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] PATH_INFO: `/v3/projects/94db5917c83e49f1a122bfbb32980d5e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:55.355731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94db5917c83e49f1a122bfbb32980d5e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:55.359804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:55.436744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94db5917c83e49f1a122bfbb32980d5e', 'request_id': 'req-c0232971-91d7-4f4a-bbfa-72be7103b52f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:55.444536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94db5917c83e49f1a122bfbb32980d5e', 'request_id': 'req-c0232971-91d7-4f4a-bbfa-72be7103b52f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:55.458816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94db5917c83e49f1a122bfbb32980d5e', 'request_id': 'req-c0232971-91d7-4f4a-bbfa-72be7103b52f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:55.474401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] The token cache is being invalidate because project 94db5917c83e49f1a122bfbb32980d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:07:55.475613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:55.477066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c0232971-91d7-4f4a-bbfa-72be7103b52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:55.483110 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2495/4959] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:07:55 2022] DELETE /identity/v3/projects/94db5917c83e49f1a122bfbb32980d5e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:55.484097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca761-d125-4a88-a877-98679d965652 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:55.484605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca761-d125-4a88-a877-98679d965652 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:55.484714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca761-d125-4a88-a877-98679d965652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:55.531024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ebfca761-d125-4a88-a877-98679d965652 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:55.534893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ebfca761-d125-4a88-a877-98679d965652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:55.689374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2465/4960] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:55.698060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f040-44a8-414d-9c3e-7fe82d4adb9a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:55.699122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f040-44a8-414d-9c3e-7fe82d4adb9a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:55.699629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f040-44a8-414d-9c3e-7fe82d4adb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:55.723024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-83f6f040-44a8-414d-9c3e-7fe82d4adb9a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:55.725867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-83f6f040-44a8-414d-9c3e-7fe82d4adb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:55.771578 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2496/4961] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:55.772288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfca761-d125-4a88-a877-98679d965652 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:55.795885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfca761-d125-4a88-a877-98679d965652 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:55.809833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:55.812224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:55.812224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:55.812728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:55.813649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:07:55.814000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:55.816083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:55.848261 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2466/4962] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:07:55.852754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f040-44a8-414d-9c3e-7fe82d4adb9a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:55.868443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f040-44a8-414d-9c3e-7fe82d4adb9a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:55.895151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a06a3e-6516-4076-9feb-686f49dc7830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:55.896259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a06a3e-6516-4076-9feb-686f49dc7830 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:55.896663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a06a3e-6516-4076-9feb-686f49dc7830 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:55.897586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a06a3e-6516-4076-9feb-686f49dc7830 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:55.898397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a06a3e-6516-4076-9feb-686f49dc7830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:55.900580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a06a3e-6516-4076-9feb-686f49dc7830 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:55.952448 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2497/4963] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:55 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:55.955721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:55.967316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808251-562d-482c-a062-24523b4a6705 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:56.093935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696c4a0-b6de-40e0-ac71-4389b2d576e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:56.095007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696c4a0-b6de-40e0-ac71-4389b2d576e8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:56.095355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696c4a0-b6de-40e0-ac71-4389b2d576e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:56.095639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696c4a0-b6de-40e0-ac71-4389b2d576e8 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:56.096619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696c4a0-b6de-40e0-ac71-4389b2d576e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:56.099418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696c4a0-b6de-40e0-ac71-4389b2d576e8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:56.135452 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2467/4964] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:07:55 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:56.140636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a06a3e-6516-4076-9feb-686f49dc7830 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:56.197312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a06a3e-6516-4076-9feb-686f49dc7830 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:56.213289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531fe35-3297-483e-aecd-89e2d2ea4cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:56.216174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531fe35-3297-483e-aecd-89e2d2ea4cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:56.217041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531fe35-3297-483e-aecd-89e2d2ea4cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:56.217751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531fe35-3297-483e-aecd-89e2d2ea4cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:56.220717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531fe35-3297-483e-aecd-89e2d2ea4cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:56.224843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531fe35-3297-483e-aecd-89e2d2ea4cd9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:56.263845 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2498/4965] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:07:56.268250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696c4a0-b6de-40e0-ac71-4389b2d576e8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:56.281571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696c4a0-b6de-40e0-ac71-4389b2d576e8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:56.289697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1801a-b95c-4341-8733-9f2e8895d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:56.290030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1801a-b95c-4341-8733-9f2e8895d47a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:56.290030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1801a-b95c-4341-8733-9f2e8895d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:56.290386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1801a-b95c-4341-8733-9f2e8895d47a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:56.291038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1801a-b95c-4341-8733-9f2e8895d47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:56.293743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1801a-b95c-4341-8733-9f2e8895d47a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:56.313179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531fe35-3297-483e-aecd-89e2d2ea4cd9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:56.319615 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2468/4966] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:56.325889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531fe35-3297-483e-aecd-89e2d2ea4cd9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:56.331167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e630-6e08-4f14-a088-8fa03fad5853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:56.332211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e630-6e08-4f14-a088-8fa03fad5853 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:56.332871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e630-6e08-4f14-a088-8fa03fad5853 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:56.333337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e630-6e08-4f14-a088-8fa03fad5853 admin admin] PATH_INFO: `/v3/projects/4ee9623925364f4ebca89cc03ffbaf96/users/4c72b3337e22447699351b49f0962538/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:56.365188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e630-6e08-4f14-a088-8fa03fad5853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee9623925364f4ebca89cc03ffbaf96, user_id=4c72b3337e22447699351b49f0962538, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:56.369454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e630-6e08-4f14-a088-8fa03fad5853 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:56.392807 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2499/4967] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:56 2022] PUT /identity/v3/projects/4ee9623925364f4ebca89cc03ffbaf96/users/4c72b3337e22447699351b49f0962538/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:56.403968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f70a-5b40-4efd-8678-81510af77271 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:56.404267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f70a-5b40-4efd-8678-81510af77271 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:56.404710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f70a-5b40-4efd-8678-81510af77271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:56.442311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2652f70a-5b40-4efd-8678-81510af77271 None None] MFA Rules not processed for user `4c72b3337e22447699351b49f0962538`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:56.444482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2652f70a-5b40-4efd-8678-81510af77271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:56.562259 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2469/4968] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:56.566693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e630-6e08-4f14-a088-8fa03fad5853 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:56.718782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e630-6e08-4f14-a088-8fa03fad5853 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:56.733821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21e726-cace-4f2f-b541-267dede15e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:56.736903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21e726-cace-4f2f-b541-267dede15e32 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:56.737210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21e726-cace-4f2f-b541-267dede15e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:56.737496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21e726-cace-4f2f-b541-267dede15e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:56.739147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21e726-cace-4f2f-b541-267dede15e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:56.748350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21e726-cace-4f2f-b541-267dede15e32 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:56.832981 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2500/4969] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:56 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:56.834229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652f70a-5b40-4efd-8678-81510af77271 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:56.853979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652f70a-5b40-4efd-8678-81510af77271 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:57.061180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1c5a6-58bd-4dfb-8a53-e197f54f74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:57.061922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c5a6-58bd-4dfb-8a53-e197f54f74d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:57.062208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c5a6-58bd-4dfb-8a53-e197f54f74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:57.062741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c5a6-58bd-4dfb-8a53-e197f54f74d6 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:57.063235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1c5a6-58bd-4dfb-8a53-e197f54f74d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:57.066203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1c5a6-58bd-4dfb-8a53-e197f54f74d6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:57.129927 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2470/4970] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:07:56 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:57.132122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21e726-cace-4f2f-b541-267dede15e32 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:57.157860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21e726-cace-4f2f-b541-267dede15e32 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:57.185690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f26c8-2c75-41ff-b08f-a78049d68681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:57.188208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f26c8-2c75-41ff-b08f-a78049d68681 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:57.189141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f26c8-2c75-41ff-b08f-a78049d68681 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:57.191392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f26c8-2c75-41ff-b08f-a78049d68681 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:57.199701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f26c8-2c75-41ff-b08f-a78049d68681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:57.210389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f26c8-2c75-41ff-b08f-a78049d68681 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:57.261413 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2501/4971] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:57.265719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1c5a6-58bd-4dfb-8a53-e197f54f74d6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:57.293501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1c5a6-58bd-4dfb-8a53-e197f54f74d6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:57.302674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b3030-43d3-4916-9a15-3741230ea5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:57.304220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3030-43d3-4916-9a15-3741230ea5db admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:57.304640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3030-43d3-4916-9a15-3741230ea5db admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:57.305004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3030-43d3-4916-9a15-3741230ea5db admin admin] PATH_INFO: `/v3/projects/96e7aef301094b659fc2e3dd1f114ec4/users/3acfe398322e4260969465d0aa439aeb/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:57.330764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3030-43d3-4916-9a15-3741230ea5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e7aef301094b659fc2e3dd1f114ec4, user_id=3acfe398322e4260969465d0aa439aeb, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:57.334181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3030-43d3-4916-9a15-3741230ea5db admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:57.361972 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2471/4972] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:57 2022] PUT /identity/v3/projects/96e7aef301094b659fc2e3dd1f114ec4/users/3acfe398322e4260969465d0aa439aeb/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:57.366269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f26c8-2c75-41ff-b08f-a78049d68681 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:57.383069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f26c8-2c75-41ff-b08f-a78049d68681 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:57.525880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8458a9-2823-4d8e-a252-3feb1034444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:57.526580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8458a9-2823-4d8e-a252-3feb1034444d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:57.526889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8458a9-2823-4d8e-a252-3feb1034444d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:57.527151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8458a9-2823-4d8e-a252-3feb1034444d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:57.527888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8458a9-2823-4d8e-a252-3feb1034444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:57.531009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8458a9-2823-4d8e-a252-3feb1034444d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:57.560785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b3030-43d3-4916-9a15-3741230ea5db admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:57.561430 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2502/4973] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:07:57.576534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b3030-43d3-4916-9a15-3741230ea5db admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:57.588546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf07be-f0d9-4cb4-a4f5-521d8a7fba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:57.589464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf07be-f0d9-4cb4-a4f5-521d8a7fba0f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:57.589745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf07be-f0d9-4cb4-a4f5-521d8a7fba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:57.590021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf07be-f0d9-4cb4-a4f5-521d8a7fba0f admin admin] PATH_INFO: `/v3/projects/96e7aef301094b659fc2e3dd1f114ec4/users/3acfe398322e4260969465d0aa439aeb/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:57.595218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf07be-f0d9-4cb4-a4f5-521d8a7fba0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e7aef301094b659fc2e3dd1f114ec4, user_id=3acfe398322e4260969465d0aa439aeb, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:57.599526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf07be-f0d9-4cb4-a4f5-521d8a7fba0f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:57.638794 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2472/4974] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:07:57 2022] PUT /identity/v3/projects/96e7aef301094b659fc2e3dd1f114ec4/users/3acfe398322e4260969465d0aa439aeb/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:57.640137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcd335-1515-41a2-855e-7f4cf1aba54c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:57.640598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcd335-1515-41a2-855e-7f4cf1aba54c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:57.640896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcd335-1515-41a2-855e-7f4cf1aba54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:57.681403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-37dcd335-1515-41a2-855e-7f4cf1aba54c None None] MFA Rules not processed for user `3acfe398322e4260969465d0aa439aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:57.682658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37dcd335-1515-41a2-855e-7f4cf1aba54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:57.838861 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2503/4975] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:07:57.843593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf07be-f0d9-4cb4-a4f5-521d8a7fba0f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:57.863347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf07be-f0d9-4cb4-a4f5-521d8a7fba0f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:57.874350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f7839-5083-40f4-aa18-3c86871951f2 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:57.875254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f7839-5083-40f4-aa18-3c86871951f2 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:57.875702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f7839-5083-40f4-aa18-3c86871951f2 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:57.876191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f7839-5083-40f4-aa18-3c86871951f2 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:57.877296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f7839-5083-40f4-aa18-3c86871951f2 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:57.879116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f7839-5083-40f4-aa18-3c86871951f2 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:57.913675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcd335-1515-41a2-855e-7f4cf1aba54c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:57.921368 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2473/4976] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:07:57 2022] POST /identity/v3/services => generated 288 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:57.937010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcd335-1515-41a2-855e-7f4cf1aba54c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:57.993917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:57.994087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:57.994376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:57.994686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:57.995442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:57.997146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.037726 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Feb 19 21:07:58.037726 ncdv-master-1 devstack@keystone.service[96910]: Failed validating 'type' in schema['properties']['enabled']: Feb 19 21:07:58.037726 ncdv-master-1 devstack@keystone.service[96910]: {'enum': [True, False, None], 'type': 'boolean'} Feb 19 21:07:58.037726 ncdv-master-1 devstack@keystone.service[96910]: On instance['enabled']: Feb 19 21:07:58.037726 ncdv-master-1 devstack@keystone.service[96910]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Feb 19 21:07:58.040715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2504/4977] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:07:57 2022] POST /identity/v3/endpoints => generated 283 bytes in 128 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Feb 19 21:07:58.045438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f7839-5083-40f4-aa18-3c86871951f2 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.059283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f7839-5083-40f4-aa18-3c86871951f2 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.067095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.068166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.068757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.070196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.071944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.077124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.085607 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Feb 19 21:07:58.085607 ncdv-master-1 devstack@keystone.service[96909]: Failed validating 'type' in schema['properties']['enabled']: Feb 19 21:07:58.085607 ncdv-master-1 devstack@keystone.service[96909]: {'enum': [True, False, None], 'type': 'boolean'} Feb 19 21:07:58.085607 ncdv-master-1 devstack@keystone.service[96909]: On instance['enabled']: Feb 19 21:07:58.085607 ncdv-master-1 devstack@keystone.service[96909]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Feb 19 21:07:58.087862 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2474/4978] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:07:58 2022] POST /identity/v3/endpoints => generated 281 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Feb 19 21:07:58.094646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.114250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32198e-b46c-43f9-b458-d17e67ed2344 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.127731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.128424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.129012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.129970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.130572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.132893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.196804 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2001980171. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:07:58.196804 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:07:58.196804 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:07:58.250493 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2505/4979] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:07:58 2022] POST /identity/v3/endpoints => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:58.254648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.269913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dc995-ef2f-480e-a230-989dd1a637bc tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.302404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2de35-f5ac-464f-b88a-facccad6f9e6 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.304677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2de35-f5ac-464f-b88a-facccad6f9e6 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.305391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2de35-f5ac-464f-b88a-facccad6f9e6 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.305892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2de35-f5ac-464f-b88a-facccad6f9e6 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/regions/tempest-region-2001980171` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.307825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2de35-f5ac-464f-b88a-facccad6f9e6 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2001980171)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.310046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2de35-f5ac-464f-b88a-facccad6f9e6 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.313001 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2475/4980] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Feb 19 21:07:58 2022] GET /identity/v3/regions/tempest-region-2001980171 => generated 180 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:07:58.317650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.338646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1150f-687d-4fa6-93e0-cd0a455fdb95 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.345216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.348653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.349226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.349728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/endpoints/b27b2d827bf1474a872b38ca2664fc6b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.378311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=b27b2d827bf1474a872b38ca2664fc6b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.380968 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:58.380968 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:07:58.380968 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:07:58.383070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.398751 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Feb 19 21:07:58.398751 ncdv-master-1 devstack@keystone.service[96910]: Failed validating 'type' in schema['properties']['enabled']: Feb 19 21:07:58.398751 ncdv-master-1 devstack@keystone.service[96910]: {'enum': [True, False, None], 'type': 'boolean'} Feb 19 21:07:58.398751 ncdv-master-1 devstack@keystone.service[96910]: On instance['enabled']: Feb 19 21:07:58.398751 ncdv-master-1 devstack@keystone.service[96910]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Feb 19 21:07:58.408208 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2506/4981] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Feb 19 21:07:58 2022] PATCH /identity/v3/endpoints/b27b2d827bf1474a872b38ca2664fc6b => generated 283 bytes in 91 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Feb 19 21:07:58.412164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2de35-f5ac-464f-b88a-facccad6f9e6 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.424634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2de35-f5ac-464f-b88a-facccad6f9e6 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.433129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.435409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.437633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.438178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/endpoints/b27b2d827bf1474a872b38ca2664fc6b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.449599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b27b2d827bf1474a872b38ca2664fc6b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.455537 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:58.455537 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:07:58.455537 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:07:58.462977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.490283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b27b2d827bf1474a872b38ca2664fc6b', 'request_id': 'req-25516630-f6a5-4234-9cd9-abb1174e6003'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:58.518915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.519776 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2476/4982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:58 2022] DELETE /identity/v3/endpoints/b27b2d827bf1474a872b38ca2664fc6b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:58.549527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35d5f6-32b1-4e88-8273-de27f222bb3b tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.569210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.570351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.570827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.571423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/regions/tempest-region-2001980171` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.572279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2001980171)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.573510 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:58.573510 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:07:58.573510 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:07:58.574984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.613961 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2507/4983] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 21:07:58 2022] DELETE /identity/v3/regions/tempest-region-2001980171 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:58.623395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.644794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25516630-f6a5-4234-9cd9-abb1174e6003 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.666806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.667883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.668567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.669102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.670086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.672173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.749523 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1302213538. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:07:58.749523 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:07:58.749523 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:07:58.843126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.851267 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2477/4984] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:07:58 2022] POST /identity/v3/endpoints => generated 361 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:07:58.864588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763aef6-4610-4fff-a5a9-93e6e10d74f8 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.889811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119194-eb80-4edf-9453-494733e23f0e tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.890651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119194-eb80-4edf-9453-494733e23f0e tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.891139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119194-eb80-4edf-9453-494733e23f0e tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.891620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119194-eb80-4edf-9453-494733e23f0e tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/regions/tempest-region-1302213538` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.892521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6119194-eb80-4edf-9453-494733e23f0e tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1302213538)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.893989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6119194-eb80-4edf-9453-494733e23f0e tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.897685 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2508/4985] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Feb 19 21:07:58 2022] GET /identity/v3/regions/tempest-region-1302213538 => generated 180 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:07:58.903487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:58.922747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c1d07-d975-42c2-a593-be5525a80596 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:58.951736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:58.952659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:58.952937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:58.954055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/endpoints/4daecbb8caa64b14be45bc1253208e4d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:58.967914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=4daecbb8caa64b14be45bc1253208e4d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:58.972173 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:58.972173 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:07:58.972173 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:07:58.973163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:58.994151 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Feb 19 21:07:58.994151 ncdv-master-1 devstack@keystone.service[96909]: Failed validating 'type' in schema['properties']['enabled']: Feb 19 21:07:58.994151 ncdv-master-1 devstack@keystone.service[96909]: {'enum': [True, False, None], 'type': 'boolean'} Feb 19 21:07:58.994151 ncdv-master-1 devstack@keystone.service[96909]: On instance['enabled']: Feb 19 21:07:58.994151 ncdv-master-1 devstack@keystone.service[96909]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Feb 19 21:07:58.996604 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2478/4986] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Feb 19 21:07:58 2022] PATCH /identity/v3/endpoints/4daecbb8caa64b14be45bc1253208e4d => generated 281 bytes in 94 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Feb 19 21:07:58.999865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119194-eb80-4edf-9453-494733e23f0e tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:59.014276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119194-eb80-4edf-9453-494733e23f0e tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:59.027847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:59.029659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:59.029659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:59.029659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/endpoints/4daecbb8caa64b14be45bc1253208e4d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:59.031710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4daecbb8caa64b14be45bc1253208e4d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:59.032953 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:59.032953 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:07:59.032953 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:07:59.034060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:59.050503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4daecbb8caa64b14be45bc1253208e4d', 'request_id': 'req-78ff13a8-225f-437e-a020-b7bfe22975a5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:59.066355 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2509/4987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:58 2022] DELETE /identity/v3/endpoints/4daecbb8caa64b14be45bc1253208e4d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:59.071984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:59.085607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b6cd3-3c7f-4a2b-8362-1496f4276938 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:59.127713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:59.128614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:59.128908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:59.129224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/regions/tempest-region-1302213538` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:59.129841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1302213538)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:59.132866 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:59.132866 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:07:59.132866 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:07:59.133800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:59.185178 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2479/4988] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 21:07:59 2022] DELETE /identity/v3/regions/tempest-region-1302213538 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:59.185805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:59.209544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff13a8-225f-437e-a020-b7bfe22975a5 tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:59.247388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75baa6-93e0-43b1-9288-f5fae01220ec tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acfe398322e4260969465d0aa439aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e7aef301094b659fc2e3dd1f114ec4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:59.248925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75baa6-93e0-43b1-9288-f5fae01220ec tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:59.249516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75baa6-93e0-43b1-9288-f5fae01220ec tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:59.250052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75baa6-93e0-43b1-9288-f5fae01220ec tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] PATH_INFO: `/v3/services/dfa57a1154bf48998f485cc0618446f1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:59.251017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75baa6-93e0-43b1-9288-f5fae01220ec tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorizing `identity:delete_service(service_id=dfa57a1154bf48998f485cc0618446f1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:59.253311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75baa6-93e0-43b1-9288-f5fae01220ec tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:59.344844 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2510/4989] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:07:59 2022] DELETE /identity/v3/services/dfa57a1154bf48998f485cc0618446f1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:07:59.348947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:59.480463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7fdb-8177-4cc5-8831-2094bd77a46f tempest-EndpointsNegativeTestJSON-1262744523 tempest-EndpointsNegativeTestJSON-1262744523-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:07:59.507257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:07:59.508137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:59.508458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:59.508734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] PATH_INFO: `/v3/users/4c72b3337e22447699351b49f0962538` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:59.510064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c72b3337e22447699351b49f0962538)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:07:59.515117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:07:59.609591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c72b3337e22447699351b49f0962538'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:59.609864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c72b3337e22447699351b49f0962538'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:59.612789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c72b3337e22447699351b49f0962538'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:59.634491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c72b3337e22447699351b49f0962538'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:59.659585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c72b3337e22447699351b49f0962538'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:07:59.710634 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2480/4990] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:07:59 2022] DELETE /identity/v3/users/4c72b3337e22447699351b49f0962538 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:07:59.712646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73a08-69dd-4a52-89f1-3ed5fa1b78e6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:07:59.713004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73a08-69dd-4a52-89f1-3ed5fa1b78e6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:07:59.713348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73a08-69dd-4a52-89f1-3ed5fa1b78e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:07:59.762820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-68f73a08-69dd-4a52-89f1-3ed5fa1b78e6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:07:59.764549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-68f73a08-69dd-4a52-89f1-3ed5fa1b78e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:07:59.868256 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2511/4991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:07:59.893027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:07:59.898201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:00.287087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a99e0-e0dc-45e9-85ae-71cd38b398b9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:00.302542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ae8fe-9260-47e0-8613-a881eb6ba2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:00.304206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae8fe-9260-47e0-8613-a881eb6ba2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:00.304686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae8fe-9260-47e0-8613-a881eb6ba2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:00.305688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae8fe-9260-47e0-8613-a881eb6ba2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:00.334028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ae8fe-9260-47e0-8613-a881eb6ba2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:00.336600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ae8fe-9260-47e0-8613-a881eb6ba2d1 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:00.356785 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2481/4992] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:01.575404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73a08-69dd-4a52-89f1-3ed5fa1b78e6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:01.576938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-68f73a08-69dd-4a52-89f1-3ed5fa1b78e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:01.603374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73a08-69dd-4a52-89f1-3ed5fa1b78e6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:01.621856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:01.622767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:01.623041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:01.623323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] PATH_INFO: `/v3/projects/4ee9623925364f4ebca89cc03ffbaf96` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:01.627255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee9623925364f4ebca89cc03ffbaf96)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:01.629872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:01.774575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee9623925364f4ebca89cc03ffbaf96', 'request_id': 'req-02d0f700-7a6b-4615-9f94-ad42281534eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:01.782223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee9623925364f4ebca89cc03ffbaf96', 'request_id': 'req-02d0f700-7a6b-4615-9f94-ad42281534eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:01.804963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee9623925364f4ebca89cc03ffbaf96', 'request_id': 'req-02d0f700-7a6b-4615-9f94-ad42281534eb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:01.823131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] The token cache is being invalidate because project 4ee9623925364f4ebca89cc03ffbaf96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:01.823619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:01.825715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:01.827949 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2512/4993] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:01 2022] DELETE /identity/v3/projects/4ee9623925364f4ebca89cc03ffbaf96 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:01.831644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ae8fe-9260-47e0-8613-a881eb6ba2d1 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:01.844246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ae8fe-9260-47e0-8613-a881eb6ba2d1 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:01.946673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:01.948721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:01.949358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:01.949872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] PATH_INFO: `/v3/users/3acfe398322e4260969465d0aa439aeb` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:01.951877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acfe398322e4260969465d0aa439aeb)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:01.954864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:02.074007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acfe398322e4260969465d0aa439aeb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.075045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acfe398322e4260969465d0aa439aeb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.075854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acfe398322e4260969465d0aa439aeb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.100646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acfe398322e4260969465d0aa439aeb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.118581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-25c58b3e-cc7d-4056-9cdf-171786e5b66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acfe398322e4260969465d0aa439aeb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.144766 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2482/4994] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:01 2022] DELETE /identity/v3/users/3acfe398322e4260969465d0aa439aeb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:02.198961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:02.204362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:02.220522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0f700-7a6b-4615-9f94-ad42281534eb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:02.305802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:02.307636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:02.307928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:02.308732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] PATH_INFO: `/v3/users/7fb0e17a60d44a8ab4114bea43e4a829` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:02.310428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb0e17a60d44a8ab4114bea43e4a829)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:02.312538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:02.405754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb0e17a60d44a8ab4114bea43e4a829'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.422995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb0e17a60d44a8ab4114bea43e4a829'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.447080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb0e17a60d44a8ab4114bea43e4a829'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.447707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb0e17a60d44a8ab4114bea43e4a829'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.448404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb0e17a60d44a8ab4114bea43e4a829'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.475452 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2513/4995] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:02 2022] DELETE /identity/v3/users/7fb0e17a60d44a8ab4114bea43e4a829 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:02.481236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34fbe-00b7-4e1a-bbdd-eada50576b66 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:02.481525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34fbe-00b7-4e1a-bbdd-eada50576b66 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:02.481808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34fbe-00b7-4e1a-bbdd-eada50576b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:02.511951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-21c34fbe-00b7-4e1a-bbdd-eada50576b66 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:02.513305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-21c34fbe-00b7-4e1a-bbdd-eada50576b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:02.590223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:02.595274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:02.640924 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2483/4996] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:02.651896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c34fbe-00b7-4e1a-bbdd-eada50576b66 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:02.654219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-21c34fbe-00b7-4e1a-bbdd-eada50576b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:02.728532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b1ffa-e73d-4ad1-b786-a219d65e7f02 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:02.734487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:02.735873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:02.736392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:02.736828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] PATH_INFO: `/v3/projects/96e7aef301094b659fc2e3dd1f114ec4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:02.739092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e7aef301094b659fc2e3dd1f114ec4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:02.744629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:02.755429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c34fbe-00b7-4e1a-bbdd-eada50576b66 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:02.760773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ca03-6d51-4024-b041-1ad1a3817d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:02.761556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ca03-6d51-4024-b041-1ad1a3817d12 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:02.761922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ca03-6d51-4024-b041-1ad1a3817d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:02.762274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ca03-6d51-4024-b041-1ad1a3817d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:02.782676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410ca03-6d51-4024-b041-1ad1a3817d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:02.782676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410ca03-6d51-4024-b041-1ad1a3817d12 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:02.790480 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2484/4997] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:08:02.816206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e7aef301094b659fc2e3dd1f114ec4', 'request_id': 'req-68888960-f377-4d71-b3d1-8c5cfdf58613'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.824671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e7aef301094b659fc2e3dd1f114ec4', 'request_id': 'req-68888960-f377-4d71-b3d1-8c5cfdf58613'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.838928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e7aef301094b659fc2e3dd1f114ec4', 'request_id': 'req-68888960-f377-4d71-b3d1-8c5cfdf58613'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.857693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] The token cache is being invalidate because project 96e7aef301094b659fc2e3dd1f114ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:02.858730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.859654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68888960-f377-4d71-b3d1-8c5cfdf58613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:02.862990 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2514/4998] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:02 2022] DELETE /identity/v3/projects/96e7aef301094b659fc2e3dd1f114ec4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:02.869929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba5abb-04e7-42e0-9c11-1ca05f4c666d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:02.870434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba5abb-04e7-42e0-9c11-1ca05f4c666d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:02.870702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba5abb-04e7-42e0-9c11-1ca05f4c666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:02.903790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-10ba5abb-04e7-42e0-9c11-1ca05f4c666d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:02.905470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-10ba5abb-04e7-42e0-9c11-1ca05f4c666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:02.983708 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2485/4999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:02.998992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58ed1-f30c-4d00-a413-68eef134d04d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:02.999327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58ed1-f30c-4d00-a413-68eef134d04d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:02.999573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58ed1-f30c-4d00-a413-68eef134d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.030948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dfa58ed1-f30c-4d00-a413-68eef134d04d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:03.032832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba5abb-04e7-42e0-9c11-1ca05f4c666d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.033579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dfa58ed1-f30c-4d00-a413-68eef134d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:03.034322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-10ba5abb-04e7-42e0-9c11-1ca05f4c666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:03.050127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba5abb-04e7-42e0-9c11-1ca05f4c666d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.050834 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2515/5000] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:03.052123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58ed1-f30c-4d00-a413-68eef134d04d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.063969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58ed1-f30c-4d00-a413-68eef134d04d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.067489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.070478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.071781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.072145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.072519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.072700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.073989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:03.074381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.075228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.075760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] PATH_INFO: `/v3/projects/bb8a3c6073ff4deca9e6c75ece698405` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.076714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.077795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8a3c6073ff4deca9e6c75ece698405)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.081580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.097033 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2516/5001] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:03.102068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.113141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8f7a1-c443-4216-9f36-8b0ad8127187 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.118690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7b13b-f9d3-4f19-b92c-30726421a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.119358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7b13b-f9d3-4f19-b92c-30726421a343 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.119640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7b13b-f9d3-4f19-b92c-30726421a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.119908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7b13b-f9d3-4f19-b92c-30726421a343 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.120664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7b13b-f9d3-4f19-b92c-30726421a343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.122728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7b13b-f9d3-4f19-b92c-30726421a343 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.159084 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2517/5002] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:03 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:03.161025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8a3c6073ff4deca9e6c75ece698405', 'request_id': 'req-e61fd408-5eb0-47ed-ac92-1850ae217a2c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:03.163779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7b13b-f9d3-4f19-b92c-30726421a343 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.170364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8a3c6073ff4deca9e6c75ece698405', 'request_id': 'req-e61fd408-5eb0-47ed-ac92-1850ae217a2c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:03.183747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8a3c6073ff4deca9e6c75ece698405', 'request_id': 'req-e61fd408-5eb0-47ed-ac92-1850ae217a2c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:03.208213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] The token cache is being invalidate because project bb8a3c6073ff4deca9e6c75ece698405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:03.208595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:03.210803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e61fd408-5eb0-47ed-ac92-1850ae217a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:03.217284 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2486/5003] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:03 2022] DELETE /identity/v3/projects/bb8a3c6073ff4deca9e6c75ece698405 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:03.219526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12e5f-7ba5-4ea2-88b3-ee0374afab3f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.219889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12e5f-7ba5-4ea2-88b3-ee0374afab3f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.220645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12e5f-7ba5-4ea2-88b3-ee0374afab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.243896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7b13b-f9d3-4f19-b92c-30726421a343 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.250850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.251169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e0a12e5f-7ba5-4ea2-88b3-ee0374afab3f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:03.251719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.252064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.252251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e0a12e5f-7ba5-4ea2-88b3-ee0374afab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:03.252670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.253931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.255483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.271390 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2487/5004] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:03.274798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848be4d-4d86-4dfa-89a2-3ab63caa766b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.275398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848be4d-4d86-4dfa-89a2-3ab63caa766b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.277023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848be4d-4d86-4dfa-89a2-3ab63caa766b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.296564 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2518/5005] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:03 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:03.301275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.314849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:03.337058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3848be4d-4d86-4dfa-89a2-3ab63caa766b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:03.338443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3848be4d-4d86-4dfa-89a2-3ab63caa766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:03.349750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb31ee-68de-44f6-97e8-5f63c11c8254 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.352358 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2488/5006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:03.357709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848be4d-4d86-4dfa-89a2-3ab63caa766b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.360780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d5f3-b3db-4b27-aff0-3ca2fb1fabe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.361482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d5f3-b3db-4b27-aff0-3ca2fb1fabe4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.361772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d5f3-b3db-4b27-aff0-3ca2fb1fabe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.362053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d5f3-b3db-4b27-aff0-3ca2fb1fabe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.363199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d5f3-b3db-4b27-aff0-3ca2fb1fabe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.364859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d5f3-b3db-4b27-aff0-3ca2fb1fabe4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.380320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848be4d-4d86-4dfa-89a2-3ab63caa766b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.388759 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2519/5007] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:08:03.390380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d5f3-b3db-4b27-aff0-3ca2fb1fabe4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.396611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.397848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.398763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.399100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.399844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:03.400939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.402612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d5f3-b3db-4b27-aff0-3ca2fb1fabe4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.408210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f1d13-57bb-423f-b86a-3e2d7624b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.409262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f1d13-57bb-423f-b86a-3e2d7624b52f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.409628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f1d13-57bb-423f-b86a-3e2d7624b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.410002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f1d13-57bb-423f-b86a-3e2d7624b52f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.410788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f1d13-57bb-423f-b86a-3e2d7624b52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.413118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f1d13-57bb-423f-b86a-3e2d7624b52f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.413897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.429876 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2520/5008] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:03.430984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f1d13-57bb-423f-b86a-3e2d7624b52f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.434075 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2489/5009] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:03.438782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.467277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f1d13-57bb-423f-b86a-3e2d7624b52f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.488193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468481f-b427-4038-afbb-d1ad1ae4d084 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.492574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca1b30-8095-467f-a221-14fd0fade3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.493616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1b30-8095-467f-a221-14fd0fade3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.493896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1b30-8095-467f-a221-14fd0fade3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.494169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1b30-8095-467f-a221-14fd0fade3c5 admin admin] PATH_INFO: `/v3/projects/6f2c97586ced4d5ba6d2da040420f0ad/users/d3d5bbb6ef21420786e59fd2d874b82a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.506752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54877-859a-46d0-89ed-ac5bd9fcfe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.508042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54877-859a-46d0-89ed-ac5bd9fcfe45 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.508042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54877-859a-46d0-89ed-ac5bd9fcfe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.508435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae54877-859a-46d0-89ed-ac5bd9fcfe45 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.508871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae54877-859a-46d0-89ed-ac5bd9fcfe45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.511268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae54877-859a-46d0-89ed-ac5bd9fcfe45 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.538159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca1b30-8095-467f-a221-14fd0fade3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2c97586ced4d5ba6d2da040420f0ad, user_id=d3d5bbb6ef21420786e59fd2d874b82a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.557887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca1b30-8095-467f-a221-14fd0fade3c5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.607062 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2490/5011] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:03 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:03.607311 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2521/5011] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:03 2022] PUT /identity/v3/projects/6f2c97586ced4d5ba6d2da040420f0ad/users/d3d5bbb6ef21420786e59fd2d874b82a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:03.607771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54877-859a-46d0-89ed-ac5bd9fcfe45 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.609006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940b71-7a4b-486d-9115-f938ef95ff9d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.610284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940b71-7a4b-486d-9115-f938ef95ff9d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.610774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940b71-7a4b-486d-9115-f938ef95ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.697521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6f940b71-7a4b-486d-9115-f938ef95ff9d None None] MFA Rules not processed for user `d3d5bbb6ef21420786e59fd2d874b82a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:03.698870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6f940b71-7a4b-486d-9115-f938ef95ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:03.776006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae54877-859a-46d0-89ed-ac5bd9fcfe45 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.788540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079e0fc-049e-49df-84ba-02e0d1f66ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.789664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079e0fc-049e-49df-84ba-02e0d1f66ead admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.789664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079e0fc-049e-49df-84ba-02e0d1f66ead admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.790320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079e0fc-049e-49df-84ba-02e0d1f66ead admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.791179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079e0fc-049e-49df-84ba-02e0d1f66ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.793894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079e0fc-049e-49df-84ba-02e0d1f66ead admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.829609 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2491/5012] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:03 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:03.834491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079e0fc-049e-49df-84ba-02e0d1f66ead admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.870910 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2522/5013] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:03.872276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940b71-7a4b-486d-9115-f938ef95ff9d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.881904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079e0fc-049e-49df-84ba-02e0d1f66ead admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.891110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940b71-7a4b-486d-9115-f938ef95ff9d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.898932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e568-35d1-4aec-85da-3d45157510eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.899622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e568-35d1-4aec-85da-3d45157510eb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.899912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e568-35d1-4aec-85da-3d45157510eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.900375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e568-35d1-4aec-85da-3d45157510eb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.901108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11e568-35d1-4aec-85da-3d45157510eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.903903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11e568-35d1-4aec-85da-3d45157510eb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.911633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f59bc0-b90c-4d40-98ba-0ab0c3089db9 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.913136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f59bc0-b90c-4d40-98ba-0ab0c3089db9 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.913424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f59bc0-b90c-4d40-98ba-0ab0c3089db9 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.913704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f59bc0-b90c-4d40-98ba-0ab0c3089db9 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/application_credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.914466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f59bc0-b90c-4d40-98ba-0ab0c3089db9 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:create_application_credential(user_id=d3d5bbb6ef21420786e59fd2d874b82a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.915652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f59bc0-b90c-4d40-98ba-0ab0c3089db9 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:03.935304 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2492/5014] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:03.939866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e568-35d1-4aec-85da-3d45157510eb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:03.971240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e568-35d1-4aec-85da-3d45157510eb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:03.991006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7c9ed-c45d-409b-8bdc-05d7bcc85c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:03.991620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7c9ed-c45d-409b-8bdc-05d7bcc85c04 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:03.991906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7c9ed-c45d-409b-8bdc-05d7bcc85c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:03.992357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7c9ed-c45d-409b-8bdc-05d7bcc85c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:03.993105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7c9ed-c45d-409b-8bdc-05d7bcc85c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:03.997628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7c9ed-c45d-409b-8bdc-05d7bcc85c04 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.045874 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2493/5015] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:04.050543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7c9ed-c45d-409b-8bdc-05d7bcc85c04 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.066373 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2523/5016] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Feb 19 21:08:03 2022] POST /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/application_credentials => generated 920 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:04.067725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f59bc0-b90c-4d40-98ba-0ab0c3089db9 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.076058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7c9ed-c45d-409b-8bdc-05d7bcc85c04 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.088677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc6b98-4cd8-4fe8-97da-b53a9d5c2d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.089757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6b98-4cd8-4fe8-97da-b53a9d5c2d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.089905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f59bc0-b90c-4d40-98ba-0ab0c3089db9 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.090011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6b98-4cd8-4fe8-97da-b53a9d5c2d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.090221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6b98-4cd8-4fe8-97da-b53a9d5c2d9c admin admin] PATH_INFO: `/v3/projects/d10c7c8b9fba438abf201d80c58a8655/users/1466ade1177f483292054d2244caee36/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.107026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.107924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.108816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.108816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules/490a2641e60948a1a9e0a818eb5f9ece` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.110278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:delete_access_rule(user_id=d3d5bbb6ef21420786e59fd2d874b82a, access_rule_id=490a2641e60948a1a9e0a818eb5f9ece)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.111995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.120636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc6b98-4cd8-4fe8-97da-b53a9d5c2d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10c7c8b9fba438abf201d80c58a8655, user_id=1466ade1177f483292054d2244caee36, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.123375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc6b98-4cd8-4fe8-97da-b53a9d5c2d9c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.153935 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2494/5017] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:04 2022] PUT /identity/v3/projects/d10c7c8b9fba438abf201d80c58a8655/users/1466ade1177f483292054d2244caee36/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:04.165527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b323-50f4-4d02-add0-d248c68fdc63 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.165822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b323-50f4-4d02-add0-d248c68fdc63 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.166104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b323-50f4-4d02-add0-d248c68fdc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.199103 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Feb 19 21:08:04.203486 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2524/5018] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Feb 19 21:08:04 2022] DELETE /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules/490a2641e60948a1a9e0a818eb5f9ece => generated 89 bytes in 133 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Feb 19 21:08:04.213469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.227112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7440b1-2738-4749-8619-160c3ac53269 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.233100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cb40b323-50f4-4d02-add0-d248c68fdc63 None None] MFA Rules not processed for user `1466ade1177f483292054d2244caee36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:04.234706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cb40b323-50f4-4d02-add0-d248c68fdc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:04.313034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfc206-2174-4e28-b004-c3a7f092715a tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.314152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfc206-2174-4e28-b004-c3a7f092715a tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.314507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfc206-2174-4e28-b004-c3a7f092715a tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.314892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfc206-2174-4e28-b004-c3a7f092715a tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/application_credentials/c9539fca8ce4429599aa42720dcda5d1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.346305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfc206-2174-4e28-b004-c3a7f092715a tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d3d5bbb6ef21420786e59fd2d874b82a, application_credential_id=c9539fca8ce4429599aa42720dcda5d1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.348421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfc206-2174-4e28-b004-c3a7f092715a tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.364089 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2495/5019] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:04.370116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40b323-50f4-4d02-add0-d248c68fdc63 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.424390 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2525/5020] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:08:04 2022] DELETE /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/application_credentials/c9539fca8ce4429599aa42720dcda5d1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:04.429722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfc206-2174-4e28-b004-c3a7f092715a tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.447848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfc206-2174-4e28-b004-c3a7f092715a tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.453937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff7204-1df4-4d48-bfda-4b3090416867 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.455217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7204-1df4-4d48-bfda-4b3090416867 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.456282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7204-1df4-4d48-bfda-4b3090416867 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.458333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7204-1df4-4d48-bfda-4b3090416867 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.460629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff7204-1df4-4d48-bfda-4b3090416867 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:list_access_rules(user_id=d3d5bbb6ef21420786e59fd2d874b82a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.462930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff7204-1df4-4d48-bfda-4b3090416867 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.469843 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2526/5021] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 21:08:04 2022] GET /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules => generated 369 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:08:04.473896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff7204-1df4-4d48-bfda-4b3090416867 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.492753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff7204-1df4-4d48-bfda-4b3090416867 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.493083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40b323-50f4-4d02-add0-d248c68fdc63 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.498147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27456-994b-4f77-9dd4-94bb67b14079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.498822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27456-994b-4f77-9dd4-94bb67b14079 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.499107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27456-994b-4f77-9dd4-94bb67b14079 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.499388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27456-994b-4f77-9dd4-94bb67b14079 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.500091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b27456-994b-4f77-9dd4-94bb67b14079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.501469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e5ca-c301-4196-b550-1823934bba14 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.502070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b27456-994b-4f77-9dd4-94bb67b14079 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.503043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e5ca-c301-4196-b550-1823934bba14 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.503669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e5ca-c301-4196-b550-1823934bba14 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.504442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e5ca-c301-4196-b550-1823934bba14 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules/490a2641e60948a1a9e0a818eb5f9ece` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.505987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94e5ca-c301-4196-b550-1823934bba14 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:delete_access_rule(user_id=d3d5bbb6ef21420786e59fd2d874b82a, access_rule_id=490a2641e60948a1a9e0a818eb5f9ece)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.508418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94e5ca-c301-4196-b550-1823934bba14 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.532314 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2527/5022] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Feb 19 21:08:04 2022] DELETE /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules/490a2641e60948a1a9e0a818eb5f9ece => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:04.537973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e5ca-c301-4196-b550-1823934bba14 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.544925 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2496/5023] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:04 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:04.548977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27456-994b-4f77-9dd4-94bb67b14079 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.551245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e5ca-c301-4196-b550-1823934bba14 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.618933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5126c2b-8410-452a-8cc7-aea09d4174df tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.620814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126c2b-8410-452a-8cc7-aea09d4174df tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.622479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126c2b-8410-452a-8cc7-aea09d4174df tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.624235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126c2b-8410-452a-8cc7-aea09d4174df tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.629061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5126c2b-8410-452a-8cc7-aea09d4174df tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:list_access_rules(user_id=d3d5bbb6ef21420786e59fd2d874b82a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.630637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5126c2b-8410-452a-8cc7-aea09d4174df tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.643475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27456-994b-4f77-9dd4-94bb67b14079 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.643716 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2528/5024] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 21:08:04 2022] GET /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules => generated 158 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:08:04.647015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5126c2b-8410-452a-8cc7-aea09d4174df tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.650416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219c889-48da-4776-9905-b4b12d8f8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.651223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c889-48da-4776-9905-b4b12d8f8794 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.651618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c889-48da-4776-9905-b4b12d8f8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.652008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c889-48da-4776-9905-b4b12d8f8794 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.652869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219c889-48da-4776-9905-b4b12d8f8794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.655780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219c889-48da-4776-9905-b4b12d8f8794 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.657804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5126c2b-8410-452a-8cc7-aea09d4174df tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.662538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf0e3-cac9-413a-8a67-7fec71e233d0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.663925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf0e3-cac9-413a-8a67-7fec71e233d0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.664409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf0e3-cac9-413a-8a67-7fec71e233d0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.664990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bf0e3-cac9-413a-8a67-7fec71e233d0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/application_credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.665911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bf0e3-cac9-413a-8a67-7fec71e233d0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:create_application_credential(user_id=d3d5bbb6ef21420786e59fd2d874b82a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.667565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bf0e3-cac9-413a-8a67-7fec71e233d0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.698741 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2497/5025] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:04 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:04.699839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219c889-48da-4776-9905-b4b12d8f8794 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.729245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219c889-48da-4776-9905-b4b12d8f8794 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.746143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cff3e-65d6-4f82-b550-4b1d8471392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.747073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cff3e-65d6-4f82-b550-4b1d8471392d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.747570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cff3e-65d6-4f82-b550-4b1d8471392d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.747929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cff3e-65d6-4f82-b550-4b1d8471392d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.748921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cff3e-65d6-4f82-b550-4b1d8471392d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.750924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cff3e-65d6-4f82-b550-4b1d8471392d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.764610 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2498/5026] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:04.768596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cff3e-65d6-4f82-b550-4b1d8471392d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.779297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cff3e-65d6-4f82-b550-4b1d8471392d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.787842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c31537-75dc-40de-a8c3-132142556570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.788800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31537-75dc-40de-a8c3-132142556570 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.789083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31537-75dc-40de-a8c3-132142556570 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.789360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31537-75dc-40de-a8c3-132142556570 admin admin] PATH_INFO: `/v3/projects/ff5cda41ea574843afe68dc01c26536b/users/3a8dba80c8794eb4adc933b43996db2a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.813179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c31537-75dc-40de-a8c3-132142556570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5cda41ea574843afe68dc01c26536b, user_id=3a8dba80c8794eb4adc933b43996db2a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.817354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c31537-75dc-40de-a8c3-132142556570 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.839314 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2529/5027] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Feb 19 21:08:04 2022] POST /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/application_credentials => generated 920 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:04.843318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf0e3-cac9-413a-8a67-7fec71e233d0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.843878 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2499/5028] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:04 2022] PUT /identity/v3/projects/ff5cda41ea574843afe68dc01c26536b/users/3a8dba80c8794eb4adc933b43996db2a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:04.850519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c31537-75dc-40de-a8c3-132142556570 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.873065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bf0e3-cac9-413a-8a67-7fec71e233d0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.930178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840ce6f-53d2-453b-a7ff-045a81c19c5f tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.931066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840ce6f-53d2-453b-a7ff-045a81c19c5f tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.931408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840ce6f-53d2-453b-a7ff-045a81c19c5f tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.931695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840ce6f-53d2-453b-a7ff-045a81c19c5f tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.932499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c31537-75dc-40de-a8c3-132142556570 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.933029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840ce6f-53d2-453b-a7ff-045a81c19c5f tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:list_access_rules(user_id=d3d5bbb6ef21420786e59fd2d874b82a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.934891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840ce6f-53d2-453b-a7ff-045a81c19c5f tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.939759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28712f06-d07f-4d30-acaf-9cadbcffa605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.941471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28712f06-d07f-4d30-acaf-9cadbcffa605 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.941593 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2530/5029] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 21:08:04 2022] GET /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules => generated 369 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:04.947942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28712f06-d07f-4d30-acaf-9cadbcffa605 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.948236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28712f06-d07f-4d30-acaf-9cadbcffa605 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.949017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840ce6f-53d2-453b-a7ff-045a81c19c5f tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.949159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28712f06-d07f-4d30-acaf-9cadbcffa605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.950684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28712f06-d07f-4d30-acaf-9cadbcffa605 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.964038 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2500/5030] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:08:04.964959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840ce6f-53d2-453b-a7ff-045a81c19c5f tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.968249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28712f06-d07f-4d30-acaf-9cadbcffa605 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:04.971132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe5b0f-8178-4230-b82a-8b1ccb35b8b0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.972269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b0f-8178-4230-b82a-8b1ccb35b8b0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.972458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b0f-8178-4230-b82a-8b1ccb35b8b0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.972618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b0f-8178-4230-b82a-8b1ccb35b8b0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/application_credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.973364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe5b0f-8178-4230-b82a-8b1ccb35b8b0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:create_application_credential(user_id=d3d5bbb6ef21420786e59fd2d874b82a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.974521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe5b0f-8178-4230-b82a-8b1ccb35b8b0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:04.978895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28712f06-d07f-4d30-acaf-9cadbcffa605 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:04.983639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876beb1-5fa6-4cf5-92f5-b2b197de22e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:04.984571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876beb1-5fa6-4cf5-92f5-b2b197de22e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:04.984854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876beb1-5fa6-4cf5-92f5-b2b197de22e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:04.985129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876beb1-5fa6-4cf5-92f5-b2b197de22e6 admin admin] PATH_INFO: `/v3/projects/ff5cda41ea574843afe68dc01c26536b/users/3a8dba80c8794eb4adc933b43996db2a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:04.987188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876beb1-5fa6-4cf5-92f5-b2b197de22e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5cda41ea574843afe68dc01c26536b, user_id=3a8dba80c8794eb4adc933b43996db2a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:04.989920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876beb1-5fa6-4cf5-92f5-b2b197de22e6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:05.003105 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2501/5031] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:04 2022] PUT /identity/v3/projects/ff5cda41ea574843afe68dc01c26536b/users/3a8dba80c8794eb4adc933b43996db2a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:05.014938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7894e-ce5f-4f3c-aa3d-ffa409d7c632 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:05.015228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7894e-ce5f-4f3c-aa3d-ffa409d7c632 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:05.015514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7894e-ce5f-4f3c-aa3d-ffa409d7c632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:05.084908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a6c7894e-ce5f-4f3c-aa3d-ffa409d7c632 None None] MFA Rules not processed for user `3a8dba80c8794eb4adc933b43996db2a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:05.086975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a6c7894e-ce5f-4f3c-aa3d-ffa409d7c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:05.101176 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2531/5032] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Feb 19 21:08:04 2022] POST /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/application_credentials => generated 921 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:05.103194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe5b0f-8178-4230-b82a-8b1ccb35b8b0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:05.119653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe5b0f-8178-4230-b82a-8b1ccb35b8b0 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:05.180517 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2502/5033] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:05.187745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387647a8-6a40-4e79-9e10-b5fa5cea5a78 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3d5bbb6ef21420786e59fd2d874b82a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2c97586ced4d5ba6d2da040420f0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:05.187745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387647a8-6a40-4e79-9e10-b5fa5cea5a78 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:05.188066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387647a8-6a40-4e79-9e10-b5fa5cea5a78 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:05.188546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387647a8-6a40-4e79-9e10-b5fa5cea5a78 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules/ec822958775340599559f4dfb7bb20b6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:05.190004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387647a8-6a40-4e79-9e10-b5fa5cea5a78 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorizing `identity:get_access_rule(user_id=d3d5bbb6ef21420786e59fd2d874b82a, access_rule_id=ec822958775340599559f4dfb7bb20b6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:05.192380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387647a8-6a40-4e79-9e10-b5fa5cea5a78 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:05.194584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7894e-ce5f-4f3c-aa3d-ffa409d7c632 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:05.196662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a6c7894e-ce5f-4f3c-aa3d-ffa409d7c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:05.204493 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2532/5034] 10.222.0.30 () {58 vars in 1358 bytes} [Sat Feb 19 21:08:05 2022] GET /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a/access_rules/ec822958775340599559f4dfb7bb20b6 => generated 229 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:08:05.205779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387647a8-6a40-4e79-9e10-b5fa5cea5a78 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:05.308008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7894e-ce5f-4f3c-aa3d-ffa409d7c632 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:05.311944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cfc54-ab54-4571-824d-4f00fbcc0013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:05.312639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cfc54-ab54-4571-824d-4f00fbcc0013 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:05.312925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cfc54-ab54-4571-824d-4f00fbcc0013 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:05.313186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cfc54-ab54-4571-824d-4f00fbcc0013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:05.323271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387647a8-6a40-4e79-9e10-b5fa5cea5a78 tempest-AccessRulesV3Test-2086582199 tempest-AccessRulesV3Test-2086582199-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:05.328425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:05.329243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:05.329534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:05.329849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] PATH_INFO: `/v3/users/d3d5bbb6ef21420786e59fd2d874b82a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:05.331025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d5bbb6ef21420786e59fd2d874b82a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:05.331366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cfc54-ab54-4571-824d-4f00fbcc0013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:05.333043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:05.333195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cfc54-ab54-4571-824d-4f00fbcc0013 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:05.346185 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2503/5035] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:08:05.423547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d5bbb6ef21420786e59fd2d874b82a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:05.463376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cfc54-ab54-4571-824d-4f00fbcc0013 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:05.480676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cfc54-ab54-4571-824d-4f00fbcc0013 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:05.493738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:05.505870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:05.510731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:05.510990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:05.512297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d5bbb6ef21420786e59fd2d874b82a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:05.525937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d5bbb6ef21420786e59fd2d874b82a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:05.526918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d5bbb6ef21420786e59fd2d874b82a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:05.528833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2c27c197-b37b-4c2a-8d8d-b291e8aaf019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d5bbb6ef21420786e59fd2d874b82a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:05.569606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2533/5036] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:05 2022] DELETE /identity/v3/users/d3d5bbb6ef21420786e59fd2d874b82a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:05.571757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff98b2-f460-4796-b657-112c12db03d2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:05.572052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff98b2-f460-4796-b657-112c12db03d2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:05.572355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff98b2-f460-4796-b657-112c12db03d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:05.612843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4cff98b2-f460-4796-b657-112c12db03d2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:05.617644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:05.618337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4cff98b2-f460-4796-b657-112c12db03d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:05.619129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:05.634009 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2504/5037] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:08:05.821645 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2534/5038] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:05.833089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:05.835132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:05.915422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963219a9-b228-4fb6-819f-54b5e6350566 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:05.998118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad176a-1d8a-4032-a8c3-0f9b8d2410a8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:06.001910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad176a-1d8a-4032-a8c3-0f9b8d2410a8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:06.003036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad176a-1d8a-4032-a8c3-0f9b8d2410a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:06.026750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:06.027431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:06.027733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:06.027992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:06.036512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-44ad176a-1d8a-4032-a8c3-0f9b8d2410a8 None None] MFA Rules not processed for user `20246495a35b4762be5b2ad98f537377`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:06.038785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-44ad176a-1d8a-4032-a8c3-0f9b8d2410a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:06.041309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:06.043174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:06.071826 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2505/5039] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:06.148017 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2535/5040] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:06.562671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:06.565015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:06.587894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545a09a-35a0-4c7f-86a3-472ae85fd85c service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:06.595873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:06.597284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:06.597803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:06.598464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] PATH_INFO: `/v3/projects/6f2c97586ced4d5ba6d2da040420f0ad` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:06.601781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2c97586ced4d5ba6d2da040420f0ad)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:06.605485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:06.663822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2c97586ced4d5ba6d2da040420f0ad', 'request_id': 'req-a030bc88-4e7c-4f3d-ae44-5a215e887544'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:06.669957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2c97586ced4d5ba6d2da040420f0ad', 'request_id': 'req-a030bc88-4e7c-4f3d-ae44-5a215e887544'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:06.680227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2c97586ced4d5ba6d2da040420f0ad', 'request_id': 'req-a030bc88-4e7c-4f3d-ae44-5a215e887544'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:06.694187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] The token cache is being invalidate because project 6f2c97586ced4d5ba6d2da040420f0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:06.694547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:06.695909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a030bc88-4e7c-4f3d-ae44-5a215e887544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:06.700898 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2506/5041] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:06 2022] DELETE /identity/v3/projects/6f2c97586ced4d5ba6d2da040420f0ad => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:06.702844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be592-82b8-4d80-ba55-90cba93d4fd4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:06.703414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be592-82b8-4d80-ba55-90cba93d4fd4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:06.704144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be592-82b8-4d80-ba55-90cba93d4fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:06.729447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-375be592-82b8-4d80-ba55-90cba93d4fd4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:06.730791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-375be592-82b8-4d80-ba55-90cba93d4fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:06.796375 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2536/5042] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:06.804269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97142c-8340-4957-83de-b769ef48ac3a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:06.804629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97142c-8340-4957-83de-b769ef48ac3a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:06.804910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97142c-8340-4957-83de-b769ef48ac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:06.825780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5b97142c-8340-4957-83de-b769ef48ac3a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:06.827032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5b97142c-8340-4957-83de-b769ef48ac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:06.841068 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2507/5043] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:06.845355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be592-82b8-4d80-ba55-90cba93d4fd4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:06.857876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be592-82b8-4d80-ba55-90cba93d4fd4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:06.866500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:06.867184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:06.867467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:06.867737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:06.868694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:06.869179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:06.870850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:06.884217 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2537/5044] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:06.888615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97142c-8340-4957-83de-b769ef48ac3a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:06.899966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97142c-8340-4957-83de-b769ef48ac3a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:06.905372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4458-8654-48ed-a006-4d332ee5aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:06.906286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4458-8654-48ed-a006-4d332ee5aa0e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:06.906729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4458-8654-48ed-a006-4d332ee5aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:06.907311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4458-8654-48ed-a006-4d332ee5aa0e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:06.908193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4458-8654-48ed-a006-4d332ee5aa0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:06.910424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4458-8654-48ed-a006-4d332ee5aa0e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:06.966338 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2508/5045] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:06 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:06.969824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:06.980578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc95a9b-b8a8-40ac-b8a2-bc100fd4819a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:07.049791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa523600-ec48-4d62-a860-a656e381117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:07.050433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa523600-ec48-4d62-a860-a656e381117a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:07.050714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa523600-ec48-4d62-a860-a656e381117a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:07.050990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa523600-ec48-4d62-a860-a656e381117a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:07.051745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa523600-ec48-4d62-a860-a656e381117a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:07.054393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa523600-ec48-4d62-a860-a656e381117a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:07.086175 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2538/5046] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:06 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:07.092250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4458-8654-48ed-a006-4d332ee5aa0e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:07.104205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4458-8654-48ed-a006-4d332ee5aa0e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:07.111926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9482ac3-dc0d-4922-8e9b-bc42cf2ece16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:07.112651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9482ac3-dc0d-4922-8e9b-bc42cf2ece16 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:07.112936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9482ac3-dc0d-4922-8e9b-bc42cf2ece16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:07.113378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9482ac3-dc0d-4922-8e9b-bc42cf2ece16 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:07.114388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9482ac3-dc0d-4922-8e9b-bc42cf2ece16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:07.115778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9482ac3-dc0d-4922-8e9b-bc42cf2ece16 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:07.131908 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2509/5047] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:07.133234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa523600-ec48-4d62-a860-a656e381117a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:07.144381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa523600-ec48-4d62-a860-a656e381117a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:07.150363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee8bbd-8864-4643-9e89-aeb8c8df2ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:07.151070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee8bbd-8864-4643-9e89-aeb8c8df2ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:07.151662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee8bbd-8864-4643-9e89-aeb8c8df2ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:07.151805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee8bbd-8864-4643-9e89-aeb8c8df2ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:07.152534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee8bbd-8864-4643-9e89-aeb8c8df2ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:07.154495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee8bbd-8864-4643-9e89-aeb8c8df2ae5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:07.173489 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2539/5048] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:07.179664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9482ac3-dc0d-4922-8e9b-bc42cf2ece16 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:07.192920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9482ac3-dc0d-4922-8e9b-bc42cf2ece16 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:07.201605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8126bda-9f70-4529-80eb-064dbd9b15ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:07.202763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8126bda-9f70-4529-80eb-064dbd9b15ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:07.203100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8126bda-9f70-4529-80eb-064dbd9b15ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:07.203240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8126bda-9f70-4529-80eb-064dbd9b15ec admin admin] PATH_INFO: `/v3/projects/241d736f5e6c4c7298b81bf9c8e891bd/users/12e5913a04d0464bbfeba056d865c0ec/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:07.221186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8126bda-9f70-4529-80eb-064dbd9b15ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=241d736f5e6c4c7298b81bf9c8e891bd, user_id=12e5913a04d0464bbfeba056d865c0ec, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:07.224230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8126bda-9f70-4529-80eb-064dbd9b15ec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:07.244038 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2510/5049] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:07 2022] PUT /identity/v3/projects/241d736f5e6c4c7298b81bf9c8e891bd/users/12e5913a04d0464bbfeba056d865c0ec/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:07.257573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973498f6-bf5d-46a3-b5ba-537ea9cac1ad None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:07.258197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973498f6-bf5d-46a3-b5ba-537ea9cac1ad None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:07.258552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973498f6-bf5d-46a3-b5ba-537ea9cac1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:07.367527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-973498f6-bf5d-46a3-b5ba-537ea9cac1ad None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:07.370462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-973498f6-bf5d-46a3-b5ba-537ea9cac1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:07.496210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8126bda-9f70-4529-80eb-064dbd9b15ec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:07.500377 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2540/5050] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:07.514306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8126bda-9f70-4529-80eb-064dbd9b15ec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:07.520780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf766e-8e74-4c55-aea3-7999f8c40a44 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:07.522334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf766e-8e74-4c55-aea3-7999f8c40a44 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:07.522862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf766e-8e74-4c55-aea3-7999f8c40a44 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:07.523388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf766e-8e74-4c55-aea3-7999f8c40a44 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:07.595261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-24bf766e-8e74-4c55-aea3-7999f8c40a44 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:07.612999 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2511/5051] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:07 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:08.619448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077b6a-36b8-4e8a-baa1-1027f3e15e2d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:08.621950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077b6a-36b8-4e8a-baa1-1027f3e15e2d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:08.622816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077b6a-36b8-4e8a-baa1-1027f3e15e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:08.659488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7d077b6a-36b8-4e8a-baa1-1027f3e15e2d None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:08.661188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d077b6a-36b8-4e8a-baa1-1027f3e15e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:08.666818 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2541/5052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:08 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:08.675150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28dce0-f50c-4deb-862e-83a2fa7a41ef None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:08.676231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28dce0-f50c-4deb-862e-83a2fa7a41ef None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:08.677418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28dce0-f50c-4deb-862e-83a2fa7a41ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:08.703331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9d28dce0-f50c-4deb-862e-83a2fa7a41ef None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:08.704798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9d28dce0-f50c-4deb-862e-83a2fa7a41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:08.714510 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2512/5053] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:08.719415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077b6a-36b8-4e8a-baa1-1027f3e15e2d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:08.740207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077b6a-36b8-4e8a-baa1-1027f3e15e2d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:08.747381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86307df-dde5-4111-ba92-2acd10983289 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:08.750378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86307df-dde5-4111-ba92-2acd10983289 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:08.751561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86307df-dde5-4111-ba92-2acd10983289 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:08.751865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86307df-dde5-4111-ba92-2acd10983289 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:08.820979 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-e86307df-dde5-4111-ba92-2acd10983289 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Feb 19 21:08:08.824242 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2542/5054] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:08 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 188 bytes in 105 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Feb 19 21:08:08.827896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28dce0-f50c-4deb-862e-83a2fa7a41ef None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:08.841675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28dce0-f50c-4deb-862e-83a2fa7a41ef None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:08.849780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252e134-4ef5-4bdd-907a-78337278c48c tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:08.852855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252e134-4ef5-4bdd-907a-78337278c48c tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:08.852855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252e134-4ef5-4bdd-907a-78337278c48c tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:08.853660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252e134-4ef5-4bdd-907a-78337278c48c tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:08.908143 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-e252e134-4ef5-4bdd-907a-78337278c48c tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Feb 19 21:08:08.909663 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2513/5055] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:08 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 188 bytes in 82 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Feb 19 21:08:08.914266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86307df-dde5-4111-ba92-2acd10983289 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:08.930918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86307df-dde5-4111-ba92-2acd10983289 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:08.936129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1831d00-dd60-48f1-8506-547c7857e106 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:08.937338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1831d00-dd60-48f1-8506-547c7857e106 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:08.937618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1831d00-dd60-48f1-8506-547c7857e106 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:08.937920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1831d00-dd60-48f1-8506-547c7857e106 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:09.045063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1831d00-dd60-48f1-8506-547c7857e106 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:09.090590 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2543/5056] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:08 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:10.095352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26882-3f4c-4a90-94bf-b4367c3dbead None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:10.095841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26882-3f4c-4a90-94bf-b4367c3dbead None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:10.095931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26882-3f4c-4a90-94bf-b4367c3dbead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:10.120467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d3b26882-3f4c-4a90-94bf-b4367c3dbead None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:10.122312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d3b26882-3f4c-4a90-94bf-b4367c3dbead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:10.130421 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2514/5057] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:10 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:10.130870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfbaf-6594-4c64-a16e-1fd5dc966138 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:10.131375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfbaf-6594-4c64-a16e-1fd5dc966138 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:10.131497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfbaf-6594-4c64-a16e-1fd5dc966138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:10.160589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-30abfbaf-6594-4c64-a16e-1fd5dc966138 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:10.161816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-30abfbaf-6594-4c64-a16e-1fd5dc966138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:10.177407 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2544/5058] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:10.180764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b26882-3f4c-4a90-94bf-b4367c3dbead None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:10.194747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b26882-3f4c-4a90-94bf-b4367c3dbead None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:10.199537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c421f0-eb52-4744-b9f0-4393c9973715 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:10.200902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c421f0-eb52-4744-b9f0-4393c9973715 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:10.201414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c421f0-eb52-4744-b9f0-4393c9973715 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:10.202200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c421f0-eb52-4744-b9f0-4393c9973715 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:10.273566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d8c421f0-eb52-4744-b9f0-4393c9973715 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:10.291830 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2515/5059] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:10 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:11.297516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dd67b-c4a5-492f-880c-73609f926df0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:11.298112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dd67b-c4a5-492f-880c-73609f926df0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:11.298219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dd67b-c4a5-492f-880c-73609f926df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:11.325243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fb5dd67b-c4a5-492f-880c-73609f926df0 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:11.326927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fb5dd67b-c4a5-492f-880c-73609f926df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:11.337606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2545/5060] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:11 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:11.338588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab0df3-65c6-4fee-b474-4d97a34ca6d9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:11.339086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab0df3-65c6-4fee-b474-4d97a34ca6d9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:11.339189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab0df3-65c6-4fee-b474-4d97a34ca6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:11.364028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8cab0df3-65c6-4fee-b474-4d97a34ca6d9 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:11.365868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8cab0df3-65c6-4fee-b474-4d97a34ca6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:11.384176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dd67b-c4a5-492f-880c-73609f926df0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:11.396136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2516/5061] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:11.402032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dd67b-c4a5-492f-880c-73609f926df0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:11.409645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c4f12-5856-4e78-b406-cc0d76a761e4 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:11.410837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c4f12-5856-4e78-b406-cc0d76a761e4 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:11.411433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c4f12-5856-4e78-b406-cc0d76a761e4 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:11.412205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c4f12-5856-4e78-b406-cc0d76a761e4 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:11.487292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-df0c4f12-5856-4e78-b406-cc0d76a761e4 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:11.506807 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2546/5062] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:11 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:12.515787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0f692-dda5-454a-80f0-64f95ae6cac1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:12.515787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0f692-dda5-454a-80f0-64f95ae6cac1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:12.515787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0f692-dda5-454a-80f0-64f95ae6cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:12.541204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c0b0f692-dda5-454a-80f0-64f95ae6cac1 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:12.542463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c0b0f692-dda5-454a-80f0-64f95ae6cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:12.553667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104a1f-ae91-4a5f-af23-ece9dfbeb592 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:12.554541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104a1f-ae91-4a5f-af23-ece9dfbeb592 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:12.555131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104a1f-ae91-4a5f-af23-ece9dfbeb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:12.558073 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2517/5063] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:12 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:12.582987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5b104a1f-ae91-4a5f-af23-ece9dfbeb592 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:12.585427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5b104a1f-ae91-4a5f-af23-ece9dfbeb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:12.600422 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2547/5064] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:12.602200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0f692-dda5-454a-80f0-64f95ae6cac1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:12.619541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0f692-dda5-454a-80f0-64f95ae6cac1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:12.625142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020b68c-403e-4a2b-9c95-6d58fbf61bbf tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:12.626896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b68c-403e-4a2b-9c95-6d58fbf61bbf tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:12.627224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b68c-403e-4a2b-9c95-6d58fbf61bbf tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:12.627789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b68c-403e-4a2b-9c95-6d58fbf61bbf tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:12.694797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6020b68c-403e-4a2b-9c95-6d58fbf61bbf tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:12.716874 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2518/5065] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:12 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:13.722363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39449d8-d4c1-46a5-bc5f-656d4a7c3a4f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:13.722926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39449d8-d4c1-46a5-bc5f-656d4a7c3a4f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:13.722926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39449d8-d4c1-46a5-bc5f-656d4a7c3a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:13.748479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c39449d8-d4c1-46a5-bc5f-656d4a7c3a4f None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:13.749783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c39449d8-d4c1-46a5-bc5f-656d4a7c3a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:13.768755 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2548/5066] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:13 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:14.109042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a425e-fb7a-4561-af9c-dfaa24342c8e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:14.109566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a425e-fb7a-4561-af9c-dfaa24342c8e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:14.109677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a425e-fb7a-4561-af9c-dfaa24342c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:14.135828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c34a425e-fb7a-4561-af9c-dfaa24342c8e None None] MFA Rules not processed for user `fad7207822c04fc289709200d7e2bd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:14.137101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c34a425e-fb7a-4561-af9c-dfaa24342c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:14.265366 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2519/5067] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:14.770898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061003-f785-4e0f-ab46-ef731c15a3df None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:14.771479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061003-f785-4e0f-ab46-ef731c15a3df None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:14.771479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061003-f785-4e0f-ab46-ef731c15a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:14.794521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-97061003-f785-4e0f-ab46-ef731c15a3df None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:14.795824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-97061003-f785-4e0f-ab46-ef731c15a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:14.810348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04617-df3d-43c4-8978-73064151064c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:14.810496 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2549/5068] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:14.810634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04617-df3d-43c4-8978-73064151064c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:14.810910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04617-df3d-43c4-8978-73064151064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:14.847599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e2a04617-df3d-43c4-8978-73064151064c None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:14.849190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e2a04617-df3d-43c4-8978-73064151064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:14.854196 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2520/5069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 19 21:08:14.858485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b0f9-ad69-46f3-9e36-d11bc36c8468 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:14.858886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b0f9-ad69-46f3-9e36-d11bc36c8468 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:14.859327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b0f9-ad69-46f3-9e36-d11bc36c8468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:14.975366 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-e229b0f9-ad69-46f3-9e36-d11bc36c8468 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Feb 19 21:08:14.978165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2550/5070] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 121 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Feb 19 21:08:14.984421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60b54-d08b-4995-acb3-fbd79bb9a15a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:14.985011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60b54-d08b-4995-acb3-fbd79bb9a15a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:14.986953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60b54-d08b-4995-acb3-fbd79bb9a15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:15.066672 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-84e60b54-d08b-4995-acb3-fbd79bb9a15a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Feb 19 21:08:15.068873 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2521/5071] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 86 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Feb 19 21:08:15.074435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf08cf-522a-42bf-aa16-6a0803a54c6c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:15.075597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf08cf-522a-42bf-aa16-6a0803a54c6c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:15.076215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf08cf-522a-42bf-aa16-6a0803a54c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:15.177287 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-debf08cf-522a-42bf-aa16-6a0803a54c6c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Feb 19 21:08:15.177287 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2551/5072] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:15 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 103 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Feb 19 21:08:16.646009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e60b54-d08b-4995-acb3-fbd79bb9a15a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:16.649011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-84e60b54-d08b-4995-acb3-fbd79bb9a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:16.789363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e60b54-d08b-4995-acb3-fbd79bb9a15a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:16.803460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d56d8-a8fe-4cbc-a117-9207d677efcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:16.804318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d56d8-a8fe-4cbc-a117-9207d677efcc service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:16.804829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d56d8-a8fe-4cbc-a117-9207d677efcc service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:16.805270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d56d8-a8fe-4cbc-a117-9207d677efcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:16.807419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f08d56d8-a8fe-4cbc-a117-9207d677efcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:16.825636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d56d8-a8fe-4cbc-a117-9207d677efcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:16.828455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d56d8-a8fe-4cbc-a117-9207d677efcc service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:16.853728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2522/5073] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:22.014084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf08cf-522a-42bf-aa16-6a0803a54c6c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:22.029291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf08cf-522a-42bf-aa16-6a0803a54c6c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:22.037899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:22.038566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:22.038856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:22.039137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:22.041064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:22.062646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:22.064378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:22.079210 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2552/5074] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:26.192258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90859d0f-eb5a-4ab4-80c5-c8356be011f0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:26.193039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90859d0f-eb5a-4ab4-80c5-c8356be011f0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:26.193342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90859d0f-eb5a-4ab4-80c5-c8356be011f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:26.248052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-90859d0f-eb5a-4ab4-80c5-c8356be011f0 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:26.249574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-90859d0f-eb5a-4ab4-80c5-c8356be011f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:26.253152 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2523/5075] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:26 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:26.258786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:26.269366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c16f-5324-4306-80ac-7bb7d73f6af2 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:26.273967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed570bbf-f2ae-421b-9917-03f16fbd78c2 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:26.275023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed570bbf-f2ae-421b-9917-03f16fbd78c2 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:26.275495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed570bbf-f2ae-421b-9917-03f16fbd78c2 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:26.275784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed570bbf-f2ae-421b-9917-03f16fbd78c2 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:26.331984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ed570bbf-f2ae-421b-9917-03f16fbd78c2 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:26.345049 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2553/5076] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:26 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:27.348948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e48b3-c39a-4d8e-ab92-4acf8f91cd61 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:27.349571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e48b3-c39a-4d8e-ab92-4acf8f91cd61 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:27.350322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e48b3-c39a-4d8e-ab92-4acf8f91cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:27.369154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-890e48b3-c39a-4d8e-ab92-4acf8f91cd61 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:27.370411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-890e48b3-c39a-4d8e-ab92-4acf8f91cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:27.373785 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2524/5077] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:27 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:27.378481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46b1b-9ed7-4e3e-937e-7643e7596056 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:27.378977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46b1b-9ed7-4e3e-937e-7643e7596056 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:27.379099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46b1b-9ed7-4e3e-937e-7643e7596056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:27.396840 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-f8b46b1b-9ed7-4e3e-937e-7643e7596056 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Feb 19 21:08:27.398083 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2554/5078] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:27 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 21:08:27.402609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4940a-1862-4918-8fe7-9d98a63ac254 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:27.402901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4940a-1862-4918-8fe7-9d98a63ac254 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:27.403204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4940a-1862-4918-8fe7-9d98a63ac254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:27.448711 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-bfe4940a-1862-4918-8fe7-9d98a63ac254 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Feb 19 21:08:27.452622 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2525/5079] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:27 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 51 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Feb 19 21:08:27.455247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13904269-c3df-497c-8e00-b4b6d8cfda24 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:27.455814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13904269-c3df-497c-8e00-b4b6d8cfda24 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:27.456102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13904269-c3df-497c-8e00-b4b6d8cfda24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:27.495794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-13904269-c3df-497c-8e00-b4b6d8cfda24 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:27.497430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-13904269-c3df-497c-8e00-b4b6d8cfda24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:27.506429 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2555/5080] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:27.513451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4940a-1862-4918-8fe7-9d98a63ac254 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:27.528040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4940a-1862-4918-8fe7-9d98a63ac254 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:27.536939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378c14-66b9-4c06-b73b-eb2f64d36add tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:27.537864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378c14-66b9-4c06-b73b-eb2f64d36add tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:27.538190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378c14-66b9-4c06-b73b-eb2f64d36add tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:27.538500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378c14-66b9-4c06-b73b-eb2f64d36add tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:27.601429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3d378c14-66b9-4c06-b73b-eb2f64d36add tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:27.614020 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2526/5081] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:27 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:28.619371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291554ed-57e5-438a-8b95-cea5a2f4ea68 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:28.619970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291554ed-57e5-438a-8b95-cea5a2f4ea68 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:28.620147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291554ed-57e5-438a-8b95-cea5a2f4ea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:28.640605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-291554ed-57e5-438a-8b95-cea5a2f4ea68 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:28.641803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-291554ed-57e5-438a-8b95-cea5a2f4ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:28.645002 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2556/5082] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:28 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:28.651844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9721a-ec35-47b6-b304-db67aa67ed3d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:28.652416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9721a-ec35-47b6-b304-db67aa67ed3d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:28.652416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9721a-ec35-47b6-b304-db67aa67ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:28.672068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-80a9721a-ec35-47b6-b304-db67aa67ed3d None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:28.673354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-80a9721a-ec35-47b6-b304-db67aa67ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:28.680686 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2527/5083] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:28.685136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291554ed-57e5-438a-8b95-cea5a2f4ea68 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:28.696620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291554ed-57e5-438a-8b95-cea5a2f4ea68 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:28.700894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da559-071d-43b5-ab6a-31b485476c73 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:28.701764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da559-071d-43b5-ab6a-31b485476c73 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:28.702248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da559-071d-43b5-ab6a-31b485476c73 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:28.702529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da559-071d-43b5-ab6a-31b485476c73 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:28.755503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5b4da559-071d-43b5-ab6a-31b485476c73 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:28.765135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2557/5084] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:28 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:29.771006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b340d2-d169-41ab-a569-ff033b79f755 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:29.771601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b340d2-d169-41ab-a569-ff033b79f755 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:29.771707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b340d2-d169-41ab-a569-ff033b79f755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:29.792628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-63b340d2-d169-41ab-a569-ff033b79f755 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:29.794297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-63b340d2-d169-41ab-a569-ff033b79f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:29.801148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2528/5085] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:29 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:29.804276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebb570-82a0-40a5-8d7d-014c9d3d50fd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:29.804879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebb570-82a0-40a5-8d7d-014c9d3d50fd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:29.804879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebb570-82a0-40a5-8d7d-014c9d3d50fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:29.824086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-55ebb570-82a0-40a5-8d7d-014c9d3d50fd None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:29.825348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-55ebb570-82a0-40a5-8d7d-014c9d3d50fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:29.836051 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2558/5086] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:29.841783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b340d2-d169-41ab-a569-ff033b79f755 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:29.857691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b340d2-d169-41ab-a569-ff033b79f755 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:29.863978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cd38d-4098-44a0-927e-d8c7e42369f7 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e5913a04d0464bbfeba056d865c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '241d736f5e6c4c7298b81bf9c8e891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:29.865104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd38d-4098-44a0-927e-d8c7e42369f7 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:29.866056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd38d-4098-44a0-927e-d8c7e42369f7 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:29.866441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd38d-4098-44a0-927e-d8c7e42369f7 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec/password` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:29.918260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db0cd38d-4098-44a0-927e-d8c7e42369f7 tempest-IdentityV3UsersTest-1246679295 tempest-IdentityV3UsersTest-1246679295-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:29.930466 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2529/5087] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:08:29 2022] POST /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec/password => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:30.935502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371112ec-2274-4317-a4b2-ea8d147f1f62 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:30.936056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371112ec-2274-4317-a4b2-ea8d147f1f62 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:30.936056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371112ec-2274-4317-a4b2-ea8d147f1f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:30.957692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-371112ec-2274-4317-a4b2-ea8d147f1f62 None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:30.960553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-371112ec-2274-4317-a4b2-ea8d147f1f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:30.964504 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2559/5088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:30 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:08:31.971056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6908a8-e553-481c-981d-9d8ca2a7a18c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:31.971615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6908a8-e553-481c-981d-9d8ca2a7a18c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:31.971615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6908a8-e553-481c-981d-9d8ca2a7a18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:31.998287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ae6908a8-e553-481c-981d-9d8ca2a7a18c None None] MFA Rules not processed for user `12e5913a04d0464bbfeba056d865c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:31.999552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae6908a8-e553-481c-981d-9d8ca2a7a18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:32.012684 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2530/5089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:32.022137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371112ec-2274-4317-a4b2-ea8d147f1f62 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:32.116113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371112ec-2274-4317-a4b2-ea8d147f1f62 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:32.122239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:32.123172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:32.123461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:32.123812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] PATH_INFO: `/v3/users/12e5913a04d0464bbfeba056d865c0ec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:32.125202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e5913a04d0464bbfeba056d865c0ec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:32.128450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:32.201086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:32.220632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:32.234152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:32.235302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:32.237025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e5913a04d0464bbfeba056d865c0ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:32.259564 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2560/5090] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:32 2022] DELETE /identity/v3/users/12e5913a04d0464bbfeba056d865c0ec => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:32.264243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd9cf-d016-4cc8-82bc-218dd07493e7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:32.264557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd9cf-d016-4cc8-82bc-218dd07493e7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:32.264846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd9cf-d016-4cc8-82bc-218dd07493e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:32.293828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-661fd9cf-d016-4cc8-82bc-218dd07493e7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:32.295320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-661fd9cf-d016-4cc8-82bc-218dd07493e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:32.418836 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2531/5091] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:32.430535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:32.434098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:32.527323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cca04c-1789-4e61-9684-3d529ec1461b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:32.531800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fa7da-3735-466b-847d-626e5c482045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:32.532611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fa7da-3735-466b-847d-626e5c482045 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:32.532900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fa7da-3735-466b-847d-626e5c482045 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:32.533258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fa7da-3735-466b-847d-626e5c482045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:32.551068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fa7da-3735-466b-847d-626e5c482045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:32.552401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fa7da-3735-466b-847d-626e5c482045 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:32.566560 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2561/5092] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:33.028887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd9cf-d016-4cc8-82bc-218dd07493e7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.033206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-661fd9cf-d016-4cc8-82bc-218dd07493e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:33.049313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd9cf-d016-4cc8-82bc-218dd07493e7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:33.054258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:33.055131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.055591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.055859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] PATH_INFO: `/v3/projects/241d736f5e6c4c7298b81bf9c8e891bd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.058484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241d736f5e6c4c7298b81bf9c8e891bd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:33.062041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:33.114497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241d736f5e6c4c7298b81bf9c8e891bd', 'request_id': 'req-591aab91-6453-49e2-9e31-66d0141a4e02'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:33.121438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241d736f5e6c4c7298b81bf9c8e891bd', 'request_id': 'req-591aab91-6453-49e2-9e31-66d0141a4e02'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:33.129420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241d736f5e6c4c7298b81bf9c8e891bd', 'request_id': 'req-591aab91-6453-49e2-9e31-66d0141a4e02'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:33.142073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] The token cache is being invalidate because project 241d736f5e6c4c7298b81bf9c8e891bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:33.142519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:33.143471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-591aab91-6453-49e2-9e31-66d0141a4e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:33.146719 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2532/5093] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:33 2022] DELETE /identity/v3/projects/241d736f5e6c4c7298b81bf9c8e891bd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:33.154168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e2f51-2262-47a2-92d8-917d6397da2b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.154953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e2f51-2262-47a2-92d8-917d6397da2b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.154953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e2f51-2262-47a2-92d8-917d6397da2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.175497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-913e2f51-2262-47a2-92d8-917d6397da2b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:33.176821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-913e2f51-2262-47a2-92d8-917d6397da2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:33.255836 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2562/5094] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:33.264158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1001c-5bb4-4415-a08b-85ee27a1efa9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.264484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1001c-5bb4-4415-a08b-85ee27a1efa9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.264771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1001c-5bb4-4415-a08b-85ee27a1efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.286976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-43a1001c-5bb4-4415-a08b-85ee27a1efa9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:33.289025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-43a1001c-5bb4-4415-a08b-85ee27a1efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:33.298177 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2533/5095] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:33.302386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e2f51-2262-47a2-92d8-917d6397da2b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.312617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e2f51-2262-47a2-92d8-917d6397da2b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:33.321788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:33.322466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.322752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.323031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.323767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:33.324075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:33.325713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:33.338485 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2563/5096] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:33.342923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1001c-5bb4-4415-a08b-85ee27a1efa9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.353166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1001c-5bb4-4415-a08b-85ee27a1efa9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:33.357857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48872-7dd0-44c2-990a-e84482289ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:33.358510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48872-7dd0-44c2-990a-e84482289ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.358787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48872-7dd0-44c2-990a-e84482289ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.359108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48872-7dd0-44c2-990a-e84482289ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.359802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e48872-7dd0-44c2-990a-e84482289ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:33.361744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e48872-7dd0-44c2-990a-e84482289ae9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:33.390466 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2534/5097] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:33 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:33.394635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.405824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ec54b-fe32-425e-82e5-91f6ad02448a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:33.479923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb201794-cab7-4b92-bf52-6d06b79b34ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:33.480738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb201794-cab7-4b92-bf52-6d06b79b34ab admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.481190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb201794-cab7-4b92-bf52-6d06b79b34ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.481466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb201794-cab7-4b92-bf52-6d06b79b34ab admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.482354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb201794-cab7-4b92-bf52-6d06b79b34ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:33.484558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb201794-cab7-4b92-bf52-6d06b79b34ab admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:33.507638 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2564/5098] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:33 2022] POST /identity/v3/users => generated 302 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:33.511743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48872-7dd0-44c2-990a-e84482289ae9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.522899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48872-7dd0-44c2-990a-e84482289ae9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:33.530035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793119d-17d0-4e61-b2f4-3d374aae9e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:33.530814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793119d-17d0-4e61-b2f4-3d374aae9e4b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.531102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793119d-17d0-4e61-b2f4-3d374aae9e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.531464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793119d-17d0-4e61-b2f4-3d374aae9e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.532351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793119d-17d0-4e61-b2f4-3d374aae9e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:33.536663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793119d-17d0-4e61-b2f4-3d374aae9e4b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:33.551031 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2535/5099] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:33.557671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb201794-cab7-4b92-bf52-6d06b79b34ab admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.569238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb201794-cab7-4b92-bf52-6d06b79b34ab admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:33.574295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54271ab-e882-48ec-ad83-fc261c86f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:33.575196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54271ab-e882-48ec-ad83-fc261c86f909 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.575476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54271ab-e882-48ec-ad83-fc261c86f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.575753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54271ab-e882-48ec-ad83-fc261c86f909 admin admin] PATH_INFO: `/v3/projects/4c1fdf4d629b41f8a5df4132d0780e59/users/e13f4f94184241439b8a4bf080ad3ad0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.595165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54271ab-e882-48ec-ad83-fc261c86f909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1fdf4d629b41f8a5df4132d0780e59, user_id=e13f4f94184241439b8a4bf080ad3ad0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:33.598257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54271ab-e882-48ec-ad83-fc261c86f909 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:33.618543 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2565/5100] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:33 2022] PUT /identity/v3/projects/4c1fdf4d629b41f8a5df4132d0780e59/users/e13f4f94184241439b8a4bf080ad3ad0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:33.623014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793119d-17d0-4e61-b2f4-3d374aae9e4b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.638976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793119d-17d0-4e61-b2f4-3d374aae9e4b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:33.702160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1ade8-995b-476a-8b4b-b213156da881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:33.702846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ade8-995b-476a-8b4b-b213156da881 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.703175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ade8-995b-476a-8b4b-b213156da881 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.703460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ade8-995b-476a-8b4b-b213156da881 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.704185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1ade8-995b-476a-8b4b-b213156da881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:33.705907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1ade8-995b-476a-8b4b-b213156da881 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:33.722432 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2536/5101] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:33.723984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54271ab-e882-48ec-ad83-fc261c86f909 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.737477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54271ab-e882-48ec-ad83-fc261c86f909 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:33.742169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d80b-3c95-46b3-829a-393c99ad2a0c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.742491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d80b-3c95-46b3-829a-393c99ad2a0c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.742779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d80b-3c95-46b3-829a-393c99ad2a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.743204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b099d-3aa6-45cf-abf7-fded95bcb70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:33.744180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b099d-3aa6-45cf-abf7-fded95bcb70f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.744556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b099d-3aa6-45cf-abf7-fded95bcb70f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.744896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b099d-3aa6-45cf-abf7-fded95bcb70f admin admin] PATH_INFO: `/v3/projects/4c1fdf4d629b41f8a5df4132d0780e59/users/e13f4f94184241439b8a4bf080ad3ad0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.747119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b099d-3aa6-45cf-abf7-fded95bcb70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1fdf4d629b41f8a5df4132d0780e59, user_id=e13f4f94184241439b8a4bf080ad3ad0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:33.750146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b099d-3aa6-45cf-abf7-fded95bcb70f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:33.761898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6f75d80b-3c95-46b3-829a-393c99ad2a0c None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:33.762276 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2566/5102] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:33 2022] PUT /identity/v3/projects/4c1fdf4d629b41f8a5df4132d0780e59/users/e13f4f94184241439b8a4bf080ad3ad0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:33.763211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6f75d80b-3c95-46b3-829a-393c99ad2a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:33.777950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47126-c20f-4984-b6ca-306283fc8de8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:33.778325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47126-c20f-4984-b6ca-306283fc8de8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:33.778681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47126-c20f-4984-b6ca-306283fc8de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:33.810360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ceb47126-c20f-4984-b6ca-306283fc8de8 None None] MFA Rules not processed for user `e13f4f94184241439b8a4bf080ad3ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:33.811496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ceb47126-c20f-4984-b6ca-306283fc8de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:33.863050 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2537/5103] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:33.908639 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2567/5104] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:33.914361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d80b-3c95-46b3-829a-393c99ad2a0c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.923934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb47126-c20f-4984-b6ca-306283fc8de8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:33.926506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ceb47126-c20f-4984-b6ca-306283fc8de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:33.994945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d80b-3c95-46b3-829a-393c99ad2a0c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:34.001278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106f05b-0834-4b68-95f6-15bfa7303fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:34.002074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f05b-0834-4b68-95f6-15bfa7303fed admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:34.002462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f05b-0834-4b68-95f6-15bfa7303fed admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:34.002921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f05b-0834-4b68-95f6-15bfa7303fed admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:34.004728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106f05b-0834-4b68-95f6-15bfa7303fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:34.006581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106f05b-0834-4b68-95f6-15bfa7303fed admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:34.052719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb47126-c20f-4984-b6ca-306283fc8de8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:34.060099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e62d7f-be4e-4e27-8a15-ef91e2c633c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:34.060563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e62d7f-be4e-4e27-8a15-ef91e2c633c1 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:34.060733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e62d7f-be4e-4e27-8a15-ef91e2c633c1 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:34.061062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e62d7f-be4e-4e27-8a15-ef91e2c633c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:34.061616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2538/5105] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:33 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:34.062807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106f05b-0834-4b68-95f6-15bfa7303fed admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:34.079608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e62d7f-be4e-4e27-8a15-ef91e2c633c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:34.079608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e62d7f-be4e-4e27-8a15-ef91e2c633c1 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:34.098272 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2568/5106] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:08:34.232486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106f05b-0834-4b68-95f6-15bfa7303fed admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:34.241396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088c48d-b82c-4d83-9a76-9be0ac4c8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:34.242742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088c48d-b82c-4d83-9a76-9be0ac4c8d8b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:34.243273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088c48d-b82c-4d83-9a76-9be0ac4c8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:34.244522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088c48d-b82c-4d83-9a76-9be0ac4c8d8b admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:34.245722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088c48d-b82c-4d83-9a76-9be0ac4c8d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:34.250957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088c48d-b82c-4d83-9a76-9be0ac4c8d8b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:34.294545 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2539/5107] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:34 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:34.299899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e62d7f-be4e-4e27-8a15-ef91e2c633c1 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:34.312660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e62d7f-be4e-4e27-8a15-ef91e2c633c1 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:34.319767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42a3ca-84ad-4d33-8550-88c5f568700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:34.323632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a3ca-84ad-4d33-8550-88c5f568700e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:34.324255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a3ca-84ad-4d33-8550-88c5f568700e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:34.324795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a3ca-84ad-4d33-8550-88c5f568700e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:34.325796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42a3ca-84ad-4d33-8550-88c5f568700e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:34.327864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42a3ca-84ad-4d33-8550-88c5f568700e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:34.340061 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2569/5108] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:34.349335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088c48d-b82c-4d83-9a76-9be0ac4c8d8b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:34.363047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088c48d-b82c-4d83-9a76-9be0ac4c8d8b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:34.393478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8d06e-3275-4e28-b82e-7bbe5828cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:34.393862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8d06e-3275-4e28-b82e-7bbe5828cc2a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:34.398139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8d06e-3275-4e28-b82e-7bbe5828cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:34.398681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8d06e-3275-4e28-b82e-7bbe5828cc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:34.400952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8d06e-3275-4e28-b82e-7bbe5828cc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:34.403890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8d06e-3275-4e28-b82e-7bbe5828cc2a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:34.430850 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2540/5109] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:34.435618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42a3ca-84ad-4d33-8550-88c5f568700e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:34.447553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42a3ca-84ad-4d33-8550-88c5f568700e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:34.471895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:34.472876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:34.473562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:34.473562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] PATH_INFO: `/v3/projects/25f522235bce4c8890427dd6a9b70afd/users/87437576118c47c18e23fb334bd2a78d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:34.496028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f522235bce4c8890427dd6a9b70afd, user_id=87437576118c47c18e23fb334bd2a78d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:34.501115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:34.534797 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2570/5110] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:34 2022] PUT /identity/v3/projects/25f522235bce4c8890427dd6a9b70afd/users/87437576118c47c18e23fb334bd2a78d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:34.536203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42d0c-273d-4050-a0e1-24531467871b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:34.536530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42d0c-273d-4050-a0e1-24531467871b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:34.537408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42d0c-273d-4050-a0e1-24531467871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:34.572393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d3c42d0c-273d-4050-a0e1-24531467871b None None] MFA Rules not processed for user `87437576118c47c18e23fb334bd2a78d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:34.574275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d3c42d0c-273d-4050-a0e1-24531467871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:34.648400 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2541/5111] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:34.660426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:34.665826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:34.779033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a79c3f-0718-4931-87a3-d3d4ef60510a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:34.783658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d7f87-c9f0-4937-996c-02f1a707fd97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:34.784890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7f87-c9f0-4937-996c-02f1a707fd97 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:34.785224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7f87-c9f0-4937-996c-02f1a707fd97 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:34.785568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7f87-c9f0-4937-996c-02f1a707fd97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:34.890880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d7f87-c9f0-4937-996c-02f1a707fd97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:34.893733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d7f87-c9f0-4937-996c-02f1a707fd97 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:34.907720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2571/5112] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:35.984891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c42d0c-273d-4050-a0e1-24531467871b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:36.186103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c42d0c-273d-4050-a0e1-24531467871b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:36.204155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:36.205900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:36.212318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:36.214980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] PATH_INFO: `/v3/users/e13f4f94184241439b8a4bf080ad3ad0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:36.216815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13f4f94184241439b8a4bf080ad3ad0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:36.222479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:36.310216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13f4f94184241439b8a4bf080ad3ad0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:36.312278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13f4f94184241439b8a4bf080ad3ad0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:36.313757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13f4f94184241439b8a4bf080ad3ad0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:36.348301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13f4f94184241439b8a4bf080ad3ad0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:36.365624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13f4f94184241439b8a4bf080ad3ad0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:36.385004 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2542/5113] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:35 2022] DELETE /identity/v3/users/e13f4f94184241439b8a4bf080ad3ad0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:36.390051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276953-d41e-4230-aece-0a83dc997729 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:36.390624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276953-d41e-4230-aece-0a83dc997729 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:36.390949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276953-d41e-4230-aece-0a83dc997729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:36.422574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c4276953-d41e-4230-aece-0a83dc997729 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:36.424540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c4276953-d41e-4230-aece-0a83dc997729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:36.550145 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2572/5114] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:36.561002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:36.562723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:36.666515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9785c3-f99e-4a68-8af3-e4443bea88f0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:36.672192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dad2c-acfa-47f4-8be5-386a4d22cff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:36.673535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dad2c-acfa-47f4-8be5-386a4d22cff8 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:36.673973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dad2c-acfa-47f4-8be5-386a4d22cff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:36.674342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dad2c-acfa-47f4-8be5-386a4d22cff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:36.686953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dad2c-acfa-47f4-8be5-386a4d22cff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:36.688637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dad2c-acfa-47f4-8be5-386a4d22cff8 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:36.708678 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2543/5115] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:37.468071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276953-d41e-4230-aece-0a83dc997729 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:37.470119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c4276953-d41e-4230-aece-0a83dc997729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:37.511488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276953-d41e-4230-aece-0a83dc997729 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:37.534963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:37.540198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:37.546780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:37.547340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] PATH_INFO: `/v3/projects/4c1fdf4d629b41f8a5df4132d0780e59` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:37.556617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1fdf4d629b41f8a5df4132d0780e59)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:37.560004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:37.688975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1fdf4d629b41f8a5df4132d0780e59', 'request_id': 'req-fc7f4983-c7de-48ad-9c37-3d083d00e660'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:37.710494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1fdf4d629b41f8a5df4132d0780e59', 'request_id': 'req-fc7f4983-c7de-48ad-9c37-3d083d00e660'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:37.727603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1fdf4d629b41f8a5df4132d0780e59', 'request_id': 'req-fc7f4983-c7de-48ad-9c37-3d083d00e660'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:37.781873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] The token cache is being invalidate because project 4c1fdf4d629b41f8a5df4132d0780e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:37.782389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:37.783472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:37.787808 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2573/5116] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:37 2022] DELETE /identity/v3/projects/4c1fdf4d629b41f8a5df4132d0780e59 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:37.791751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dad2c-acfa-47f4-8be5-386a4d22cff8 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:37.805386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dad2c-acfa-47f4-8be5-386a4d22cff8 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:37.934793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:37.936014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:37.936563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:37.937358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] PATH_INFO: `/v3/users/87437576118c47c18e23fb334bd2a78d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:37.938951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87437576118c47c18e23fb334bd2a78d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:37.941401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:38.022414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87437576118c47c18e23fb334bd2a78d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:38.024780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87437576118c47c18e23fb334bd2a78d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:38.026152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87437576118c47c18e23fb334bd2a78d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:38.056975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87437576118c47c18e23fb334bd2a78d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:38.073175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a193739-c9cc-48c6-9a00-711cd55975a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87437576118c47c18e23fb334bd2a78d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:38.094519 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2544/5117] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:37 2022] DELETE /identity/v3/users/87437576118c47c18e23fb334bd2a78d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:38.723651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:38.726201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:38.758454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f4983-c7de-48ad-9c37-3d083d00e660 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:38.856000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:38.858380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:38.858849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:38.859302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] PATH_INFO: `/v3/projects/25f522235bce4c8890427dd6a9b70afd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:38.861111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f522235bce4c8890427dd6a9b70afd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:38.864781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:38.933207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f522235bce4c8890427dd6a9b70afd', 'request_id': 'req-db378f35-6132-4eaf-8a99-5a4fe01a99d9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:38.955117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f522235bce4c8890427dd6a9b70afd', 'request_id': 'req-db378f35-6132-4eaf-8a99-5a4fe01a99d9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:38.980799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f522235bce4c8890427dd6a9b70afd', 'request_id': 'req-db378f35-6132-4eaf-8a99-5a4fe01a99d9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:39.040410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] The token cache is being invalidate because project 25f522235bce4c8890427dd6a9b70afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:39.043313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:39.046021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db378f35-6132-4eaf-8a99-5a4fe01a99d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:39.054452 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2574/5118] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:38 2022] DELETE /identity/v3/projects/25f522235bce4c8890427dd6a9b70afd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:39.056078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6177c-f647-4644-825b-b74cba49c5ed None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:39.056847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6177c-f647-4644-825b-b74cba49c5ed None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:39.056847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6177c-f647-4644-825b-b74cba49c5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:39.124804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f7a6177c-f647-4644-825b-b74cba49c5ed None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:39.126846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f7a6177c-f647-4644-825b-b74cba49c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:39.290345 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2545/5119] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:39.298964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53956f5-2191-4ebb-8f89-6de33be2eb37 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:39.299628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53956f5-2191-4ebb-8f89-6de33be2eb37 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:39.300011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53956f5-2191-4ebb-8f89-6de33be2eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:39.355104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c53956f5-2191-4ebb-8f89-6de33be2eb37 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:39.359725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c53956f5-2191-4ebb-8f89-6de33be2eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:39.392777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6177c-f647-4644-825b-b74cba49c5ed None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:39.404387 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2575/5120] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:39.410477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6177c-f647-4644-825b-b74cba49c5ed None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:39.431483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:39.434484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:39.440102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:39.440684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:39.441834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:39.442258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:39.444488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:39.504141 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2546/5121] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:39.510466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53956f5-2191-4ebb-8f89-6de33be2eb37 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:39.524429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53956f5-2191-4ebb-8f89-6de33be2eb37 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:39.544963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a891-3f42-40c8-aaf1-d224f3752fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:39.567006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a891-3f42-40c8-aaf1-d224f3752fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:39.569001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a891-3f42-40c8-aaf1-d224f3752fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:39.574223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a891-3f42-40c8-aaf1-d224f3752fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:39.575608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966a891-3f42-40c8-aaf1-d224f3752fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:39.577771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966a891-3f42-40c8-aaf1-d224f3752fa5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:39.643594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:39.647184 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2576/5122] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:39 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:39.665049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702df12-18ba-482c-a735-c0ed7720b405 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:39.858887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f8bb-f826-4040-b89c-4b82b0b88036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:39.859877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f8bb-f826-4040-b89c-4b82b0b88036 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:39.860592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f8bb-f826-4040-b89c-4b82b0b88036 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:39.861117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f8bb-f826-4040-b89c-4b82b0b88036 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:39.862116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273f8bb-f826-4040-b89c-4b82b0b88036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:39.864252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273f8bb-f826-4040-b89c-4b82b0b88036 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:39.897133 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2547/5123] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:39 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:39.906623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a891-3f42-40c8-aaf1-d224f3752fa5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:39.922195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a891-3f42-40c8-aaf1-d224f3752fa5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:39.928704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da993ea-2694-45cb-a849-0fcea0f2a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:39.929715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da993ea-2694-45cb-a849-0fcea0f2a290 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:39.930175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da993ea-2694-45cb-a849-0fcea0f2a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:39.930622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da993ea-2694-45cb-a849-0fcea0f2a290 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:39.932284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da993ea-2694-45cb-a849-0fcea0f2a290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:39.941304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da993ea-2694-45cb-a849-0fcea0f2a290 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:39.969599 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2577/5124] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:39.971086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f8bb-f826-4040-b89c-4b82b0b88036 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:39.999540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f8bb-f826-4040-b89c-4b82b0b88036 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:40.008506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc5296-faf7-4a0b-8af2-854b8f79c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:40.009434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5296-faf7-4a0b-8af2-854b8f79c9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:40.009716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5296-faf7-4a0b-8af2-854b8f79c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:40.009994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc5296-faf7-4a0b-8af2-854b8f79c9c6 admin admin] PATH_INFO: `/v3/projects/f74cca290ae4474883092b4b11af8678/users/206808baa5174d928b68758ac7f163e9/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:40.040319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc5296-faf7-4a0b-8af2-854b8f79c9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74cca290ae4474883092b4b11af8678, user_id=206808baa5174d928b68758ac7f163e9, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:40.043240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc5296-faf7-4a0b-8af2-854b8f79c9c6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:40.062302 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2548/5125] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:39 2022] PUT /identity/v3/projects/f74cca290ae4474883092b4b11af8678/users/206808baa5174d928b68758ac7f163e9/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:40.067018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da993ea-2694-45cb-a849-0fcea0f2a290 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:40.091311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da993ea-2694-45cb-a849-0fcea0f2a290 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:40.202437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839b6e1-4a53-4809-889f-61ce0c8bd1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:40.203615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839b6e1-4a53-4809-889f-61ce0c8bd1eb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:40.204116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839b6e1-4a53-4809-889f-61ce0c8bd1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:40.204653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839b6e1-4a53-4809-889f-61ce0c8bd1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:40.205601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839b6e1-4a53-4809-889f-61ce0c8bd1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:40.207663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839b6e1-4a53-4809-889f-61ce0c8bd1eb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:40.226546 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2578/5126] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:40.236414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc5296-faf7-4a0b-8af2-854b8f79c9c6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:40.250580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc5296-faf7-4a0b-8af2-854b8f79c9c6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:40.270705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9abb2f-d67f-4800-9c4b-6c65a533598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:40.271681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abb2f-d67f-4800-9c4b-6c65a533598c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:40.272111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abb2f-d67f-4800-9c4b-6c65a533598c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:40.272428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abb2f-d67f-4800-9c4b-6c65a533598c admin admin] PATH_INFO: `/v3/projects/f74cca290ae4474883092b4b11af8678/users/206808baa5174d928b68758ac7f163e9/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:40.275859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9abb2f-d67f-4800-9c4b-6c65a533598c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74cca290ae4474883092b4b11af8678, user_id=206808baa5174d928b68758ac7f163e9, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:40.280419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9abb2f-d67f-4800-9c4b-6c65a533598c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:40.299032 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2549/5127] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:40 2022] PUT /identity/v3/projects/f74cca290ae4474883092b4b11af8678/users/206808baa5174d928b68758ac7f163e9/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:40.313564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79fed-f40e-4437-a606-33dd6be235f0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:40.313564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79fed-f40e-4437-a606-33dd6be235f0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:40.313958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79fed-f40e-4437-a606-33dd6be235f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:40.392175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-66e79fed-f40e-4437-a606-33dd6be235f0 None None] MFA Rules not processed for user `206808baa5174d928b68758ac7f163e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:40.394640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-66e79fed-f40e-4437-a606-33dd6be235f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:40.546910 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2579/5128] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:40.547156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9abb2f-d67f-4800-9c4b-6c65a533598c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:40.702986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9abb2f-d67f-4800-9c4b-6c65a533598c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:40.719065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187f129-1d6a-4787-8a24-0b9833444672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:40.719065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187f129-1d6a-4787-8a24-0b9833444672 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:40.719065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187f129-1d6a-4787-8a24-0b9833444672 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:40.719065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187f129-1d6a-4787-8a24-0b9833444672 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:40.719848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187f129-1d6a-4787-8a24-0b9833444672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:40.719848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187f129-1d6a-4787-8a24-0b9833444672 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:40.766268 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2550/5129] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:40 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:40.770369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79fed-f40e-4437-a606-33dd6be235f0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:40.784959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79fed-f40e-4437-a606-33dd6be235f0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:40.883357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900cdc-2845-4998-b005-b8b3ae8403ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:40.884459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900cdc-2845-4998-b005-b8b3ae8403ad admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:40.884812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900cdc-2845-4998-b005-b8b3ae8403ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:40.885168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900cdc-2845-4998-b005-b8b3ae8403ad admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:40.885997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd900cdc-2845-4998-b005-b8b3ae8403ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:40.888023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd900cdc-2845-4998-b005-b8b3ae8403ad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:40.922060 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2580/5130] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:40 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:40.923992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187f129-1d6a-4787-8a24-0b9833444672 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:40.943073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187f129-1d6a-4787-8a24-0b9833444672 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:40.956092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2b57-92b7-4101-8b84-0f19ab024c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:40.959691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2b57-92b7-4101-8b84-0f19ab024c77 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:40.960067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2b57-92b7-4101-8b84-0f19ab024c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:40.960439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2b57-92b7-4101-8b84-0f19ab024c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:40.961272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2b57-92b7-4101-8b84-0f19ab024c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:40.966327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2b57-92b7-4101-8b84-0f19ab024c77 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:40.987083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900cdc-2845-4998-b005-b8b3ae8403ad admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:40.987805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2551/5131] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:41.004758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900cdc-2845-4998-b005-b8b3ae8403ad admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:41.011402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf84b5-ac50-4352-9d46-2e78e5b2b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:41.012480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf84b5-ac50-4352-9d46-2e78e5b2b9ce admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:41.013003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf84b5-ac50-4352-9d46-2e78e5b2b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:41.013496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf84b5-ac50-4352-9d46-2e78e5b2b9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:41.014463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf84b5-ac50-4352-9d46-2e78e5b2b9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:41.026945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf84b5-ac50-4352-9d46-2e78e5b2b9ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:41.038789 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2581/5132] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:41.042667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2b57-92b7-4101-8b84-0f19ab024c77 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:41.055085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2b57-92b7-4101-8b84-0f19ab024c77 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:41.068707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:41.071154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:41.071667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:41.072162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] PATH_INFO: `/v3/projects/97aa75ad1012429daa69d403684b589b/users/ff0fa70b9264456689aa38f9f2f80537/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:41.096612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97aa75ad1012429daa69d403684b589b, user_id=ff0fa70b9264456689aa38f9f2f80537, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:41.099318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:41.132301 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2552/5133] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:41 2022] PUT /identity/v3/projects/97aa75ad1012429daa69d403684b589b/users/ff0fa70b9264456689aa38f9f2f80537/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:41.142363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321083-6ea9-486a-8222-94bd155c9bc9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:41.142980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321083-6ea9-486a-8222-94bd155c9bc9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:41.143292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321083-6ea9-486a-8222-94bd155c9bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:41.184691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-20321083-6ea9-486a-8222-94bd155c9bc9 None None] MFA Rules not processed for user `ff0fa70b9264456689aa38f9f2f80537`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:41.185940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-20321083-6ea9-486a-8222-94bd155c9bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:41.293002 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2582/5134] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:41.306936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:41.308996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:41.396949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c36e7-b457-495b-83d0-a8c2e8b55627 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:41.401565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d79f9-b423-4188-b675-357e358d0603 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:41.401915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d79f9-b423-4188-b675-357e358d0603 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:41.402198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d79f9-b423-4188-b675-357e358d0603 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:41.402474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d79f9-b423-4188-b675-357e358d0603 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:41.490500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d79f9-b423-4188-b675-357e358d0603 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:41.492274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d79f9-b423-4188-b675-357e358d0603 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:41.505188 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2553/5135] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:42.328592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20321083-6ea9-486a-8222-94bd155c9bc9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:42.421495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20321083-6ea9-486a-8222-94bd155c9bc9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:42.433723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:42.434624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:42.434912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:42.435187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] PATH_INFO: `/v3/users/206808baa5174d928b68758ac7f163e9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:42.437333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=206808baa5174d928b68758ac7f163e9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:42.438973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:42.562938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206808baa5174d928b68758ac7f163e9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:42.588160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206808baa5174d928b68758ac7f163e9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:42.602906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206808baa5174d928b68758ac7f163e9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:42.603784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206808baa5174d928b68758ac7f163e9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:42.604770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206808baa5174d928b68758ac7f163e9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:42.635209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2583/5136] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:42 2022] DELETE /identity/v3/users/206808baa5174d928b68758ac7f163e9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:42.637752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d9186-53ca-41db-8a2c-06851a206242 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:42.638259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d9186-53ca-41db-8a2c-06851a206242 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:42.638364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d9186-53ca-41db-8a2c-06851a206242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:42.668642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0b6d9186-53ca-41db-8a2c-06851a206242 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:42.670913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0b6d9186-53ca-41db-8a2c-06851a206242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:42.793513 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2554/5137] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:42.804103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:42.805622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:42.904598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173efe0-0131-4bf9-bf5e-b56793298a2e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:42.910903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea409-7a91-446d-8ee5-1c5df16751e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:42.912636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea409-7a91-446d-8ee5-1c5df16751e2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:42.913214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea409-7a91-446d-8ee5-1c5df16751e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:42.913730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea409-7a91-446d-8ee5-1c5df16751e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:42.928488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eea409-7a91-446d-8ee5-1c5df16751e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:42.930563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eea409-7a91-446d-8ee5-1c5df16751e2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:42.943952 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2584/5138] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:43.332611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d9186-53ca-41db-8a2c-06851a206242 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:43.334769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0b6d9186-53ca-41db-8a2c-06851a206242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:43.356234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d9186-53ca-41db-8a2c-06851a206242 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:43.368697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:43.369844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:43.370068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:43.371029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] PATH_INFO: `/v3/projects/f74cca290ae4474883092b4b11af8678` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:43.374338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74cca290ae4474883092b4b11af8678)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:43.376568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:43.492647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74cca290ae4474883092b4b11af8678', 'request_id': 'req-98987931-59b3-45fb-9833-67fd65a1b800'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.510309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74cca290ae4474883092b4b11af8678', 'request_id': 'req-98987931-59b3-45fb-9833-67fd65a1b800'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.526959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74cca290ae4474883092b4b11af8678', 'request_id': 'req-98987931-59b3-45fb-9833-67fd65a1b800'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.550563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] The token cache is being invalidate because project f74cca290ae4474883092b4b11af8678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:43.551947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.554721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.559352 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2555/5139] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:43 2022] DELETE /identity/v3/projects/f74cca290ae4474883092b4b11af8678 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:43.563258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea409-7a91-446d-8ee5-1c5df16751e2 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:43.578427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea409-7a91-446d-8ee5-1c5df16751e2 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:43.742306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:43.743436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:43.743816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:43.744200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] PATH_INFO: `/v3/users/ff0fa70b9264456689aa38f9f2f80537` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:43.746665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0fa70b9264456689aa38f9f2f80537)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:43.749777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:43.814118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:43.815676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:43.837959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987931-59b3-45fb-9833-67fd65a1b800 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:43.846995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:43.848753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:43.849888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:43.850458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] PATH_INFO: `/v3/users/1466ade1177f483292054d2244caee36` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:43.852736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1466ade1177f483292054d2244caee36)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:43.855983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0fa70b9264456689aa38f9f2f80537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.856785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:43.875274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0fa70b9264456689aa38f9f2f80537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.891286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0fa70b9264456689aa38f9f2f80537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.892704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0fa70b9264456689aa38f9f2f80537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.893741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08cee09a-e779-4f64-9589-8ab11066eebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0fa70b9264456689aa38f9f2f80537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.929773 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2585/5140] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:43 2022] DELETE /identity/v3/users/ff0fa70b9264456689aa38f9f2f80537 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:43.933636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1466ade1177f483292054d2244caee36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.934628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1466ade1177f483292054d2244caee36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.935477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1466ade1177f483292054d2244caee36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.951461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1466ade1177f483292054d2244caee36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.963385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1466ade1177f483292054d2244caee36'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:43.983960 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2556/5141] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:43 2022] DELETE /identity/v3/users/1466ade1177f483292054d2244caee36 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:43.989034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f9e8-e97d-4f8d-9b0c-1ee7bb844151 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:43.989232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f9e8-e97d-4f8d-9b0c-1ee7bb844151 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:43.989360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f9e8-e97d-4f8d-9b0c-1ee7bb844151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:44.038333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9d79f9e8-e97d-4f8d-9b0c-1ee7bb844151 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:44.041198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9d79f9e8-e97d-4f8d-9b0c-1ee7bb844151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:44.173928 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2586/5142] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:44.184159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:44.186405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:44.304805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4a21b-b9d5-4583-a580-0ddb5f9b3c72 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:44.309084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3dcd0-7f30-4e9a-bfa0-a9ca0df3c4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:44.309862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3dcd0-7f30-4e9a-bfa0-a9ca0df3c4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:44.310060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3dcd0-7f30-4e9a-bfa0-a9ca0df3c4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:44.310310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3dcd0-7f30-4e9a-bfa0-a9ca0df3c4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:44.326279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3dcd0-7f30-4e9a-bfa0-a9ca0df3c4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:44.329894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3dcd0-7f30-4e9a-bfa0-a9ca0df3c4a0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:44.353719 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2557/5143] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:44.457450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79f9e8-e97d-4f8d-9b0c-1ee7bb844151 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:44.460705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9d79f9e8-e97d-4f8d-9b0c-1ee7bb844151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:44.477819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79f9e8-e97d-4f8d-9b0c-1ee7bb844151 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:44.503780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:44.505320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:44.524139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:44.524544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] PATH_INFO: `/v3/projects/97aa75ad1012429daa69d403684b589b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:44.528780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97aa75ad1012429daa69d403684b589b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:44.530739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:44.612140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97aa75ad1012429daa69d403684b589b', 'request_id': 'req-b08548a4-f647-4bc8-b532-6bd69d546e67'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:44.620456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97aa75ad1012429daa69d403684b589b', 'request_id': 'req-b08548a4-f647-4bc8-b532-6bd69d546e67'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:44.640523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97aa75ad1012429daa69d403684b589b', 'request_id': 'req-b08548a4-f647-4bc8-b532-6bd69d546e67'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:44.663151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] The token cache is being invalidate because project 97aa75ad1012429daa69d403684b589b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:44.663479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:44.666562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b08548a4-f647-4bc8-b532-6bd69d546e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:44.673882 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2587/5144] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:44 2022] DELETE /identity/v3/projects/97aa75ad1012429daa69d403684b589b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:44.681270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bad01e-ef22-4129-a2a8-abcb4f8548a6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:44.681549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bad01e-ef22-4129-a2a8-abcb4f8548a6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:44.681830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bad01e-ef22-4129-a2a8-abcb4f8548a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:44.708276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-29bad01e-ef22-4129-a2a8-abcb4f8548a6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:44.710411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-29bad01e-ef22-4129-a2a8-abcb4f8548a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:44.827249 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2558/5145] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:44.835772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc366d-6508-4453-adb0-1eb6fadda66d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:44.836070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc366d-6508-4453-adb0-1eb6fadda66d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:44.836377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc366d-6508-4453-adb0-1eb6fadda66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:44.847783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bad01e-ef22-4129-a2a8-abcb4f8548a6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:44.857751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-29bad01e-ef22-4129-a2a8-abcb4f8548a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:44.887003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bad01e-ef22-4129-a2a8-abcb4f8548a6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:44.887239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ddfc366d-6508-4453-adb0-1eb6fadda66d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:44.890937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ddfc366d-6508-4453-adb0-1eb6fadda66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:44.892373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:44.893513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:44.894012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:44.894553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] PATH_INFO: `/v3/projects/d10c7c8b9fba438abf201d80c58a8655` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:44.896101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10c7c8b9fba438abf201d80c58a8655)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:44.899042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:44.916580 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2588/5146] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:44.917755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc366d-6508-4453-adb0-1eb6fadda66d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:44.939983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc366d-6508-4453-adb0-1eb6fadda66d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:44.948122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:44.951318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:44.951816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:44.952693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:44.954288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:44.955092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:44.964152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:44.987856 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2589/5147] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:44.993630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:44.995978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10c7c8b9fba438abf201d80c58a8655', 'request_id': 'req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.017637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10c7c8b9fba438abf201d80c58a8655', 'request_id': 'req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.027398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104aeb-f963-4a4f-8c27-994cc9a3cdc7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:45.031330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10c7c8b9fba438abf201d80c58a8655', 'request_id': 'req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.054969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] The token cache is being invalidate because project d10c7c8b9fba438abf201d80c58a8655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:45.059612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.060825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.062798 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2559/5148] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:44 2022] DELETE /identity/v3/projects/d10c7c8b9fba438abf201d80c58a8655 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:45.073423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:45.074849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:45.167707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:45.168452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:45.168831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:45.169370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:45.170140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:45.172054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:45.225995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df9dba-0d6e-4b9c-8f6b-81626c7b10fb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:45.241075 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2590/5149] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:44 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:45.245758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:45.256934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:45.257401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:45.258726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:45.259072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:45.259457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] PATH_INFO: `/v3/users/3a8dba80c8794eb4adc933b43996db2a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:45.262455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8dba80c8794eb4adc933b43996db2a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:45.264656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:45.352210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b883302-3656-40cc-9e7a-07fb81c5ed5c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:45.361461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:45.362357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:45.362642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:45.362919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:45.363866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:45.369061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:45.405404 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2591/5150] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:45 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:45.406356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8dba80c8794eb4adc933b43996db2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.406603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:45.407342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8dba80c8794eb4adc933b43996db2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.408283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8dba80c8794eb4adc933b43996db2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.409047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:45.423947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef076b-3586-45e7-a1f8-20ba6e4c8d8e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:45.429381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8f1b-cbc2-46f8-bd43-967ac976785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:45.430140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8f1b-cbc2-46f8-bd43-967ac976785b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:45.430637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8f1b-cbc2-46f8-bd43-967ac976785b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:45.430997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8f1b-cbc2-46f8-bd43-967ac976785b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:45.431808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d8f1b-cbc2-46f8-bd43-967ac976785b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:45.433593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d8f1b-cbc2-46f8-bd43-967ac976785b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:45.438333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8dba80c8794eb4adc933b43996db2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.449509 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2592/5151] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:45.454138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8f1b-cbc2-46f8-bd43-967ac976785b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:45.467789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8f1b-cbc2-46f8-bd43-967ac976785b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:45.468550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa1af7ad-5121-4354-afc5-3ec11ad6793f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8dba80c8794eb4adc933b43996db2a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:45.480435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acbb93-2e87-4a02-9e68-ae8c8915534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:45.481824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbb93-2e87-4a02-9e68-ae8c8915534b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:45.482272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbb93-2e87-4a02-9e68-ae8c8915534b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:45.482737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbb93-2e87-4a02-9e68-ae8c8915534b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:45.483976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acbb93-2e87-4a02-9e68-ae8c8915534b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:45.485813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acbb93-2e87-4a02-9e68-ae8c8915534b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:45.502306 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2593/5152] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:45.503562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acbb93-2e87-4a02-9e68-ae8c8915534b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:45.511457 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2560/5153] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:45 2022] DELETE /identity/v3/users/3a8dba80c8794eb4adc933b43996db2a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:45.529511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acbb93-2e87-4a02-9e68-ae8c8915534b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:45.684877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:45.686647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:45.687129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:45.687598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] PATH_INFO: `/v3/projects/4056c7ee7a2743399a382b2175014fb0/users/58164ad4e614490788e35ee489dc165a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:45.715232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4056c7ee7a2743399a382b2175014fb0, user_id=58164ad4e614490788e35ee489dc165a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:45.719036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:45.746337 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2594/5154] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:45 2022] PUT /identity/v3/projects/4056c7ee7a2743399a382b2175014fb0/users/58164ad4e614490788e35ee489dc165a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:45.759115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee619-f9d9-4d4b-9467-2a7f951fc7bd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:45.759404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee619-f9d9-4d4b-9467-2a7f951fc7bd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:45.759699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee619-f9d9-4d4b-9467-2a7f951fc7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:45.819145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f75ee619-f9d9-4d4b-9467-2a7f951fc7bd None None] MFA Rules not processed for user `58164ad4e614490788e35ee489dc165a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:45.821258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f75ee619-f9d9-4d4b-9467-2a7f951fc7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:45.911583 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2561/5155] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:45.927321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:45.929831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:46.032055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3bcf3-373b-414e-a035-d0bf3629dc0c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:46.039799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f0be-b8ea-453b-9568-8ebe07d9ffc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:46.040584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f0be-b8ea-453b-9568-8ebe07d9ffc1 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.041050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f0be-b8ea-453b-9568-8ebe07d9ffc1 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.041543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f0be-b8ea-453b-9568-8ebe07d9ffc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.056291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f0be-b8ea-453b-9568-8ebe07d9ffc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:46.058860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f0be-b8ea-453b-9568-8ebe07d9ffc1 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:46.081548 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2595/5156] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:46.118627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee619-f9d9-4d4b-9467-2a7f951fc7bd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:46.120245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f75ee619-f9d9-4d4b-9467-2a7f951fc7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:46.276288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee619-f9d9-4d4b-9467-2a7f951fc7bd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:46.283385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:46.284693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.285348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.285869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] PATH_INFO: `/v3/projects/ff5cda41ea574843afe68dc01c26536b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.289060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5cda41ea574843afe68dc01c26536b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:46.291401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:46.366918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f0be-b8ea-453b-9568-8ebe07d9ffc1 service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:46.384318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f0be-b8ea-453b-9568-8ebe07d9ffc1 service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:46.402774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5cda41ea574843afe68dc01c26536b', 'request_id': 'req-50c6a58a-3d64-4787-a447-69213bf3b86e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.426117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5cda41ea574843afe68dc01c26536b', 'request_id': 'req-50c6a58a-3d64-4787-a447-69213bf3b86e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.449584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5cda41ea574843afe68dc01c26536b', 'request_id': 'req-50c6a58a-3d64-4787-a447-69213bf3b86e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.467233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:46.469271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.469997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.470484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] PATH_INFO: `/v3/users/58164ad4e614490788e35ee489dc165a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.471734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] The token cache is being invalidate because project ff5cda41ea574843afe68dc01c26536b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:46.472259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58164ad4e614490788e35ee489dc165a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:46.472687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.475972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-50c6a58a-3d64-4787-a447-69213bf3b86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.480893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:46.492294 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2562/5157] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:46 2022] DELETE /identity/v3/projects/ff5cda41ea574843afe68dc01c26536b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:46.493975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161c52-5d52-430d-ae0c-a726d56f4a99 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.494345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161c52-5d52-430d-ae0c-a726d56f4a99 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.496375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161c52-5d52-430d-ae0c-a726d56f4a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.541176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e2161c52-5d52-430d-ae0c-a726d56f4a99 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:46.542487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e2161c52-5d52-430d-ae0c-a726d56f4a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:46.575963 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2563/5158] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:46.577955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec545c58-7b6b-4154-9e6a-df02c1a4f504 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.578240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec545c58-7b6b-4154-9e6a-df02c1a4f504 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.578541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec545c58-7b6b-4154-9e6a-df02c1a4f504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.616768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ec545c58-7b6b-4154-9e6a-df02c1a4f504 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:46.618297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ec545c58-7b6b-4154-9e6a-df02c1a4f504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:46.640384 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2564/5159] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:46.643320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec545c58-7b6b-4154-9e6a-df02c1a4f504 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:46.650908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58164ad4e614490788e35ee489dc165a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.664958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec545c58-7b6b-4154-9e6a-df02c1a4f504 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:46.679486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:46.680354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.680790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.681208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.682103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:46.682557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:46.684363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:46.706636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58164ad4e614490788e35ee489dc165a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.713840 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2565/5160] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:08:46.718420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:46.735983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58164ad4e614490788e35ee489dc165a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.736658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58164ad4e614490788e35ee489dc165a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.737296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95caecf3-10cf-4045-a6ae-711088cb32b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58164ad4e614490788e35ee489dc165a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:46.740663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c3466-3417-414e-a279-df7f451819b4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:46.754045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:46.755249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.756270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.756804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.757738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:46.762729 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2596/5161] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:46 2022] DELETE /identity/v3/users/58164ad4e614490788e35ee489dc165a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:46.763605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:46.767668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103d3d-ce40-4973-bb72-8d2893c07ce5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.767958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103d3d-ce40-4973-bb72-8d2893c07ce5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.768238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0103d3d-ce40-4973-bb72-8d2893c07ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.813160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c0103d3d-ce40-4973-bb72-8d2893c07ce5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:46.815871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c0103d3d-ce40-4973-bb72-8d2893c07ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:46.842799 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2566/5162] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:46 2022] POST /identity/v3/projects => generated 363 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:46.846326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:46.855540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:46.956990 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2597/5163] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:46.975745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0103d3d-ce40-4973-bb72-8d2893c07ce5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:46.977529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c0103d3d-ce40-4973-bb72-8d2893c07ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:46.987858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a72c4-b099-4e7f-97b9-12c7ded0d711 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:46.993824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c509-0f5a-42df-ab90-4ca0fc49977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:46.994520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c509-0f5a-42df-ab90-4ca0fc49977a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:46.994810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c509-0f5a-42df-ab90-4ca0fc49977a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:46.995996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c509-0f5a-42df-ab90-4ca0fc49977a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:46.997276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c509-0f5a-42df-ab90-4ca0fc49977a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.001247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c509-0f5a-42df-ab90-4ca0fc49977a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:47.033124 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2567/5164] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:46 2022] POST /identity/v3/users => generated 282 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:47.038268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c509-0f5a-42df-ab90-4ca0fc49977a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:47.050769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c509-0f5a-42df-ab90-4ca0fc49977a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:47.062990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d20769-8a4a-464e-bba9-94ac1ca16430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:47.063726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d20769-8a4a-464e-bba9-94ac1ca16430 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.064014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d20769-8a4a-464e-bba9-94ac1ca16430 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.064291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d20769-8a4a-464e-bba9-94ac1ca16430 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.065073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d20769-8a4a-464e-bba9-94ac1ca16430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.071673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d20769-8a4a-464e-bba9-94ac1ca16430 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:47.087765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0103d3d-ce40-4973-bb72-8d2893c07ce5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:47.097711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2568/5165] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:47.102352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d20769-8a4a-464e-bba9-94ac1ca16430 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:47.120761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d20769-8a4a-464e-bba9-94ac1ca16430 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:47.135846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde13b7-783e-4e22-9759-1bdd87f90adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:47.137159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde13b7-783e-4e22-9759-1bdd87f90adc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.137630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde13b7-783e-4e22-9759-1bdd87f90adc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.138093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde13b7-783e-4e22-9759-1bdd87f90adc admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.141644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde13b7-783e-4e22-9759-1bdd87f90adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.142477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde13b7-783e-4e22-9759-1bdd87f90adc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:47.156684 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2569/5166] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:47.161237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde13b7-783e-4e22-9759-1bdd87f90adc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:47.171711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde13b7-783e-4e22-9759-1bdd87f90adc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:47.177540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec1ea5-dffe-43e2-8263-64ff94a14698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:47.178477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec1ea5-dffe-43e2-8263-64ff94a14698 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.178936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec1ea5-dffe-43e2-8263-64ff94a14698 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.179269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec1ea5-dffe-43e2-8263-64ff94a14698 admin admin] PATH_INFO: `/v3/projects/53b55d0fe70045ddac8112f06b75b66e/users/f21551db5b4c4803baec9f555c9008f4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.180303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fb12-cc44-4fae-a8c1-ffd66160603f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:47.181298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fb12-cc44-4fae-a8c1-ffd66160603f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.181848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fb12-cc44-4fae-a8c1-ffd66160603f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.182363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fb12-cc44-4fae-a8c1-ffd66160603f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.200283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec1ea5-dffe-43e2-8263-64ff94a14698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b55d0fe70045ddac8112f06b75b66e, user_id=f21551db5b4c4803baec9f555c9008f4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.201342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95fb12-cc44-4fae-a8c1-ffd66160603f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.203508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec1ea5-dffe-43e2-8263-64ff94a14698 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:47.203865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95fb12-cc44-4fae-a8c1-ffd66160603f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:47.226518 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2570/5167] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:47 2022] PUT /identity/v3/projects/53b55d0fe70045ddac8112f06b75b66e/users/f21551db5b4c4803baec9f555c9008f4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:47.253781 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2598/5168] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:47.321996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f151-d9a6-44f4-aabb-f224ab99246d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.322334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f151-d9a6-44f4-aabb-f224ab99246d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.322624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f151-d9a6-44f4-aabb-f224ab99246d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.354222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1033f151-d9a6-44f4-aabb-f224ab99246d None None] MFA Rules not processed for user `f21551db5b4c4803baec9f555c9008f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:47.356419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1033f151-d9a6-44f4-aabb-f224ab99246d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:47.435421 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2571/5169] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:47.436314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fb12-cc44-4fae-a8c1-ffd66160603f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:47.450308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fb12-cc44-4fae-a8c1-ffd66160603f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:47.581728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fa3b5-0ca6-464a-a854-1e1cd1ffb1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:47.584058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa3b5-0ca6-464a-a854-1e1cd1ffb1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.584362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa3b5-0ca6-464a-a854-1e1cd1ffb1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.584643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa3b5-0ca6-464a-a854-1e1cd1ffb1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.585711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fa3b5-0ca6-464a-a854-1e1cd1ffb1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.588486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fa3b5-0ca6-464a-a854-1e1cd1ffb1b0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:47.675539 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2599/5170] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:47 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:47.677988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033f151-d9a6-44f4-aabb-f224ab99246d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:47.726711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033f151-d9a6-44f4-aabb-f224ab99246d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:47.838309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f0c85-37c4-46dc-9bc5-03063e954388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:47.840077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0c85-37c4-46dc-9bc5-03063e954388 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.840489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0c85-37c4-46dc-9bc5-03063e954388 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.840994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0c85-37c4-46dc-9bc5-03063e954388 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.842136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f0c85-37c4-46dc-9bc5-03063e954388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.844201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f0c85-37c4-46dc-9bc5-03063e954388 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:47.876996 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2572/5171] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:47 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:47.881283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fa3b5-0ca6-464a-a854-1e1cd1ffb1b0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:47.892998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fa3b5-0ca6-464a-a854-1e1cd1ffb1b0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:47.902301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a921b3-fa01-4b19-9c7f-fd5fdd9e2080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:47.903022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a921b3-fa01-4b19-9c7f-fd5fdd9e2080 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.903280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a921b3-fa01-4b19-9c7f-fd5fdd9e2080 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.903561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a921b3-fa01-4b19-9c7f-fd5fdd9e2080 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.904306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a921b3-fa01-4b19-9c7f-fd5fdd9e2080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.917689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a921b3-fa01-4b19-9c7f-fd5fdd9e2080 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:47.942664 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2600/5172] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:47.948027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f0c85-37c4-46dc-9bc5-03063e954388 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:47.962274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f0c85-37c4-46dc-9bc5-03063e954388 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:47.969772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:47.971149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:47.971581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:47.971858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] PATH_INFO: `/v3/projects/fd2ff83e2875460289d27cf25df598ce/users/ea1cfe90223642a7873f2bbc1fab9fe6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:47.993312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2ff83e2875460289d27cf25df598ce, user_id=ea1cfe90223642a7873f2bbc1fab9fe6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:47.997685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:48.024324 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2573/5173] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:47 2022] PUT /identity/v3/projects/fd2ff83e2875460289d27cf25df598ce/users/ea1cfe90223642a7873f2bbc1fab9fe6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:48.028251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a921b3-fa01-4b19-9c7f-fd5fdd9e2080 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:48.043486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a921b3-fa01-4b19-9c7f-fd5fdd9e2080 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:48.152194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7faa8c-94b0-42f6-8622-d0de6a7a4da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:48.153916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7faa8c-94b0-42f6-8622-d0de6a7a4da5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.154440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7faa8c-94b0-42f6-8622-d0de6a7a4da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.155349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7faa8c-94b0-42f6-8622-d0de6a7a4da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.156875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7faa8c-94b0-42f6-8622-d0de6a7a4da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:48.160171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7faa8c-94b0-42f6-8622-d0de6a7a4da5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:48.162722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:48.166193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:48.184802 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2601/5174] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:48.189721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7faa8c-94b0-42f6-8622-d0de6a7a4da5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:48.197992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9ecf2-2241-4aa1-9e21-41cb6257dc98 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:48.216690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:48.218970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.219461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.219945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] PATH_INFO: `/v3/projects/4056c7ee7a2743399a382b2175014fb0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.227436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4056c7ee7a2743399a382b2175014fb0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:48.229786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7faa8c-94b0-42f6-8622-d0de6a7a4da5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:48.232957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:48.247513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f41ef-bc23-497c-964a-ed685cf0b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:48.248506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f41ef-bc23-497c-964a-ed685cf0b998 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.248721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f41ef-bc23-497c-964a-ed685cf0b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.249015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f41ef-bc23-497c-964a-ed685cf0b998 admin admin] PATH_INFO: `/v3/projects/fd2ff83e2875460289d27cf25df598ce/users/ea1cfe90223642a7873f2bbc1fab9fe6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.253016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f41ef-bc23-497c-964a-ed685cf0b998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2ff83e2875460289d27cf25df598ce, user_id=ea1cfe90223642a7873f2bbc1fab9fe6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:48.270191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f41ef-bc23-497c-964a-ed685cf0b998 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:48.317743 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2602/5175] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:48 2022] PUT /identity/v3/projects/fd2ff83e2875460289d27cf25df598ce/users/ea1cfe90223642a7873f2bbc1fab9fe6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:48.328454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60833f82-1df5-4da9-9368-984fb0e73b86 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.328853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60833f82-1df5-4da9-9368-984fb0e73b86 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.329138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60833f82-1df5-4da9-9368-984fb0e73b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.402772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-60833f82-1df5-4da9-9368-984fb0e73b86 None None] MFA Rules not processed for user `ea1cfe90223642a7873f2bbc1fab9fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:48.404012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-60833f82-1df5-4da9-9368-984fb0e73b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:48.429354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4056c7ee7a2743399a382b2175014fb0', 'request_id': 'req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:48.464048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4056c7ee7a2743399a382b2175014fb0', 'request_id': 'req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:48.481924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4056c7ee7a2743399a382b2175014fb0', 'request_id': 'req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:48.513752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] The token cache is being invalidate because project 4056c7ee7a2743399a382b2175014fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:48.514068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:48.517936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eb8e034-de8e-44c4-865e-9b34c2d3bac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:48.528153 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2574/5176] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:48 2022] DELETE /identity/v3/projects/4056c7ee7a2743399a382b2175014fb0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:48.530680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63ecfa-125f-4f23-8060-b449691b71eb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.533468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63ecfa-125f-4f23-8060-b449691b71eb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.533919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63ecfa-125f-4f23-8060-b449691b71eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.593382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5e63ecfa-125f-4f23-8060-b449691b71eb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:48.598597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e63ecfa-125f-4f23-8060-b449691b71eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:48.648714 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2603/5177] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:08:48.655353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60833f82-1df5-4da9-9368-984fb0e73b86 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:48.657063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-60833f82-1df5-4da9-9368-984fb0e73b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:48.796448 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2575/5178] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:48.805311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82aa2e-cd35-4f96-a1c5-329baf5b027e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.805603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82aa2e-cd35-4f96-a1c5-329baf5b027e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.805873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82aa2e-cd35-4f96-a1c5-329baf5b027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.846369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60833f82-1df5-4da9-9368-984fb0e73b86 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:48.856320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3b5e3-e52c-4085-98ac-2e78a7ec2dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:48.857019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3b5e3-e52c-4085-98ac-2e78a7ec2dfc service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.857302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3b5e3-e52c-4085-98ac-2e78a7ec2dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.857578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3b5e3-e52c-4085-98ac-2e78a7ec2dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.859132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2c82aa2e-cd35-4f96-a1c5-329baf5b027e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:48.862531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2c82aa2e-cd35-4f96-a1c5-329baf5b027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:48.878719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3b5e3-e52c-4085-98ac-2e78a7ec2dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:48.880156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3b5e3-e52c-4085-98ac-2e78a7ec2dfc service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:48.889410 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2576/5179] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:48.890721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82aa2e-cd35-4f96-a1c5-329baf5b027e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:48.907311 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2604/5180] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:48.907908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82aa2e-cd35-4f96-a1c5-329baf5b027e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:48.920624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:48.921306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.921592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.921860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.922595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:48.922903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:48.924560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:48.951451 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2577/5181] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:48.955779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3b5e3-e52c-4085-98ac-2e78a7ec2dfc service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:48.975894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3b5e3-e52c-4085-98ac-2e78a7ec2dfc service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:48.994945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42318-5fe5-4906-b8f6-10e1ec156c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:48.995686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42318-5fe5-4906-b8f6-10e1ec156c0b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:48.996021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42318-5fe5-4906-b8f6-10e1ec156c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:48.996409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42318-5fe5-4906-b8f6-10e1ec156c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:48.997055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd42318-5fe5-4906-b8f6-10e1ec156c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:48.999092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd42318-5fe5-4906-b8f6-10e1ec156c0b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:49.033772 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2605/5182] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:48 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:49.039095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:49.060320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920324f6-c967-4582-8832-d231694edb24 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:49.073564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42318-5fe5-4906-b8f6-10e1ec156c0b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:49.142387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1748be2-9499-4e58-ba88-605bad7278fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:49.143068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748be2-9499-4e58-ba88-605bad7278fa admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:49.143532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748be2-9499-4e58-ba88-605bad7278fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:49.143874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1748be2-9499-4e58-ba88-605bad7278fa admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:49.144625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1748be2-9499-4e58-ba88-605bad7278fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:49.149394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1748be2-9499-4e58-ba88-605bad7278fa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:49.177022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42318-5fe5-4906-b8f6-10e1ec156c0b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:49.182049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c838b-e9ed-428b-9f6d-36e2ba1c42fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:49.182743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c838b-e9ed-428b-9f6d-36e2ba1c42fd service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:49.183227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c838b-e9ed-428b-9f6d-36e2ba1c42fd service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:49.183227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c838b-e9ed-428b-9f6d-36e2ba1c42fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:49.185367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e5c838b-e9ed-428b-9f6d-36e2ba1c42fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:49.196462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2578/5183] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:49 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:08:49.200761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1748be2-9499-4e58-ba88-605bad7278fa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:49.216726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1748be2-9499-4e58-ba88-605bad7278fa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:49.225940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e75852-b11b-4cc2-a4b4-82201ef4b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:49.226646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75852-b11b-4cc2-a4b4-82201ef4b776 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:49.226930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75852-b11b-4cc2-a4b4-82201ef4b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:49.227210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75852-b11b-4cc2-a4b4-82201ef4b776 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:49.227994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e75852-b11b-4cc2-a4b4-82201ef4b776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:49.230304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e75852-b11b-4cc2-a4b4-82201ef4b776 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:49.242024 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2579/5184] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:49.246463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e75852-b11b-4cc2-a4b4-82201ef4b776 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:49.257680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e75852-b11b-4cc2-a4b4-82201ef4b776 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:49.262858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd12a2-6e09-4e8d-a68d-5597d6ccf81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:49.263848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd12a2-6e09-4e8d-a68d-5597d6ccf81b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:49.264319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd12a2-6e09-4e8d-a68d-5597d6ccf81b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:49.264636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd12a2-6e09-4e8d-a68d-5597d6ccf81b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:49.265393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd12a2-6e09-4e8d-a68d-5597d6ccf81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:49.267036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd12a2-6e09-4e8d-a68d-5597d6ccf81b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:49.273240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c838b-e9ed-428b-9f6d-36e2ba1c42fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:49.277759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c838b-e9ed-428b-9f6d-36e2ba1c42fd service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:49.281044 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2580/5185] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:49.285197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd12a2-6e09-4e8d-a68d-5597d6ccf81b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:49.291296 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2606/5186] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:49.296580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd12a2-6e09-4e8d-a68d-5597d6ccf81b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:49.302511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:49.303506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:49.303858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:49.304209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] PATH_INFO: `/v3/projects/8f8d78b37852431c9f16ee8a47991b85/users/a252a85e541f41728586f9ea910a5508/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:49.331143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8d78b37852431c9f16ee8a47991b85, user_id=a252a85e541f41728586f9ea910a5508, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:49.334166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:49.362753 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2581/5187] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:49 2022] PUT /identity/v3/projects/8f8d78b37852431c9f16ee8a47991b85/users/a252a85e541f41728586f9ea910a5508/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:49.373426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5b24-effb-46af-8fab-44f3907cbd09 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:49.373719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5b24-effb-46af-8fab-44f3907cbd09 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:49.373986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5b24-effb-46af-8fab-44f3907cbd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:49.426414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-36fd5b24-effb-46af-8fab-44f3907cbd09 None None] MFA Rules not processed for user `a252a85e541f41728586f9ea910a5508`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:49.428995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-36fd5b24-effb-46af-8fab-44f3907cbd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:49.585884 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2607/5188] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:49.597363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:49.599688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:49.750742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7883f-30bc-4a4c-8a5c-c67bcd431b64 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:49.754982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:49.755724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:49.755990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:49.756272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:49.769040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:49.770574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:49.781685 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2582/5189] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:52.907326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11759e-c600-4997-b1b3-5115e109c786 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:52.907987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11759e-c600-4997-b1b3-5115e109c786 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:52.907987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11759e-c600-4997-b1b3-5115e109c786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:52.931892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1a11759e-c600-4997-b1b3-5115e109c786 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:52.933175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a11759e-c600-4997-b1b3-5115e109c786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:53.007475 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2608/5190] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:53.031043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:53.032790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:53.147486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4fa4-2864-4533-8318-27e54baa9117 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:53.155550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b84c6e-b680-4785-a6ce-8deb7bf56882 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:53.156594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b84c6e-b680-4785-a6ce-8deb7bf56882 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:53.156879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b84c6e-b680-4785-a6ce-8deb7bf56882 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:53.157158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b84c6e-b680-4785-a6ce-8deb7bf56882 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:53.169837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b84c6e-b680-4785-a6ce-8deb7bf56882 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:53.172063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b84c6e-b680-4785-a6ce-8deb7bf56882 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:53.185012 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2583/5191] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:08:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:08:56.075768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11759e-c600-4997-b1b3-5115e109c786 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:56.223865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11759e-c600-4997-b1b3-5115e109c786 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:56.233274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:56.234869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:56.234869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:56.235141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] PATH_INFO: `/v3/users/a252a85e541f41728586f9ea910a5508` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:56.236800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a252a85e541f41728586f9ea910a5508)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:56.239097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:56.325498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a252a85e541f41728586f9ea910a5508'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:56.359239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a252a85e541f41728586f9ea910a5508'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:56.371231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a252a85e541f41728586f9ea910a5508'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:56.373309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a252a85e541f41728586f9ea910a5508'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:56.375391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a252a85e541f41728586f9ea910a5508'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:56.409280 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2609/5192] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:56 2022] DELETE /identity/v3/users/a252a85e541f41728586f9ea910a5508 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:56.414488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8d67-ad0c-489f-9362-2e2b59dd690b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:56.415594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8d67-ad0c-489f-9362-2e2b59dd690b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:56.416171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8d67-ad0c-489f-9362-2e2b59dd690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:56.447866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0fbb8d67-ad0c-489f-9362-2e2b59dd690b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:56.450279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0fbb8d67-ad0c-489f-9362-2e2b59dd690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:56.593657 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2584/5193] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:56.604039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:56.605550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:56.703897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1351029-c90f-4115-80f1-a07456fe7874 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:56.708259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:56.710112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:56.710112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:56.710112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:56.722344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:56.729883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:56.756930 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2610/5194] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:57.021834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb8d67-ad0c-489f-9362-2e2b59dd690b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:57.024805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0fbb8d67-ad0c-489f-9362-2e2b59dd690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:57.064856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb8d67-ad0c-489f-9362-2e2b59dd690b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:57.077602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:57.078838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:57.079972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:57.080317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] PATH_INFO: `/v3/projects/8f8d78b37852431c9f16ee8a47991b85` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:57.082672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8d78b37852431c9f16ee8a47991b85)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:57.106623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:57.132527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:57.134181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:57.244209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8d78b37852431c9f16ee8a47991b85', 'request_id': 'req-f6e66152-20be-44f9-a68b-ceef14fdfe0b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:57.267959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8d78b37852431c9f16ee8a47991b85', 'request_id': 'req-f6e66152-20be-44f9-a68b-ceef14fdfe0b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:57.272956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700ce53-31e9-4f01-b765-37394502c3cd service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:57.298278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8d78b37852431c9f16ee8a47991b85', 'request_id': 'req-f6e66152-20be-44f9-a68b-ceef14fdfe0b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:57.334715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] The token cache is being invalidate because project 8f8d78b37852431c9f16ee8a47991b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:57.336162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:57.338966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f6e66152-20be-44f9-a68b-ceef14fdfe0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:57.342606 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2585/5195] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:57 2022] DELETE /identity/v3/projects/8f8d78b37852431c9f16ee8a47991b85 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:57.348857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694549-c9d7-49cf-b8b7-ca29d8f83ff8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:57.349932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694549-c9d7-49cf-b8b7-ca29d8f83ff8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:57.350396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694549-c9d7-49cf-b8b7-ca29d8f83ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:57.401428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3d694549-c9d7-49cf-b8b7-ca29d8f83ff8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:57.403117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3d694549-c9d7-49cf-b8b7-ca29d8f83ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:57.451199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:57.451881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:57.452157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:57.452458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:57.456077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:57.546646 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2586/5196] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:57.557070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb6a87-ad22-498a-a761-59cde28587fa None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:57.557629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb6a87-ad22-498a-a761-59cde28587fa None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:57.559024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb6a87-ad22-498a-a761-59cde28587fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:57.602181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:57.604193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:57.606602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-edbb6a87-ad22-498a-a761-59cde28587fa None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:57.610464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-edbb6a87-ad22-498a-a761-59cde28587fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:57.633901 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2587/5197] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:57.639306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb6a87-ad22-498a-a761-59cde28587fa None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:57.657532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb6a87-ad22-498a-a761-59cde28587fa None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:57.662771 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2611/5198] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:57.678351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:57.679166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:57.679543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:57.679914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:57.681000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:08:57.681527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:57.683497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:57.711274 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2588/5199] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:08:57.721012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:57.741598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbca999-ce3c-49c2-8c6a-33b0ea5783d8 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:57.747521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfd9ce-d1ad-453e-bf86-1eded4fae937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:57.748559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd9ce-d1ad-453e-bf86-1eded4fae937 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:57.749101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd9ce-d1ad-453e-bf86-1eded4fae937 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:57.749455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd9ce-d1ad-453e-bf86-1eded4fae937 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:57.750245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfd9ce-d1ad-453e-bf86-1eded4fae937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:57.752426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfd9ce-d1ad-453e-bf86-1eded4fae937 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:57.788960 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2612/5200] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:08:57 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:57.792874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:57.810242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04e1bb-d578-430f-9ec7-cf7921a48b04 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:57.898601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d64f5-aacd-44fe-9e6a-f213fcfe3808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:57.901248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d64f5-aacd-44fe-9e6a-f213fcfe3808 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:57.901778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d64f5-aacd-44fe-9e6a-f213fcfe3808 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:57.903044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d64f5-aacd-44fe-9e6a-f213fcfe3808 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:57.905393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d64f5-aacd-44fe-9e6a-f213fcfe3808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:57.907774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d64f5-aacd-44fe-9e6a-f213fcfe3808 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:57.940767 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2589/5201] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:08:57 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:08:57.942957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfd9ce-d1ad-453e-bf86-1eded4fae937 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:57.957955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfd9ce-d1ad-453e-bf86-1eded4fae937 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:57.965683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30169c0-5576-475d-9fed-582729b6529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:57.966801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30169c0-5576-475d-9fed-582729b6529d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:57.967275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30169c0-5576-475d-9fed-582729b6529d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:57.967763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30169c0-5576-475d-9fed-582729b6529d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:57.969129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30169c0-5576-475d-9fed-582729b6529d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:57.973825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30169c0-5576-475d-9fed-582729b6529d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:57.987619 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2613/5202] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:57.992679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d64f5-aacd-44fe-9e6a-f213fcfe3808 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:58.005904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d64f5-aacd-44fe-9e6a-f213fcfe3808 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:58.014605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887169f-b0bb-4e01-bb8c-a149441c1efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:58.015611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887169f-b0bb-4e01-bb8c-a149441c1efa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:58.015904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887169f-b0bb-4e01-bb8c-a149441c1efa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:58.016183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887169f-b0bb-4e01-bb8c-a149441c1efa admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:58.017115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887169f-b0bb-4e01-bb8c-a149441c1efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:58.019170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887169f-b0bb-4e01-bb8c-a149441c1efa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:58.039218 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2590/5203] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:08:58.040450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30169c0-5576-475d-9fed-582729b6529d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:58.051666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30169c0-5576-475d-9fed-582729b6529d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:58.061885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:58.062856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:58.063145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:58.063638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] PATH_INFO: `/v3/projects/4c9689c924eb49f8a8bdb4c1192d9d7f/users/167133674ecf4a659ec3657cc3591bcf/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:58.094405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9689c924eb49f8a8bdb4c1192d9d7f, user_id=167133674ecf4a659ec3657cc3591bcf, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:58.098696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:58.137508 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2614/5204] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:08:58 2022] PUT /identity/v3/projects/4c9689c924eb49f8a8bdb4c1192d9d7f/users/167133674ecf4a659ec3657cc3591bcf/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:58.139659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497cd9-7ac3-4a96-9d85-a3a3b3fd6e21 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:58.140381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497cd9-7ac3-4a96-9d85-a3a3b3fd6e21 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:58.141177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497cd9-7ac3-4a96-9d85-a3a3b3fd6e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:58.200424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-57497cd9-7ac3-4a96-9d85-a3a3b3fd6e21 None None] MFA Rules not processed for user `167133674ecf4a659ec3657cc3591bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:58.204459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57497cd9-7ac3-4a96-9d85-a3a3b3fd6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:58.313639 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2591/5205] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:58.325258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:58.331967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:58.356306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57497cd9-7ac3-4a96-9d85-a3a3b3fd6e21 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:58.358016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57497cd9-7ac3-4a96-9d85-a3a3b3fd6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:58.417695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac964213-e8e1-4606-bae2-aaf2c03d768b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:58.424293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32b785-b234-42cd-a092-21048ebf11a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:58.425037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32b785-b234-42cd-a092-21048ebf11a1 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:58.425324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32b785-b234-42cd-a092-21048ebf11a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:58.425603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32b785-b234-42cd-a092-21048ebf11a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:58.437585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32b785-b234-42cd-a092-21048ebf11a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:58.439120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32b785-b234-42cd-a092-21048ebf11a1 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:58.454109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57497cd9-7ac3-4a96-9d85-a3a3b3fd6e21 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:58.456003 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2615/5206] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:58.461105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:58.462266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:58.462545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:58.462811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] PATH_INFO: `/v3/users/f21551db5b4c4803baec9f555c9008f4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:58.472871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21551db5b4c4803baec9f555c9008f4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:58.480940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:58.608982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21551db5b4c4803baec9f555c9008f4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:58.609664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21551db5b4c4803baec9f555c9008f4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:58.610866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21551db5b4c4803baec9f555c9008f4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:58.642149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21551db5b4c4803baec9f555c9008f4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:58.667061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21551db5b4c4803baec9f555c9008f4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:58.694396 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2592/5207] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:58 2022] DELETE /identity/v3/users/f21551db5b4c4803baec9f555c9008f4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:08:58.698860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937026-49ad-4ffb-a331-2780952902db None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:58.699225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937026-49ad-4ffb-a331-2780952902db None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:58.699510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937026-49ad-4ffb-a331-2780952902db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:58.744244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-67937026-49ad-4ffb-a331-2780952902db None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:08:58.745658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-67937026-49ad-4ffb-a331-2780952902db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:58.909742 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2616/5208] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:08:58.923870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:58.925351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:59.025747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ed162-9a03-40b7-9b3d-cfd294f13900 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:59.031386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ce11b-584f-471a-b39d-51d674f95b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:59.032098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ce11b-584f-471a-b39d-51d674f95b9f service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:59.032409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ce11b-584f-471a-b39d-51d674f95b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:59.032689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ce11b-584f-471a-b39d-51d674f95b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:59.053669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ce11b-584f-471a-b39d-51d674f95b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:59.055891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ce11b-584f-471a-b39d-51d674f95b9f service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:59.082961 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2593/5209] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:08:59.600149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937026-49ad-4ffb-a331-2780952902db None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:59.603675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-67937026-49ad-4ffb-a331-2780952902db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:08:59.625250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937026-49ad-4ffb-a331-2780952902db None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:59.637952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:59.639567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:08:59.640432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:08:59.641247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] PATH_INFO: `/v3/projects/53b55d0fe70045ddac8112f06b75b66e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:08:59.645204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b55d0fe70045ddac8112f06b75b66e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:08:59.650003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:08:59.765235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b55d0fe70045ddac8112f06b75b66e', 'request_id': 'req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:59.775262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b55d0fe70045ddac8112f06b75b66e', 'request_id': 'req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:59.794569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b55d0fe70045ddac8112f06b75b66e', 'request_id': 'req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:59.814113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] The token cache is being invalidate because project 53b55d0fe70045ddac8112f06b75b66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:08:59.814523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:59.815444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:08:59.818623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2617/5210] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:08:59 2022] DELETE /identity/v3/projects/53b55d0fe70045ddac8112f06b75b66e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:08:59.822577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ce11b-584f-471a-b39d-51d674f95b9f service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:08:59.839543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ce11b-584f-471a-b39d-51d674f95b9f service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:08:59.996035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:08:59.998625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:00.000928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:00.006733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] PATH_INFO: `/v3/users/ea1cfe90223642a7873f2bbc1fab9fe6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:00.011904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1cfe90223642a7873f2bbc1fab9fe6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:00.015502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:00.120894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1cfe90223642a7873f2bbc1fab9fe6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:00.122427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1cfe90223642a7873f2bbc1fab9fe6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:00.123821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1cfe90223642a7873f2bbc1fab9fe6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:00.159006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1cfe90223642a7873f2bbc1fab9fe6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:00.186371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4daf8033-e4c3-4036-96ff-800c67feb446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1cfe90223642a7873f2bbc1fab9fe6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:00.216568 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2594/5211] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:08:59 2022] DELETE /identity/v3/users/ea1cfe90223642a7873f2bbc1fab9fe6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:00.983391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:00.986854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:01.008564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb94d-4bcc-4015-a410-21d60e4c09ae admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:01.131948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:01.133208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:01.134293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:01.134746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] PATH_INFO: `/v3/projects/fd2ff83e2875460289d27cf25df598ce` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:01.136671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2ff83e2875460289d27cf25df598ce)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:01.139312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:01.216408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2ff83e2875460289d27cf25df598ce', 'request_id': 'req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:01.222198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2ff83e2875460289d27cf25df598ce', 'request_id': 'req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:01.234337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2ff83e2875460289d27cf25df598ce', 'request_id': 'req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:01.254850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] The token cache is being invalidate because project fd2ff83e2875460289d27cf25df598ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:01.255676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:01.256734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dafdcbaf-8925-4cd4-8639-b797e8bf1b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:01.259200 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2618/5212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:00 2022] DELETE /identity/v3/projects/fd2ff83e2875460289d27cf25df598ce => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:01.263885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0a06d-5a33-4b8d-8819-882d38770377 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:01.264484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0a06d-5a33-4b8d-8819-882d38770377 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:01.264484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0a06d-5a33-4b8d-8819-882d38770377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:01.285278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cce0a06d-5a33-4b8d-8819-882d38770377 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:01.286847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cce0a06d-5a33-4b8d-8819-882d38770377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:01.423960 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2595/5213] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:01.435454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd846-3382-4edb-8900-f843c07026ca None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:01.435813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd846-3382-4edb-8900-f843c07026ca None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:01.436083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd846-3382-4edb-8900-f843c07026ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:01.476568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d4ddd846-3382-4edb-8900-f843c07026ca None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:01.478348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4ddd846-3382-4edb-8900-f843c07026ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:01.495183 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2619/5214] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:01.505456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0a06d-5a33-4b8d-8819-882d38770377 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:01.521044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0a06d-5a33-4b8d-8819-882d38770377 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:01.528456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:01.530122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:01.530643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:01.531235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:01.532295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:01.532869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:01.534918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:01.553704 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2596/5215] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:01.559481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddd846-3382-4edb-8900-f843c07026ca None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:01.573184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddd846-3382-4edb-8900-f843c07026ca None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:01.579863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8e90c-4b17-4c74-ad04-446abed351f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:01.581036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8e90c-4b17-4c74-ad04-446abed351f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:01.581586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8e90c-4b17-4c74-ad04-446abed351f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:01.582102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8e90c-4b17-4c74-ad04-446abed351f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:01.585878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8e90c-4b17-4c74-ad04-446abed351f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:01.589687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8e90c-4b17-4c74-ad04-446abed351f9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:01.686596 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2620/5216] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:01 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:01.690743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:01.707006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc8644-22d6-4655-aa19-4fadfd8f4ff0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:01.837968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cefd56-e440-4da1-87bd-f84aa7be632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:01.838697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cefd56-e440-4da1-87bd-f84aa7be632d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:01.840695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cefd56-e440-4da1-87bd-f84aa7be632d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:01.841001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cefd56-e440-4da1-87bd-f84aa7be632d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:01.842319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cefd56-e440-4da1-87bd-f84aa7be632d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:01.846785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cefd56-e440-4da1-87bd-f84aa7be632d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:01.882046 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2597/5217] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:01 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:01.883563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8e90c-4b17-4c74-ad04-446abed351f9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:01.898799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8e90c-4b17-4c74-ad04-446abed351f9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:01.904984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53db2b2-8a93-4492-8a65-882c41d3d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:01.905878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53db2b2-8a93-4492-8a65-882c41d3d80c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:01.906465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53db2b2-8a93-4492-8a65-882c41d3d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:01.906856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53db2b2-8a93-4492-8a65-882c41d3d80c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:01.907923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53db2b2-8a93-4492-8a65-882c41d3d80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:01.910149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53db2b2-8a93-4492-8a65-882c41d3d80c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:01.930191 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2621/5218] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:01.933677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cefd56-e440-4da1-87bd-f84aa7be632d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:01.950310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cefd56-e440-4da1-87bd-f84aa7be632d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:01.980479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a61394-b882-4302-8dc9-cbb59f38b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:01.981182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a61394-b882-4302-8dc9-cbb59f38b0aa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:01.981469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a61394-b882-4302-8dc9-cbb59f38b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:01.981746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a61394-b882-4302-8dc9-cbb59f38b0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:01.982521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a61394-b882-4302-8dc9-cbb59f38b0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:01.984188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a61394-b882-4302-8dc9-cbb59f38b0aa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:02.014712 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2598/5219] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:02.014979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53db2b2-8a93-4492-8a65-882c41d3d80c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:02.026407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53db2b2-8a93-4492-8a65-882c41d3d80c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:02.033868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf6c1f-35b7-4976-9d49-8968199d733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:02.035268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6c1f-35b7-4976-9d49-8968199d733d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:02.035555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6c1f-35b7-4976-9d49-8968199d733d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:02.035839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6c1f-35b7-4976-9d49-8968199d733d admin admin] PATH_INFO: `/v3/projects/67dea5f032894c1f968944abdac71f71/users/93f89149cadc47ac81dd4885c5eec984/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:02.056372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf6c1f-35b7-4976-9d49-8968199d733d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67dea5f032894c1f968944abdac71f71, user_id=93f89149cadc47ac81dd4885c5eec984, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:02.058567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf6c1f-35b7-4976-9d49-8968199d733d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:02.084044 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2622/5220] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:02 2022] PUT /identity/v3/projects/67dea5f032894c1f968944abdac71f71/users/93f89149cadc47ac81dd4885c5eec984/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:02.102138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee7972-0d61-40b9-80b1-b74451ea088d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:02.102515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee7972-0d61-40b9-80b1-b74451ea088d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:02.103345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee7972-0d61-40b9-80b1-b74451ea088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:02.155408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e4ee7972-0d61-40b9-80b1-b74451ea088d None None] MFA Rules not processed for user `93f89149cadc47ac81dd4885c5eec984`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:02.156741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e4ee7972-0d61-40b9-80b1-b74451ea088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:02.354580 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2599/5221] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:02.359678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf6c1f-35b7-4976-9d49-8968199d733d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:02.471991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf6c1f-35b7-4976-9d49-8968199d733d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:02.479948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522a6e0-bafe-495b-8daa-9b8078bb14b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:02.481110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522a6e0-bafe-495b-8daa-9b8078bb14b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:02.482765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522a6e0-bafe-495b-8daa-9b8078bb14b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:02.483250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522a6e0-bafe-495b-8daa-9b8078bb14b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:02.483997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522a6e0-bafe-495b-8daa-9b8078bb14b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:02.486080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522a6e0-bafe-495b-8daa-9b8078bb14b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:02.522751 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2623/5222] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:02 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:02.526636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee7972-0d61-40b9-80b1-b74451ea088d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:02.545134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee7972-0d61-40b9-80b1-b74451ea088d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:02.715856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eef47-4aa7-4118-8e91-f49013e7e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:02.716618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eef47-4aa7-4118-8e91-f49013e7e54f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:02.717115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eef47-4aa7-4118-8e91-f49013e7e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:02.717394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eef47-4aa7-4118-8e91-f49013e7e54f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:02.718183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2eef47-4aa7-4118-8e91-f49013e7e54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:02.720397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2eef47-4aa7-4118-8e91-f49013e7e54f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:02.770916 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2600/5223] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:02 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:02.775558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522a6e0-bafe-495b-8daa-9b8078bb14b7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:02.815119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522a6e0-bafe-495b-8daa-9b8078bb14b7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:02.825109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd0f52-177b-4662-a9ef-cfe668fe395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:02.826712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0f52-177b-4662-a9ef-cfe668fe395b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:02.828180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0f52-177b-4662-a9ef-cfe668fe395b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:02.831509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0f52-177b-4662-a9ef-cfe668fe395b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:02.833805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd0f52-177b-4662-a9ef-cfe668fe395b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:02.837021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd0f52-177b-4662-a9ef-cfe668fe395b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:02.883759 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2624/5224] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:02.888557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eef47-4aa7-4118-8e91-f49013e7e54f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:02.913099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eef47-4aa7-4118-8e91-f49013e7e54f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:02.930168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0900bd-0bbb-4cb6-8f42-5d6f4e590743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:02.931675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0900bd-0bbb-4cb6-8f42-5d6f4e590743 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:02.932209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0900bd-0bbb-4cb6-8f42-5d6f4e590743 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:02.933756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0900bd-0bbb-4cb6-8f42-5d6f4e590743 admin admin] PATH_INFO: `/v3/projects/7c8f6b2a75a24ca49373c87d95c9668b/users/5efd0e4590d94d8c9957cbc719bbf5c8/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:02.983234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0900bd-0bbb-4cb6-8f42-5d6f4e590743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8f6b2a75a24ca49373c87d95c9668b, user_id=5efd0e4590d94d8c9957cbc719bbf5c8, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:02.998930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0900bd-0bbb-4cb6-8f42-5d6f4e590743 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:03.031368 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2601/5225] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:02 2022] PUT /identity/v3/projects/7c8f6b2a75a24ca49373c87d95c9668b/users/5efd0e4590d94d8c9957cbc719bbf5c8/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:03.035230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd0f52-177b-4662-a9ef-cfe668fe395b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:03.051868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd0f52-177b-4662-a9ef-cfe668fe395b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:03.165685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec5f05-5420-4b27-aeb3-5f73041de11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:03.167241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5f05-5420-4b27-aeb3-5f73041de11d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:03.167770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5f05-5420-4b27-aeb3-5f73041de11d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:03.169904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5f05-5420-4b27-aeb3-5f73041de11d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:03.174724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec5f05-5420-4b27-aeb3-5f73041de11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:03.178184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec5f05-5420-4b27-aeb3-5f73041de11d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:03.198974 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2625/5226] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:03.199333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0900bd-0bbb-4cb6-8f42-5d6f4e590743 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:03.237148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0900bd-0bbb-4cb6-8f42-5d6f4e590743 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:03.245100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:03.247160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:03.247684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:03.248192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] PATH_INFO: `/v3/projects/7c8f6b2a75a24ca49373c87d95c9668b/users/5efd0e4590d94d8c9957cbc719bbf5c8/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:03.251152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8f6b2a75a24ca49373c87d95c9668b, user_id=5efd0e4590d94d8c9957cbc719bbf5c8, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:03.254352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:03.270086 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2602/5227] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:03 2022] PUT /identity/v3/projects/7c8f6b2a75a24ca49373c87d95c9668b/users/5efd0e4590d94d8c9957cbc719bbf5c8/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:03.281327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168eede-eb0b-416e-b3b5-a013763ac6d1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:03.281628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168eede-eb0b-416e-b3b5-a013763ac6d1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:03.281970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168eede-eb0b-416e-b3b5-a013763ac6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:03.359614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7168eede-eb0b-416e-b3b5-a013763ac6d1 None None] MFA Rules not processed for user `5efd0e4590d94d8c9957cbc719bbf5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:03.361623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7168eede-eb0b-416e-b3b5-a013763ac6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:03.544130 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2626/5228] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:03.556936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:03.560644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:03.684269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66106c-9b37-46c4-a29f-f16bf6f3be5a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:03.691127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838cc5-7955-49c4-b646-145772bdeecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:03.692045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838cc5-7955-49c4-b646-145772bdeecd service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:03.692323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838cc5-7955-49c4-b646-145772bdeecd service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:03.696538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838cc5-7955-49c4-b646-145772bdeecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:03.808881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e838cc5-7955-49c4-b646-145772bdeecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:03.811230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e838cc5-7955-49c4-b646-145772bdeecd service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:03.833035 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2603/5229] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:05.620020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168eede-eb0b-416e-b3b5-a013763ac6d1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:05.622645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7168eede-eb0b-416e-b3b5-a013763ac6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:05.794250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168eede-eb0b-416e-b3b5-a013763ac6d1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:05.803356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:05.804518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:05.804942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:05.805283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] PATH_INFO: `/v3/users/167133674ecf4a659ec3657cc3591bcf` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:05.806654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=167133674ecf4a659ec3657cc3591bcf)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:05.810330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:05.921576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167133674ecf4a659ec3657cc3591bcf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:05.947130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167133674ecf4a659ec3657cc3591bcf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:05.960647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167133674ecf4a659ec3657cc3591bcf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:05.961564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167133674ecf4a659ec3657cc3591bcf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:05.962268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167133674ecf4a659ec3657cc3591bcf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:05.985108 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2627/5230] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:05 2022] DELETE /identity/v3/users/167133674ecf4a659ec3657cc3591bcf => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:05.990445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6899-b948-416d-8111-19cef7b118dd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:05.991686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6899-b948-416d-8111-19cef7b118dd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:05.992208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6899-b948-416d-8111-19cef7b118dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:06.017338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ba0d6899-b948-416d-8111-19cef7b118dd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:06.018984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ba0d6899-b948-416d-8111-19cef7b118dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:06.116559 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2604/5231] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:06.128372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:06.136372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:06.217517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439db74c-b77d-4c3a-a926-10e3c71d4c3f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:06.223524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401257a-f146-4f16-9a57-ff07300dbd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:06.224397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401257a-f146-4f16-9a57-ff07300dbd61 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:06.224791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401257a-f146-4f16-9a57-ff07300dbd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:06.225141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401257a-f146-4f16-9a57-ff07300dbd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:06.236857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401257a-f146-4f16-9a57-ff07300dbd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:06.238411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401257a-f146-4f16-9a57-ff07300dbd61 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:06.249483 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2628/5232] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:06.466091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6899-b948-416d-8111-19cef7b118dd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:06.469845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ba0d6899-b948-416d-8111-19cef7b118dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:06.517206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6899-b948-416d-8111-19cef7b118dd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:06.525163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:06.526892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:06.527360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:06.527839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] PATH_INFO: `/v3/projects/4c9689c924eb49f8a8bdb4c1192d9d7f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:06.530631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9689c924eb49f8a8bdb4c1192d9d7f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:06.535146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:06.620309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9689c924eb49f8a8bdb4c1192d9d7f', 'request_id': 'req-01737be8-49be-4193-b64c-940e0c1de3dd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:06.634357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9689c924eb49f8a8bdb4c1192d9d7f', 'request_id': 'req-01737be8-49be-4193-b64c-940e0c1de3dd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:06.649080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9689c924eb49f8a8bdb4c1192d9d7f', 'request_id': 'req-01737be8-49be-4193-b64c-940e0c1de3dd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:06.679507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] The token cache is being invalidate because project 4c9689c924eb49f8a8bdb4c1192d9d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:06.681011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:06.681756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-01737be8-49be-4193-b64c-940e0c1de3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:06.684137 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2605/5233] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:06 2022] DELETE /identity/v3/projects/4c9689c924eb49f8a8bdb4c1192d9d7f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:06.689921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254760-bbe0-4c3b-80f4-86c97fbcd1f7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:06.690498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254760-bbe0-4c3b-80f4-86c97fbcd1f7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:06.690619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254760-bbe0-4c3b-80f4-86c97fbcd1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:06.710417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c3254760-bbe0-4c3b-80f4-86c97fbcd1f7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:06.711870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c3254760-bbe0-4c3b-80f4-86c97fbcd1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:06.818556 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2629/5234] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:06.913413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30202aa-7061-4b9e-bd59-ff9da454cea7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:06.913759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30202aa-7061-4b9e-bd59-ff9da454cea7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:06.913979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30202aa-7061-4b9e-bd59-ff9da454cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:06.937985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c30202aa-7061-4b9e-bd59-ff9da454cea7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:06.939242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c30202aa-7061-4b9e-bd59-ff9da454cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:06.948901 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2606/5235] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:06.954249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254760-bbe0-4c3b-80f4-86c97fbcd1f7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:06.976644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254760-bbe0-4c3b-80f4-86c97fbcd1f7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:07.005896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:07.006875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.007384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.007760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.008688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:07.009102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:07.010846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:07.028572 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2630/5236] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:09:07.029961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30202aa-7061-4b9e-bd59-ff9da454cea7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:07.047103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30202aa-7061-4b9e-bd59-ff9da454cea7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:07.054097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a7998-0bdb-400d-aeeb-8cc3da5f4ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:07.054760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a7998-0bdb-400d-aeeb-8cc3da5f4ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.055038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a7998-0bdb-400d-aeeb-8cc3da5f4ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.055309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a7998-0bdb-400d-aeeb-8cc3da5f4ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.055997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a7998-0bdb-400d-aeeb-8cc3da5f4ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:07.058163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a7998-0bdb-400d-aeeb-8cc3da5f4ff7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:07.104849 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2607/5237] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:07 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:07.109195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:07.125514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616c985-641b-43fb-9ad0-41e927dd14e8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:07.235877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc001f-4b1c-4c8a-adfa-bbfb675c767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:07.235877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc001f-4b1c-4c8a-adfa-bbfb675c767c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.235877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc001f-4b1c-4c8a-adfa-bbfb675c767c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.236974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc001f-4b1c-4c8a-adfa-bbfb675c767c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.238405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc001f-4b1c-4c8a-adfa-bbfb675c767c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:07.243195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc001f-4b1c-4c8a-adfa-bbfb675c767c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:07.292781 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2631/5238] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:07 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:07.296291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a7998-0bdb-400d-aeeb-8cc3da5f4ff7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:07.325079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a7998-0bdb-400d-aeeb-8cc3da5f4ff7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:07.336606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092160-8ad4-4c51-bb8a-ceb6f2aec812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:07.337977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092160-8ad4-4c51-bb8a-ceb6f2aec812 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.338432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092160-8ad4-4c51-bb8a-ceb6f2aec812 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.339009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092160-8ad4-4c51-bb8a-ceb6f2aec812 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.339922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092160-8ad4-4c51-bb8a-ceb6f2aec812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:07.341773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092160-8ad4-4c51-bb8a-ceb6f2aec812 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:07.362837 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2608/5239] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:07.363424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc001f-4b1c-4c8a-adfa-bbfb675c767c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:07.379148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc001f-4b1c-4c8a-adfa-bbfb675c767c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:07.403739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677693a-5789-4acc-be65-6a72cea8a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:07.405162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677693a-5789-4acc-be65-6a72cea8a8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.405318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677693a-5789-4acc-be65-6a72cea8a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.405679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677693a-5789-4acc-be65-6a72cea8a8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.407216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677693a-5789-4acc-be65-6a72cea8a8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:07.412577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677693a-5789-4acc-be65-6a72cea8a8c4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:07.455252 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2632/5240] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:07.456894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092160-8ad4-4c51-bb8a-ceb6f2aec812 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:07.470713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092160-8ad4-4c51-bb8a-ceb6f2aec812 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:07.496175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25f5ce-7a05-4175-ac0c-e31ef84321ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:07.497735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f5ce-7a05-4175-ac0c-e31ef84321ea admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.498209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f5ce-7a05-4175-ac0c-e31ef84321ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.498661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f5ce-7a05-4175-ac0c-e31ef84321ea admin admin] PATH_INFO: `/v3/projects/59621d85e5e543e9a722034f0798f241/users/16bcdb3d611c40668cb0b502168cc9e2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.530327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25f5ce-7a05-4175-ac0c-e31ef84321ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=59621d85e5e543e9a722034f0798f241, user_id=16bcdb3d611c40668cb0b502168cc9e2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:07.537428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25f5ce-7a05-4175-ac0c-e31ef84321ea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:07.570952 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2609/5241] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:07 2022] PUT /identity/v3/projects/59621d85e5e543e9a722034f0798f241/users/16bcdb3d611c40668cb0b502168cc9e2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:07.581669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa18d-0ecd-45b6-a1a8-77a48d1b4e1d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.582502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa18d-0ecd-45b6-a1a8-77a48d1b4e1d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.582822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa18d-0ecd-45b6-a1a8-77a48d1b4e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.638144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c72fa18d-0ecd-45b6-a1a8-77a48d1b4e1d None None] MFA Rules not processed for user `16bcdb3d611c40668cb0b502168cc9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:07.640695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c72fa18d-0ecd-45b6-a1a8-77a48d1b4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:07.797432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2633/5242] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:07.803746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25f5ce-7a05-4175-ac0c-e31ef84321ea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:07.845182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa18d-0ecd-45b6-a1a8-77a48d1b4e1d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:07.846747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c72fa18d-0ecd-45b6-a1a8-77a48d1b4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:07.907014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25f5ce-7a05-4175-ac0c-e31ef84321ea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:07.913941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf266-95de-45c6-a4f2-f06517f1a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:07.914691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf266-95de-45c6-a4f2-f06517f1a944 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.914998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf266-95de-45c6-a4f2-f06517f1a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.915464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf266-95de-45c6-a4f2-f06517f1a944 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.916376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf266-95de-45c6-a4f2-f06517f1a944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:07.918518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf266-95de-45c6-a4f2-f06517f1a944 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:07.944947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa18d-0ecd-45b6-a1a8-77a48d1b4e1d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:07.951487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:07.952495 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2610/5243] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:07 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:07.953464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:07.953759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:07.954092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:07.956610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:07.957692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf266-95de-45c6-a4f2-f06517f1a944 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:08.032672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf266-95de-45c6-a4f2-f06517f1a944 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:08.038582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:08.038846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9613c4e-f6cf-40ea-b88c-d8de5dbe4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:08.039537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613c4e-f6cf-40ea-b88c-d8de5dbe4080 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:08.039822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613c4e-f6cf-40ea-b88c-d8de5dbe4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:08.040168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613c4e-f6cf-40ea-b88c-d8de5dbe4080 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:08.041085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9613c4e-f6cf-40ea-b88c-d8de5dbe4080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:08.041428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:08.043083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9613c4e-f6cf-40ea-b88c-d8de5dbe4080 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:08.053415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2634/5244] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:08.068583 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2611/5245] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:07 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:08.073046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:08.084369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b810006-2f96-4870-9d77-a27d06fc3374 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:08.089320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcb6b8-c762-4394-902d-de18cca560ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:08.090001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcb6b8-c762-4394-902d-de18cca560ce admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:08.090313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcb6b8-c762-4394-902d-de18cca560ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:08.090595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcb6b8-c762-4394-902d-de18cca560ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:08.091324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcb6b8-c762-4394-902d-de18cca560ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:08.093081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcb6b8-c762-4394-902d-de18cca560ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:08.108382 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2635/5246] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:08.113095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9613c4e-f6cf-40ea-b88c-d8de5dbe4080 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:08.126171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9613c4e-f6cf-40ea-b88c-d8de5dbe4080 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:08.132010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d14bf-7b4e-472a-8027-a2fe0e200cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:08.132895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d14bf-7b4e-472a-8027-a2fe0e200cae admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:08.133182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d14bf-7b4e-472a-8027-a2fe0e200cae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:08.133466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d14bf-7b4e-472a-8027-a2fe0e200cae admin admin] PATH_INFO: `/v3/projects/97c64402f85a4cde892165cbd69a4010/users/0a6b650c9109416e9f8fcbc39d839f57/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:08.154312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d14bf-7b4e-472a-8027-a2fe0e200cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c64402f85a4cde892165cbd69a4010, user_id=0a6b650c9109416e9f8fcbc39d839f57, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:08.157866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d14bf-7b4e-472a-8027-a2fe0e200cae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:08.186681 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2612/5247] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:08 2022] PUT /identity/v3/projects/97c64402f85a4cde892165cbd69a4010/users/0a6b650c9109416e9f8fcbc39d839f57/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:08.192711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcb6b8-c762-4394-902d-de18cca560ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:08.210022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcb6b8-c762-4394-902d-de18cca560ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:08.305851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2afee-b733-48f6-bf5d-af3160c526ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:08.307542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2afee-b733-48f6-bf5d-af3160c526ba admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:08.307835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2afee-b733-48f6-bf5d-af3160c526ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:08.308210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2afee-b733-48f6-bf5d-af3160c526ba admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:08.309817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2afee-b733-48f6-bf5d-af3160c526ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:08.312746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2afee-b733-48f6-bf5d-af3160c526ba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:08.326494 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2636/5248] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:09:08.331179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d14bf-7b4e-472a-8027-a2fe0e200cae admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:08.351975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d14bf-7b4e-472a-8027-a2fe0e200cae admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:08.357961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50786-5b93-4149-b8ed-626106241920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:08.358767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50786-5b93-4149-b8ed-626106241920 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:08.359048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50786-5b93-4149-b8ed-626106241920 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:08.359396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50786-5b93-4149-b8ed-626106241920 admin admin] PATH_INFO: `/v3/projects/97c64402f85a4cde892165cbd69a4010/users/0a6b650c9109416e9f8fcbc39d839f57/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:08.361550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50786-5b93-4149-b8ed-626106241920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c64402f85a4cde892165cbd69a4010, user_id=0a6b650c9109416e9f8fcbc39d839f57, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:08.365746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50786-5b93-4149-b8ed-626106241920 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:08.379172 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2613/5249] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:08 2022] PUT /identity/v3/projects/97c64402f85a4cde892165cbd69a4010/users/0a6b650c9109416e9f8fcbc39d839f57/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:08.390861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f228-9ebd-4654-a084-25486141b8e8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:08.391168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f228-9ebd-4654-a084-25486141b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:08.391422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f228-9ebd-4654-a084-25486141b8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:08.444624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d546f228-9ebd-4654-a084-25486141b8e8 None None] MFA Rules not processed for user `0a6b650c9109416e9f8fcbc39d839f57`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:08.446067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d546f228-9ebd-4654-a084-25486141b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:08.599476 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2637/5250] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:08.611732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50786-5b93-4149-b8ed-626106241920 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:08.686878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50786-5b93-4149-b8ed-626106241920 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:08.704042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cb644-9c15-4e7f-a9c1-479400902bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:08.705231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb644-9c15-4e7f-a9c1-479400902bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:08.705528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb644-9c15-4e7f-a9c1-479400902bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:08.706653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb644-9c15-4e7f-a9c1-479400902bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:08.722504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb644-9c15-4e7f-a9c1-479400902bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:08.724751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb644-9c15-4e7f-a9c1-479400902bd2 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:08.737285 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2614/5251] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:08.814834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f228-9ebd-4654-a084-25486141b8e8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:08.952263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f228-9ebd-4654-a084-25486141b8e8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:08.957651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:08.959247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:08.959247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:08.959247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] PATH_INFO: `/v3/users/16bcdb3d611c40668cb0b502168cc9e2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:08.960861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16bcdb3d611c40668cb0b502168cc9e2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:08.963135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:09.033629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16bcdb3d611c40668cb0b502168cc9e2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.049042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16bcdb3d611c40668cb0b502168cc9e2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.062743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16bcdb3d611c40668cb0b502168cc9e2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.063457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16bcdb3d611c40668cb0b502168cc9e2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.064313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16bcdb3d611c40668cb0b502168cc9e2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.104679 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2638/5252] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:08 2022] DELETE /identity/v3/users/16bcdb3d611c40668cb0b502168cc9e2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:09.110847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4882f0d-22e5-4f20-a5e6-72e375572c69 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:09.111399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4882f0d-22e5-4f20-a5e6-72e375572c69 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:09.111399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4882f0d-22e5-4f20-a5e6-72e375572c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:09.152956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f4882f0d-22e5-4f20-a5e6-72e375572c69 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:09.155817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f4882f0d-22e5-4f20-a5e6-72e375572c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:09.251642 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2615/5253] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:09.261636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:09.264078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:09.346248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c5875-e39e-4f11-860c-ee61015ba531 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:09.350681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd42279-5010-4c28-94f0-b01d2ec94e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:09.351432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd42279-5010-4c28-94f0-b01d2ec94e15 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:09.351778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd42279-5010-4c28-94f0-b01d2ec94e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:09.352153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd42279-5010-4c28-94f0-b01d2ec94e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:09.362451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd42279-5010-4c28-94f0-b01d2ec94e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:09.363753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd42279-5010-4c28-94f0-b01d2ec94e15 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:09.374644 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2639/5254] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:09.786817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4882f0d-22e5-4f20-a5e6-72e375572c69 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:09.788501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f4882f0d-22e5-4f20-a5e6-72e375572c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:09.803812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4882f0d-22e5-4f20-a5e6-72e375572c69 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:09.810482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:09.811694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:09.812146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:09.812636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] PATH_INFO: `/v3/projects/59621d85e5e543e9a722034f0798f241` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:09.816303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59621d85e5e543e9a722034f0798f241)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:09.819703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:09.889590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59621d85e5e543e9a722034f0798f241', 'request_id': 'req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.895282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59621d85e5e543e9a722034f0798f241', 'request_id': 'req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.902753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59621d85e5e543e9a722034f0798f241', 'request_id': 'req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.914955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] The token cache is being invalidate because project 59621d85e5e543e9a722034f0798f241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:09.915250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.915911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:09.917790 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2616/5255] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:09 2022] DELETE /identity/v3/projects/59621d85e5e543e9a722034f0798f241 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:09.923027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd42279-5010-4c28-94f0-b01d2ec94e15 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:09.933672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd42279-5010-4c28-94f0-b01d2ec94e15 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:09.992933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:09.993817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:09.994103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:09.994382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] PATH_INFO: `/v3/users/0a6b650c9109416e9f8fcbc39d839f57` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:09.995598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6b650c9109416e9f8fcbc39d839f57)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:09.997554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:10.044563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6b650c9109416e9f8fcbc39d839f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.056770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6b650c9109416e9f8fcbc39d839f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.064144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6b650c9109416e9f8fcbc39d839f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.064834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6b650c9109416e9f8fcbc39d839f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.065474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5576a6b-bc4d-4c1f-afca-154a2c760971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6b650c9109416e9f8fcbc39d839f57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.078962 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2640/5256] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:09 2022] DELETE /identity/v3/users/0a6b650c9109416e9f8fcbc39d839f57 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:10.451788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:10.454250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:10.471302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e5295-4bf9-4f8b-81dc-1b3f24ffc95c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:10.596225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:10.597238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:10.597584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:10.598015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] PATH_INFO: `/v3/projects/97c64402f85a4cde892165cbd69a4010` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:10.600250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c64402f85a4cde892165cbd69a4010)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:10.602625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:10.662795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c64402f85a4cde892165cbd69a4010', 'request_id': 'req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.670796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c64402f85a4cde892165cbd69a4010', 'request_id': 'req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.682721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c64402f85a4cde892165cbd69a4010', 'request_id': 'req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.697514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] The token cache is being invalidate because project 97c64402f85a4cde892165cbd69a4010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:10.697824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.698717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-994ede26-fe95-482e-9f36-5bf0c0ffa4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:10.704246 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2617/5257] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:10 2022] DELETE /identity/v3/projects/97c64402f85a4cde892165cbd69a4010 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:10.706794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7a25-b09e-442a-ae31-a154925926c2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:10.707452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7a25-b09e-442a-ae31-a154925926c2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:10.711236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7a25-b09e-442a-ae31-a154925926c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:10.741613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-66ac7a25-b09e-442a-ae31-a154925926c2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:10.744575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-66ac7a25-b09e-442a-ae31-a154925926c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:10.838223 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2641/5258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:10.846436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b98c-d6f7-4215-bbae-91caa1e54093 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:10.846883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b98c-d6f7-4215-bbae-91caa1e54093 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:10.847281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b98c-d6f7-4215-bbae-91caa1e54093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:10.875633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fa56b98c-d6f7-4215-bbae-91caa1e54093 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:10.886345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa56b98c-d6f7-4215-bbae-91caa1e54093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:10.910789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac7a25-b09e-442a-ae31-a154925926c2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:10.916508 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2618/5259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:10.924078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac7a25-b09e-442a-ae31-a154925926c2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:10.931325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:10.932301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:10.932898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:10.933640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:10.934454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:10.934837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:10.936960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:10.957233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b98c-d6f7-4215-bbae-91caa1e54093 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:10.960468 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2642/5260] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:10.968596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b98c-d6f7-4215-bbae-91caa1e54093 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:10.973904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e05c0-9889-4214-bd7e-5d73baf1d682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:10.975945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e05c0-9889-4214-bd7e-5d73baf1d682 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:10.976495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e05c0-9889-4214-bd7e-5d73baf1d682 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:10.976686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e05c0-9889-4214-bd7e-5d73baf1d682 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:10.977368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e05c0-9889-4214-bd7e-5d73baf1d682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:10.979824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e05c0-9889-4214-bd7e-5d73baf1d682 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.020276 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2619/5261] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:10 2022] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:11.026750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:11.043961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef83a4-9e20-4acb-b3db-4454b95bb00b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:11.156085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e1dd1-d683-4a8c-8d2e-70beceab4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:11.156873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1dd1-d683-4a8c-8d2e-70beceab4cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.157295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1dd1-d683-4a8c-8d2e-70beceab4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.157599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1dd1-d683-4a8c-8d2e-70beceab4cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.158318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e1dd1-d683-4a8c-8d2e-70beceab4cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:11.160671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e1dd1-d683-4a8c-8d2e-70beceab4cd6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.185583 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2643/5262] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:11 2022] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:11.190226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e05c0-9889-4214-bd7e-5d73baf1d682 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:11.213870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e05c0-9889-4214-bd7e-5d73baf1d682 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:11.219405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310ba4-9267-4658-903b-ea5ef96d6355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:11.220160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310ba4-9267-4658-903b-ea5ef96d6355 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.220493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310ba4-9267-4658-903b-ea5ef96d6355 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.220812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310ba4-9267-4658-903b-ea5ef96d6355 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.221577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04310ba4-9267-4658-903b-ea5ef96d6355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:11.223252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04310ba4-9267-4658-903b-ea5ef96d6355 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.238474 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2620/5263] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:11.239502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e1dd1-d683-4a8c-8d2e-70beceab4cd6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:11.253086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e1dd1-d683-4a8c-8d2e-70beceab4cd6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:11.258792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c3530-f8e4-443b-82f7-91dc0fca9d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:11.259484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c3530-f8e4-443b-82f7-91dc0fca9d54 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.259790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c3530-f8e4-443b-82f7-91dc0fca9d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.260074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c3530-f8e4-443b-82f7-91dc0fca9d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.260855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c3530-f8e4-443b-82f7-91dc0fca9d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:11.262475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c3530-f8e4-443b-82f7-91dc0fca9d54 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.274996 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2644/5264] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:09:11.279318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310ba4-9267-4658-903b-ea5ef96d6355 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:11.290907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310ba4-9267-4658-903b-ea5ef96d6355 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:11.297608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56053ac0-e5f3-4ec0-9f88-19a57faf8b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:11.298703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053ac0-e5f3-4ec0-9f88-19a57faf8b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.299057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053ac0-e5f3-4ec0-9f88-19a57faf8b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.299391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053ac0-e5f3-4ec0-9f88-19a57faf8b46 admin admin] PATH_INFO: `/v3/projects/d7a9695bfcbf4ba2bb0e81f060f0a4e2/users/74e8119404b84d46a857e43d1e2567d2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.318548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56053ac0-e5f3-4ec0-9f88-19a57faf8b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9695bfcbf4ba2bb0e81f060f0a4e2, user_id=74e8119404b84d46a857e43d1e2567d2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:11.321601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56053ac0-e5f3-4ec0-9f88-19a57faf8b46 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.341714 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2621/5265] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:11 2022] PUT /identity/v3/projects/d7a9695bfcbf4ba2bb0e81f060f0a4e2/users/74e8119404b84d46a857e43d1e2567d2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:11.353168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63cfc7-7068-4d5f-a960-8c64bede4179 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.353500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63cfc7-7068-4d5f-a960-8c64bede4179 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.353725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63cfc7-7068-4d5f-a960-8c64bede4179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.384797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-de63cfc7-7068-4d5f-a960-8c64bede4179 None None] MFA Rules not processed for user `74e8119404b84d46a857e43d1e2567d2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:11.386385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de63cfc7-7068-4d5f-a960-8c64bede4179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:11.540003 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2645/5266] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:11.545352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56053ac0-e5f3-4ec0-9f88-19a57faf8b46 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:11.623760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56053ac0-e5f3-4ec0-9f88-19a57faf8b46 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:11.629988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92797f8b-ab64-4eb7-913f-f66d2f44cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:11.630865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797f8b-ab64-4eb7-913f-f66d2f44cb88 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.631191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797f8b-ab64-4eb7-913f-f66d2f44cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.631475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797f8b-ab64-4eb7-913f-f66d2f44cb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.632223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92797f8b-ab64-4eb7-913f-f66d2f44cb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:11.634310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92797f8b-ab64-4eb7-913f-f66d2f44cb88 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.668984 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2622/5267] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:11 2022] POST /identity/v3/projects => generated 399 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:11.673936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63cfc7-7068-4d5f-a960-8c64bede4179 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:11.691284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63cfc7-7068-4d5f-a960-8c64bede4179 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:11.823957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1604e3a-b8be-42f2-9622-307a99233ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:11.825173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1604e3a-b8be-42f2-9622-307a99233ade admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.825586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1604e3a-b8be-42f2-9622-307a99233ade admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.825891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1604e3a-b8be-42f2-9622-307a99233ade admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.826736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1604e3a-b8be-42f2-9622-307a99233ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:11.829029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1604e3a-b8be-42f2-9622-307a99233ade admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.865231 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2646/5268] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:11 2022] POST /identity/v3/users => generated 306 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:11.867122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92797f8b-ab64-4eb7-913f-f66d2f44cb88 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:11.886976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92797f8b-ab64-4eb7-913f-f66d2f44cb88 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:11.894783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7db69-d7d7-45e0-931c-5b1b59337285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:11.895515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7db69-d7d7-45e0-931c-5b1b59337285 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.896705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7db69-d7d7-45e0-931c-5b1b59337285 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.897175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7db69-d7d7-45e0-931c-5b1b59337285 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.898154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7db69-d7d7-45e0-931c-5b1b59337285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:11.899828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7db69-d7d7-45e0-931c-5b1b59337285 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.912689 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2623/5269] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:09:11.917533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1604e3a-b8be-42f2-9622-307a99233ade admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:11.933125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1604e3a-b8be-42f2-9622-307a99233ade admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:11.943934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b523-3652-4080-bdaa-88274c9d787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:11.945098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b523-3652-4080-bdaa-88274c9d787d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:11.945402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b523-3652-4080-bdaa-88274c9d787d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:11.945664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b523-3652-4080-bdaa-88274c9d787d admin admin] PATH_INFO: `/v3/projects/01134b64d40b49b4b5603308b7237b96/users/16228ab197a34fe1a4f073a945394562/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:11.973864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632b523-3652-4080-bdaa-88274c9d787d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01134b64d40b49b4b5603308b7237b96, user_id=16228ab197a34fe1a4f073a945394562, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:11.980404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632b523-3652-4080-bdaa-88274c9d787d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:11.999508 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2647/5270] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:11 2022] PUT /identity/v3/projects/01134b64d40b49b4b5603308b7237b96/users/16228ab197a34fe1a4f073a945394562/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:12.004128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7db69-d7d7-45e0-931c-5b1b59337285 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:12.016098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7db69-d7d7-45e0-931c-5b1b59337285 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:12.092900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2355a-8b9b-46a9-8c6f-353fa83b014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:12.093663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2355a-8b9b-46a9-8c6f-353fa83b014d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:12.094058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2355a-8b9b-46a9-8c6f-353fa83b014d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:12.094285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2355a-8b9b-46a9-8c6f-353fa83b014d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:12.095041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2355a-8b9b-46a9-8c6f-353fa83b014d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:12.096815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2355a-8b9b-46a9-8c6f-353fa83b014d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:12.108463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2624/5271] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:12.117601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b523-3652-4080-bdaa-88274c9d787d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:12.132763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b523-3652-4080-bdaa-88274c9d787d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:12.139049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:12.140137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:12.140539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:12.141107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] PATH_INFO: `/v3/projects/01134b64d40b49b4b5603308b7237b96/users/16228ab197a34fe1a4f073a945394562/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:12.143415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01134b64d40b49b4b5603308b7237b96, user_id=16228ab197a34fe1a4f073a945394562, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:12.147257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:12.165436 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2648/5272] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:12 2022] PUT /identity/v3/projects/01134b64d40b49b4b5603308b7237b96/users/16228ab197a34fe1a4f073a945394562/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:12.186898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda779-83e5-43f6-b453-078db6d19d38 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:12.187206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda779-83e5-43f6-b453-078db6d19d38 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:12.187505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda779-83e5-43f6-b453-078db6d19d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:12.219477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eecda779-83e5-43f6-b453-078db6d19d38 None None] MFA Rules not processed for user `16228ab197a34fe1a4f073a945394562`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:12.221260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eecda779-83e5-43f6-b453-078db6d19d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:12.310512 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2625/5273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:12.322352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:12.324253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:12.390316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca434-8aee-4167-b3fc-150f7fb3ee68 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:12.394231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43ab69-30c8-44ad-9cfa-c6899ccc0178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:12.394932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ab69-30c8-44ad-9cfa-c6899ccc0178 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:12.395214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ab69-30c8-44ad-9cfa-c6899ccc0178 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:12.395491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ab69-30c8-44ad-9cfa-c6899ccc0178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:12.406115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43ab69-30c8-44ad-9cfa-c6899ccc0178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:12.407558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43ab69-30c8-44ad-9cfa-c6899ccc0178 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:12.418937 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2649/5274] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:12.496877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecda779-83e5-43f6-b453-078db6d19d38 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:12.506297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42e116-0d08-4f4f-8c94-3d4c311bbdd1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:12.506837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42e116-0d08-4f4f-8c94-3d4c311bbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:12.507126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42e116-0d08-4f4f-8c94-3d4c311bbdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:12.509090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecda779-83e5-43f6-b453-078db6d19d38 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:12.512658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396156f5-4055-4581-ba36-a71783d0c8f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:12.513299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396156f5-4055-4581-ba36-a71783d0c8f7 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:12.513579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396156f5-4055-4581-ba36-a71783d0c8f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:12.513853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396156f5-4055-4581-ba36-a71783d0c8f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:12.527213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4b42e116-0d08-4f4f-8c94-3d4c311bbdd1 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:12.528370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4b42e116-0d08-4f4f-8c94-3d4c311bbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:12.604891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396156f5-4055-4581-ba36-a71783d0c8f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:12.606714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396156f5-4055-4581-ba36-a71783d0c8f7 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:12.610594 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2650/5275] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:12.620142 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2626/5276] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:12.626425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42e116-0d08-4f4f-8c94-3d4c311bbdd1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:12.628748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4b42e116-0d08-4f4f-8c94-3d4c311bbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:12.738108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42e116-0d08-4f4f-8c94-3d4c311bbdd1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:12.745518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072b4d2-2de4-4f36-a71c-d43cbe0b2500 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:12.746219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072b4d2-2de4-4f36-a71c-d43cbe0b2500 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:12.746637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072b4d2-2de4-4f36-a71c-d43cbe0b2500 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:12.747039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072b4d2-2de4-4f36-a71c-d43cbe0b2500 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:12.758441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072b4d2-2de4-4f36-a71c-d43cbe0b2500 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:12.760405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072b4d2-2de4-4f36-a71c-d43cbe0b2500 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:12.777817 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2651/5277] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:14.717076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159857c2-e0b9-4a49-a8a2-5317e181c63a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:14.719575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159857c2-e0b9-4a49-a8a2-5317e181c63a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:14.719575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159857c2-e0b9-4a49-a8a2-5317e181c63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:14.741841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-159857c2-e0b9-4a49-a8a2-5317e181c63a None None] MFA Rules not processed for user `20246495a35b4762be5b2ad98f537377`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:14.743112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-159857c2-e0b9-4a49-a8a2-5317e181c63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:14.852007 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2627/5278] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:16.932549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d29c-98e2-4756-a181-6fae652fd886 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:16.933477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d29c-98e2-4756-a181-6fae652fd886 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:16.933934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d29c-98e2-4756-a181-6fae652fd886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:16.956050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8435d29c-98e2-4756-a181-6fae652fd886 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:16.959057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8435d29c-98e2-4756-a181-6fae652fd886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:16.972293 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2652/5279] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:16.999222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159857c2-e0b9-4a49-a8a2-5317e181c63a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:17.028708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159857c2-e0b9-4a49-a8a2-5317e181c63a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:17.043874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:17.050081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:17.050444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:17.050750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:17.077228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:17.079000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:17.091635 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2628/5280] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:17.289826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435d29c-98e2-4756-a181-6fae652fd886 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:17.459193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435d29c-98e2-4756-a181-6fae652fd886 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:17.466326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:17.468469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:17.470035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:17.470035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] PATH_INFO: `/v3/users/74e8119404b84d46a857e43d1e2567d2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:17.471069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e8119404b84d46a857e43d1e2567d2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:17.477005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:17.607265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e8119404b84d46a857e43d1e2567d2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:17.628221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e8119404b84d46a857e43d1e2567d2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:17.641542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e8119404b84d46a857e43d1e2567d2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:17.642418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e8119404b84d46a857e43d1e2567d2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:17.642568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:17.644174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d51d6cf1-13c4-4878-a105-9f7ef8c98966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e8119404b84d46a857e43d1e2567d2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:17.644465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:17.675239 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2653/5281] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:17 2022] DELETE /identity/v3/users/74e8119404b84d46a857e43d1e2567d2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:17.677300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123858-f9a0-43b1-bda0-1702b1a64328 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:17.682170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123858-f9a0-43b1-bda0-1702b1a64328 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:17.682799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123858-f9a0-43b1-bda0-1702b1a64328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:17.732973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-37123858-f9a0-43b1-bda0-1702b1a64328 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:17.734201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37123858-f9a0-43b1-bda0-1702b1a64328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:17.795664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01022a1-660b-4fb5-9b58-5c7b58bb9149 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:17.836083 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2654/5282] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:17.849361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37123858-f9a0-43b1-bda0-1702b1a64328 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:17.850757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37123858-f9a0-43b1-bda0-1702b1a64328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:17.911258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:17.912518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:17.912895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:17.913211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:17.915618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:17.932733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37123858-f9a0-43b1-bda0-1702b1a64328 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:17.937590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:17.938353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:17.938706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:17.939087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:17.953350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:17.954950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:17.982987 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2655/5283] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:18.023690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:18.026779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:18.052812 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2629/5284] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:18.353000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:18.354999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:18.374361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2624a5-aa62-409a-9ce1-bd50de2cc13d service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:18.381703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:18.383419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:18.384495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:18.384769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] PATH_INFO: `/v3/projects/d7a9695bfcbf4ba2bb0e81f060f0a4e2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:18.386594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a9695bfcbf4ba2bb0e81f060f0a4e2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:18.389968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:18.532432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a9695bfcbf4ba2bb0e81f060f0a4e2', 'request_id': 'req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.545506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a9695bfcbf4ba2bb0e81f060f0a4e2', 'request_id': 'req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.566867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a9695bfcbf4ba2bb0e81f060f0a4e2', 'request_id': 'req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.587566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] The token cache is being invalidate because project d7a9695bfcbf4ba2bb0e81f060f0a4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:18.588138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.589113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.595454 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2656/5285] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:18 2022] DELETE /identity/v3/projects/d7a9695bfcbf4ba2bb0e81f060f0a4e2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:18.595631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:18.611448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f33ccf-5754-4eda-80a4-7715706ee5ba service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:18.719997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:18.726296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:18.727152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:18.727699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] PATH_INFO: `/v3/users/16228ab197a34fe1a4f073a945394562` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:18.738584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16228ab197a34fe1a4f073a945394562)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:18.743361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:18.889525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16228ab197a34fe1a4f073a945394562'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.890244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16228ab197a34fe1a4f073a945394562'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.890958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16228ab197a34fe1a4f073a945394562'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.926238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16228ab197a34fe1a4f073a945394562'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.953435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fb36dea7-6995-4973-a840-88548b25882a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16228ab197a34fe1a4f073a945394562'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:18.978723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2630/5286] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:18 2022] DELETE /identity/v3/users/16228ab197a34fe1a4f073a945394562 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:19.937678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:19.939207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:19.960471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9adcd4-08f6-4960-9ed2-dd84fd41daca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:20.061834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:20.062961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.063508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.063824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] PATH_INFO: `/v3/projects/01134b64d40b49b4b5603308b7237b96` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.065198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01134b64d40b49b4b5603308b7237b96)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:20.068895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:20.148967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01134b64d40b49b4b5603308b7237b96', 'request_id': 'req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:20.155750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01134b64d40b49b4b5603308b7237b96', 'request_id': 'req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:20.167386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01134b64d40b49b4b5603308b7237b96', 'request_id': 'req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:20.182269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] The token cache is being invalidate because project 01134b64d40b49b4b5603308b7237b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:20.182611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:20.183547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-662fdc65-2ab8-4d64-b8d0-955bd7ba9309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:20.185298 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2657/5287] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:19 2022] DELETE /identity/v3/projects/01134b64d40b49b4b5603308b7237b96 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:20.190232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1038c-be33-44d2-ac87-d419749303df None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.190732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1038c-be33-44d2-ac87-d419749303df None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.190849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1038c-be33-44d2-ac87-d419749303df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.231304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b8a1038c-be33-44d2-ac87-d419749303df None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:20.234060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b8a1038c-be33-44d2-ac87-d419749303df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:20.321160 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2631/5288] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:20.330530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b971524-520c-4c91-b306-ce33a884f62d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.330826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b971524-520c-4c91-b306-ce33a884f62d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.331217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b971524-520c-4c91-b306-ce33a884f62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.355316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8b971524-520c-4c91-b306-ce33a884f62d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:20.356658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b971524-520c-4c91-b306-ce33a884f62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:20.387839 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2658/5289] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:20.391852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1038c-be33-44d2-ac87-d419749303df None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:20.412707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1038c-be33-44d2-ac87-d419749303df None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:20.424953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:20.426432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.428223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.430805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.431755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:20.432287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:20.435674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:20.466190 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2632/5290] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:09:20.472132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b971524-520c-4c91-b306-ce33a884f62d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:20.490981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b971524-520c-4c91-b306-ce33a884f62d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:20.501930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54b72-bb80-442a-856f-d9efac195956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:20.503069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54b72-bb80-442a-856f-d9efac195956 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.503558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54b72-bb80-442a-856f-d9efac195956 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.504052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54b72-bb80-442a-856f-d9efac195956 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.506130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54b72-bb80-442a-856f-d9efac195956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:20.510213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54b72-bb80-442a-856f-d9efac195956 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:20.577524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2659/5291] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:20 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:20.580251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:20.599561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc6afe-b2b0-45c1-87a3-d7b6b1a89439 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:20.679708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142c5b2-3c9b-44e3-86bd-36057a698155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:20.680572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142c5b2-3c9b-44e3-86bd-36057a698155 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.680994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142c5b2-3c9b-44e3-86bd-36057a698155 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.681365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142c5b2-3c9b-44e3-86bd-36057a698155 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.682336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142c5b2-3c9b-44e3-86bd-36057a698155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:20.684638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142c5b2-3c9b-44e3-86bd-36057a698155 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:20.721825 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2633/5292] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:20 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:20.734637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54b72-bb80-442a-856f-d9efac195956 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:20.748995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54b72-bb80-442a-856f-d9efac195956 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:20.758920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3816a3-af4d-444e-a0a2-f0edac78d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:20.769639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3816a3-af4d-444e-a0a2-f0edac78d038 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.770173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3816a3-af4d-444e-a0a2-f0edac78d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.770695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3816a3-af4d-444e-a0a2-f0edac78d038 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.771664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3816a3-af4d-444e-a0a2-f0edac78d038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:20.775493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3816a3-af4d-444e-a0a2-f0edac78d038 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:20.794407 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2660/5293] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:20.801402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142c5b2-3c9b-44e3-86bd-36057a698155 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:20.815878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142c5b2-3c9b-44e3-86bd-36057a698155 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:20.824015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dccf62-557b-4d3d-a83a-0180f797cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:20.825425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccf62-557b-4d3d-a83a-0180f797cf88 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.825896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccf62-557b-4d3d-a83a-0180f797cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.826321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccf62-557b-4d3d-a83a-0180f797cf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.827353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dccf62-557b-4d3d-a83a-0180f797cf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:20.830581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dccf62-557b-4d3d-a83a-0180f797cf88 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:20.849474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3816a3-af4d-444e-a0a2-f0edac78d038 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:20.849945 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2634/5294] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:20.885162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3816a3-af4d-444e-a0a2-f0edac78d038 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:20.894841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacadfd-e66d-47ff-96b8-72d372e08d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:20.896175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacadfd-e66d-47ff-96b8-72d372e08d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.897003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacadfd-e66d-47ff-96b8-72d372e08d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.897448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacadfd-e66d-47ff-96b8-72d372e08d6b admin admin] PATH_INFO: `/v3/projects/5ce9d03199e64e2799ddd19f55656c67/users/0b1d9afaf3d64a79be5bc9ec73a8ebec/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.924696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacadfd-e66d-47ff-96b8-72d372e08d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce9d03199e64e2799ddd19f55656c67, user_id=0b1d9afaf3d64a79be5bc9ec73a8ebec, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:20.927754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacadfd-e66d-47ff-96b8-72d372e08d6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:20.954513 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2661/5295] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:20 2022] PUT /identity/v3/projects/5ce9d03199e64e2799ddd19f55656c67/users/0b1d9afaf3d64a79be5bc9ec73a8ebec/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:20.966106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a96c1-bf5f-439e-819d-6ce1bc45dc95 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:20.966398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a96c1-bf5f-439e-819d-6ce1bc45dc95 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:20.966671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a96c1-bf5f-439e-819d-6ce1bc45dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:20.999381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-722a96c1-bf5f-439e-819d-6ce1bc45dc95 None None] MFA Rules not processed for user `0b1d9afaf3d64a79be5bc9ec73a8ebec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:21.003540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-722a96c1-bf5f-439e-819d-6ce1bc45dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:21.116661 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2635/5296] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:21.121441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacadfd-e66d-47ff-96b8-72d372e08d6b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:21.258279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacadfd-e66d-47ff-96b8-72d372e08d6b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:21.266889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07180342-6235-42b7-8afd-ee173a4d0ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:21.267834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180342-6235-42b7-8afd-ee173a4d0ada admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:21.268901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180342-6235-42b7-8afd-ee173a4d0ada admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:21.269605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180342-6235-42b7-8afd-ee173a4d0ada admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:21.270582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07180342-6235-42b7-8afd-ee173a4d0ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:21.274438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07180342-6235-42b7-8afd-ee173a4d0ada admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:21.312389 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2662/5297] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:21 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:21.316110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a96c1-bf5f-439e-819d-6ce1bc45dc95 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:21.334653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a96c1-bf5f-439e-819d-6ce1bc45dc95 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:21.440787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390873-5f57-4b0d-a0f7-2eec208cc762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:21.441864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390873-5f57-4b0d-a0f7-2eec208cc762 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:21.442174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390873-5f57-4b0d-a0f7-2eec208cc762 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:21.442474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390873-5f57-4b0d-a0f7-2eec208cc762 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:21.444043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75390873-5f57-4b0d-a0f7-2eec208cc762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:21.446282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75390873-5f57-4b0d-a0f7-2eec208cc762 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:21.479362 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2636/5298] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:21 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:21.485058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07180342-6235-42b7-8afd-ee173a4d0ada admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:21.500521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07180342-6235-42b7-8afd-ee173a4d0ada admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:21.506300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cebfe8-e8d1-448e-9e8b-afe9220a16ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:21.506965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cebfe8-e8d1-448e-9e8b-afe9220a16ed admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:21.507305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cebfe8-e8d1-448e-9e8b-afe9220a16ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:21.507525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cebfe8-e8d1-448e-9e8b-afe9220a16ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:21.508243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cebfe8-e8d1-448e-9e8b-afe9220a16ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:21.510383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cebfe8-e8d1-448e-9e8b-afe9220a16ed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:21.523430 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2663/5299] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:21.527785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390873-5f57-4b0d-a0f7-2eec208cc762 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:21.540881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390873-5f57-4b0d-a0f7-2eec208cc762 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:21.546646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87e77c-383c-416d-8e6e-38048f12d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:21.547583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87e77c-383c-416d-8e6e-38048f12d337 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:21.547926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87e77c-383c-416d-8e6e-38048f12d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:21.548275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87e77c-383c-416d-8e6e-38048f12d337 admin admin] PATH_INFO: `/v3/projects/03c92aec5dfc489f9b64de9d8e6b3eac/users/8a0b47faa1e14092a4a22baf8a5726ca/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:21.569375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87e77c-383c-416d-8e6e-38048f12d337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c92aec5dfc489f9b64de9d8e6b3eac, user_id=8a0b47faa1e14092a4a22baf8a5726ca, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:21.572265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87e77c-383c-416d-8e6e-38048f12d337 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:21.588483 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2637/5300] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:21 2022] PUT /identity/v3/projects/03c92aec5dfc489f9b64de9d8e6b3eac/users/8a0b47faa1e14092a4a22baf8a5726ca/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:21.592441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cebfe8-e8d1-448e-9e8b-afe9220a16ed admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:21.606694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cebfe8-e8d1-448e-9e8b-afe9220a16ed admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:21.689635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72941bd1-dc26-4ee6-b678-91c263ad02b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:21.691787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72941bd1-dc26-4ee6-b678-91c263ad02b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:21.692101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72941bd1-dc26-4ee6-b678-91c263ad02b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:21.692470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72941bd1-dc26-4ee6-b678-91c263ad02b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:21.693349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72941bd1-dc26-4ee6-b678-91c263ad02b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:21.694957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72941bd1-dc26-4ee6-b678-91c263ad02b4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:21.709592 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2664/5301] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:21.713770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87e77c-383c-416d-8e6e-38048f12d337 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:21.732415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87e77c-383c-416d-8e6e-38048f12d337 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:21.733058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:21.734542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:21.734929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:21.735332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] PATH_INFO: `/v3/projects/03c92aec5dfc489f9b64de9d8e6b3eac/users/8a0b47faa1e14092a4a22baf8a5726ca/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:21.738290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c92aec5dfc489f9b64de9d8e6b3eac, user_id=8a0b47faa1e14092a4a22baf8a5726ca, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:21.742242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:21.756369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2638/5302] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:21 2022] PUT /identity/v3/projects/03c92aec5dfc489f9b64de9d8e6b3eac/users/8a0b47faa1e14092a4a22baf8a5726ca/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:21.783122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a68c9-cdcd-436b-8bd6-dfd485d5efde None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:21.783468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a68c9-cdcd-436b-8bd6-dfd485d5efde None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:21.783721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a68c9-cdcd-436b-8bd6-dfd485d5efde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:21.823853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-778a68c9-cdcd-436b-8bd6-dfd485d5efde None None] MFA Rules not processed for user `8a0b47faa1e14092a4a22baf8a5726ca`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:21.825852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-778a68c9-cdcd-436b-8bd6-dfd485d5efde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:21.980238 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2665/5303] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:21.995502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:21.997806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:22.090793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72b710-736b-427f-b0e6-938303dcd55e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:22.096499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bdc5d-ed08-4338-8818-fd16bae52b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:22.097814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bdc5d-ed08-4338-8818-fd16bae52b7a service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:22.098223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bdc5d-ed08-4338-8818-fd16bae52b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:22.100577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bdc5d-ed08-4338-8818-fd16bae52b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:22.119001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bdc5d-ed08-4338-8818-fd16bae52b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:22.120883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bdc5d-ed08-4338-8818-fd16bae52b7a service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:22.151804 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2639/5304] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:22.406181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a68c9-cdcd-436b-8bd6-dfd485d5efde None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:22.576426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a68c9-cdcd-436b-8bd6-dfd485d5efde None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:22.583497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:22.585199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:22.585764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:22.586295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] PATH_INFO: `/v3/users/0b1d9afaf3d64a79be5bc9ec73a8ebec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:22.587980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1d9afaf3d64a79be5bc9ec73a8ebec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:22.590316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:22.689189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1d9afaf3d64a79be5bc9ec73a8ebec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:22.711423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1d9afaf3d64a79be5bc9ec73a8ebec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:22.737771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1d9afaf3d64a79be5bc9ec73a8ebec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:22.740979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1d9afaf3d64a79be5bc9ec73a8ebec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:22.743255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1d9afaf3d64a79be5bc9ec73a8ebec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:22.769598 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2666/5305] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:22 2022] DELETE /identity/v3/users/0b1d9afaf3d64a79be5bc9ec73a8ebec => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:22.774398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4fc11-ccfe-4dad-9846-422456f2f536 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:22.780709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4fc11-ccfe-4dad-9846-422456f2f536 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:22.781572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4fc11-ccfe-4dad-9846-422456f2f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:22.809198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-74b4fc11-ccfe-4dad-9846-422456f2f536 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:22.810623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-74b4fc11-ccfe-4dad-9846-422456f2f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:22.918014 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2640/5306] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:22.937947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:22.939801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:23.043296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1c88b-da7e-402d-84f9-c9125d84cb4a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:23.049723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d279b-aff9-4472-ae18-64da9c026ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:23.050767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d279b-aff9-4472-ae18-64da9c026ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:23.051264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d279b-aff9-4472-ae18-64da9c026ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:23.052443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d279b-aff9-4472-ae18-64da9c026ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:23.064320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d279b-aff9-4472-ae18-64da9c026ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:23.066334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d279b-aff9-4472-ae18-64da9c026ce1 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:23.081571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2667/5307] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:23.480129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4fc11-ccfe-4dad-9846-422456f2f536 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:23.482098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-74b4fc11-ccfe-4dad-9846-422456f2f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:23.497371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4fc11-ccfe-4dad-9846-422456f2f536 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:23.503155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:23.504112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:23.504358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:23.504610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] PATH_INFO: `/v3/projects/5ce9d03199e64e2799ddd19f55656c67` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:23.506915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce9d03199e64e2799ddd19f55656c67)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:23.508877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:23.572169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce9d03199e64e2799ddd19f55656c67', 'request_id': 'req-05c5711e-7ff2-4942-a833-6b1d6d8bf359'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.581020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce9d03199e64e2799ddd19f55656c67', 'request_id': 'req-05c5711e-7ff2-4942-a833-6b1d6d8bf359'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.592932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce9d03199e64e2799ddd19f55656c67', 'request_id': 'req-05c5711e-7ff2-4942-a833-6b1d6d8bf359'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.616003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] The token cache is being invalidate because project 5ce9d03199e64e2799ddd19f55656c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:23.616672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.617679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.623087 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2641/5308] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:23 2022] DELETE /identity/v3/projects/5ce9d03199e64e2799ddd19f55656c67 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:23.624695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d279b-aff9-4472-ae18-64da9c026ce1 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:23.641597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d279b-aff9-4472-ae18-64da9c026ce1 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:23.785967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:23.787574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:23.788105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:23.788560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] PATH_INFO: `/v3/users/8a0b47faa1e14092a4a22baf8a5726ca` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:23.790418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0b47faa1e14092a4a22baf8a5726ca)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:23.794325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:23.897394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0b47faa1e14092a4a22baf8a5726ca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.917407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0b47faa1e14092a4a22baf8a5726ca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.941417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0b47faa1e14092a4a22baf8a5726ca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.943120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0b47faa1e14092a4a22baf8a5726ca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.943807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8ec9a541-1f49-4def-a04c-b2b0aba1c934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0b47faa1e14092a4a22baf8a5726ca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:23.973768 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2668/5309] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:23 2022] DELETE /identity/v3/users/8a0b47faa1e14092a4a22baf8a5726ca => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:24.578104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:24.584244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:24.624013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5711e-7ff2-4942-a833-6b1d6d8bf359 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:24.693661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:24.694747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:24.695061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:24.695412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] PATH_INFO: `/v3/projects/03c92aec5dfc489f9b64de9d8e6b3eac` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:24.696811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c92aec5dfc489f9b64de9d8e6b3eac)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:24.699003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:24.750737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c92aec5dfc489f9b64de9d8e6b3eac', 'request_id': 'req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:24.757472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c92aec5dfc489f9b64de9d8e6b3eac', 'request_id': 'req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:24.766933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c92aec5dfc489f9b64de9d8e6b3eac', 'request_id': 'req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:24.780753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] The token cache is being invalidate because project 03c92aec5dfc489f9b64de9d8e6b3eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:24.781096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:24.782889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-154f8be4-8f6a-436d-9fbb-d22dd0470d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:24.783575 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2642/5310] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:24 2022] DELETE /identity/v3/projects/03c92aec5dfc489f9b64de9d8e6b3eac => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:24.791332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30099dae-00d6-45c6-82ce-8b6c0e612d79 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:24.791865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30099dae-00d6-45c6-82ce-8b6c0e612d79 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:24.792065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30099dae-00d6-45c6-82ce-8b6c0e612d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:24.811799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-30099dae-00d6-45c6-82ce-8b6c0e612d79 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:24.813146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-30099dae-00d6-45c6-82ce-8b6c0e612d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:24.891443 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2669/5311] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:24.901121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecd5e-685f-4881-9aa8-fde7cba19505 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:24.901761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecd5e-685f-4881-9aa8-fde7cba19505 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:24.902140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecd5e-685f-4881-9aa8-fde7cba19505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:24.924121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-60fecd5e-685f-4881-9aa8-fde7cba19505 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:24.925376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-60fecd5e-685f-4881-9aa8-fde7cba19505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:24.936529 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2643/5312] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:24.939867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30099dae-00d6-45c6-82ce-8b6c0e612d79 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:24.951261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30099dae-00d6-45c6-82ce-8b6c0e612d79 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:24.957389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:24.957576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:24.957741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:24.958650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:24.959394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:24.959736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:24.961470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:24.977289 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2670/5313] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:24.985994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fecd5e-685f-4881-9aa8-fde7cba19505 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:24.998480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fecd5e-685f-4881-9aa8-fde7cba19505 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.005421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f2571-e2b8-42c6-97d6-4c360431cc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.006185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2571-e2b8-42c6-97d6-4c360431cc7d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.006531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2571-e2b8-42c6-97d6-4c360431cc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.006759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2571-e2b8-42c6-97d6-4c360431cc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.007522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f2571-e2b8-42c6-97d6-4c360431cc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.009671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f2571-e2b8-42c6-97d6-4c360431cc7d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:25.042850 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2644/5314] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:24 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:25.048103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:25.059677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fdbef-c8f8-4f18-af8a-1e9d0b0e048a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.125670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c059b-4d07-451c-ab13-44888bc3910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.126359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c059b-4d07-451c-ab13-44888bc3910a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.126697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c059b-4d07-451c-ab13-44888bc3910a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.126974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c059b-4d07-451c-ab13-44888bc3910a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.127778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c059b-4d07-451c-ab13-44888bc3910a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.129864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c059b-4d07-451c-ab13-44888bc3910a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:25.154632 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2671/5315] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:25 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:25.158818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f2571-e2b8-42c6-97d6-4c360431cc7d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:25.170797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f2571-e2b8-42c6-97d6-4c360431cc7d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.175780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb14e76-9f80-4edd-89ac-9a3d4d6f397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.176739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb14e76-9f80-4edd-89ac-9a3d4d6f397b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.177066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb14e76-9f80-4edd-89ac-9a3d4d6f397b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.177348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb14e76-9f80-4edd-89ac-9a3d4d6f397b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.178463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb14e76-9f80-4edd-89ac-9a3d4d6f397b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.179745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb14e76-9f80-4edd-89ac-9a3d4d6f397b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:25.194516 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2645/5316] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:25.199241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c059b-4d07-451c-ab13-44888bc3910a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:25.210487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c059b-4d07-451c-ab13-44888bc3910a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.217305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd100-8e14-4413-bf66-54c92e9f5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.218029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd100-8e14-4413-bf66-54c92e9f5678 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.218309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd100-8e14-4413-bf66-54c92e9f5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.218797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd100-8e14-4413-bf66-54c92e9f5678 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.219572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd100-8e14-4413-bf66-54c92e9f5678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.221411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd100-8e14-4413-bf66-54c92e9f5678 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:25.232929 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2672/5317] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:25.237276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb14e76-9f80-4edd-89ac-9a3d4d6f397b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:25.247744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb14e76-9f80-4edd-89ac-9a3d4d6f397b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.254031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771151-e4c9-4e80-8960-8d6662d48d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.255443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771151-e4c9-4e80-8960-8d6662d48d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.255724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771151-e4c9-4e80-8960-8d6662d48d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.256022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771151-e4c9-4e80-8960-8d6662d48d4e admin admin] PATH_INFO: `/v3/projects/ddc16bded5c94738af3359f5d222bfe5/users/9b38446c9fb34a33a7b297eae8fbf6f3/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.275158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2771151-e4c9-4e80-8960-8d6662d48d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc16bded5c94738af3359f5d222bfe5, user_id=9b38446c9fb34a33a7b297eae8fbf6f3, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.279239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2771151-e4c9-4e80-8960-8d6662d48d4e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:25.303994 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2646/5318] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:25 2022] PUT /identity/v3/projects/ddc16bded5c94738af3359f5d222bfe5/users/9b38446c9fb34a33a7b297eae8fbf6f3/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:25.317120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469a0b8-9684-4f33-8b58-274bd87273d0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.317803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469a0b8-9684-4f33-8b58-274bd87273d0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.318126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469a0b8-9684-4f33-8b58-274bd87273d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.351007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f469a0b8-9684-4f33-8b58-274bd87273d0 None None] MFA Rules not processed for user `9b38446c9fb34a33a7b297eae8fbf6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:25.352382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f469a0b8-9684-4f33-8b58-274bd87273d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:25.451991 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2673/5319] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:25.458591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771151-e4c9-4e80-8960-8d6662d48d4e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:25.542404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771151-e4c9-4e80-8960-8d6662d48d4e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.547129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6af667-7184-4ec2-a419-e66dff265808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.547790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af667-7184-4ec2-a419-e66dff265808 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.548096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af667-7184-4ec2-a419-e66dff265808 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.548365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af667-7184-4ec2-a419-e66dff265808 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.549063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6af667-7184-4ec2-a419-e66dff265808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.552562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6af667-7184-4ec2-a419-e66dff265808 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:25.579750 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2647/5320] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:25 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:25.585652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469a0b8-9684-4f33-8b58-274bd87273d0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:25.608268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469a0b8-9684-4f33-8b58-274bd87273d0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.772288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeefcf7-99e3-4117-b1b6-a48c5b2c2e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.773417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeefcf7-99e3-4117-b1b6-a48c5b2c2e21 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.773885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeefcf7-99e3-4117-b1b6-a48c5b2c2e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.774333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeefcf7-99e3-4117-b1b6-a48c5b2c2e21 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.775744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeefcf7-99e3-4117-b1b6-a48c5b2c2e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.778062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeefcf7-99e3-4117-b1b6-a48c5b2c2e21 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:25.818145 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2674/5321] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:25 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:25.824402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6af667-7184-4ec2-a419-e66dff265808 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:25.876961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6af667-7184-4ec2-a419-e66dff265808 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.898729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cb4f2-6017-4125-8d2c-d8ed62ab94e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.900461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cb4f2-6017-4125-8d2c-d8ed62ab94e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.900939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cb4f2-6017-4125-8d2c-d8ed62ab94e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.901399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cb4f2-6017-4125-8d2c-d8ed62ab94e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.913894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cb4f2-6017-4125-8d2c-d8ed62ab94e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.920670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cb4f2-6017-4125-8d2c-d8ed62ab94e3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:25.953906 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2648/5322] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:25.957788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeefcf7-99e3-4117-b1b6-a48c5b2c2e21 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:25.971340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeefcf7-99e3-4117-b1b6-a48c5b2c2e21 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:25.982325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393566-98fa-43df-a128-dad839302cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:25.983360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393566-98fa-43df-a128-dad839302cea admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:25.983738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393566-98fa-43df-a128-dad839302cea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:25.984264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393566-98fa-43df-a128-dad839302cea admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:25.985987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393566-98fa-43df-a128-dad839302cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:25.987392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393566-98fa-43df-a128-dad839302cea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:26.008408 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2675/5323] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:26.013390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cb4f2-6017-4125-8d2c-d8ed62ab94e3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:26.029030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cb4f2-6017-4125-8d2c-d8ed62ab94e3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:26.038316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce731be-7b22-44fd-a7de-9d09c7973a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:26.040204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce731be-7b22-44fd-a7de-9d09c7973a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:26.040558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce731be-7b22-44fd-a7de-9d09c7973a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:26.040843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce731be-7b22-44fd-a7de-9d09c7973a36 admin admin] PATH_INFO: `/v3/projects/f5360c3a64534d08a38eb69fb78a8f67/users/58f8c627c63e4eecb23c5388adec258c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:26.065618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce731be-7b22-44fd-a7de-9d09c7973a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5360c3a64534d08a38eb69fb78a8f67, user_id=58f8c627c63e4eecb23c5388adec258c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:26.069508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce731be-7b22-44fd-a7de-9d09c7973a36 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:26.088889 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2649/5324] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:26 2022] PUT /identity/v3/projects/f5360c3a64534d08a38eb69fb78a8f67/users/58f8c627c63e4eecb23c5388adec258c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:26.099549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af590e1b-ff42-4699-8164-576f9dc58d16 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:26.100246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af590e1b-ff42-4699-8164-576f9dc58d16 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:26.100790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af590e1b-ff42-4699-8164-576f9dc58d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:26.132904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-af590e1b-ff42-4699-8164-576f9dc58d16 None None] MFA Rules not processed for user `58f8c627c63e4eecb23c5388adec258c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:26.134117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-af590e1b-ff42-4699-8164-576f9dc58d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:26.245405 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2676/5325] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:26.251463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce731be-7b22-44fd-a7de-9d09c7973a36 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:26.386753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce731be-7b22-44fd-a7de-9d09c7973a36 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:26.401424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003f1e0-0ca6-4576-a00f-c526041a3082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:26.402932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f1e0-0ca6-4576-a00f-c526041a3082 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:26.403653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f1e0-0ca6-4576-a00f-c526041a3082 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:26.404361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f1e0-0ca6-4576-a00f-c526041a3082 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:26.405798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003f1e0-0ca6-4576-a00f-c526041a3082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:26.413499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003f1e0-0ca6-4576-a00f-c526041a3082 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:26.490820 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2650/5326] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:26 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:26.496022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af590e1b-ff42-4699-8164-576f9dc58d16 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:26.520287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af590e1b-ff42-4699-8164-576f9dc58d16 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:26.678376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a7c90-e424-4c2a-9338-49b4151abb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:26.679630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a7c90-e424-4c2a-9338-49b4151abb61 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:26.680109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a7c90-e424-4c2a-9338-49b4151abb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:26.681517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a7c90-e424-4c2a-9338-49b4151abb61 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:26.682830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a7c90-e424-4c2a-9338-49b4151abb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:26.686881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a7c90-e424-4c2a-9338-49b4151abb61 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:26.729880 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2677/5327] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:26 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:26.731337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003f1e0-0ca6-4576-a00f-c526041a3082 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:26.753129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003f1e0-0ca6-4576-a00f-c526041a3082 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:26.760921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45769d6-94be-4f27-a8bd-2a20c0ae3216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:26.762321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45769d6-94be-4f27-a8bd-2a20c0ae3216 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:26.762952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45769d6-94be-4f27-a8bd-2a20c0ae3216 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:26.763438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45769d6-94be-4f27-a8bd-2a20c0ae3216 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:26.764542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45769d6-94be-4f27-a8bd-2a20c0ae3216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:26.766893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45769d6-94be-4f27-a8bd-2a20c0ae3216 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:26.781482 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2651/5328] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:26.787173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a7c90-e424-4c2a-9338-49b4151abb61 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:26.814471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a7c90-e424-4c2a-9338-49b4151abb61 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:26.824676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c62f-5f6f-48e0-a1c6-e3a06b7a69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:26.826268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c62f-5f6f-48e0-a1c6-e3a06b7a69cf admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:26.826792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c62f-5f6f-48e0-a1c6-e3a06b7a69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:26.827524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c62f-5f6f-48e0-a1c6-e3a06b7a69cf admin admin] PATH_INFO: `/v3/projects/3fd43f13c7ba4ef3bfa192ea332d340c/users/461ace16e23247168d57d571d461d28f/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:26.862111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2c62f-5f6f-48e0-a1c6-e3a06b7a69cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd43f13c7ba4ef3bfa192ea332d340c, user_id=461ace16e23247168d57d571d461d28f, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:26.868113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2c62f-5f6f-48e0-a1c6-e3a06b7a69cf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:26.906345 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2678/5329] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:26 2022] PUT /identity/v3/projects/3fd43f13c7ba4ef3bfa192ea332d340c/users/461ace16e23247168d57d571d461d28f/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:26.911104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45769d6-94be-4f27-a8bd-2a20c0ae3216 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:26.935329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45769d6-94be-4f27-a8bd-2a20c0ae3216 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:27.151728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a23e42-f9eb-4f8b-ad29-e08f7e3136c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:27.153076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23e42-f9eb-4f8b-ad29-e08f7e3136c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:27.153614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23e42-f9eb-4f8b-ad29-e08f7e3136c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:27.154632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23e42-f9eb-4f8b-ad29-e08f7e3136c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:27.155454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a23e42-f9eb-4f8b-ad29-e08f7e3136c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:27.158492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a23e42-f9eb-4f8b-ad29-e08f7e3136c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:27.181399 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2652/5330] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:27.185528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c62f-5f6f-48e0-a1c6-e3a06b7a69cf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:27.217567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c62f-5f6f-48e0-a1c6-e3a06b7a69cf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:27.226960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:27.227945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:27.228352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:27.228720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] PATH_INFO: `/v3/projects/3fd43f13c7ba4ef3bfa192ea332d340c/users/461ace16e23247168d57d571d461d28f/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:27.231435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd43f13c7ba4ef3bfa192ea332d340c, user_id=461ace16e23247168d57d571d461d28f, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:27.234691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:27.252831 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2679/5331] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:27 2022] PUT /identity/v3/projects/3fd43f13c7ba4ef3bfa192ea332d340c/users/461ace16e23247168d57d571d461d28f/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:27.263882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd652a-fdf6-4001-b0ae-0f02b0ad558a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:27.264217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd652a-fdf6-4001-b0ae-0f02b0ad558a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:27.264537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd652a-fdf6-4001-b0ae-0f02b0ad558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:27.321190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-25fd652a-fdf6-4001-b0ae-0f02b0ad558a None None] MFA Rules not processed for user `461ace16e23247168d57d571d461d28f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:27.322656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25fd652a-fdf6-4001-b0ae-0f02b0ad558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:27.419280 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2653/5332] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:27.437615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:27.440121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:27.520014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3f70a-22bc-4509-b7e7-967a8b073821 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:27.525367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:27.526214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:27.526505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:27.526850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:27.537750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:27.539199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:27.549314 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2680/5333] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:27.591111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd652a-fdf6-4001-b0ae-0f02b0ad558a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:27.592554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25fd652a-fdf6-4001-b0ae-0f02b0ad558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:27.608953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd652a-fdf6-4001-b0ae-0f02b0ad558a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:27.612614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdab46-59f1-4cd1-bbb9-d3b1de3dd0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:27.613242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdab46-59f1-4cd1-bbb9-d3b1de3dd0cd service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:27.613520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdab46-59f1-4cd1-bbb9-d3b1de3dd0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:27.613793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdab46-59f1-4cd1-bbb9-d3b1de3dd0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:27.673142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdab46-59f1-4cd1-bbb9-d3b1de3dd0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:27.674610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdab46-59f1-4cd1-bbb9-d3b1de3dd0cd service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:27.684667 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2654/5334] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:27.854108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:27.860197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:27.952806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27030747-b06f-4812-af52-6ff57ef544f2 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:27.958735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:27.960198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:27.960671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:27.961111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] PATH_INFO: `/v3/users/93f89149cadc47ac81dd4885c5eec984` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:27.964394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f89149cadc47ac81dd4885c5eec984)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:27.966715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:28.034032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f89149cadc47ac81dd4885c5eec984'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.050033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f89149cadc47ac81dd4885c5eec984'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.065441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f89149cadc47ac81dd4885c5eec984'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.066133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f89149cadc47ac81dd4885c5eec984'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.066949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f89149cadc47ac81dd4885c5eec984'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.092065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2681/5335] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:27 2022] DELETE /identity/v3/users/93f89149cadc47ac81dd4885c5eec984 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:28.094900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ed190-caca-4d96-9021-697042408965 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:28.095491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ed190-caca-4d96-9021-697042408965 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:28.095923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ed190-caca-4d96-9021-697042408965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:28.120301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9d5ed190-caca-4d96-9021-697042408965 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:28.121759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9d5ed190-caca-4d96-9021-697042408965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:28.196459 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2655/5336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:28.208736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:28.210832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:28.296739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e2c91-6781-4fa6-8953-1db542843db9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:28.308195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becae92-cb84-44a0-8db5-efe6cd5cf318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:28.309332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becae92-cb84-44a0-8db5-efe6cd5cf318 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:28.310163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becae92-cb84-44a0-8db5-efe6cd5cf318 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:28.310736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becae92-cb84-44a0-8db5-efe6cd5cf318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:28.329694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becae92-cb84-44a0-8db5-efe6cd5cf318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:28.331443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becae92-cb84-44a0-8db5-efe6cd5cf318 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:28.344415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2682/5337] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:28.765626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ed190-caca-4d96-9021-697042408965 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:28.767211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9d5ed190-caca-4d96-9021-697042408965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:28.787821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ed190-caca-4d96-9021-697042408965 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:28.793967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:28.795062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:28.795546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:28.795997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] PATH_INFO: `/v3/projects/67dea5f032894c1f968944abdac71f71` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:28.801875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=67dea5f032894c1f968944abdac71f71)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:28.806138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:28.867263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67dea5f032894c1f968944abdac71f71', 'request_id': 'req-31d86530-f366-4b04-becf-f4f5c2b367ea'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.872774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67dea5f032894c1f968944abdac71f71', 'request_id': 'req-31d86530-f366-4b04-becf-f4f5c2b367ea'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.880878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67dea5f032894c1f968944abdac71f71', 'request_id': 'req-31d86530-f366-4b04-becf-f4f5c2b367ea'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.899833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] The token cache is being invalidate because project 67dea5f032894c1f968944abdac71f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:28.900185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.901176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:28.904242 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2656/5338] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:28 2022] DELETE /identity/v3/projects/67dea5f032894c1f968944abdac71f71 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:28.909867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becae92-cb84-44a0-8db5-efe6cd5cf318 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:28.933889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becae92-cb84-44a0-8db5-efe6cd5cf318 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:29.009835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:29.010762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:29.011101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:29.011379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] PATH_INFO: `/v3/users/5efd0e4590d94d8c9957cbc719bbf5c8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:29.013144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5efd0e4590d94d8c9957cbc719bbf5c8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:29.015345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:29.079130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5efd0e4590d94d8c9957cbc719bbf5c8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:29.095761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5efd0e4590d94d8c9957cbc719bbf5c8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:29.118769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5efd0e4590d94d8c9957cbc719bbf5c8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:29.120113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5efd0e4590d94d8c9957cbc719bbf5c8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:29.121344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cb01610-6de7-43d5-b88e-e8162183d34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5efd0e4590d94d8c9957cbc719bbf5c8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:29.151127 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2683/5339] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:28 2022] DELETE /identity/v3/users/5efd0e4590d94d8c9957cbc719bbf5c8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:29.632447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:29.635863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:29.687141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86530-f366-4b04-becf-f4f5c2b367ea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:29.845923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:29.847372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:29.847919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:29.852308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] PATH_INFO: `/v3/projects/7c8f6b2a75a24ca49373c87d95c9668b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:29.855037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8f6b2a75a24ca49373c87d95c9668b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:29.857362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:29.992388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8f6b2a75a24ca49373c87d95c9668b', 'request_id': 'req-b80ab20d-8ac1-4e1f-af28-6e291b29b614'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:30.002524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8f6b2a75a24ca49373c87d95c9668b', 'request_id': 'req-b80ab20d-8ac1-4e1f-af28-6e291b29b614'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:30.013235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8f6b2a75a24ca49373c87d95c9668b', 'request_id': 'req-b80ab20d-8ac1-4e1f-af28-6e291b29b614'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:30.048911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] The token cache is being invalidate because project 7c8f6b2a75a24ca49373c87d95c9668b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:30.049119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:30.049858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b80ab20d-8ac1-4e1f-af28-6e291b29b614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:30.052791 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2657/5340] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:29 2022] DELETE /identity/v3/projects/7c8f6b2a75a24ca49373c87d95c9668b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:30.058182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b540a-4015-425d-9413-74ced5a3dcbf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.058762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b540a-4015-425d-9413-74ced5a3dcbf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.058874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b540a-4015-425d-9413-74ced5a3dcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.084584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9e6b540a-4015-425d-9413-74ced5a3dcbf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:30.088015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e6b540a-4015-425d-9413-74ced5a3dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:30.269103 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2684/5341] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:30.278984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862cb84-b08d-4359-856e-c8e4527475f8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.279367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862cb84-b08d-4359-856e-c8e4527475f8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.279874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862cb84-b08d-4359-856e-c8e4527475f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.321848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c862cb84-b08d-4359-856e-c8e4527475f8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:30.322829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c862cb84-b08d-4359-856e-c8e4527475f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:30.349985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b540a-4015-425d-9413-74ced5a3dcbf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:30.351909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e6b540a-4015-425d-9413-74ced5a3dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:30.364465 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2658/5342] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:30.369202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862cb84-b08d-4359-856e-c8e4527475f8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:30.387551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862cb84-b08d-4359-856e-c8e4527475f8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:30.402096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:30.405458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.406771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.406771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.407126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:30.407631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:30.412100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:30.448364 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2659/5343] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:09:30.454270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:30.481424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd096-da5e-4702-926b-6f73c054d535 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:30.496398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8f1c7-e615-4eb7-b463-46622151fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:30.502653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8f1c7-e615-4eb7-b463-46622151fd25 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.502957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8f1c7-e615-4eb7-b463-46622151fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.503242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8f1c7-e615-4eb7-b463-46622151fd25 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.503986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8f1c7-e615-4eb7-b463-46622151fd25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:30.507190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8f1c7-e615-4eb7-b463-46622151fd25 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:30.545755 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2660/5344] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:30 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:30.550933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8f1c7-e615-4eb7-b463-46622151fd25 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:30.578555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b540a-4015-425d-9413-74ced5a3dcbf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:30.656107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:30.656497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8f1c7-e615-4eb7-b463-46622151fd25 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:30.657206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.657206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.657591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.664373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:30.664627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b7ea4-f254-4383-b846-cf43c51dd252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:30.665426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7ea4-f254-4383-b846-cf43c51dd252 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.665818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7ea4-f254-4383-b846-cf43c51dd252 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.666310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7ea4-f254-4383-b846-cf43c51dd252 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.667017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b7ea4-f254-4383-b846-cf43c51dd252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:30.668982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b7ea4-f254-4383-b846-cf43c51dd252 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:30.685078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:30.686823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:30.696712 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2661/5345] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:30 2022] POST /identity/v3/users => generated 305 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:30.702478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b7ea4-f254-4383-b846-cf43c51dd252 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:30.707586 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2685/5346] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:30.720264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b7ea4-f254-4383-b846-cf43c51dd252 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:30.727567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1f3eb-28fa-4149-8740-5e69b705e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:30.728369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1f3eb-28fa-4149-8740-5e69b705e6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.728709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1f3eb-28fa-4149-8740-5e69b705e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.729011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1f3eb-28fa-4149-8740-5e69b705e6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.729992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1f3eb-28fa-4149-8740-5e69b705e6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:30.733394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1f3eb-28fa-4149-8740-5e69b705e6e2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:30.749911 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2662/5347] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:30.754424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:30.766793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3ae2-abb1-4d74-90d8-da6366a2c593 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:30.774808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fbcbb-3f27-4a7d-bde9-3f7ab45319f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:30.775529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fbcbb-3f27-4a7d-bde9-3f7ab45319f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.776053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fbcbb-3f27-4a7d-bde9-3f7ab45319f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.776376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fbcbb-3f27-4a7d-bde9-3f7ab45319f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.777157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fbcbb-3f27-4a7d-bde9-3f7ab45319f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:30.778998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fbcbb-3f27-4a7d-bde9-3f7ab45319f2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:30.799769 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2686/5348] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:30.802760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1f3eb-28fa-4149-8740-5e69b705e6e2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:30.818198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1f3eb-28fa-4149-8740-5e69b705e6e2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:30.825021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4016c-d857-43b2-89da-2b9832c98fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:30.826246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4016c-d857-43b2-89da-2b9832c98fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.826532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4016c-d857-43b2-89da-2b9832c98fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.826814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4016c-d857-43b2-89da-2b9832c98fc4 admin admin] PATH_INFO: `/v3/projects/fe922c59496340b484fcbc21e6b98aa1/users/06d114f732524806aef02b8091c1adfa/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.844110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4016c-d857-43b2-89da-2b9832c98fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe922c59496340b484fcbc21e6b98aa1, user_id=06d114f732524806aef02b8091c1adfa, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:30.847276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4016c-d857-43b2-89da-2b9832c98fc4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:30.879139 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2663/5349] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:30 2022] PUT /identity/v3/projects/fe922c59496340b484fcbc21e6b98aa1/users/06d114f732524806aef02b8091c1adfa/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:30.899271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429509a-7e22-44be-a47c-56a3621bccf9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:30.899685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429509a-7e22-44be-a47c-56a3621bccf9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:30.899975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429509a-7e22-44be-a47c-56a3621bccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:30.931695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3429509a-7e22-44be-a47c-56a3621bccf9 None None] MFA Rules not processed for user `06d114f732524806aef02b8091c1adfa`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:30.934009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3429509a-7e22-44be-a47c-56a3621bccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:31.039053 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2687/5350] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:31.044269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4016c-d857-43b2-89da-2b9832c98fc4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.074544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429509a-7e22-44be-a47c-56a3621bccf9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.076282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3429509a-7e22-44be-a47c-56a3621bccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:31.126682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4016c-d857-43b2-89da-2b9832c98fc4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:31.133996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b16a4-18ec-4006-a8bb-ff04bd813829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:31.134688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b16a4-18ec-4006-a8bb-ff04bd813829 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.134971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b16a4-18ec-4006-a8bb-ff04bd813829 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.135249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b16a4-18ec-4006-a8bb-ff04bd813829 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.135951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b16a4-18ec-4006-a8bb-ff04bd813829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:31.138314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b16a4-18ec-4006-a8bb-ff04bd813829 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:31.160719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429509a-7e22-44be-a47c-56a3621bccf9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:31.167949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:31.169075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.169631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.170277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] PATH_INFO: `/v3/users/9b38446c9fb34a33a7b297eae8fbf6f3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.172584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b38446c9fb34a33a7b297eae8fbf6f3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:31.175178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:31.203427 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2664/5351] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:31 2022] POST /identity/v3/projects => generated 409 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:31.204787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b16a4-18ec-4006-a8bb-ff04bd813829 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.254156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b38446c9fb34a33a7b297eae8fbf6f3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:31.284218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b38446c9fb34a33a7b297eae8fbf6f3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:31.298491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b38446c9fb34a33a7b297eae8fbf6f3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:31.299271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b38446c9fb34a33a7b297eae8fbf6f3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:31.300025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1b4c1bb9-ff44-4872-9a97-e682493e54ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b38446c9fb34a33a7b297eae8fbf6f3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:31.337523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b16a4-18ec-4006-a8bb-ff04bd813829 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:31.341626 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2688/5352] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:31 2022] DELETE /identity/v3/users/9b38446c9fb34a33a7b297eae8fbf6f3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:31.344108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8edcb-d119-43ea-85d8-53303d16536e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.344639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8edcb-d119-43ea-85d8-53303d16536e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.345965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8edcb-d119-43ea-85d8-53303d16536e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.417098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-62d8edcb-d119-43ea-85d8-53303d16536e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:31.420766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-62d8edcb-d119-43ea-85d8-53303d16536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:31.421757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:31.423744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.423744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.423744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.424284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:31.427302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:31.442069 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2689/5353] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:31.472430 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2665/5354] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:31 2022] POST /identity/v3/users => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:31.477866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8edcb-d119-43ea-85d8-53303d16536e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.479031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.481854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-62d8edcb-d119-43ea-85d8-53303d16536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:31.483675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:31.502022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520fa8a-30a4-4d7c-9ac5-d3b2284621ed admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:31.510001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f5294-55a9-4c9b-b949-a06c81c02266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:31.510874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f5294-55a9-4c9b-b949-a06c81c02266 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.511165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f5294-55a9-4c9b-b949-a06c81c02266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.511438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f5294-55a9-4c9b-b949-a06c81c02266 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.512224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f5294-55a9-4c9b-b949-a06c81c02266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:31.513885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f5294-55a9-4c9b-b949-a06c81c02266 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:31.527300 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2666/5355] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:31.531757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f5294-55a9-4c9b-b949-a06c81c02266 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.550893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f5294-55a9-4c9b-b949-a06c81c02266 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:31.568535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5968d1-6c3f-472b-8e29-384a5e4d6645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:31.570196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5968d1-6c3f-472b-8e29-384a5e4d6645 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.570839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5968d1-6c3f-472b-8e29-384a5e4d6645 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.571547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5968d1-6c3f-472b-8e29-384a5e4d6645 admin admin] PATH_INFO: `/v3/projects/f8a8d266446444f089c5b7f12751d137/users/7b270d7d34f24cf0b129c10feb7068c1/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.588834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8edcb-d119-43ea-85d8-53303d16536e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:31.594256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c7c23-c239-4234-9b91-756628e53fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:31.595125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7c23-c239-4234-9b91-756628e53fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.595409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7c23-c239-4234-9b91-756628e53fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.595684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7c23-c239-4234-9b91-756628e53fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.602245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5968d1-6c3f-472b-8e29-384a5e4d6645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a8d266446444f089c5b7f12751d137, user_id=7b270d7d34f24cf0b129c10feb7068c1, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:31.605273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5968d1-6c3f-472b-8e29-384a5e4d6645 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:31.613544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c7c23-c239-4234-9b91-756628e53fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:31.619066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c7c23-c239-4234-9b91-756628e53fc9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:31.630012 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2667/5356] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:31 2022] PUT /identity/v3/projects/f8a8d266446444f089c5b7f12751d137/users/7b270d7d34f24cf0b129c10feb7068c1/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:31.634434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5968d1-6c3f-472b-8e29-384a5e4d6645 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.653585 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2690/5357] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:31.737620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5968d1-6c3f-472b-8e29-384a5e4d6645 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:31.747450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cb6da-d4db-47da-81fc-c95e5778a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:31.748200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cb6da-d4db-47da-81fc-c95e5778a788 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.748521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cb6da-d4db-47da-81fc-c95e5778a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.748821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cb6da-d4db-47da-81fc-c95e5778a788 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.750534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cb6da-d4db-47da-81fc-c95e5778a788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:31.752166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cb6da-d4db-47da-81fc-c95e5778a788 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:31.775965 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2668/5358] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:31.781777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c7c23-c239-4234-9b91-756628e53fc9 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.802655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c7c23-c239-4234-9b91-756628e53fc9 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:31.814567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:31.816265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.817066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.818405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] PATH_INFO: `/v3/projects/f8a8d266446444f089c5b7f12751d137/users/7b270d7d34f24cf0b129c10feb7068c1/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.822333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a8d266446444f089c5b7f12751d137, user_id=7b270d7d34f24cf0b129c10feb7068c1, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:31.833233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:31.852571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2691/5359] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:31 2022] PUT /identity/v3/projects/f8a8d266446444f089c5b7f12751d137/users/7b270d7d34f24cf0b129c10feb7068c1/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:31.866315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f5e-3a5c-4a40-b6df-163a256d78f4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:31.866604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f5e-3a5c-4a40-b6df-163a256d78f4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:31.866879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f5e-3a5c-4a40-b6df-163a256d78f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:31.916232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cd2e9f5e-3a5c-4a40-b6df-163a256d78f4 None None] MFA Rules not processed for user `7b270d7d34f24cf0b129c10feb7068c1`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:31.918736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cd2e9f5e-3a5c-4a40-b6df-163a256d78f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:31.939254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:31.941442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:32.076828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e611-e618-44fe-bcd2-d2c2dbd0bda2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:32.083571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:32.085040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:32.085431 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2669/5360] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:32.091050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:32.091557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] PATH_INFO: `/v3/users/0edf621841d44514b6082172d15af2a7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:32.091992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9f5e-3a5c-4a40-b6df-163a256d78f4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:32.093410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edf621841d44514b6082172d15af2a7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:32.093880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cd2e9f5e-3a5c-4a40-b6df-163a256d78f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:32.095859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:32.166869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edf621841d44514b6082172d15af2a7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.172994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9f5e-3a5c-4a40-b6df-163a256d78f4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:32.180129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:32.183037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:32.183544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:32.183996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:32.186703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edf621841d44514b6082172d15af2a7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.198199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:32.199957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:32.204700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edf621841d44514b6082172d15af2a7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.206692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edf621841d44514b6082172d15af2a7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.208869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edf621841d44514b6082172d15af2a7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.214608 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2670/5361] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:32.215706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:32.217279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:32.231729 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2692/5362] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:31 2022] DELETE /identity/v3/users/0edf621841d44514b6082172d15af2a7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:32.242515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df35790-3a67-44a1-ad10-42c04255044b service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:32.307835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:32.309532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:32.309817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:32.310093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] PATH_INFO: `/v3/projects/ddc16bded5c94738af3359f5d222bfe5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:32.311328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc16bded5c94738af3359f5d222bfe5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:32.313463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:32.367811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc16bded5c94738af3359f5d222bfe5', 'request_id': 'req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.373605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc16bded5c94738af3359f5d222bfe5', 'request_id': 'req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.383871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc16bded5c94738af3359f5d222bfe5', 'request_id': 'req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.397068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] The token cache is being invalidate because project ddc16bded5c94738af3359f5d222bfe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:32.397068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.397860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.398724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:32.399463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2671/5363] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:32 2022] DELETE /identity/v3/projects/ddc16bded5c94738af3359f5d222bfe5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:32.400241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:32.403646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:32.405142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:32.474859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6ab0-df91-47a2-a42c-be90076850b9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:32.476195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac4b21-06d4-468c-b42b-1102c3b2b1ae admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:32.481357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:32.482304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:32.482584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:32.482862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] PATH_INFO: `/v3/users/58f8c627c63e4eecb23c5388adec258c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:32.484158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f8c627c63e4eecb23c5388adec258c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:32.486115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:32.525026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:32.525682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:32.525966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:32.526242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:32.528017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:32.535229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f8c627c63e4eecb23c5388adec258c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.536002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f8c627c63e4eecb23c5388adec258c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.536671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f8c627c63e4eecb23c5388adec258c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.549446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f8c627c63e4eecb23c5388adec258c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.557527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f8c627c63e4eecb23c5388adec258c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.570783 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2672/5364] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:32 2022] DELETE /identity/v3/users/58f8c627c63e4eecb23c5388adec258c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:32.573858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:32.573858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:32.587325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:32.588899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:32.599096 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2693/5365] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:32.660644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb04bb-81a7-45f5-b59c-680e4b270995 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:32.668397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:32.669398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:32.669753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:32.671109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] PATH_INFO: `/v3/projects/ba9b396737a34280bdc448a2b0df5a7e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:32.672662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9b396737a34280bdc448a2b0df5a7e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:32.674816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:32.768891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9b396737a34280bdc448a2b0df5a7e', 'request_id': 'req-4f391ed3-32ca-409a-8039-8d6a21fda9cc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.778134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9b396737a34280bdc448a2b0df5a7e', 'request_id': 'req-4f391ed3-32ca-409a-8039-8d6a21fda9cc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.791202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9b396737a34280bdc448a2b0df5a7e', 'request_id': 'req-4f391ed3-32ca-409a-8039-8d6a21fda9cc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.811565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] The token cache is being invalidate because project ba9b396737a34280bdc448a2b0df5a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:32.811969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.813219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:32.816564 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2673/5366] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:32 2022] DELETE /identity/v3/projects/ba9b396737a34280bdc448a2b0df5a7e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:32.996516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:33.030508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5579d9-9c4e-4f54-91ef-bb91ba1dbbb2 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:33.186662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:33.187826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:33.188275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:33.188598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] PATH_INFO: `/v3/projects/f5360c3a64534d08a38eb69fb78a8f67` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:33.190003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5360c3a64534d08a38eb69fb78a8f67)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:33.192396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:33.247612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5360c3a64534d08a38eb69fb78a8f67', 'request_id': 'req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.256592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5360c3a64534d08a38eb69fb78a8f67', 'request_id': 'req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.268459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5360c3a64534d08a38eb69fb78a8f67', 'request_id': 'req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.282358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] The token cache is being invalidate because project f5360c3a64534d08a38eb69fb78a8f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:33.282851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.283690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.285521 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2694/5367] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:32 2022] DELETE /identity/v3/projects/f5360c3a64534d08a38eb69fb78a8f67 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:33.290869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:33.293732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:33.308099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f391ed3-32ca-409a-8039-8d6a21fda9cc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:33.382629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:33.383632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:33.383923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:33.384298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] PATH_INFO: `/v3/users/461ace16e23247168d57d571d461d28f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:33.386888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461ace16e23247168d57d571d461d28f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:33.389420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:33.461269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461ace16e23247168d57d571d461d28f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.462040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461ace16e23247168d57d571d461d28f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.463164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461ace16e23247168d57d571d461d28f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.485792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461ace16e23247168d57d571d461d28f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.496064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3a6e4dd1-3bdd-47db-b8c6-975b6d285bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461ace16e23247168d57d571d461d28f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:33.514316 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2674/5368] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:33 2022] DELETE /identity/v3/users/461ace16e23247168d57d571d461d28f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:33.948212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:33.949884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:33.965084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13b6cd-4f9e-42f0-ab70-41ae87fc418d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:34.037388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:34.038354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.038612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.038876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] PATH_INFO: `/v3/projects/3fd43f13c7ba4ef3bfa192ea332d340c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.040106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd43f13c7ba4ef3bfa192ea332d340c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:34.042060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:34.096936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd43f13c7ba4ef3bfa192ea332d340c', 'request_id': 'req-a753de5e-e981-4bd9-b702-faf98fb8491a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:34.105036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd43f13c7ba4ef3bfa192ea332d340c', 'request_id': 'req-a753de5e-e981-4bd9-b702-faf98fb8491a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:34.115206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd43f13c7ba4ef3bfa192ea332d340c', 'request_id': 'req-a753de5e-e981-4bd9-b702-faf98fb8491a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:34.131273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] The token cache is being invalidate because project 3fd43f13c7ba4ef3bfa192ea332d340c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:34.131667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:34.133254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a753de5e-e981-4bd9-b702-faf98fb8491a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:34.135550 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2695/5369] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:33 2022] DELETE /identity/v3/projects/3fd43f13c7ba4ef3bfa192ea332d340c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:34.142630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e264aa-fdc6-4dc3-b46b-7eea347da78d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.143223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e264aa-fdc6-4dc3-b46b-7eea347da78d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.143697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e264aa-fdc6-4dc3-b46b-7eea347da78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.178223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-87e264aa-fdc6-4dc3-b46b-7eea347da78d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:34.181282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-87e264aa-fdc6-4dc3-b46b-7eea347da78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:34.318509 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2675/5370] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:34.319429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec80fa0-a442-46f6-83bc-24f65d74ceee None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.320141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec80fa0-a442-46f6-83bc-24f65d74ceee None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.320141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec80fa0-a442-46f6-83bc-24f65d74ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.362876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bec80fa0-a442-46f6-83bc-24f65d74ceee None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:34.364809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bec80fa0-a442-46f6-83bc-24f65d74ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:34.377985 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2696/5371] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:34.383289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e264aa-fdc6-4dc3-b46b-7eea347da78d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:34.402641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e264aa-fdc6-4dc3-b46b-7eea347da78d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:34.424088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:34.424927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.425289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.425667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.434922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:34.434922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:34.434922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:34.456988 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2676/5372] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:34.462821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec80fa0-a442-46f6-83bc-24f65d74ceee None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:34.485266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec80fa0-a442-46f6-83bc-24f65d74ceee None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:34.499204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98af86-f0c1-45d2-bf90-270233001ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:34.500853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98af86-f0c1-45d2-bf90-270233001ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.501388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98af86-f0c1-45d2-bf90-270233001ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.502671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98af86-f0c1-45d2-bf90-270233001ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.503932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98af86-f0c1-45d2-bf90-270233001ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:34.507834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98af86-f0c1-45d2-bf90-270233001ec0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:34.550519 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2697/5373] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:34 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:34.555670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:34.573555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448df7-6784-4886-b572-dfcad40d8f92 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:34.694133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf51796-c120-4892-bcd7-457baa7cd1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:34.695654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf51796-c120-4892-bcd7-457baa7cd1aa admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.695992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf51796-c120-4892-bcd7-457baa7cd1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.696895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf51796-c120-4892-bcd7-457baa7cd1aa admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.697013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf51796-c120-4892-bcd7-457baa7cd1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:34.699157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf51796-c120-4892-bcd7-457baa7cd1aa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:34.732064 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2677/5374] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:34 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:34.736747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98af86-f0c1-45d2-bf90-270233001ec0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:34.751606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98af86-f0c1-45d2-bf90-270233001ec0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:34.760408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d407f6c-60ad-4f80-9e4f-4950e38ac584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:34.761456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d407f6c-60ad-4f80-9e4f-4950e38ac584 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.761845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d407f6c-60ad-4f80-9e4f-4950e38ac584 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.762320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d407f6c-60ad-4f80-9e4f-4950e38ac584 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.763204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d407f6c-60ad-4f80-9e4f-4950e38ac584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:34.765154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d407f6c-60ad-4f80-9e4f-4950e38ac584 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:34.783902 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2698/5375] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:34.790855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf51796-c120-4892-bcd7-457baa7cd1aa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:34.808161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf51796-c120-4892-bcd7-457baa7cd1aa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:34.824622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af07cd-8ac8-47be-b33f-9590fa03927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:34.825490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af07cd-8ac8-47be-b33f-9590fa03927f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.826520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af07cd-8ac8-47be-b33f-9590fa03927f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.826905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af07cd-8ac8-47be-b33f-9590fa03927f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.827927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af07cd-8ac8-47be-b33f-9590fa03927f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:34.830101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af07cd-8ac8-47be-b33f-9590fa03927f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:34.870197 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2678/5376] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:34.872737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d407f6c-60ad-4f80-9e4f-4950e38ac584 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:34.893040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d407f6c-60ad-4f80-9e4f-4950e38ac584 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:34.904903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e17b60-c591-426d-a13c-f63db23ec0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:34.906041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e17b60-c591-426d-a13c-f63db23ec0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.906438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e17b60-c591-426d-a13c-f63db23ec0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.906797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e17b60-c591-426d-a13c-f63db23ec0a5 admin admin] PATH_INFO: `/v3/projects/54445abc95ac452287a14122aac23505/users/913e0568bfb44e6e88c20fbae6e1cf48/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:34.937484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e17b60-c591-426d-a13c-f63db23ec0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54445abc95ac452287a14122aac23505, user_id=913e0568bfb44e6e88c20fbae6e1cf48, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:34.940602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e17b60-c591-426d-a13c-f63db23ec0a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:34.960995 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2699/5377] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:34 2022] PUT /identity/v3/projects/54445abc95ac452287a14122aac23505/users/913e0568bfb44e6e88c20fbae6e1cf48/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:34.974782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07835-bd50-4548-bdb4-de08b085ea69 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:34.975265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07835-bd50-4548-bdb4-de08b085ea69 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:34.976105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07835-bd50-4548-bdb4-de08b085ea69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:35.035583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-19d07835-bd50-4548-bdb4-de08b085ea69 None None] MFA Rules not processed for user `913e0568bfb44e6e88c20fbae6e1cf48`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:35.037949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-19d07835-bd50-4548-bdb4-de08b085ea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:35.132511 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2679/5378] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:35.137409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e17b60-c591-426d-a13c-f63db23ec0a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:35.246732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e17b60-c591-426d-a13c-f63db23ec0a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:35.256925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915539f-4379-4f9a-b542-546222241095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:35.259273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915539f-4379-4f9a-b542-546222241095 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:35.259732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915539f-4379-4f9a-b542-546222241095 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:35.260187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915539f-4379-4f9a-b542-546222241095 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:35.261408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915539f-4379-4f9a-b542-546222241095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:35.264891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915539f-4379-4f9a-b542-546222241095 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:35.314563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2700/5379] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:35 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:35.321767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07835-bd50-4548-bdb4-de08b085ea69 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:35.342938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07835-bd50-4548-bdb4-de08b085ea69 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:35.491951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66ff47-3591-4e8c-8711-63414e9fec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:35.492737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ff47-3591-4e8c-8711-63414e9fec65 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:35.493025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ff47-3591-4e8c-8711-63414e9fec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:35.493332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ff47-3591-4e8c-8711-63414e9fec65 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:35.494528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66ff47-3591-4e8c-8711-63414e9fec65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:35.496914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66ff47-3591-4e8c-8711-63414e9fec65 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:35.539662 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2680/5380] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:35 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:35.540994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915539f-4379-4f9a-b542-546222241095 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:35.555204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915539f-4379-4f9a-b542-546222241095 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:35.564978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6d678-1f8b-4e87-9fd1-7407f46ba205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:35.566028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d678-1f8b-4e87-9fd1-7407f46ba205 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:35.566443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d678-1f8b-4e87-9fd1-7407f46ba205 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:35.568681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d678-1f8b-4e87-9fd1-7407f46ba205 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:35.568681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6d678-1f8b-4e87-9fd1-7407f46ba205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:35.570470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6d678-1f8b-4e87-9fd1-7407f46ba205 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:35.584602 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2701/5381] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:35.589022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66ff47-3591-4e8c-8711-63414e9fec65 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:35.605368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66ff47-3591-4e8c-8711-63414e9fec65 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:35.617356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99d264-db81-4377-9239-3bb6008a32ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:35.618038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99d264-db81-4377-9239-3bb6008a32ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:35.618357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99d264-db81-4377-9239-3bb6008a32ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:35.618638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99d264-db81-4377-9239-3bb6008a32ec admin admin] PATH_INFO: `/v3/projects/0fb8cbf5c97c4753bb1824f14baeb120/users/241cd5ade1b446cab420244eda7ff05b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:35.676997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99d264-db81-4377-9239-3bb6008a32ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb8cbf5c97c4753bb1824f14baeb120, user_id=241cd5ade1b446cab420244eda7ff05b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:35.681490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99d264-db81-4377-9239-3bb6008a32ec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:35.709922 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2681/5382] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:35 2022] PUT /identity/v3/projects/0fb8cbf5c97c4753bb1824f14baeb120/users/241cd5ade1b446cab420244eda7ff05b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:35.714258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6d678-1f8b-4e87-9fd1-7407f46ba205 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:35.737488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6d678-1f8b-4e87-9fd1-7407f46ba205 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:35.844302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1821624-b89c-4b7c-bcc0-f72374643843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:35.848218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821624-b89c-4b7c-bcc0-f72374643843 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:35.849212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821624-b89c-4b7c-bcc0-f72374643843 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:35.849499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821624-b89c-4b7c-bcc0-f72374643843 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:35.850398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1821624-b89c-4b7c-bcc0-f72374643843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:35.854988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1821624-b89c-4b7c-bcc0-f72374643843 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:35.873402 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2702/5383] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:09:35.877021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99d264-db81-4377-9239-3bb6008a32ec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:35.897309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99d264-db81-4377-9239-3bb6008a32ec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:35.907499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:35.908954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:35.909527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:35.909942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] PATH_INFO: `/v3/projects/0fb8cbf5c97c4753bb1824f14baeb120/users/241cd5ade1b446cab420244eda7ff05b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:35.913499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb8cbf5c97c4753bb1824f14baeb120, user_id=241cd5ade1b446cab420244eda7ff05b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:35.916906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:35.939693 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2682/5384] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:35 2022] PUT /identity/v3/projects/0fb8cbf5c97c4753bb1824f14baeb120/users/241cd5ade1b446cab420244eda7ff05b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:35.953462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852292-6e8b-41ed-b54f-2c73bc9f6012 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:35.953915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852292-6e8b-41ed-b54f-2c73bc9f6012 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:35.954352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852292-6e8b-41ed-b54f-2c73bc9f6012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:35.991143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-be852292-6e8b-41ed-b54f-2c73bc9f6012 None None] MFA Rules not processed for user `241cd5ade1b446cab420244eda7ff05b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:35.993054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-be852292-6e8b-41ed-b54f-2c73bc9f6012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:36.092995 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2703/5385] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:36.106395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:36.108506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:36.224730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0982151-bcee-4592-9b24-0fbeb01244c1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:36.234639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbceffd-e227-413b-ab52-20fadcec0dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:36.236834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbceffd-e227-413b-ab52-20fadcec0dbc service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:36.237592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbceffd-e227-413b-ab52-20fadcec0dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:36.238857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbceffd-e227-413b-ab52-20fadcec0dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:36.261592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbceffd-e227-413b-ab52-20fadcec0dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:36.264461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbceffd-e227-413b-ab52-20fadcec0dbc service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:36.329650 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2683/5386] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:36.960042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be852292-6e8b-41ed-b54f-2c73bc9f6012 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:37.079881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be852292-6e8b-41ed-b54f-2c73bc9f6012 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:37.087278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:37.088900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:37.089167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:37.089819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] PATH_INFO: `/v3/users/913e0568bfb44e6e88c20fbae6e1cf48` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:37.092020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=913e0568bfb44e6e88c20fbae6e1cf48)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:37.094815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:37.164143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913e0568bfb44e6e88c20fbae6e1cf48'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:37.178936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913e0568bfb44e6e88c20fbae6e1cf48'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:37.193365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913e0568bfb44e6e88c20fbae6e1cf48'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:37.194372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913e0568bfb44e6e88c20fbae6e1cf48'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:37.195112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913e0568bfb44e6e88c20fbae6e1cf48'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:37.213284 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2704/5387] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:36 2022] DELETE /identity/v3/users/913e0568bfb44e6e88c20fbae6e1cf48 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:37.218452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b5de8-3182-411a-ada9-4694c94268e8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:37.218797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b5de8-3182-411a-ada9-4694c94268e8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:37.219105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b5de8-3182-411a-ada9-4694c94268e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:37.243456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2a7b5de8-3182-411a-ada9-4694c94268e8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:37.245690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a7b5de8-3182-411a-ada9-4694c94268e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:37.362362 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2684/5388] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:37.371565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:37.373374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:37.478154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c033c6-28ae-4a11-a520-f944e84b8c4a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:37.484271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:37.486084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:37.486568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:37.487593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:37.504603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:37.506609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:37.521653 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2705/5389] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:37.544264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b5de8-3182-411a-ada9-4694c94268e8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:37.546456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a7b5de8-3182-411a-ada9-4694c94268e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:37.563520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b5de8-3182-411a-ada9-4694c94268e8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:37.568426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:37.569220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:37.569502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:37.569980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:37.572645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:37.593373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:37.596302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:37.626716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2685/5390] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:37.887055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:37.889026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:37.912502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39267152-469c-4957-812c-de511b7643e0 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:37.919794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:37.920727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:37.921034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:37.921249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] PATH_INFO: `/v3/projects/54445abc95ac452287a14122aac23505` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:37.922610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54445abc95ac452287a14122aac23505)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:37.924853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:38.025577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54445abc95ac452287a14122aac23505', 'request_id': 'req-3d0de564-0363-489f-b867-b41be96b4740'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.041445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54445abc95ac452287a14122aac23505', 'request_id': 'req-3d0de564-0363-489f-b867-b41be96b4740'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.057764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54445abc95ac452287a14122aac23505', 'request_id': 'req-3d0de564-0363-489f-b867-b41be96b4740'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.080615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] The token cache is being invalidate because project 54445abc95ac452287a14122aac23505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:38.081404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.082186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.084834 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2706/5391] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:37 2022] DELETE /identity/v3/projects/54445abc95ac452287a14122aac23505 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:38.090606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:38.103877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2376cd-4f97-4ca3-b5a6-9af88fe854d3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:38.197689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:38.211045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:38.211231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:38.211565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] PATH_INFO: `/v3/users/241cd5ade1b446cab420244eda7ff05b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:38.218181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] RBAC: Authorizing `identity:delete_user(user_id=241cd5ade1b446cab420244eda7ff05b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:38.220469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:38.311350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241cd5ade1b446cab420244eda7ff05b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.312124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241cd5ade1b446cab420244eda7ff05b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.312933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241cd5ade1b446cab420244eda7ff05b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.333955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241cd5ade1b446cab420244eda7ff05b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.344482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-619181a3-301b-4da6-9bb3-f87d063a517f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241cd5ade1b446cab420244eda7ff05b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:38.372136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2686/5392] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:38 2022] DELETE /identity/v3/users/241cd5ade1b446cab420244eda7ff05b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:38.879095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:38.883494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:38.915529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0de564-0363-489f-b867-b41be96b4740 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:39.002551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:39.003720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.004314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.005348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] PATH_INFO: `/v3/projects/0fb8cbf5c97c4753bb1824f14baeb120` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.007178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb8cbf5c97c4753bb1824f14baeb120)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:39.010406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:39.087305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb8cbf5c97c4753bb1824f14baeb120', 'request_id': 'req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:39.095857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb8cbf5c97c4753bb1824f14baeb120', 'request_id': 'req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:39.110364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb8cbf5c97c4753bb1824f14baeb120', 'request_id': 'req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:39.135744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] The token cache is being invalidate because project 0fb8cbf5c97c4753bb1824f14baeb120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:39.136321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:39.137721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b6f05c4-84c1-483f-a5e3-1f42b93f52ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:39.140156 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2707/5393] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:38 2022] DELETE /identity/v3/projects/0fb8cbf5c97c4753bb1824f14baeb120 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:39.146931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8b00-12a1-483b-a4b1-ed098057655b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.147170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8b00-12a1-483b-a4b1-ed098057655b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.148995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8b00-12a1-483b-a4b1-ed098057655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.183230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-97ec8b00-12a1-483b-a4b1-ed098057655b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:39.184868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-97ec8b00-12a1-483b-a4b1-ed098057655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:39.280604 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2687/5394] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:39.290145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13868b-54d6-44dc-b1a2-2f850f2eb491 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.293152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13868b-54d6-44dc-b1a2-2f850f2eb491 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.293555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13868b-54d6-44dc-b1a2-2f850f2eb491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.321022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5e13868b-54d6-44dc-b1a2-2f850f2eb491 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:39.323372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e13868b-54d6-44dc-b1a2-2f850f2eb491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:39.335067 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2708/5395] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:39.340121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec8b00-12a1-483b-a4b1-ed098057655b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:39.351864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec8b00-12a1-483b-a4b1-ed098057655b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:39.357425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:39.358701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.359051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.359407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.360223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:39.360640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:39.362545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:39.378615 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2688/5396] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:39.384032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13868b-54d6-44dc-b1a2-2f850f2eb491 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:39.395739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13868b-54d6-44dc-b1a2-2f850f2eb491 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:39.401861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9738cf-3d9a-48ff-971d-00ae82e0a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:39.402539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9738cf-3d9a-48ff-971d-00ae82e0a2af admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.402855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9738cf-3d9a-48ff-971d-00ae82e0a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.403107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9738cf-3d9a-48ff-971d-00ae82e0a2af admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.403810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9738cf-3d9a-48ff-971d-00ae82e0a2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:39.406755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9738cf-3d9a-48ff-971d-00ae82e0a2af admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:39.438196 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2709/5397] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:39 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:39.442860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:39.453842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31472adc-3297-4c33-bbec-7ecdba4e444c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:39.520220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99332ee7-1869-48d8-9f01-0262157fd53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:39.521644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99332ee7-1869-48d8-9f01-0262157fd53d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.522075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99332ee7-1869-48d8-9f01-0262157fd53d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.522317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99332ee7-1869-48d8-9f01-0262157fd53d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.523033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99332ee7-1869-48d8-9f01-0262157fd53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:39.525119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99332ee7-1869-48d8-9f01-0262157fd53d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:39.550874 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2689/5398] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:39 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:39.554795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9738cf-3d9a-48ff-971d-00ae82e0a2af admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:39.566278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9738cf-3d9a-48ff-971d-00ae82e0a2af admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:39.573037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c60e42-250c-4ceb-ba12-fd42336a6caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:39.574104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60e42-250c-4ceb-ba12-fd42336a6caf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.574332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60e42-250c-4ceb-ba12-fd42336a6caf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.574728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60e42-250c-4ceb-ba12-fd42336a6caf admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.575543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c60e42-250c-4ceb-ba12-fd42336a6caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:39.577344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c60e42-250c-4ceb-ba12-fd42336a6caf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:39.591398 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2710/5399] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:39.595404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99332ee7-1869-48d8-9f01-0262157fd53d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:39.606343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99332ee7-1869-48d8-9f01-0262157fd53d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:39.612121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b5bde-d823-4a4f-ad8f-9e8a5035348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:39.613029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b5bde-d823-4a4f-ad8f-9e8a5035348a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.613500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b5bde-d823-4a4f-ad8f-9e8a5035348a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.614633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b5bde-d823-4a4f-ad8f-9e8a5035348a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.615544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b5bde-d823-4a4f-ad8f-9e8a5035348a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:39.617344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b5bde-d823-4a4f-ad8f-9e8a5035348a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:39.629374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2690/5400] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:39.633858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c60e42-250c-4ceb-ba12-fd42336a6caf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:39.648828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c60e42-250c-4ceb-ba12-fd42336a6caf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:39.655183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:39.656378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.656845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.657390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] PATH_INFO: `/v3/projects/662ba7222f29447f96e77acbe3cc19e4/users/e9ded92b708a429f96d0dcb6d6b5d197/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.679205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662ba7222f29447f96e77acbe3cc19e4, user_id=e9ded92b708a429f96d0dcb6d6b5d197, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:39.683434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:39.706706 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2711/5401] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:39 2022] PUT /identity/v3/projects/662ba7222f29447f96e77acbe3cc19e4/users/e9ded92b708a429f96d0dcb6d6b5d197/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:39.717925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d2b2c-06df-4055-8a63-11552087a751 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.718309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d2b2c-06df-4055-8a63-11552087a751 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.718822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d2b2c-06df-4055-8a63-11552087a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.759525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8c4d2b2c-06df-4055-8a63-11552087a751 None None] MFA Rules not processed for user `e9ded92b708a429f96d0dcb6d6b5d197`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:39.761065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8c4d2b2c-06df-4055-8a63-11552087a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:39.804380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:39.806915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:39.891870 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2691/5402] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:39.903013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d2b2c-06df-4055-8a63-11552087a751 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:39.904858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8c4d2b2c-06df-4055-8a63-11552087a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:39.969254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70db3-b2d7-4d00-adf7-e58eb6ea2f73 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:39.979830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:39.981821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:39.983623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:39.984820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] PATH_INFO: `/v3/users/06d114f732524806aef02b8091c1adfa` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:39.986969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d114f732524806aef02b8091c1adfa)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:39.992784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:40.023205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d2b2c-06df-4055-8a63-11552087a751 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:40.029201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abcf72-47e1-4aef-ad6e-44efc02323f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:40.030013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abcf72-47e1-4aef-ad6e-44efc02323f7 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:40.030404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abcf72-47e1-4aef-ad6e-44efc02323f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:40.030955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abcf72-47e1-4aef-ad6e-44efc02323f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:40.061153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abcf72-47e1-4aef-ad6e-44efc02323f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:40.064807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abcf72-47e1-4aef-ad6e-44efc02323f7 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:40.078098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d114f732524806aef02b8091c1adfa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.087984 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2692/5403] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:40.106348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d114f732524806aef02b8091c1adfa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.120413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abcf72-47e1-4aef-ad6e-44efc02323f7 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:40.132538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d114f732524806aef02b8091c1adfa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.135770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d114f732524806aef02b8091c1adfa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.137565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abcf72-47e1-4aef-ad6e-44efc02323f7 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:40.139136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1c510292-103c-482d-8c6b-3f46a1be9761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d114f732524806aef02b8091c1adfa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.162448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:40.163453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:40.163715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:40.164050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] PATH_INFO: `/v3/users/e9ded92b708a429f96d0dcb6d6b5d197` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:40.169012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ded92b708a429f96d0dcb6d6b5d197)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:40.170858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:40.182911 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2712/5404] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:39 2022] DELETE /identity/v3/users/06d114f732524806aef02b8091c1adfa => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:40.185440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e66-abe6-454a-ab2a-30911c072e9e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:40.185734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e66-abe6-454a-ab2a-30911c072e9e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:40.186022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e66-abe6-454a-ab2a-30911c072e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:40.214191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6c798e66-abe6-454a-ab2a-30911c072e9e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:40.215827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6c798e66-abe6-454a-ab2a-30911c072e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:40.267704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ded92b708a429f96d0dcb6d6b5d197'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.276698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ded92b708a429f96d0dcb6d6b5d197'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.279260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ded92b708a429f96d0dcb6d6b5d197'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.295643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ded92b708a429f96d0dcb6d6b5d197'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.306022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ded92b708a429f96d0dcb6d6b5d197'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:40.330941 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2713/5405] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:40.332425 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2693/5406] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:40 2022] DELETE /identity/v3/users/e9ded92b708a429f96d0dcb6d6b5d197 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:40.340068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4dcd4-9a0a-4c51-ad1c-680bc1cb84eb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:40.340400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4dcd4-9a0a-4c51-ad1c-680bc1cb84eb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:40.340759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4dcd4-9a0a-4c51-ad1c-680bc1cb84eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:40.362590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-57d4dcd4-9a0a-4c51-ad1c-680bc1cb84eb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:40.363965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-57d4dcd4-9a0a-4c51-ad1c-680bc1cb84eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:40.377978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:40.382135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:40.455352 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2714/5407] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:40.465881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4dcd4-9a0a-4c51-ad1c-680bc1cb84eb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:40.469483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-57d4dcd4-9a0a-4c51-ad1c-680bc1cb84eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:40.501152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94608186-66ac-4add-84d3-51a053f0e533 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:40.509554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:40.511363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:40.511731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:40.512084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:40.527784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:40.529371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:40.543613 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2694/5408] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:40.545685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4dcd4-9a0a-4c51-ad1c-680bc1cb84eb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:40.552616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b3b71-41fc-48f8-8019-147ab28f4526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:40.553438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b3b71-41fc-48f8-8019-147ab28f4526 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:40.553783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b3b71-41fc-48f8-8019-147ab28f4526 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:40.554088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b3b71-41fc-48f8-8019-147ab28f4526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:40.567505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b3b71-41fc-48f8-8019-147ab28f4526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:40.569163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b3b71-41fc-48f8-8019-147ab28f4526 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:40.585021 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2715/5409] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:40.937332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:40.938848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:40.956403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ef80-4497-4693-8b1e-1f17d7fb1966 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:40.963239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:40.964501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:40.964957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:40.968787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] PATH_INFO: `/v3/projects/662ba7222f29447f96e77acbe3cc19e4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:40.974143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662ba7222f29447f96e77acbe3cc19e4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:40.977824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:41.049415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662ba7222f29447f96e77acbe3cc19e4', 'request_id': 'req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.058042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662ba7222f29447f96e77acbe3cc19e4', 'request_id': 'req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.068205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662ba7222f29447f96e77acbe3cc19e4', 'request_id': 'req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.084810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] The token cache is being invalidate because project 662ba7222f29447f96e77acbe3cc19e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:41.085250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.086327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-beb78f1a-f1cb-4837-831b-c4c88ebef0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.089235 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2695/5410] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:40 2022] DELETE /identity/v3/projects/662ba7222f29447f96e77acbe3cc19e4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:41.099151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7063ea-be71-4aec-a9c6-cdb8e385f51d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.099626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7063ea-be71-4aec-a9c6-cdb8e385f51d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.100102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7063ea-be71-4aec-a9c6-cdb8e385f51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:41.142685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7f7063ea-be71-4aec-a9c6-cdb8e385f51d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:41.147582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7f7063ea-be71-4aec-a9c6-cdb8e385f51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:41.263392 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2716/5411] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:41.274227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765507a-ce9a-4d64-8a30-9a330172d4f7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.274524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765507a-ce9a-4d64-8a30-9a330172d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.274794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765507a-ce9a-4d64-8a30-9a330172d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:41.303037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9765507a-ce9a-4d64-8a30-9a330172d4f7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:41.304779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9765507a-ce9a-4d64-8a30-9a330172d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:41.313775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7063ea-be71-4aec-a9c6-cdb8e385f51d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:41.315348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7f7063ea-be71-4aec-a9c6-cdb8e385f51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:41.331437 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2696/5412] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:41.337449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765507a-ce9a-4d64-8a30-9a330172d4f7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:41.347019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7063ea-be71-4aec-a9c6-cdb8e385f51d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:41.366290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765507a-ce9a-4d64-8a30-9a330172d4f7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:41.367598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:41.371159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.374215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.374579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] PATH_INFO: `/v3/projects/fe922c59496340b484fcbc21e6b98aa1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:41.376199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe922c59496340b484fcbc21e6b98aa1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:41.384806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:41.385863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:41.387425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.387935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.388876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:41.389827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:41.390320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:41.392294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:41.418796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2697/5413] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:41.425410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:41.458808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7877d2-b275-4a93-a143-92d96a37de52 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:41.466659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe922c59496340b484fcbc21e6b98aa1', 'request_id': 'req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.481543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe922c59496340b484fcbc21e6b98aa1', 'request_id': 'req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.496755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe922c59496340b484fcbc21e6b98aa1', 'request_id': 'req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.522148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] The token cache is being invalidate because project fe922c59496340b484fcbc21e6b98aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:41.522571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.523559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.525775 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2717/5414] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:41 2022] DELETE /identity/v3/projects/fe922c59496340b484fcbc21e6b98aa1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:41.533363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:41.535129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:41.553890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:41.554693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.554981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.555286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:41.556031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:41.558168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:41.613467 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2698/5415] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:41 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:41.614787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:41.617252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:41.700130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d658bb-5f0c-4661-a6aa-0a20e3c6d472 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:41.767306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd780-e224-424d-b760-dbd43c756639 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:41.777756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184943a-591b-458b-8c78-09185ea87b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:41.780914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184943a-591b-458b-8c78-09185ea87b95 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.781209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184943a-591b-458b-8c78-09185ea87b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.782425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184943a-591b-458b-8c78-09185ea87b95 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:41.788950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184943a-591b-458b-8c78-09185ea87b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:41.792447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184943a-591b-458b-8c78-09185ea87b95 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:41.853350 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2699/5416] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:41 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:41.854079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:41.855517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.855517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.855795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] PATH_INFO: `/v3/users/7b270d7d34f24cf0b129c10feb7068c1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:41.858722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184943a-591b-458b-8c78-09185ea87b95 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:41.866556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b270d7d34f24cf0b129c10feb7068c1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:41.869660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:41.890598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184943a-591b-458b-8c78-09185ea87b95 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:41.905147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aff5c6-1ebd-4b40-9a68-4a773c30facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:41.905869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aff5c6-1ebd-4b40-9a68-4a773c30facb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.906481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aff5c6-1ebd-4b40-9a68-4a773c30facb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.906481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aff5c6-1ebd-4b40-9a68-4a773c30facb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:41.907177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aff5c6-1ebd-4b40-9a68-4a773c30facb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:41.913641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aff5c6-1ebd-4b40-9a68-4a773c30facb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:41.948788 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2700/5417] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:41.953987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aff5c6-1ebd-4b40-9a68-4a773c30facb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:41.963519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b270d7d34f24cf0b129c10feb7068c1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:41.965389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aff5c6-1ebd-4b40-9a68-4a773c30facb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:41.983547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:41.985253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:41.986066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:41.986744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:42.003479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:42.012148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b270d7d34f24cf0b129c10feb7068c1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:42.016144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:42.026163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b270d7d34f24cf0b129c10feb7068c1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:42.028447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b270d7d34f24cf0b129c10feb7068c1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:42.029284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f16804b-308c-49bf-abc8-0f61bc59aa72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b270d7d34f24cf0b129c10feb7068c1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:42.049474 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2701/5418] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:42.054926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:42.058253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:42.065731 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2718/5419] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:41 2022] DELETE /identity/v3/users/7b270d7d34f24cf0b129c10feb7068c1 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:42.085395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c51d2-0502-4c19-a73e-e7673a50be1d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:42.232047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:42.233074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:42.234107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:42.234468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] PATH_INFO: `/v3/projects/817d9ee0a83c4d7bb3f89e39672b3ce8/users/98e561dfb87f4d7b8bdac1b469ed2c90/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:42.260714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=817d9ee0a83c4d7bb3f89e39672b3ce8, user_id=98e561dfb87f4d7b8bdac1b469ed2c90, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:42.266277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:42.314474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f169601-dda7-4923-a3ed-09dd89476f49 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:42.315314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f169601-dda7-4923-a3ed-09dd89476f49 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:42.315435 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2702/5420] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:42 2022] PUT /identity/v3/projects/817d9ee0a83c4d7bb3f89e39672b3ce8/users/98e561dfb87f4d7b8bdac1b469ed2c90/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:42.315532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f169601-dda7-4923-a3ed-09dd89476f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:42.376871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4f169601-dda7-4923-a3ed-09dd89476f49 None None] MFA Rules not processed for user `98e561dfb87f4d7b8bdac1b469ed2c90`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:42.379918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4f169601-dda7-4923-a3ed-09dd89476f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:42.581140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2719/5421] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:42.591696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:42.593603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:42.653040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed982e6-f85a-4a1d-a70b-a63fba1c1e33 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:42.653608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed982e6-f85a-4a1d-a70b-a63fba1c1e33 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:42.654120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed982e6-f85a-4a1d-a70b-a63fba1c1e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:42.684981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-eed982e6-f85a-4a1d-a70b-a63fba1c1e33 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:42.685845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eed982e6-f85a-4a1d-a70b-a63fba1c1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:42.767932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a205a4b-02b6-4942-8379-5005d3017f0f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:42.773026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:42.773815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:42.774098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:42.774370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:42.786944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:42.789018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:42.810974 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2703/5422] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:42.824785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:42.837814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:42.850703 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2720/5423] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:42.852766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed982e6-f85a-4a1d-a70b-a63fba1c1e33 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:42.854704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eed982e6-f85a-4a1d-a70b-a63fba1c1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:42.966624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed982e6-f85a-4a1d-a70b-a63fba1c1e33 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:42.970430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda89e84-7a73-45c5-bb70-c3d41e9a918c service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:42.973498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:42.975804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:42.976369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:42.976848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] PATH_INFO: `/v3/projects/f8a8d266446444f089c5b7f12751d137` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:42.978022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:42.978364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a8d266446444f089c5b7f12751d137)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:42.979261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:42.979597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:42.980493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:42.980819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] PATH_INFO: `/v3/users/fad7207822c04fc289709200d7e2bd2d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:42.981934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad7207822c04fc289709200d7e2bd2d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:42.984222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:43.044204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a8d266446444f089c5b7f12751d137', 'request_id': 'req-21f99d31-a9aa-4c17-bba2-717cd07d9765'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.045656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad7207822c04fc289709200d7e2bd2d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.046487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad7207822c04fc289709200d7e2bd2d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.047180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad7207822c04fc289709200d7e2bd2d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.052435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a8d266446444f089c5b7f12751d137', 'request_id': 'req-21f99d31-a9aa-4c17-bba2-717cd07d9765'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.063488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad7207822c04fc289709200d7e2bd2d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.063909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a8d266446444f089c5b7f12751d137', 'request_id': 'req-21f99d31-a9aa-4c17-bba2-717cd07d9765'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.076356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-99defa08-d55b-43be-8b29-dc6cee3d4b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad7207822c04fc289709200d7e2bd2d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.083166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] The token cache is being invalidate because project f8a8d266446444f089c5b7f12751d137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:43.083549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.084318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.086309 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2721/5424] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:42 2022] DELETE /identity/v3/projects/f8a8d266446444f089c5b7f12751d137 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:43.087284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:43.089163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:43.097277 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2704/5425] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:42 2022] DELETE /identity/v3/users/fad7207822c04fc289709200d7e2bd2d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:43.099343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2dfc-8b45-4a03-97f4-085de9fec816 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.099732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2dfc-8b45-4a03-97f4-085de9fec816 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.100143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba2dfc-8b45-4a03-97f4-085de9fec816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.133601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f6ba2dfc-8b45-4a03-97f4-085de9fec816 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:43.134958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f6ba2dfc-8b45-4a03-97f4-085de9fec816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:43.205986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f99d31-a9aa-4c17-bba2-717cd07d9765 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:43.257963 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2705/5426] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:43.267705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534af0-f8dc-4a3d-a64f-d6e1f8b64fe8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.268299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534af0-f8dc-4a3d-a64f-d6e1f8b64fe8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.268878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534af0-f8dc-4a3d-a64f-d6e1f8b64fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.316363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:43.316363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.316363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.317806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.321451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:43.332525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-37534af0-f8dc-4a3d-a64f-d6e1f8b64fe8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:43.337180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-37534af0-f8dc-4a3d-a64f-d6e1f8b64fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:43.350930 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2706/5427] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:43.355787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37534af0-f8dc-4a3d-a64f-d6e1f8b64fe8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:43.371322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37534af0-f8dc-4a3d-a64f-d6e1f8b64fe8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:43.378829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:43.380472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.380772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.381139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.382094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:43.382424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:43.384411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:43.404430 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2707/5428] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:43.405473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:43.407641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:43.420387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:43.422325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:43.433284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98e59e-bbc8-4962-bfc7-542d4df45bdb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:43.440702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:43.441695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.442305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.442705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] PATH_INFO: `/v3/projects/e4e370ef28034ffbbbee9d2cfd826084` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.443498 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2722/5429] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:09:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:43.444243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:43.444475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e370ef28034ffbbbee9d2cfd826084)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:43.446924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:43.456905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7212bb-324b-421e-bbf6-9f8e8e3bd9f2 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:43.466375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015274-2f03-4cb5-ac59-a9fa1bb06a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:43.467152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015274-2f03-4cb5-ac59-a9fa1bb06a6b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.467449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015274-2f03-4cb5-ac59-a9fa1bb06a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.467716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015274-2f03-4cb5-ac59-a9fa1bb06a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.468471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19015274-2f03-4cb5-ac59-a9fa1bb06a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:43.470375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19015274-2f03-4cb5-ac59-a9fa1bb06a6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:43.524159 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2723/5430] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:43 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:43.534327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015274-2f03-4cb5-ac59-a9fa1bb06a6b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:43.585755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e370ef28034ffbbbee9d2cfd826084', 'request_id': 'req-5dbd7a45-7b9e-4034-b593-475b34c27cb0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.595080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e370ef28034ffbbbee9d2cfd826084', 'request_id': 'req-5dbd7a45-7b9e-4034-b593-475b34c27cb0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.615088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e370ef28034ffbbbee9d2cfd826084', 'request_id': 'req-5dbd7a45-7b9e-4034-b593-475b34c27cb0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.637538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] The token cache is being invalidate because project e4e370ef28034ffbbbee9d2cfd826084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:43.638080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.639310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5dbd7a45-7b9e-4034-b593-475b34c27cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:43.646585 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2708/5431] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:43 2022] DELETE /identity/v3/projects/e4e370ef28034ffbbbee9d2cfd826084 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:43.649786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f170c-6a0a-4c66-8286-105a12e8c9de None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.650270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f170c-6a0a-4c66-8286-105a12e8c9de None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.650667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f170c-6a0a-4c66-8286-105a12e8c9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.669742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015274-2f03-4cb5-ac59-a9fa1bb06a6b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:43.676610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d49f170c-6a0a-4c66-8286-105a12e8c9de None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:43.678458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d49f170c-6a0a-4c66-8286-105a12e8c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:43.779421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:43.780695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.781175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.781653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.782568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:43.784940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:43.826841 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2724/5432] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:43 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:43.832079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:43.835276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:43.837767 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2709/5433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:43.839988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b908a-8781-44be-9f94-4f0371513c80 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.843048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b908a-8781-44be-9f94-4f0371513c80 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.843458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b908a-8781-44be-9f94-4f0371513c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.861897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6687-5c0a-4ed9-bd50-cac0dbbc1a68 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:43.869728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b73e7-db45-4f70-a635-ca9acbeb3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:43.872767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b73e7-db45-4f70-a635-ca9acbeb3f20 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.873816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b73e7-db45-4f70-a635-ca9acbeb3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.875036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b73e7-db45-4f70-a635-ca9acbeb3f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.881471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b73e7-db45-4f70-a635-ca9acbeb3f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:43.886764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b73e7-db45-4f70-a635-ca9acbeb3f20 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:43.901389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e02b908a-8781-44be-9f94-4f0371513c80 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:43.903249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e02b908a-8781-44be-9f94-4f0371513c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:43.930263 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2710/5434] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:43.935428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b908a-8781-44be-9f94-4f0371513c80 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:43.951657 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2725/5435] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:43.952134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b908a-8781-44be-9f94-4f0371513c80 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:43.965950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b73e7-db45-4f70-a635-ca9acbeb3f20 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:43.967234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:43.968018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:43.968508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:43.968992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:43.970061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:43.971675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:43.975282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.008080 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2711/5436] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:44.009702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.021860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b73e7-db45-4f70-a635-ca9acbeb3f20 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.034373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47849-bfbc-43de-a2e9-aa9f0df36c0e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.039924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebfeea-1bfe-403f-ae2d-1c1213966551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.041727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebfeea-1bfe-403f-ae2d-1c1213966551 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.042165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebfeea-1bfe-403f-ae2d-1c1213966551 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.042456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebfeea-1bfe-403f-ae2d-1c1213966551 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.046638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a69d18-da12-49bd-b500-0593029a5877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.047887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69d18-da12-49bd-b500-0593029a5877 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.048424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69d18-da12-49bd-b500-0593029a5877 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.049071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69d18-da12-49bd-b500-0593029a5877 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.053000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a69d18-da12-49bd-b500-0593029a5877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.055261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a69d18-da12-49bd-b500-0593029a5877 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.055596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebfeea-1bfe-403f-ae2d-1c1213966551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.064753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebfeea-1bfe-403f-ae2d-1c1213966551 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.098037 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2726/5437] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:44.099666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebfeea-1bfe-403f-ae2d-1c1213966551 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.116192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebfeea-1bfe-403f-ae2d-1c1213966551 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.122808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e31e0-6bd4-4877-81de-327f7b6320d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.126648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e31e0-6bd4-4877-81de-327f7b6320d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.126959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e31e0-6bd4-4877-81de-327f7b6320d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.127739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e31e0-6bd4-4877-81de-327f7b6320d4 admin admin] PATH_INFO: `/v3/projects/991178f94bdc40b69af75ce8c36ab5b9/users/23571a2bdce54e46b86c89ae723dae1a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.139812 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2712/5438] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:44 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:44.141669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a69d18-da12-49bd-b500-0593029a5877 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.153414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e31e0-6bd4-4877-81de-327f7b6320d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991178f94bdc40b69af75ce8c36ab5b9, user_id=23571a2bdce54e46b86c89ae723dae1a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.156499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e31e0-6bd4-4877-81de-327f7b6320d4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.188417 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2727/5439] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:44 2022] PUT /identity/v3/projects/991178f94bdc40b69af75ce8c36ab5b9/users/23571a2bdce54e46b86c89ae723dae1a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:44.205252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55460eb-de50-45db-9581-018c2a82e8d9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.205748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55460eb-de50-45db-9581-018c2a82e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.205923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55460eb-de50-45db-9581-018c2a82e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.239837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a69d18-da12-49bd-b500-0593029a5877 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.264254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d55460eb-de50-45db-9581-018c2a82e8d9 None None] MFA Rules not processed for user `23571a2bdce54e46b86c89ae723dae1a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:44.268703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d55460eb-de50-45db-9581-018c2a82e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:44.345312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a171f-3bb1-491f-bab7-3c75307b7c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.346503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a171f-3bb1-491f-bab7-3c75307b7c86 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.347281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a171f-3bb1-491f-bab7-3c75307b7c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.348072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a171f-3bb1-491f-bab7-3c75307b7c86 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.350983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a171f-3bb1-491f-bab7-3c75307b7c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.353860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a171f-3bb1-491f-bab7-3c75307b7c86 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.403360 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2713/5440] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:44 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:44.404600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a171f-3bb1-491f-bab7-3c75307b7c86 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.418645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a171f-3bb1-491f-bab7-3c75307b7c86 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.427907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28253870-3bee-4d56-9f02-bc05032eabe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.429529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253870-3bee-4d56-9f02-bc05032eabe7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.429820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253870-3bee-4d56-9f02-bc05032eabe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.430103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253870-3bee-4d56-9f02-bc05032eabe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.432899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28253870-3bee-4d56-9f02-bc05032eabe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.434947 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2728/5441] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:44.435446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28253870-3bee-4d56-9f02-bc05032eabe7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.439615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55460eb-de50-45db-9581-018c2a82e8d9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.452617 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2714/5442] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:44.454227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28253870-3bee-4d56-9f02-bc05032eabe7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.466208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55460eb-de50-45db-9581-018c2a82e8d9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.470632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28253870-3bee-4d56-9f02-bc05032eabe7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.476797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c980aa-e506-4c39-8bd7-931daea79ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.477482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c980aa-e506-4c39-8bd7-931daea79ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.477764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c980aa-e506-4c39-8bd7-931daea79ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.478039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c980aa-e506-4c39-8bd7-931daea79ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.478894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c980aa-e506-4c39-8bd7-931daea79ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.479595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a014d-696a-4240-ad99-d7270e95843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.480703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a014d-696a-4240-ad99-d7270e95843e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.481044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c980aa-e506-4c39-8bd7-931daea79ce5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.481839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a014d-696a-4240-ad99-d7270e95843e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.482279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a014d-696a-4240-ad99-d7270e95843e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.482921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a014d-696a-4240-ad99-d7270e95843e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.485176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a014d-696a-4240-ad99-d7270e95843e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.499383 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2715/5443] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:44.506276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a014d-696a-4240-ad99-d7270e95843e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.521419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a014d-696a-4240-ad99-d7270e95843e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.524230 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2729/5444] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:44 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:44.528815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c980aa-e506-4c39-8bd7-931daea79ce5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.627498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaebb1-22a2-48fe-8de4-8ddfcf698e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.628399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaebb1-22a2-48fe-8de4-8ddfcf698e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.628758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaebb1-22a2-48fe-8de4-8ddfcf698e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.629068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaebb1-22a2-48fe-8de4-8ddfcf698e2f admin admin] PATH_INFO: `/v3/projects/7097138db348491089709bb37f2eff92/users/452340e5dd004bbba6b7ae6877866e02/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.631456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c980aa-e506-4c39-8bd7-931daea79ce5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.646920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cba03-d9ab-4acf-8d1d-6eb123fec80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.647616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cba03-d9ab-4acf-8d1d-6eb123fec80c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.648264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cba03-d9ab-4acf-8d1d-6eb123fec80c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.649116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaebb1-22a2-48fe-8de4-8ddfcf698e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7097138db348491089709bb37f2eff92, user_id=452340e5dd004bbba6b7ae6877866e02, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.650338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cba03-d9ab-4acf-8d1d-6eb123fec80c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.650941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cba03-d9ab-4acf-8d1d-6eb123fec80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.652893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cba03-d9ab-4acf-8d1d-6eb123fec80c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.656431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaebb1-22a2-48fe-8de4-8ddfcf698e2f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.699364 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2716/5445] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:44 2022] PUT /identity/v3/projects/7097138db348491089709bb37f2eff92/users/452340e5dd004bbba6b7ae6877866e02/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:44.703198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b61b1-7f8a-4f2f-afd8-6ebed92e7df3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.703908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b61b1-7f8a-4f2f-afd8-6ebed92e7df3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.706425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b61b1-7f8a-4f2f-afd8-6ebed92e7df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.715060 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2730/5446] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:44 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:44.716143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cba03-d9ab-4acf-8d1d-6eb123fec80c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.742411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cba03-d9ab-4acf-8d1d-6eb123fec80c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.749465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-537b61b1-7f8a-4f2f-afd8-6ebed92e7df3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:44.751160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-537b61b1-7f8a-4f2f-afd8-6ebed92e7df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:44.849751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc31f3-d198-4d99-84a2-17387d6b22b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.850094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc31f3-d198-4d99-84a2-17387d6b22b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.850613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc31f3-d198-4d99-84a2-17387d6b22b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.850973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc31f3-d198-4d99-84a2-17387d6b22b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.852065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc31f3-d198-4d99-84a2-17387d6b22b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.857047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc31f3-d198-4d99-84a2-17387d6b22b5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:44.877711 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2731/5447] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:44.881994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc31f3-d198-4d99-84a2-17387d6b22b5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.892526 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2717/5448] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:44.902598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b61b1-7f8a-4f2f-afd8-6ebed92e7df3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:44.906431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-537b61b1-7f8a-4f2f-afd8-6ebed92e7df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:44.908634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc31f3-d198-4d99-84a2-17387d6b22b5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:44.930515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e72797-deca-42f0-865f-10818d6e1d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:44.932883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72797-deca-42f0-865f-10818d6e1d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:44.933252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72797-deca-42f0-865f-10818d6e1d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:44.934361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72797-deca-42f0-865f-10818d6e1d63 admin admin] PATH_INFO: `/v3/projects/fee5cd2a8302459bbd904e691cbfffb5/users/3205f4eb387a4924aafcfa7a244424e5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:44.981779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e72797-deca-42f0-865f-10818d6e1d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee5cd2a8302459bbd904e691cbfffb5, user_id=3205f4eb387a4924aafcfa7a244424e5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:44.986010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e72797-deca-42f0-865f-10818d6e1d63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:45.020502 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2732/5449] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:44 2022] PUT /identity/v3/projects/fee5cd2a8302459bbd904e691cbfffb5/users/3205f4eb387a4924aafcfa7a244424e5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:45.026995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e72797-deca-42f0-865f-10818d6e1d63 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:45.030839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b61b1-7f8a-4f2f-afd8-6ebed92e7df3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:45.149994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:45.150905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:45.151230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:45.152398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:45.174609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e72797-deca-42f0-865f-10818d6e1d63 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:45.189790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1495f-a9a4-46e5-accf-ebcb70d71405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:45.190763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1495f-a9a4-46e5-accf-ebcb70d71405 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:45.191271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1495f-a9a4-46e5-accf-ebcb70d71405 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:45.191729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1495f-a9a4-46e5-accf-ebcb70d71405 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:45.194323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1495f-a9a4-46e5-accf-ebcb70d71405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:45.202902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1495f-a9a4-46e5-accf-ebcb70d71405 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:45.222907 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2733/5450] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:45.228497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1495f-a9a4-46e5-accf-ebcb70d71405 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:45.249821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1495f-a9a4-46e5-accf-ebcb70d71405 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:45.261084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a711880-02a0-4dc9-894a-a9a40ea029f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:45.261999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a711880-02a0-4dc9-894a-a9a40ea029f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:45.262291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a711880-02a0-4dc9-894a-a9a40ea029f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:45.262578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a711880-02a0-4dc9-894a-a9a40ea029f9 admin admin] PATH_INFO: `/v3/projects/fee5cd2a8302459bbd904e691cbfffb5/users/3205f4eb387a4924aafcfa7a244424e5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:45.266157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a711880-02a0-4dc9-894a-a9a40ea029f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee5cd2a8302459bbd904e691cbfffb5, user_id=3205f4eb387a4924aafcfa7a244424e5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:45.272206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a711880-02a0-4dc9-894a-a9a40ea029f9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:45.303759 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2734/5451] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:45 2022] PUT /identity/v3/projects/fee5cd2a8302459bbd904e691cbfffb5/users/3205f4eb387a4924aafcfa7a244424e5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:45.322301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba7fa-b88b-4cd4-a144-732f1e167841 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:45.322539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba7fa-b88b-4cd4-a144-732f1e167841 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:45.322794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba7fa-b88b-4cd4-a144-732f1e167841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:45.326032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:45.327716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:45.340760 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2718/5452] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:45.402373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-164ba7fa-b88b-4cd4-a144-732f1e167841 None None] MFA Rules not processed for user `3205f4eb387a4924aafcfa7a244424e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:45.410069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-164ba7fa-b88b-4cd4-a144-732f1e167841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:45.628795 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2735/5453] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:45.644420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:45.647532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:45.764313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea07c-ac52-4792-9680-b0fc81462e61 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:45.864564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fefa3-a6e6-4662-9aed-12d806063cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:45.865543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fefa3-a6e6-4662-9aed-12d806063cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:45.866041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fefa3-a6e6-4662-9aed-12d806063cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:45.866535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fefa3-a6e6-4662-9aed-12d806063cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:45.885376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fefa3-a6e6-4662-9aed-12d806063cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:45.888361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fefa3-a6e6-4662-9aed-12d806063cc8 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:45.908994 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2719/5454] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:45.972837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edb7a8-f9c9-4938-aeda-5042ed5dc330 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:45.973279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edb7a8-f9c9-4938-aeda-5042ed5dc330 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:45.974157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edb7a8-f9c9-4938-aeda-5042ed5dc330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:46.042031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-91edb7a8-f9c9-4938-aeda-5042ed5dc330 None None] MFA Rules not processed for user `452340e5dd004bbba6b7ae6877866e02`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:46.043990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-91edb7a8-f9c9-4938-aeda-5042ed5dc330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:46.083266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fefa3-a6e6-4662-9aed-12d806063cc8 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:46.095334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fefa3-a6e6-4662-9aed-12d806063cc8 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:46.107653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:46.108690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:46.109954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:46.109954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:46.177658 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2736/5455] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:46.179841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6101-2891-474b-9da1-b8e4f91cc765 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:46.180138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6101-2891-474b-9da1-b8e4f91cc765 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:46.180539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6101-2891-474b-9da1-b8e4f91cc765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:46.214668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:46.216611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:46.219887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d9fc6101-2891-474b-9da1-b8e4f91cc765 None None] MFA Rules not processed for user `452340e5dd004bbba6b7ae6877866e02`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:46.222894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d9fc6101-2891-474b-9da1-b8e4f91cc765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:46.228821 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2720/5456] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:46.250868 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2737/5457] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:46.265599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:46.268174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:46.368143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427c43-f222-4127-9da4-55df59a49018 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:46.378135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb0f8f-5c1a-4bca-a428-7c38746eb92a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:46.378818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb0f8f-5c1a-4bca-a428-7c38746eb92a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:46.379168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb0f8f-5c1a-4bca-a428-7c38746eb92a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:46.379612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb0f8f-5c1a-4bca-a428-7c38746eb92a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:46.395628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb0f8f-5c1a-4bca-a428-7c38746eb92a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:46.405327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb0f8f-5c1a-4bca-a428-7c38746eb92a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:46.421554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2721/5458] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:48.244840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc6101-2891-474b-9da1-b8e4f91cc765 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:48.401272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc6101-2891-474b-9da1-b8e4f91cc765 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:48.407250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:48.408431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:48.408993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:48.409461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] PATH_INFO: `/v3/users/452340e5dd004bbba6b7ae6877866e02` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:48.411856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452340e5dd004bbba6b7ae6877866e02)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:48.414488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:48.553798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452340e5dd004bbba6b7ae6877866e02'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:48.584654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452340e5dd004bbba6b7ae6877866e02'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:48.604868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452340e5dd004bbba6b7ae6877866e02'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:48.605963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452340e5dd004bbba6b7ae6877866e02'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:48.607447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70169d91-eaee-42be-901b-a7dc4849be83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452340e5dd004bbba6b7ae6877866e02'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:48.651475 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2738/5459] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:48 2022] DELETE /identity/v3/users/452340e5dd004bbba6b7ae6877866e02 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:48.963425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb0f8f-5c1a-4bca-a428-7c38746eb92a service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:48.993583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb0f8f-5c1a-4bca-a428-7c38746eb92a service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:49.077014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:49.078331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:49.078835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:49.079489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] PATH_INFO: `/v3/projects/7097138db348491089709bb37f2eff92` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:49.081838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7097138db348491089709bb37f2eff92)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:49.085255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:49.217931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7097138db348491089709bb37f2eff92', 'request_id': 'req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:49.232877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7097138db348491089709bb37f2eff92', 'request_id': 'req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:49.258185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7097138db348491089709bb37f2eff92', 'request_id': 'req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:49.284239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] The token cache is being invalidate because project 7097138db348491089709bb37f2eff92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:49.284578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:49.287849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9003413b-5e28-4b6c-abe5-9cde99e1aeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:49.292643 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2722/5460] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:48 2022] DELETE /identity/v3/projects/7097138db348491089709bb37f2eff92 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:49.300747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8b0a-a569-4ca2-a4b3-ca699a1d8742 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:49.301339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8b0a-a569-4ca2-a4b3-ca699a1d8742 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:49.301636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8b0a-a569-4ca2-a4b3-ca699a1d8742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:49.357825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ba0b8b0a-a569-4ca2-a4b3-ca699a1d8742 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:49.359361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ba0b8b0a-a569-4ca2-a4b3-ca699a1d8742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:49.624237 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2739/5461] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:49.634979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c430d-f026-4943-af1a-3bfc017ef186 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:49.635268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c430d-f026-4943-af1a-3bfc017ef186 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:49.635549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c430d-f026-4943-af1a-3bfc017ef186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:49.682977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f11c430d-f026-4943-af1a-3bfc017ef186 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:49.684243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f11c430d-f026-4943-af1a-3bfc017ef186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:49.712702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8b0a-a569-4ca2-a4b3-ca699a1d8742 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:49.721555 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2723/5462] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:49.725180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8b0a-a569-4ca2-a4b3-ca699a1d8742 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:49.742334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:49.743111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:49.743406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:49.744212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:49.744999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:49.745318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:49.747704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:49.768514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c430d-f026-4943-af1a-3bfc017ef186 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:49.768885 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2740/5463] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:49.798707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c430d-f026-4943-af1a-3bfc017ef186 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:49.823643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35cb4a-0fac-4ca7-80a9-faa0a31af5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:49.824369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35cb4a-0fac-4ca7-80a9-faa0a31af5da admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:49.824654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35cb4a-0fac-4ca7-80a9-faa0a31af5da admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:49.826117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35cb4a-0fac-4ca7-80a9-faa0a31af5da admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:49.826849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35cb4a-0fac-4ca7-80a9-faa0a31af5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:49.833015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35cb4a-0fac-4ca7-80a9-faa0a31af5da admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:49.924944 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2724/5464] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:49 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:49.926329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:49.956407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146be0a-822b-498c-9763-7af66694ca1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:50.148747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333197-abd3-4d4e-bbfd-ddac0503f778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:50.149464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333197-abd3-4d4e-bbfd-ddac0503f778 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:50.149767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333197-abd3-4d4e-bbfd-ddac0503f778 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:50.150028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333197-abd3-4d4e-bbfd-ddac0503f778 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:50.150738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7333197-abd3-4d4e-bbfd-ddac0503f778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:50.160182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7333197-abd3-4d4e-bbfd-ddac0503f778 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:50.221371 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2741/5465] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:49 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:50.226495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35cb4a-0fac-4ca7-80a9-faa0a31af5da admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:50.245510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35cb4a-0fac-4ca7-80a9-faa0a31af5da admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:50.272737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f8d53-966a-428a-9dc4-c4aebaf7dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:50.275936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f8d53-966a-428a-9dc4-c4aebaf7dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:50.281059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f8d53-966a-428a-9dc4-c4aebaf7dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:50.281347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f8d53-966a-428a-9dc4-c4aebaf7dfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:50.288571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f8d53-966a-428a-9dc4-c4aebaf7dfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:50.290724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f8d53-966a-428a-9dc4-c4aebaf7dfbf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:50.334970 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2725/5466] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:50.338422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333197-abd3-4d4e-bbfd-ddac0503f778 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:50.361974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333197-abd3-4d4e-bbfd-ddac0503f778 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:50.385088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7569d8-c430-468f-9c5f-5586669ef656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:50.385690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7569d8-c430-468f-9c5f-5586669ef656 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:50.385978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7569d8-c430-468f-9c5f-5586669ef656 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:50.386437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7569d8-c430-468f-9c5f-5586669ef656 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:50.387939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7569d8-c430-468f-9c5f-5586669ef656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:50.398984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7569d8-c430-468f-9c5f-5586669ef656 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:50.433299 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2742/5467] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:50.438270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f8d53-966a-428a-9dc4-c4aebaf7dfbf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:50.457382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f8d53-966a-428a-9dc4-c4aebaf7dfbf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:50.479820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ab947-0eda-453d-9a4e-91fc1278f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:50.482118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab947-0eda-453d-9a4e-91fc1278f42d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:50.482470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab947-0eda-453d-9a4e-91fc1278f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:50.483636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab947-0eda-453d-9a4e-91fc1278f42d admin admin] PATH_INFO: `/v3/projects/522b4fc9cc7d415888294667b3fff49f/users/41af8a7ec8ee427a95b97fbb2463c90e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:50.514731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ab947-0eda-453d-9a4e-91fc1278f42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=522b4fc9cc7d415888294667b3fff49f, user_id=41af8a7ec8ee427a95b97fbb2463c90e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:50.521942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ab947-0eda-453d-9a4e-91fc1278f42d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:50.565068 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2726/5468] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:50 2022] PUT /identity/v3/projects/522b4fc9cc7d415888294667b3fff49f/users/41af8a7ec8ee427a95b97fbb2463c90e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:50.583716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b610a-6c3e-4aec-82be-691e3dcb0688 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:50.584864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b610a-6c3e-4aec-82be-691e3dcb0688 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:50.585699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b610a-6c3e-4aec-82be-691e3dcb0688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:50.642266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e62b610a-6c3e-4aec-82be-691e3dcb0688 None None] MFA Rules not processed for user `41af8a7ec8ee427a95b97fbb2463c90e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:50.644539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e62b610a-6c3e-4aec-82be-691e3dcb0688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:50.774757 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2743/5469] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:50.780369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ab947-0eda-453d-9a4e-91fc1278f42d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:50.930091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ab947-0eda-453d-9a4e-91fc1278f42d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:50.943845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd6b5-6beb-42ea-954c-0ed63cc250b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:50.947015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd6b5-6beb-42ea-954c-0ed63cc250b6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:50.947399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd6b5-6beb-42ea-954c-0ed63cc250b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:50.948180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd6b5-6beb-42ea-954c-0ed63cc250b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:50.951905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd6b5-6beb-42ea-954c-0ed63cc250b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:50.956791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd6b5-6beb-42ea-954c-0ed63cc250b6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:51.028373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2727/5470] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:50 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:51.033132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b610a-6c3e-4aec-82be-691e3dcb0688 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:51.047786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b610a-6c3e-4aec-82be-691e3dcb0688 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:51.198393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf6bbf-c035-46dd-9fc1-c173b1affa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:51.199732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf6bbf-c035-46dd-9fc1-c173b1affa41 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:51.200075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf6bbf-c035-46dd-9fc1-c173b1affa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:51.201432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf6bbf-c035-46dd-9fc1-c173b1affa41 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:51.202223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf6bbf-c035-46dd-9fc1-c173b1affa41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:51.204521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf6bbf-c035-46dd-9fc1-c173b1affa41 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:51.255986 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2744/5471] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:51 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:51.261974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd6b5-6beb-42ea-954c-0ed63cc250b6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:51.279878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd6b5-6beb-42ea-954c-0ed63cc250b6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:51.292980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea53e-61d9-4799-a48a-73ad63566f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:51.294040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea53e-61d9-4799-a48a-73ad63566f5f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:51.294624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea53e-61d9-4799-a48a-73ad63566f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:51.295408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea53e-61d9-4799-a48a-73ad63566f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:51.297027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea53e-61d9-4799-a48a-73ad63566f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:51.298994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea53e-61d9-4799-a48a-73ad63566f5f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:51.317770 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2728/5472] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:51.322020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf6bbf-c035-46dd-9fc1-c173b1affa41 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:51.339535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf6bbf-c035-46dd-9fc1-c173b1affa41 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:51.352029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5876a-e4e9-4d55-8ef9-cda8adacf7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:51.353404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5876a-e4e9-4d55-8ef9-cda8adacf7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:51.353695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5876a-e4e9-4d55-8ef9-cda8adacf7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:51.354472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5876a-e4e9-4d55-8ef9-cda8adacf7b3 admin admin] PATH_INFO: `/v3/projects/19a8d74cc39c47878ea60bf1aca386c3/users/16eceee95a3b472d956c73f2d9f81970/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:51.384888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5876a-e4e9-4d55-8ef9-cda8adacf7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a8d74cc39c47878ea60bf1aca386c3, user_id=16eceee95a3b472d956c73f2d9f81970, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:51.389477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5876a-e4e9-4d55-8ef9-cda8adacf7b3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:51.436973 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2745/5473] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:51 2022] PUT /identity/v3/projects/19a8d74cc39c47878ea60bf1aca386c3/users/16eceee95a3b472d956c73f2d9f81970/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:51.441307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea53e-61d9-4799-a48a-73ad63566f5f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:51.466624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea53e-61d9-4799-a48a-73ad63566f5f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:51.622668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8df360-1c3e-423d-b76f-916de5194d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:51.623669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8df360-1c3e-423d-b76f-916de5194d69 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:51.623964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8df360-1c3e-423d-b76f-916de5194d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:51.624317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8df360-1c3e-423d-b76f-916de5194d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:51.625111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8df360-1c3e-423d-b76f-916de5194d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:51.627584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8df360-1c3e-423d-b76f-916de5194d69 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:51.653226 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2729/5474] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:51.659616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5876a-e4e9-4d55-8ef9-cda8adacf7b3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:51.706961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5876a-e4e9-4d55-8ef9-cda8adacf7b3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:51.748534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8987573-4ce4-4f8a-bf8c-205d90ab4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:51.749469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987573-4ce4-4f8a-bf8c-205d90ab4f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:51.749920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987573-4ce4-4f8a-bf8c-205d90ab4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:51.750211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987573-4ce4-4f8a-bf8c-205d90ab4f8a admin admin] PATH_INFO: `/v3/projects/19a8d74cc39c47878ea60bf1aca386c3/users/16eceee95a3b472d956c73f2d9f81970/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:51.752711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8987573-4ce4-4f8a-bf8c-205d90ab4f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a8d74cc39c47878ea60bf1aca386c3, user_id=16eceee95a3b472d956c73f2d9f81970, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:51.756541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8987573-4ce4-4f8a-bf8c-205d90ab4f8a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:51.780588 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2746/5475] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:51 2022] PUT /identity/v3/projects/19a8d74cc39c47878ea60bf1aca386c3/users/16eceee95a3b472d956c73f2d9f81970/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:51.797017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a395c-17b1-42a5-bf97-515cf40302ca None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:51.797132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a395c-17b1-42a5-bf97-515cf40302ca None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:51.797454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a395c-17b1-42a5-bf97-515cf40302ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:51.847967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d26a395c-17b1-42a5-bf97-515cf40302ca None None] MFA Rules not processed for user `16eceee95a3b472d956c73f2d9f81970`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:51.851717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d26a395c-17b1-42a5-bf97-515cf40302ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:51.995679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2730/5476] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:52.108224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8987573-4ce4-4f8a-bf8c-205d90ab4f8a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:52.124321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8987573-4ce4-4f8a-bf8c-205d90ab4f8a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:52.131705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:52.132690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:52.133156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:52.133476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:52.134407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:52.136424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:52.143176 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invalid input for field 'name': '' is too short Feb 19 21:09:52.143176 ncdv-master-1 devstack@keystone.service[96910]: Failed validating 'minLength' in schema['properties']['name']: Feb 19 21:09:52.143176 ncdv-master-1 devstack@keystone.service[96910]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Feb 19 21:09:52.143176 ncdv-master-1 devstack@keystone.service[96910]: On instance['name']: Feb 19 21:09:52.143176 ncdv-master-1 devstack@keystone.service[96910]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Feb 19 21:09:52.144550 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2747/5477] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:09:52 2022] POST /identity/v3/domains => generated 283 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Feb 19 21:09:52.150329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a395c-17b1-42a5-bf97-515cf40302ca None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:52.163007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a395c-17b1-42a5-bf97-515cf40302ca None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:52.169520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:52.171116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:52.171420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:52.171693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:52.172471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:52.174245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:52.188093 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Feb 19 21:09:52.188093 ncdv-master-1 devstack@keystone.service[96909]: Failed validating 'maxLength' in schema['properties']['name']: Feb 19 21:09:52.188093 ncdv-master-1 devstack@keystone.service[96909]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Feb 19 21:09:52.188093 ncdv-master-1 devstack@keystone.service[96909]: On instance['name']: Feb 19 21:09:52.188093 ncdv-master-1 devstack@keystone.service[96909]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Feb 19 21:09:52.195364 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2731/5478] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:09:52 2022] POST /identity/v3/domains => generated 412 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Feb 19 21:09:52.196133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:52.216850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80a95-8290-4773-b328-c4fd12d9ed37 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:52.230650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315abe7-9e5a-4497-b435-db588c7d6521 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:52.232074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315abe7-9e5a-4497-b435-db588c7d6521 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:52.232201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315abe7-9e5a-4497-b435-db588c7d6521 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:52.232537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315abe7-9e5a-4497-b435-db588c7d6521 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:52.234896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315abe7-9e5a-4497-b435-db588c7d6521 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:52.237914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315abe7-9e5a-4497-b435-db588c7d6521 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:52.274757 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2748/5479] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:09:52 2022] POST /identity/v3/domains => generated 275 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:52.278199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:52.289910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d37b-826b-4400-aed3-d7f8dfaafb30 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:52.407057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:52.409356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:52.417277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:52.418689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains/31374fbea4214a72ace1487c9c2a76c0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:52.465541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=31374fbea4214a72ace1487c9c2a76c0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:52.472770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:52.553323 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Feb 19 21:09:52.568684 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2732/5480] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:09:52 2022] DELETE /identity/v3/domains/31374fbea4214a72ace1487c9c2a76c0 => generated 120 bytes in 287 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:09:52.568908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315abe7-9e5a-4497-b435-db588c7d6521 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:52.586075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315abe7-9e5a-4497-b435-db588c7d6521 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:52.602199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:52.603420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:52.603420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:52.603651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains/31374fbea4214a72ace1487c9c2a76c0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:52.605731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=31374fbea4214a72ace1487c9c2a76c0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:52.609163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:52.648605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:52.649463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:52.690902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:52.695463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:52.704554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:52.705732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:52.714510 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2749/5481] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:09:52 2022] PATCH /identity/v3/domains/31374fbea4214a72ace1487c9c2a76c0 => generated 276 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:52.715844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:52.719324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:52.878403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501b506-37a0-4ab8-9cde-4646379e708a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:52.943067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5e85-44b5-4967-b4ee-7895e7756080 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:52.959249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:52.960806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:52.961104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:52.961382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains/31374fbea4214a72ace1487c9c2a76c0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:52.992249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=31374fbea4214a72ace1487c9c2a76c0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:52.997782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:53.021425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:53.022329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:53.022872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:53.023232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] PATH_INFO: `/v3/users/23571a2bdce54e46b86c89ae723dae1a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:53.025156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23571a2bdce54e46b86c89ae723dae1a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:53.027120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:53.055166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.059489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.129225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23571a2bdce54e46b86c89ae723dae1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.130494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23571a2bdce54e46b86c89ae723dae1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.131343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23571a2bdce54e46b86c89ae723dae1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.169866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23571a2bdce54e46b86c89ae723dae1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.197110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8827267c-5f9d-4f79-b0a0-953edb5db6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23571a2bdce54e46b86c89ae723dae1a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.217426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0', 'request_id': 'req-9df48d7c-1635-4841-8ebb-c9605cf22675'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.265067 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2733/5482] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:52 2022] DELETE /identity/v3/users/23571a2bdce54e46b86c89ae723dae1a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:53.271679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0', 'request_id': 'req-9df48d7c-1635-4841-8ebb-c9605cf22675'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.276463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe683f3-803c-4e32-b306-408f09f8ef0e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:53.277067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe683f3-803c-4e32-b306-408f09f8ef0e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:53.279795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe683f3-803c-4e32-b306-408f09f8ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:53.315296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0', 'request_id': 'req-9df48d7c-1635-4841-8ebb-c9605cf22675'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.358620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5fe683f3-803c-4e32-b306-408f09f8ef0e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:53.365965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] The token cache is being invalidate because project 31374fbea4214a72ace1487c9c2a76c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:53.367130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.368243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.369187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5fe683f3-803c-4e32-b306-408f09f8ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:53.386661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0', 'request_id': 'req-9df48d7c-1635-4841-8ebb-c9605cf22675'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.406340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0', 'request_id': 'req-9df48d7c-1635-4841-8ebb-c9605cf22675'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.406340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '31374fbea4214a72ace1487c9c2a76c0', 'request_id': 'req-9df48d7c-1635-4841-8ebb-c9605cf22675'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:53.417278 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2750/5483] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:09:52 2022] DELETE /identity/v3/domains/31374fbea4214a72ace1487c9c2a76c0 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:53.426107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:53.428320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:53.503714 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2734/5484] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:53.518786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe683f3-803c-4e32-b306-408f09f8ef0e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:53.521686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5fe683f3-803c-4e32-b306-408f09f8ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:53.550657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48d7c-1635-4841-8ebb-c9605cf22675 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:53.644933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe683f3-803c-4e32-b306-408f09f8ef0e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:53.656542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b16b30-f9f2-4edd-b878-5dae9e0ad214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:53.657540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16b30-f9f2-4edd-b878-5dae9e0ad214 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:53.658569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16b30-f9f2-4edd-b878-5dae9e0ad214 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:53.659120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16b30-f9f2-4edd-b878-5dae9e0ad214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:53.681823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a27ef-54a4-47eb-9784-57e2ca425373 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:53.682751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a27ef-54a4-47eb-9784-57e2ca425373 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:53.683039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a27ef-54a4-47eb-9784-57e2ca425373 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:53.683324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a27ef-54a4-47eb-9784-57e2ca425373 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains/19f3cb18c46f404bb50c0edb42ed9f44` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:53.691647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b16b30-f9f2-4edd-b878-5dae9e0ad214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:53.693937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b16b30-f9f2-4edd-b878-5dae9e0ad214 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:53.715989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a27ef-54a4-47eb-9784-57e2ca425373 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:09:53.716710 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2735/5485] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:53.759463 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b10a27ef-54a4-47eb-9784-57e2ca425373 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Could not find domain: 19f3cb18c46f404bb50c0edb42ed9f44.: keystone.exception.DomainNotFound: Could not find domain: 19f3cb18c46f404bb50c0edb42ed9f44. Feb 19 21:09:53.768022 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2751/5486] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:09:53 2022] DELETE /identity/v3/domains/19f3cb18c46f404bb50c0edb42ed9f44 => generated 112 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:09:53.768378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b16b30-f9f2-4edd-b878-5dae9e0ad214 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:53.781081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b16b30-f9f2-4edd-b878-5dae9e0ad214 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:53.788665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3733289-f6b3-4f98-b948-3456f472265a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:53.790030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733289-f6b3-4f98-b948-3456f472265a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:53.790423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733289-f6b3-4f98-b948-3456f472265a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:53.790705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733289-f6b3-4f98-b948-3456f472265a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:53.791813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3733289-f6b3-4f98-b948-3456f472265a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:53.794010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3733289-f6b3-4f98-b948-3456f472265a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:53.818628 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2736/5487] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:09:53 2022] POST /identity/v3/domains => generated 251 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:53.823143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a27ef-54a4-47eb-9784-57e2ca425373 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:53.839363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a27ef-54a4-47eb-9784-57e2ca425373 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:54.038342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:54.039118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:54.039425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:54.039721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:54.040606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:54.046041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:54.068554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.sql.core [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-44174061' for key 'project.ixu_project_name_domain_id'") Feb 19 21:09:54.068554 ncdv-master-1 devstack@keystone.service[96910]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 19 21:09:54.068554 ncdv-master-1 devstack@keystone.service[96910]: [parameters: {'id': '30ac17ea60c946ecb092f28947876bc9', 'name': 'tempest-domain-dup-44174061', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Feb 19 21:09:54.068554 ncdv-master-1 devstack@keystone.service[96910]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96910) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 19 21:09:54.120943 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-44174061.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-44174061. Feb 19 21:09:54.122652 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2752/5488] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:09:53 2022] POST /identity/v3/domains => generated 210 bytes in 300 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 19 21:09:54.127235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3733289-f6b3-4f98-b948-3456f472265a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:54.147950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3733289-f6b3-4f98-b948-3456f472265a tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:54.163110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:54.164688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:54.165165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:54.165627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains/27e5c63eae63436a932dfbda2b166700` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:54.195963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=27e5c63eae63436a932dfbda2b166700)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:54.197834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:54.230460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '27e5c63eae63436a932dfbda2b166700'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.231527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '27e5c63eae63436a932dfbda2b166700'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.266199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:54.269365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:54.294902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '27e5c63eae63436a932dfbda2b166700'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.295989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '27e5c63eae63436a932dfbda2b166700'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.300422 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2737/5489] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:09:54 2022] PATCH /identity/v3/domains/27e5c63eae63436a932dfbda2b166700 => generated 252 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:54.305989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:54.308024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:54.469431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e6c16-c125-499a-8f2f-2e8b26c02f2e tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:54.469688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e7e4-04c5-4201-a438-adc3570ca384 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:54.478377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:54.479705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:54.480287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:54.481102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains/27e5c63eae63436a932dfbda2b166700` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:54.506014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=27e5c63eae63436a932dfbda2b166700)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:54.508588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:54.548861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '27e5c63eae63436a932dfbda2b166700'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.555121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '27e5c63eae63436a932dfbda2b166700'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.575735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:54.577216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:54.577991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:54.578448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] PATH_INFO: `/v3/projects/991178f94bdc40b69af75ce8c36ab5b9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:54.580650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991178f94bdc40b69af75ce8c36ab5b9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:54.583323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:54.664598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991178f94bdc40b69af75ce8c36ab5b9', 'request_id': 'req-53dad82a-27e6-42f4-a4e4-e33698b31c65'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.669715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e5c63eae63436a932dfbda2b166700', 'request_id': 'req-b38cbbe6-5a29-4665-a484-afd60cfba3ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.671746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991178f94bdc40b69af75ce8c36ab5b9', 'request_id': 'req-53dad82a-27e6-42f4-a4e4-e33698b31c65'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.682429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e5c63eae63436a932dfbda2b166700', 'request_id': 'req-b38cbbe6-5a29-4665-a484-afd60cfba3ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.693592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991178f94bdc40b69af75ce8c36ab5b9', 'request_id': 'req-53dad82a-27e6-42f4-a4e4-e33698b31c65'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.701785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e5c63eae63436a932dfbda2b166700', 'request_id': 'req-b38cbbe6-5a29-4665-a484-afd60cfba3ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.719933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] The token cache is being invalidate because project 991178f94bdc40b69af75ce8c36ab5b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:54.720408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.721973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.723981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] The token cache is being invalidate because project 27e5c63eae63436a932dfbda2b166700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:54.726284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.733247 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2753/5490] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:54 2022] DELETE /identity/v3/projects/991178f94bdc40b69af75ce8c36ab5b9 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:54.734208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.738027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:54.740530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:54.763824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '27e5c63eae63436a932dfbda2b166700', 'request_id': 'req-b38cbbe6-5a29-4665-a484-afd60cfba3ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.765591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '27e5c63eae63436a932dfbda2b166700', 'request_id': 'req-b38cbbe6-5a29-4665-a484-afd60cfba3ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.769316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '27e5c63eae63436a932dfbda2b166700', 'request_id': 'req-b38cbbe6-5a29-4665-a484-afd60cfba3ac'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:54.778954 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2738/5491] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:09:54 2022] DELETE /identity/v3/domains/27e5c63eae63436a932dfbda2b166700 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:54.786585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:54.790307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:54.887067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad82a-27e6-42f4-a4e4-e33698b31c65 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:54.890308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbbe6-5a29-4665-a484-afd60cfba3ac tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:54.894420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:54.895890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:54.896800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:54.897364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] PATH_INFO: `/v3/users/3205f4eb387a4924aafcfa7a244424e5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:54.899732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3205f4eb387a4924aafcfa7a244424e5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:54.903348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:54.992901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16eceee95a3b472d956c73f2d9f81970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19a8d74cc39c47878ea60bf1aca386c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:54.993406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:54.993789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:54.994853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] PATH_INFO: `/v3/domains/31374fbea4214a72ace1487c9c2a76c0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:55.008937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:09:55.022980 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Could not find domain: 31374fbea4214a72ace1487c9c2a76c0.: keystone.exception.DomainNotFound: Could not find domain: 31374fbea4214a72ace1487c9c2a76c0. Feb 19 21:09:55.023664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3205f4eb387a4924aafcfa7a244424e5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.024385 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2739/5492] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:09:54 2022] PATCH /identity/v3/domains/31374fbea4214a72ace1487c9c2a76c0 => generated 112 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:09:55.029063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:55.032643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:55.057740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaa3fe-1e1c-4dfc-8315-e28e06435719 tempest-DomainsNegativeTestJSON-349532330 tempest-DomainsNegativeTestJSON-349532330-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:55.066594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:55.069456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:55.069859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:55.070144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] PATH_INFO: `/v3/users/41af8a7ec8ee427a95b97fbb2463c90e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:55.072550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41af8a7ec8ee427a95b97fbb2463c90e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:55.082004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3205f4eb387a4924aafcfa7a244424e5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.085278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:55.096911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3205f4eb387a4924aafcfa7a244424e5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.097531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3205f4eb387a4924aafcfa7a244424e5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.098612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0089b054-bfe9-4150-aa0e-bd19320e2a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3205f4eb387a4924aafcfa7a244424e5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.150070 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2754/5493] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:54 2022] DELETE /identity/v3/users/3205f4eb387a4924aafcfa7a244424e5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:55.213743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41af8a7ec8ee427a95b97fbb2463c90e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.215190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41af8a7ec8ee427a95b97fbb2463c90e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.216547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41af8a7ec8ee427a95b97fbb2463c90e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.243115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41af8a7ec8ee427a95b97fbb2463c90e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.284909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41af8a7ec8ee427a95b97fbb2463c90e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.321759 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2740/5494] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:55 2022] DELETE /identity/v3/users/41af8a7ec8ee427a95b97fbb2463c90e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:55.327508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23516-39da-4aa8-b867-0fbdf12ecfbe None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:55.328007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23516-39da-4aa8-b867-0fbdf12ecfbe None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:55.329142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23516-39da-4aa8-b867-0fbdf12ecfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:55.372912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f8f23516-39da-4aa8-b867-0fbdf12ecfbe None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:55.374220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8f23516-39da-4aa8-b867-0fbdf12ecfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:55.508377 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2755/5495] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:55.518810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:55.521831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:55.623459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b8be-2aa3-401e-89b7-0b88cb00ec45 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:55.630191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb01c9-56d0-4ec2-bb3f-887724c2c8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:55.631819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb01c9-56d0-4ec2-bb3f-887724c2c8aa service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:55.632599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb01c9-56d0-4ec2-bb3f-887724c2c8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:55.634099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb01c9-56d0-4ec2-bb3f-887724c2c8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:55.664414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb01c9-56d0-4ec2-bb3f-887724c2c8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:55.664622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f23516-39da-4aa8-b867-0fbdf12ecfbe None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:55.666620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb01c9-56d0-4ec2-bb3f-887724c2c8aa service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:55.667760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8f23516-39da-4aa8-b867-0fbdf12ecfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:55.698496 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2741/5496] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:09:55.700973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f23516-39da-4aa8-b867-0fbdf12ecfbe None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:55.725150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:55.726053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:55.726270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:55.726550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] PATH_INFO: `/v3/projects/fee5cd2a8302459bbd904e691cbfffb5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:55.727862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee5cd2a8302459bbd904e691cbfffb5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:55.729831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:55.833340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee5cd2a8302459bbd904e691cbfffb5', 'request_id': 'req-935261ab-5a94-4914-ac79-48ac0c4c624b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.840793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee5cd2a8302459bbd904e691cbfffb5', 'request_id': 'req-935261ab-5a94-4914-ac79-48ac0c4c624b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.859269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee5cd2a8302459bbd904e691cbfffb5', 'request_id': 'req-935261ab-5a94-4914-ac79-48ac0c4c624b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.878777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] The token cache is being invalidate because project fee5cd2a8302459bbd904e691cbfffb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:55.879456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.880578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-935261ab-5a94-4914-ac79-48ac0c4c624b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:55.891274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bac5-ed4a-4140-afe4-23b768e37026 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:55.892004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bac5-ed4a-4140-afe4-23b768e37026 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:55.892495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bac5-ed4a-4140-afe4-23b768e37026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:55.894344 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2756/5497] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:55 2022] DELETE /identity/v3/projects/fee5cd2a8302459bbd904e691cbfffb5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:55.936072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1759bac5-ed4a-4140-afe4-23b768e37026 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:55.939884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1759bac5-ed4a-4140-afe4-23b768e37026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:56.060374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2742/5498] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:56.064799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b404-c7fb-4957-9098-adce2caac5cd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.065255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b404-c7fb-4957-9098-adce2caac5cd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.065548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b404-c7fb-4957-9098-adce2caac5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.094608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-25f4b404-c7fb-4957-9098-adce2caac5cd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:56.095921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-25f4b404-c7fb-4957-9098-adce2caac5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:56.125606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759bac5-ed4a-4140-afe4-23b768e37026 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:56.132595 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2757/5499] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:09:56.138091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759bac5-ed4a-4140-afe4-23b768e37026 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:56.144663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:56.146118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.147215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.147215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.148649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:56.149159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:56.152556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:56.176737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2743/5500] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:56.178216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b404-c7fb-4957-9098-adce2caac5cd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:56.199345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b404-c7fb-4957-9098-adce2caac5cd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:56.216221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f3cdc-ae55-478c-9458-f73b8069a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:56.218786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3cdc-ae55-478c-9458-f73b8069a76a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.219268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3cdc-ae55-478c-9458-f73b8069a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.219688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3cdc-ae55-478c-9458-f73b8069a76a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.220925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f3cdc-ae55-478c-9458-f73b8069a76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:56.225509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f3cdc-ae55-478c-9458-f73b8069a76a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:56.239380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:56.242260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:56.311453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b0a25-4bda-4650-ba70-af365392d5e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:56.318126 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2758/5501] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:56 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:56.319563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f3cdc-ae55-478c-9458-f73b8069a76a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:56.449858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f3cdc-ae55-478c-9458-f73b8069a76a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:56.461605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee433e7-2fac-4d2e-bdaf-b33559235030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:56.461779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:56.462786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee433e7-2fac-4d2e-bdaf-b33559235030 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.462918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.462918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.463360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] PATH_INFO: `/v3/projects/522b4fc9cc7d415888294667b3fff49f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.463733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee433e7-2fac-4d2e-bdaf-b33559235030 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.464817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee433e7-2fac-4d2e-bdaf-b33559235030 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.466320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee433e7-2fac-4d2e-bdaf-b33559235030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:56.467845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522b4fc9cc7d415888294667b3fff49f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:56.469097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee433e7-2fac-4d2e-bdaf-b33559235030 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:56.470330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:56.532490 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2759/5502] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:56 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:56.537214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee433e7-2fac-4d2e-bdaf-b33559235030 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:56.561898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee433e7-2fac-4d2e-bdaf-b33559235030 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:56.562980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522b4fc9cc7d415888294667b3fff49f', 'request_id': 'req-02a20192-3b63-4409-bf69-3a610e526c34'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.574957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522b4fc9cc7d415888294667b3fff49f', 'request_id': 'req-02a20192-3b63-4409-bf69-3a610e526c34'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.595705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522b4fc9cc7d415888294667b3fff49f', 'request_id': 'req-02a20192-3b63-4409-bf69-3a610e526c34'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.612312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] The token cache is being invalidate because project 522b4fc9cc7d415888294667b3fff49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:56.612701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.613504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.615894 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2744/5503] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:56 2022] DELETE /identity/v3/projects/522b4fc9cc7d415888294667b3fff49f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:56.625679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:56.628220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:56.681204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:56.682982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.683634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.684221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.685513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:56.688269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:56.714191 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2760/5504] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:09:56.718834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:56.722121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:56.755265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7870173-29e8-4aa1-ac73-8afc67dee68e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:56.763030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d957a-69c7-4c01-9184-c5d2b4a24719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:56.764097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d957a-69c7-4c01-9184-c5d2b4a24719 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.764620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d957a-69c7-4c01-9184-c5d2b4a24719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.765068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d957a-69c7-4c01-9184-c5d2b4a24719 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.765964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d957a-69c7-4c01-9184-c5d2b4a24719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:56.767879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d957a-69c7-4c01-9184-c5d2b4a24719 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:56.781051 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2761/5505] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:56.785518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d957a-69c7-4c01-9184-c5d2b4a24719 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:56.798720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d957a-69c7-4c01-9184-c5d2b4a24719 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:56.808110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a20192-3b63-4409-bf69-3a610e526c34 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:56.810731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269832b7-a57e-46f6-a260-428ae0ffcdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:56.812372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269832b7-a57e-46f6-a260-428ae0ffcdd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.813169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269832b7-a57e-46f6-a260-428ae0ffcdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.813329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269832b7-a57e-46f6-a260-428ae0ffcdd9 admin admin] PATH_INFO: `/v3/projects/c2c621a7d80e4ce68cd35b7b04213893/users/abfbe8acb61d4beb886d4e2ea60f5369/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.820378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:56.821806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.822166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.822487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] PATH_INFO: `/v3/users/16eceee95a3b472d956c73f2d9f81970` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.824149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16eceee95a3b472d956c73f2d9f81970)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:56.827506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:56.851487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269832b7-a57e-46f6-a260-428ae0ffcdd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c621a7d80e4ce68cd35b7b04213893, user_id=abfbe8acb61d4beb886d4e2ea60f5369, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:56.859197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269832b7-a57e-46f6-a260-428ae0ffcdd9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:56.886885 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2762/5506] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:56 2022] PUT /identity/v3/projects/c2c621a7d80e4ce68cd35b7b04213893/users/abfbe8acb61d4beb886d4e2ea60f5369/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:09:56.901913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6961-f236-44d9-808a-f7c532f10bc4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:56.901913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6961-f236-44d9-808a-f7c532f10bc4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:56.902680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6961-f236-44d9-808a-f7c532f10bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:56.947706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c55e6961-f236-44d9-808a-f7c532f10bc4 None None] MFA Rules not processed for user `abfbe8acb61d4beb886d4e2ea60f5369`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:56.950231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c55e6961-f236-44d9-808a-f7c532f10bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:56.954650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16eceee95a3b472d956c73f2d9f81970'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.957318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16eceee95a3b472d956c73f2d9f81970'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.957318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16eceee95a3b472d956c73f2d9f81970'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.979453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16eceee95a3b472d956c73f2d9f81970'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:56.995606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16eceee95a3b472d956c73f2d9f81970'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:57.031135 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2745/5507] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:56 2022] DELETE /identity/v3/users/16eceee95a3b472d956c73f2d9f81970 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:57.096134 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2763/5508] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:57.104358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:57.109301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:57.276179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cebf3-9954-4c7f-a4f0-b2b064dc0051 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:57.326639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dd3f0-ec50-4f76-bb55-b262f5fe9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:57.330193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dd3f0-ec50-4f76-bb55-b262f5fe9976 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:57.331031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dd3f0-ec50-4f76-bb55-b262f5fe9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:57.331559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dd3f0-ec50-4f76-bb55-b262f5fe9976 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:57.332958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dd3f0-ec50-4f76-bb55-b262f5fe9976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:57.337576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dd3f0-ec50-4f76-bb55-b262f5fe9976 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:57.420386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6961-f236-44d9-808a-f7c532f10bc4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:57.425587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c55e6961-f236-44d9-808a-f7c532f10bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:57.462735 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2746/5509] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:57 2022] POST /identity/v3/projects => generated 383 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:57.467393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dd3f0-ec50-4f76-bb55-b262f5fe9976 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:57.652095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6961-f236-44d9-808a-f7c532f10bc4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:57.673199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:57.675777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:57.677167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:57.677896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] PATH_INFO: `/v3/users/98e561dfb87f4d7b8bdac1b469ed2c90` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:57.681852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e561dfb87f4d7b8bdac1b469ed2c90)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:57.682412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dd3f0-ec50-4f76-bb55-b262f5fe9976 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:57.696743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:57.708090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d10f-6112-4f52-8edf-459ece76f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:57.713087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d10f-6112-4f52-8edf-459ece76f4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:57.715291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d10f-6112-4f52-8edf-459ece76f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:57.717392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d10f-6112-4f52-8edf-459ece76f4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:57.725611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d10f-6112-4f52-8edf-459ece76f4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:57.735463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d10f-6112-4f52-8edf-459ece76f4b0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:57.812935 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2747/5510] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:57 2022] POST /identity/v3/users => generated 298 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:09:57.825649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d10f-6112-4f52-8edf-459ece76f4b0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:57.919119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d10f-6112-4f52-8edf-459ece76f4b0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:57.933780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e561dfb87f4d7b8bdac1b469ed2c90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:57.944707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:57.947806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:57.948099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:57.948400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:57.949442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:57.952220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:57.967653 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2748/5511] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:57.968649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:57.971683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:57.974967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e561dfb87f4d7b8bdac1b469ed2c90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:57.989985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e561dfb87f4d7b8bdac1b469ed2c90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:57.993527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e561dfb87f4d7b8bdac1b469ed2c90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:57.994429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e561dfb87f4d7b8bdac1b469ed2c90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:58.001417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854126c8-891a-414c-83e1-6fb7573694cf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:58.013171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:58.017402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.017629 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2764/5512] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:09:57 2022] DELETE /identity/v3/users/98e561dfb87f4d7b8bdac1b469ed2c90 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:58.017776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.017776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] PATH_INFO: `/v3/projects/19a8d74cc39c47878ea60bf1aca386c3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.018127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:58.018127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:58.018360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a8d74cc39c47878ea60bf1aca386c3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:58.020846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:58.153047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a8d74cc39c47878ea60bf1aca386c3', 'request_id': 'req-d389af28-8bcb-4807-8400-76bc62ee00e4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:58.165626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10893979-3a31-4621-bb6a-2ab0ea1e04af admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:58.170563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a8d74cc39c47878ea60bf1aca386c3', 'request_id': 'req-d389af28-8bcb-4807-8400-76bc62ee00e4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:58.197974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a8d74cc39c47878ea60bf1aca386c3', 'request_id': 'req-d389af28-8bcb-4807-8400-76bc62ee00e4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:58.232449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] The token cache is being invalidate because project 19a8d74cc39c47878ea60bf1aca386c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:58.232449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:58.234803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d389af28-8bcb-4807-8400-76bc62ee00e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:58.242952 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2749/5513] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:57 2022] DELETE /identity/v3/projects/19a8d74cc39c47878ea60bf1aca386c3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:58.242952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4511d-6041-4105-8627-9097ba5c796c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.242952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4511d-6041-4105-8627-9097ba5c796c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.242952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4511d-6041-4105-8627-9097ba5c796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.265828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f2e4511d-6041-4105-8627-9097ba5c796c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:58.267166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f2e4511d-6041-4105-8627-9097ba5c796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:58.309864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:58.311284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.311790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.312272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] PATH_INFO: `/v3/projects/a3774673b1554094aec71fdd66110b0f/users/7797d0a2cb444c5ea40dc47f8608b103/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.333046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3774673b1554094aec71fdd66110b0f, user_id=7797d0a2cb444c5ea40dc47f8608b103, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:58.336311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:58.353846 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2750/5514] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:58.355170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5608fd-de96-40e3-83b5-627dd345eef6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.355466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5608fd-de96-40e3-83b5-627dd345eef6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.355752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5608fd-de96-40e3-83b5-627dd345eef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.378293 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2765/5515] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:58 2022] PUT /identity/v3/projects/a3774673b1554094aec71fdd66110b0f/users/7797d0a2cb444c5ea40dc47f8608b103/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:58.378293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:58.382534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:58.390856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1f5608fd-de96-40e3-83b5-627dd345eef6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:58.393868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1f5608fd-de96-40e3-83b5-627dd345eef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:58.495875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4472f-c096-41f7-ab85-7e5faefad889 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:58.502465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f145e3f-24a3-44e1-b57e-0edd01c7684a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:58.503668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145e3f-24a3-44e1-b57e-0edd01c7684a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.503943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145e3f-24a3-44e1-b57e-0edd01c7684a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.504697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145e3f-24a3-44e1-b57e-0edd01c7684a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.505924 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2751/5516] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:58.509031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5608fd-de96-40e3-83b5-627dd345eef6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:58.515857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1f5608fd-de96-40e3-83b5-627dd345eef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:58.525538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f145e3f-24a3-44e1-b57e-0edd01c7684a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:58.527145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f145e3f-24a3-44e1-b57e-0edd01c7684a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:58.539954 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2766/5517] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:58.541531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4c0c-37b0-4ec1-8374-d81250203212 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.541891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4c0c-37b0-4ec1-8374-d81250203212 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.542371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4c0c-37b0-4ec1-8374-d81250203212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.544556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5608fd-de96-40e3-83b5-627dd345eef6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:58.553260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c96d0-9ebf-4b28-ac83-c2d1baf0ceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:58.554601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c96d0-9ebf-4b28-ac83-c2d1baf0ceef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.555133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c96d0-9ebf-4b28-ac83-c2d1baf0ceef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.555682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c96d0-9ebf-4b28-ac83-c2d1baf0ceef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.557176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c96d0-9ebf-4b28-ac83-c2d1baf0ceef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:58.559379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c96d0-9ebf-4b28-ac83-c2d1baf0ceef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:58.574706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-458d4c0c-37b0-4ec1-8374-d81250203212 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:58.590157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-458d4c0c-37b0-4ec1-8374-d81250203212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:58.590952 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2752/5518] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:58.595366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c96d0-9ebf-4b28-ac83-c2d1baf0ceef admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:58.602299 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2767/5519] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:58.607001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4c0c-37b0-4ec1-8374-d81250203212 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:58.630774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4c0c-37b0-4ec1-8374-d81250203212 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:58.631489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c96d0-9ebf-4b28-ac83-c2d1baf0ceef admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:58.639307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:58.640804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.641293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.641728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.642860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:09:58.650911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:58.653679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:58.658854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1460e1-9c50-4496-8605-c3fdde801233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:58.662262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1460e1-9c50-4496-8605-c3fdde801233 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.663299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1460e1-9c50-4496-8605-c3fdde801233 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.669097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1460e1-9c50-4496-8605-c3fdde801233 admin admin] PATH_INFO: `/v3/projects/a3774673b1554094aec71fdd66110b0f/users/7797d0a2cb444c5ea40dc47f8608b103/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.677281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1460e1-9c50-4496-8605-c3fdde801233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3774673b1554094aec71fdd66110b0f, user_id=7797d0a2cb444c5ea40dc47f8608b103, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:58.678765 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2768/5520] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:09:58.682517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1460e1-9c50-4496-8605-c3fdde801233 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:58.686582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:58.706604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1532ed-718b-4b75-93ff-50c413c07b20 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:58.720711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2753/5521] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:58 2022] PUT /identity/v3/projects/a3774673b1554094aec71fdd66110b0f/users/7797d0a2cb444c5ea40dc47f8608b103/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:58.740395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4de6-1277-4f6c-a574-655dd8c589f5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.741272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4de6-1277-4f6c-a574-655dd8c589f5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.741991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4de6-1277-4f6c-a574-655dd8c589f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.808637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eaca4de6-1277-4f6c-a574-655dd8c589f5 None None] MFA Rules not processed for user `7797d0a2cb444c5ea40dc47f8608b103`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:58.810495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eaca4de6-1277-4f6c-a574-655dd8c589f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:58.872655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243a02b-816b-4174-a52e-40faa3991bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:58.874017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243a02b-816b-4174-a52e-40faa3991bca admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:58.874906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243a02b-816b-4174-a52e-40faa3991bca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:58.875189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243a02b-816b-4174-a52e-40faa3991bca admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:58.875906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243a02b-816b-4174-a52e-40faa3991bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:58.877856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243a02b-816b-4174-a52e-40faa3991bca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:58.928817 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2769/5522] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:09:58 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:58.931461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243a02b-816b-4174-a52e-40faa3991bca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:58.982594 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2754/5523] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:58.997075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca4de6-1277-4f6c-a574-655dd8c589f5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:59.000489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eaca4de6-1277-4f6c-a574-655dd8c589f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:59.121585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243a02b-816b-4174-a52e-40faa3991bca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:59.136791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646a4af-4dab-43df-ae67-76278e06d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:59.136791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646a4af-4dab-43df-ae67-76278e06d9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.136791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646a4af-4dab-43df-ae67-76278e06d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.136791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646a4af-4dab-43df-ae67-76278e06d9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.138733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646a4af-4dab-43df-ae67-76278e06d9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:59.138733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646a4af-4dab-43df-ae67-76278e06d9b6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:59.178900 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2770/5524] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:09:58 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:09:59.183831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646a4af-4dab-43df-ae67-76278e06d9b6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:59.202671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646a4af-4dab-43df-ae67-76278e06d9b6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:59.214639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:59.218943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.218943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.218943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.218943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:59.223732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca4de6-1277-4f6c-a574-655dd8c589f5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:59.225159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:59.256088 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2771/5525] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:59.256088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:59.261321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:59.279451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe16a2f-8b2f-405c-8b34-8f083eb956b4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:59.286854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:59.299296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.299768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.300156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] PATH_INFO: `/v3/projects/817d9ee0a83c4d7bb3f89e39672b3ce8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.305632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817d9ee0a83c4d7bb3f89e39672b3ce8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:59.309858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:59.378725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3bb15-f6f7-460c-85c5-543c021d99f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:59.380166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3bb15-f6f7-460c-85c5-543c021d99f6 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.380508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3bb15-f6f7-460c-85c5-543c021d99f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.380792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3bb15-f6f7-460c-85c5-543c021d99f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.428263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817d9ee0a83c4d7bb3f89e39672b3ce8', 'request_id': 'req-960c8d02-e30a-4566-bbf7-bf01f12f41e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:59.437664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817d9ee0a83c4d7bb3f89e39672b3ce8', 'request_id': 'req-960c8d02-e30a-4566-bbf7-bf01f12f41e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:59.463371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817d9ee0a83c4d7bb3f89e39672b3ce8', 'request_id': 'req-960c8d02-e30a-4566-bbf7-bf01f12f41e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:59.499851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] The token cache is being invalidate because project 817d9ee0a83c4d7bb3f89e39672b3ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:09:59.500622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:59.501863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:09:59.513252 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2772/5526] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:09:59 2022] DELETE /identity/v3/projects/817d9ee0a83c4d7bb3f89e39672b3ce8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:59.514703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:59.516894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:59.532775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3bb15-f6f7-460c-85c5-543c021d99f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:59.534344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3bb15-f6f7-460c-85c5-543c021d99f6 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:59.552454 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2755/5527] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:09:59.553888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d20f79-e798-420c-a899-83b8d39c36f3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.554176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d20f79-e798-420c-a899-83b8d39c36f3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.554536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d20f79-e798-420c-a899-83b8d39c36f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.581366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e3d20f79-e798-420c-a899-83b8d39c36f3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:59.583602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e3d20f79-e798-420c-a899-83b8d39c36f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:59.708799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c8d02-e30a-4566-bbf7-bf01f12f41e1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:59.714949 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2756/5528] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:59.716495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a3824-d69e-4089-8bdf-76e35d1adcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:59.717339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3824-d69e-4089-8bdf-76e35d1adcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.717745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3824-d69e-4089-8bdf-76e35d1adcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.718152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3824-d69e-4089-8bdf-76e35d1adcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.718710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d20f79-e798-420c-a899-83b8d39c36f3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:59.719227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a3824-d69e-4089-8bdf-76e35d1adcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:59.721407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a3824-d69e-4089-8bdf-76e35d1adcb1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:59.723483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e3d20f79-e798-420c-a899-83b8d39c36f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:59.735597 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2773/5529] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:09:59.737195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cde6d0-254b-4937-81a9-22a661bb1293 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.737593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cde6d0-254b-4937-81a9-22a661bb1293 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.737978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cde6d0-254b-4937-81a9-22a661bb1293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.771709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-94cde6d0-254b-4937-81a9-22a661bb1293 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:09:59.774231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-94cde6d0-254b-4937-81a9-22a661bb1293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:59.791411 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2774/5530] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:09:59.792513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cde6d0-254b-4937-81a9-22a661bb1293 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:59.804880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cde6d0-254b-4937-81a9-22a661bb1293 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:59.815502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2992e-f47d-400d-80b8-8ee46f807dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:59.816763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2992e-f47d-400d-80b8-8ee46f807dee admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.818523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2992e-f47d-400d-80b8-8ee46f807dee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.818523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2992e-f47d-400d-80b8-8ee46f807dee admin admin] PATH_INFO: `/v3/projects/938c5739244e4eb7bd8eeeebc39e95c4/users/ee1d45a0fc6645e3929e97f9417417c4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.840430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2992e-f47d-400d-80b8-8ee46f807dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=938c5739244e4eb7bd8eeeebc39e95c4, user_id=ee1d45a0fc6645e3929e97f9417417c4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:09:59.843023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2992e-f47d-400d-80b8-8ee46f807dee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:09:59.865197 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2775/5531] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:09:59 2022] PUT /identity/v3/projects/938c5739244e4eb7bd8eeeebc39e95c4/users/ee1d45a0fc6645e3929e97f9417417c4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:09:59.866839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2992e-f47d-400d-80b8-8ee46f807dee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:09:59.877799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d20f79-e798-420c-a899-83b8d39c36f3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:09:59.977236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:09:59.978694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:09:59.979038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:09:59.979492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:09:59.981650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:09:59.997317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2992e-f47d-400d-80b8-8ee46f807dee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.003272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1db57-81be-4d24-9281-de1eb332574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.003737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1db57-81be-4d24-9281-de1eb332574b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.004119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1db57-81be-4d24-9281-de1eb332574b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.004519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1db57-81be-4d24-9281-de1eb332574b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.005765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1db57-81be-4d24-9281-de1eb332574b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:00.006131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1db57-81be-4d24-9281-de1eb332574b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.008082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1db57-81be-4d24-9281-de1eb332574b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.024530 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2776/5532] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:00.030151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31750740-8287-4093-8c05-d1913708da0d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.031234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31750740-8287-4093-8c05-d1913708da0d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.033068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31750740-8287-4093-8c05-d1913708da0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.081084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.083938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.087188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-31750740-8287-4093-8c05-d1913708da0d None None] MFA Rules not processed for user `ee1d45a0fc6645e3929e97f9417417c4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:00.089162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-31750740-8287-4093-8c05-d1913708da0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:00.095149 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2757/5533] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:09:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:00.096372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.114240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd13b8-ae4f-43b9-a444-3a8a8c2dacb9 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.127290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29de2-b965-4150-b8d2-25d33c07d905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.127967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29de2-b965-4150-b8d2-25d33c07d905 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.128243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29de2-b965-4150-b8d2-25d33c07d905 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.128541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29de2-b965-4150-b8d2-25d33c07d905 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.129298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29de2-b965-4150-b8d2-25d33c07d905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.131258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29de2-b965-4150-b8d2-25d33c07d905 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.170567 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2758/5534] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:00 2022] POST /identity/v3/projects => generated 399 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:00.175167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29de2-b965-4150-b8d2-25d33c07d905 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.252848 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2777/5535] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:00.253689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31750740-8287-4093-8c05-d1913708da0d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.278740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31750740-8287-4093-8c05-d1913708da0d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.302999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29de2-b965-4150-b8d2-25d33c07d905 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.310688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094ea04-1192-4e45-a862-6d10285a8e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.311388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094ea04-1192-4e45-a862-6d10285a8e0d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.311671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094ea04-1192-4e45-a862-6d10285a8e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.312110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094ea04-1192-4e45-a862-6d10285a8e0d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.312862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094ea04-1192-4e45-a862-6d10285a8e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.315470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094ea04-1192-4e45-a862-6d10285a8e0d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.359686 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2759/5536] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:00 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:00.362708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094ea04-1192-4e45-a862-6d10285a8e0d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.388132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094ea04-1192-4e45-a862-6d10285a8e0d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.412888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ebc4-5c3f-45d3-8aaf-0c9524138842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.413945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ebc4-5c3f-45d3-8aaf-0c9524138842 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.414289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ebc4-5c3f-45d3-8aaf-0c9524138842 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.414689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ebc4-5c3f-45d3-8aaf-0c9524138842 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.415737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547ebc4-5c3f-45d3-8aaf-0c9524138842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.418348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547ebc4-5c3f-45d3-8aaf-0c9524138842 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.434252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888da709-626e-4701-85bd-a8e6796c5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.437726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888da709-626e-4701-85bd-a8e6796c5dfd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.438000 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2760/5537] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:00.438201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888da709-626e-4701-85bd-a8e6796c5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.438358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888da709-626e-4701-85bd-a8e6796c5dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.439578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888da709-626e-4701-85bd-a8e6796c5dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.443718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888da709-626e-4701-85bd-a8e6796c5dfd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.450987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ebc4-5c3f-45d3-8aaf-0c9524138842 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.471034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ebc4-5c3f-45d3-8aaf-0c9524138842 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.479690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0d57-57b5-4f46-8664-6024e5fd186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.480392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0d57-57b5-4f46-8664-6024e5fd186b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.480804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0d57-57b5-4f46-8664-6024e5fd186b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.481128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0d57-57b5-4f46-8664-6024e5fd186b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.481877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c0d57-57b5-4f46-8664-6024e5fd186b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.483792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c0d57-57b5-4f46-8664-6024e5fd186b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.495606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2778/5538] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:00 2022] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:00.497674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888da709-626e-4701-85bd-a8e6796c5dfd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.506855 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2761/5539] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:00.507790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0d57-57b5-4f46-8664-6024e5fd186b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.524175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0d57-57b5-4f46-8664-6024e5fd186b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.622416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56538fc7-16e7-47af-8c81-8a9b6fb033d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.624372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56538fc7-16e7-47af-8c81-8a9b6fb033d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.624372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56538fc7-16e7-47af-8c81-8a9b6fb033d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.624372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56538fc7-16e7-47af-8c81-8a9b6fb033d5 admin admin] PATH_INFO: `/v3/projects/f6febf49fb5f409ebd8ed6d9427348de/users/aa1513aa7d1542af9143c209717ad117/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.627739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888da709-626e-4701-85bd-a8e6796c5dfd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.633088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.633940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.634286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.634571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.635278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.637248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.646754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56538fc7-16e7-47af-8c81-8a9b6fb033d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6febf49fb5f409ebd8ed6d9427348de, user_id=aa1513aa7d1542af9143c209717ad117, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.653351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56538fc7-16e7-47af-8c81-8a9b6fb033d5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.664147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2779/5540] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:00 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:00.664539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.669580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:00.682505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0cb11-2be0-4e32-9d9b-3ecf44ee1ec0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.712459 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2762/5541] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:00 2022] PUT /identity/v3/projects/f6febf49fb5f409ebd8ed6d9427348de/users/aa1513aa7d1542af9143c209717ad117/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:00.713407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56538fc7-16e7-47af-8c81-8a9b6fb033d5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.774197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.775983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.776527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.777292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] PATH_INFO: `/v3/users/abfbe8acb61d4beb886d4e2ea60f5369` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.779178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfbe8acb61d4beb886d4e2ea60f5369)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.782374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.806979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56538fc7-16e7-47af-8c81-8a9b6fb033d5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:00.806979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3ba66-0982-482f-86ce-7af7904e1340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:00.806979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ba66-0982-482f-86ce-7af7904e1340 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.806979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ba66-0982-482f-86ce-7af7904e1340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.808313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ba66-0982-482f-86ce-7af7904e1340 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.808313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3ba66-0982-482f-86ce-7af7904e1340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:00.809223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3ba66-0982-482f-86ce-7af7904e1340 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:00.823929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2763/5542] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:00.825180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a9ad0-57a8-4f79-83ee-37d6387d10e3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.825471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a9ad0-57a8-4f79-83ee-37d6387d10e3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.826060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a9ad0-57a8-4f79-83ee-37d6387d10e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.860787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-315a9ad0-57a8-4f79-83ee-37d6387d10e3 None None] MFA Rules not processed for user `aa1513aa7d1542af9143c209717ad117`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:00.862307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-315a9ad0-57a8-4f79-83ee-37d6387d10e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:00.871710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfbe8acb61d4beb886d4e2ea60f5369'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:00.894235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfbe8acb61d4beb886d4e2ea60f5369'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:00.904369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfbe8acb61d4beb886d4e2ea60f5369'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:00.905363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfbe8acb61d4beb886d4e2ea60f5369'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:00.906064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfbe8acb61d4beb886d4e2ea60f5369'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:00.920710 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2780/5543] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:00 2022] DELETE /identity/v3/users/abfbe8acb61d4beb886d4e2ea60f5369 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:00.921769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:00.923079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:00.944387 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2764/5544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:00.944387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c80c7-02e6-4e7d-8c5a-082160a7196b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:00.944887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c80c7-02e6-4e7d-8c5a-082160a7196b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:00.944887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c80c7-02e6-4e7d-8c5a-082160a7196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:00.970949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8a8c80c7-02e6-4e7d-8c5a-082160a7196b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:00.972309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a8c80c7-02e6-4e7d-8c5a-082160a7196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:01.018382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d1eec-c1b1-473c-8c5a-888d4fae49ab admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:01.024898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:01.026210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:01.026543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:01.027546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] PATH_INFO: `/v3/projects/edd0f97d0ade48b5af1f53f27a293600/users/ad2959fdf181449da56a9351f0fb7352/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:01.051050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd0f97d0ade48b5af1f53f27a293600, user_id=ad2959fdf181449da56a9351f0fb7352, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:01.051780 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2765/5545] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:01.053354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c80c7-02e6-4e7d-8c5a-082160a7196b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:01.054081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:01.056380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a8c80c7-02e6-4e7d-8c5a-082160a7196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:01.089174 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2781/5546] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:00 2022] PUT /identity/v3/projects/edd0f97d0ade48b5af1f53f27a293600/users/ad2959fdf181449da56a9351f0fb7352/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:01.090149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:01.091870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:01.146329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c80c7-02e6-4e7d-8c5a-082160a7196b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:01.189450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e730f-d0f8-48e4-9e9b-3b8201e904b5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:01.197069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2aca1-ba13-4e19-83a7-a7295f6e3dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:01.198178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2aca1-ba13-4e19-83a7-a7295f6e3dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:01.198798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2aca1-ba13-4e19-83a7-a7295f6e3dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:01.199276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2aca1-ba13-4e19-83a7-a7295f6e3dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:01.224612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcd604-7b7c-49a2-98ea-cab5bd9aef7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:01.225270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcd604-7b7c-49a2-98ea-cab5bd9aef7d service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:01.225555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcd604-7b7c-49a2-98ea-cab5bd9aef7d service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:01.225835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcd604-7b7c-49a2-98ea-cab5bd9aef7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:01.300538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2aca1-ba13-4e19-83a7-a7295f6e3dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:01.302548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2aca1-ba13-4e19-83a7-a7295f6e3dc0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:01.313798 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2782/5547] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:01.314662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2aca1-ba13-4e19-83a7-a7295f6e3dc0 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:01.323037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcd604-7b7c-49a2-98ea-cab5bd9aef7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:01.325738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcd604-7b7c-49a2-98ea-cab5bd9aef7d service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:01.328630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2aca1-ba13-4e19-83a7-a7295f6e3dc0 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:01.338294 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2766/5548] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:01.338547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356a36d-acdf-4bb5-ae40-90577700fd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:01.339304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a36d-acdf-4bb5-ae40-90577700fd80 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:01.339653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a36d-acdf-4bb5-ae40-90577700fd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:01.339973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a36d-acdf-4bb5-ae40-90577700fd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:01.342340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356a36d-acdf-4bb5-ae40-90577700fd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:01.351298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356a36d-acdf-4bb5-ae40-90577700fd80 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:01.376216 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2783/5549] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:01.380102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcd604-7b7c-49a2-98ea-cab5bd9aef7d service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:01.397599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcd604-7b7c-49a2-98ea-cab5bd9aef7d service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:01.403661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813846ef-e3c3-4d53-bef4-fa15fbafb72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:01.405155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813846ef-e3c3-4d53-bef4-fa15fbafb72c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:01.405534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813846ef-e3c3-4d53-bef4-fa15fbafb72c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:01.406763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813846ef-e3c3-4d53-bef4-fa15fbafb72c admin admin] PATH_INFO: `/v3/projects/edd0f97d0ade48b5af1f53f27a293600/users/ad2959fdf181449da56a9351f0fb7352/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:01.412776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813846ef-e3c3-4d53-bef4-fa15fbafb72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd0f97d0ade48b5af1f53f27a293600, user_id=ad2959fdf181449da56a9351f0fb7352, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:01.418026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813846ef-e3c3-4d53-bef4-fa15fbafb72c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:01.440363 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2767/5550] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:01 2022] PUT /identity/v3/projects/edd0f97d0ade48b5af1f53f27a293600/users/ad2959fdf181449da56a9351f0fb7352/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:01.450399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a66030-ab94-403e-99b5-c872f3d68933 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:01.450696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a66030-ab94-403e-99b5-c872f3d68933 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:01.450981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a66030-ab94-403e-99b5-c872f3d68933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:01.488160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a3a66030-ab94-403e-99b5-c872f3d68933 None None] MFA Rules not processed for user `ad2959fdf181449da56a9351f0fb7352`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:01.489657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a3a66030-ab94-403e-99b5-c872f3d68933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:01.634888 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2784/5551] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:01.639851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813846ef-e3c3-4d53-bef4-fa15fbafb72c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:01.653329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813846ef-e3c3-4d53-bef4-fa15fbafb72c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:01.659991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:01.661525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:01.662233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:01.663395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:01.664638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:01.666453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:01.694616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2768/5552] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:10:01 2022] POST /identity/v3/domains => generated 276 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:01.699139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a66030-ab94-403e-99b5-c872f3d68933 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:01.711612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a66030-ab94-403e-99b5-c872f3d68933 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:01.846314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17871c8-47f7-4c2c-8fda-824e5905c3e3 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:01.856827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17871c8-47f7-4c2c-8fda-824e5905c3e3 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:01.857224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17871c8-47f7-4c2c-8fda-824e5905c3e3 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:01.857516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17871c8-47f7-4c2c-8fda-824e5905c3e3 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:01.863446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17871c8-47f7-4c2c-8fda-824e5905c3e3 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:01.870844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17871c8-47f7-4c2c-8fda-824e5905c3e3 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:01.939387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:01.942730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:01.987035 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2785/5553] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:01 2022] POST /identity/v3/projects => generated 402 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:01.987638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17871c8-47f7-4c2c-8fda-824e5905c3e3 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.106631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76a42-f111-4618-beb0-0c847ac394e2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.126723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17871c8-47f7-4c2c-8fda-824e5905c3e3 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.134477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e936-629b-4a34-b9fa-0a6d48f1a6d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.135079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e936-629b-4a34-b9fa-0a6d48f1a6d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.135371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e936-629b-4a34-b9fa-0a6d48f1a6d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.135656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e936-629b-4a34-b9fa-0a6d48f1a6d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.137043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e936-629b-4a34-b9fa-0a6d48f1a6d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.140290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e936-629b-4a34-b9fa-0a6d48f1a6d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.164529 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2786/5554] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:10:01 2022] POST /identity/v3/groups => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:02.169564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e936-629b-4a34-b9fa-0a6d48f1a6d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.184035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e936-629b-4a34-b9fa-0a6d48f1a6d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.190832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef51547-9791-475d-adce-9bc60494e35d tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.192682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51547-9791-475d-adce-9bc60494e35d tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.193016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51547-9791-475d-adce-9bc60494e35d tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.193462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51547-9791-475d-adce-9bc60494e35d tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.194319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef51547-9791-475d-adce-9bc60494e35d tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.195453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.196351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef51547-9791-475d-adce-9bc60494e35d tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.196575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.196958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.197575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] PATH_INFO: `/v3/projects/c2c621a7d80e4ce68cd35b7b04213893` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.199435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c621a7d80e4ce68cd35b7b04213893)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.201705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.228524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2787/5555] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:02 2022] POST /identity/v3/users => generated 445 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:02.231325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef51547-9791-475d-adce-9bc60494e35d tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.246449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef51547-9791-475d-adce-9bc60494e35d tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.252435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c114be-2424-400c-a6c9-d30ae88765fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.253118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c114be-2424-400c-a6c9-d30ae88765fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.253411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c114be-2424-400c-a6c9-d30ae88765fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.253704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c114be-2424-400c-a6c9-d30ae88765fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.255015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c114be-2424-400c-a6c9-d30ae88765fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.256812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c114be-2424-400c-a6c9-d30ae88765fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.282135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2788/5556] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:10:02 2022] POST /identity/v3/roles => generated 240 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:02.287136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c114be-2424-400c-a6c9-d30ae88765fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.296057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c621a7d80e4ce68cd35b7b04213893', 'request_id': 'req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.307205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c114be-2424-400c-a6c9-d30ae88765fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.316208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c621a7d80e4ce68cd35b7b04213893', 'request_id': 'req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.336892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c621a7d80e4ce68cd35b7b04213893', 'request_id': 'req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.364463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] The token cache is being invalidate because project c2c621a7d80e4ce68cd35b7b04213893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:02.365456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.367052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.373900 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2769/5557] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:01 2022] DELETE /identity/v3/projects/c2c621a7d80e4ce68cd35b7b04213893 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:02.376540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.381444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:02.429628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.430818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.431184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.432646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/groups/aee5b969c2384716aab296be3a02c741/roles/ec5e6e8f790a4054823d321d619ef8b4/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.439570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_grant(project_id=253d66ce2d174ad3836ff4efbdf59359, group_id=aee5b969c2384716aab296be3a02c741, role_id=ec5e6e8f790a4054823d321d619ef8b4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.442674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.457456 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2789/5558] 10.222.0.30 () {60 vars in 1584 bytes} [Sat Feb 19 21:10:02 2022] PUT /identity/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/groups/aee5b969c2384716aab296be3a02c741/roles/ec5e6e8f790a4054823d321d619ef8b4/inherited_to_projects => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:02.461513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.464494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:02.478774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9a010-39fc-4c6a-9741-8a53d1a25a0e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.549417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d04aa-74d1-440c-970a-066f1412a529 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.551771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.553029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.553639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.553921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] PATH_INFO: `/v3/users/7797d0a2cb444c5ea40dc47f8608b103` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.555372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7797d0a2cb444c5ea40dc47f8608b103)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.557506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.557694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6865922-de57-44ea-ae63-007887985e47 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.558537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6865922-de57-44ea-ae63-007887985e47 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.558818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6865922-de57-44ea-ae63-007887985e47 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.559093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6865922-de57-44ea-ae63-007887985e47 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/groups/aee5b969c2384716aab296be3a02c741/roles/ec5e6e8f790a4054823d321d619ef8b4/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.562959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6865922-de57-44ea-ae63-007887985e47 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:check_grant(project_id=253d66ce2d174ad3836ff4efbdf59359, group_id=aee5b969c2384716aab296be3a02c741, role_id=ec5e6e8f790a4054823d321d619ef8b4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.566464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6865922-de57-44ea-ae63-007887985e47 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.576671 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2790/5559] 10.222.0.30 () {58 vars in 1566 bytes} [Sat Feb 19 21:10:02 2022] HEAD /identity/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/groups/aee5b969c2384716aab296be3a02c741/roles/ec5e6e8f790a4054823d321d619ef8b4/inherited_to_projects => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:02.579456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6865922-de57-44ea-ae63-007887985e47 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.593910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6865922-de57-44ea-ae63-007887985e47 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.599860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.601521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.601867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.602110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/groups/aee5b969c2384716aab296be3a02c741/roles/ec5e6e8f790a4054823d321d619ef8b4/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.605371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=253d66ce2d174ad3836ff4efbdf59359, group_id=aee5b969c2384716aab296be3a02c741, role_id=ec5e6e8f790a4054823d321d619ef8b4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.608874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.616665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role ec5e6e8f790a4054823d321d619ef8b4 was removed from group aee5b969c2384716aab296be3a02c741 on project 253d66ce2d174ad3836ff4efbdf59359. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:02.617004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.617930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.645487 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2791/5560] 10.222.0.30 () {58 vars in 1568 bytes} [Sat Feb 19 21:10:02 2022] DELETE /identity/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/groups/aee5b969c2384716aab296be3a02c741/roles/ec5e6e8f790a4054823d321d619ef8b4/inherited_to_projects => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:02.647787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.650178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:02.659071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7797d0a2cb444c5ea40dc47f8608b103'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.659756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7797d0a2cb444c5ea40dc47f8608b103'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.661164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7797d0a2cb444c5ea40dc47f8608b103'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.689894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7797d0a2cb444c5ea40dc47f8608b103'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.691729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7797d0a2cb444c5ea40dc47f8608b103'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.706644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2770/5561] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:02 2022] DELETE /identity/v3/users/7797d0a2cb444c5ea40dc47f8608b103 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:02.738147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919d85-6c2a-48f8-a44c-fcb5c581430a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.798481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.799565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.799793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.800072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles/ec5e6e8f790a4054823d321d619ef8b4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.801649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ec5e6e8f790a4054823d321d619ef8b4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.806897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.840733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role ec5e6e8f790a4054823d321d619ef8b4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:02.841115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.842254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:02.844521 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2792/5562] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:02 2022] DELETE /identity/v3/roles/ec5e6e8f790a4054823d321d619ef8b4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:02.851037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.852659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:02.869393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3334ce-22ff-4d0c-b0f6-e47b7f9b21b7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:02.940888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b89e2-b1a3-4430-85c2-55d8b0f5259e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:02.941546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b89e2-b1a3-4430-85c2-55d8b0f5259e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:02.942626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b89e2-b1a3-4430-85c2-55d8b0f5259e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:02.943008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b89e2-b1a3-4430-85c2-55d8b0f5259e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:02.944134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b89e2-b1a3-4430-85c2-55d8b0f5259e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:02.946959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b89e2-b1a3-4430-85c2-55d8b0f5259e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:02.972424 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2771/5563] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:10:02 2022] POST /identity/v3/roles => generated 240 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:02.973621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:02.975496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:03.007203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964c905-3d03-4846-9866-ef7bb50a7cdd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.016990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.018018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.018334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.018681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/30463d8e53da4a108a92cd6445d4b238/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.047927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_grant(project_id=253d66ce2d174ad3836ff4efbdf59359, user_id=3cb765a0bf904308851a10d2401037dd, role_id=30463d8e53da4a108a92cd6445d4b238)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.053091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.089637 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2793/5564] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Feb 19 21:10:02 2022] PUT /identity/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/30463d8e53da4a108a92cd6445d4b238/inherited_to_projects => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:03.093420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b89e2-b1a3-4430-85c2-55d8b0f5259e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.111235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b89e2-b1a3-4430-85c2-55d8b0f5259e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.183687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.185742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:03.286155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec197-2412-4a93-9e60-4d0951b44b51 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.288542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec197-2412-4a93-9e60-4d0951b44b51 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.289108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec197-2412-4a93-9e60-4d0951b44b51 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.289587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec197-2412-4a93-9e60-4d0951b44b51 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/30463d8e53da4a108a92cd6445d4b238/inherited_to_projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.291993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec197-2412-4a93-9e60-4d0951b44b51 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:check_grant(project_id=253d66ce2d174ad3836ff4efbdf59359, user_id=3cb765a0bf904308851a10d2401037dd, role_id=30463d8e53da4a108a92cd6445d4b238)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.294759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec197-2412-4a93-9e60-4d0951b44b51 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.303383 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2772/5565] 10.222.0.30 () {58 vars in 1563 bytes} [Sat Feb 19 21:10:03 2022] HEAD /identity/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/30463d8e53da4a108a92cd6445d4b238/inherited_to_projects => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:03.307915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec197-2412-4a93-9e60-4d0951b44b51 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.313081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f0ca2-cdb5-4648-8267-e0fb3ef5d5f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.319224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.319934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec197-2412-4a93-9e60-4d0951b44b51 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.320144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.320799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.321149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] PATH_INFO: `/v3/projects/a3774673b1554094aec71fdd66110b0f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.322410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3774673b1554094aec71fdd66110b0f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.324389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.328738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.330077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.330077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.330311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/30463d8e53da4a108a92cd6445d4b238/inherited_to_projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.334215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=253d66ce2d174ad3836ff4efbdf59359, user_id=3cb765a0bf904308851a10d2401037dd, role_id=30463d8e53da4a108a92cd6445d4b238)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.337292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.346584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 30463d8e53da4a108a92cd6445d4b238 was removed from user 3cb765a0bf904308851a10d2401037dd on project 253d66ce2d174ad3836ff4efbdf59359. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:03.347133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.348891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.372398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2773/5566] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Feb 19 21:10:03 2022] DELETE /identity/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/30463d8e53da4a108a92cd6445d4b238/inherited_to_projects => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:03.376876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.378862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:03.409274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3774673b1554094aec71fdd66110b0f', 'request_id': 'req-b346182f-efc5-4970-900b-06ac9f254311'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.420312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3774673b1554094aec71fdd66110b0f', 'request_id': 'req-b346182f-efc5-4970-900b-06ac9f254311'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.436955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3774673b1554094aec71fdd66110b0f', 'request_id': 'req-b346182f-efc5-4970-900b-06ac9f254311'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.455776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] The token cache is being invalidate because project a3774673b1554094aec71fdd66110b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:03.456150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.457047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b346182f-efc5-4970-900b-06ac9f254311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.459403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696ecdd-e285-42ee-9795-c748005ef150 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.462936 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2794/5567] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:03 2022] DELETE /identity/v3/projects/a3774673b1554094aec71fdd66110b0f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:03.465210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a744-3d1e-47da-89c8-cc1a084b9746 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.465972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a744-3d1e-47da-89c8-cc1a084b9746 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.466653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a744-3d1e-47da-89c8-cc1a084b9746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.495208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a014a744-3d1e-47da-89c8-cc1a084b9746 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:03.497121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a014a744-3d1e-47da-89c8-cc1a084b9746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:03.532692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.533565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.533877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.534156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles/30463d8e53da4a108a92cd6445d4b238` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.536851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=30463d8e53da4a108a92cd6445d4b238)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.538481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.584311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 30463d8e53da4a108a92cd6445d4b238 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:03.584739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.585498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-231fe41d-cb81-4422-b4a5-cffcf6d11414 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:03.586546 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2795/5568] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:03.587558 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2774/5569] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:03 2022] DELETE /identity/v3/roles/30463d8e53da4a108a92cd6445d4b238 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:03.592720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014a744-3d1e-47da-89c8-cc1a084b9746 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.594559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a014a744-3d1e-47da-89c8-cc1a084b9746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:03.595163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0922e-5aeb-491a-bf85-0fe13649dcd0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.595497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0922e-5aeb-491a-bf85-0fe13649dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.595782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0922e-5aeb-491a-bf85-0fe13649dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.612138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014a744-3d1e-47da-89c8-cc1a084b9746 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.616615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-26c0922e-5aeb-491a-bf85-0fe13649dcd0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:03.617809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-26c0922e-5aeb-491a-bf85-0fe13649dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:03.676154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.676869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.677159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.677444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.678189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.679790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.685069 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2775/5570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:03.689528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0922e-5aeb-491a-bf85-0fe13649dcd0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.696069 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2796/5571] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:10:03 2022] POST /identity/v3/roles => generated 240 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:03.702530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.703408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0922e-5aeb-491a-bf85-0fe13649dcd0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.705295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:03.709957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.712831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.712831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.712831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.712831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:03.712831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.714410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.722615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824ca40-16cc-4dea-837f-38253538c81a tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.732257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2776/5572] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:03.733467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.733842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75f37f-1e41-4e2f-8f04-bd9fd7d017a1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.735104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75f37f-1e41-4e2f-8f04-bd9fd7d017a1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.735494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75f37f-1e41-4e2f-8f04-bd9fd7d017a1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.735870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75f37f-1e41-4e2f-8f04-bd9fd7d017a1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/groups/aee5b969c2384716aab296be3a02c741/roles/774cafb64c7d461d9a97c39ce7c4cea6/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.738899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75f37f-1e41-4e2f-8f04-bd9fd7d017a1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3fa7acb66ab8462695b8f0b37d65b038, group_id=aee5b969c2384716aab296be3a02c741, role_id=774cafb64c7d461d9a97c39ce7c4cea6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.742000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75f37f-1e41-4e2f-8f04-bd9fd7d017a1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.745559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e846ed-973b-487d-aaee-d4ee93ffbe22 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.752116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01acb08-999a-41ab-88f3-b9ee9377bcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.752866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01acb08-999a-41ab-88f3-b9ee9377bcea admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.753143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01acb08-999a-41ab-88f3-b9ee9377bcea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.753416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01acb08-999a-41ab-88f3-b9ee9377bcea admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.754136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01acb08-999a-41ab-88f3-b9ee9377bcea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.756138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01acb08-999a-41ab-88f3-b9ee9377bcea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.756655 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2797/5573] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Feb 19 21:10:03 2022] PUT /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/groups/aee5b969c2384716aab296be3a02c741/roles/774cafb64c7d461d9a97c39ce7c4cea6/inherited_to_projects => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:03.760588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75f37f-1e41-4e2f-8f04-bd9fd7d017a1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.801429 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2777/5574] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:03 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:03.808552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01acb08-999a-41ab-88f3-b9ee9377bcea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.839084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75f37f-1e41-4e2f-8f04-bd9fd7d017a1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.891234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01acb08-999a-41ab-88f3-b9ee9377bcea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.898141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d982c9d-615f-4009-b4d7-d43cb6f56214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.899391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d982c9d-615f-4009-b4d7-d43cb6f56214 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.899836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d982c9d-615f-4009-b4d7-d43cb6f56214 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.900386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d982c9d-615f-4009-b4d7-d43cb6f56214 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.901337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d982c9d-615f-4009-b4d7-d43cb6f56214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.903439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d982c9d-615f-4009-b4d7-d43cb6f56214 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.927873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97d812-c081-47dc-a3ab-8cedc5a7147e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.928734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d812-c081-47dc-a3ab-8cedc5a7147e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.929025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d812-c081-47dc-a3ab-8cedc5a7147e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.929305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d812-c081-47dc-a3ab-8cedc5a7147e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/groups/aee5b969c2384716aab296be3a02c741/roles/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.931035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97d812-c081-47dc-a3ab-8cedc5a7147e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3fa7acb66ab8462695b8f0b37d65b038, group_id=aee5b969c2384716aab296be3a02c741)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.933145 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2778/5575] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:03 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:03.933792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97d812-c081-47dc-a3ab-8cedc5a7147e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.936414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d982c9d-615f-4009-b4d7-d43cb6f56214 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.947268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d982c9d-615f-4009-b4d7-d43cb6f56214 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.947487 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2798/5576] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Feb 19 21:10:03 2022] GET /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/groups/aee5b969c2384716aab296be3a02c741/roles/inherited_to_projects => generated 448 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:03.951685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97d812-c081-47dc-a3ab-8cedc5a7147e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.956822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f849ca-812f-4734-ae74-904ed1c6f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.958218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f849ca-812f-4734-ae74-904ed1c6f48a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.958218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f849ca-812f-4734-ae74-904ed1c6f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.958475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f849ca-812f-4734-ae74-904ed1c6f48a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.959332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f849ca-812f-4734-ae74-904ed1c6f48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.960912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f849ca-812f-4734-ae74-904ed1c6f48a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.961682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97d812-c081-47dc-a3ab-8cedc5a7147e tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.970030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110d0af-3e07-428e-99db-7951f7a23fd2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.970889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110d0af-3e07-428e-99db-7951f7a23fd2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.971180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110d0af-3e07-428e-99db-7951f7a23fd2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.971463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110d0af-3e07-428e-99db-7951f7a23fd2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/groups/aee5b969c2384716aab296be3a02c741/roles/774cafb64c7d461d9a97c39ce7c4cea6/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.972673 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2779/5577] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:03 2022] GET /identity/v3/roles => generated 1651 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:03.974443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110d0af-3e07-428e-99db-7951f7a23fd2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3fa7acb66ab8462695b8f0b37d65b038, group_id=aee5b969c2384716aab296be3a02c741, role_id=774cafb64c7d461d9a97c39ce7c4cea6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.977323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f849ca-812f-4734-ae74-904ed1c6f48a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.977470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110d0af-3e07-428e-99db-7951f7a23fd2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.984021 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2799/5578] 10.222.0.30 () {58 vars in 1563 bytes} [Sat Feb 19 21:10:03 2022] HEAD /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/groups/aee5b969c2384716aab296be3a02c741/roles/774cafb64c7d461d9a97c39ce7c4cea6/inherited_to_projects => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:03.988385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110d0af-3e07-428e-99db-7951f7a23fd2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:03.989255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f849ca-812f-4734-ae74-904ed1c6f48a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:03.995050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f9b01-2f4d-4202-a86e-8a804b344f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:03.995739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f9b01-2f4d-4202-a86e-8a804b344f19 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:03.996025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f9b01-2f4d-4202-a86e-8a804b344f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:03.996303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f9b01-2f4d-4202-a86e-8a804b344f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:03.997057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f9b01-2f4d-4202-a86e-8a804b344f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:03.998672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f9b01-2f4d-4202-a86e-8a804b344f19 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:03.999232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110d0af-3e07-428e-99db-7951f7a23fd2 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.004070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.005621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.005911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.006187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/groups/aee5b969c2384716aab296be3a02c741/roles/774cafb64c7d461d9a97c39ce7c4cea6/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.012572 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2780/5579] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:03 2022] GET /identity/v3/roles => generated 1651 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:04.013895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3fa7acb66ab8462695b8f0b37d65b038, group_id=aee5b969c2384716aab296be3a02c741, role_id=774cafb64c7d461d9a97c39ce7c4cea6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.016776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.016989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f9b01-2f4d-4202-a86e-8a804b344f19 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.023355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 774cafb64c7d461d9a97c39ce7c4cea6 was removed from group aee5b969c2384716aab296be3a02c741 on domain 3fa7acb66ab8462695b8f0b37d65b038. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:04.023736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:04.024814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:04.028981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f9b01-2f4d-4202-a86e-8a804b344f19 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.035161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c41fc-9087-4dbb-ba61-f89b0b4a24ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.036410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c41fc-9087-4dbb-ba61-f89b0b4a24ac admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.036824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c41fc-9087-4dbb-ba61-f89b0b4a24ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.037234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c41fc-9087-4dbb-ba61-f89b0b4a24ac admin admin] PATH_INFO: `/v3/projects/cff0d215a214460c9416ea760e822a14/users/80f051bbb561496181a42136f6ca2032/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.041572 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2800/5580] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Feb 19 21:10:03 2022] DELETE /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/groups/aee5b969c2384716aab296be3a02c741/roles/774cafb64c7d461d9a97c39ce7c4cea6/inherited_to_projects => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:04.045854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.047759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:04.062190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c41fc-9087-4dbb-ba61-f89b0b4a24ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff0d215a214460c9416ea760e822a14, user_id=80f051bbb561496181a42136f6ca2032, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.065696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c41fc-9087-4dbb-ba61-f89b0b4a24ac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.093400 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2781/5581] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:04 2022] PUT /identity/v3/projects/cff0d215a214460c9416ea760e822a14/users/80f051bbb561496181a42136f6ca2032/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:04.105797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a699f2-5526-4821-9627-4da6baa85a00 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.106127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a699f2-5526-4821-9627-4da6baa85a00 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.106612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a699f2-5526-4821-9627-4da6baa85a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.140179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c2a699f2-5526-4821-9627-4da6baa85a00 None None] MFA Rules not processed for user `80f051bbb561496181a42136f6ca2032`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:04.142065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c2a699f2-5526-4821-9627-4da6baa85a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:04.194755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed74f08-ce67-4f2b-bc61-a560d9485c70 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.243637 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2782/5582] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:04.253412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a699f2-5526-4821-9627-4da6baa85a00 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.255500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c2a699f2-5526-4821-9627-4da6baa85a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:04.288534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.290078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.292800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.293097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles/774cafb64c7d461d9a97c39ce7c4cea6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.295036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=774cafb64c7d461d9a97c39ce7c4cea6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.296929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.346902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 774cafb64c7d461d9a97c39ce7c4cea6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:04.347640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:04.348243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:04.353454 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2801/5583] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:04 2022] DELETE /identity/v3/roles/774cafb64c7d461d9a97c39ce7c4cea6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:04.361275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.364223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:04.370724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a699f2-5526-4821-9627-4da6baa85a00 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.451300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.451968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.452252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.452564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.453435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.455924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.471773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9af67-43e3-4e13-af07-83682d0e182b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.479584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7912d-3168-4a99-8147-6616896eff93 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.480431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7912d-3168-4a99-8147-6616896eff93 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.480671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7912d-3168-4a99-8147-6616896eff93 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.480964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7912d-3168-4a99-8147-6616896eff93 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.481768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7912d-3168-4a99-8147-6616896eff93 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.483378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7912d-3168-4a99-8147-6616896eff93 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.498775 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2783/5584] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:04 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:04.501266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.503662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:04.510785 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2802/5585] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:10:04 2022] POST /identity/v3/roles => generated 240 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:04.515613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7912d-3168-4a99-8147-6616896eff93 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.531490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7912d-3168-4a99-8147-6616896eff93 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.613853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdfe8a-831e-4733-b0a1-bd2dac462267 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.622603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062a9bf-45ae-4176-a486-a46c8b4d8eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.624264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e854f-fdf8-453d-bc72-94c313e9cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.624965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e854f-fdf8-453d-bc72-94c313e9cdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.625248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e854f-fdf8-453d-bc72-94c313e9cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.625557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e854f-fdf8-453d-bc72-94c313e9cdc0 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.625879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a9bf-45ae-4176-a486-a46c8b4d8eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.626644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a9bf-45ae-4176-a486-a46c8b4d8eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.626644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a9bf-45ae-4176-a486-a46c8b4d8eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/5869585e1b5242a0931a3f1c5a87e403/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.627367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e854f-fdf8-453d-bc72-94c313e9cdc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.631523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e854f-fdf8-453d-bc72-94c313e9cdc0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.637346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062a9bf-45ae-4176-a486-a46c8b4d8eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3fa7acb66ab8462695b8f0b37d65b038, user_id=3cb765a0bf904308851a10d2401037dd, role_id=5869585e1b5242a0931a3f1c5a87e403)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.647516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062a9bf-45ae-4176-a486-a46c8b4d8eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.669164 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2803/5586] 10.222.0.30 () {60 vars in 1578 bytes} [Sat Feb 19 21:10:04 2022] PUT /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/5869585e1b5242a0931a3f1c5a87e403/inherited_to_projects => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:04.673198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062a9bf-45ae-4176-a486-a46c8b4d8eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.677995 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2784/5587] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:04 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:04.682293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e854f-fdf8-453d-bc72-94c313e9cdc0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.698623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e854f-fdf8-453d-bc72-94c313e9cdc0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.760604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062a9bf-45ae-4176-a486-a46c8b4d8eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.768881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3413-a87d-4276-82c5-66c62f13cc1b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.770518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3413-a87d-4276-82c5-66c62f13cc1b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.770921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3413-a87d-4276-82c5-66c62f13cc1b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.771233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3413-a87d-4276-82c5-66c62f13cc1b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.773589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e3413-a87d-4276-82c5-66c62f13cc1b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3fa7acb66ab8462695b8f0b37d65b038, user_id=3cb765a0bf904308851a10d2401037dd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.776369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e3413-a87d-4276-82c5-66c62f13cc1b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.780106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865d68-9506-430f-8d5d-24e0ae28a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.780613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865d68-9506-430f-8d5d-24e0ae28a3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.781074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865d68-9506-430f-8d5d-24e0ae28a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.781420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865d68-9506-430f-8d5d-24e0ae28a3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.782174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865d68-9506-430f-8d5d-24e0ae28a3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.783902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865d68-9506-430f-8d5d-24e0ae28a3c2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.795035 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2804/5588] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Feb 19 21:10:04 2022] GET /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/inherited_to_projects => generated 447 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:04.796659 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2785/5589] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:04 2022] GET /identity/v3/roles => generated 1651 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:04.797204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3413-a87d-4276-82c5-66c62f13cc1b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.800724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865d68-9506-430f-8d5d-24e0ae28a3c2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.809876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3413-a87d-4276-82c5-66c62f13cc1b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.811073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865d68-9506-430f-8d5d-24e0ae28a3c2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.815082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc505-6931-4334-8af2-1ed8373fff5b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.816115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0063707-e082-4ce5-b042-1c0a41e91433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.816268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc505-6931-4334-8af2-1ed8373fff5b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.817382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc505-6931-4334-8af2-1ed8373fff5b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.817740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc505-6931-4334-8af2-1ed8373fff5b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/5869585e1b5242a0931a3f1c5a87e403/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.817949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0063707-e082-4ce5-b042-1c0a41e91433 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.818227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0063707-e082-4ce5-b042-1c0a41e91433 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.818500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0063707-e082-4ce5-b042-1c0a41e91433 admin admin] PATH_INFO: `/v3/projects/c5c2481a0ee54734ab42231ae9ec6ecc/users/041dd96820174f1c9bfa020cef480c24/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.820208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fc505-6931-4334-8af2-1ed8373fff5b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3fa7acb66ab8462695b8f0b37d65b038, user_id=3cb765a0bf904308851a10d2401037dd, role_id=5869585e1b5242a0931a3f1c5a87e403)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.823273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fc505-6931-4334-8af2-1ed8373fff5b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.830431 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2805/5590] 10.222.0.30 () {58 vars in 1560 bytes} [Sat Feb 19 21:10:04 2022] HEAD /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/5869585e1b5242a0931a3f1c5a87e403/inherited_to_projects => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:04.835253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0063707-e082-4ce5-b042-1c0a41e91433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c2481a0ee54734ab42231ae9ec6ecc, user_id=041dd96820174f1c9bfa020cef480c24, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.837888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc505-6931-4334-8af2-1ed8373fff5b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.838061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0063707-e082-4ce5-b042-1c0a41e91433 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.849029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc505-6931-4334-8af2-1ed8373fff5b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.853971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2786/5591] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:04 2022] PUT /identity/v3/projects/c5c2481a0ee54734ab42231ae9ec6ecc/users/041dd96820174f1c9bfa020cef480c24/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:04.857938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0063707-e082-4ce5-b042-1c0a41e91433 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.913918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:04.914288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:04.914598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:04.915045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/5869585e1b5242a0931a3f1c5a87e403/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:04.917924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3fa7acb66ab8462695b8f0b37d65b038, user_id=3cb765a0bf904308851a10d2401037dd, role_id=5869585e1b5242a0931a3f1c5a87e403)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:04.920825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:04.926692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 5869585e1b5242a0931a3f1c5a87e403 was removed from user 3cb765a0bf904308851a10d2401037dd on domain 3fa7acb66ab8462695b8f0b37d65b038. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:04.926926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:04.927638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:04.942944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0063707-e082-4ce5-b042-1c0a41e91433 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:04.943228 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2806/5592] 10.222.0.30 () {58 vars in 1562 bytes} [Sat Feb 19 21:10:04 2022] DELETE /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/5869585e1b5242a0931a3f1c5a87e403/inherited_to_projects => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:04.947531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:04.949143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:05.036059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.037677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.038076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.038330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.039187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.040054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a4dd1-2083-4a53-b209-a34ea2ac6521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.041733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.052020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.054735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.055234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.055368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles/5869585e1b5242a0931a3f1c5a87e403` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.061404 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2787/5593] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:04 2022] GET /identity/v3/roles => generated 1651 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:05.062323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5869585e1b5242a0931a3f1c5a87e403)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.063777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.066178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:05.068901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.085312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93d8c0-0dbe-4521-b549-da0fc8ed3e76 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.093996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5617-67a1-4c15-be16-225d5cdba301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.095342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5617-67a1-4c15-be16-225d5cdba301 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.095906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5617-67a1-4c15-be16-225d5cdba301 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.096616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5617-67a1-4c15-be16-225d5cdba301 admin admin] PATH_INFO: `/v3/projects/c5c2481a0ee54734ab42231ae9ec6ecc/users/041dd96820174f1c9bfa020cef480c24/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.100148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5617-67a1-4c15-be16-225d5cdba301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c2481a0ee54734ab42231ae9ec6ecc, user_id=041dd96820174f1c9bfa020cef480c24, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.108551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5617-67a1-4c15-be16-225d5cdba301 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.127176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 5869585e1b5242a0931a3f1c5a87e403 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:05.127176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:05.137124 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2788/5594] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:05 2022] PUT /identity/v3/projects/c5c2481a0ee54734ab42231ae9ec6ecc/users/041dd96820174f1c9bfa020cef480c24/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:05.137290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:05.137290 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2807/5595] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:04 2022] DELETE /identity/v3/roles/5869585e1b5242a0931a3f1c5a87e403 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:05.138898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2a76-89b9-425a-a924-eabec3cc574d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.139172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2a76-89b9-425a-a924-eabec3cc574d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.143364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2a76-89b9-425a-a924-eabec3cc574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.143525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.143525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:05.188641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-17ca2a76-89b9-425a-a924-eabec3cc574d None None] MFA Rules not processed for user `041dd96820174f1c9bfa020cef480c24`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:05.191603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-17ca2a76-89b9-425a-a924-eabec3cc574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:05.265099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5053a-0adc-4a8f-808f-c28f977ee48f tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.270984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58f4c-b491-4e15-9a0f-b2bbaa957231 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.271909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58f4c-b491-4e15-9a0f-b2bbaa957231 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.271909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58f4c-b491-4e15-9a0f-b2bbaa957231 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.272232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58f4c-b491-4e15-9a0f-b2bbaa957231 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.273483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58f4c-b491-4e15-9a0f-b2bbaa957231 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.275295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58f4c-b491-4e15-9a0f-b2bbaa957231 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.294103 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2808/5596] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:10:05 2022] POST /identity/v3/roles => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:05.299072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58f4c-b491-4e15-9a0f-b2bbaa957231 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.300731 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2789/5597] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:05.311598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2a76-89b9-425a-a924-eabec3cc574d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.312570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58f4c-b491-4e15-9a0f-b2bbaa957231 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.313450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-17ca2a76-89b9-425a-a924-eabec3cc574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:05.318999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49fdd-5283-47e6-ac2d-07943a81ae19 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.319825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49fdd-5283-47e6-ac2d-07943a81ae19 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.320105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49fdd-5283-47e6-ac2d-07943a81ae19 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.320909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49fdd-5283-47e6-ac2d-07943a81ae19 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.321706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49fdd-5283-47e6-ac2d-07943a81ae19 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.323444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49fdd-5283-47e6-ac2d-07943a81ae19 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.367171 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2809/5598] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:05 2022] POST /identity/v3/projects => generated 409 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:05.371671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49fdd-5283-47e6-ac2d-07943a81ae19 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.394761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2a76-89b9-425a-a924-eabec3cc574d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.448903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49fdd-5283-47e6-ac2d-07943a81ae19 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.453643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.455008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.455281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.455642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.456113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c6d0b-bf13-498b-8652-ae040f8589a0 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.457994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6d0b-bf13-498b-8652-ae040f8589a0 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.458226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:05.458504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6d0b-bf13-498b-8652-ae040f8589a0 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.458994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6d0b-bf13-498b-8652-ae040f8589a0 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/547cf6b151414dddaa0e08f834ccd0e2/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.462442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c6d0b-bf13-498b-8652-ae040f8589a0 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3fa7acb66ab8462695b8f0b37d65b038, user_id=3cb765a0bf904308851a10d2401037dd, role_id=547cf6b151414dddaa0e08f834ccd0e2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.467609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c6d0b-bf13-498b-8652-ae040f8589a0 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.486828 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2810/5599] 10.222.0.30 () {60 vars in 1578 bytes} [Sat Feb 19 21:10:05 2022] PUT /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/547cf6b151414dddaa0e08f834ccd0e2/inherited_to_projects => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:05.491327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c6d0b-bf13-498b-8652-ae040f8589a0 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.527692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.529474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.541399 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2790/5600] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:05.587492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c6d0b-bf13-498b-8652-ae040f8589a0 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.594183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.595115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.595574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.596079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.597241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Adding query filter params (scope.project.id=253d66ce2d174ad3836ff4efbdf59359, user.id=3cb765a0bf904308851a10d2401037dd) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:05.598038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.600371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.754864 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2811/5601] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:10:05 2022] GET /identity/v3/role_assignments?scope.project.id=253d66ce2d174ad3836ff4efbdf59359&user.id=3cb765a0bf904308851a10d2401037dd&effective => generated 648 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:05.758592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.778664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c50ff-6f1e-4296-982d-b83c1452bf81 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.783980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.785021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.786055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.786864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.787526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Adding query filter params (scope.project.id=277435f6d5414380a6bffd0808d0d782, user.id=3cb765a0bf904308851a10d2401037dd) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:05.787912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.790221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.888432 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2791/5602] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:10:05 2022] GET /identity/v3/role_assignments?scope.project.id=277435f6d5414380a6bffd0808d0d782&user.id=3cb765a0bf904308851a10d2401037dd&effective => generated 648 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:05.889997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.902590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f5c20-de24-44c9-9b02-aa4c480d86af tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:05.908799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:05.909952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:05.910231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:05.910739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/547cf6b151414dddaa0e08f834ccd0e2/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:05.913554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3fa7acb66ab8462695b8f0b37d65b038, user_id=3cb765a0bf904308851a10d2401037dd, role_id=547cf6b151414dddaa0e08f834ccd0e2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:05.917624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:05.923922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 547cf6b151414dddaa0e08f834ccd0e2 was removed from user 3cb765a0bf904308851a10d2401037dd on domain 3fa7acb66ab8462695b8f0b37d65b038. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:05.924229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:05.925047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:05.947607 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2812/5603] 10.222.0.30 () {58 vars in 1562 bytes} [Sat Feb 19 21:10:05 2022] DELETE /identity/v3/OS-INHERIT/domains/3fa7acb66ab8462695b8f0b37d65b038/users/3cb765a0bf904308851a10d2401037dd/roles/547cf6b151414dddaa0e08f834ccd0e2/inherited_to_projects => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:05.957170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:05.959301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:05.976661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c08dc4-140f-4f87-ad6a-280f38cbc4fb tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:06.104150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:06.105776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:06.106385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:06.107548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:06.109417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Adding query filter params (scope.project.id=253d66ce2d174ad3836ff4efbdf59359, user.id=3cb765a0bf904308851a10d2401037dd) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:06.110072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:06.114473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:06.228638 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2792/5604] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:10:05 2022] GET /identity/v3/role_assignments?scope.project.id=253d66ce2d174ad3836ff4efbdf59359&user.id=3cb765a0bf904308851a10d2401037dd&effective => generated 228 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:06.230429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:06.241911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ea85-fa32-4916-b285-800552e566c6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:06.249912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:06.250809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:06.251210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:06.251572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:06.252652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Adding query filter params (scope.project.id=277435f6d5414380a6bffd0808d0d782, user.id=3cb765a0bf904308851a10d2401037dd) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:06.253026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:06.257330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:06.343057 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2813/5605] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:10:06 2022] GET /identity/v3/role_assignments?scope.project.id=277435f6d5414380a6bffd0808d0d782&user.id=3cb765a0bf904308851a10d2401037dd&effective => generated 228 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:06.347396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:06.370358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28265c-1aa7-4bc3-924e-d1cc79333521 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:06.370358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:06.370358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:06.370829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:06.370829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/projects/277435f6d5414380a6bffd0808d0d782` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:06.371846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_project(project_id=277435f6d5414380a6bffd0808d0d782)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:06.374370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:06.457048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277435f6d5414380a6bffd0808d0d782', 'request_id': 'req-47d8d921-b34a-473f-96ed-29d546319e3c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.468625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277435f6d5414380a6bffd0808d0d782', 'request_id': 'req-47d8d921-b34a-473f-96ed-29d546319e3c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.484240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277435f6d5414380a6bffd0808d0d782', 'request_id': 'req-47d8d921-b34a-473f-96ed-29d546319e3c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.513136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] The token cache is being invalidate because project 277435f6d5414380a6bffd0808d0d782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:06.513968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.515256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.518574 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2793/5606] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:06 2022] DELETE /identity/v3/projects/277435f6d5414380a6bffd0808d0d782 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:06.523284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:06.527440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:06.552069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a17cc-058f-44c8-80dc-c076e2e9dd77 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:06.648028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:06.648839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:06.649155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:06.649571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles/547cf6b151414dddaa0e08f834ccd0e2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:06.651006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=547cf6b151414dddaa0e08f834ccd0e2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:06.652942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:06.700928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 547cf6b151414dddaa0e08f834ccd0e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:06.701228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.702062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.710986 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2814/5607] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:06 2022] DELETE /identity/v3/roles/547cf6b151414dddaa0e08f834ccd0e2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:06.712227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:06.726994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8d921-b34a-473f-96ed-29d546319e3c tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:06.772311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:06.774418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:06.834885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:06.835897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:06.836280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:06.836859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:06.837991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:06.840030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:06.867760 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2794/5608] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:10:06 2022] POST /identity/v3/roles => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:06.870663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02b1f-3d8e-4492-89db-8e8a13c4824b tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:06.872487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:06.874434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:06.877363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:06.878317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:06.878671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:06.879017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] PATH_INFO: `/v3/users/aa1513aa7d1542af9143c209717ad117` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:06.881127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1513aa7d1542af9143c209717ad117)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:06.883689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:06.890209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdbf34-b995-4b41-ba70-09b7c9b776cd tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:06.906983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a2938-b8c6-4a13-a633-bd91ea00c4a6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:06.907949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a2938-b8c6-4a13-a633-bd91ea00c4a6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:06.908455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a2938-b8c6-4a13-a633-bd91ea00c4a6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:06.908980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a2938-b8c6-4a13-a633-bd91ea00c4a6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:06.910141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a2938-b8c6-4a13-a633-bd91ea00c4a6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:06.913612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a2938-b8c6-4a13-a633-bd91ea00c4a6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:06.951119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1513aa7d1542af9143c209717ad117'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.964856 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2795/5609] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:06 2022] POST /identity/v3/projects => generated 409 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:06.966017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1513aa7d1542af9143c209717ad117'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.966671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a2938-b8c6-4a13-a633-bd91ea00c4a6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:06.978415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1513aa7d1542af9143c209717ad117'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.980857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1513aa7d1542af9143c209717ad117'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:06.981998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7c2b69ce-abb6-4944-b8b4-577cdeae8503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1513aa7d1542af9143c209717ad117'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:07.003681 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2815/5610] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:06 2022] DELETE /identity/v3/users/aa1513aa7d1542af9143c209717ad117 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:07.009216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f17fc-a599-4b26-a8e8-655362e1cd97 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:07.009696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f17fc-a599-4b26-a8e8-655362e1cd97 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:07.009913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f17fc-a599-4b26-a8e8-655362e1cd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:07.045726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5e5f17fc-a599-4b26-a8e8-655362e1cd97 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:07.047029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e5f17fc-a599-4b26-a8e8-655362e1cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:07.091165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a2938-b8c6-4a13-a633-bd91ea00c4a6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:07.168603 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2816/5611] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:07.168603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f17fc-a599-4b26-a8e8-655362e1cd97 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:07.175352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e5f17fc-a599-4b26-a8e8-655362e1cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:07.187921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:07.188814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:07.189118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:07.189388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/9d0fbc72097449f8a765f6148740b390/inherited_to_projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:07.193521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:create_grant(project_id=253d66ce2d174ad3836ff4efbdf59359, user_id=3cb765a0bf904308851a10d2401037dd, role_id=9d0fbc72097449f8a765f6148740b390)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:07.196431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:07.218874 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2796/5612] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Feb 19 21:10:06 2022] PUT /identity/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/9d0fbc72097449f8a765f6148740b390/inherited_to_projects => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:07.225767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:07.230869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:07.337185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f17fc-a599-4b26-a8e8-655362e1cd97 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:07.390004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37125e1e-1c28-4da4-8f1a-c06d180eccd9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:07.396638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:07.397303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:07.397772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:07.398374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:07.466767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:07.467774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:07.467918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:07.468201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:07.470538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:07.484529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:07.485976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:07.498231 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2797/5613] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:07.499078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:07.501046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:07.561729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:07.563353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:07.578723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a9c9e-9ed9-42ec-86f2-f0e9dc8cca0e service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:07.584923 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2817/5614] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:07.587905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:07.589026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:07.589470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:07.590124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:07.591293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Adding query filter params (scope.project.id=a78e85fe3df641b38c3f4ea2e3969eaf, user.id=3cb765a0bf904308851a10d2401037dd) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:07.592159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:07.593846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:07.706826 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2798/5615] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:10:07 2022] GET /identity/v3/role_assignments?scope.project.id=a78e85fe3df641b38c3f4ea2e3969eaf&user.id=3cb765a0bf904308851a10d2401037dd&effective => generated 649 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:07.711519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:07.730402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53071dee-8d41-4b1a-9588-12a9fb058240 service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:07.745103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:07.746526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:07.756932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:07.759783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:07.760753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/9d0fbc72097449f8a765f6148740b390/inherited_to_projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:07.769592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=253d66ce2d174ad3836ff4efbdf59359, user_id=3cb765a0bf904308851a10d2401037dd, role_id=9d0fbc72097449f8a765f6148740b390)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:07.779044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:07.786598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbc584-862f-4b37-a6d5-7fc2b01ce5d1 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:07.791991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 9d0fbc72097449f8a765f6148740b390 was removed from user 3cb765a0bf904308851a10d2401037dd on project 253d66ce2d174ad3836ff4efbdf59359. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:07.792452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:07.793818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:07.794112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:07.794630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:07.794980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:07.795266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:07.797752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:07.816069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:07.818224 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2818/5616] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Feb 19 21:10:07 2022] DELETE /identity/v3/OS-INHERIT/projects/253d66ce2d174ad3836ff4efbdf59359/users/3cb765a0bf904308851a10d2401037dd/roles/9d0fbc72097449f8a765f6148740b390/inherited_to_projects => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:07.819372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:07.821062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:07.821367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:07.900029 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2799/5617] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:07.926157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c45d-ed90-4de1-aaba-5ad719a83eee tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:07.931878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:07.932629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:07.933066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:07.933216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:07.934005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Adding query filter params (scope.project.id=a78e85fe3df641b38c3f4ea2e3969eaf, user.id=3cb765a0bf904308851a10d2401037dd) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:07.934324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:07.936318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.002300 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2819/5618] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Feb 19 21:10:07 2022] GET /identity/v3/role_assignments?scope.project.id=a78e85fe3df641b38c3f4ea2e3969eaf&user.id=3cb765a0bf904308851a10d2401037dd&effective => generated 228 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:08.003859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.026671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357ad4b-9397-4d89-8753-e9efb2f3189b service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.034898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.038634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.039867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.040870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.041165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.041453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/projects/a78e85fe3df641b38c3f4ea2e3969eaf` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.044083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a78e85fe3df641b38c3f4ea2e3969eaf)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.046136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.116268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78e85fe3df641b38c3f4ea2e3969eaf', 'request_id': 'req-061663f5-a784-45a1-8065-4e13cf24e508'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.124570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78e85fe3df641b38c3f4ea2e3969eaf', 'request_id': 'req-061663f5-a784-45a1-8065-4e13cf24e508'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.132811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe277d34-192a-4119-aed3-c13a5d974530 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.134383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78e85fe3df641b38c3f4ea2e3969eaf', 'request_id': 'req-061663f5-a784-45a1-8065-4e13cf24e508'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.149260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] The token cache is being invalidate because project a78e85fe3df641b38c3f4ea2e3969eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:08.149597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.150366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.155610 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2800/5619] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:08 2022] DELETE /identity/v3/projects/a78e85fe3df641b38c3f4ea2e3969eaf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:08.155610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.155610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.206903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.208520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.208884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.209217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] PATH_INFO: `/v3/projects/f6febf49fb5f409ebd8ed6d9427348de` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.210790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6febf49fb5f409ebd8ed6d9427348de)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.213908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.230916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061663f5-a784-45a1-8065-4e13cf24e508 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.235604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297efdc-e448-4320-8707-cd7ad7e0a6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.236408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297efdc-e448-4320-8707-cd7ad7e0a6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.236760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297efdc-e448-4320-8707-cd7ad7e0a6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.237105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297efdc-e448-4320-8707-cd7ad7e0a6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.239674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1297efdc-e448-4320-8707-cd7ad7e0a6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.275787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6febf49fb5f409ebd8ed6d9427348de', 'request_id': 'req-b1fe0185-b45d-4083-a806-f28d17a00d78'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.283108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6febf49fb5f409ebd8ed6d9427348de', 'request_id': 'req-b1fe0185-b45d-4083-a806-f28d17a00d78'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.294713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6febf49fb5f409ebd8ed6d9427348de', 'request_id': 'req-b1fe0185-b45d-4083-a806-f28d17a00d78'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.309590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] The token cache is being invalidate because project f6febf49fb5f409ebd8ed6d9427348de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:08.310288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.311434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.316444 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2820/5620] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:08 2022] DELETE /identity/v3/projects/f6febf49fb5f409ebd8ed6d9427348de => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:08.316444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.316444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.329866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297efdc-e448-4320-8707-cd7ad7e0a6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.331451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297efdc-e448-4320-8707-cd7ad7e0a6e9 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.345795 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2801/5621] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:08.350570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c791-5a27-4a4d-ae1c-b51bad7a2238 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.351205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c791-5a27-4a4d-ae1c-b51bad7a2238 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.351988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c791-5a27-4a4d-ae1c-b51bad7a2238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.374081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dd93c791-5a27-4a4d-ae1c-b51bad7a2238 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:08.375864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dd93c791-5a27-4a4d-ae1c-b51bad7a2238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.414348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0185-b45d-4083-a806-f28d17a00d78 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.421385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.423054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.423717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.424012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/roles/9d0fbc72097449f8a765f6148740b390` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.426066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9d0fbc72097449f8a765f6148740b390)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.427818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.458497 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2802/5622] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:08.467504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476ef7-e7f8-4a87-bc4b-e232f413043a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.468560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476ef7-e7f8-4a87-bc4b-e232f413043a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.469100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476ef7-e7f8-4a87-bc4b-e232f413043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.474104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invalidating the token cache because role 9d0fbc72097449f8a765f6148740b390 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:08.474488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.475179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.482427 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2821/5623] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:08 2022] DELETE /identity/v3/roles/9d0fbc72097449f8a765f6148740b390 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:08.484672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.486740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.501461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b3476ef7-e7f8-4a87-bc4b-e232f413043a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:08.503593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b3476ef7-e7f8-4a87-bc4b-e232f413043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.588324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77277eeb-7135-472d-bd25-fd6214138762 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.594382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.596777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.596777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.596777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/users/3cb765a0bf904308851a10d2401037dd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.598936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3cb765a0bf904308851a10d2401037dd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.601767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.607130 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2803/5624] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:08.612651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3476ef7-e7f8-4a87-bc4b-e232f413043a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.625817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3476ef7-e7f8-4a87-bc4b-e232f413043a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.634911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.638153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.638633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.640346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.643465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:08.643874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.646266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.659752 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2804/5625] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:08.667387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.675350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb765a0bf904308851a10d2401037dd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.686795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e20d-6a4e-4ba5-833c-89937cae5597 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.690587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb765a0bf904308851a10d2401037dd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.700938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.702084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.702388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.702718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.703752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.706806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.714389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb765a0bf904308851a10d2401037dd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.716581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb765a0bf904308851a10d2401037dd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.718503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb765a0bf904308851a10d2401037dd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:08.760832 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2822/5626] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:08 2022] DELETE /identity/v3/users/3cb765a0bf904308851a10d2401037dd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:08.764958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.766483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.768719 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2805/5627] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:08 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:08.770404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.772751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:08.852554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d5f5a-6cea-4eb8-bb6e-8b97921f992a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.856315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561a56b-dba4-4be8-8662-16df981abd75 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.859029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed32fad-645e-4e2b-b11c-40766c115a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.859720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed32fad-645e-4e2b-b11c-40766c115a57 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.859999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed32fad-645e-4e2b-b11c-40766c115a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.860296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed32fad-645e-4e2b-b11c-40766c115a57 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.861018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed32fad-645e-4e2b-b11c-40766c115a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.863269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed32fad-645e-4e2b-b11c-40766c115a57 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.891260 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2806/5628] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:08 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:08.893283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed32fad-645e-4e2b-b11c-40766c115a57 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:08.937979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed32fad-645e-4e2b-b11c-40766c115a57 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:08.943264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3086429-17e7-4396-8fc4-0a4741ad3112 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.944564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3086429-17e7-4396-8fc4-0a4741ad3112 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.944872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3086429-17e7-4396-8fc4-0a4741ad3112 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.945254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3086429-17e7-4396-8fc4-0a4741ad3112 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/groups/aee5b969c2384716aab296be3a02c741` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.946879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3086429-17e7-4396-8fc4-0a4741ad3112 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_group(group_id=aee5b969c2384716aab296be3a02c741)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.949885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3086429-17e7-4396-8fc4-0a4741ad3112 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.950806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c60fe4-11b8-4576-8adb-4c74851d31d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:08.951935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60fe4-11b8-4576-8adb-4c74851d31d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.952225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60fe4-11b8-4576-8adb-4c74851d31d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.952901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60fe4-11b8-4576-8adb-4c74851d31d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.953373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c60fe4-11b8-4576-8adb-4c74851d31d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:08.955814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c60fe4-11b8-4576-8adb-4c74851d31d6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:08.967807 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2807/5629] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:08.968866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a1da-de5d-44b3-9ae3-8eade6138c5a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:08.969154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a1da-de5d-44b3-9ae3-8eade6138c5a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:08.969439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a1da-de5d-44b3-9ae3-8eade6138c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:08.991992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b7a9a1da-de5d-44b3-9ae3-8eade6138c5a None None] MFA Rules not processed for user `20246495a35b4762be5b2ad98f537377`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:08.993813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b7a9a1da-de5d-44b3-9ae3-8eade6138c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:09.019592 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2823/5630] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:10:08 2022] DELETE /identity/v3/groups/aee5b969c2384716aab296be3a02c741 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:09.019592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3086429-17e7-4396-8fc4-0a4741ad3112 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:09.072595 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2808/5631] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:09.073619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a1da-de5d-44b3-9ae3-8eade6138c5a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:09.095014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a1da-de5d-44b3-9ae3-8eade6138c5a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:09.120517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3086429-17e7-4396-8fc4-0a4741ad3112 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:09.126604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba498a-cb05-455d-b420-1746ba365841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:09.127327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba498a-cb05-455d-b420-1746ba365841 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:09.128451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba498a-cb05-455d-b420-1746ba365841 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:09.128666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba498a-cb05-455d-b420-1746ba365841 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:09.130136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba498a-cb05-455d-b420-1746ba365841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:09.132245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba498a-cb05-455d-b420-1746ba365841 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:09.146936 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2824/5632] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:09.157331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba498a-cb05-455d-b420-1746ba365841 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:09.178960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba498a-cb05-455d-b420-1746ba365841 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:09.194008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82422b5f-d578-47b8-a184-1515ea420690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:09.195467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422b5f-d578-47b8-a184-1515ea420690 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:09.197976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422b5f-d578-47b8-a184-1515ea420690 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:09.198869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82422b5f-d578-47b8-a184-1515ea420690 admin admin] PATH_INFO: `/v3/projects/7dc28ea863f6483dbdecf4c18a814fe4/users/d15e85943f5d418a94fab0d22598cb78/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:09.236355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:09.236952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82422b5f-d578-47b8-a184-1515ea420690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc28ea863f6483dbdecf4c18a814fe4, user_id=d15e85943f5d418a94fab0d22598cb78, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:09.238103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:09.238627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:09.239216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/projects/253d66ce2d174ad3836ff4efbdf59359` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:09.240763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82422b5f-d578-47b8-a184-1515ea420690 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:09.241120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_project(project_id=253d66ce2d174ad3836ff4efbdf59359)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:09.243250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:09.267782 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2825/5633] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:09 2022] PUT /identity/v3/projects/7dc28ea863f6483dbdecf4c18a814fe4/users/d15e85943f5d418a94fab0d22598cb78/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:09.277302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892fd2-1fe1-481a-adbe-d109aa1d24dd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:09.277302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892fd2-1fe1-481a-adbe-d109aa1d24dd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:09.277629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892fd2-1fe1-481a-adbe-d109aa1d24dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:09.309363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4d892fd2-1fe1-481a-adbe-d109aa1d24dd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:09.310918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4d892fd2-1fe1-481a-adbe-d109aa1d24dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:09.345679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253d66ce2d174ad3836ff4efbdf59359', 'request_id': 'req-6d6d6eb6-e324-427c-901e-b16d21774ff7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.357373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253d66ce2d174ad3836ff4efbdf59359', 'request_id': 'req-6d6d6eb6-e324-427c-901e-b16d21774ff7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.371335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253d66ce2d174ad3836ff4efbdf59359', 'request_id': 'req-6d6d6eb6-e324-427c-901e-b16d21774ff7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.385201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] The token cache is being invalidate because project 253d66ce2d174ad3836ff4efbdf59359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:09.385683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.386239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.387853 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2809/5634] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:09 2022] DELETE /identity/v3/projects/253d66ce2d174ad3836ff4efbdf59359 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:09.396496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:09.398952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:09.419906 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2826/5635] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:09.433596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d892fd2-1fe1-481a-adbe-d109aa1d24dd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:09.438728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4d892fd2-1fe1-481a-adbe-d109aa1d24dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:09.496961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d6eb6-e324-427c-901e-b16d21774ff7 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:09.503511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:09.505309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:09.505827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:09.506383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/domains/3fa7acb66ab8462695b8f0b37d65b038` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:09.508294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3fa7acb66ab8462695b8f0b37d65b038)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:09.510293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:09.570025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d892fd2-1fe1-481a-adbe-d109aa1d24dd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:09.673474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:09.674577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:09.675144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:09.675651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:09.690718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.693443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.759138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.760852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.764068 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2810/5636] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:10:09 2022] PATCH /identity/v3/domains/3fa7acb66ab8462695b8f0b37d65b038 => generated 277 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:09.768105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:09.773118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:09.787866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:09.789959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:09.808736 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2827/5637] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:09.876623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36969-5d37-4b6d-ad58-6246088c3db9 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:09.886496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2959fdf181449da56a9351f0fb7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd0f97d0ade48b5af1f53f27a293600', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:09.887844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:09.888966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:09.889170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] PATH_INFO: `/v3/domains/3fa7acb66ab8462695b8f0b37d65b038` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:09.918582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3fa7acb66ab8462695b8f0b37d65b038)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:09.922530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:09.963264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:09.967690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.036497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038', 'request_id': 'req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.045187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038', 'request_id': 'req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.059020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038', 'request_id': 'req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.107208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] The token cache is being invalidate because project 3fa7acb66ab8462695b8f0b37d65b038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:10.107521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.110089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.140868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038', 'request_id': 'req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.142620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038', 'request_id': 'req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.147695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3fa7acb66ab8462695b8f0b37d65b038', 'request_id': 'req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.156646 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2811/5638] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:10:09 2022] DELETE /identity/v3/domains/3fa7acb66ab8462695b8f0b37d65b038 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:10.162151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:10.163940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:10.180070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f348f-ca80-4188-a300-a41cde7a7f6d service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:10.322085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:10.322966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:10.323248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:10.323529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] PATH_INFO: `/v3/users/ee1d45a0fc6645e3929e97f9417417c4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:10.325765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1d45a0fc6645e3929e97f9417417c4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:10.327689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:10.440613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1d45a0fc6645e3929e97f9417417c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.463476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1d45a0fc6645e3929e97f9417417c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.476877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1d45a0fc6645e3929e97f9417417c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.481832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:10.482030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1d45a0fc6645e3929e97f9417417c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.483597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-780bdbdd-f8c6-48f6-9f70-db3a64fcfe58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1d45a0fc6645e3929e97f9417417c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:10.484398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:10.518946 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2828/5639] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:10 2022] DELETE /identity/v3/users/ee1d45a0fc6645e3929e97f9417417c4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:10.522748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5973f0-17f0-4000-bb67-45c0ef74a985 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:10.523077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5973f0-17f0-4000-bb67-45c0ef74a985 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:10.523309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5973f0-17f0-4000-bb67-45c0ef74a985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:10.547993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ed5973f0-17f0-4000-bb67-45c0ef74a985 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:10.549250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ed5973f0-17f0-4000-bb67-45c0ef74a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:10.573698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0542482-cf49-4e1b-9dd6-39bb0a2c35f6 tempest-InheritsV3TestJSON-2136919132 tempest-InheritsV3TestJSON-2136919132-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:10.660135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2829/5640] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:10.673525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5973f0-17f0-4000-bb67-45c0ef74a985 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:10.676204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ed5973f0-17f0-4000-bb67-45c0ef74a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:10.685607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:10.688045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:10.689163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:10.690368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:10.696241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:10.818304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5973f0-17f0-4000-bb67-45c0ef74a985 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:10.826712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:10.827674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:10.828172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:10.828952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:10.858332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:10.862402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:10.874066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:10.877196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:10.898808 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2830/5641] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:10.909371 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2812/5642] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:12.923987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:12.926657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:12.966525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84e442-a236-46c8-ab16-9d4b20ff7cfd service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:12.992276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:12.993564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:12.994677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:12.994960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] PATH_INFO: `/v3/projects/938c5739244e4eb7bd8eeeebc39e95c4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:13.000066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938c5739244e4eb7bd8eeeebc39e95c4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:13.006335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:13.153548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938c5739244e4eb7bd8eeeebc39e95c4', 'request_id': 'req-3b02fd10-d6f6-4bda-a26d-9501fd236f19'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.163374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938c5739244e4eb7bd8eeeebc39e95c4', 'request_id': 'req-3b02fd10-d6f6-4bda-a26d-9501fd236f19'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.178096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938c5739244e4eb7bd8eeeebc39e95c4', 'request_id': 'req-3b02fd10-d6f6-4bda-a26d-9501fd236f19'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.196202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] The token cache is being invalidate because project 938c5739244e4eb7bd8eeeebc39e95c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:13.196573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.197398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.202987 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2831/5643] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:12 2022] DELETE /identity/v3/projects/938c5739244e4eb7bd8eeeebc39e95c4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:13.204248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:13.229637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23c45-c746-4a40-ace1-3e195903c6b9 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:13.377826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:13.378946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:13.379946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:13.381081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] PATH_INFO: `/v3/users/ad2959fdf181449da56a9351f0fb7352` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:13.383158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2959fdf181449da56a9351f0fb7352)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:13.385337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:13.481528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2959fdf181449da56a9351f0fb7352'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.482937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2959fdf181449da56a9351f0fb7352'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.485769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2959fdf181449da56a9351f0fb7352'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.510862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2959fdf181449da56a9351f0fb7352'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.528433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-61c91abf-7da9-4709-80e6-3e0f022792d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2959fdf181449da56a9351f0fb7352'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:13.576269 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2813/5644] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:13 2022] DELETE /identity/v3/users/ad2959fdf181449da56a9351f0fb7352 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:14.894679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:14.898437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:14.946411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02fd10-d6f6-4bda-a26d-9501fd236f19 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:15.072804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:15.073534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:15.074688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:15.074975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] PATH_INFO: `/v3/projects/edd0f97d0ade48b5af1f53f27a293600` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:15.076976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd0f97d0ade48b5af1f53f27a293600)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:15.080807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:15.195887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd0f97d0ade48b5af1f53f27a293600', 'request_id': 'req-08822ddb-cc76-401f-91a5-94ad909cac74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:15.207035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd0f97d0ade48b5af1f53f27a293600', 'request_id': 'req-08822ddb-cc76-401f-91a5-94ad909cac74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:15.236309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd0f97d0ade48b5af1f53f27a293600', 'request_id': 'req-08822ddb-cc76-401f-91a5-94ad909cac74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:15.269531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] The token cache is being invalidate because project edd0f97d0ade48b5af1f53f27a293600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:15.270424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:15.274498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-08822ddb-cc76-401f-91a5-94ad909cac74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:15.277640 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2832/5645] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:14 2022] DELETE /identity/v3/projects/edd0f97d0ade48b5af1f53f27a293600 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:15.282529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fc24a-df68-49df-8762-751aa8a7cc00 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:15.283086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fc24a-df68-49df-8762-751aa8a7cc00 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:15.283086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fc24a-df68-49df-8762-751aa8a7cc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:15.310667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f23fc24a-df68-49df-8762-751aa8a7cc00 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:15.312807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f23fc24a-df68-49df-8762-751aa8a7cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:15.449267 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2814/5646] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:15.458158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756428-9a8a-4ea6-880d-b8a907fa98cc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:15.458446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756428-9a8a-4ea6-880d-b8a907fa98cc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:15.458734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756428-9a8a-4ea6-880d-b8a907fa98cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:15.518804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-65756428-9a8a-4ea6-880d-b8a907fa98cc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:15.520642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-65756428-9a8a-4ea6-880d-b8a907fa98cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:15.531964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5573-613c-4902-b5f3-d05e92181a18 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:15.532651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5573-613c-4902-b5f3-d05e92181a18 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:15.533185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd5573-613c-4902-b5f3-d05e92181a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:15.540559 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2833/5647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:15.544616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756428-9a8a-4ea6-880d-b8a907fa98cc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:15.564069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e8fd5573-613c-4902-b5f3-d05e92181a18 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:15.565070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756428-9a8a-4ea6-880d-b8a907fa98cc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:15.567600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e8fd5573-613c-4902-b5f3-d05e92181a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:15.579893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:15.580625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:15.581055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:15.583122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:15.584059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:15.584495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:15.591707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:15.635483 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2834/5648] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:15.641017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:15.681335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c35a-fed2-4966-a9d6-dd925a9cb339 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:15.700810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aefab-3856-485c-ab1e-127fdf213d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:15.700810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aefab-3856-485c-ab1e-127fdf213d55 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:15.700810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aefab-3856-485c-ab1e-127fdf213d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:15.700810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aefab-3856-485c-ab1e-127fdf213d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:15.701384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71aefab-3856-485c-ab1e-127fdf213d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:15.705606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71aefab-3856-485c-ab1e-127fdf213d55 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:15.783543 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2835/5649] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:15 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:15.786532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aefab-3856-485c-ab1e-127fdf213d55 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:15.811859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2815/5650] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:15.829046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd5573-613c-4902-b5f3-d05e92181a18 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:15.831168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e8fd5573-613c-4902-b5f3-d05e92181a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:15.991779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aefab-3856-485c-ab1e-127fdf213d55 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:16.007668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dfe86-80a2-4867-a75d-ca721b6415fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:16.008593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfe86-80a2-4867-a75d-ca721b6415fe admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:16.008984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfe86-80a2-4867-a75d-ca721b6415fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:16.009317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfe86-80a2-4867-a75d-ca721b6415fe admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:16.013303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dfe86-80a2-4867-a75d-ca721b6415fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:16.027816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dfe86-80a2-4867-a75d-ca721b6415fe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:16.052671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd5573-613c-4902-b5f3-d05e92181a18 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:16.123724 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2836/5651] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:15 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:16.126786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dfe86-80a2-4867-a75d-ca721b6415fe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:16.158991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dfe86-80a2-4867-a75d-ca721b6415fe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:16.164370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64ff3a-388f-4274-9d97-0ff56ae63fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:16.165756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ff3a-388f-4274-9d97-0ff56ae63fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:16.166046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ff3a-388f-4274-9d97-0ff56ae63fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:16.166421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ff3a-388f-4274-9d97-0ff56ae63fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:16.168140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64ff3a-388f-4274-9d97-0ff56ae63fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:16.169933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64ff3a-388f-4274-9d97-0ff56ae63fa8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:16.173057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d5d1-323c-40f5-9859-497fe2de19a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:16.174123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d5d1-323c-40f5-9859-497fe2de19a8 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:16.174816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d5d1-323c-40f5-9859-497fe2de19a8 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:16.175265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d5d1-323c-40f5-9859-497fe2de19a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:16.203394 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2837/5652] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:16.204303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64ff3a-388f-4274-9d97-0ff56ae63fa8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:16.225676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64ff3a-388f-4274-9d97-0ff56ae63fa8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:16.244319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8baa5-9f72-4b3e-8a23-baa4ed3bd316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:16.245175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8baa5-9f72-4b3e-8a23-baa4ed3bd316 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:16.245508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8baa5-9f72-4b3e-8a23-baa4ed3bd316 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:16.245791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8baa5-9f72-4b3e-8a23-baa4ed3bd316 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:16.247800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8baa5-9f72-4b3e-8a23-baa4ed3bd316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:16.251045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8baa5-9f72-4b3e-8a23-baa4ed3bd316 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:16.284576 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2838/5653] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:16.285582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8baa5-9f72-4b3e-8a23-baa4ed3bd316 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:16.303550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308d5d1-323c-40f5-9859-497fe2de19a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:16.305541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308d5d1-323c-40f5-9859-497fe2de19a8 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:16.332713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8baa5-9f72-4b3e-8a23-baa4ed3bd316 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:16.336040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2816/5654] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:10:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:10:16.349176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40098-9a99-4496-bd85-a9b76cb1f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:16.350319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40098-9a99-4496-bd85-a9b76cb1f4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:16.350547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40098-9a99-4496-bd85-a9b76cb1f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:16.350816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40098-9a99-4496-bd85-a9b76cb1f4e2 admin admin] PATH_INFO: `/v3/projects/d595425661fd4c1f90cf375d6a230195/users/72404685abe14a6b9d9c4c00e5b0a415/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:16.389740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a40098-9a99-4496-bd85-a9b76cb1f4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d595425661fd4c1f90cf375d6a230195, user_id=72404685abe14a6b9d9c4c00e5b0a415, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:16.392686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a40098-9a99-4496-bd85-a9b76cb1f4e2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:16.429700 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2839/5655] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:16 2022] PUT /identity/v3/projects/d595425661fd4c1f90cf375d6a230195/users/72404685abe14a6b9d9c4c00e5b0a415/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:16.430783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1196-0d1f-4b86-b6e6-f2b0a7ebaaae None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:16.433418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1196-0d1f-4b86-b6e6-f2b0a7ebaaae None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:16.433823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1196-0d1f-4b86-b6e6-f2b0a7ebaaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:16.581081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-370d1196-0d1f-4b86-b6e6-f2b0a7ebaaae None None] MFA Rules not processed for user `72404685abe14a6b9d9c4c00e5b0a415`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:16.581081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-370d1196-0d1f-4b86-b6e6-f2b0a7ebaaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:16.850275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40098-9a99-4496-bd85-a9b76cb1f4e2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:16.856670 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2817/5656] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:16.933677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d1196-0d1f-4b86-b6e6-f2b0a7ebaaae None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:16.935375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-370d1196-0d1f-4b86-b6e6-f2b0a7ebaaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:17.058608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40098-9a99-4496-bd85-a9b76cb1f4e2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:17.077162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edfc79-ec67-4cbb-879e-15cfa55a4487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:17.077943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfc79-ec67-4cbb-879e-15cfa55a4487 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:17.078325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfc79-ec67-4cbb-879e-15cfa55a4487 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:17.078798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfc79-ec67-4cbb-879e-15cfa55a4487 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:17.080804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edfc79-ec67-4cbb-879e-15cfa55a4487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:17.083858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edfc79-ec67-4cbb-879e-15cfa55a4487 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:17.167711 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2840/5657] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:16 2022] POST /identity/v3/projects => generated 375 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:17.168879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edfc79-ec67-4cbb-879e-15cfa55a4487 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:17.195718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d1196-0d1f-4b86-b6e6-f2b0a7ebaaae None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:17.446005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:17.446911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:17.447198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:17.448722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edfc79-ec67-4cbb-879e-15cfa55a4487 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:17.449776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] PATH_INFO: `/v3/users/80f051bbb561496181a42136f6ca2032` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:17.451932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f051bbb561496181a42136f6ca2032)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:17.456719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:17.467987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2535ab8-ad8d-4b23-bd60-1a8128fc28cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:17.468673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535ab8-ad8d-4b23-bd60-1a8128fc28cd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:17.475703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535ab8-ad8d-4b23-bd60-1a8128fc28cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:17.476213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535ab8-ad8d-4b23-bd60-1a8128fc28cd admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:17.488645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2535ab8-ad8d-4b23-bd60-1a8128fc28cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:17.502125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2535ab8-ad8d-4b23-bd60-1a8128fc28cd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:17.574025 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2841/5658] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:17 2022] POST /identity/v3/users => generated 294 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:17.582458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2535ab8-ad8d-4b23-bd60-1a8128fc28cd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:17.658348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f051bbb561496181a42136f6ca2032'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:17.660109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f051bbb561496181a42136f6ca2032'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:17.661657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f051bbb561496181a42136f6ca2032'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:17.667251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2535ab8-ad8d-4b23-bd60-1a8128fc28cd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:17.692706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f051bbb561496181a42136f6ca2032'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:17.699817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:17.701129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:17.701817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:17.702483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:17.707123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:17.710514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:17.737937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e1313f4-5952-444c-b64a-17a1f7968ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f051bbb561496181a42136f6ca2032'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:17.756018 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2842/5659] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:17.760622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:17.766721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:17.813030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcca6f7-1e09-4b87-9d09-7729a54dcfac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:17.833142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab997f-e7fc-46c8-b3ec-f3d8c4ccfba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:17.834276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab997f-e7fc-46c8-b3ec-f3d8c4ccfba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:17.835410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab997f-e7fc-46c8-b3ec-f3d8c4ccfba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:17.836970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab997f-e7fc-46c8-b3ec-f3d8c4ccfba8 admin admin] PATH_INFO: `/v3/projects/7f5ade936f1f4f599c99a77d544ea82d/users/6fbed6e363164a1ea03ef1824fbef08e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:17.858971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2818/5660] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:16 2022] DELETE /identity/v3/users/80f051bbb561496181a42136f6ca2032 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:17.861835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e73ff-61f9-4d24-bf03-f9956155217b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:17.862276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e73ff-61f9-4d24-bf03-f9956155217b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:17.862682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e73ff-61f9-4d24-bf03-f9956155217b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:17.908299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab997f-e7fc-46c8-b3ec-f3d8c4ccfba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5ade936f1f4f599c99a77d544ea82d, user_id=6fbed6e363164a1ea03ef1824fbef08e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:17.911719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab997f-e7fc-46c8-b3ec-f3d8c4ccfba8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:17.946332 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2843/5661] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:17 2022] PUT /identity/v3/projects/7f5ade936f1f4f599c99a77d544ea82d/users/6fbed6e363164a1ea03ef1824fbef08e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:17.947707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab997f-e7fc-46c8-b3ec-f3d8c4ccfba8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:17.977238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3f2e73ff-61f9-4d24-bf03-f9956155217b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:17.978504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3f2e73ff-61f9-4d24-bf03-f9956155217b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:18.091499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab997f-e7fc-46c8-b3ec-f3d8c4ccfba8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:18.100116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7218524-0af2-4bd5-b0b9-93c4a62b3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:18.101208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218524-0af2-4bd5-b0b9-93c4a62b3a9e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:18.101677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218524-0af2-4bd5-b0b9-93c4a62b3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:18.102118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218524-0af2-4bd5-b0b9-93c4a62b3a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:18.103052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7218524-0af2-4bd5-b0b9-93c4a62b3a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:18.105024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7218524-0af2-4bd5-b0b9-93c4a62b3a9e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:18.118449 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2844/5662] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:18.122710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7218524-0af2-4bd5-b0b9-93c4a62b3a9e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:18.135859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7218524-0af2-4bd5-b0b9-93c4a62b3a9e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:18.143348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbbbdf-0522-4742-a18a-ff41c1cb3f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:18.145387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbbdf-0522-4742-a18a-ff41c1cb3f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:18.146041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbbdf-0522-4742-a18a-ff41c1cb3f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:18.146494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbbdf-0522-4742-a18a-ff41c1cb3f04 admin admin] PATH_INFO: `/v3/projects/7f5ade936f1f4f599c99a77d544ea82d/users/6fbed6e363164a1ea03ef1824fbef08e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:18.148956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbbbdf-0522-4742-a18a-ff41c1cb3f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5ade936f1f4f599c99a77d544ea82d, user_id=6fbed6e363164a1ea03ef1824fbef08e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:18.153413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbbbdf-0522-4742-a18a-ff41c1cb3f04 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:18.168875 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2845/5663] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:18 2022] PUT /identity/v3/projects/7f5ade936f1f4f599c99a77d544ea82d/users/6fbed6e363164a1ea03ef1824fbef08e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:18.183268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c72b-c27d-41e5-b92e-f637080405fb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:18.183899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c72b-c27d-41e5-b92e-f637080405fb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:18.184506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c72b-c27d-41e5-b92e-f637080405fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:18.236824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5491c72b-c27d-41e5-b92e-f637080405fb None None] MFA Rules not processed for user `6fbed6e363164a1ea03ef1824fbef08e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:18.238541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5491c72b-c27d-41e5-b92e-f637080405fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:18.282250 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2819/5664] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:18.286014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a11c-6003-41ee-8fed-ace0f2288f16 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:18.291344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a11c-6003-41ee-8fed-ace0f2288f16 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:18.291813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a11c-6003-41ee-8fed-ace0f2288f16 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:18.299911 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2820/5665] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:10:18 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:10:18.304474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0b798-96ed-4123-b045-1c6362f4644b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:18.305150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0b798-96ed-4123-b045-1c6362f4644b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:18.305668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0b798-96ed-4123-b045-1c6362f4644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:18.386992 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2846/5666] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:18.394181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c72b-c27d-41e5-b92e-f637080405fb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:18.398860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5491c72b-c27d-41e5-b92e-f637080405fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:18.433778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eff0b798-96ed-4123-b045-1c6362f4644b None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:18.435778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eff0b798-96ed-4123-b045-1c6362f4644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:18.608684 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2821/5667] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:18.610533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0b798-96ed-4123-b045-1c6362f4644b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:18.634101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c72b-c27d-41e5-b92e-f637080405fb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:18.643717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c997342-db44-46f9-8c9f-e274e4ec4da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:18.645685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c997342-db44-46f9-8c9f-e274e4ec4da8 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:18.645990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c997342-db44-46f9-8c9f-e274e4ec4da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:18.646273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c997342-db44-46f9-8c9f-e274e4ec4da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:18.651219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0b798-96ed-4123-b045-1c6362f4644b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:18.666356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d66cf-e7fc-43e8-83ab-01a81d4937dc tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:18.667525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d66cf-e7fc-43e8-83ab-01a81d4937dc tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:18.670292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d66cf-e7fc-43e8-83ab-01a81d4937dc tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:18.671072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d66cf-e7fc-43e8-83ab-01a81d4937dc tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:18.672138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d66cf-e7fc-43e8-83ab-01a81d4937dc tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:18.675471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d66cf-e7fc-43e8-83ab-01a81d4937dc tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:18.730311 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2822/5668] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:18 2022] POST /identity/v3/projects => generated 333 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:18.747919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d66cf-e7fc-43e8-83ab-01a81d4937dc tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:18.814986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c997342-db44-46f9-8c9f-e274e4ec4da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:18.817190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c997342-db44-46f9-8c9f-e274e4ec4da8 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:18.846917 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2847/5669] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:18.940973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d66cf-e7fc-43e8-83ab-01a81d4937dc tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:18.970881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877f679-0735-4920-95c4-36ccd03341f2 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:18.972463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f679-0735-4920-95c4-36ccd03341f2 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:18.973930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f679-0735-4920-95c4-36ccd03341f2 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:18.975483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f679-0735-4920-95c4-36ccd03341f2 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:18.977100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877f679-0735-4920-95c4-36ccd03341f2 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:18.981590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877f679-0735-4920-95c4-36ccd03341f2 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:19.105096 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2823/5670] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:10:18 2022] POST /identity/v3/projects => generated 333 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:19.108948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c997342-db44-46f9-8c9f-e274e4ec4da8 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:19.130435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c997342-db44-46f9-8c9f-e274e4ec4da8 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:19.140948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877f679-0735-4920-95c4-36ccd03341f2 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:19.320900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0aa81-ffb8-413a-b83c-e59658ead49e tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:19.322026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0aa81-ffb8-413a-b83c-e59658ead49e tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:19.322026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0aa81-ffb8-413a-b83c-e59658ead49e tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:19.322321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0aa81-ffb8-413a-b83c-e59658ead49e tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:19.323030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0aa81-ffb8-413a-b83c-e59658ead49e tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:19.325138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0aa81-ffb8-413a-b83c-e59658ead49e tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:19.346328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877f679-0735-4920-95c4-36ccd03341f2 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:19.373276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b025ed2-fa29-42b2-87c3-f47a0352277f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:19.374360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b025ed2-fa29-42b2-87c3-f47a0352277f service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:19.374743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b025ed2-fa29-42b2-87c3-f47a0352277f service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:19.375028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b025ed2-fa29-42b2-87c3-f47a0352277f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:19.447996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b025ed2-fa29-42b2-87c3-f47a0352277f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:19.449719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b025ed2-fa29-42b2-87c3-f47a0352277f service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:19.481546 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2848/5671] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:19 2022] POST /identity/v3/projects => generated 358 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:19.486217 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2824/5672] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:19.491619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0aa81-ffb8-413a-b83c-e59658ead49e tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:19.657884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0aa81-ffb8-413a-b83c-e59658ead49e tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:19.668150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7276461-aaa8-4406-a04c-e5b9eee3b282 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:19.669564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7276461-aaa8-4406-a04c-e5b9eee3b282 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:19.670069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7276461-aaa8-4406-a04c-e5b9eee3b282 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:19.670866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7276461-aaa8-4406-a04c-e5b9eee3b282 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:19.671905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7276461-aaa8-4406-a04c-e5b9eee3b282 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:19.675874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7276461-aaa8-4406-a04c-e5b9eee3b282 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:19.730191 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2849/5673] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 21:10:19 2022] GET /identity/v3/projects => generated 7221 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:19.734946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b025ed2-fa29-42b2-87c3-f47a0352277f service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:19.758568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b025ed2-fa29-42b2-87c3-f47a0352277f service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:19.771962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:19.773635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:19.774106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:19.776842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:19.777863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:19.778381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:19.782601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:19.844976 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2825/5674] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 21:10:19 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:19.851632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7276461-aaa8-4406-a04c-e5b9eee3b282 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:19.897472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7276461-aaa8-4406-a04c-e5b9eee3b282 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:19.931476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:19.934563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:19.936829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:19.939477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:19.949446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Adding query filter params (parent_id=3de5ca9202e54b2e852fdaf2c9dd9dc6) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:19.949785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:19.951712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:20.007401 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2850/5675] 10.222.0.30 () {58 vars in 1215 bytes} [Sat Feb 19 21:10:19 2022] GET /identity/v3/projects?parent_id=3de5ca9202e54b2e852fdaf2c9dd9dc6 => generated 498 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:20.012805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:20.061443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9c9d6-c25d-4133-9a00-aa6106709e28 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:20.069836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:20.071817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:20.072634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:20.073203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects/0d10c5bd88e647939393c7ce55a711a1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:20.081459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d10c5bd88e647939393c7ce55a711a1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:20.084784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:20.243028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d10c5bd88e647939393c7ce55a711a1', 'request_id': 'req-39b6e015-fa50-42e8-8683-e53c2085de7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.258341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d10c5bd88e647939393c7ce55a711a1', 'request_id': 'req-39b6e015-fa50-42e8-8683-e53c2085de7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.277128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d10c5bd88e647939393c7ce55a711a1', 'request_id': 'req-39b6e015-fa50-42e8-8683-e53c2085de7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.316231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] The token cache is being invalidate because project 0d10c5bd88e647939393c7ce55a711a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:20.316231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.316925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.320652 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2826/5676] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:20 2022] DELETE /identity/v3/projects/0d10c5bd88e647939393c7ce55a711a1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:20.326487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:20.328535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:20.357394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bb39-f92c-4604-a056-1b4dedb05b48 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:20.559994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:20.560956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:20.561245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:20.561588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects/3de5ca9202e54b2e852fdaf2c9dd9dc6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:20.563633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3de5ca9202e54b2e852fdaf2c9dd9dc6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:20.570250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:20.743187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de5ca9202e54b2e852fdaf2c9dd9dc6', 'request_id': 'req-76c3560f-8029-4eda-922d-810602d2dbc8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.750416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de5ca9202e54b2e852fdaf2c9dd9dc6', 'request_id': 'req-76c3560f-8029-4eda-922d-810602d2dbc8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.763605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de5ca9202e54b2e852fdaf2c9dd9dc6', 'request_id': 'req-76c3560f-8029-4eda-922d-810602d2dbc8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.797581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] The token cache is being invalidate because project 3de5ca9202e54b2e852fdaf2c9dd9dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:20.800312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.806039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:20.809193 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2851/5677] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:20 2022] DELETE /identity/v3/projects/3de5ca9202e54b2e852fdaf2c9dd9dc6 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:20.812990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:20.845964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6e015-fa50-42e8-8683-e53c2085de7a tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:20.995902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbed6e363164a1ea03ef1824fbef08e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f5ade936f1f4f599c99a77d544ea82d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:20.996949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:20.997169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:20.997346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] PATH_INFO: `/v3/projects/de261cc5c5ab4f0a988cf2c86ae07441` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:21.001317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de261cc5c5ab4f0a988cf2c86ae07441)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:21.003201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:21.127042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de261cc5c5ab4f0a988cf2c86ae07441', 'request_id': 'req-19c54670-9f0a-4ec6-81df-f4dd7398a87f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.137819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de261cc5c5ab4f0a988cf2c86ae07441', 'request_id': 'req-19c54670-9f0a-4ec6-81df-f4dd7398a87f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.149443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de261cc5c5ab4f0a988cf2c86ae07441', 'request_id': 'req-19c54670-9f0a-4ec6-81df-f4dd7398a87f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.166976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] The token cache is being invalidate because project de261cc5c5ab4f0a988cf2c86ae07441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:21.167304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.168035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-19c54670-9f0a-4ec6-81df-f4dd7398a87f tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.170505 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2827/5678] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:20 2022] DELETE /identity/v3/projects/de261cc5c5ab4f0a988cf2c86ae07441 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:21.174517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:21.176916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:21.417784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3560f-8029-4eda-922d-810602d2dbc8 tempest-ListProjectsTestJSON-546974496 tempest-ListProjectsTestJSON-546974496-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:21.574268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:21.575805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:21.576402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:21.576971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] PATH_INFO: `/v3/users/72404685abe14a6b9d9c4c00e5b0a415` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:21.581469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72404685abe14a6b9d9c4c00e5b0a415)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:21.584693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:21.729895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72404685abe14a6b9d9c4c00e5b0a415'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.753791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72404685abe14a6b9d9c4c00e5b0a415'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.775668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72404685abe14a6b9d9c4c00e5b0a415'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.777726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72404685abe14a6b9d9c4c00e5b0a415'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.779176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72404685abe14a6b9d9c4c00e5b0a415'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:21.834847 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2852/5679] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:21 2022] DELETE /identity/v3/users/72404685abe14a6b9d9c4c00e5b0a415 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:21.836659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b8c7d-4a63-4850-93c9-5eb5a84711d0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:21.837241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b8c7d-4a63-4850-93c9-5eb5a84711d0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:21.837356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b8c7d-4a63-4850-93c9-5eb5a84711d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:21.887056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e01b8c7d-4a63-4850-93c9-5eb5a84711d0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:21.889150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e01b8c7d-4a63-4850-93c9-5eb5a84711d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:22.127273 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2828/5680] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:22.164551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:22.174265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:22.283149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b8c7d-4a63-4850-93c9-5eb5a84711d0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:22.285435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e01b8c7d-4a63-4850-93c9-5eb5a84711d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:22.315493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b8c7d-4a63-4850-93c9-5eb5a84711d0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:22.352823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:22.370857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:22.372187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:22.375339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] PATH_INFO: `/v3/projects/cff0d215a214460c9416ea760e822a14` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:22.380114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff0d215a214460c9416ea760e822a14)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:22.393031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:22.473849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed26d5-9ec7-48b4-974e-ac2d20053967 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:22.486654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478bb61-c7d3-4a8a-933c-20a04cbb456a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:22.487355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478bb61-c7d3-4a8a-933c-20a04cbb456a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:22.488230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478bb61-c7d3-4a8a-933c-20a04cbb456a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:22.488739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478bb61-c7d3-4a8a-933c-20a04cbb456a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:22.518887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478bb61-c7d3-4a8a-933c-20a04cbb456a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:22.523836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478bb61-c7d3-4a8a-933c-20a04cbb456a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:22.549620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2853/5681] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:22.568458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff0d215a214460c9416ea760e822a14', 'request_id': 'req-2de8d56b-57ab-4622-98c8-53a30a6b5b76'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:22.584816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff0d215a214460c9416ea760e822a14', 'request_id': 'req-2de8d56b-57ab-4622-98c8-53a30a6b5b76'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:22.606672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff0d215a214460c9416ea760e822a14', 'request_id': 'req-2de8d56b-57ab-4622-98c8-53a30a6b5b76'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:22.638884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] The token cache is being invalidate because project cff0d215a214460c9416ea760e822a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:22.642949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:22.646790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2de8d56b-57ab-4622-98c8-53a30a6b5b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:22.651574 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2829/5682] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:22 2022] DELETE /identity/v3/projects/cff0d215a214460c9416ea760e822a14 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:22.655631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478bb61-c7d3-4a8a-933c-20a04cbb456a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:22.673950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478bb61-c7d3-4a8a-933c-20a04cbb456a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:22.822646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:22.824186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:22.824786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:22.825321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] PATH_INFO: `/v3/users/041dd96820174f1c9bfa020cef480c24` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:22.826940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041dd96820174f1c9bfa020cef480c24)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:22.829204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:22.954215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041dd96820174f1c9bfa020cef480c24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:22.979603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041dd96820174f1c9bfa020cef480c24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:23.014223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041dd96820174f1c9bfa020cef480c24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:23.015085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041dd96820174f1c9bfa020cef480c24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:23.016543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041dd96820174f1c9bfa020cef480c24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:23.064494 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2854/5683] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:22 2022] DELETE /identity/v3/users/041dd96820174f1c9bfa020cef480c24 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:23.218683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5f61-b50f-4b9a-8a47-5c97cc97f209 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:23.219970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5f61-b50f-4b9a-8a47-5c97cc97f209 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:23.220727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5f61-b50f-4b9a-8a47-5c97cc97f209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:23.264792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-967a5f61-b50f-4b9a-8a47-5c97cc97f209 None None] MFA Rules not processed for user `d15e85943f5d418a94fab0d22598cb78`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:23.266692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-967a5f61-b50f-4b9a-8a47-5c97cc97f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:23.408063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:23.410007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:23.413986 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2830/5684] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:23.541610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a5f61-b50f-4b9a-8a47-5c97cc97f209 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:23.543366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-967a5f61-b50f-4b9a-8a47-5c97cc97f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:23.599381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6cfe-9f8d-4ff7-85f5-5d0f49acf1b7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:23.622098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5e227-77f2-4a86-b319-b0493e976b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:23.623091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e227-77f2-4a86-b319-b0493e976b05 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:23.623591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e227-77f2-4a86-b319-b0493e976b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:23.624189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5e227-77f2-4a86-b319-b0493e976b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:23.626473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5e227-77f2-4a86-b319-b0493e976b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:23.629707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5e227-77f2-4a86-b319-b0493e976b05 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:23.715454 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2855/5685] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:23 2022] POST /identity/v3/projects => generated 379 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:23.726900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5e227-77f2-4a86-b319-b0493e976b05 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:23.800720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a5f61-b50f-4b9a-8a47-5c97cc97f209 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:23.931897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5e227-77f2-4a86-b319-b0493e976b05 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:23.944838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7324f-c684-4239-baa7-ff02c0acd466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:23.945779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7324f-c684-4239-baa7-ff02c0acd466 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:23.946077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7324f-c684-4239-baa7-ff02c0acd466 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:23.946384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7324f-c684-4239-baa7-ff02c0acd466 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:23.947541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7324f-c684-4239-baa7-ff02c0acd466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:23.951746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7324f-c684-4239-baa7-ff02c0acd466 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:23.999824 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2856/5686] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:23 2022] POST /identity/v3/users => generated 296 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:24.003671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7324f-c684-4239-baa7-ff02c0acd466 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:24.018483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:24.018483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:24.019036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:24.019036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] PATH_INFO: `/v3/projects/d595425661fd4c1f90cf375d6a230195` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:24.026189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7324f-c684-4239-baa7-ff02c0acd466 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:24.029803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d595425661fd4c1f90cf375d6a230195)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:24.033756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:24.043496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b8b11-a9ee-44b1-9b4f-0daeb3ba12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:24.044265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b8b11-a9ee-44b1-9b4f-0daeb3ba12d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:24.044645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b8b11-a9ee-44b1-9b4f-0daeb3ba12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:24.044957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b8b11-a9ee-44b1-9b4f-0daeb3ba12d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:24.045701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b8b11-a9ee-44b1-9b4f-0daeb3ba12d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:24.051066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b8b11-a9ee-44b1-9b4f-0daeb3ba12d3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:24.078341 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2857/5687] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:24.081408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b8b11-a9ee-44b1-9b4f-0daeb3ba12d3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:24.158403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b8b11-a9ee-44b1-9b4f-0daeb3ba12d3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:24.170717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd595425661fd4c1f90cf375d6a230195', 'request_id': 'req-83951f15-3b36-4db1-b5a8-22a1433bdeda'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.193708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd595425661fd4c1f90cf375d6a230195', 'request_id': 'req-83951f15-3b36-4db1-b5a8-22a1433bdeda'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.218551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd595425661fd4c1f90cf375d6a230195', 'request_id': 'req-83951f15-3b36-4db1-b5a8-22a1433bdeda'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.256219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] The token cache is being invalidate because project d595425661fd4c1f90cf375d6a230195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:24.256982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.257397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.260174 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2831/5688] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:23 2022] DELETE /identity/v3/projects/d595425661fd4c1f90cf375d6a230195 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:24.263710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:24.265806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:24.369072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:24.372994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:24.373553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:24.375679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] PATH_INFO: `/v3/projects/a156d0f2c1cb49f6ad7ba684fc36203a/users/60dfc693d9b64b7fb5bbaefcf922249a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:24.441351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a156d0f2c1cb49f6ad7ba684fc36203a, user_id=60dfc693d9b64b7fb5bbaefcf922249a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:24.453409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:24.487934 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2858/5689] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:24 2022] PUT /identity/v3/projects/a156d0f2c1cb49f6ad7ba684fc36203a/users/60dfc693d9b64b7fb5bbaefcf922249a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:24.496157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:24.499981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951f15-3b36-4db1-b5a8-22a1433bdeda admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:24.500633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:24.718108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:24.721335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:24.721529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:24.721814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] PATH_INFO: `/v3/users/6fbed6e363164a1ea03ef1824fbef08e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:24.727034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbed6e363164a1ea03ef1824fbef08e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:24.733119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:24.749657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c535f-486b-4bbc-b2e6-da2ed74a11a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:24.761912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:24.763175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:24.763461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:24.763740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:24.767144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:24.771949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:24.805745 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2859/5690] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:24.809203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:24.815224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:24.849175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbed6e363164a1ea03ef1824fbef08e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.851215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369858-36c4-450d-801d-4cddf380034e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:24.852105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbed6e363164a1ea03ef1824fbef08e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.852989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbed6e363164a1ea03ef1824fbef08e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.857734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:24.859477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:24.860107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:24.860697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] PATH_INFO: `/v3/projects/c5c2481a0ee54734ab42231ae9ec6ecc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:24.862551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c2481a0ee54734ab42231ae9ec6ecc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:24.866248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:24.885767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbed6e363164a1ea03ef1824fbef08e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.903631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbed6e363164a1ea03ef1824fbef08e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:24.945488 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2832/5691] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:24 2022] DELETE /identity/v3/users/6fbed6e363164a1ea03ef1824fbef08e => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:24.953545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:24.959037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:24.989395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c2481a0ee54734ab42231ae9ec6ecc', 'request_id': 'req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:25.005037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c2481a0ee54734ab42231ae9ec6ecc', 'request_id': 'req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:25.024813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c2481a0ee54734ab42231ae9ec6ecc', 'request_id': 'req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:25.056715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] The token cache is being invalidate because project c5c2481a0ee54734ab42231ae9ec6ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:25.058473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:25.060583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:25.069940 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2860/5692] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:24 2022] DELETE /identity/v3/projects/c5c2481a0ee54734ab42231ae9ec6ecc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:25.074071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:25.081699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:25.187664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fc376-95f7-4dec-a2d3-21db3622c271 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:25.204682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3b914-adab-4681-a5d9-438b796415e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:25.205636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b914-adab-4681-a5d9-438b796415e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:25.205930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b914-adab-4681-a5d9-438b796415e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:25.206238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b914-adab-4681-a5d9-438b796415e5 admin admin] PATH_INFO: `/v3/projects/a156d0f2c1cb49f6ad7ba684fc36203a/users/60dfc693d9b64b7fb5bbaefcf922249a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:25.214499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b914-adab-4681-a5d9-438b796415e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a156d0f2c1cb49f6ad7ba684fc36203a, user_id=60dfc693d9b64b7fb5bbaefcf922249a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:25.220946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b914-adab-4681-a5d9-438b796415e5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:25.260428 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2833/5693] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:24 2022] PUT /identity/v3/projects/a156d0f2c1cb49f6ad7ba684fc36203a/users/60dfc693d9b64b7fb5bbaefcf922249a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:25.261784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0481dc-2259-4e46-a1aa-18a77b1dc26c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:25.262070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0481dc-2259-4e46-a1aa-18a77b1dc26c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:25.262347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0481dc-2259-4e46-a1aa-18a77b1dc26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:25.305193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-aa0481dc-2259-4e46-a1aa-18a77b1dc26c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:25.306446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aa0481dc-2259-4e46-a1aa-18a77b1dc26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:25.400723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3239f-2cb1-4c42-ae47-4e33f40da5ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:25.531451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:25.532915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:25.534161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:25.534662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:25.538637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:25.546482 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2834/5694] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:25.559875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72bba-0666-4ea0-96b6-fc58ddd9099e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:25.560216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72bba-0666-4ea0-96b6-fc58ddd9099e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:25.560433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72bba-0666-4ea0-96b6-fc58ddd9099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:25.634005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:25.635482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:25.653342 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2861/5695] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:25.691912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8db72bba-0666-4ea0-96b6-fc58ddd9099e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:25.699222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8db72bba-0666-4ea0-96b6-fc58ddd9099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:25.740536 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2835/5696] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:25.746087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:25.766287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbb4fe-2d7e-497c-aaa2-0de346d8acea service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:25.780261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:25.782595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:25.782933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:25.783770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:25.784643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:25.785991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:25.791895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:25.828525 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2862/5697] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:25.834991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72bba-0666-4ea0-96b6-fc58ddd9099e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:25.852769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72bba-0666-4ea0-96b6-fc58ddd9099e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:25.868070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2a22d-3bc6-4884-b427-3e70bd419807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:25.884837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a22d-3bc6-4884-b427-3e70bd419807 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:25.885791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a22d-3bc6-4884-b427-3e70bd419807 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:25.888627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a22d-3bc6-4884-b427-3e70bd419807 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:25.890957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2a22d-3bc6-4884-b427-3e70bd419807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:25.900168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2a22d-3bc6-4884-b427-3e70bd419807 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:25.974713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2836/5698] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:25 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:25.978394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:25.996902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbde96a-40ef-44d3-b43e-dd64dbffe8e6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:26.136218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43fb05-8a68-4319-bb9b-1d48f97e9d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:26.137609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43fb05-8a68-4319-bb9b-1d48f97e9d28 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:26.138241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43fb05-8a68-4319-bb9b-1d48f97e9d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:26.138721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43fb05-8a68-4319-bb9b-1d48f97e9d28 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:26.140117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43fb05-8a68-4319-bb9b-1d48f97e9d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:26.143004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43fb05-8a68-4319-bb9b-1d48f97e9d28 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:26.202632 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2863/5699] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:25 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:26.206818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2a22d-3bc6-4884-b427-3e70bd419807 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:26.227120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2a22d-3bc6-4884-b427-3e70bd419807 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:26.253323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeb022-4dd0-49db-92b6-de2b88254288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:26.255549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeb022-4dd0-49db-92b6-de2b88254288 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:26.256620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeb022-4dd0-49db-92b6-de2b88254288 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:26.258423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeb022-4dd0-49db-92b6-de2b88254288 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:26.259416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faeb022-4dd0-49db-92b6-de2b88254288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:26.262457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faeb022-4dd0-49db-92b6-de2b88254288 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:26.305393 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2837/5700] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:26.310942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43fb05-8a68-4319-bb9b-1d48f97e9d28 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:26.356175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43fb05-8a68-4319-bb9b-1d48f97e9d28 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:26.376301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e22ca-cf48-4b18-860d-bb9ac8725dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:26.377123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e22ca-cf48-4b18-860d-bb9ac8725dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:26.381177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e22ca-cf48-4b18-860d-bb9ac8725dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:26.381581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e22ca-cf48-4b18-860d-bb9ac8725dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:26.382345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e22ca-cf48-4b18-860d-bb9ac8725dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:26.385673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e22ca-cf48-4b18-860d-bb9ac8725dc9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:26.422011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeb022-4dd0-49db-92b6-de2b88254288 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:26.424759 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2864/5701] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:26.439785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeb022-4dd0-49db-92b6-de2b88254288 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:26.469231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:26.474089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:26.474882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:26.475411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] PATH_INFO: `/v3/projects/8784470ae96b46a79c5b058ffb1173c3/users/d29d77f86ecd490da83816708092ff71/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:26.503543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8784470ae96b46a79c5b058ffb1173c3, user_id=d29d77f86ecd490da83816708092ff71, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:26.504928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:26.553832 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2838/5702] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:26 2022] PUT /identity/v3/projects/8784470ae96b46a79c5b058ffb1173c3/users/d29d77f86ecd490da83816708092ff71/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:26.566994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356583c2-8ae3-46a2-9716-9672cd5ece22 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:26.567315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356583c2-8ae3-46a2-9716-9672cd5ece22 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:26.568025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356583c2-8ae3-46a2-9716-9672cd5ece22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:26.610647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-356583c2-8ae3-46a2-9716-9672cd5ece22 None None] MFA Rules not processed for user `d29d77f86ecd490da83816708092ff71`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:26.612356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-356583c2-8ae3-46a2-9716-9672cd5ece22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:26.722399 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2865/5703] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:26.733243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:26.735267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:26.926610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356583c2-8ae3-46a2-9716-9672cd5ece22 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:26.929310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-356583c2-8ae3-46a2-9716-9672cd5ece22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:26.971844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93d005-d351-493a-ace0-ccc4567e276d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:26.989299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea318f75-759d-4c64-8999-255d0dbc2294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:26.990352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318f75-759d-4c64-8999-255d0dbc2294 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:26.990841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318f75-759d-4c64-8999-255d0dbc2294 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:26.991318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318f75-759d-4c64-8999-255d0dbc2294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:27.031390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea318f75-759d-4c64-8999-255d0dbc2294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:27.034535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea318f75-759d-4c64-8999-255d0dbc2294 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:27.107014 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2839/5704] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:27.115744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356583c2-8ae3-46a2-9716-9672cd5ece22 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:27.137536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:27.140494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:27.140829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:27.141683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] PATH_INFO: `/v3/projects/7f5ade936f1f4f599c99a77d544ea82d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:27.146769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f5ade936f1f4f599c99a77d544ea82d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:27.151878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:27.278754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5ade936f1f4f599c99a77d544ea82d', 'request_id': 'req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:27.294020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5ade936f1f4f599c99a77d544ea82d', 'request_id': 'req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:27.319083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5ade936f1f4f599c99a77d544ea82d', 'request_id': 'req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:27.353372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] The token cache is being invalidate because project 7f5ade936f1f4f599c99a77d544ea82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:27.353372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:27.353372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:27.353372 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2866/5705] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:26 2022] DELETE /identity/v3/projects/7f5ade936f1f4f599c99a77d544ea82d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:27.355232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155d8eb-6105-4c95-bb93-4d26cf1bd608 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:27.355840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155d8eb-6105-4c95-bb93-4d26cf1bd608 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:27.356513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155d8eb-6105-4c95-bb93-4d26cf1bd608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:27.421446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3155d8eb-6105-4c95-bb93-4d26cf1bd608 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:27.427107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3155d8eb-6105-4c95-bb93-4d26cf1bd608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:27.512709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:27.515285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:27.634863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2840/5706] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:27.651528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287afb-ab6e-44ea-a15f-014b1d2ed285 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:27.652501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287afb-ab6e-44ea-a15f-014b1d2ed285 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:27.654038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287afb-ab6e-44ea-a15f-014b1d2ed285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:27.737675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-55287afb-ab6e-44ea-a15f-014b1d2ed285 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:27.740297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55287afb-ab6e-44ea-a15f-014b1d2ed285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:27.771868 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2841/5707] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:27.790393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaacbea-f3fa-4156-81bf-35f3edaaf6d2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:27.803680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287afb-ab6e-44ea-a15f-014b1d2ed285 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:27.808685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:27.809750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:27.810248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:27.810690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:27.832321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287afb-ab6e-44ea-a15f-014b1d2ed285 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:27.841110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:27.841628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:27.843002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:27.843888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:27.844720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:27.859154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:27.867295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:27.876453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:27.931095 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2842/5708] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:27.936284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:27.997985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791ea3-cadf-4034-9ffb-037c542b165c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:28.012994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3575a2-07f3-4f6d-a354-f07cc27fb2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:28.013681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3575a2-07f3-4f6d-a354-f07cc27fb2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:28.013966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3575a2-07f3-4f6d-a354-f07cc27fb2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:28.014266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3575a2-07f3-4f6d-a354-f07cc27fb2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:28.015168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3575a2-07f3-4f6d-a354-f07cc27fb2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:28.017358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3575a2-07f3-4f6d-a354-f07cc27fb2d2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:28.107932 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2843/5709] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:27 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:28.111512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3575a2-07f3-4f6d-a354-f07cc27fb2d2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:28.206903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:28.209648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:28.242710 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2867/5710] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:28.409437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3575a2-07f3-4f6d-a354-f07cc27fb2d2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:28.424173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b925-6a68-43bc-a10e-efb6db6e4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:28.426806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b925-6a68-43bc-a10e-efb6db6e4bbe admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:28.428192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b925-6a68-43bc-a10e-efb6db6e4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:28.429744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b925-6a68-43bc-a10e-efb6db6e4bbe admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:28.432716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4b925-6a68-43bc-a10e-efb6db6e4bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:28.436615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4b925-6a68-43bc-a10e-efb6db6e4bbe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:28.503330 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2844/5711] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:28 2022] POST /identity/v3/users => generated 283 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:28.510207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:28.530601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c197-7d2e-49ad-9f5a-00b52656de39 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:28.543206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc684f-7742-4087-bdb2-58775f19d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:28.544968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc684f-7742-4087-bdb2-58775f19d2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:28.545525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc684f-7742-4087-bdb2-58775f19d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:28.548024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc684f-7742-4087-bdb2-58775f19d2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:28.552958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc684f-7742-4087-bdb2-58775f19d2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:28.558837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc684f-7742-4087-bdb2-58775f19d2a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:28.586401 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2868/5712] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:28.591190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b925-6a68-43bc-a10e-efb6db6e4bbe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:28.616810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b925-6a68-43bc-a10e-efb6db6e4bbe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:28.637510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d623a6-858f-4e65-b100-e8a550fe11b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:28.638820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d623a6-858f-4e65-b100-e8a550fe11b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:28.640617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d623a6-858f-4e65-b100-e8a550fe11b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:28.642186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d623a6-858f-4e65-b100-e8a550fe11b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:28.645183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d623a6-858f-4e65-b100-e8a550fe11b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:28.650483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d623a6-858f-4e65-b100-e8a550fe11b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:28.694100 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2845/5713] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:28.697628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc684f-7742-4087-bdb2-58775f19d2a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:28.728322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc684f-7742-4087-bdb2-58775f19d2a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:28.760436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ef1f5-1733-4009-b024-4ba631205d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:28.765872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef1f5-1733-4009-b024-4ba631205d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:28.766910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef1f5-1733-4009-b024-4ba631205d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:28.768955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef1f5-1733-4009-b024-4ba631205d1f admin admin] PATH_INFO: `/v3/projects/f7cfc76f98b54988bc2c659034eb13ba/users/83357200fc2e4bd288faec987278f89b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:28.865552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ef1f5-1733-4009-b024-4ba631205d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cfc76f98b54988bc2c659034eb13ba, user_id=83357200fc2e4bd288faec987278f89b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:28.887113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ef1f5-1733-4009-b024-4ba631205d1f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:28.959327 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2869/5714] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:28 2022] PUT /identity/v3/projects/f7cfc76f98b54988bc2c659034eb13ba/users/83357200fc2e4bd288faec987278f89b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:28.975588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed99cfc-a18e-4488-b2f8-81bc281b546c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:28.976408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed99cfc-a18e-4488-b2f8-81bc281b546c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:28.977159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed99cfc-a18e-4488-b2f8-81bc281b546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:29.157536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2ed99cfc-a18e-4488-b2f8-81bc281b546c None None] MFA Rules not processed for user `83357200fc2e4bd288faec987278f89b`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:29.160585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2ed99cfc-a18e-4488-b2f8-81bc281b546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:29.517907 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2846/5715] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:29.523817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ef1f5-1733-4009-b024-4ba631205d1f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:29.676853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ef1f5-1733-4009-b024-4ba631205d1f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:29.683130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059a871-1d8b-41ac-b6ae-6052bf63828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:29.684372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a871-1d8b-41ac-b6ae-6052bf63828a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:29.684902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a871-1d8b-41ac-b6ae-6052bf63828a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:29.685412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a871-1d8b-41ac-b6ae-6052bf63828a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:29.686368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059a871-1d8b-41ac-b6ae-6052bf63828a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:29.689069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059a871-1d8b-41ac-b6ae-6052bf63828a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:29.792574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2870/5716] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:29 2022] POST /identity/v3/projects => generated 367 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:29.798670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed99cfc-a18e-4488-b2f8-81bc281b546c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:29.829162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed99cfc-a18e-4488-b2f8-81bc281b546c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:30.013740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b2182-3019-4bb1-a9be-3900430757be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:30.015459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b2182-3019-4bb1-a9be-3900430757be admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:30.017496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b2182-3019-4bb1-a9be-3900430757be admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:30.018714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b2182-3019-4bb1-a9be-3900430757be admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:30.021347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b2182-3019-4bb1-a9be-3900430757be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:30.029180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b2182-3019-4bb1-a9be-3900430757be admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:30.110335 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2847/5717] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:29 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:30.114601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059a871-1d8b-41ac-b6ae-6052bf63828a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:30.132480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059a871-1d8b-41ac-b6ae-6052bf63828a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:30.148893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7448026-75c3-4cb6-959c-43df27726bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:30.150987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7448026-75c3-4cb6-959c-43df27726bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:30.152725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7448026-75c3-4cb6-959c-43df27726bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:30.155285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7448026-75c3-4cb6-959c-43df27726bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:30.158532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7448026-75c3-4cb6-959c-43df27726bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:30.162848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7448026-75c3-4cb6-959c-43df27726bf8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:30.201350 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2871/5718] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:30.206866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b2182-3019-4bb1-a9be-3900430757be admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:30.226154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b2182-3019-4bb1-a9be-3900430757be admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:30.241625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a7c0-eebc-4c75-8c94-fca6b82f3658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:30.242546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a7c0-eebc-4c75-8c94-fca6b82f3658 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:30.242840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a7c0-eebc-4c75-8c94-fca6b82f3658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:30.243118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a7c0-eebc-4c75-8c94-fca6b82f3658 admin admin] PATH_INFO: `/v3/projects/b6a20b86a9454fb3908f2171525ab39c/users/7dbe782f071242df9259359d0ccce0b6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:30.293229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3a7c0-eebc-4c75-8c94-fca6b82f3658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a20b86a9454fb3908f2171525ab39c, user_id=7dbe782f071242df9259359d0ccce0b6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:30.297746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3a7c0-eebc-4c75-8c94-fca6b82f3658 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:30.361237 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2848/5719] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:30 2022] PUT /identity/v3/projects/b6a20b86a9454fb3908f2171525ab39c/users/7dbe782f071242df9259359d0ccce0b6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:30.362429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7448026-75c3-4cb6-959c-43df27726bf8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:30.377456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7448026-75c3-4cb6-959c-43df27726bf8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:30.559745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9049d5-70a0-46d1-98aa-0500190dedb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:30.561345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9049d5-70a0-46d1-98aa-0500190dedb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:30.565353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9049d5-70a0-46d1-98aa-0500190dedb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:30.565904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9049d5-70a0-46d1-98aa-0500190dedb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:30.567020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9049d5-70a0-46d1-98aa-0500190dedb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:30.569210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9049d5-70a0-46d1-98aa-0500190dedb8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:30.594702 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2872/5720] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:30.596128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a7c0-eebc-4c75-8c94-fca6b82f3658 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:30.610664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a7c0-eebc-4c75-8c94-fca6b82f3658 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:30.662058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602f099-e62c-495a-945a-50520fef31d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:30.664188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f099-e62c-495a-945a-50520fef31d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:30.666797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f099-e62c-495a-945a-50520fef31d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:30.667850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f099-e62c-495a-945a-50520fef31d1 admin admin] PATH_INFO: `/v3/projects/b6a20b86a9454fb3908f2171525ab39c/users/7dbe782f071242df9259359d0ccce0b6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:30.677938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602f099-e62c-495a-945a-50520fef31d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a20b86a9454fb3908f2171525ab39c, user_id=7dbe782f071242df9259359d0ccce0b6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:30.684756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602f099-e62c-495a-945a-50520fef31d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:30.738365 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2849/5721] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:30 2022] PUT /identity/v3/projects/b6a20b86a9454fb3908f2171525ab39c/users/7dbe782f071242df9259359d0ccce0b6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:30.740305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37215-98b3-42f3-a43c-a9a694a7d75e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:30.740702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37215-98b3-42f3-a43c-a9a694a7d75e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:30.741095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37215-98b3-42f3-a43c-a9a694a7d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:30.812810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0bd37215-98b3-42f3-a43c-a9a694a7d75e None None] MFA Rules not processed for user `7dbe782f071242df9259359d0ccce0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:30.816530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0bd37215-98b3-42f3-a43c-a9a694a7d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:30.988924 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2873/5722] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:30.993562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602f099-e62c-495a-945a-50520fef31d1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:31.014194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602f099-e62c-495a-945a-50520fef31d1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:31.027432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de0578-cd80-4c76-8e73-0691eb4edca9 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:31.028349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de0578-cd80-4c76-8e73-0691eb4edca9 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:31.028801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de0578-cd80-4c76-8e73-0691eb4edca9 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:31.029242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de0578-cd80-4c76-8e73-0691eb4edca9 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:31.030223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de0578-cd80-4c76-8e73-0691eb4edca9 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:31.032267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de0578-cd80-4c76-8e73-0691eb4edca9 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:31.069418 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2850/5723] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:10:30 2022] POST /identity/v3/domains => generated 275 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:31.074326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37215-98b3-42f3-a43c-a9a694a7d75e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:31.095779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37215-98b3-42f3-a43c-a9a694a7d75e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:31.245346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91df41-99b2-4f09-9213-37ea3909c348 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:31.246057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91df41-99b2-4f09-9213-37ea3909c348 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:31.246410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91df41-99b2-4f09-9213-37ea3909c348 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:31.246710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91df41-99b2-4f09-9213-37ea3909c348 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:31.247425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91df41-99b2-4f09-9213-37ea3909c348 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:31.249633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91df41-99b2-4f09-9213-37ea3909c348 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:31.344989 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2874/5724] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:31 2022] POST /identity/v3/users => generated 347 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:31.349902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de0578-cd80-4c76-8e73-0691eb4edca9 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:31.372312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de0578-cd80-4c76-8e73-0691eb4edca9 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:31.401954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76520c63-04b8-4026-ae14-0f724a5e7ce4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:31.404754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76520c63-04b8-4026-ae14-0f724a5e7ce4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:31.408130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76520c63-04b8-4026-ae14-0f724a5e7ce4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:31.408570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76520c63-04b8-4026-ae14-0f724a5e7ce4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:31.412250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76520c63-04b8-4026-ae14-0f724a5e7ce4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:31.414362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76520c63-04b8-4026-ae14-0f724a5e7ce4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:31.517711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2851/5725] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:31 2022] POST /identity/v3/users => generated 323 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:31.520961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91df41-99b2-4f09-9213-37ea3909c348 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:31.536801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91df41-99b2-4f09-9213-37ea3909c348 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:31.556673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dfda4-7d31-4c49-8598-87ab2e16e368 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:31.558133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dfda4-7d31-4c49-8598-87ab2e16e368 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:31.558664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dfda4-7d31-4c49-8598-87ab2e16e368 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:31.559210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dfda4-7d31-4c49-8598-87ab2e16e368 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users/eb8b67591ad84de8ad66de68e70f62c0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:31.602848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dfda4-7d31-4c49-8598-87ab2e16e368 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:get_user(user_id=eb8b67591ad84de8ad66de68e70f62c0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:31.606479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dfda4-7d31-4c49-8598-87ab2e16e368 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:31.610117 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2875/5726] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:10:31 2022] GET /identity/v3/users/eb8b67591ad84de8ad66de68e70f62c0 => generated 347 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:31.621746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76520c63-04b8-4026-ae14-0f724a5e7ce4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:31.656638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76520c63-04b8-4026-ae14-0f724a5e7ce4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:31.664997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:31.666610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:31.667454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:31.668225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:31.670577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Adding query filter params (domain_id=175c62b1ece84a1385ed064d75fdf5ea) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:31.671457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:31.675034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:31.719793 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2852/5727] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Feb 19 21:10:31 2022] GET /identity/v3/users?domain_id=175c62b1ece84a1385ed064d75fdf5ea => generated 484 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:31.725499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dfda4-7d31-4c49-8598-87ab2e16e368 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:31.752117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dfda4-7d31-4c49-8598-87ab2e16e368 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:31.775499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b418-2d63-40ba-9dfd-c51335dac3f3 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:31.777549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b418-2d63-40ba-9dfd-c51335dac3f3 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:31.778061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b418-2d63-40ba-9dfd-c51335dac3f3 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:31.779675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b418-2d63-40ba-9dfd-c51335dac3f3 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:31.780703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6b418-2d63-40ba-9dfd-c51335dac3f3 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:31.786699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6b418-2d63-40ba-9dfd-c51335dac3f3 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:31.958511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:31.970785 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2876/5728] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:31 2022] GET /identity/v3/users => generated 8584 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:31.982962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01465c82-1661-4cb4-838f-21ecdedced5f tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:32.019883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:32.020892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.021346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.021798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.023716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1243544620) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:32.024408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:32.026472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:32.085568 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2853/5729] 10.222.0.30 () {58 vars in 1188 bytes} [Sat Feb 19 21:10:31 2022] GET /identity/v3/users?name=tempest-test_user-1243544620 => generated 475 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:32.096972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b418-2d63-40ba-9dfd-c51335dac3f3 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:32.149219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b418-2d63-40ba-9dfd-c51335dac3f3 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:32.189238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:32.195175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.203434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.204595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.208118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:32.209060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:32.213969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:32.233800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:32.236286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:32.260745 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2877/5730] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 21:10:32 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:32.268312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:32.290886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1c665-4831-4690-894d-7764e782ac5a tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:32.301882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:32.303301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.303778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.304159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users/9bdd4c06bdad4208ab6ee198a08459e0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.329632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9bdd4c06bdad4208ab6ee198a08459e0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:32.332308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:32.377288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2cae-bde5-4609-aad8-fd9c8038b9a5 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:32.389148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:32.390072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.390360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.390644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] PATH_INFO: `/v3/users/d29d77f86ecd490da83816708092ff71` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.393594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29d77f86ecd490da83816708092ff71)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:32.399415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:32.400081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdd4c06bdad4208ab6ee198a08459e0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.418385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdd4c06bdad4208ab6ee198a08459e0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.428461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdd4c06bdad4208ab6ee198a08459e0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.429269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdd4c06bdad4208ab6ee198a08459e0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.430742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdd4c06bdad4208ab6ee198a08459e0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.445778 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2878/5731] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:32 2022] DELETE /identity/v3/users/9bdd4c06bdad4208ab6ee198a08459e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:32.451587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:32.453868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:32.480014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29d77f86ecd490da83816708092ff71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.481134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29d77f86ecd490da83816708092ff71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.482607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29d77f86ecd490da83816708092ff71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.502502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29d77f86ecd490da83816708092ff71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.514325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae1be8c2-6769-4bff-b565-d1deb951f207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29d77f86ecd490da83816708092ff71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.530445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e09c6-3aa4-47ff-b08b-fc5b5a8e42b4 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:32.533716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2854/5732] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:32 2022] DELETE /identity/v3/users/d29d77f86ecd490da83816708092ff71 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:32.536042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:32.537672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.537961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.538339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/users/eb8b67591ad84de8ad66de68e70f62c0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.539621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ced0-c5b5-4604-bdcf-5c29736e60df None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.539828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb8b67591ad84de8ad66de68e70f62c0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:32.540063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ced0-c5b5-4604-bdcf-5c29736e60df None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.540448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ced0-c5b5-4604-bdcf-5c29736e60df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.542174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:32.572355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5543ced0-c5b5-4604-bdcf-5c29736e60df None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:32.573827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5543ced0-c5b5-4604-bdcf-5c29736e60df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:32.606561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8b67591ad84de8ad66de68e70f62c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.620473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8b67591ad84de8ad66de68e70f62c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.631338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8b67591ad84de8ad66de68e70f62c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.632035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8b67591ad84de8ad66de68e70f62c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.632944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8b67591ad84de8ad66de68e70f62c0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.648826 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2879/5733] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:32 2022] DELETE /identity/v3/users/eb8b67591ad84de8ad66de68e70f62c0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:32.652727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:32.657246 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2855/5734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:32.657806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:32.670387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ced0-c5b5-4604-bdcf-5c29736e60df None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:32.672115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5543ced0-c5b5-4604-bdcf-5c29736e60df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:32.747501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8defff-f832-42b0-a1f8-1ce3d45cbc90 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:32.762977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:32.763895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.764182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.764507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/domains/175c62b1ece84a1385ed064d75fdf5ea` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.766563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=175c62b1ece84a1385ed064d75fdf5ea)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:32.768974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:32.773542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ced0-c5b5-4604-bdcf-5c29736e60df None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:32.794247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.795331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.830288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:32.831343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.832058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.832603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.836694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.836941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:32.837890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:32.859820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2880/5735] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:10:32 2022] PATCH /identity/v3/domains/175c62b1ece84a1385ed064d75fdf5ea => generated 276 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:32.861160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:32.862698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:32.932200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:32.933997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:32.947077 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2856/5736] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:32.955999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c8e0b-9f13-4215-bcf3-d0f9f6f9baf6 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:32.964077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbe782f071242df9259359d0ccce0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a20b86a9454fb3908f2171525ab39c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:32.965797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:32.966365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:32.966914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] PATH_INFO: `/v3/domains/175c62b1ece84a1385ed064d75fdf5ea` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:32.987311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=175c62b1ece84a1385ed064d75fdf5ea)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:32.991292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:33.023475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.027811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.081395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea', 'request_id': 'req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.089304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea', 'request_id': 'req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.113986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea', 'request_id': 'req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.141084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] The token cache is being invalidate because project 175c62b1ece84a1385ed064d75fdf5ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:33.141615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.143039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.157718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea', 'request_id': 'req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.164446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea', 'request_id': 'req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.165606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47 tempest-UsersV3TestJSON-1484555225 tempest-UsersV3TestJSON-1484555225-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '175c62b1ece84a1385ed064d75fdf5ea', 'request_id': 'req-6f3241bf-13e4-4058-b9f6-67cab4c6aa47'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.177307 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2881/5737] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:10:32 2022] DELETE /identity/v3/domains/175c62b1ece84a1385ed064d75fdf5ea => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:33.181004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:33.184063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:33.199770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00004dc-1c88-4e7a-bb0f-b8c9fb5e4afa service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:33.306971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:33.307905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:33.308319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:33.308628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] PATH_INFO: `/v3/users/83357200fc2e4bd288faec987278f89b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:33.310235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83357200fc2e4bd288faec987278f89b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:33.313180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:33.404529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83357200fc2e4bd288faec987278f89b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.405779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83357200fc2e4bd288faec987278f89b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.406609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83357200fc2e4bd288faec987278f89b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.423521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83357200fc2e4bd288faec987278f89b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.435765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83357200fc2e4bd288faec987278f89b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.460870 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2857/5738] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:33 2022] DELETE /identity/v3/users/83357200fc2e4bd288faec987278f89b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:33.463073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ebf27-8709-4a75-b1ff-aab5abe91a1d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:33.463477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ebf27-8709-4a75-b1ff-aab5abe91a1d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:33.463861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ebf27-8709-4a75-b1ff-aab5abe91a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:33.483507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e26ebf27-8709-4a75-b1ff-aab5abe91a1d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:33.485274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e26ebf27-8709-4a75-b1ff-aab5abe91a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:33.555928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:33.562045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:33.570303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2882/5739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:33.585698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ebf27-8709-4a75-b1ff-aab5abe91a1d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:33.588025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e26ebf27-8709-4a75-b1ff-aab5abe91a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:33.600345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be7c1c-6a1d-495b-a6b0-fd1aa196a7d9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:33.633179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:33.634410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:33.634867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:33.635144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] PATH_INFO: `/v3/projects/8784470ae96b46a79c5b058ffb1173c3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:33.636497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8784470ae96b46a79c5b058ffb1173c3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:33.638413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:33.707586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ebf27-8709-4a75-b1ff-aab5abe91a1d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:33.710753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8784470ae96b46a79c5b058ffb1173c3', 'request_id': 'req-9590a574-6334-45f2-9cb7-c0022a8cc260'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.716989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8784470ae96b46a79c5b058ffb1173c3', 'request_id': 'req-9590a574-6334-45f2-9cb7-c0022a8cc260'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.726353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8784470ae96b46a79c5b058ffb1173c3', 'request_id': 'req-9590a574-6334-45f2-9cb7-c0022a8cc260'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.745411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] The token cache is being invalidate because project 8784470ae96b46a79c5b058ffb1173c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:33.745711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.746413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9590a574-6334-45f2-9cb7-c0022a8cc260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:33.748089 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2858/5740] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:33 2022] DELETE /identity/v3/projects/8784470ae96b46a79c5b058ffb1173c3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:33.753932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c591ecd-0955-417d-8970-92e145646897 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:33.754534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c591ecd-0955-417d-8970-92e145646897 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:33.755126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c591ecd-0955-417d-8970-92e145646897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:33.782823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:33.783739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:33.785925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5c591ecd-0955-417d-8970-92e145646897 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:33.787219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5c591ecd-0955-417d-8970-92e145646897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:33.792840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:33.792840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:33.795019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:33.857821 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2859/5741] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:33.867102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24101b-60d7-481a-a379-6286b48ea29d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:33.867402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24101b-60d7-481a-a379-6286b48ea29d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:33.867684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24101b-60d7-481a-a379-6286b48ea29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:33.942330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:33.944258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:33.949166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1c24101b-60d7-481a-a379-6286b48ea29d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:33.957871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1c24101b-60d7-481a-a379-6286b48ea29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:33.960075 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2883/5742] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:33.989504 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2860/5743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:33.994615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.027659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28730dbe-d89b-458a-bddf-514fecc63a93 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:34.047849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:34.049472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:34.050063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:34.058513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:34.060147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:34.060895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:34.063346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:34.088388 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2884/5744] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:34.092636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24101b-60d7-481a-a379-6286b48ea29d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.113288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24101b-60d7-481a-a379-6286b48ea29d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:34.127727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f332ae-d072-47bc-8e61-10b797b3dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:34.130240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f332ae-d072-47bc-8e61-10b797b3dcfb admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:34.130642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f332ae-d072-47bc-8e61-10b797b3dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:34.130993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f332ae-d072-47bc-8e61-10b797b3dcfb admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:34.132307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f332ae-d072-47bc-8e61-10b797b3dcfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:34.136296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f332ae-d072-47bc-8e61-10b797b3dcfb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:34.183843 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2861/5745] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:34 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:34.189720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.225139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d472368-2a1d-4cbc-a4f0-969ddfbc8eac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:34.392592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d22c4-f61c-4937-a94b-85efaea4458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:34.392592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d22c4-f61c-4937-a94b-85efaea4458a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:34.392592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d22c4-f61c-4937-a94b-85efaea4458a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:34.393488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d22c4-f61c-4937-a94b-85efaea4458a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:34.393819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d22c4-f61c-4937-a94b-85efaea4458a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:34.395985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d22c4-f61c-4937-a94b-85efaea4458a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:34.431906 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2885/5746] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:34 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:34.438731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f332ae-d072-47bc-8e61-10b797b3dcfb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.457656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f332ae-d072-47bc-8e61-10b797b3dcfb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:34.468393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a18a8-6340-450a-be82-6e6339f412fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:34.469304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a18a8-6340-450a-be82-6e6339f412fa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:34.469594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a18a8-6340-450a-be82-6e6339f412fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:34.469877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a18a8-6340-450a-be82-6e6339f412fa admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:34.470763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a18a8-6340-450a-be82-6e6339f412fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:34.472923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a18a8-6340-450a-be82-6e6339f412fa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:34.489903 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2862/5747] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:34.496230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d22c4-f61c-4937-a94b-85efaea4458a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.516427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d22c4-f61c-4937-a94b-85efaea4458a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:34.523036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:34.524933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:34.525971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:34.526365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:34.527913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:34.530165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:34.548545 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2886/5748] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:34.550442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a18a8-6340-450a-be82-6e6339f412fa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.564858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a18a8-6340-450a-be82-6e6339f412fa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:34.577896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194ceb1-92f2-4765-8467-9ddd4f9e57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:34.580427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ceb1-92f2-4765-8467-9ddd4f9e57d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:34.581610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ceb1-92f2-4765-8467-9ddd4f9e57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:34.585012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ceb1-92f2-4765-8467-9ddd4f9e57d9 admin admin] PATH_INFO: `/v3/projects/463a97fa588d4fc2bb01401ca0fcb8aa/users/52c7a837477849768d5a90636fddf7b4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:34.635824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194ceb1-92f2-4765-8467-9ddd4f9e57d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463a97fa588d4fc2bb01401ca0fcb8aa, user_id=52c7a837477849768d5a90636fddf7b4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:34.638828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194ceb1-92f2-4765-8467-9ddd4f9e57d9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:34.643392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.646541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:34.666145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3751a-f73d-48db-8e17-75ef2845efc3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:34.670936 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2863/5749] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:34 2022] PUT /identity/v3/projects/463a97fa588d4fc2bb01401ca0fcb8aa/users/52c7a837477849768d5a90636fddf7b4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:34.684027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c8e9-fdaf-4039-a76a-8255aef53074 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:34.687862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c8e9-fdaf-4039-a76a-8255aef53074 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:34.688133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c8e9-fdaf-4039-a76a-8255aef53074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:34.740885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9784c8e9-fdaf-4039-a76a-8255aef53074 None None] MFA Rules not processed for user `52c7a837477849768d5a90636fddf7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:34.746057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9784c8e9-fdaf-4039-a76a-8255aef53074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:34.824916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:34.825825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:34.826627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:34.827099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] PATH_INFO: `/v3/projects/f7cfc76f98b54988bc2c659034eb13ba` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:34.842072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cfc76f98b54988bc2c659034eb13ba)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:34.844044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:34.918039 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2864/5750] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:34.929041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cfc76f98b54988bc2c659034eb13ba', 'request_id': 'req-00e97f7e-02cd-435c-aa00-e1b049011d23'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:34.930051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c8e9-fdaf-4039-a76a-8255aef53074 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.931716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9784c8e9-fdaf-4039-a76a-8255aef53074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:34.935981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cfc76f98b54988bc2c659034eb13ba', 'request_id': 'req-00e97f7e-02cd-435c-aa00-e1b049011d23'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:34.951861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cfc76f98b54988bc2c659034eb13ba', 'request_id': 'req-00e97f7e-02cd-435c-aa00-e1b049011d23'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:34.972865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] The token cache is being invalidate because project f7cfc76f98b54988bc2c659034eb13ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:34.973291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:34.974658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:34.977374 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2887/5751] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:34 2022] DELETE /identity/v3/projects/f7cfc76f98b54988bc2c659034eb13ba => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:34.981060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:34.982750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:35.015261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c8e9-fdaf-4039-a76a-8255aef53074 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:35.076317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97f7e-02cd-435c-aa00-e1b049011d23 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:35.082548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:35.083630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:35.084554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:35.084945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] PATH_INFO: `/v3/users/7dbe782f071242df9259359d0ccce0b6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:35.086458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbe782f071242df9259359d0ccce0b6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:35.087579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224c29-38b0-45b2-93c9-63a9e1abfae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:35.088666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224c29-38b0-45b2-93c9-63a9e1abfae3 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:35.088802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:35.089248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224c29-38b0-45b2-93c9-63a9e1abfae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:35.090024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224c29-38b0-45b2-93c9-63a9e1abfae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:35.093389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2e224c29-38b0-45b2-93c9-63a9e1abfae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:35.161815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbe782f071242df9259359d0ccce0b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:35.175101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224c29-38b0-45b2-93c9-63a9e1abfae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:35.177376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224c29-38b0-45b2-93c9-63a9e1abfae3 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:35.183602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbe782f071242df9259359d0ccce0b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:35.188901 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2865/5752] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:35.218123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbe782f071242df9259359d0ccce0b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:35.218863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbe782f071242df9259359d0ccce0b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:35.231906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbe782f071242df9259359d0ccce0b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:35.248200 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2888/5753] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:34 2022] DELETE /identity/v3/users/7dbe782f071242df9259359d0ccce0b6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:35.855606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6db-8462-45e1-bd3f-40ce28a664e4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:35.856679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6db-8462-45e1-bd3f-40ce28a664e4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:35.857307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6db-8462-45e1-bd3f-40ce28a664e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:35.899792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b7dca6db-8462-45e1-bd3f-40ce28a664e4 None None] MFA Rules not processed for user `60dfc693d9b64b7fb5bbaefcf922249a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:35.901308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b7dca6db-8462-45e1-bd3f-40ce28a664e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:36.040648 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2866/5754] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:36.049116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:36.051430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:36.228263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca6db-8462-45e1-bd3f-40ce28a664e4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:36.229857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b7dca6db-8462-45e1-bd3f-40ce28a664e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:36.257059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14eba-0638-4cbf-9803-bae766e4ca26 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:36.267588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca311554-a5a2-4c2e-8229-4de3e294ad0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:36.268275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311554-a5a2-4c2e-8229-4de3e294ad0e service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:36.268617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311554-a5a2-4c2e-8229-4de3e294ad0e service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:36.269917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311554-a5a2-4c2e-8229-4de3e294ad0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:36.284205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca311554-a5a2-4c2e-8229-4de3e294ad0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:36.286313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca311554-a5a2-4c2e-8229-4de3e294ad0e service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:36.307065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2889/5755] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:36.388837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca6db-8462-45e1-bd3f-40ce28a664e4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:36.400678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:36.402372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:36.402852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:36.404224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] PATH_INFO: `/v3/projects/b6a20b86a9454fb3908f2171525ab39c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:36.407906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a20b86a9454fb3908f2171525ab39c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:36.408583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:36.513032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a20b86a9454fb3908f2171525ab39c', 'request_id': 'req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:36.522436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a20b86a9454fb3908f2171525ab39c', 'request_id': 'req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:36.536167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a20b86a9454fb3908f2171525ab39c', 'request_id': 'req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:36.577940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] The token cache is being invalidate because project b6a20b86a9454fb3908f2171525ab39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:36.578234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:36.579282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:36.584275 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2867/5756] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:36 2022] DELETE /identity/v3/projects/b6a20b86a9454fb3908f2171525ab39c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:36.586465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9023ec-5ee0-4064-ba46-d9db53689f3f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:36.587842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9023ec-5ee0-4064-ba46-d9db53689f3f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:36.588369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9023ec-5ee0-4064-ba46-d9db53689f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:36.645954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6b9023ec-5ee0-4064-ba46-d9db53689f3f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:36.647469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6b9023ec-5ee0-4064-ba46-d9db53689f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:36.667930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:36.669506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:36.743772 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2890/5757] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:36.745156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec369f5-ed4f-4a6d-ab2b-d1078dab7aaf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:36.745449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec369f5-ed4f-4a6d-ab2b-d1078dab7aaf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:36.745726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec369f5-ed4f-4a6d-ab2b-d1078dab7aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:36.766086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5ec369f5-ed4f-4a6d-ab2b-d1078dab7aaf None None] MFA Rules not processed for user `52c7a837477849768d5a90636fddf7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:36.767163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5ec369f5-ed4f-4a6d-ab2b-d1078dab7aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:36.787522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf183-38fa-40bf-a3aa-5d5652d346b6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:36.794070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655a7f5-d16f-45eb-9924-00b30ad5310a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:36.795059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a7f5-d16f-45eb-9924-00b30ad5310a service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:36.795548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a7f5-d16f-45eb-9924-00b30ad5310a service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:36.796024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a7f5-d16f-45eb-9924-00b30ad5310a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:36.798473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a655a7f5-d16f-45eb-9924-00b30ad5310a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:36.812178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a7f5-d16f-45eb-9924-00b30ad5310a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:36.813996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a7f5-d16f-45eb-9924-00b30ad5310a service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:36.826825 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2868/5758] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:36.827990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bf0e-28d7-4ff9-b113-c48565e49025 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:36.828266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bf0e-28d7-4ff9-b113-c48565e49025 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:36.828583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bf0e-28d7-4ff9-b113-c48565e49025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:36.843315 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2891/5759] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:36.856543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1432bf0e-28d7-4ff9-b113-c48565e49025 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:36.857836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1432bf0e-28d7-4ff9-b113-c48565e49025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:36.872791 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2869/5760] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:36.877104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec369f5-ed4f-4a6d-ab2b-d1078dab7aaf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:36.891306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec369f5-ed4f-4a6d-ab2b-d1078dab7aaf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:36.896368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:36.897191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:36.897511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:36.897774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:36.898673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:36.898985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:36.900919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:36.916816 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2892/5761] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:36.921562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432bf0e-28d7-4ff9-b113-c48565e49025 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:36.935968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432bf0e-28d7-4ff9-b113-c48565e49025 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:36.941955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ca4c-4094-41bc-81f8-6a75a17cd59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:36.942993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ca4c-4094-41bc-81f8-6a75a17cd59e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:36.943313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ca4c-4094-41bc-81f8-6a75a17cd59e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:36.943790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ca4c-4094-41bc-81f8-6a75a17cd59e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:36.944528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7ca4c-4094-41bc-81f8-6a75a17cd59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:36.947056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7ca4c-4094-41bc-81f8-6a75a17cd59e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:36.984413 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2870/5762] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:36 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:36.985702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:37.002033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef02ad2-8305-43e0-8eca-9305c327c26b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:37.091237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0b2c6-31ce-47c5-839f-20929d25aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:37.092689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b2c6-31ce-47c5-839f-20929d25aeab admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:37.093133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b2c6-31ce-47c5-839f-20929d25aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:37.093609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b2c6-31ce-47c5-839f-20929d25aeab admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:37.094874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0b2c6-31ce-47c5-839f-20929d25aeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:37.099197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0b2c6-31ce-47c5-839f-20929d25aeab admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:37.135322 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2893/5763] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:36 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:37.139505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ca4c-4094-41bc-81f8-6a75a17cd59e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:37.154171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ca4c-4094-41bc-81f8-6a75a17cd59e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:37.168873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac242b-b675-4edf-8fa9-07ba1266ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:37.170044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac242b-b675-4edf-8fa9-07ba1266ee4b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:37.170508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac242b-b675-4edf-8fa9-07ba1266ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:37.171965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac242b-b675-4edf-8fa9-07ba1266ee4b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:37.173043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac242b-b675-4edf-8fa9-07ba1266ee4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:37.174956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac242b-b675-4edf-8fa9-07ba1266ee4b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:37.208069 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2871/5764] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:37.208745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0b2c6-31ce-47c5-839f-20929d25aeab admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:37.232937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0b2c6-31ce-47c5-839f-20929d25aeab admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:37.245916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02d95e-1d63-48a8-8b16-48a1d1cef347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:37.249666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d95e-1d63-48a8-8b16-48a1d1cef347 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:37.249967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d95e-1d63-48a8-8b16-48a1d1cef347 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:37.250254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d95e-1d63-48a8-8b16-48a1d1cef347 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:37.252697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02d95e-1d63-48a8-8b16-48a1d1cef347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:37.256267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02d95e-1d63-48a8-8b16-48a1d1cef347 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:37.282401 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2894/5765] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:37.286732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac242b-b675-4edf-8fa9-07ba1266ee4b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:37.306973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac242b-b675-4edf-8fa9-07ba1266ee4b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:37.315151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1f3d-7390-4898-85ea-f78a9dfb036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:37.316546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1f3d-7390-4898-85ea-f78a9dfb036b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:37.317108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1f3d-7390-4898-85ea-f78a9dfb036b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:37.317512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1f3d-7390-4898-85ea-f78a9dfb036b admin admin] PATH_INFO: `/v3/projects/340e3d52e01f4fa3a398b3c6fb4ab0f5/users/2505c2c9808c44cc8b8c37624752cffc/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:37.341696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa1f3d-7390-4898-85ea-f78a9dfb036b admin admin] RBAC: Authorizing `identity:create_grant(project_id=340e3d52e01f4fa3a398b3c6fb4ab0f5, user_id=2505c2c9808c44cc8b8c37624752cffc, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:37.348215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa1f3d-7390-4898-85ea-f78a9dfb036b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:37.377067 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2872/5766] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:37 2022] PUT /identity/v3/projects/340e3d52e01f4fa3a398b3c6fb4ab0f5/users/2505c2c9808c44cc8b8c37624752cffc/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:37.388781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1da6-2fba-4ad8-9f4d-943d76266c28 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:37.389209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1da6-2fba-4ad8-9f4d-943d76266c28 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:37.389792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1da6-2fba-4ad8-9f4d-943d76266c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:37.425159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-71ba1da6-2fba-4ad8-9f4d-943d76266c28 None None] MFA Rules not processed for user `2505c2c9808c44cc8b8c37624752cffc`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:37.426646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-71ba1da6-2fba-4ad8-9f4d-943d76266c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:37.516307 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2895/5767] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:37.521214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1f3d-7390-4898-85ea-f78a9dfb036b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:37.615989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1f3d-7390-4898-85ea-f78a9dfb036b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:37.622240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa64373-1274-4fac-89ff-56d2fc779620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:37.623130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64373-1274-4fac-89ff-56d2fc779620 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:37.623874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64373-1274-4fac-89ff-56d2fc779620 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:37.624471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64373-1274-4fac-89ff-56d2fc779620 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:37.625340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa64373-1274-4fac-89ff-56d2fc779620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:37.627705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa64373-1274-4fac-89ff-56d2fc779620 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:37.631476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba1da6-2fba-4ad8-9f4d-943d76266c28 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:37.633106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-71ba1da6-2fba-4ad8-9f4d-943d76266c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:37.686701 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2873/5768] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:37 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:37.690896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa64373-1274-4fac-89ff-56d2fc779620 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:37.835816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba1da6-2fba-4ad8-9f4d-943d76266c28 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:37.841489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa64373-1274-4fac-89ff-56d2fc779620 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:37.859857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a8df2-a2b7-4d3d-9d72-e50cc6b836a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:37.861679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8df2-a2b7-4d3d-9d72-e50cc6b836a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:37.862546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8df2-a2b7-4d3d-9d72-e50cc6b836a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:37.863917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8df2-a2b7-4d3d-9d72-e50cc6b836a0 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:37.865653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a8df2-a2b7-4d3d-9d72-e50cc6b836a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:37.870372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a8df2-a2b7-4d3d-9d72-e50cc6b836a0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:37.983846 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2874/5769] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:37 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:37.990081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a8df2-a2b7-4d3d-9d72-e50cc6b836a0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.011993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a8df2-a2b7-4d3d-9d72-e50cc6b836a0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.037695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807e789-a8c9-4ae4-baa8-abbccd7d5f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.039009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e789-a8c9-4ae4-baa8-abbccd7d5f9d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.039670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e789-a8c9-4ae4-baa8-abbccd7d5f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.040175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e789-a8c9-4ae4-baa8-abbccd7d5f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.041893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807e789-a8c9-4ae4-baa8-abbccd7d5f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.045021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807e789-a8c9-4ae4-baa8-abbccd7d5f9d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.051344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.052026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.052304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.052673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.062472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:38.067215 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2875/5770] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:38.068455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807e789-a8c9-4ae4-baa8-abbccd7d5f9d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.086078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807e789-a8c9-4ae4-baa8-abbccd7d5f9d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.094032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.096039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.109151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.109980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.110262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.110694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] PATH_INFO: `/v3/projects/d151d06c1a2b4a43aeff1cfe609dcf57/users/87ad11510ad34ab38a312d7fe9056eec/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.120396 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2896/5771] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:38.149524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d151d06c1a2b4a43aeff1cfe609dcf57, user_id=87ad11510ad34ab38a312d7fe9056eec, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.152547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.201453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.202948 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2876/5772] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:38 2022] PUT /identity/v3/projects/d151d06c1a2b4a43aeff1cfe609dcf57/users/87ad11510ad34ab38a312d7fe9056eec/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:38.209248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.212232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:38.220649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1899ba-8fa5-43b1-8429-a598a631e8b4 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.342177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d730b1-0210-47e1-add5-a4b0bce850ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.343061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d730b1-0210-47e1-add5-a4b0bce850ec admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.343352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d730b1-0210-47e1-add5-a4b0bce850ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.344265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d730b1-0210-47e1-add5-a4b0bce850ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.348936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d730b1-0210-47e1-add5-a4b0bce850ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.351408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d730b1-0210-47e1-add5-a4b0bce850ec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.374208 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2897/5773] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:38.378301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d730b1-0210-47e1-add5-a4b0bce850ec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.380739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475ccbf-95d1-4377-bc78-437649fd0aba admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.388507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38eb69-179d-41ec-97f4-219a79476b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.390903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38eb69-179d-41ec-97f4-219a79476b57 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.391232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38eb69-179d-41ec-97f4-219a79476b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.391517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38eb69-179d-41ec-97f4-219a79476b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.397857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a38eb69-179d-41ec-97f4-219a79476b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:38.412938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d730b1-0210-47e1-add5-a4b0bce850ec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.428495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38eb69-179d-41ec-97f4-219a79476b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.429170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38eb69-179d-41ec-97f4-219a79476b57 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.433605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99320d3d-24c3-4ff7-a917-23bc16e58830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.435759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99320d3d-24c3-4ff7-a917-23bc16e58830 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.436891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99320d3d-24c3-4ff7-a917-23bc16e58830 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.437708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99320d3d-24c3-4ff7-a917-23bc16e58830 admin admin] PATH_INFO: `/v3/projects/d151d06c1a2b4a43aeff1cfe609dcf57/users/87ad11510ad34ab38a312d7fe9056eec/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.445545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99320d3d-24c3-4ff7-a917-23bc16e58830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d151d06c1a2b4a43aeff1cfe609dcf57, user_id=87ad11510ad34ab38a312d7fe9056eec, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.454274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99320d3d-24c3-4ff7-a917-23bc16e58830 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.456369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2877/5774] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:38.471513 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2898/5775] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:38 2022] PUT /identity/v3/projects/d151d06c1a2b4a43aeff1cfe609dcf57/users/87ad11510ad34ab38a312d7fe9056eec/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:38.482478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daa1f4-97cd-45a6-a86a-46bbdf8dc9f2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.483028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daa1f4-97cd-45a6-a86a-46bbdf8dc9f2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.483286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daa1f4-97cd-45a6-a86a-46bbdf8dc9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.535798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f6daa1f4-97cd-45a6-a86a-46bbdf8dc9f2 None None] MFA Rules not processed for user `87ad11510ad34ab38a312d7fe9056eec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:38.537368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f6daa1f4-97cd-45a6-a86a-46bbdf8dc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:38.640591 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2878/5776] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:38.646667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99320d3d-24c3-4ff7-a917-23bc16e58830 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.670654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99320d3d-24c3-4ff7-a917-23bc16e58830 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.678664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.679442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.679979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.680345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.681821 ncdv-master-1 devstack@keystone.service[96910]: WARNING oslo_log.versionutils [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Feb 19 21:10:38.682506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.683870 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:38.683870 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:10:38.683870 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:10:38.685068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.722449 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2899/5777] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:10:38 2022] POST /identity/v3/policies => generated 229 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:38.730931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daa1f4-97cd-45a6-a86a-46bbdf8dc9f2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.742537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daa1f4-97cd-45a6-a86a-46bbdf8dc9f2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.755252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.757351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.759003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.760614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies/5c0a211f84fd438f84d30dd79b930fed` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.761806 ncdv-master-1 devstack@keystone.service[96909]: WARNING oslo_log.versionutils [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Feb 19 21:10:38.762978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=5c0a211f84fd438f84d30dd79b930fed)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.767179 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:38.767179 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:10:38.767179 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:10:38.771141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.813632 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2879/5778] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Feb 19 21:10:38 2022] PATCH /identity/v3/policies/5c0a211f84fd438f84d30dd79b930fed => generated 235 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:38.818289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.833286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62278f-d7df-468e-baba-dbfa9a3d2017 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.839203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.840527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.840917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.841299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies/5c0a211f84fd438f84d30dd79b930fed` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.842504 ncdv-master-1 devstack@keystone.service[96910]: WARNING oslo_log.versionutils [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Feb 19 21:10:38.843890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=5c0a211f84fd438f84d30dd79b930fed)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.845474 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:38.845474 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:10:38.845474 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:10:38.846868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.861732 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2900/5779] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:10:38 2022] GET /identity/v3/policies/5c0a211f84fd438f84d30dd79b930fed => generated 235 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:38.863799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.881238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1525c-7d16-4f56-9139-d4d58dcb623d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.888782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.889844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.890231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.890626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies/5c0a211f84fd438f84d30dd79b930fed` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.891758 ncdv-master-1 devstack@keystone.service[96909]: WARNING oslo_log.versionutils [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Feb 19 21:10:38.892625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=5c0a211f84fd438f84d30dd79b930fed)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.894998 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:38.894998 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:10:38.894998 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:10:38.896022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.922036 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2880/5780] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:38 2022] DELETE /identity/v3/policies/5c0a211f84fd438f84d30dd79b930fed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:38.922898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:38.936080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f35e8-d90b-4bf9-9c73-00a36b13dd7d tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:38.943784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32784d-84e0-4246-bdd5-481ee58e5d05 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:38.944508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32784d-84e0-4246-bdd5-481ee58e5d05 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:38.944795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32784d-84e0-4246-bdd5-481ee58e5d05 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:38.945073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32784d-84e0-4246-bdd5-481ee58e5d05 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:38.946328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32784d-84e0-4246-bdd5-481ee58e5d05 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:38.948254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32784d-84e0-4246-bdd5-481ee58e5d05 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:38.984082 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2901/5781] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:10:38 2022] POST /identity/v3/policies => generated 230 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:38.986075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:39.000046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef68b0-4f2c-44a1-bd3e-b623aee39eac tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:39.006084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:39.006750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.007029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.007537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.009438 ncdv-master-1 devstack@keystone.service[96909]: WARNING oslo_log.versionutils [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Feb 19 21:10:39.010223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:39.011930 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:39.011930 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:10:39.011930 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:10:39.013835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:39.042267 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2881/5782] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:10:38 2022] POST /identity/v3/policies => generated 228 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:39.046762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32784d-84e0-4246-bdd5-481ee58e5d05 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:39.059986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32784d-84e0-4246-bdd5-481ee58e5d05 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:39.066027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777cf23-802c-4189-bc1d-5ecf7868935f tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:39.067417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777cf23-802c-4189-bc1d-5ecf7868935f tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.068067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777cf23-802c-4189-bc1d-5ecf7868935f tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.068485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777cf23-802c-4189-bc1d-5ecf7868935f tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.070498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777cf23-802c-4189-bc1d-5ecf7868935f tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:39.072963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777cf23-802c-4189-bc1d-5ecf7868935f tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:39.106037 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2902/5783] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:10:39 2022] POST /identity/v3/policies => generated 229 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:39.109756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:39.121122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bcdc-0651-4917-8087-db565a0ee7c0 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:39.139455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:39.140980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.141964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.143054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.145487 ncdv-master-1 devstack@keystone.service[96909]: WARNING oslo_log.versionutils [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Feb 19 21:10:39.146337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:39.147727 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:39.147727 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:10:39.147727 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:10:39.149016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:39.163394 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2882/5784] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 21:10:39 2022] GET /identity/v3/policies => generated 763 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:39.168583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777cf23-802c-4189-bc1d-5ecf7868935f tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:39.180486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777cf23-802c-4189-bc1d-5ecf7868935f tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:39.185789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:39.188250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.188801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.189249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies/977f86aa12144d9b83885c064ea31aca` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.190234 ncdv-master-1 devstack@keystone.service[96910]: WARNING oslo_log.versionutils [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Feb 19 21:10:39.191031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=977f86aa12144d9b83885c064ea31aca)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:39.194137 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:39.194137 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:10:39.194137 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:10:39.195438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:39.222884 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2903/5785] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:39 2022] DELETE /identity/v3/policies/977f86aa12144d9b83885c064ea31aca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:39.227083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:39.240407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a990f73-2ce1-4971-8630-261bee786fbc tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:39.250263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237550d7-b736-48a9-a815-3b37e33f8c23 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:39.251851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237550d7-b736-48a9-a815-3b37e33f8c23 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.252039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237550d7-b736-48a9-a815-3b37e33f8c23 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.252226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237550d7-b736-48a9-a815-3b37e33f8c23 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies/ac1f876bc4ac4b5a85b15a651e7d9a1b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.253397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237550d7-b736-48a9-a815-3b37e33f8c23 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ac1f876bc4ac4b5a85b15a651e7d9a1b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:39.256120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237550d7-b736-48a9-a815-3b37e33f8c23 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:39.280374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2883/5786] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:39 2022] DELETE /identity/v3/policies/ac1f876bc4ac4b5a85b15a651e7d9a1b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:39.282965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:39.301330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743c0f-d15c-48d0-aadc-b68d52388f0a tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:39.320029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e976c-3a35-4874-a90d-d2bd35f9ef1e tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ad11510ad34ab38a312d7fe9056eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:39.320956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e976c-3a35-4874-a90d-d2bd35f9ef1e tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.321243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e976c-3a35-4874-a90d-d2bd35f9ef1e tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.321521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e976c-3a35-4874-a90d-d2bd35f9ef1e tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] PATH_INFO: `/v3/policies/a936408335464232a814f0ea169b79b5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.322729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e976c-3a35-4874-a90d-d2bd35f9ef1e tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a936408335464232a814f0ea169b79b5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:39.327209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e976c-3a35-4874-a90d-d2bd35f9ef1e tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:39.389062 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2904/5787] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:39 2022] DELETE /identity/v3/policies/a936408335464232a814f0ea169b79b5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:39.396711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237550d7-b736-48a9-a815-3b37e33f8c23 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:39.485989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237550d7-b736-48a9-a815-3b37e33f8c23 tempest-PoliciesTestJSON-14221860 tempest-PoliciesTestJSON-14221860-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:39.495666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:39.496964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.497533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.498030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] PATH_INFO: `/v3/users/2505c2c9808c44cc8b8c37624752cffc` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.499894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2505c2c9808c44cc8b8c37624752cffc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:39.504478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:39.565770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2505c2c9808c44cc8b8c37624752cffc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:39.566760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2505c2c9808c44cc8b8c37624752cffc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:39.567847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2505c2c9808c44cc8b8c37624752cffc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:39.580715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2505c2c9808c44cc8b8c37624752cffc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:39.589924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2505c2c9808c44cc8b8c37624752cffc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:39.608351 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2884/5788] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:39 2022] DELETE /identity/v3/users/2505c2c9808c44cc8b8c37624752cffc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:39.614942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05559616-c7ef-43f1-81b2-dda88876d20e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.614942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05559616-c7ef-43f1-81b2-dda88876d20e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.614942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05559616-c7ef-43f1-81b2-dda88876d20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.632984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-05559616-c7ef-43f1-81b2-dda88876d20e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:39.634551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-05559616-c7ef-43f1-81b2-dda88876d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:39.708362 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2905/5789] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:39.719307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:39.721063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:39.818361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7cc4-e844-49c3-b5ef-31d9062dfb00 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:39.824955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:39.825821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:39.826290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:39.826746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:39.838648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:39.840561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:39.854147 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2885/5790] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:39.999915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82df3bc-636a-4498-ab40-9c34bf19ae9c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:40.000799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82df3bc-636a-4498-ab40-9c34bf19ae9c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:40.001366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82df3bc-636a-4498-ab40-9c34bf19ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:40.035444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b82df3bc-636a-4498-ab40-9c34bf19ae9c None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:40.038818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b82df3bc-636a-4498-ab40-9c34bf19ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:40.123960 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2906/5791] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:40.140537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:40.142782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:40.300192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88c82-ccbc-4ccb-997a-246028ee3754 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:40.306889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98349f-0b24-45e9-aef9-78e38c4c31f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:40.307881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98349f-0b24-45e9-aef9-78e38c4c31f4 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:40.308573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98349f-0b24-45e9-aef9-78e38c4c31f4 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:40.309061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98349f-0b24-45e9-aef9-78e38c4c31f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:40.322259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98349f-0b24-45e9-aef9-78e38c4c31f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:40.324172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98349f-0b24-45e9-aef9-78e38c4c31f4 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:40.345177 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2886/5792] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:10:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:10:40.915378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82df3bc-636a-4498-ab40-9c34bf19ae9c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:40.917595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b82df3bc-636a-4498-ab40-9c34bf19ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:40.972232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82df3bc-636a-4498-ab40-9c34bf19ae9c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:40.989321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:40.990227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:40.990734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:40.991188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] PATH_INFO: `/v3/projects/340e3d52e01f4fa3a398b3c6fb4ab0f5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:40.995249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=340e3d52e01f4fa3a398b3c6fb4ab0f5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:41.001971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:41.147449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340e3d52e01f4fa3a398b3c6fb4ab0f5', 'request_id': 'req-28e9c885-ab4f-46d0-9571-a167a30334d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.155865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340e3d52e01f4fa3a398b3c6fb4ab0f5', 'request_id': 'req-28e9c885-ab4f-46d0-9571-a167a30334d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.176430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340e3d52e01f4fa3a398b3c6fb4ab0f5', 'request_id': 'req-28e9c885-ab4f-46d0-9571-a167a30334d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.205811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] The token cache is being invalidate because project 340e3d52e01f4fa3a398b3c6fb4ab0f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:41.206112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.222032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.226775 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2907/5793] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:40 2022] DELETE /identity/v3/projects/340e3d52e01f4fa3a398b3c6fb4ab0f5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:41.231091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98349f-0b24-45e9-aef9-78e38c4c31f4 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:41.247727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98349f-0b24-45e9-aef9-78e38c4c31f4 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:41.367484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:41.368630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:41.369051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:41.369434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] PATH_INFO: `/v3/users/87ad11510ad34ab38a312d7fe9056eec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:41.370927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ad11510ad34ab38a312d7fe9056eec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:41.373477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:41.494239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ad11510ad34ab38a312d7fe9056eec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.495334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ad11510ad34ab38a312d7fe9056eec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.496348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ad11510ad34ab38a312d7fe9056eec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.548202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ad11510ad34ab38a312d7fe9056eec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.576146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ad11510ad34ab38a312d7fe9056eec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:41.607635 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2887/5794] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:41 2022] DELETE /identity/v3/users/87ad11510ad34ab38a312d7fe9056eec => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:43.424478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:43.426224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:43.441369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9c885-ab4f-46d0-9571-a167a30334d8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:43.574932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:43.576965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:43.686857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150dbcf-8845-4372-b05f-5cfd51d6892f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:43.693684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:43.694897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:43.695441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:43.695939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] PATH_INFO: `/v3/users/20246495a35b4762be5b2ad98f537377` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:43.698436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20246495a35b4762be5b2ad98f537377)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:43.700828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:43.748004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:43.749919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:43.750520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:43.751120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] PATH_INFO: `/v3/projects/d151d06c1a2b4a43aeff1cfe609dcf57` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:43.754881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d151d06c1a2b4a43aeff1cfe609dcf57)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:43.759057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:43.792850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20246495a35b4762be5b2ad98f537377'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.794270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20246495a35b4762be5b2ad98f537377'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.795463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20246495a35b4762be5b2ad98f537377'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.815320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20246495a35b4762be5b2ad98f537377'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.827154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7a3d6b5-2110-4992-a6e1-f0aad078a51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20246495a35b4762be5b2ad98f537377'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.844215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'request_id': 'req-d1e2bd60-f25e-4788-a5ac-6b118de60813'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.847457 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2888/5795] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:43 2022] DELETE /identity/v3/users/20246495a35b4762be5b2ad98f537377 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:43.850847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'request_id': 'req-d1e2bd60-f25e-4788-a5ac-6b118de60813'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.863540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd151d06c1a2b4a43aeff1cfe609dcf57', 'request_id': 'req-d1e2bd60-f25e-4788-a5ac-6b118de60813'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.877314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] The token cache is being invalidate because project d151d06c1a2b4a43aeff1cfe609dcf57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:43.877900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.879682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d1e2bd60-f25e-4788-a5ac-6b118de60813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:43.882113 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2908/5796] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:43 2022] DELETE /identity/v3/projects/d151d06c1a2b4a43aeff1cfe609dcf57 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:43.887837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b2044-131c-43a0-8d5f-c9044c251879 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:43.890222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b2044-131c-43a0-8d5f-c9044c251879 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:43.891646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b2044-131c-43a0-8d5f-c9044c251879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:43.936699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b35b2044-131c-43a0-8d5f-c9044c251879 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:43.938157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b35b2044-131c-43a0-8d5f-c9044c251879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:44.031455 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2889/5797] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:44.040323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc543967-ca90-4e54-930c-64f18d766b28 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.040798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc543967-ca90-4e54-930c-64f18d766b28 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.041333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc543967-ca90-4e54-930c-64f18d766b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.072190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cc543967-ca90-4e54-930c-64f18d766b28 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:44.074474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc543967-ca90-4e54-930c-64f18d766b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:44.086801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2909/5798] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:44.093312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b2044-131c-43a0-8d5f-c9044c251879 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.121939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b2044-131c-43a0-8d5f-c9044c251879 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.135976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.137790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.138158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.138907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.141208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:44.142000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.145277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.154391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc543967-ca90-4e54-930c-64f18d766b28 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.158682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc543967-ca90-4e54-930c-64f18d766b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:44.174805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2890/5799] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:44.176560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.180425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc543967-ca90-4e54-930c-64f18d766b28 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.195256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.196472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.196610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153d925-4562-4921-9985-f409dcc25cf7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.197101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.197602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] PATH_INFO: `/v3/projects/e5f81dcc5d52473ab53817e20df04cd9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.199167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f81dcc5d52473ab53817e20df04cd9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.201508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.202762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa32daf-d3c2-439d-96ea-1fb2bc294d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.203441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa32daf-d3c2-439d-96ea-1fb2bc294d93 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.203698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa32daf-d3c2-439d-96ea-1fb2bc294d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.203963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa32daf-d3c2-439d-96ea-1fb2bc294d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.205183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa32daf-d3c2-439d-96ea-1fb2bc294d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.207238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa32daf-d3c2-439d-96ea-1fb2bc294d93 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.256977 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2891/5800] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:44.258518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa32daf-d3c2-439d-96ea-1fb2bc294d93 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.274144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f81dcc5d52473ab53817e20df04cd9', 'request_id': 'req-b98c0928-1f43-4e25-be29-c522c44e8146'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:44.280466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f81dcc5d52473ab53817e20df04cd9', 'request_id': 'req-b98c0928-1f43-4e25-be29-c522c44e8146'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:44.289867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f81dcc5d52473ab53817e20df04cd9', 'request_id': 'req-b98c0928-1f43-4e25-be29-c522c44e8146'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:44.330576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] The token cache is being invalidate because project e5f81dcc5d52473ab53817e20df04cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:44.330968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:44.331584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b98c0928-1f43-4e25-be29-c522c44e8146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:44.333963 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2910/5801] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:44 2022] DELETE /identity/v3/projects/e5f81dcc5d52473ab53817e20df04cd9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:44.340476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c88ed-2c46-485b-9d7f-d80cfb0ffcaa None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.340819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c88ed-2c46-485b-9d7f-d80cfb0ffcaa None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.341032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c88ed-2c46-485b-9d7f-d80cfb0ffcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.346402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa32daf-d3c2-439d-96ea-1fb2bc294d93 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.377317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5f5c88ed-2c46-485b-9d7f-d80cfb0ffcaa None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:44.378707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5f5c88ed-2c46-485b-9d7f-d80cfb0ffcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:44.417901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.418636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.419019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.419482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.420904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.423264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.451075 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2892/5802] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:44.452455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.455216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:44.471443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f07030-9954-4e12-ac43-d4c16daf4eb4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.475734 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2911/5803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:44.477666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b33d7-7026-4f91-a16b-958366730c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.478512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b33d7-7026-4f91-a16b-958366730c7b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.479025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b33d7-7026-4f91-a16b-958366730c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.479422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b33d7-7026-4f91-a16b-958366730c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.480289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b33d7-7026-4f91-a16b-958366730c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.482071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b33d7-7026-4f91-a16b-958366730c7b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.496199 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2893/5804] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:44.500792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c88ed-2c46-485b-9d7f-d80cfb0ffcaa None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.515460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c88ed-2c46-485b-9d7f-d80cfb0ffcaa None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.534391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a030-3524-4ec1-8ff2-78dc4d82a9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.535193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a030-3524-4ec1-8ff2-78dc4d82a9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.535479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a030-3524-4ec1-8ff2-78dc4d82a9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.535761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a030-3524-4ec1-8ff2-78dc4d82a9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.536705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5a030-3524-4ec1-8ff2-78dc4d82a9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.541375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5a030-3524-4ec1-8ff2-78dc4d82a9d0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.562155 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2912/5805] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:44.568127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1ced6-e861-44fe-ab77-08db995f1eb7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.568457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1ced6-e861-44fe-ab77-08db995f1eb7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.568750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1ced6-e861-44fe-ab77-08db995f1eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.571941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a030-3524-4ec1-8ff2-78dc4d82a9d0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.582905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a030-3524-4ec1-8ff2-78dc4d82a9d0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.589518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad6fc7-19c8-453e-918b-8b9515a0364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.590554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6fc7-19c8-453e-918b-8b9515a0364c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.590866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dfe1ced6-e861-44fe-ab77-08db995f1eb7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:44.591453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6fc7-19c8-453e-918b-8b9515a0364c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.591453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6fc7-19c8-453e-918b-8b9515a0364c admin admin] PATH_INFO: `/v3/projects/0de2da654165406b809f0259787fbad9/users/b7ba6b9c0aea42c893e9c79864b2887e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.592117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dfe1ced6-e861-44fe-ab77-08db995f1eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:44.601340 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2894/5806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:44.605676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1ced6-e861-44fe-ab77-08db995f1eb7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.609076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6fc7-19c8-453e-918b-8b9515a0364c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de2da654165406b809f0259787fbad9, user_id=b7ba6b9c0aea42c893e9c79864b2887e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.611883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6fc7-19c8-453e-918b-8b9515a0364c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.615082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1ced6-e861-44fe-ab77-08db995f1eb7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.623278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.623975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.624314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.624868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.625598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:44.625903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.627954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.642853 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2913/5807] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:44 2022] PUT /identity/v3/projects/0de2da654165406b809f0259787fbad9/users/b7ba6b9c0aea42c893e9c79864b2887e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:44.645289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1634f-13af-4eb6-b388-000187e44024 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.645716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1634f-13af-4eb6-b388-000187e44024 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.646088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1634f-13af-4eb6-b388-000187e44024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.649852 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2895/5808] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:44.651114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.666566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e79c-749d-428a-82bd-8c0a15458e68 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.683425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-11b1634f-13af-4eb6-b388-000187e44024 None None] MFA Rules not processed for user `b7ba6b9c0aea42c893e9c79864b2887e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:44.685271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-11b1634f-13af-4eb6-b388-000187e44024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:44.767478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9139bd-d3d9-44b9-88e4-ffa349d37184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.768157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9139bd-d3d9-44b9-88e4-ffa349d37184 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.768484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9139bd-d3d9-44b9-88e4-ffa349d37184 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.768994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9139bd-d3d9-44b9-88e4-ffa349d37184 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.770453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9139bd-d3d9-44b9-88e4-ffa349d37184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.772421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9139bd-d3d9-44b9-88e4-ffa349d37184 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.791879 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2914/5809] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:44.796555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1634f-13af-4eb6-b388-000187e44024 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.807078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2896/5810] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:44.811003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9139bd-d3d9-44b9-88e4-ffa349d37184 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:44.813455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1634f-13af-4eb6-b388-000187e44024 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.901700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9139bd-d3d9-44b9-88e4-ffa349d37184 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:44.915207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733ebb1-ac1c-451a-97e4-ee158092ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.916430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733ebb1-ac1c-451a-97e4-ee158092ab0c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.917027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733ebb1-ac1c-451a-97e4-ee158092ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.917789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733ebb1-ac1c-451a-97e4-ee158092ab0c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.919120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733ebb1-ac1c-451a-97e4-ee158092ab0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.923199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733ebb1-ac1c-451a-97e4-ee158092ab0c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:44.959301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e84fc-8595-44df-a6ca-9da7cc941e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:44.959834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e84fc-8595-44df-a6ca-9da7cc941e55 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:44.960141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e84fc-8595-44df-a6ca-9da7cc941e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:44.960474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e84fc-8595-44df-a6ca-9da7cc941e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:44.961454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e84fc-8595-44df-a6ca-9da7cc941e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:44.963574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e84fc-8595-44df-a6ca-9da7cc941e55 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.005948 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2897/5811] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:45.008748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733ebb1-ac1c-451a-97e4-ee158092ab0c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.040154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733ebb1-ac1c-451a-97e4-ee158092ab0c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.045836 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2915/5812] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:44 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:45.047623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e84fc-8595-44df-a6ca-9da7cc941e55 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.201981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e84fc-8595-44df-a6ca-9da7cc941e55 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.208375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e13e38-8aa6-471e-8d97-321ebfe3bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.209073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e13e38-8aa6-471e-8d97-321ebfe3bb07 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.209360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e13e38-8aa6-471e-8d97-321ebfe3bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.209692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e13e38-8aa6-471e-8d97-321ebfe3bb07 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.210390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e13e38-8aa6-471e-8d97-321ebfe3bb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:45.212283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e13e38-8aa6-471e-8d97-321ebfe3bb07 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.253121 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2916/5813] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:45 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:45.259835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e13e38-8aa6-471e-8d97-321ebfe3bb07 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.271552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e13e38-8aa6-471e-8d97-321ebfe3bb07 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.273891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964ad86-7da3-4ed9-8392-c30ab2472bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.275421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ad86-7da3-4ed9-8392-c30ab2472bdd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.275950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ad86-7da3-4ed9-8392-c30ab2472bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.276632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ad86-7da3-4ed9-8392-c30ab2472bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.277571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dda27-046d-4c08-aec2-d415ef46069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.278357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dda27-046d-4c08-aec2-d415ef46069c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.278745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964ad86-7da3-4ed9-8392-c30ab2472bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:45.278873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dda27-046d-4c08-aec2-d415ef46069c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.279202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dda27-046d-4c08-aec2-d415ef46069c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.280122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dda27-046d-4c08-aec2-d415ef46069c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:45.281993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dda27-046d-4c08-aec2-d415ef46069c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.283596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964ad86-7da3-4ed9-8392-c30ab2472bdd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.306796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2898/5814] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:45.308022 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2917/5815] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:45.313584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dda27-046d-4c08-aec2-d415ef46069c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.314198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964ad86-7da3-4ed9-8392-c30ab2472bdd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.329373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dda27-046d-4c08-aec2-d415ef46069c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.335384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964ad86-7da3-4ed9-8392-c30ab2472bdd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.344548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29da012-ecfb-4be1-b1ba-f1f139fb8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.345272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f16a7-d13b-4d82-8b0d-62ca83198e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.346912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f16a7-d13b-4d82-8b0d-62ca83198e6c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.347833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f16a7-d13b-4d82-8b0d-62ca83198e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.348570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f16a7-d13b-4d82-8b0d-62ca83198e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.349624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f16a7-d13b-4d82-8b0d-62ca83198e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:45.351738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f16a7-d13b-4d82-8b0d-62ca83198e6c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.352417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da012-ecfb-4be1-b1ba-f1f139fb8379 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.352807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da012-ecfb-4be1-b1ba-f1f139fb8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.353792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da012-ecfb-4be1-b1ba-f1f139fb8379 admin admin] PATH_INFO: `/v3/projects/bb42e633383e44748194bbb8920faba1/users/6847ae6d802749198ff01904e7824647/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.372021 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2918/5816] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:45.378484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f16a7-d13b-4d82-8b0d-62ca83198e6c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.403976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f16a7-d13b-4d82-8b0d-62ca83198e6c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.407390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29da012-ecfb-4be1-b1ba-f1f139fb8379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb42e633383e44748194bbb8920faba1, user_id=6847ae6d802749198ff01904e7824647, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:45.413510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b917ca1-898e-4fe4-bd6b-6398ea8bfb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.415211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917ca1-898e-4fe4-bd6b-6398ea8bfb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.415497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29da012-ecfb-4be1-b1ba-f1f139fb8379 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.415726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917ca1-898e-4fe4-bd6b-6398ea8bfb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.416594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917ca1-898e-4fe4-bd6b-6398ea8bfb1b admin admin] PATH_INFO: `/v3/projects/85755c1b89f44eb0a4db800f8bf319f0/users/664f926973a242fcad5a2f1a02f773d7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.448557 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2899/5817] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:45 2022] PUT /identity/v3/projects/bb42e633383e44748194bbb8920faba1/users/6847ae6d802749198ff01904e7824647/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:45.449645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29da012-ecfb-4be1-b1ba-f1f139fb8379 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.456884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b917ca1-898e-4fe4-bd6b-6398ea8bfb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85755c1b89f44eb0a4db800f8bf319f0, user_id=664f926973a242fcad5a2f1a02f773d7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:45.465830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b917ca1-898e-4fe4-bd6b-6398ea8bfb1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.508564 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2919/5818] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:45 2022] PUT /identity/v3/projects/85755c1b89f44eb0a4db800f8bf319f0/users/664f926973a242fcad5a2f1a02f773d7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:45.510389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d130a-b0d2-4a5b-8602-d2d379a63711 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.510696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d130a-b0d2-4a5b-8602-d2d379a63711 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.510977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d130a-b0d2-4a5b-8602-d2d379a63711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.552719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5c3d130a-b0d2-4a5b-8602-d2d379a63711 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:45.553941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5c3d130a-b0d2-4a5b-8602-d2d379a63711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:45.584571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29da012-ecfb-4be1-b1ba-f1f139fb8379 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.687004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40defff-e306-4998-bf90-91e478486542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.688425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40defff-e306-4998-bf90-91e478486542 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.688716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40defff-e306-4998-bf90-91e478486542 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.688996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40defff-e306-4998-bf90-91e478486542 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.689893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40defff-e306-4998-bf90-91e478486542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:45.692590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40defff-e306-4998-bf90-91e478486542 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.705907 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2900/5819] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:45.711044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40defff-e306-4998-bf90-91e478486542 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.727104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40defff-e306-4998-bf90-91e478486542 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.735547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c487154-bc49-4640-8f5c-c37ebba311d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.736513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487154-bc49-4640-8f5c-c37ebba311d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.736794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487154-bc49-4640-8f5c-c37ebba311d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.737067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487154-bc49-4640-8f5c-c37ebba311d0 admin admin] PATH_INFO: `/v3/projects/bb42e633383e44748194bbb8920faba1/users/6847ae6d802749198ff01904e7824647/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.742875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c487154-bc49-4640-8f5c-c37ebba311d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb42e633383e44748194bbb8920faba1, user_id=6847ae6d802749198ff01904e7824647, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:45.746016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c487154-bc49-4640-8f5c-c37ebba311d0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:45.751108 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2920/5820] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:45.772568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d130a-b0d2-4a5b-8602-d2d379a63711 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:45.775785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5c3d130a-b0d2-4a5b-8602-d2d379a63711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:45.780465 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2901/5821] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:45 2022] PUT /identity/v3/projects/bb42e633383e44748194bbb8920faba1/users/6847ae6d802749198ff01904e7824647/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:45.792428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13094d6-1dd8-49da-a5c2-1607edc50a2b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.793011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13094d6-1dd8-49da-a5c2-1607edc50a2b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.793379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13094d6-1dd8-49da-a5c2-1607edc50a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:45.845724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d130a-b0d2-4a5b-8602-d2d379a63711 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:45.857860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d13094d6-1dd8-49da-a5c2-1607edc50a2b None None] MFA Rules not processed for user `6847ae6d802749198ff01904e7824647`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:45.859403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d13094d6-1dd8-49da-a5c2-1607edc50a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:45.904118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca89c3-47e5-4ccc-a9e2-ac4190f11a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:45.904908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca89c3-47e5-4ccc-a9e2-ac4190f11a1f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:45.905261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca89c3-47e5-4ccc-a9e2-ac4190f11a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:45.905758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca89c3-47e5-4ccc-a9e2-ac4190f11a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.034584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca89c3-47e5-4ccc-a9e2-ac4190f11a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.039257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca89c3-47e5-4ccc-a9e2-ac4190f11a1f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.051828 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2902/5822] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:46.059218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13094d6-1dd8-49da-a5c2-1607edc50a2b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.064656 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2921/5823] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:46.071368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13094d6-1dd8-49da-a5c2-1607edc50a2b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.077650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fdd66-c514-48c0-a2a9-a6728a822dfa tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.078283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fdd66-c514-48c0-a2a9-a6728a822dfa tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.078549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fdd66-c514-48c0-a2a9-a6728a822dfa tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.078994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fdd66-c514-48c0-a2a9-a6728a822dfa tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.079887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fdd66-c514-48c0-a2a9-a6728a822dfa tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.082470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fdd66-c514-48c0-a2a9-a6728a822dfa tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.126753 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2903/5824] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:46 2022] POST /identity/v3/projects => generated 359 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:46.127966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca89c3-47e5-4ccc-a9e2-ac4190f11a1f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.146916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca89c3-47e5-4ccc-a9e2-ac4190f11a1f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.246018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.247065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.247356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.247657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags/tempest-tag-586548918` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.248954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=29d82c2c7c0947368d1f2e3772f48ca1, value=tempest-tag-586548918)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.251688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.315448 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-586548918. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:10:46.315448 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:10:46.315448 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:10:46.327821 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2922/5825] 10.222.0.30 () {60 vars in 1329 bytes} [Sat Feb 19 21:10:46 2022] PUT /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags/tempest-tag-586548918 => generated 0 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Feb 19 21:10:46.330975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fdd66-c514-48c0-a2a9-a6728a822dfa tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.343908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fdd66-c514-48c0-a2a9-a6728a822dfa tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.350041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2151d9-081b-4daa-ab10-05c5f5ea5d63 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.352635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2151d9-081b-4daa-ab10-05c5f5ea5d63 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.352635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2151d9-081b-4daa-ab10-05c5f5ea5d63 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.352635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2151d9-081b-4daa-ab10-05c5f5ea5d63 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags/tempest-tag-586548918` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.398079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2151d9-081b-4daa-ab10-05c5f5ea5d63 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=29d82c2c7c0947368d1f2e3772f48ca1, value=tempest-tag-586548918)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.401059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2151d9-081b-4daa-ab10-05c5f5ea5d63 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.417128 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2904/5826] 10.222.0.30 () {58 vars in 1310 bytes} [Sat Feb 19 21:10:46 2022] GET /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags/tempest-tag-586548918 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:46.421821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.436844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c9f3-d805-4f52-a340-6de300f15f33 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.444949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea651d-d86d-4e43-86a3-d1a68c94b19a tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.446020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea651d-d86d-4e43-86a3-d1a68c94b19a tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.446541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea651d-d86d-4e43-86a3-d1a68c94b19a tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.446895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea651d-d86d-4e43-86a3-d1a68c94b19a tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.448507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea651d-d86d-4e43-86a3-d1a68c94b19a tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=29d82c2c7c0947368d1f2e3772f48ca1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.450730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea651d-d86d-4e43-86a3-d1a68c94b19a tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.510274 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2923/5827] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Feb 19 21:10:46 2022] PUT /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags => generated 141 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:46.511511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2151d9-081b-4daa-ab10-05c5f5ea5d63 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.522654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2151d9-081b-4daa-ab10-05c5f5ea5d63 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.528292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05539882-602f-4151-ad72-3d3d5dd2955f tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.529204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05539882-602f-4151-ad72-3d3d5dd2955f tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.529428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05539882-602f-4151-ad72-3d3d5dd2955f tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.529708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05539882-602f-4151-ad72-3d3d5dd2955f tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.547427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05539882-602f-4151-ad72-3d3d5dd2955f tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=29d82c2c7c0947368d1f2e3772f48ca1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.549935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05539882-602f-4151-ad72-3d3d5dd2955f tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.566831 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2905/5828] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:10:46 2022] GET /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags => generated 141 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:46.570874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea651d-d86d-4e43-86a3-d1a68c94b19a tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.582689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea651d-d86d-4e43-86a3-d1a68c94b19a tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.593301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.595592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.596192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.597210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags/tempest-tag-1163053319` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.599341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=29d82c2c7c0947368d1f2e3772f48ca1, value=tempest-tag-1163053319)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.601530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.659244 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1163053319. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:10:46.659244 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:10:46.659244 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:10:46.665314 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2924/5829] 10.222.0.30 () {58 vars in 1316 bytes} [Sat Feb 19 21:10:46 2022] DELETE /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags/tempest-tag-1163053319 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:46.669654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05539882-602f-4151-ad72-3d3d5dd2955f tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.680858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05539882-602f-4151-ad72-3d3d5dd2955f tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.686998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.687963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.688564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.688761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags/tempest-tag-1163053319` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.712078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=29d82c2c7c0947368d1f2e3772f48ca1, value=tempest-tag-1163053319)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.714197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.762801 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Could not find project tag: tempest-tag-1163053319.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1163053319. Feb 19 21:10:46.768881 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2906/5830] 10.222.0.30 () {58 vars in 1313 bytes} [Sat Feb 19 21:10:46 2022] GET /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags/tempest-tag-1163053319 => generated 107 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:10:46.772250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.794440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dacd-568a-439a-bd30-a7019b9b4d8e tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.801088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae7b76-6a8a-45b8-8d74-f8c7c88f683c tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.802188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7b76-6a8a-45b8-8d74-f8c7c88f683c tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.802550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7b76-6a8a-45b8-8d74-f8c7c88f683c tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.802850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7b76-6a8a-45b8-8d74-f8c7c88f683c tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.804599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae7b76-6a8a-45b8-8d74-f8c7c88f683c tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=29d82c2c7c0947368d1f2e3772f48ca1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.806840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae7b76-6a8a-45b8-8d74-f8c7c88f683c tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.864043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2925/5831] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:10:46 2022] DELETE /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:46.865452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.876130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00bf3-e07f-4636-af71-514c6ef64adf tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.882164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.883377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.883674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.883947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.896069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=29d82c2c7c0947368d1f2e3772f48ca1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.898287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.912373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2907/5832] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:10:46 2022] GET /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1/tags => generated 66 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:10:46.915298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae7b76-6a8a-45b8-8d74-f8c7c88f683c tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:46.928643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae7b76-6a8a-45b8-8d74-f8c7c88f683c tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:46.935698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6847ae6d802749198ff01904e7824647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb42e633383e44748194bbb8920faba1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:46.936887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:46.937255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:46.937427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] PATH_INFO: `/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:46.940552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorizing `identity:delete_project(project_id=29d82c2c7c0947368d1f2e3772f48ca1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:46.941870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:46.994614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d82c2c7c0947368d1f2e3772f48ca1', 'request_id': 'req-f3d47096-91a3-499d-abe3-68dbee98b626'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.001162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d82c2c7c0947368d1f2e3772f48ca1', 'request_id': 'req-f3d47096-91a3-499d-abe3-68dbee98b626'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.012451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d82c2c7c0947368d1f2e3772f48ca1', 'request_id': 'req-f3d47096-91a3-499d-abe3-68dbee98b626'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.027322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] The token cache is being invalidate because project 29d82c2c7c0947368d1f2e3772f48ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:47.027621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.028186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f3d47096-91a3-499d-abe3-68dbee98b626 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.030054 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2926/5833] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:46 2022] DELETE /identity/v3/projects/29d82c2c7c0947368d1f2e3772f48ca1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:47.035313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:47.037479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:47.148138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faf5f8-b34c-4781-a433-16248b2bf3d2 tempest-IdentityV3ProjectTagsTest-136377270 tempest-IdentityV3ProjectTagsTest-136377270-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:47.195255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf1a7-1512-41e5-b92e-3237764e2147 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:47.195470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf1a7-1512-41e5-b92e-3237764e2147 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:47.195732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf1a7-1512-41e5-b92e-3237764e2147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:47.226087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fceaf1a7-1512-41e5-b92e-3237764e2147 None None] MFA Rules not processed for user `664f926973a242fcad5a2f1a02f773d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:47.227750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fceaf1a7-1512-41e5-b92e-3237764e2147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:47.262173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:47.263104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:47.263383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:47.263659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] PATH_INFO: `/v3/users/b7ba6b9c0aea42c893e9c79864b2887e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:47.265362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ba6b9c0aea42c893e9c79864b2887e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:47.276974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:47.314131 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2927/5834] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:47.324755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed1e6-14cf-4771-a089-0d4634613983 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:47.325138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed1e6-14cf-4771-a089-0d4634613983 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:47.325555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed1e6-14cf-4771-a089-0d4634613983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:47.351376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fe2ed1e6-14cf-4771-a089-0d4634613983 None None] MFA Rules not processed for user `664f926973a242fcad5a2f1a02f773d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:47.352931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fe2ed1e6-14cf-4771-a089-0d4634613983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:47.363338 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2928/5835] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:47.371842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ba6b9c0aea42c893e9c79864b2887e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.373927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d75e9-16e8-4cf3-b71d-d679fd8b1bb3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:47.374218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d75e9-16e8-4cf3-b71d-d679fd8b1bb3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:47.374497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d75e9-16e8-4cf3-b71d-d679fd8b1bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:47.374616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ba6b9c0aea42c893e9c79864b2887e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.375798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ba6b9c0aea42c893e9c79864b2887e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.400578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d54d75e9-16e8-4cf3-b71d-d679fd8b1bb3 None None] MFA Rules not processed for user `664f926973a242fcad5a2f1a02f773d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:47.401136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d54d75e9-16e8-4cf3-b71d-d679fd8b1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:47.401279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ba6b9c0aea42c893e9c79864b2887e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.413577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-937761fb-6346-4a8c-9a5f-3b89c1d8b8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ba6b9c0aea42c893e9c79864b2887e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:47.419158 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2929/5836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:47.426568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d75e9-16e8-4cf3-b71d-d679fd8b1bb3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:47.429123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d54d75e9-16e8-4cf3-b71d-d679fd8b1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:47.440407 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2908/5837] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:47 2022] DELETE /identity/v3/users/b7ba6b9c0aea42c893e9c79864b2887e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:47.448053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30980eb1-1142-4573-abff-5f0074bebb0d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:47.448571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30980eb1-1142-4573-abff-5f0074bebb0d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:47.449067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30980eb1-1142-4573-abff-5f0074bebb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:47.474677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-30980eb1-1142-4573-abff-5f0074bebb0d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:47.475948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-30980eb1-1142-4573-abff-5f0074bebb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:47.535345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d75e9-16e8-4cf3-b71d-d679fd8b1bb3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:47.562093 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2909/5838] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:47.572408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30980eb1-1142-4573-abff-5f0074bebb0d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:47.573969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-30980eb1-1142-4573-abff-5f0074bebb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:47.628382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:47.629763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:47.630048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:47.630327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:47.632317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:47.662576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30980eb1-1142-4573-abff-5f0074bebb0d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:47.666847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:47.667473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:47.667867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:47.668007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:47.681452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:47.683527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:47.720523 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2910/5839] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:47.724413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:47.728053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:47.748765 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2930/5840] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:48.293936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:48.297373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:48.334325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f034a41-3e63-487a-8bc0-e8c1e3b15990 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:48.349008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:48.351111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:48.351111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:48.351880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] PATH_INFO: `/v3/projects/0de2da654165406b809f0259787fbad9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:48.358075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de2da654165406b809f0259787fbad9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:48.370550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:48.490353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de2da654165406b809f0259787fbad9', 'request_id': 'req-32d70cee-b12e-4f80-94c2-40baedc9bf25'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.500586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de2da654165406b809f0259787fbad9', 'request_id': 'req-32d70cee-b12e-4f80-94c2-40baedc9bf25'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.521465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de2da654165406b809f0259787fbad9', 'request_id': 'req-32d70cee-b12e-4f80-94c2-40baedc9bf25'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.540437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] The token cache is being invalidate because project 0de2da654165406b809f0259787fbad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:48.540998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.541988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-32d70cee-b12e-4f80-94c2-40baedc9bf25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.544278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2911/5841] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:48 2022] DELETE /identity/v3/projects/0de2da654165406b809f0259787fbad9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:48.548233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:48.561974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d7512-8f2b-4b6f-bb0a-72d4a7d17224 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:48.728399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:48.728672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:48.728925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:48.729100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] PATH_INFO: `/v3/users/6847ae6d802749198ff01904e7824647` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:48.730412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6847ae6d802749198ff01904e7824647)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:48.734767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:48.817549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270908-eee7-468b-8b03-354ef6f74cca None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:48.818362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6847ae6d802749198ff01904e7824647'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.818511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270908-eee7-468b-8b03-354ef6f74cca None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:48.818511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270908-eee7-468b-8b03-354ef6f74cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:48.845724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6847ae6d802749198ff01904e7824647'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.858206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6847ae6d802749198ff01904e7824647'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.859594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6847ae6d802749198ff01904e7824647'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.860304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6847ae6d802749198ff01904e7824647'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:48.881410 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2931/5842] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:48 2022] DELETE /identity/v3/users/6847ae6d802749198ff01904e7824647 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:48.898782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-25270908-eee7-468b-8b03-354ef6f74cca None None] MFA Rules not processed for user `664f926973a242fcad5a2f1a02f773d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:48.900309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25270908-eee7-468b-8b03-354ef6f74cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:49.026681 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2912/5843] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:49.587532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:49.589907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:49.688617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374ff78-b4b6-40a1-8d94-f59515d59b8a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:49.697574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:49.698461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:49.698739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:49.699015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] PATH_INFO: `/v3/projects/bb42e633383e44748194bbb8920faba1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:49.700683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb42e633383e44748194bbb8920faba1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:49.704955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:49.805538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb42e633383e44748194bbb8920faba1', 'request_id': 'req-12fd465f-fa88-42d1-96c6-16b79732924b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:49.813085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb42e633383e44748194bbb8920faba1', 'request_id': 'req-12fd465f-fa88-42d1-96c6-16b79732924b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:49.828428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb42e633383e44748194bbb8920faba1', 'request_id': 'req-12fd465f-fa88-42d1-96c6-16b79732924b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:49.864445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] The token cache is being invalidate because project bb42e633383e44748194bbb8920faba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:49.864756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:49.868074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-12fd465f-fa88-42d1-96c6-16b79732924b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:49.871577 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2932/5844] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:49 2022] DELETE /identity/v3/projects/bb42e633383e44748194bbb8920faba1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:49.878273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae559-18e6-44b4-bd39-dd469aa84f04 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:49.880083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae559-18e6-44b4-bd39-dd469aa84f04 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:49.881312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae559-18e6-44b4-bd39-dd469aa84f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:49.965597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-745ae559-18e6-44b4-bd39-dd469aa84f04 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:49.974764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-745ae559-18e6-44b4-bd39-dd469aa84f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:50.217565 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2913/5845] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:50.223233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5b21-4e6b-4698-aa2c-c72646a43251 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:50.229093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5b21-4e6b-4698-aa2c-c72646a43251 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:50.230030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5b21-4e6b-4698-aa2c-c72646a43251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:50.280670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e97a5b21-4e6b-4698-aa2c-c72646a43251 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:50.282371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e97a5b21-4e6b-4698-aa2c-c72646a43251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:50.322060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae559-18e6-44b4-bd39-dd469aa84f04 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:50.332318 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2933/5846] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:50.336277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae559-18e6-44b4-bd39-dd469aa84f04 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:50.357581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd68da-6cc7-4e10-a26a-0f2c7a5ccb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:50.358203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd68da-6cc7-4e10-a26a-0f2c7a5ccb2b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:50.358489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd68da-6cc7-4e10-a26a-0f2c7a5ccb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:50.358777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd68da-6cc7-4e10-a26a-0f2c7a5ccb2b admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:50.363347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd68da-6cc7-4e10-a26a-0f2c7a5ccb2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:50.363347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd68da-6cc7-4e10-a26a-0f2c7a5ccb2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:50.369284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd68da-6cc7-4e10-a26a-0f2c7a5ccb2b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:50.398646 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2914/5847] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:50.401223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5b21-4e6b-4698-aa2c-c72646a43251 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:50.430101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5b21-4e6b-4698-aa2c-c72646a43251 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:50.444176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80209fa-a601-4eb4-a135-a40ffebf4361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:50.447311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80209fa-a601-4eb4-a135-a40ffebf4361 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:50.447604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80209fa-a601-4eb4-a135-a40ffebf4361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:50.447927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80209fa-a601-4eb4-a135-a40ffebf4361 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:50.450554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80209fa-a601-4eb4-a135-a40ffebf4361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:50.458105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80209fa-a601-4eb4-a135-a40ffebf4361 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:50.465165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097e58b-5511-405e-8685-295775688343 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:50.465342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097e58b-5511-405e-8685-295775688343 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:50.465622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097e58b-5511-405e-8685-295775688343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:50.546229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c097e58b-5511-405e-8685-295775688343 None None] MFA Rules not processed for user `664f926973a242fcad5a2f1a02f773d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:50.557795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c097e58b-5511-405e-8685-295775688343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:50.570043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2934/5848] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:50 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:50.574965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80209fa-a601-4eb4-a135-a40ffebf4361 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:50.862853 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2915/5849] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:50.882893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80209fa-a601-4eb4-a135-a40ffebf4361 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:50.906569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a8cd-00f9-4bb4-83c3-b2105ff8b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:50.907263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a8cd-00f9-4bb4-83c3-b2105ff8b9fe admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:50.907542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a8cd-00f9-4bb4-83c3-b2105ff8b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:50.907817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a8cd-00f9-4bb4-83c3-b2105ff8b9fe admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:50.908533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2a8cd-00f9-4bb4-83c3-b2105ff8b9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:50.923008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2a8cd-00f9-4bb4-83c3-b2105ff8b9fe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:50.977526 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2935/5850] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:50 2022] POST /identity/v3/users => generated 284 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:50.981525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097e58b-5511-405e-8685-295775688343 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:51.007165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097e58b-5511-405e-8685-295775688343 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:51.029590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf58a6-be53-438b-8921-aac5992ccabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:51.030293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf58a6-be53-438b-8921-aac5992ccabf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:51.033687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf58a6-be53-438b-8921-aac5992ccabf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:51.033908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf58a6-be53-438b-8921-aac5992ccabf admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:51.034732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf58a6-be53-438b-8921-aac5992ccabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:51.041594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf58a6-be53-438b-8921-aac5992ccabf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:51.075518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a8cd-00f9-4bb4-83c3-b2105ff8b9fe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:51.088377 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2916/5851] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:51.093913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a8cd-00f9-4bb4-83c3-b2105ff8b9fe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:51.111009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8b59-52c5-4864-bfdd-cc83930ad11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:51.114609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8b59-52c5-4864-bfdd-cc83930ad11d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:51.115601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8b59-52c5-4864-bfdd-cc83930ad11d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:51.116802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8b59-52c5-4864-bfdd-cc83930ad11d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:51.120265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8b59-52c5-4864-bfdd-cc83930ad11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:51.124172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8b59-52c5-4864-bfdd-cc83930ad11d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:51.147120 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2936/5852] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:51.148527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf58a6-be53-438b-8921-aac5992ccabf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:51.160734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf58a6-be53-438b-8921-aac5992ccabf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:51.165934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0298c6d-d326-40b8-abdc-4c8649d91372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:51.166936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0298c6d-d326-40b8-abdc-4c8649d91372 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:51.167444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0298c6d-d326-40b8-abdc-4c8649d91372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:51.167795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0298c6d-d326-40b8-abdc-4c8649d91372 admin admin] PATH_INFO: `/v3/projects/3252f11bcef044c987706465bc0c51b6/users/7d09e1c8f82647c984c758e177c1f67c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:51.197203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0298c6d-d326-40b8-abdc-4c8649d91372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3252f11bcef044c987706465bc0c51b6, user_id=7d09e1c8f82647c984c758e177c1f67c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:51.203602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0298c6d-d326-40b8-abdc-4c8649d91372 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:51.262380 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2917/5853] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:51 2022] PUT /identity/v3/projects/3252f11bcef044c987706465bc0c51b6/users/7d09e1c8f82647c984c758e177c1f67c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:51.289502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d0f8-e835-4920-8aac-9f6fc937fb8f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:51.289795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d0f8-e835-4920-8aac-9f6fc937fb8f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:51.290068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d0f8-e835-4920-8aac-9f6fc937fb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:51.373404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-18e0d0f8-e835-4920-8aac-9f6fc937fb8f None None] MFA Rules not processed for user `7d09e1c8f82647c984c758e177c1f67c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:51.374668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-18e0d0f8-e835-4920-8aac-9f6fc937fb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:51.552107 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2937/5854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:51.552685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0298c6d-d326-40b8-abdc-4c8649d91372 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:51.727466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0298c6d-d326-40b8-abdc-4c8649d91372 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:51.736242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71f4f1-164b-4a9c-816e-2a2bf311b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:51.737413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f4f1-164b-4a9c-816e-2a2bf311b5db admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:51.738595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f4f1-164b-4a9c-816e-2a2bf311b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:51.739043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f4f1-164b-4a9c-816e-2a2bf311b5db admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:51.739973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71f4f1-164b-4a9c-816e-2a2bf311b5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:51.745981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71f4f1-164b-4a9c-816e-2a2bf311b5db admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:51.794112 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2918/5855] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:51 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:51.798053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0d0f8-e835-4920-8aac-9f6fc937fb8f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:51.843290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0d0f8-e835-4920-8aac-9f6fc937fb8f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:51.980778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5156-0589-4fb9-93d1-30b42d22ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:51.982366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5156-0589-4fb9-93d1-30b42d22ca2d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:51.983618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5156-0589-4fb9-93d1-30b42d22ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:51.984088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5156-0589-4fb9-93d1-30b42d22ca2d admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:51.985141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5156-0589-4fb9-93d1-30b42d22ca2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:51.987659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5156-0589-4fb9-93d1-30b42d22ca2d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:52.038724 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2938/5856] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:51 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:52.043980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71f4f1-164b-4a9c-816e-2a2bf311b5db admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:52.062552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71f4f1-164b-4a9c-816e-2a2bf311b5db admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:52.070550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875aa39-3c89-4e1e-9fe1-ea8b2a2c2159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:52.071622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875aa39-3c89-4e1e-9fe1-ea8b2a2c2159 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:52.072090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875aa39-3c89-4e1e-9fe1-ea8b2a2c2159 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:52.072591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875aa39-3c89-4e1e-9fe1-ea8b2a2c2159 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:52.074402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875aa39-3c89-4e1e-9fe1-ea8b2a2c2159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:52.077353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875aa39-3c89-4e1e-9fe1-ea8b2a2c2159 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:52.091799 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2919/5857] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:52.097663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5156-0589-4fb9-93d1-30b42d22ca2d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:52.112409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5156-0589-4fb9-93d1-30b42d22ca2d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:52.132461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f5f39-f987-4c91-ac0b-b2bb73592394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:52.133582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f5f39-f987-4c91-ac0b-b2bb73592394 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:52.134839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f5f39-f987-4c91-ac0b-b2bb73592394 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:52.135136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f5f39-f987-4c91-ac0b-b2bb73592394 admin admin] PATH_INFO: `/v3/projects/6acd6a45d0c7432abaa331897fa62306/users/fe20bee437534e6eb1a122d277c16744/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:52.176098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f5f39-f987-4c91-ac0b-b2bb73592394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acd6a45d0c7432abaa331897fa62306, user_id=fe20bee437534e6eb1a122d277c16744, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:52.179204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f5f39-f987-4c91-ac0b-b2bb73592394 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:52.223416 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2939/5858] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:52 2022] PUT /identity/v3/projects/6acd6a45d0c7432abaa331897fa62306/users/fe20bee437534e6eb1a122d277c16744/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:52.227256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875aa39-3c89-4e1e-9fe1-ea8b2a2c2159 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:52.239306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875aa39-3c89-4e1e-9fe1-ea8b2a2c2159 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:52.380121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cf780-3695-4647-9273-adcac37233e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:52.381462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cf780-3695-4647-9273-adcac37233e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:52.381997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cf780-3695-4647-9273-adcac37233e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:52.382499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cf780-3695-4647-9273-adcac37233e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:52.383475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cf780-3695-4647-9273-adcac37233e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:52.388666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cf780-3695-4647-9273-adcac37233e8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:52.411308 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2920/5859] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:52.415272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f5f39-f987-4c91-ac0b-b2bb73592394 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:52.435423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f5f39-f987-4c91-ac0b-b2bb73592394 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:52.444287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520027f-770f-404e-8b56-dd0d178ec79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:52.445656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520027f-770f-404e-8b56-dd0d178ec79a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:52.446338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520027f-770f-404e-8b56-dd0d178ec79a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:52.446867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520027f-770f-404e-8b56-dd0d178ec79a admin admin] PATH_INFO: `/v3/projects/6acd6a45d0c7432abaa331897fa62306/users/fe20bee437534e6eb1a122d277c16744/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:52.450505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520027f-770f-404e-8b56-dd0d178ec79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acd6a45d0c7432abaa331897fa62306, user_id=fe20bee437534e6eb1a122d277c16744, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:52.453869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520027f-770f-404e-8b56-dd0d178ec79a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:52.468309 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2940/5860] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:52 2022] PUT /identity/v3/projects/6acd6a45d0c7432abaa331897fa62306/users/fe20bee437534e6eb1a122d277c16744/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:52.490618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07f8f-43ef-402a-acad-72b20a416518 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:52.491821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07f8f-43ef-402a-acad-72b20a416518 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:52.492591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07f8f-43ef-402a-acad-72b20a416518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:52.544151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-34c07f8f-43ef-402a-acad-72b20a416518 None None] MFA Rules not processed for user `fe20bee437534e6eb1a122d277c16744`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:52.545923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-34c07f8f-43ef-402a-acad-72b20a416518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:52.736386 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2921/5861] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:52.741482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520027f-770f-404e-8b56-dd0d178ec79a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:52.758947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520027f-770f-404e-8b56-dd0d178ec79a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:52.764353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:52.765682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:52.765682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:52.766070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:52.766837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:52.767865 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:52.767865 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:10:52.767865 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:10:52.768787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:52.803096 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2941/5862] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:10:52 2022] POST /identity/v3/regions => generated 224 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:52.804575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07f8f-43ef-402a-acad-72b20a416518 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:52.834456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07f8f-43ef-402a-acad-72b20a416518 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:52.861083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:52.861773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:52.862067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:52.862399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:52.863822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:52.865092 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:52.865092 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:10:52.865092 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:10:52.881340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:52.935772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:52.937257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2922/5863] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:10:52 2022] POST /identity/v3/regions => generated 224 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:52.953625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dd197-a927-4b14-9018-66ca2d73f3a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:52.996227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9450a-57b9-4651-9d62-fc12b950a993 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.002057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9450a-57b9-4651-9d62-fc12b950a993 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.002707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9450a-57b9-4651-9d62-fc12b950a993 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.003222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9450a-57b9-4651-9d62-fc12b950a993 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/58e3df95-6c90-4009-8f27-363effdfa667` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.007709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9450a-57b9-4651-9d62-fc12b950a993 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:create_region(region_id=58e3df95-6c90-4009-8f27-363effdfa667)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.009946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9450a-57b9-4651-9d62-fc12b950a993 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.048128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.048804 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2942/5864] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Feb 19 21:10:52 2022] PUT /identity/v3/regions/58e3df95-6c90-4009-8f27-363effdfa667 => generated 232 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:53.064040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16089-e64d-41c6-bbbc-e186c9723380 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.097835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf3991-fccd-47e5-b140-5d448d29e1a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.098731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3991-fccd-47e5-b140-5d448d29e1a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.099013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3991-fccd-47e5-b140-5d448d29e1a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.100428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3991-fccd-47e5-b140-5d448d29e1a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/58e3df95-6c90-4009-8f27-363effdfa667` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.101127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf3991-fccd-47e5-b140-5d448d29e1a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=58e3df95-6c90-4009-8f27-363effdfa667)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.102767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf3991-fccd-47e5-b140-5d448d29e1a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.145216 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2923/5865] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:10:53 2022] DELETE /identity/v3/regions/58e3df95-6c90-4009-8f27-363effdfa667 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:53.147556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9450a-57b9-4651-9d62-fc12b950a993 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.163670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9450a-57b9-4651-9d62-fc12b950a993 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.204222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c329b1-c11e-490c-a95e-4d0d55634a4b tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.205312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c329b1-c11e-490c-a95e-4d0d55634a4b tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.205810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c329b1-c11e-490c-a95e-4d0d55634a4b tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.206297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c329b1-c11e-490c-a95e-4d0d55634a4b tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.207756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c329b1-c11e-490c-a95e-4d0d55634a4b tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.210534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c329b1-c11e-490c-a95e-4d0d55634a4b tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.247922 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2943/5866] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Feb 19 21:10:53 2022] POST /identity/v3/regions => generated 253 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:53.252094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf3991-fccd-47e5-b140-5d448d29e1a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.268565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf3991-fccd-47e5-b140-5d448d29e1a1 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.292953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.294135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.294484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.294842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/604fb9d7d96f432589ceb5e250e06e83` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.295662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:update_region(region_id=604fb9d7d96f432589ceb5e250e06e83)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.297470 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:53.297470 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:10:53.297470 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:10:53.307313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.357366 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2924/5867] 10.222.0.30 () {60 vars in 1249 bytes} [Sat Feb 19 21:10:53 2022] PATCH /identity/v3/regions/604fb9d7d96f432589ceb5e250e06e83 => generated 254 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:53.361810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c329b1-c11e-490c-a95e-4d0d55634a4b tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.377444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.382533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:53.388223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c329b1-c11e-490c-a95e-4d0d55634a4b tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.437568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692ce7a-a262-4014-906d-e08989a54995 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.438572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692ce7a-a262-4014-906d-e08989a54995 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.438724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692ce7a-a262-4014-906d-e08989a54995 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.439037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692ce7a-a262-4014-906d-e08989a54995 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/604fb9d7d96f432589ceb5e250e06e83` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.439983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692ce7a-a262-4014-906d-e08989a54995 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:get_region(region_id=604fb9d7d96f432589ceb5e250e06e83)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.441385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692ce7a-a262-4014-906d-e08989a54995 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.454008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2944/5868] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:10:53 2022] GET /identity/v3/regions/604fb9d7d96f432589ceb5e250e06e83 => generated 254 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:53.457763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692ce7a-a262-4014-906d-e08989a54995 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.484223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692ce7a-a262-4014-906d-e08989a54995 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.499784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284664b-47c5-48a0-839e-16260496ac1c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.500442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284664b-47c5-48a0-839e-16260496ac1c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.500973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284664b-47c5-48a0-839e-16260496ac1c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.501322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284664b-47c5-48a0-839e-16260496ac1c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/604fb9d7d96f432589ceb5e250e06e83` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.501993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284664b-47c5-48a0-839e-16260496ac1c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=604fb9d7d96f432589ceb5e250e06e83)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.503645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284664b-47c5-48a0-839e-16260496ac1c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.552382 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2945/5869] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:10:53 2022] DELETE /identity/v3/regions/604fb9d7d96f432589ceb5e250e06e83 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:53.557544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284664b-47c5-48a0-839e-16260496ac1c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.598201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a257c-5ee4-42d3-ab19-1f8b19627445 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.617617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284664b-47c5-48a0-839e-16260496ac1c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.627469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046e48-e5c2-4268-ab6d-9403e7ea9f43 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.628230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046e48-e5c2-4268-ab6d-9403e7ea9f43 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.628806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046e48-e5c2-4268-ab6d-9403e7ea9f43 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.629102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046e48-e5c2-4268-ab6d-9403e7ea9f43 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.629887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae046e48-e5c2-4268-ab6d-9403e7ea9f43 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.635171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae046e48-e5c2-4268-ab6d-9403e7ea9f43 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.641185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.642466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.642913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.643518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] PATH_INFO: `/v3/users/d15e85943f5d418a94fab0d22598cb78` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.646229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15e85943f5d418a94fab0d22598cb78)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.651884 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2946/5870] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 21:10:53 2022] GET /identity/v3/regions => generated 670 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:53.652902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.656286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046e48-e5c2-4268-ab6d-9403e7ea9f43 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.684130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046e48-e5c2-4268-ab6d-9403e7ea9f43 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.713664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.714559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.714845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.715128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/604fb9d7d96f432589ceb5e250e06e83` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.715805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=604fb9d7d96f432589ceb5e250e06e83)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.725896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.751453 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Could not find region: 604fb9d7d96f432589ceb5e250e06e83.: keystone.exception.RegionNotFound: Could not find region: 604fb9d7d96f432589ceb5e250e06e83. Feb 19 21:10:53.758384 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2947/5871] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:10:53 2022] DELETE /identity/v3/regions/604fb9d7d96f432589ceb5e250e06e83 => generated 112 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:10:53.763375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.781704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0fcbe-a239-4966-90ae-61f8feb0dd2c tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.788952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15e85943f5d418a94fab0d22598cb78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:53.790175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15e85943f5d418a94fab0d22598cb78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:53.791389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15e85943f5d418a94fab0d22598cb78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:53.793119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.794114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.794373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.794761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.795561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.796873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.807711 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2948/5872] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 21:10:53 2022] GET /identity/v3/regions => generated 670 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:53.813403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.818329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:53.823032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15e85943f5d418a94fab0d22598cb78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:53.851296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15e85943f5d418a94fab0d22598cb78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:53.851957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec747c-1a2a-43a0-bee8-9756ffcdc56a tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:53.867696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474b6c-7aae-40d2-952f-7e1bc42e1b19 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:53.868739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474b6c-7aae-40d2-952f-7e1bc42e1b19 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:53.869261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474b6c-7aae-40d2-952f-7e1bc42e1b19 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:53.869940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474b6c-7aae-40d2-952f-7e1bc42e1b19 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:53.872759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474b6c-7aae-40d2-952f-7e1bc42e1b19 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:53.876215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474b6c-7aae-40d2-952f-7e1bc42e1b19 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:53.910543 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2925/5873] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:53 2022] DELETE /identity/v3/users/d15e85943f5d418a94fab0d22598cb78 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:53.924035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:53.927472 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2949/5874] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Feb 19 21:10:53 2022] POST /identity/v3/regions => generated 254 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:54.069543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7cd7e-ac39-406c-9191-e0e8cd112fa7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:54.092857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:54.094307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:54.094606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:54.094886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:54.096431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Adding query filter params (parent_region_id=48a02439b1a34e55ba95f7ecfed83955) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:54.097932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:54.099314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:54.119712 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2926/5875] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:10:53 2022] GET /identity/v3/regions?parent_region_id=48a02439b1a34e55ba95f7ecfed83955 => generated 400 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:54.119965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474b6c-7aae-40d2-952f-7e1bc42e1b19 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:54.138266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474b6c-7aae-40d2-952f-7e1bc42e1b19 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:54.165541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eb1b6-994b-41eb-ad0b-836efa246544 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:54.169303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eb1b6-994b-41eb-ad0b-836efa246544 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:54.170620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eb1b6-994b-41eb-ad0b-836efa246544 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:54.171620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eb1b6-994b-41eb-ad0b-836efa246544 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/882765c538c14a6389c5a629b0847f6b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:54.172524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16eb1b6-994b-41eb-ad0b-836efa246544 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=882765c538c14a6389c5a629b0847f6b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:54.179129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16eb1b6-994b-41eb-ad0b-836efa246544 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:54.222117 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2950/5876] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:10:54 2022] DELETE /identity/v3/regions/882765c538c14a6389c5a629b0847f6b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:54.227385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:54.241123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef55f-3a1a-411c-9701-04edf5e9a0b7 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:54.286555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:54.287441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:54.287730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:54.288010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/6dd3989a693e4ebba71e791cd18b4dbe` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:54.288828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=6dd3989a693e4ebba71e791cd18b4dbe)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:54.290468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:54.329750 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2927/5877] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:10:54 2022] DELETE /identity/v3/regions/6dd3989a693e4ebba71e791cd18b4dbe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:54.335072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eb1b6-994b-41eb-ad0b-836efa246544 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:54.353182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eb1b6-994b-41eb-ad0b-836efa246544 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:54.393695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe20bee437534e6eb1a122d277c16744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6acd6a45d0c7432abaa331897fa62306', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:54.396254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:54.396565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:54.396834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] PATH_INFO: `/v3/regions/48a02439b1a34e55ba95f7ecfed83955` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:54.405360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=48a02439b1a34e55ba95f7ecfed83955)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:54.407336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:54.482406 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2951/5878] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:10:54 2022] DELETE /identity/v3/regions/48a02439b1a34e55ba95f7ecfed83955 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:54.484121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:54.485786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:54.550848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:54.554588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:54.687167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebf1db-f14d-4b36-ab5b-3961f26f3eec tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:54.742911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a609-8880-4882-92fa-26f0580aa676 tempest-RegionsTestJSON-1826391548 tempest-RegionsTestJSON-1826391548-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:54.746931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:54.748427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:54.749382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:54.750321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] PATH_INFO: `/v3/users/7d09e1c8f82647c984c758e177c1f67c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:54.752582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d09e1c8f82647c984c758e177c1f67c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:54.756304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:54.757246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:54.758341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:54.758798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:54.759262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] PATH_INFO: `/v3/projects/7dc28ea863f6483dbdecf4c18a814fe4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:54.762519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc28ea863f6483dbdecf4c18a814fe4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:54.765896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:54.855366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc28ea863f6483dbdecf4c18a814fe4', 'request_id': 'req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.866191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc28ea863f6483dbdecf4c18a814fe4', 'request_id': 'req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.878240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc28ea863f6483dbdecf4c18a814fe4', 'request_id': 'req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.893760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] The token cache is being invalidate because project 7dc28ea863f6483dbdecf4c18a814fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:54.894475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.974428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.974428 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2952/5879] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:54 2022] DELETE /identity/v3/projects/7dc28ea863f6483dbdecf4c18a814fe4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:54.974821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d09e1c8f82647c984c758e177c1f67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.974821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d09e1c8f82647c984c758e177c1f67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.974821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d09e1c8f82647c984c758e177c1f67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.975150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:54.975150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:54.975366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d09e1c8f82647c984c758e177c1f67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.981358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-531ecced-8b6c-4852-ba2e-b2172c479b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d09e1c8f82647c984c758e177c1f67c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:54.999430 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2928/5880] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:54 2022] DELETE /identity/v3/users/7d09e1c8f82647c984c758e177c1f67c => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:55.005641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec7bc-a188-4ee8-a853-9a2904c93153 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:55.006469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec7bc-a188-4ee8-a853-9a2904c93153 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:55.007015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec7bc-a188-4ee8-a853-9a2904c93153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:55.011998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344ca41-bb33-4ad3-9bc7-5dc8c1df8153 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:55.047099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-de4ec7bc-a188-4ee8-a853-9a2904c93153 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:55.048868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-de4ec7bc-a188-4ee8-a853-9a2904c93153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:55.086465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:55.089224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:55.090589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:55.091007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] PATH_INFO: `/v3/users/60dfc693d9b64b7fb5bbaefcf922249a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:55.094291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60dfc693d9b64b7fb5bbaefcf922249a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:55.098615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:55.150117 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2929/5881] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:55.173724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ec7bc-a188-4ee8-a853-9a2904c93153 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:55.176682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-de4ec7bc-a188-4ee8-a853-9a2904c93153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:55.202556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60dfc693d9b64b7fb5bbaefcf922249a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:55.227256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60dfc693d9b64b7fb5bbaefcf922249a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:55.250294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60dfc693d9b64b7fb5bbaefcf922249a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:55.250939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60dfc693d9b64b7fb5bbaefcf922249a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:55.251573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60dfc693d9b64b7fb5bbaefcf922249a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:55.287555 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2953/5882] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:54 2022] DELETE /identity/v3/users/60dfc693d9b64b7fb5bbaefcf922249a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:55.306719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ec7bc-a188-4ee8-a853-9a2904c93153 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:55.382882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:55.383694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:55.384100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:55.385384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:55.387670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:55.440223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:55.441774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:55.539164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:55.540926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:55.554741 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2930/5883] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:10:55.610558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7679651-832d-4fff-b59e-f7c67886b692 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:55.617636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befea07d-f59b-4cf4-8036-38bcf0aeb90a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:55.618479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea07d-f59b-4cf4-8036-38bcf0aeb90a service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:55.618870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea07d-f59b-4cf4-8036-38bcf0aeb90a service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:55.619526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea07d-f59b-4cf4-8036-38bcf0aeb90a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:55.622153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-befea07d-f59b-4cf4-8036-38bcf0aeb90a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:55.639292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befea07d-f59b-4cf4-8036-38bcf0aeb90a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:55.641240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befea07d-f59b-4cf4-8036-38bcf0aeb90a service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:55.658571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2954/5884] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:56.094593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:56.096191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:56.114327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf0d85-5090-4ef5-84a0-36e549d0903d service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:56.133449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:56.135263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:56.135754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:56.136216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] PATH_INFO: `/v3/projects/a156d0f2c1cb49f6ad7ba684fc36203a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:56.137886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a156d0f2c1cb49f6ad7ba684fc36203a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:56.141803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:56.226631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a156d0f2c1cb49f6ad7ba684fc36203a', 'request_id': 'req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.233172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a156d0f2c1cb49f6ad7ba684fc36203a', 'request_id': 'req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.243481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a156d0f2c1cb49f6ad7ba684fc36203a', 'request_id': 'req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.258378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] The token cache is being invalidate because project a156d0f2c1cb49f6ad7ba684fc36203a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:56.259083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.259875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.262057 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2931/5885] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:56 2022] DELETE /identity/v3/projects/a156d0f2c1cb49f6ad7ba684fc36203a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:56.268652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2be06-8a74-4560-a024-37ebe8ea7ff0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:56.269623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2be06-8a74-4560-a024-37ebe8ea7ff0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:56.270358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2be06-8a74-4560-a024-37ebe8ea7ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:56.298289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a9d2be06-8a74-4560-a024-37ebe8ea7ff0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:56.309553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a9d2be06-8a74-4560-a024-37ebe8ea7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:56.340459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:56.344220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:56.475131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f786e-23a2-4847-ac1d-1ad6151cbb27 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:56.482369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:56.483286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:56.483675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:56.484958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] PATH_INFO: `/v3/projects/3252f11bcef044c987706465bc0c51b6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:56.486388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3252f11bcef044c987706465bc0c51b6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:56.490815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:56.513899 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2955/5886] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:56.515478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7f79-fbe9-4b7a-85b9-08617b4f9c74 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:56.515763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7f79-fbe9-4b7a-85b9-08617b4f9c74 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:56.516046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7f79-fbe9-4b7a-85b9-08617b4f9c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:56.543747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b46b7f79-fbe9-4b7a-85b9-08617b4f9c74 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:56.545766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b46b7f79-fbe9-4b7a-85b9-08617b4f9c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:56.559025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3252f11bcef044c987706465bc0c51b6', 'request_id': 'req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.570386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3252f11bcef044c987706465bc0c51b6', 'request_id': 'req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.586069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3252f11bcef044c987706465bc0c51b6', 'request_id': 'req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.606315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] The token cache is being invalidate because project 3252f11bcef044c987706465bc0c51b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:56.608751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.613523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.618428 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2932/5887] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:56 2022] DELETE /identity/v3/projects/3252f11bcef044c987706465bc0c51b6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:56.630988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:56.637199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:56.669546 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2956/5888] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:56.676863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7f79-fbe9-4b7a-85b9-08617b4f9c74 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:56.690653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7f79-fbe9-4b7a-85b9-08617b4f9c74 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:56.705564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:56.706650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:56.707410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:56.707918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:56.708982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:56.709573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:56.712543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:56.739000 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2957/5889] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:56.742598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:56.761850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5434e3-1fe8-4dad-ba3d-4a04db710ea5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:56.764776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d601843-dccc-414a-8e9e-3837756bcfb1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:56.774998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c848c02-004e-4b5a-a7be-369286fb6571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:56.775978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c848c02-004e-4b5a-a7be-369286fb6571 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:56.776435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:56.776552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c848c02-004e-4b5a-a7be-369286fb6571 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:56.777194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c848c02-004e-4b5a-a7be-369286fb6571 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:56.779829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c848c02-004e-4b5a-a7be-369286fb6571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:56.780682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:56.781090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:56.781388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] PATH_INFO: `/v3/users/fe20bee437534e6eb1a122d277c16744` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:56.782947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe20bee437534e6eb1a122d277c16744)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:56.786102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:56.789618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c848c02-004e-4b5a-a7be-369286fb6571 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:56.855227 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2958/5890] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:56 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:56.873110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c848c02-004e-4b5a-a7be-369286fb6571 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:56.908701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe20bee437534e6eb1a122d277c16744'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.910246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe20bee437534e6eb1a122d277c16744'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.911049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe20bee437534e6eb1a122d277c16744'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.931078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe20bee437534e6eb1a122d277c16744'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.945210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe20bee437534e6eb1a122d277c16744'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:56.970312 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2933/5891] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:56 2022] DELETE /identity/v3/users/fe20bee437534e6eb1a122d277c16744 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:56.999971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c848c02-004e-4b5a-a7be-369286fb6571 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:57.073612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af876af0-98b6-481f-af3d-c71f3ce36bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:57.075617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876af0-98b6-481f-af3d-c71f3ce36bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:57.076123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876af0-98b6-481f-af3d-c71f3ce36bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:57.076777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876af0-98b6-481f-af3d-c71f3ce36bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:57.078347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af876af0-98b6-481f-af3d-c71f3ce36bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:57.080567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af876af0-98b6-481f-af3d-c71f3ce36bb7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:57.116577 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2959/5892] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:56 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:57.125168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:57.126922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:57.143359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b395-a456-403a-b4a4-cc21a1cd06ea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:57.150827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781e3b-0d8d-49ad-a26b-e0bfca3d62be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:57.151941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781e3b-0d8d-49ad-a26b-e0bfca3d62be admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:57.153485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781e3b-0d8d-49ad-a26b-e0bfca3d62be admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:57.154000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781e3b-0d8d-49ad-a26b-e0bfca3d62be admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:57.155007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781e3b-0d8d-49ad-a26b-e0bfca3d62be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:57.157207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781e3b-0d8d-49ad-a26b-e0bfca3d62be admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:57.170810 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2934/5893] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:57.174427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af876af0-98b6-481f-af3d-c71f3ce36bb7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:57.189249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af876af0-98b6-481f-af3d-c71f3ce36bb7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:57.207323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c9fdb-6cc8-41fc-8ffa-22b00e6e1b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:57.208020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9fdb-6cc8-41fc-8ffa-22b00e6e1b6b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:57.208292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9fdb-6cc8-41fc-8ffa-22b00e6e1b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:57.208633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9fdb-6cc8-41fc-8ffa-22b00e6e1b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:57.209523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9fdb-6cc8-41fc-8ffa-22b00e6e1b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:57.211621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9fdb-6cc8-41fc-8ffa-22b00e6e1b6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:57.234671 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2960/5894] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:57.235762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781e3b-0d8d-49ad-a26b-e0bfca3d62be admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:57.247285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781e3b-0d8d-49ad-a26b-e0bfca3d62be admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:57.257887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fe9dc-af0f-44dd-8e1d-23040b099ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:57.259631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fe9dc-af0f-44dd-8e1d-23040b099ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:57.260915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fe9dc-af0f-44dd-8e1d-23040b099ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:57.262537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fe9dc-af0f-44dd-8e1d-23040b099ffc admin admin] PATH_INFO: `/v3/projects/9f4ed687e80941d9a5befe1031923ed5/users/b9e2bf42ef6446c69f1775a25ef76a92/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:57.304688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fe9dc-af0f-44dd-8e1d-23040b099ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4ed687e80941d9a5befe1031923ed5, user_id=b9e2bf42ef6446c69f1775a25ef76a92, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:57.307954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fe9dc-af0f-44dd-8e1d-23040b099ffc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:57.335486 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2935/5895] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:57 2022] PUT /identity/v3/projects/9f4ed687e80941d9a5befe1031923ed5/users/b9e2bf42ef6446c69f1775a25ef76a92/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:57.346827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941a46-21d3-4b58-a57a-e440118f936d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:57.347387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941a46-21d3-4b58-a57a-e440118f936d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:57.347515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941a46-21d3-4b58-a57a-e440118f936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:57.379808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3e941a46-21d3-4b58-a57a-e440118f936d None None] MFA Rules not processed for user `b9e2bf42ef6446c69f1775a25ef76a92`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:57.381417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3e941a46-21d3-4b58-a57a-e440118f936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:57.547731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fe9dc-af0f-44dd-8e1d-23040b099ffc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:57.550888 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2961/5896] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:57.652278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fe9dc-af0f-44dd-8e1d-23040b099ffc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:57.665889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e71bb-0a4f-49e2-bf9c-2c0617b6366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:57.670510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e941a46-21d3-4b58-a57a-e440118f936d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:57.672547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3e941a46-21d3-4b58-a57a-e440118f936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:57.679315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e71bb-0a4f-49e2-bf9c-2c0617b6366e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:57.681674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e71bb-0a4f-49e2-bf9c-2c0617b6366e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:57.682213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e71bb-0a4f-49e2-bf9c-2c0617b6366e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:57.684019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e71bb-0a4f-49e2-bf9c-2c0617b6366e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:57.688457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e71bb-0a4f-49e2-bf9c-2c0617b6366e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:57.712862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e941a46-21d3-4b58-a57a-e440118f936d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:57.725193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:57.729519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:57.729889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:57.731270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] PATH_INFO: `/v3/projects/6acd6a45d0c7432abaa331897fa62306` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:57.739164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6acd6a45d0c7432abaa331897fa62306)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:57.741748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:57.748953 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2936/5897] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:57 2022] POST /identity/v3/projects => generated 389 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:57.753202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e71bb-0a4f-49e2-bf9c-2c0617b6366e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:57.862413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6acd6a45d0c7432abaa331897fa62306', 'request_id': 'req-5fdabf06-ae87-4cca-9bda-95acc6d48467'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:57.885075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6acd6a45d0c7432abaa331897fa62306', 'request_id': 'req-5fdabf06-ae87-4cca-9bda-95acc6d48467'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:57.903830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6acd6a45d0c7432abaa331897fa62306', 'request_id': 'req-5fdabf06-ae87-4cca-9bda-95acc6d48467'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:57.914231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e71bb-0a4f-49e2-bf9c-2c0617b6366e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:57.937151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] The token cache is being invalidate because project 6acd6a45d0c7432abaa331897fa62306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:10:57.937843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:57.942781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5fdabf06-ae87-4cca-9bda-95acc6d48467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:57.952023 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2962/5898] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:10:57 2022] DELETE /identity/v3/projects/6acd6a45d0c7432abaa331897fa62306 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:57.953735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bd1d8-9211-4a47-a191-394cf73b4d46 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:57.954268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bd1d8-9211-4a47-a191-394cf73b4d46 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:57.954725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bd1d8-9211-4a47-a191-394cf73b4d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:57.979008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-697bd1d8-9211-4a47-a191-394cf73b4d46 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:57.980524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-697bd1d8-9211-4a47-a191-394cf73b4d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:58.065686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.068978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.074082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.074525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.075705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.087729 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2963/5899] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:58.088909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.090008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483a275-defb-47d2-8cbe-725a653f470d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.090382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483a275-defb-47d2-8cbe-725a653f470d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.090665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483a275-defb-47d2-8cbe-725a653f470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.115237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1483a275-defb-47d2-8cbe-725a653f470d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:58.116539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1483a275-defb-47d2-8cbe-725a653f470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:58.130931 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2964/5900] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:58.132098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483a275-defb-47d2-8cbe-725a653f470d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.139281 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2937/5901] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:57 2022] POST /identity/v3/users => generated 295 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:58.143680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483a275-defb-47d2-8cbe-725a653f470d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.145607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.147609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:58.150904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.152305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.152632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.152910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.153943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:10:58.153943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.155611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.163840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f189659-44a7-437b-ad49-31a0fe48b409 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.175908 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2965/5902] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:58.177713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.181175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1220-7bf0-450c-b6a4-4cef4a5463f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.182055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1220-7bf0-450c-b6a4-4cef4a5463f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.182336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1220-7bf0-450c-b6a4-4cef4a5463f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.182610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1220-7bf0-450c-b6a4-4cef4a5463f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.183342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1220-7bf0-450c-b6a4-4cef4a5463f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.185114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1220-7bf0-450c-b6a4-4cef4a5463f6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.197431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a7564-c5a3-478e-aabd-6f84df9c45e8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.198198 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2938/5903] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:58.202277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1220-7bf0-450c-b6a4-4cef4a5463f6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.204653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ea6c3-d455-4737-8fe3-3f402d5d6930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.205486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea6c3-d455-4737-8fe3-3f402d5d6930 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.205869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea6c3-d455-4737-8fe3-3f402d5d6930 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.206247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea6c3-d455-4737-8fe3-3f402d5d6930 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.207855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ea6c3-d455-4737-8fe3-3f402d5d6930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.210859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ea6c3-d455-4737-8fe3-3f402d5d6930 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.215725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1220-7bf0-450c-b6a4-4cef4a5463f6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.232599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f97d-cd6f-4f86-966b-3c9997ded7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.233583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f97d-cd6f-4f86-966b-3c9997ded7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.233583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f97d-cd6f-4f86-966b-3c9997ded7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.233826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f97d-cd6f-4f86-966b-3c9997ded7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.234541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042f97d-cd6f-4f86-966b-3c9997ded7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.236412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042f97d-cd6f-4f86-966b-3c9997ded7b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.256711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2939/5904] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:58.259700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f97d-cd6f-4f86-966b-3c9997ded7b9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.272036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f97d-cd6f-4f86-966b-3c9997ded7b9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.275018 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2966/5905] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:58 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:58.279324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ea6c3-d455-4737-8fe3-3f402d5d6930 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.348513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0c5ae-70cf-46ff-b249-875078e56a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.349716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c5ae-70cf-46ff-b249-875078e56a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.350171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c5ae-70cf-46ff-b249-875078e56a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.350440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c5ae-70cf-46ff-b249-875078e56a77 admin admin] PATH_INFO: `/v3/projects/d7a70abff20548db85811d1b374387b3/users/3e7e07d3b583452386242a42cd87acc1/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.369710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c5ae-70cf-46ff-b249-875078e56a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a70abff20548db85811d1b374387b3, user_id=3e7e07d3b583452386242a42cd87acc1, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.373098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c5ae-70cf-46ff-b249-875078e56a77 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.397593 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2940/5906] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:58 2022] PUT /identity/v3/projects/d7a70abff20548db85811d1b374387b3/users/3e7e07d3b583452386242a42cd87acc1/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:58.402730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ea6c3-d455-4737-8fe3-3f402d5d6930 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.407953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d184f01-9a72-48ab-84c6-ad27a34625c8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.410435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d184f01-9a72-48ab-84c6-ad27a34625c8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.410751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d184f01-9a72-48ab-84c6-ad27a34625c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.454987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0d184f01-9a72-48ab-84c6-ad27a34625c8 None None] MFA Rules not processed for user `3e7e07d3b583452386242a42cd87acc1`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:58.456151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0d184f01-9a72-48ab-84c6-ad27a34625c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:58.484069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fee29-07a5-43e3-9c55-681a9cc626aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.484917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fee29-07a5-43e3-9c55-681a9cc626aa admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.485272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fee29-07a5-43e3-9c55-681a9cc626aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.485624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fee29-07a5-43e3-9c55-681a9cc626aa admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.486482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fee29-07a5-43e3-9c55-681a9cc626aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.489325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fee29-07a5-43e3-9c55-681a9cc626aa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.528149 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2967/5907] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:58 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:58.532138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fee29-07a5-43e3-9c55-681a9cc626aa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.544508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fee29-07a5-43e3-9c55-681a9cc626aa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.545177 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2941/5908] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:58.549696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d184f01-9a72-48ab-84c6-ad27a34625c8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.555406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c36e43-3596-4f13-9e39-87b108df746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.556090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c36e43-3596-4f13-9e39-87b108df746a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.556407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c36e43-3596-4f13-9e39-87b108df746a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.556720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c36e43-3596-4f13-9e39-87b108df746a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.557481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c36e43-3596-4f13-9e39-87b108df746a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.559337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c36e43-3596-4f13-9e39-87b108df746a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.562858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d184f01-9a72-48ab-84c6-ad27a34625c8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.570159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c17833-0e8e-4a37-8661-34be77299c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.571207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c17833-0e8e-4a37-8661-34be77299c3d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.571534 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2968/5909] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:58.571855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c17833-0e8e-4a37-8661-34be77299c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.572137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c17833-0e8e-4a37-8661-34be77299c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.572886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c17833-0e8e-4a37-8661-34be77299c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.574832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c17833-0e8e-4a37-8661-34be77299c3d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.575884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c36e43-3596-4f13-9e39-87b108df746a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.587774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c36e43-3596-4f13-9e39-87b108df746a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.597020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40735bca-6548-4eed-b63c-25e91e874151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.598519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40735bca-6548-4eed-b63c-25e91e874151 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.598810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40735bca-6548-4eed-b63c-25e91e874151 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.599095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40735bca-6548-4eed-b63c-25e91e874151 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.599847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40735bca-6548-4eed-b63c-25e91e874151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.601605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40735bca-6548-4eed-b63c-25e91e874151 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.617030 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2969/5910] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:58.621601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40735bca-6548-4eed-b63c-25e91e874151 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.625444 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2942/5911] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:10:58 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:58.628516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c17833-0e8e-4a37-8661-34be77299c3d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.638947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40735bca-6548-4eed-b63c-25e91e874151 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.736617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c17833-0e8e-4a37-8661-34be77299c3d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.744475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f97368-b6d6-4e9e-8b8b-f15c9eb4d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.749034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f97368-b6d6-4e9e-8b8b-f15c9eb4d526 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.749496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f97368-b6d6-4e9e-8b8b-f15c9eb4d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.749963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f97368-b6d6-4e9e-8b8b-f15c9eb4d526 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.750756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f97368-b6d6-4e9e-8b8b-f15c9eb4d526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.754399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f97368-b6d6-4e9e-8b8b-f15c9eb4d526 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.757073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7658bf-03a0-4f3c-baa5-833a4d262015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.759021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7658bf-03a0-4f3c-baa5-833a4d262015 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.759576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7658bf-03a0-4f3c-baa5-833a4d262015 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.760124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7658bf-03a0-4f3c-baa5-833a4d262015 admin admin] PATH_INFO: `/v3/projects/9cdcdff8f466493ebfae0c76cb060e7e/users/5bd49ee97d4e41af997492d7303d0c1f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.785896 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2943/5912] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:10:58 2022] POST /identity/v3/users => generated 301 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:58.791058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7658bf-03a0-4f3c-baa5-833a4d262015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdcdff8f466493ebfae0c76cb060e7e, user_id=5bd49ee97d4e41af997492d7303d0c1f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.792534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f97368-b6d6-4e9e-8b8b-f15c9eb4d526 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.793964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7658bf-03a0-4f3c-baa5-833a4d262015 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.804964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f97368-b6d6-4e9e-8b8b-f15c9eb4d526 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.811807 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2970/5913] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:58 2022] PUT /identity/v3/projects/9cdcdff8f466493ebfae0c76cb060e7e/users/5bd49ee97d4e41af997492d7303d0c1f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:58.825749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280da2-3d49-40e5-830c-7f4836aa3508 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.826064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280da2-3d49-40e5-830c-7f4836aa3508 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.826470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280da2-3d49-40e5-830c-7f4836aa3508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.861618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-68280da2-3d49-40e5-830c-7f4836aa3508 None None] MFA Rules not processed for user `5bd49ee97d4e41af997492d7303d0c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:58.862895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-68280da2-3d49-40e5-830c-7f4836aa3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:58.887288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24446fb-2e09-492f-9841-59e5c43d5d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.888513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24446fb-2e09-492f-9841-59e5c43d5d97 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.888815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24446fb-2e09-492f-9841-59e5c43d5d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.889103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24446fb-2e09-492f-9841-59e5c43d5d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.889863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24446fb-2e09-492f-9841-59e5c43d5d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.891575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24446fb-2e09-492f-9841-59e5c43d5d97 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.904106 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2944/5914] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:10:58.908258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24446fb-2e09-492f-9841-59e5c43d5d97 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.919985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24446fb-2e09-492f-9841-59e5c43d5d97 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.927175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59b573-8cce-4cc5-9ac0-bee3f0abc57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.928302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59b573-8cce-4cc5-9ac0-bee3f0abc57a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.928536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59b573-8cce-4cc5-9ac0-bee3f0abc57a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.928830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59b573-8cce-4cc5-9ac0-bee3f0abc57a admin admin] PATH_INFO: `/v3/projects/1113a42ca18c4dc6aebfed897b6cdfbf/users/744c8535c989444e99ceedccdfe9c2be/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.938090 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2971/5915] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:10:58.943717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280da2-3d49-40e5-830c-7f4836aa3508 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:58.947285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59b573-8cce-4cc5-9ac0-bee3f0abc57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1113a42ca18c4dc6aebfed897b6cdfbf, user_id=744c8535c989444e99ceedccdfe9c2be, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.951131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59b573-8cce-4cc5-9ac0-bee3f0abc57a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.953044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280da2-3d49-40e5-830c-7f4836aa3508 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:58.960417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd343ed7-3777-459c-8f29-268c8aad5bf5 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:58.962305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd343ed7-3777-459c-8f29-268c8aad5bf5 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:58.962712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd343ed7-3777-459c-8f29-268c8aad5bf5 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:58.962999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd343ed7-3777-459c-8f29-268c8aad5bf5 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:58.963695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd343ed7-3777-459c-8f29-268c8aad5bf5 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:58.965278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd343ed7-3777-459c-8f29-268c8aad5bf5 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:58.969814 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2945/5916] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:58 2022] PUT /identity/v3/projects/1113a42ca18c4dc6aebfed897b6cdfbf/users/744c8535c989444e99ceedccdfe9c2be/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:58.974289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59b573-8cce-4cc5-9ac0-bee3f0abc57a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.021464 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2972/5917] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Feb 19 21:10:58 2022] POST /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2 => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:59.024611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd343ed7-3777-459c-8f29-268c8aad5bf5 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.037682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd343ed7-3777-459c-8f29-268c8aad5bf5 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.080143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59b573-8cce-4cc5-9ac0-bee3f0abc57a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.093288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e2516-756c-4266-93d4-a8e761593c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.094391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2516-756c-4266-93d4-a8e761593c4c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.094916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2516-756c-4266-93d4-a8e761593c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.095393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2516-756c-4266-93d4-a8e761593c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.096371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e2516-756c-4266-93d4-a8e761593c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.098958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e2516-756c-4266-93d4-a8e761593c4c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.110068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b594ac6-e649-430f-8842-b0d1742d0d59 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.111152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b594ac6-e649-430f-8842-b0d1742d0d59 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.111896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b594ac6-e649-430f-8842-b0d1742d0d59 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.112186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b594ac6-e649-430f-8842-b0d1742d0d59 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/46659d5bd8da4c63a95ce2ec9a0f8ebe` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.113930 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2946/5918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:10:59.119293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b594ac6-e649-430f-8842-b0d1742d0d59 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f, credential_id=46659d5bd8da4c63a95ce2ec9a0f8ebe)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.120972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b594ac6-e649-430f-8842-b0d1742d0d59 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.122238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e2516-756c-4266-93d4-a8e761593c4c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.142007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e2516-756c-4266-93d4-a8e761593c4c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.149897 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2973/5919] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Feb 19 21:10:59 2022] DELETE /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/46659d5bd8da4c63a95ce2ec9a0f8ebe => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:59.152680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfd7dc-c41a-4623-bba7-08c94d0db324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.153723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfd7dc-c41a-4623-bba7-08c94d0db324 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.154012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfd7dc-c41a-4623-bba7-08c94d0db324 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.154291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfd7dc-c41a-4623-bba7-08c94d0db324 admin admin] PATH_INFO: `/v3/projects/1113a42ca18c4dc6aebfed897b6cdfbf/users/744c8535c989444e99ceedccdfe9c2be/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.154564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b594ac6-e649-430f-8842-b0d1742d0d59 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.163153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfd7dc-c41a-4623-bba7-08c94d0db324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1113a42ca18c4dc6aebfed897b6cdfbf, user_id=744c8535c989444e99ceedccdfe9c2be, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.167964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfd7dc-c41a-4623-bba7-08c94d0db324 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.169124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b594ac6-e649-430f-8842-b0d1742d0d59 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.180046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb76fb9-2f89-4333-92f2-1ea055ae3f77 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.181019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76fb9-2f89-4333-92f2-1ea055ae3f77 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.181409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76fb9-2f89-4333-92f2-1ea055ae3f77 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.187104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76fb9-2f89-4333-92f2-1ea055ae3f77 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.187864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb76fb9-2f89-4333-92f2-1ea055ae3f77 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.188256 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2947/5920] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:10:59 2022] PUT /identity/v3/projects/1113a42ca18c4dc6aebfed897b6cdfbf/users/744c8535c989444e99ceedccdfe9c2be/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:59.189446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb76fb9-2f89-4333-92f2-1ea055ae3f77 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.211062 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2974/5921] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Feb 19 21:10:59 2022] POST /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2 => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:59.211234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11c8b3-2b2e-4a34-a3ee-ca7e184463cf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.211234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11c8b3-2b2e-4a34-a3ee-ca7e184463cf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.211440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11c8b3-2b2e-4a34-a3ee-ca7e184463cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.212791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb76fb9-2f89-4333-92f2-1ea055ae3f77 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.222855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb76fb9-2f89-4333-92f2-1ea055ae3f77 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.256124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0f11c8b3-2b2e-4a34-a3ee-ca7e184463cf None None] MFA Rules not processed for user `744c8535c989444e99ceedccdfe9c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:59.257431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0f11c8b3-2b2e-4a34-a3ee-ca7e184463cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:59.278615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46677e46-0829-40c8-8c22-86850a006fcd tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.279525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677e46-0829-40c8-8c22-86850a006fcd tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.279819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677e46-0829-40c8-8c22-86850a006fcd tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.280103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677e46-0829-40c8-8c22-86850a006fcd tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/d6dec29b7711471cab7a70cd252b2aff` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.282226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46677e46-0829-40c8-8c22-86850a006fcd tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f, credential_id=d6dec29b7711471cab7a70cd252b2aff)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.283666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46677e46-0829-40c8-8c22-86850a006fcd tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.300566 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2975/5922] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Feb 19 21:10:59 2022] DELETE /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/d6dec29b7711471cab7a70cd252b2aff => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:59.304781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46677e46-0829-40c8-8c22-86850a006fcd tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.314136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46677e46-0829-40c8-8c22-86850a006fcd tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.318667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84b0db-9fe9-4b3c-b248-babd14238d9f tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.319552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84b0db-9fe9-4b3c-b248-babd14238d9f tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.319837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84b0db-9fe9-4b3c-b248-babd14238d9f tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.320632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84b0db-9fe9-4b3c-b248-babd14238d9f tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/d6dec29b7711471cab7a70cd252b2aff` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.329651 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2948/5923] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:59.335014 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-ea84b0db-9fe9-4b3c-b248-babd14238d9f tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Could not find credential: 0984ed4aa97f1989afa2205fbd63e5a159506c13cece1f548e99e2fc8aeb1c89.: keystone.exception.CredentialNotFound: Could not find credential: 0984ed4aa97f1989afa2205fbd63e5a159506c13cece1f548e99e2fc8aeb1c89. Feb 19 21:10:59.336260 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2976/5924] 10.222.0.30 () {58 vars in 1376 bytes} [Sat Feb 19 21:10:59 2022] GET /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/d6dec29b7711471cab7a70cd252b2aff => generated 148 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:10:59.341431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11c8b3-2b2e-4a34-a3ee-ca7e184463cf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.343006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84b0db-9fe9-4b3c-b248-babd14238d9f tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.344761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ea84b0db-9fe9-4b3c-b248-babd14238d9f tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:59.352135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11c8b3-2b2e-4a34-a3ee-ca7e184463cf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.356890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e875-9800-40e3-93d8-5f3680f3ddf2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.357727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e875-9800-40e3-93d8-5f3680f3ddf2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.358011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e875-9800-40e3-93d8-5f3680f3ddf2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.358288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e875-9800-40e3-93d8-5f3680f3ddf2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.358974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02e875-9800-40e3-93d8-5f3680f3ddf2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.360566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02e875-9800-40e3-93d8-5f3680f3ddf2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.379055 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2949/5925] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Feb 19 21:10:59 2022] POST /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2 => generated 367 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:59.383383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e875-9800-40e3-93d8-5f3680f3ddf2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.394437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e875-9800-40e3-93d8-5f3680f3ddf2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.399098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acf747-48e3-446a-b356-27e85fd69f6e tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.399916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acf747-48e3-446a-b356-27e85fd69f6e tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.400197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acf747-48e3-446a-b356-27e85fd69f6e tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.400514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acf747-48e3-446a-b356-27e85fd69f6e tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.401264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acf747-48e3-446a-b356-27e85fd69f6e tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.402745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acf747-48e3-446a-b356-27e85fd69f6e tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.419225 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2950/5926] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Feb 19 21:10:59 2022] POST /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2 => generated 367 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:10:59.423467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acf747-48e3-446a-b356-27e85fd69f6e tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.425790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84b0db-9fe9-4b3c-b248-babd14238d9f tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.431706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.432388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.432674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.432956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.433138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acf747-48e3-446a-b356-27e85fd69f6e tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.434762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:59.437525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dca86-8314-457f-9584-ff17b2dd2567 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.438335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dca86-8314-457f-9584-ff17b2dd2567 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.438624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dca86-8314-457f-9584-ff17b2dd2567 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.438902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dca86-8314-457f-9584-ff17b2dd2567 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.439551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dca86-8314-457f-9584-ff17b2dd2567 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=5bd49ee97d4e41af997492d7303d0c1f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.441797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dca86-8314-457f-9584-ff17b2dd2567 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.453294 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2951/5927] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Feb 19 21:10:59 2022] GET /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2 => generated 865 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:10:59.458294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dca86-8314-457f-9584-ff17b2dd2567 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.467621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dca86-8314-457f-9584-ff17b2dd2567 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.471888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adc06d-31a9-4076-8f9d-a8ed9582482a tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.472818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc06d-31a9-4076-8f9d-a8ed9582482a tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.473094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc06d-31a9-4076-8f9d-a8ed9582482a tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.473372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adc06d-31a9-4076-8f9d-a8ed9582482a tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/52feb81bf153492295bd8eeef62fd441` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.475402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adc06d-31a9-4076-8f9d-a8ed9582482a tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f, credential_id=52feb81bf153492295bd8eeef62fd441)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.476871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adc06d-31a9-4076-8f9d-a8ed9582482a tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.496593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.497889 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2952/5928] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Feb 19 21:10:59 2022] DELETE /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/52feb81bf153492295bd8eeef62fd441 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:59.498246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.502109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adc06d-31a9-4076-8f9d-a8ed9582482a tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.510383 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2977/5929] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:10:59.512436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adc06d-31a9-4076-8f9d-a8ed9582482a tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.516808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3babb-01e9-4db6-8729-e953c5b45f1c tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.517674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3babb-01e9-4db6-8729-e953c5b45f1c tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.517960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3babb-01e9-4db6-8729-e953c5b45f1c tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.518241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3babb-01e9-4db6-8729-e953c5b45f1c tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/d3dbbbf2d26048689339fdea7abdd783` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.520859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3babb-01e9-4db6-8729-e953c5b45f1c tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f, credential_id=d3dbbbf2d26048689339fdea7abdd783)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.522275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3babb-01e9-4db6-8729-e953c5b45f1c tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.539572 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2953/5930] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Feb 19 21:10:59 2022] DELETE /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/d3dbbbf2d26048689339fdea7abdd783 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:10:59.545042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.563936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad5c6d-b4c9-424d-a4f4-ad6d5038cf65 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.569380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e377-d2e2-484e-9173-196bb2be0774 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.570214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e377-d2e2-484e-9173-196bb2be0774 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.570563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e377-d2e2-484e-9173-196bb2be0774 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.570832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e377-d2e2-484e-9173-196bb2be0774 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.571541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557e377-d2e2-484e-9173-196bb2be0774 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.573186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557e377-d2e2-484e-9173-196bb2be0774 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.594182 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2978/5931] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Feb 19 21:10:59 2022] POST /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2 => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:10:59.598452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3babb-01e9-4db6-8729-e953c5b45f1c tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.607973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3babb-01e9-4db6-8729-e953c5b45f1c tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.612123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5e11b-fa28-4fc8-8b5b-b8a6adedcdb2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.613072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e11b-fa28-4fc8-8b5b-b8a6adedcdb2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.613329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e11b-fa28-4fc8-8b5b-b8a6adedcdb2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.613669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e11b-fa28-4fc8-8b5b-b8a6adedcdb2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/a955db843bcd4827b9c27a261134e1cc` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.615661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5e11b-fa28-4fc8-8b5b-b8a6adedcdb2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f, credential_id=a955db843bcd4827b9c27a261134e1cc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.617361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5e11b-fa28-4fc8-8b5b-b8a6adedcdb2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.620292 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2954/5932] 10.222.0.30 () {58 vars in 1376 bytes} [Sat Feb 19 21:10:59 2022] GET /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/a955db843bcd4827b9c27a261134e1cc => generated 367 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:10:59.625009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e377-d2e2-484e-9173-196bb2be0774 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.636021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e377-d2e2-484e-9173-196bb2be0774 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.641344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcb57a-1bb7-4c8f-9dbd-d10c1bc533bb tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd49ee97d4e41af997492d7303d0c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cdcdff8f466493ebfae0c76cb060e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.642421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcb57a-1bb7-4c8f-9dbd-d10c1bc533bb tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.642705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcb57a-1bb7-4c8f-9dbd-d10c1bc533bb tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.642984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcb57a-1bb7-4c8f-9dbd-d10c1bc533bb tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/a955db843bcd4827b9c27a261134e1cc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.645789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcb57a-1bb7-4c8f-9dbd-d10c1bc533bb tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5bd49ee97d4e41af997492d7303d0c1f, credential_id=a955db843bcd4827b9c27a261134e1cc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.647883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcb57a-1bb7-4c8f-9dbd-d10c1bc533bb tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.668743 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2979/5933] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Feb 19 21:10:59 2022] DELETE /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f/credentials/OS-EC2/a955db843bcd4827b9c27a261134e1cc => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:59.673364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5e11b-fa28-4fc8-8b5b-b8a6adedcdb2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.761677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5e11b-fa28-4fc8-8b5b-b8a6adedcdb2 tempest-EC2CredentialsTest-149307930 tempest-EC2CredentialsTest-149307930-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:10:59.766749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:10:59.767646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.767927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.768198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] PATH_INFO: `/v3/users/5bd49ee97d4e41af997492d7303d0c1f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.769983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd49ee97d4e41af997492d7303d0c1f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:10:59.771910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:10:59.825196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd49ee97d4e41af997492d7303d0c1f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:59.825921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd49ee97d4e41af997492d7303d0c1f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:59.826550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd49ee97d4e41af997492d7303d0c1f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:59.839344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd49ee97d4e41af997492d7303d0c1f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:59.847269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd49ee97d4e41af997492d7303d0c1f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:10:59.861029 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2955/5934] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:10:59 2022] DELETE /identity/v3/users/5bd49ee97d4e41af997492d7303d0c1f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:10:59.866829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec6a7d-0dee-4d4d-b24d-57ecb3ad1dda None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:10:59.867094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec6a7d-0dee-4d4d-b24d-57ecb3ad1dda None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:10:59.867380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec6a7d-0dee-4d4d-b24d-57ecb3ad1dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:10:59.890855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c5ec6a7d-0dee-4d4d-b24d-57ecb3ad1dda None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:10:59.892163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c5ec6a7d-0dee-4d4d-b24d-57ecb3ad1dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:10:59.968576 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2980/5935] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:10:59.981563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:10:59.984010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:00.053376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7696f2b-6266-4c42-a0bf-0302a50470a1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:00.058464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8cb72-e315-410a-85a1-7e3f0212af50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:00.059277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8cb72-e315-410a-85a1-7e3f0212af50 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:00.059566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8cb72-e315-410a-85a1-7e3f0212af50 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:00.059849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8cb72-e315-410a-85a1-7e3f0212af50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:00.074293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8cb72-e315-410a-85a1-7e3f0212af50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:00.075829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8cb72-e315-410a-85a1-7e3f0212af50 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:00.089450 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2956/5936] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:00.610473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec6a7d-0dee-4d4d-b24d-57ecb3ad1dda None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:00.614699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c5ec6a7d-0dee-4d4d-b24d-57ecb3ad1dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:00.652602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec6a7d-0dee-4d4d-b24d-57ecb3ad1dda None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:00.661397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:00.662972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:00.663640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:00.664276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] PATH_INFO: `/v3/projects/9cdcdff8f466493ebfae0c76cb060e7e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:00.667209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdcdff8f466493ebfae0c76cb060e7e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:00.670644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:00.758926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdcdff8f466493ebfae0c76cb060e7e', 'request_id': 'req-1cc3d274-f929-485a-8ade-7b4f717be3b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:00.764812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdcdff8f466493ebfae0c76cb060e7e', 'request_id': 'req-1cc3d274-f929-485a-8ade-7b4f717be3b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:00.777143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdcdff8f466493ebfae0c76cb060e7e', 'request_id': 'req-1cc3d274-f929-485a-8ade-7b4f717be3b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:00.792301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] The token cache is being invalidate because project 9cdcdff8f466493ebfae0c76cb060e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:00.792637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:00.793312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1cc3d274-f929-485a-8ade-7b4f717be3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:00.801854 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2981/5937] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:00 2022] DELETE /identity/v3/projects/9cdcdff8f466493ebfae0c76cb060e7e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:00.804070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99eb249-4e9d-4252-8979-3c54e5eedd6f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:00.804558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99eb249-4e9d-4252-8979-3c54e5eedd6f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:00.804920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99eb249-4e9d-4252-8979-3c54e5eedd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:00.829751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c99eb249-4e9d-4252-8979-3c54e5eedd6f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:00.839112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c99eb249-4e9d-4252-8979-3c54e5eedd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:00.933132 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2957/5938] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:00.942194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07a0d-247f-46cd-9d22-ee10369211ab None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:00.942515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07a0d-247f-46cd-9d22-ee10369211ab None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:00.942785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07a0d-247f-46cd-9d22-ee10369211ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.010579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f4f07a0d-247f-46cd-9d22-ee10369211ab None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:01.012071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f4f07a0d-247f-46cd-9d22-ee10369211ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:01.022215 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2982/5939] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:01.025905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99eb249-4e9d-4252-8979-3c54e5eedd6f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.039143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99eb249-4e9d-4252-8979-3c54e5eedd6f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:01.045500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:01.046503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.047119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.047571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.048957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:01.049479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:01.052193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:01.070472 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2958/5940] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:01.074745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07a0d-247f-46cd-9d22-ee10369211ab None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.087832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07a0d-247f-46cd-9d22-ee10369211ab None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:01.095394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37561a96-c5a1-41fa-a695-a6dc3b0e2c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:01.097568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561a96-c5a1-41fa-a695-a6dc3b0e2c65 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.098563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561a96-c5a1-41fa-a695-a6dc3b0e2c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.099104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561a96-c5a1-41fa-a695-a6dc3b0e2c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.100090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561a96-c5a1-41fa-a695-a6dc3b0e2c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:01.102542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561a96-c5a1-41fa-a695-a6dc3b0e2c65 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:01.151167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.153219 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2983/5941] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:01 2022] POST /identity/v3/projects => generated 397 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:01.166519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30f66d-89ca-45b8-8cda-3bcd77279986 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:01.306270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b5959-1546-42ac-a04d-122af0e6dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:01.306966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5959-1546-42ac-a04d-122af0e6dfea admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.307251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5959-1546-42ac-a04d-122af0e6dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.307688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5959-1546-42ac-a04d-122af0e6dfea admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.308445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b5959-1546-42ac-a04d-122af0e6dfea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:01.310724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b5959-1546-42ac-a04d-122af0e6dfea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:01.345568 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2959/5942] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:01 2022] POST /identity/v3/users => generated 305 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:01.351839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37561a96-c5a1-41fa-a695-a6dc3b0e2c65 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.369909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37561a96-c5a1-41fa-a695-a6dc3b0e2c65 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:01.379138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ad80-8523-41eb-9868-448079e887f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:01.379870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ad80-8523-41eb-9868-448079e887f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.380199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ad80-8523-41eb-9868-448079e887f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.380603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ad80-8523-41eb-9868-448079e887f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.381349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ad80-8523-41eb-9868-448079e887f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:01.383196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ad80-8523-41eb-9868-448079e887f8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:01.403087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b5959-1546-42ac-a04d-122af0e6dfea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.404130 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2984/5943] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:01.414444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b5959-1546-42ac-a04d-122af0e6dfea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:01.419412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe0d4d-3533-47d8-b73b-46d3b784991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:01.420529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe0d4d-3533-47d8-b73b-46d3b784991e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.420639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe0d4d-3533-47d8-b73b-46d3b784991e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.420893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe0d4d-3533-47d8-b73b-46d3b784991e admin admin] PATH_INFO: `/v3/projects/64b30065ccff4072a560f40f66d2c386/users/b668d6ab475842e296a0270c3d103857/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.441553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe0d4d-3533-47d8-b73b-46d3b784991e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b30065ccff4072a560f40f66d2c386, user_id=b668d6ab475842e296a0270c3d103857, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:01.444610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe0d4d-3533-47d8-b73b-46d3b784991e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:01.469955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ad80-8523-41eb-9868-448079e887f8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.470536 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2960/5944] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:01 2022] PUT /identity/v3/projects/64b30065ccff4072a560f40f66d2c386/users/b668d6ab475842e296a0270c3d103857/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:11:01.482473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ad80-8523-41eb-9868-448079e887f8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:01.554435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc975ed-1ebf-49be-a047-9612e2612fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:01.555057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc975ed-1ebf-49be-a047-9612e2612fdb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.555349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc975ed-1ebf-49be-a047-9612e2612fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.555614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc975ed-1ebf-49be-a047-9612e2612fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.556364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc975ed-1ebf-49be-a047-9612e2612fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:01.558160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc975ed-1ebf-49be-a047-9612e2612fdb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:01.577157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe0d4d-3533-47d8-b73b-46d3b784991e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.585986 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2985/5945] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:01.589682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe0d4d-3533-47d8-b73b-46d3b784991e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:01.594902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a3812-915e-469a-a8e6-9f1345f923e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:01.595802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a3812-915e-469a-a8e6-9f1345f923e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.596083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a3812-915e-469a-a8e6-9f1345f923e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.596389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a3812-915e-469a-a8e6-9f1345f923e1 admin admin] PATH_INFO: `/v3/projects/64b30065ccff4072a560f40f66d2c386/users/b668d6ab475842e296a0270c3d103857/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.599157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a3812-915e-469a-a8e6-9f1345f923e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b30065ccff4072a560f40f66d2c386, user_id=b668d6ab475842e296a0270c3d103857, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:01.602502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a3812-915e-469a-a8e6-9f1345f923e1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:01.636893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46a2f-dc9d-4dbf-9ac9-061093b7e7c6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.637510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46a2f-dc9d-4dbf-9ac9-061093b7e7c6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.637733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46a2f-dc9d-4dbf-9ac9-061093b7e7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.639175 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2961/5946] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:01 2022] PUT /identity/v3/projects/64b30065ccff4072a560f40f66d2c386/users/b668d6ab475842e296a0270c3d103857/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:01.674351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-45a46a2f-dc9d-4dbf-9ac9-061093b7e7c6 None None] MFA Rules not processed for user `b668d6ab475842e296a0270c3d103857`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:01.676054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-45a46a2f-dc9d-4dbf-9ac9-061093b7e7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:01.772634 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2986/5947] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:01.777259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a3812-915e-469a-a8e6-9f1345f923e1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.866776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a3812-915e-469a-a8e6-9f1345f923e1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:01.877155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3066e2-e4aa-4880-bdc8-755873a1633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:01.877970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3066e2-e4aa-4880-bdc8-755873a1633d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:01.878778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3066e2-e4aa-4880-bdc8-755873a1633d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:01.879068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3066e2-e4aa-4880-bdc8-755873a1633d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:01.879800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3066e2-e4aa-4880-bdc8-755873a1633d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:01.882333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3066e2-e4aa-4880-bdc8-755873a1633d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:01.923284 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2962/5948] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:01 2022] POST /identity/v3/projects => generated 397 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:11:01.927374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46a2f-dc9d-4dbf-9ac9-061093b7e7c6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:01.938673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46a2f-dc9d-4dbf-9ac9-061093b7e7c6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:02.052835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b86a-aa38-4f04-9fdf-18465a67ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:02.053599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b86a-aa38-4f04-9fdf-18465a67ffb4 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:02.053859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b86a-aa38-4f04-9fdf-18465a67ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:02.054100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b86a-aa38-4f04-9fdf-18465a67ffb4 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:02.054809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0b86a-aa38-4f04-9fdf-18465a67ffb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:02.057317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0b86a-aa38-4f04-9fdf-18465a67ffb4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:02.093385 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2987/5949] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:01 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:02.097385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3066e2-e4aa-4880-bdc8-755873a1633d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:02.114493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3066e2-e4aa-4880-bdc8-755873a1633d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:02.122484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb26f35-908d-416e-b3cb-1a6872bced57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:02.124879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26f35-908d-416e-b3cb-1a6872bced57 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:02.125168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26f35-908d-416e-b3cb-1a6872bced57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:02.125625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26f35-908d-416e-b3cb-1a6872bced57 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:02.126949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb26f35-908d-416e-b3cb-1a6872bced57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:02.129496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb26f35-908d-416e-b3cb-1a6872bced57 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:02.144636 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2963/5950] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:02.148495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b86a-aa38-4f04-9fdf-18465a67ffb4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:02.160422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b86a-aa38-4f04-9fdf-18465a67ffb4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:02.166834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4473c-1aba-427b-aced-07f4f3891652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:02.167646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4473c-1aba-427b-aced-07f4f3891652 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:02.167931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4473c-1aba-427b-aced-07f4f3891652 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:02.168225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4473c-1aba-427b-aced-07f4f3891652 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:02.169128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4473c-1aba-427b-aced-07f4f3891652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:02.171050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4473c-1aba-427b-aced-07f4f3891652 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:02.183607 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2988/5951] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:11:02.188683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb26f35-908d-416e-b3cb-1a6872bced57 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:02.200533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb26f35-908d-416e-b3cb-1a6872bced57 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:02.205952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:02.207388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:02.207672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:02.207951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] PATH_INFO: `/v3/projects/bfdc6e9035f64d3a8ae318133abf8ef6/users/74931a20f5be47af8339bd696b210543/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:02.225404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdc6e9035f64d3a8ae318133abf8ef6, user_id=74931a20f5be47af8339bd696b210543, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:02.228071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:02.251702 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2964/5952] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:02 2022] PUT /identity/v3/projects/bfdc6e9035f64d3a8ae318133abf8ef6/users/74931a20f5be47af8339bd696b210543/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:02.262270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000685c-9cda-464d-8b91-814e6a50b460 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:02.262582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000685c-9cda-464d-8b91-814e6a50b460 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:02.262835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000685c-9cda-464d-8b91-814e6a50b460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:02.307867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1000685c-9cda-464d-8b91-814e6a50b460 None None] MFA Rules not processed for user `74931a20f5be47af8339bd696b210543`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:02.311123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1000685c-9cda-464d-8b91-814e6a50b460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:02.420186 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2989/5953] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:02.428314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:02.430410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:02.517100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7bdb-407d-4d45-9402-1695988bad93 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:02.521563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb332fe7-27ef-4d59-a47c-7cd4b1c6df15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:02.522213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332fe7-27ef-4d59-a47c-7cd4b1c6df15 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:02.522498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332fe7-27ef-4d59-a47c-7cd4b1c6df15 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:02.522780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332fe7-27ef-4d59-a47c-7cd4b1c6df15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:02.593876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb332fe7-27ef-4d59-a47c-7cd4b1c6df15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:02.595329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb332fe7-27ef-4d59-a47c-7cd4b1c6df15 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:02.605941 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2965/5954] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:03.031049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000685c-9cda-464d-8b91-814e6a50b460 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:03.099192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000685c-9cda-464d-8b91-814e6a50b460 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:03.104308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:03.105421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:03.106211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:03.106211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] PATH_INFO: `/v3/users/b668d6ab475842e296a0270c3d103857` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:03.107181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b668d6ab475842e296a0270c3d103857)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:03.109731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:03.158319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b668d6ab475842e296a0270c3d103857'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:03.170657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b668d6ab475842e296a0270c3d103857'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:03.178453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b668d6ab475842e296a0270c3d103857'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:03.179189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b668d6ab475842e296a0270c3d103857'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:03.179843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b668d6ab475842e296a0270c3d103857'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:03.192358 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2990/5955] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:03 2022] DELETE /identity/v3/users/b668d6ab475842e296a0270c3d103857 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:11:03.197421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2f7e-34f3-40c1-bb40-f979b6a31e22 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:03.197909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2f7e-34f3-40c1-bb40-f979b6a31e22 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:03.198026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2f7e-34f3-40c1-bb40-f979b6a31e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:03.215563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-365a2f7e-34f3-40c1-bb40-f979b6a31e22 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:03.216909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-365a2f7e-34f3-40c1-bb40-f979b6a31e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:03.276678 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2966/5956] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:03.287483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:03.289782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:03.327569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a2f7e-34f3-40c1-bb40-f979b6a31e22 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:03.329046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-365a2f7e-34f3-40c1-bb40-f979b6a31e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:03.376389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94356ca9-72d8-4ca0-880e-9f46b2252ec7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:03.384775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:03.385877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:03.386163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:03.386441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:03.399831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:03.401701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:03.406116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a2f7e-34f3-40c1-bb40-f979b6a31e22 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:03.410828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:03.412721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:03.413066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:03.413447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:03.414390 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2991/5957] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:03.415746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:03.518165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:03.523132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:03.538382 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2967/5958] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:11:03.851749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:03.854764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:03.887362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acd780-2518-4c26-82e5-9ca1a41132f5 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:03.902851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:03.908211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:03.908838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:03.909236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] PATH_INFO: `/v3/projects/64b30065ccff4072a560f40f66d2c386` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:03.912537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b30065ccff4072a560f40f66d2c386)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:03.916076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:04.036386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b30065ccff4072a560f40f66d2c386', 'request_id': 'req-a0f58eee-80ef-4c70-8347-f9894d7a9c96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.050049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b30065ccff4072a560f40f66d2c386', 'request_id': 'req-a0f58eee-80ef-4c70-8347-f9894d7a9c96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.075208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b30065ccff4072a560f40f66d2c386', 'request_id': 'req-a0f58eee-80ef-4c70-8347-f9894d7a9c96'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.102791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] The token cache is being invalidate because project 64b30065ccff4072a560f40f66d2c386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:04.103328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.104293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.106971 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2992/5959] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:03 2022] DELETE /identity/v3/projects/64b30065ccff4072a560f40f66d2c386 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:04.110904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:04.131158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b894192-5f14-4242-a2e1-83ca7714d338 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:04.245864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:04.246766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:04.247048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:04.247326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] PATH_INFO: `/v3/users/74931a20f5be47af8339bd696b210543` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:04.253883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74931a20f5be47af8339bd696b210543)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:04.277818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:04.426707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74931a20f5be47af8339bd696b210543'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.428689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74931a20f5be47af8339bd696b210543'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.438589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74931a20f5be47af8339bd696b210543'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.456710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74931a20f5be47af8339bd696b210543'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.468991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c6faef-5ce7-4942-9616-a616de895ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74931a20f5be47af8339bd696b210543'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:04.493735 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2968/5960] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:04 2022] DELETE /identity/v3/users/74931a20f5be47af8339bd696b210543 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:05.188163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:05.189737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:05.211278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f58eee-80ef-4c70-8347-f9894d7a9c96 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:05.349785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:05.350707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:05.350991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:05.351325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] PATH_INFO: `/v3/projects/bfdc6e9035f64d3a8ae318133abf8ef6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:05.353979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdc6e9035f64d3a8ae318133abf8ef6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:05.361735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:05.431687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdc6e9035f64d3a8ae318133abf8ef6', 'request_id': 'req-87fcee65-aea8-4748-a828-16622a06d7ca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:05.442215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdc6e9035f64d3a8ae318133abf8ef6', 'request_id': 'req-87fcee65-aea8-4748-a828-16622a06d7ca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:05.466861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdc6e9035f64d3a8ae318133abf8ef6', 'request_id': 'req-87fcee65-aea8-4748-a828-16622a06d7ca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:05.500938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] The token cache is being invalidate because project bfdc6e9035f64d3a8ae318133abf8ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:05.501413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:05.502260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87fcee65-aea8-4748-a828-16622a06d7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:05.512378 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2993/5961] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:05 2022] DELETE /identity/v3/projects/bfdc6e9035f64d3a8ae318133abf8ef6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:05.512516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21c6d-de57-4c0b-bb4d-3248a88b4c09 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:05.512950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21c6d-de57-4c0b-bb4d-3248a88b4c09 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:05.513041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21c6d-de57-4c0b-bb4d-3248a88b4c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:05.553323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-04a21c6d-de57-4c0b-bb4d-3248a88b4c09 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:05.555070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-04a21c6d-de57-4c0b-bb4d-3248a88b4c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:05.704403 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2969/5962] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:05.711516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195d22e-eeb1-4cfd-b31c-1404c64e4cac None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:05.711876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195d22e-eeb1-4cfd-b31c-1404c64e4cac None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:05.712139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195d22e-eeb1-4cfd-b31c-1404c64e4cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:05.805037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2195d22e-eeb1-4cfd-b31c-1404c64e4cac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:05.813835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2195d22e-eeb1-4cfd-b31c-1404c64e4cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:05.841954 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2994/5963] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:05.846002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a21c6d-de57-4c0b-bb4d-3248a88b4c09 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:05.857253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a21c6d-de57-4c0b-bb4d-3248a88b4c09 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:05.873290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:05.874137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:05.874419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:05.874705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:05.875622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:05.875911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:05.881003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:05.913848 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2970/5964] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:05.918164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195d22e-eeb1-4cfd-b31c-1404c64e4cac None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:05.937578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195d22e-eeb1-4cfd-b31c-1404c64e4cac None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:05.947265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b15c-e4c1-4151-be36-8108bdc1c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:05.948025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b15c-e4c1-4151-be36-8108bdc1c222 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:05.948317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b15c-e4c1-4151-be36-8108bdc1c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:05.948812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b15c-e4c1-4151-be36-8108bdc1c222 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:05.949327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139b15c-e4c1-4151-be36-8108bdc1c222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:05.952712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139b15c-e4c1-4151-be36-8108bdc1c222 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:06.021411 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2995/5965] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:05 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:06.025244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:06.039655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb349-a104-4cdf-8d3c-847ede25b25a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:06.181662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc3b1-e585-4690-b9c6-c3d284904b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:06.182676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc3b1-e585-4690-b9c6-c3d284904b1a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:06.182968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc3b1-e585-4690-b9c6-c3d284904b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:06.183295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc3b1-e585-4690-b9c6-c3d284904b1a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:06.184724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fc3b1-e585-4690-b9c6-c3d284904b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:06.188203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fc3b1-e585-4690-b9c6-c3d284904b1a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:06.257039 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2971/5966] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:06 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:06.261132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b15c-e4c1-4151-be36-8108bdc1c222 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:06.275701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b15c-e4c1-4151-be36-8108bdc1c222 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:06.289207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafed1aa-d466-44ae-aa41-8e8309d71d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:06.289904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafed1aa-d466-44ae-aa41-8e8309d71d27 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:06.291624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafed1aa-d466-44ae-aa41-8e8309d71d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:06.293731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafed1aa-d466-44ae-aa41-8e8309d71d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:06.296249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafed1aa-d466-44ae-aa41-8e8309d71d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:06.302169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafed1aa-d466-44ae-aa41-8e8309d71d27 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:06.336574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2996/5967] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:06.341854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc3b1-e585-4690-b9c6-c3d284904b1a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:06.356982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc3b1-e585-4690-b9c6-c3d284904b1a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:06.366602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1090eb-5749-4bd1-9041-c1beada94c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:06.367623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1090eb-5749-4bd1-9041-c1beada94c50 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:06.368061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1090eb-5749-4bd1-9041-c1beada94c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:06.368366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1090eb-5749-4bd1-9041-c1beada94c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:06.369290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1090eb-5749-4bd1-9041-c1beada94c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:06.371243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1090eb-5749-4bd1-9041-c1beada94c50 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:06.398615 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2972/5968] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:06.400404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafed1aa-d466-44ae-aa41-8e8309d71d27 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:06.416616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafed1aa-d466-44ae-aa41-8e8309d71d27 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:06.422516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fc892-0159-4add-a4af-4767e05ff446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:06.423641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc892-0159-4add-a4af-4767e05ff446 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:06.424230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc892-0159-4add-a4af-4767e05ff446 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:06.424721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc892-0159-4add-a4af-4767e05ff446 admin admin] PATH_INFO: `/v3/projects/cb29c2e34ac04b6e8d84379398c15e66/users/e78892f0edf64022998e5dcdd038ea53/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:06.466848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fc892-0159-4add-a4af-4767e05ff446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb29c2e34ac04b6e8d84379398c15e66, user_id=e78892f0edf64022998e5dcdd038ea53, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:06.479827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fc892-0159-4add-a4af-4767e05ff446 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:06.538483 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2997/5969] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:06 2022] PUT /identity/v3/projects/cb29c2e34ac04b6e8d84379398c15e66/users/e78892f0edf64022998e5dcdd038ea53/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:06.550119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344e1c-8ef3-4d53-a9b3-848ed95e6492 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:06.550614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344e1c-8ef3-4d53-a9b3-848ed95e6492 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:06.550898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344e1c-8ef3-4d53-a9b3-848ed95e6492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:06.611798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-51344e1c-8ef3-4d53-a9b3-848ed95e6492 None None] MFA Rules not processed for user `e78892f0edf64022998e5dcdd038ea53`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:06.613042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-51344e1c-8ef3-4d53-a9b3-848ed95e6492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:06.793222 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2973/5970] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:06.793422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fc892-0159-4add-a4af-4767e05ff446 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:06.937656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fc892-0159-4add-a4af-4767e05ff446 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:06.943791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e498-6814-4458-9a01-db5d4d8cbc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:06.944666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e498-6814-4458-9a01-db5d4d8cbc85 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:06.945025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e498-6814-4458-9a01-db5d4d8cbc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:06.945376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e498-6814-4458-9a01-db5d4d8cbc85 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:06.954154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8e498-6814-4458-9a01-db5d4d8cbc85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:06.962837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8e498-6814-4458-9a01-db5d4d8cbc85 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:07.009524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2998/5971] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:06 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:11:07.013377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344e1c-8ef3-4d53-a9b3-848ed95e6492 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:07.050907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344e1c-8ef3-4d53-a9b3-848ed95e6492 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:07.215832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abf490-dd87-4794-827d-739fe168b8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:07.216688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf490-dd87-4794-827d-739fe168b8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:07.217067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf490-dd87-4794-827d-739fe168b8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:07.217428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf490-dd87-4794-827d-739fe168b8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:07.218225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abf490-dd87-4794-827d-739fe168b8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:07.220303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abf490-dd87-4794-827d-739fe168b8e9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:07.274834 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2974/5972] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:07 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:07.275213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e498-6814-4458-9a01-db5d4d8cbc85 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:07.295512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e498-6814-4458-9a01-db5d4d8cbc85 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:07.324048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea1a0-ccee-4a07-a628-1fb11582ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:07.330453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea1a0-ccee-4a07-a628-1fb11582ccc8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:07.331065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea1a0-ccee-4a07-a628-1fb11582ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:07.332421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea1a0-ccee-4a07-a628-1fb11582ccc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:07.337214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ea1a0-ccee-4a07-a628-1fb11582ccc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:07.349538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ea1a0-ccee-4a07-a628-1fb11582ccc8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:07.430341 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 2999/5973] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:07.434056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abf490-dd87-4794-827d-739fe168b8e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:07.449825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abf490-dd87-4794-827d-739fe168b8e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:07.457855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7f7bd-beae-4ebe-86ec-ab8417975604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:07.459125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7f7bd-beae-4ebe-86ec-ab8417975604 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:07.459603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7f7bd-beae-4ebe-86ec-ab8417975604 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:07.461520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7f7bd-beae-4ebe-86ec-ab8417975604 admin admin] PATH_INFO: `/v3/projects/a44e599e0fb44e8680206731c305f686/users/0889fb0c9c7d4369bbcb49d7b1c73537/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:07.491069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7f7bd-beae-4ebe-86ec-ab8417975604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44e599e0fb44e8680206731c305f686, user_id=0889fb0c9c7d4369bbcb49d7b1c73537, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:07.503035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7f7bd-beae-4ebe-86ec-ab8417975604 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:07.560793 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2975/5974] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:07 2022] PUT /identity/v3/projects/a44e599e0fb44e8680206731c305f686/users/0889fb0c9c7d4369bbcb49d7b1c73537/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:07.564896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea1a0-ccee-4a07-a628-1fb11582ccc8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:07.579650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea1a0-ccee-4a07-a628-1fb11582ccc8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:07.750323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904eef7-836d-44d7-836c-20010036467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:07.751841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904eef7-836d-44d7-836c-20010036467a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:07.752534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904eef7-836d-44d7-836c-20010036467a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:07.752534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904eef7-836d-44d7-836c-20010036467a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:07.754340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904eef7-836d-44d7-836c-20010036467a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:07.756171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904eef7-836d-44d7-836c-20010036467a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:07.767677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3000/5975] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:07.771893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7f7bd-beae-4ebe-86ec-ab8417975604 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:07.783923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7f7bd-beae-4ebe-86ec-ab8417975604 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:07.793784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:07.794843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:07.795200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:07.795561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] PATH_INFO: `/v3/projects/a44e599e0fb44e8680206731c305f686/users/0889fb0c9c7d4369bbcb49d7b1c73537/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:07.797813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44e599e0fb44e8680206731c305f686, user_id=0889fb0c9c7d4369bbcb49d7b1c73537, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:07.801227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:07.826756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6051-e7c6-4073-be94-c9e6de90cc7f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:07.828422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6051-e7c6-4073-be94-c9e6de90cc7f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:07.828795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6051-e7c6-4073-be94-c9e6de90cc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:07.830107 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2976/5976] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:07 2022] PUT /identity/v3/projects/a44e599e0fb44e8680206731c305f686/users/0889fb0c9c7d4369bbcb49d7b1c73537/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:07.896548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-701f6051-e7c6-4073-be94-c9e6de90cc7f None None] MFA Rules not processed for user `0889fb0c9c7d4369bbcb49d7b1c73537`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:07.898033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-701f6051-e7c6-4073-be94-c9e6de90cc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:08.040318 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3001/5977] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:08.052145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:08.054351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:08.187395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2dc2-874a-4359-a3b4-2cd4f6356e21 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:08.194720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0738719-bac2-4ce9-a754-6932debd86de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:08.195605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738719-bac2-4ce9-a754-6932debd86de service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:08.196040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738719-bac2-4ce9-a754-6932debd86de service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:08.196577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738719-bac2-4ce9-a754-6932debd86de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:08.350097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738719-bac2-4ce9-a754-6932debd86de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:08.353314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738719-bac2-4ce9-a754-6932debd86de service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:08.372296 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2977/5978] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:08.993268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f6051-e7c6-4073-be94-c9e6de90cc7f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:09.007164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f6051-e7c6-4073-be94-c9e6de90cc7f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:09.015984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeea8c-ccbe-4bf7-b375-b450aae3e096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:09.016938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeea8c-ccbe-4bf7-b375-b450aae3e096 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:09.017367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeea8c-ccbe-4bf7-b375-b450aae3e096 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:09.017788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeea8c-ccbe-4bf7-b375-b450aae3e096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:09.035589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeea8c-ccbe-4bf7-b375-b450aae3e096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:09.037369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeea8c-ccbe-4bf7-b375-b450aae3e096 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:09.056417 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3002/5979] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:12.151419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbade29-c89d-47ee-af9a-42909ee45e0d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:12.152410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbade29-c89d-47ee-af9a-42909ee45e0d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:12.152915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbade29-c89d-47ee-af9a-42909ee45e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:12.193949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4dbade29-c89d-47ee-af9a-42909ee45e0d None None] MFA Rules not processed for user `b9e2bf42ef6446c69f1775a25ef76a92`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:12.195347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4dbade29-c89d-47ee-af9a-42909ee45e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:12.329723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2978/5980] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:14.161805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f31c9-bdbb-4b33-88d6-bdd1b34dba42 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:14.162286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f31c9-bdbb-4b33-88d6-bdd1b34dba42 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:14.162359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f31c9-bdbb-4b33-88d6-bdd1b34dba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:14.196172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fd3f31c9-bdbb-4b33-88d6-bdd1b34dba42 None None] MFA Rules not processed for user `7132cae4ebd549d491f5d0dcf83394ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:14.197728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fd3f31c9-bdbb-4b33-88d6-bdd1b34dba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:14.343129 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3003/5981] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:14.352166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbade29-c89d-47ee-af9a-42909ee45e0d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:14.354670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4dbade29-c89d-47ee-af9a-42909ee45e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:14.557355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbade29-c89d-47ee-af9a-42909ee45e0d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:14.574614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:14.575289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:14.575572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:14.575850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:14.581264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:14.605612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:14.607529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:14.623440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2979/5982] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:11:24.400081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f31c9-bdbb-4b33-88d6-bdd1b34dba42 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:24.402622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fd3f31c9-bdbb-4b33-88d6-bdd1b34dba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:24.441637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f31c9-bdbb-4b33-88d6-bdd1b34dba42 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:24.452366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c91927-436b-4509-8761-3897fd83451f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:24.455437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c91927-436b-4509-8761-3897fd83451f service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:24.456035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c91927-436b-4509-8761-3897fd83451f service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:24.456768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c91927-436b-4509-8761-3897fd83451f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:24.459501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-10c91927-436b-4509-8761-3897fd83451f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:24.478724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c91927-436b-4509-8761-3897fd83451f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:24.480978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c91927-436b-4509-8761-3897fd83451f service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:24.499865 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3004/5983] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:26.353906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:26.387879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e863a-5847-48b0-8db0-3f2c05c1f292 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:26.392597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040c4b-a9e4-4d62-84ef-990b89dbb16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:26.394434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040c4b-a9e4-4d62-84ef-990b89dbb16c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:26.399894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040c4b-a9e4-4d62-84ef-990b89dbb16c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:26.400857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040c4b-a9e4-4d62-84ef-990b89dbb16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:26.405387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-14040c4b-a9e4-4d62-84ef-990b89dbb16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:26.432120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14040c4b-a9e4-4d62-84ef-990b89dbb16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:26.434608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14040c4b-a9e4-4d62-84ef-990b89dbb16c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:26.453035 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2980/5984] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:27.441863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c91927-436b-4509-8761-3897fd83451f service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:27.610696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c91927-436b-4509-8761-3897fd83451f service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:27.622679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:27.625065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:27.625592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:27.626209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] PATH_INFO: `/v3/users/e78892f0edf64022998e5dcdd038ea53` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:27.627829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78892f0edf64022998e5dcdd038ea53)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:27.631552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:27.781206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78892f0edf64022998e5dcdd038ea53'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:27.823944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78892f0edf64022998e5dcdd038ea53'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:27.850941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78892f0edf64022998e5dcdd038ea53'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:27.851767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78892f0edf64022998e5dcdd038ea53'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:27.852653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78892f0edf64022998e5dcdd038ea53'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:27.873291 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3005/5985] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:27 2022] DELETE /identity/v3/users/e78892f0edf64022998e5dcdd038ea53 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:27.882254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5b75b-4204-49d8-a9f1-32aa3fd7fac6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:27.882254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5b75b-4204-49d8-a9f1-32aa3fd7fac6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:27.882254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5b75b-4204-49d8-a9f1-32aa3fd7fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:27.943656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0af5b75b-4204-49d8-a9f1-32aa3fd7fac6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:27.945178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0af5b75b-4204-49d8-a9f1-32aa3fd7fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:28.069822 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2981/5986] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:28.080514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:28.082713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:28.175219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3961b0d-ce18-4423-9948-652dc80689b4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:28.187007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28570c9c-dc44-4a20-a2d7-858b064616ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:28.187495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28570c9c-dc44-4a20-a2d7-858b064616ed service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:28.188376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28570c9c-dc44-4a20-a2d7-858b064616ed service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:28.188376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28570c9c-dc44-4a20-a2d7-858b064616ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:28.231964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28570c9c-dc44-4a20-a2d7-858b064616ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:28.233795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28570c9c-dc44-4a20-a2d7-858b064616ed service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:28.247098 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3006/5987] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:28.564676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5b75b-4204-49d8-a9f1-32aa3fd7fac6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:28.566715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0af5b75b-4204-49d8-a9f1-32aa3fd7fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:28.602056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5b75b-4204-49d8-a9f1-32aa3fd7fac6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:28.613957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:28.615118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:28.615572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:28.616013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] PATH_INFO: `/v3/projects/cb29c2e34ac04b6e8d84379398c15e66` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:28.617658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb29c2e34ac04b6e8d84379398c15e66)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:28.619781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:28.693509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb29c2e34ac04b6e8d84379398c15e66', 'request_id': 'req-42acb667-5f2a-4048-94c2-854ef1f4fa85'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.701083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb29c2e34ac04b6e8d84379398c15e66', 'request_id': 'req-42acb667-5f2a-4048-94c2-854ef1f4fa85'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.712501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb29c2e34ac04b6e8d84379398c15e66', 'request_id': 'req-42acb667-5f2a-4048-94c2-854ef1f4fa85'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.729441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] The token cache is being invalidate because project cb29c2e34ac04b6e8d84379398c15e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:28.729782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.730633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.732894 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2982/5988] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:28 2022] DELETE /identity/v3/projects/cb29c2e34ac04b6e8d84379398c15e66 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:28.742283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28570c9c-dc44-4a20-a2d7-858b064616ed service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:28.756692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28570c9c-dc44-4a20-a2d7-858b064616ed service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:28.834964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:28.836836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:28.838744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:28.839311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] PATH_INFO: `/v3/users/0889fb0c9c7d4369bbcb49d7b1c73537` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:28.841580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0889fb0c9c7d4369bbcb49d7b1c73537)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:28.844044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:28.921412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0889fb0c9c7d4369bbcb49d7b1c73537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.938943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0889fb0c9c7d4369bbcb49d7b1c73537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.956552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0889fb0c9c7d4369bbcb49d7b1c73537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.957287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0889fb0c9c7d4369bbcb49d7b1c73537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.959940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9845b848-f1e6-43e1-bf1a-c02cad510ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0889fb0c9c7d4369bbcb49d7b1c73537'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:28.990207 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3007/5989] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:28 2022] DELETE /identity/v3/users/0889fb0c9c7d4369bbcb49d7b1c73537 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:29.506471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:29.513301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:29.550090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb667-5f2a-4048-94c2-854ef1f4fa85 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:29.639916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:29.641115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:29.641473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:29.641758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] PATH_INFO: `/v3/projects/a44e599e0fb44e8680206731c305f686` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:29.648894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44e599e0fb44e8680206731c305f686)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:29.652253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:29.708353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44e599e0fb44e8680206731c305f686', 'request_id': 'req-d570966e-5706-41d0-87f2-64ebc7bced86'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:29.716832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44e599e0fb44e8680206731c305f686', 'request_id': 'req-d570966e-5706-41d0-87f2-64ebc7bced86'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:29.728695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44e599e0fb44e8680206731c305f686', 'request_id': 'req-d570966e-5706-41d0-87f2-64ebc7bced86'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:29.748111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] The token cache is being invalidate because project a44e599e0fb44e8680206731c305f686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:29.749318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:29.751307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d570966e-5706-41d0-87f2-64ebc7bced86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:29.751950 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2983/5990] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:29 2022] DELETE /identity/v3/projects/a44e599e0fb44e8680206731c305f686 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:29.758708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce353d-b28f-4e78-913b-2591184389db None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:29.759985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce353d-b28f-4e78-913b-2591184389db None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:29.760665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce353d-b28f-4e78-913b-2591184389db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:29.800696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-00ce353d-b28f-4e78-913b-2591184389db None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:29.803086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00ce353d-b28f-4e78-913b-2591184389db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:29.912650 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3008/5991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:29.921603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac9df8-2947-444d-a95c-65009a521c82 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:29.923051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac9df8-2947-444d-a95c-65009a521c82 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:29.923051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac9df8-2947-444d-a95c-65009a521c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:29.966201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-70ac9df8-2947-444d-a95c-65009a521c82 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:29.966201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-70ac9df8-2947-444d-a95c-65009a521c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:29.976427 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2984/5992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:29.981254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce353d-b28f-4e78-913b-2591184389db None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:29.994668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce353d-b28f-4e78-913b-2591184389db None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:30.011901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:30.013378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:30.013808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:30.014548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:30.014928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:30.015527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:30.017367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:30.069206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac9df8-2947-444d-a95c-65009a521c82 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:30.077637 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3009/5993] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:11:30.081357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac9df8-2947-444d-a95c-65009a521c82 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:30.095173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afd4fc-67c6-49f6-8b80-659920d4c917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:30.096113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afd4fc-67c6-49f6-8b80-659920d4c917 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:30.096432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afd4fc-67c6-49f6-8b80-659920d4c917 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:30.096747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afd4fc-67c6-49f6-8b80-659920d4c917 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:30.097469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afd4fc-67c6-49f6-8b80-659920d4c917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:30.100201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afd4fc-67c6-49f6-8b80-659920d4c917 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:30.167230 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2985/5994] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:30 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:30.174691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:30.194168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d095a-fcf0-4e40-bd7e-87a51749d23f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:30.311185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bbb60-111f-4931-9f94-734a20f73364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:30.311854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bbb60-111f-4931-9f94-734a20f73364 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:30.312151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bbb60-111f-4931-9f94-734a20f73364 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:30.312627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bbb60-111f-4931-9f94-734a20f73364 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:30.313976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bbb60-111f-4931-9f94-734a20f73364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:30.316743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bbb60-111f-4931-9f94-734a20f73364 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:30.353559 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3010/5995] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:30 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:30.359557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afd4fc-67c6-49f6-8b80-659920d4c917 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:30.405128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afd4fc-67c6-49f6-8b80-659920d4c917 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:30.421660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148039f-ddaa-4ce3-8279-5e1a67b13016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:30.429825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148039f-ddaa-4ce3-8279-5e1a67b13016 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:30.430329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148039f-ddaa-4ce3-8279-5e1a67b13016 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:30.430872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148039f-ddaa-4ce3-8279-5e1a67b13016 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:30.437046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148039f-ddaa-4ce3-8279-5e1a67b13016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:30.453467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148039f-ddaa-4ce3-8279-5e1a67b13016 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:30.477491 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2986/5996] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:30.479356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bbb60-111f-4931-9f94-734a20f73364 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:30.494776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bbb60-111f-4931-9f94-734a20f73364 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:30.513557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db12177-bb4a-41fd-ad2e-108b7a381615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:30.515803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db12177-bb4a-41fd-ad2e-108b7a381615 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:30.516479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db12177-bb4a-41fd-ad2e-108b7a381615 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:30.516941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db12177-bb4a-41fd-ad2e-108b7a381615 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:30.519130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db12177-bb4a-41fd-ad2e-108b7a381615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:30.521429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db12177-bb4a-41fd-ad2e-108b7a381615 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:30.541734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148039f-ddaa-4ce3-8279-5e1a67b13016 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:30.543608 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3011/5997] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:30.562155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148039f-ddaa-4ce3-8279-5e1a67b13016 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:30.581373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7aa00-a5fb-4607-af6c-152fed6c8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:30.582657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7aa00-a5fb-4607-af6c-152fed6c8d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:30.583060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7aa00-a5fb-4607-af6c-152fed6c8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:30.583441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7aa00-a5fb-4607-af6c-152fed6c8d09 admin admin] PATH_INFO: `/v3/projects/e080c070389f40c4924f778ff7ee385d/users/c037b4c027a244cebe4cf48ce7887320/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:30.613658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7aa00-a5fb-4607-af6c-152fed6c8d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e080c070389f40c4924f778ff7ee385d, user_id=c037b4c027a244cebe4cf48ce7887320, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:30.618971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7aa00-a5fb-4607-af6c-152fed6c8d09 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:30.643868 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2987/5998] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:30 2022] PUT /identity/v3/projects/e080c070389f40c4924f778ff7ee385d/users/c037b4c027a244cebe4cf48ce7887320/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:30.655724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be6c15-4a63-4759-8716-e505fe6bbea6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:30.656124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be6c15-4a63-4759-8716-e505fe6bbea6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:30.656652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be6c15-4a63-4759-8716-e505fe6bbea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:30.709363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-82be6c15-4a63-4759-8716-e505fe6bbea6 None None] MFA Rules not processed for user `c037b4c027a244cebe4cf48ce7887320`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:30.711629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-82be6c15-4a63-4759-8716-e505fe6bbea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:30.790955 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3012/5999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:30.795519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7aa00-a5fb-4607-af6c-152fed6c8d09 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:30.872219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7aa00-a5fb-4607-af6c-152fed6c8d09 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:30.877071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d954e-dd0e-484f-a88b-e585d6990afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:30.877760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d954e-dd0e-484f-a88b-e585d6990afa admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:30.878046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d954e-dd0e-484f-a88b-e585d6990afa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:30.878325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d954e-dd0e-484f-a88b-e585d6990afa admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:30.879011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d954e-dd0e-484f-a88b-e585d6990afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:30.881012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d954e-dd0e-484f-a88b-e585d6990afa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:30.913916 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2988/6000] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:30 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:30.915265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be6c15-4a63-4759-8716-e505fe6bbea6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:30.933738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be6c15-4a63-4759-8716-e505fe6bbea6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:31.016361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee95d-9751-40bb-a9bd-ae8599884d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:31.017186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee95d-9751-40bb-a9bd-ae8599884d1a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:31.017469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee95d-9751-40bb-a9bd-ae8599884d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:31.017785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee95d-9751-40bb-a9bd-ae8599884d1a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:31.019314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fee95d-9751-40bb-a9bd-ae8599884d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:31.021495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fee95d-9751-40bb-a9bd-ae8599884d1a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:31.048448 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3013/6001] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:30 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:31.052215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d954e-dd0e-484f-a88b-e585d6990afa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:31.065730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d954e-dd0e-484f-a88b-e585d6990afa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:31.073209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add307a-4c0f-4e51-a99f-bdc42b0bbf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:31.074476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add307a-4c0f-4e51-a99f-bdc42b0bbf92 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:31.074476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add307a-4c0f-4e51-a99f-bdc42b0bbf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:31.075149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add307a-4c0f-4e51-a99f-bdc42b0bbf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:31.075518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add307a-4c0f-4e51-a99f-bdc42b0bbf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:31.085670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add307a-4c0f-4e51-a99f-bdc42b0bbf92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:31.091492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2989/6002] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:31.095517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee95d-9751-40bb-a9bd-ae8599884d1a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:31.108679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee95d-9751-40bb-a9bd-ae8599884d1a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:31.114862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff7bd-70c9-4012-946e-a79976dd0f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:31.115794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff7bd-70c9-4012-946e-a79976dd0f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:31.115794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff7bd-70c9-4012-946e-a79976dd0f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:31.116060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff7bd-70c9-4012-946e-a79976dd0f62 admin admin] PATH_INFO: `/v3/projects/b237efdf868a4b02bcaa7a91461a0a56/users/325f6109edea4ff6ad533fd209e7f6b5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:31.140174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff7bd-70c9-4012-946e-a79976dd0f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b237efdf868a4b02bcaa7a91461a0a56, user_id=325f6109edea4ff6ad533fd209e7f6b5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:31.142911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff7bd-70c9-4012-946e-a79976dd0f62 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:31.158629 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3014/6003] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:31 2022] PUT /identity/v3/projects/b237efdf868a4b02bcaa7a91461a0a56/users/325f6109edea4ff6ad533fd209e7f6b5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:31.162542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add307a-4c0f-4e51-a99f-bdc42b0bbf92 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:31.172808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add307a-4c0f-4e51-a99f-bdc42b0bbf92 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:31.244241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f05e6-5bd4-426b-abfb-5c1c47be87c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:31.244241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f05e6-5bd4-426b-abfb-5c1c47be87c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:31.244823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f05e6-5bd4-426b-abfb-5c1c47be87c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:31.245012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f05e6-5bd4-426b-abfb-5c1c47be87c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:31.245848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f05e6-5bd4-426b-abfb-5c1c47be87c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:31.247473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f05e6-5bd4-426b-abfb-5c1c47be87c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:31.262929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2990/6004] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:31.264045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff7bd-70c9-4012-946e-a79976dd0f62 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:31.279403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff7bd-70c9-4012-946e-a79976dd0f62 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:31.284262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:31.285204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:31.285499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:31.285776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] PATH_INFO: `/v3/projects/b237efdf868a4b02bcaa7a91461a0a56/users/325f6109edea4ff6ad533fd209e7f6b5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:31.287940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b237efdf868a4b02bcaa7a91461a0a56, user_id=325f6109edea4ff6ad533fd209e7f6b5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:31.291720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:31.319159 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3015/6005] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:31 2022] PUT /identity/v3/projects/b237efdf868a4b02bcaa7a91461a0a56/users/325f6109edea4ff6ad533fd209e7f6b5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:11:31.330718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe49a3-eaba-4a0c-92ff-b82e0750157e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:31.331378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe49a3-eaba-4a0c-92ff-b82e0750157e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:31.331798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe49a3-eaba-4a0c-92ff-b82e0750157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:31.391150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-15fe49a3-eaba-4a0c-92ff-b82e0750157e None None] MFA Rules not processed for user `325f6109edea4ff6ad533fd209e7f6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:31.397829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-15fe49a3-eaba-4a0c-92ff-b82e0750157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:31.506284 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2991/6006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:31.518578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:31.524006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:31.668079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac9b92-755d-49ce-ae76-d0ed120a2769 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:31.672442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b4d0c-0535-4762-8075-646e47f72f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:31.673111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4d0c-0535-4762-8075-646e47f72f5e service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:31.673393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4d0c-0535-4762-8075-646e47f72f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:31.673752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4d0c-0535-4762-8075-646e47f72f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:31.689129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b4d0c-0535-4762-8075-646e47f72f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:31.690896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b4d0c-0535-4762-8075-646e47f72f5e service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:31.712868 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3016/6007] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:32.553727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe49a3-eaba-4a0c-92ff-b82e0750157e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:32.555320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-15fe49a3-eaba-4a0c-92ff-b82e0750157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:32.581647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe49a3-eaba-4a0c-92ff-b82e0750157e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:32.587118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:32.589235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:32.589642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:32.590240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:32.593537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:32.686589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:32.688238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:32.703498 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2992/6008] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:11:34.068940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b4d0c-0535-4762-8075-646e47f72f5e service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:34.079218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b4d0c-0535-4762-8075-646e47f72f5e service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:34.084541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08aebd-c665-437d-aa23-bee0ae3972a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:34.085141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08aebd-c665-437d-aa23-bee0ae3972a9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:34.085464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08aebd-c665-437d-aa23-bee0ae3972a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:34.085698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08aebd-c665-437d-aa23-bee0ae3972a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:34.160051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08aebd-c665-437d-aa23-bee0ae3972a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:34.161538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08aebd-c665-437d-aa23-bee0ae3972a9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:34.173599 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3017/6009] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:11:35.972482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:35.989223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70ac9b-8a1f-4dd7-b9b8-fb34520cfa4d service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:36.008388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:36.008388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:36.008388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:36.008388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] PATH_INFO: `/v3/users/c037b4c027a244cebe4cf48ce7887320` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:36.011591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c037b4c027a244cebe4cf48ce7887320)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:36.013750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:36.156699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c037b4c027a244cebe4cf48ce7887320'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:36.158236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c037b4c027a244cebe4cf48ce7887320'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:36.159920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c037b4c027a244cebe4cf48ce7887320'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:36.197829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c037b4c027a244cebe4cf48ce7887320'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:36.209866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c037b4c027a244cebe4cf48ce7887320'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:36.229118 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2993/6010] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:35 2022] DELETE /identity/v3/users/c037b4c027a244cebe4cf48ce7887320 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:36.235106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfadf72-b0d0-4933-b7b9-875d0a0430ff None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:36.237299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfadf72-b0d0-4933-b7b9-875d0a0430ff None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:36.238529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfadf72-b0d0-4933-b7b9-875d0a0430ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:36.263190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5dfadf72-b0d0-4933-b7b9-875d0a0430ff None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:36.265630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5dfadf72-b0d0-4933-b7b9-875d0a0430ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:36.532282 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3018/6011] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:36.534579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:36.538828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:36.706412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa1f37-05c3-4864-96f7-579c62cf4138 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:36.722118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259080a-b037-48df-b56f-f476fdedf9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:36.735770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259080a-b037-48df-b56f-f476fdedf9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:36.737010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259080a-b037-48df-b56f-f476fdedf9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:36.737943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259080a-b037-48df-b56f-f476fdedf9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:36.763417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259080a-b037-48df-b56f-f476fdedf9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:36.765232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259080a-b037-48df-b56f-f476fdedf9b1 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:36.808457 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2994/6012] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:37.413210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfadf72-b0d0-4933-b7b9-875d0a0430ff None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:37.416783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5dfadf72-b0d0-4933-b7b9-875d0a0430ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:37.429871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfadf72-b0d0-4933-b7b9-875d0a0430ff None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:37.457803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:37.458852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:37.459284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:37.459801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] PATH_INFO: `/v3/projects/e080c070389f40c4924f778ff7ee385d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:37.462274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e080c070389f40c4924f778ff7ee385d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:37.468574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:37.624079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e080c070389f40c4924f778ff7ee385d', 'request_id': 'req-6dd47052-6b87-4c00-b7e5-3bd8a2855826'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:37.642492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e080c070389f40c4924f778ff7ee385d', 'request_id': 'req-6dd47052-6b87-4c00-b7e5-3bd8a2855826'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:37.665708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e080c070389f40c4924f778ff7ee385d', 'request_id': 'req-6dd47052-6b87-4c00-b7e5-3bd8a2855826'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:37.696728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] The token cache is being invalidate because project e080c070389f40c4924f778ff7ee385d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:37.697494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:37.698650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:37.700617 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3019/6013] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:37 2022] DELETE /identity/v3/projects/e080c070389f40c4924f778ff7ee385d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:37.706566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259080a-b037-48df-b56f-f476fdedf9b1 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:37.720242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259080a-b037-48df-b56f-f476fdedf9b1 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:37.867393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:37.868798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:37.869371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:37.869910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] PATH_INFO: `/v3/users/325f6109edea4ff6ad533fd209e7f6b5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:37.871390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325f6109edea4ff6ad533fd209e7f6b5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:37.873859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:37.984432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325f6109edea4ff6ad533fd209e7f6b5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:37.986135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325f6109edea4ff6ad533fd209e7f6b5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:38.029049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325f6109edea4ff6ad533fd209e7f6b5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:38.084087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325f6109edea4ff6ad533fd209e7f6b5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:38.110837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-204fd46a-b863-4dd9-9abb-a784e7f07440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325f6109edea4ff6ad533fd209e7f6b5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:38.138124 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2995/6014] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:37 2022] DELETE /identity/v3/users/325f6109edea4ff6ad533fd209e7f6b5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:38.676355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:38.678741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:38.710658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd47052-6b87-4c00-b7e5-3bd8a2855826 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:38.915958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:38.921434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:38.921792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:38.922236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] PATH_INFO: `/v3/projects/b237efdf868a4b02bcaa7a91461a0a56` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:38.924022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b237efdf868a4b02bcaa7a91461a0a56)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:38.926522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:39.032062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b237efdf868a4b02bcaa7a91461a0a56', 'request_id': 'req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:39.035859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b237efdf868a4b02bcaa7a91461a0a56', 'request_id': 'req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:39.055832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b237efdf868a4b02bcaa7a91461a0a56', 'request_id': 'req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:39.074743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] The token cache is being invalidate because project b237efdf868a4b02bcaa7a91461a0a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:39.075094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:39.077049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b8549ac-0ce1-48bc-82f5-19c7cba81ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:39.084625 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3020/6015] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:38 2022] DELETE /identity/v3/projects/b237efdf868a4b02bcaa7a91461a0a56 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:39.086147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e3e6-af8f-4570-a7ea-7707d3ca86c9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:39.086630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e3e6-af8f-4570-a7ea-7707d3ca86c9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:39.086729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e3e6-af8f-4570-a7ea-7707d3ca86c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:39.149910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d9c3e3e6-af8f-4570-a7ea-7707d3ca86c9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:39.156455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d9c3e3e6-af8f-4570-a7ea-7707d3ca86c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:39.334864 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2996/6016] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:39.342629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36d56-a99b-44c6-a641-c82b4811d95c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:39.342956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36d56-a99b-44c6-a641-c82b4811d95c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:39.343271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36d56-a99b-44c6-a641-c82b4811d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:39.377134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-88d36d56-a99b-44c6-a641-c82b4811d95c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:39.380286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-88d36d56-a99b-44c6-a641-c82b4811d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:39.399209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3021/6017] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:39.405523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3e3e6-af8f-4570-a7ea-7707d3ca86c9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:39.419687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3e3e6-af8f-4570-a7ea-7707d3ca86c9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:39.435309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:39.436665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:39.436947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:39.437225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:39.438262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:39.438570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:39.441284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:39.492729 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2997/6018] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:39.498488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d36d56-a99b-44c6-a641-c82b4811d95c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:39.522035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d36d56-a99b-44c6-a641-c82b4811d95c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:39.545491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002819d-c64b-4167-8ca0-ed7f3eea6ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:39.546560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002819d-c64b-4167-8ca0-ed7f3eea6ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:39.547051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002819d-c64b-4167-8ca0-ed7f3eea6ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:39.547524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002819d-c64b-4167-8ca0-ed7f3eea6ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:39.548700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002819d-c64b-4167-8ca0-ed7f3eea6ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:39.553430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002819d-c64b-4167-8ca0-ed7f3eea6ba6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:39.619785 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3022/6019] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:39 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:39.624115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:39.644366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae60e41-e8f0-44a1-a0a6-d09bec36502c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:39.790181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cb1c9-1d9c-417d-a82f-7ea0d93b8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:39.790994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cb1c9-1d9c-417d-a82f-7ea0d93b8198 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:39.791386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cb1c9-1d9c-417d-a82f-7ea0d93b8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:39.791775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cb1c9-1d9c-417d-a82f-7ea0d93b8198 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:39.792643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cb1c9-1d9c-417d-a82f-7ea0d93b8198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:39.794913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9cb1c9-1d9c-417d-a82f-7ea0d93b8198 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:39.835937 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2998/6020] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:39 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:39.837813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002819d-c64b-4167-8ca0-ed7f3eea6ba6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:39.861132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002819d-c64b-4167-8ca0-ed7f3eea6ba6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:39.897394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13800d6-a45b-4a4f-b905-77ad454e68b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:39.899881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13800d6-a45b-4a4f-b905-77ad454e68b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:39.906686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13800d6-a45b-4a4f-b905-77ad454e68b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:39.906686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13800d6-a45b-4a4f-b905-77ad454e68b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:39.908736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13800d6-a45b-4a4f-b905-77ad454e68b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:39.915840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13800d6-a45b-4a4f-b905-77ad454e68b0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:39.968710 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3023/6021] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:39.974651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cb1c9-1d9c-417d-a82f-7ea0d93b8198 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:39.995686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cb1c9-1d9c-417d-a82f-7ea0d93b8198 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:40.007711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdadcd-65a0-401c-8047-f0edf57ae527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:40.008782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdadcd-65a0-401c-8047-f0edf57ae527 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:40.009430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdadcd-65a0-401c-8047-f0edf57ae527 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:40.009548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdadcd-65a0-401c-8047-f0edf57ae527 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:40.010525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdadcd-65a0-401c-8047-f0edf57ae527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:40.013724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdadcd-65a0-401c-8047-f0edf57ae527 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:40.062146 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 2999/6022] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:11:40.063045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13800d6-a45b-4a4f-b905-77ad454e68b0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:40.088256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13800d6-a45b-4a4f-b905-77ad454e68b0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:40.103522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6b477-9a7b-4bd6-a35e-51cf6158613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:40.104642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6b477-9a7b-4bd6-a35e-51cf6158613f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:40.105028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6b477-9a7b-4bd6-a35e-51cf6158613f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:40.105401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6b477-9a7b-4bd6-a35e-51cf6158613f admin admin] PATH_INFO: `/v3/projects/ff85d2cee41542398436748c9e050f7e/users/90dcb99a4a704f51ab29add456f4e629/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:40.167124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6b477-9a7b-4bd6-a35e-51cf6158613f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff85d2cee41542398436748c9e050f7e, user_id=90dcb99a4a704f51ab29add456f4e629, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:40.170779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6b477-9a7b-4bd6-a35e-51cf6158613f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:40.256909 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3024/6023] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:40 2022] PUT /identity/v3/projects/ff85d2cee41542398436748c9e050f7e/users/90dcb99a4a704f51ab29add456f4e629/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:11:40.329115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4d6e-f2eb-44e7-81e8-12b5be15cad3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:40.329737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4d6e-f2eb-44e7-81e8-12b5be15cad3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:40.329737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4d6e-f2eb-44e7-81e8-12b5be15cad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:40.393921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9ffa4d6e-f2eb-44e7-81e8-12b5be15cad3 None None] MFA Rules not processed for user `90dcb99a4a704f51ab29add456f4e629`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:40.394880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9ffa4d6e-f2eb-44e7-81e8-12b5be15cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:40.585938 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3000/6024] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:40.590769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6b477-9a7b-4bd6-a35e-51cf6158613f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:40.773057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6b477-9a7b-4bd6-a35e-51cf6158613f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:40.793232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436af91a-fb00-4e26-b23d-638ae63292dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:40.794025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436af91a-fb00-4e26-b23d-638ae63292dc admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:40.794426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436af91a-fb00-4e26-b23d-638ae63292dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:40.794576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436af91a-fb00-4e26-b23d-638ae63292dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:40.795353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436af91a-fb00-4e26-b23d-638ae63292dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:40.801184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436af91a-fb00-4e26-b23d-638ae63292dc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:40.864028 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3025/6025] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:40 2022] POST /identity/v3/projects => generated 391 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:40.867947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa4d6e-f2eb-44e7-81e8-12b5be15cad3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:40.888840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa4d6e-f2eb-44e7-81e8-12b5be15cad3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:41.015094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b7ba-e360-4260-9f03-b4970edfd0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:41.015614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b7ba-e360-4260-9f03-b4970edfd0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:41.016764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b7ba-e360-4260-9f03-b4970edfd0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:41.016764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b7ba-e360-4260-9f03-b4970edfd0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:41.018942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3b7ba-e360-4260-9f03-b4970edfd0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:41.022099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3b7ba-e360-4260-9f03-b4970edfd0e7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:41.071104 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3001/6026] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:40 2022] POST /identity/v3/users => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:11:41.075454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436af91a-fb00-4e26-b23d-638ae63292dc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:41.092115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436af91a-fb00-4e26-b23d-638ae63292dc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:41.103772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8900801-b431-4ce5-af57-f881c9f45fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:41.104892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900801-b431-4ce5-af57-f881c9f45fad admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:41.105406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900801-b431-4ce5-af57-f881c9f45fad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:41.105947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900801-b431-4ce5-af57-f881c9f45fad admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:41.106975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8900801-b431-4ce5-af57-f881c9f45fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:41.109906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8900801-b431-4ce5-af57-f881c9f45fad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:41.150426 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3026/6027] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:41.151987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b7ba-e360-4260-9f03-b4970edfd0e7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:41.177929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b7ba-e360-4260-9f03-b4970edfd0e7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:41.187516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87491-172a-48a0-9ee2-4986647c2fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:41.195578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87491-172a-48a0-9ee2-4986647c2fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:41.196102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87491-172a-48a0-9ee2-4986647c2fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:41.196669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87491-172a-48a0-9ee2-4986647c2fa3 admin admin] PATH_INFO: `/v3/projects/e91f805870b94517ad20df24bd980cd3/users/f6d92deff70d44e0a917b9e06bcf6d5b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:41.218793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b87491-172a-48a0-9ee2-4986647c2fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91f805870b94517ad20df24bd980cd3, user_id=f6d92deff70d44e0a917b9e06bcf6d5b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:41.225098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b87491-172a-48a0-9ee2-4986647c2fa3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:41.242100 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3002/6028] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:41 2022] PUT /identity/v3/projects/e91f805870b94517ad20df24bd980cd3/users/f6d92deff70d44e0a917b9e06bcf6d5b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:41.245984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8900801-b431-4ce5-af57-f881c9f45fad admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:41.259101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8900801-b431-4ce5-af57-f881c9f45fad admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:41.347477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37c4d-f7b1-4914-9e08-d80b004369dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:41.348189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37c4d-f7b1-4914-9e08-d80b004369dc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:41.348548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37c4d-f7b1-4914-9e08-d80b004369dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:41.348834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37c4d-f7b1-4914-9e08-d80b004369dc admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:41.349567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae37c4d-f7b1-4914-9e08-d80b004369dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:41.351388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae37c4d-f7b1-4914-9e08-d80b004369dc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:41.362452 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3027/6029] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:41.366633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87491-172a-48a0-9ee2-4986647c2fa3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:41.377846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87491-172a-48a0-9ee2-4986647c2fa3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:41.383657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:41.384971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:41.384971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:41.385314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] PATH_INFO: `/v3/projects/e91f805870b94517ad20df24bd980cd3/users/f6d92deff70d44e0a917b9e06bcf6d5b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:41.387450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91f805870b94517ad20df24bd980cd3, user_id=f6d92deff70d44e0a917b9e06bcf6d5b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:41.390210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:41.403369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3003/6030] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:41 2022] PUT /identity/v3/projects/e91f805870b94517ad20df24bd980cd3/users/f6d92deff70d44e0a917b9e06bcf6d5b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:41.415363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc3d64-6b45-4b43-8cb5-d7771b4deb0b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:41.415653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc3d64-6b45-4b43-8cb5-d7771b4deb0b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:41.415932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc3d64-6b45-4b43-8cb5-d7771b4deb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:41.463573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7fbc3d64-6b45-4b43-8cb5-d7771b4deb0b None None] MFA Rules not processed for user `f6d92deff70d44e0a917b9e06bcf6d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:41.464596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7fbc3d64-6b45-4b43-8cb5-d7771b4deb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:41.552310 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3028/6031] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:41.569013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:41.571059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:41.646247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd395a07-585b-4e79-a64e-2341282fd9ff admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:41.651135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7018fb-732d-40c0-90d6-c72a2018cf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:41.661307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7018fb-732d-40c0-90d6-c72a2018cf92 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:41.661890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7018fb-732d-40c0-90d6-c72a2018cf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:41.662790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7018fb-732d-40c0-90d6-c72a2018cf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:41.679186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7018fb-732d-40c0-90d6-c72a2018cf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:41.680723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7018fb-732d-40c0-90d6-c72a2018cf92 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:41.691809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3004/6032] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:42.762652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc3d64-6b45-4b43-8cb5-d7771b4deb0b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:42.764209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7fbc3d64-6b45-4b43-8cb5-d7771b4deb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:42.910569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc3d64-6b45-4b43-8cb5-d7771b4deb0b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:42.929382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:42.929635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:42.930034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:42.930413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] PATH_INFO: `/v3/users/a388edbf88ba4749b3abb2a42b750757` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:42.931953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a388edbf88ba4749b3abb2a42b750757)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:42.934723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:43.049335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a388edbf88ba4749b3abb2a42b750757'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:43.082945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a388edbf88ba4749b3abb2a42b750757'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:43.112827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a388edbf88ba4749b3abb2a42b750757'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:43.113692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a388edbf88ba4749b3abb2a42b750757'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:43.114518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d2f40db6-0fac-4ebf-ac48-b1e03b4fa21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a388edbf88ba4749b3abb2a42b750757'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:43.158563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3029/6033] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:42 2022] DELETE /identity/v3/users/a388edbf88ba4749b3abb2a42b750757 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:43.822705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7018fb-732d-40c0-90d6-c72a2018cf92 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:43.837464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7018fb-732d-40c0-90d6-c72a2018cf92 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:43.942484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:43.943980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:43.944634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:43.945049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] PATH_INFO: `/v3/projects/61ad9ca9c0944ba68443aaa71a10eb19` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:43.959613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ad9ca9c0944ba68443aaa71a10eb19)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:43.963969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:44.105165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ad9ca9c0944ba68443aaa71a10eb19', 'request_id': 'req-528780fa-043c-4595-8d3a-9a6e8e412365'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.129761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ad9ca9c0944ba68443aaa71a10eb19', 'request_id': 'req-528780fa-043c-4595-8d3a-9a6e8e412365'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.157745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ad9ca9c0944ba68443aaa71a10eb19', 'request_id': 'req-528780fa-043c-4595-8d3a-9a6e8e412365'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.179232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] The token cache is being invalidate because project 61ad9ca9c0944ba68443aaa71a10eb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:44.180874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.182902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.187689 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3005/6034] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:43 2022] DELETE /identity/v3/projects/61ad9ca9c0944ba68443aaa71a10eb19 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:44.193152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8cf1a-b655-4cad-8aa0-5e225e92709c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:44.194032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8cf1a-b655-4cad-8aa0-5e225e92709c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:44.194409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8cf1a-b655-4cad-8aa0-5e225e92709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:44.234570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b1f8cf1a-b655-4cad-8aa0-5e225e92709c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:44.236202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b1f8cf1a-b655-4cad-8aa0-5e225e92709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:44.379332 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3030/6035] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:44.387258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:44.390108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:44.397978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473355-6abd-4f0a-ada6-33fa5e34fa0f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:44.398451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473355-6abd-4f0a-ada6-33fa5e34fa0f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:44.398565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473355-6abd-4f0a-ada6-33fa5e34fa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:44.416479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528780fa-043c-4595-8d3a-9a6e8e412365 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:44.429665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:44.435001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-45473355-6abd-4f0a-ada6-33fa5e34fa0f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:44.435753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:44.436061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:44.436294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] PATH_INFO: `/v3/users/90dcb99a4a704f51ab29add456f4e629` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:44.438002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=90dcb99a4a704f51ab29add456f4e629)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:44.438549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-45473355-6abd-4f0a-ada6-33fa5e34fa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:44.440773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:44.461218 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3031/6036] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:44.462779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45473355-6abd-4f0a-ada6-33fa5e34fa0f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:44.475034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45473355-6abd-4f0a-ada6-33fa5e34fa0f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:44.484177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:44.486066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:44.486536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:44.487540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:44.488531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:44.489033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:44.490938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:44.520622 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3032/6037] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:44.527270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:44.549055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00146-71ae-4522-9d0d-bdd6e2817764 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:44.561518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:44.561518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:44.561518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:44.561518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:44.568288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:44.570884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:44.594101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90dcb99a4a704f51ab29add456f4e629'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.594814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90dcb99a4a704f51ab29add456f4e629'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.595786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90dcb99a4a704f51ab29add456f4e629'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.629022 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3033/6038] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:44 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:44.635339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:44.635617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90dcb99a4a704f51ab29add456f4e629'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.642942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:44.656465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d99659a0-3d07-4641-9d49-7849f72c88ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90dcb99a4a704f51ab29add456f4e629'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:44.692005 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3006/6039] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:44 2022] DELETE /identity/v3/users/90dcb99a4a704f51ab29add456f4e629 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:11:44.701613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826e386-0511-4395-9d59-b5b47106acf7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:44.702277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826e386-0511-4395-9d59-b5b47106acf7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:44.702766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826e386-0511-4395-9d59-b5b47106acf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:44.748829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2826e386-0511-4395-9d59-b5b47106acf7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:44.750440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2826e386-0511-4395-9d59-b5b47106acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:44.795021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50ce73-7990-4b42-b3fd-1600e18a5e1a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:44.926980 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3007/6040] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:44.941444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826e386-0511-4395-9d59-b5b47106acf7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:44.947598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2826e386-0511-4395-9d59-b5b47106acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:44.957987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd7e7-8e84-44cf-bd7d-af48c35525ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:44.959602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd7e7-8e84-44cf-bd7d-af48c35525ee admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:44.960287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd7e7-8e84-44cf-bd7d-af48c35525ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:44.961054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd7e7-8e84-44cf-bd7d-af48c35525ee admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:44.962924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dd7e7-8e84-44cf-bd7d-af48c35525ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:44.978017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dd7e7-8e84-44cf-bd7d-af48c35525ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:45.040053 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3034/6041] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:44 2022] POST /identity/v3/users => generated 287 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:45.045095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd7e7-8e84-44cf-bd7d-af48c35525ee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:45.066047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd7e7-8e84-44cf-bd7d-af48c35525ee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:45.087347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219fe5b-2956-4dd7-a67f-bb9ed783dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:45.091559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219fe5b-2956-4dd7-a67f-bb9ed783dd68 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:45.092278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219fe5b-2956-4dd7-a67f-bb9ed783dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:45.105485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219fe5b-2956-4dd7-a67f-bb9ed783dd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:45.106341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219fe5b-2956-4dd7-a67f-bb9ed783dd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:45.108033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219fe5b-2956-4dd7-a67f-bb9ed783dd68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:45.146556 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3035/6042] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:45.154642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219fe5b-2956-4dd7-a67f-bb9ed783dd68 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:45.175924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219fe5b-2956-4dd7-a67f-bb9ed783dd68 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:45.186842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea7869-5a3e-4db0-a75b-79261362b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:45.187877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7869-5a3e-4db0-a75b-79261362b6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:45.187877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7869-5a3e-4db0-a75b-79261362b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:45.188157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7869-5a3e-4db0-a75b-79261362b6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:45.189066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea7869-5a3e-4db0-a75b-79261362b6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:45.191619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea7869-5a3e-4db0-a75b-79261362b6d4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:45.192740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826e386-0511-4395-9d59-b5b47106acf7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:45.212452 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3036/6043] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:45.213021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42571f-3ce3-496e-a1e6-cd6fe6a3e3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:45.213021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42571f-3ce3-496e-a1e6-cd6fe6a3e3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:45.213021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42571f-3ce3-496e-a1e6-cd6fe6a3e3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:45.213021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42571f-3ce3-496e-a1e6-cd6fe6a3e3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:45.218288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea7869-5a3e-4db0-a75b-79261362b6d4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:45.249306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea7869-5a3e-4db0-a75b-79261362b6d4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:45.253695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42571f-3ce3-496e-a1e6-cd6fe6a3e3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:45.261862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42571f-3ce3-496e-a1e6-cd6fe6a3e3a1 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:45.267731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:45.270869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:45.271294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:45.271890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] PATH_INFO: `/v3/projects/afea26862aa14ee295839accbd0eb214/users/ce0a2626431d46a893675223ae24885a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:45.308554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3008/6044] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:45.351626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afea26862aa14ee295839accbd0eb214, user_id=ce0a2626431d46a893675223ae24885a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:45.355369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:45.412680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3037/6045] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:45 2022] PUT /identity/v3/projects/afea26862aa14ee295839accbd0eb214/users/ce0a2626431d46a893675223ae24885a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:45.424303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f416a7e-84eb-4971-b1ca-c90ede31155b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:45.425405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f416a7e-84eb-4971-b1ca-c90ede31155b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:45.427029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f416a7e-84eb-4971-b1ca-c90ede31155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:45.502080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4f416a7e-84eb-4971-b1ca-c90ede31155b None None] MFA Rules not processed for user `ce0a2626431d46a893675223ae24885a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:45.503706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4f416a7e-84eb-4971-b1ca-c90ede31155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:45.636703 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3009/6046] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:45.649456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:45.652123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:45.749674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f416a7e-84eb-4971-b1ca-c90ede31155b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:45.751188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4f416a7e-84eb-4971-b1ca-c90ede31155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:45.803511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a7cec-d092-4865-b98d-8946e78075d7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:45.810425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238adb-cba0-45f1-bea2-8404d3c78477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:45.811360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238adb-cba0-45f1-bea2-8404d3c78477 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:45.811742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238adb-cba0-45f1-bea2-8404d3c78477 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:45.812137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238adb-cba0-45f1-bea2-8404d3c78477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:45.823457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c238adb-cba0-45f1-bea2-8404d3c78477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:45.825461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c238adb-cba0-45f1-bea2-8404d3c78477 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:45.840312 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3038/6047] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:45.870342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f416a7e-84eb-4971-b1ca-c90ede31155b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:45.876093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:45.877269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:45.878369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:45.878908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] PATH_INFO: `/v3/projects/ff85d2cee41542398436748c9e050f7e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:45.881293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff85d2cee41542398436748c9e050f7e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:45.884529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:45.958141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff85d2cee41542398436748c9e050f7e', 'request_id': 'req-ade6d24a-6170-4292-bcb8-77013c49eb05'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:45.970016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff85d2cee41542398436748c9e050f7e', 'request_id': 'req-ade6d24a-6170-4292-bcb8-77013c49eb05'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:45.990071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff85d2cee41542398436748c9e050f7e', 'request_id': 'req-ade6d24a-6170-4292-bcb8-77013c49eb05'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.012663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] The token cache is being invalidate because project ff85d2cee41542398436748c9e050f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:46.013693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.014606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.020619 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3010/6048] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:45 2022] DELETE /identity/v3/projects/ff85d2cee41542398436748c9e050f7e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:11:46.027656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238adb-cba0-45f1-bea2-8404d3c78477 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:46.042332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238adb-cba0-45f1-bea2-8404d3c78477 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:46.149473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:46.150863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:46.150863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:46.150863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] PATH_INFO: `/v3/users/f6d92deff70d44e0a917b9e06bcf6d5b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:46.152193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d92deff70d44e0a917b9e06bcf6d5b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:46.154169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:46.256891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d92deff70d44e0a917b9e06bcf6d5b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.275227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d92deff70d44e0a917b9e06bcf6d5b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.285896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d92deff70d44e0a917b9e06bcf6d5b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.286738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d92deff70d44e0a917b9e06bcf6d5b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.287818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-57063c98-c6c9-4b18-a740-b9ee12ef79d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d92deff70d44e0a917b9e06bcf6d5b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.307897 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3039/6049] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:46 2022] DELETE /identity/v3/users/f6d92deff70d44e0a917b9e06bcf6d5b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:46.740020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:46.742120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:46.787659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6d24a-6170-4292-bcb8-77013c49eb05 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:46.891668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:46.893045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:46.894946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:46.896224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] PATH_INFO: `/v3/projects/e91f805870b94517ad20df24bd980cd3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:46.898222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91f805870b94517ad20df24bd980cd3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:46.900479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:46.972254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91f805870b94517ad20df24bd980cd3', 'request_id': 'req-6a412aac-85f0-4fc3-93fe-e1997c3f3109'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.980549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91f805870b94517ad20df24bd980cd3', 'request_id': 'req-6a412aac-85f0-4fc3-93fe-e1997c3f3109'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:46.992432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91f805870b94517ad20df24bd980cd3', 'request_id': 'req-6a412aac-85f0-4fc3-93fe-e1997c3f3109'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:47.016630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] The token cache is being invalidate because project e91f805870b94517ad20df24bd980cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:47.017143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:47.017887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6a412aac-85f0-4fc3-93fe-e1997c3f3109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:47.020106 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3011/6050] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:46 2022] DELETE /identity/v3/projects/e91f805870b94517ad20df24bd980cd3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:47.025175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aff102-e854-42bd-bf95-46ca0e7b4b7a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.025581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aff102-e854-42bd-bf95-46ca0e7b4b7a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.025866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aff102-e854-42bd-bf95-46ca0e7b4b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.048320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c8aff102-e854-42bd-bf95-46ca0e7b4b7a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:47.050621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c8aff102-e854-42bd-bf95-46ca0e7b4b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:47.122657 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3040/6051] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:47.131585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf25c-284e-490e-91d5-98ebc4695b91 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.131868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf25c-284e-490e-91d5-98ebc4695b91 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.132146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf25c-284e-490e-91d5-98ebc4695b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.155958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c5ccf25c-284e-490e-91d5-98ebc4695b91 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:47.157210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c5ccf25c-284e-490e-91d5-98ebc4695b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:47.165529 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3012/6052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:47.169863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aff102-e854-42bd-bf95-46ca0e7b4b7a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:47.180928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aff102-e854-42bd-bf95-46ca0e7b4b7a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:47.186093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:47.186869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.187227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.187570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.188402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:47.188790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:47.191090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:47.207157 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3041/6053] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:47.208979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccf25c-284e-490e-91d5-98ebc4695b91 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:47.218773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccf25c-284e-490e-91d5-98ebc4695b91 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:47.224015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42460af-8955-488d-9c06-3625cceba0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:47.224698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42460af-8955-488d-9c06-3625cceba0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.224980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42460af-8955-488d-9c06-3625cceba0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.225256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42460af-8955-488d-9c06-3625cceba0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.225953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42460af-8955-488d-9c06-3625cceba0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:47.227857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42460af-8955-488d-9c06-3625cceba0a2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:47.257923 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3013/6054] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:47 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:47.259145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:47.270298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93344a66-fc33-44d6-8915-1f50eeb5fef7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:47.330111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57db78b-b5eb-4110-b438-4d65b47875e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:47.331430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57db78b-b5eb-4110-b438-4d65b47875e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.331785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57db78b-b5eb-4110-b438-4d65b47875e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.332236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57db78b-b5eb-4110-b438-4d65b47875e5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.333313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57db78b-b5eb-4110-b438-4d65b47875e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:47.335258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57db78b-b5eb-4110-b438-4d65b47875e5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:47.364821 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3042/6055] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:47 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:47.366185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42460af-8955-488d-9c06-3625cceba0a2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:47.376772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42460af-8955-488d-9c06-3625cceba0a2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:47.382341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cd612-d460-480d-a7ae-d5b23195c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:47.383015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd612-d460-480d-a7ae-d5b23195c846 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.383304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd612-d460-480d-a7ae-d5b23195c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.383583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd612-d460-480d-a7ae-d5b23195c846 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.384309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cd612-d460-480d-a7ae-d5b23195c846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:47.385963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cd612-d460-480d-a7ae-d5b23195c846 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:47.397546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3014/6056] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:47.401881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57db78b-b5eb-4110-b438-4d65b47875e5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:47.413874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57db78b-b5eb-4110-b438-4d65b47875e5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:47.419305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ec255-6c99-4493-8123-b8243f0f5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:47.420000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec255-6c99-4493-8123-b8243f0f5287 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.420283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec255-6c99-4493-8123-b8243f0f5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.420805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec255-6c99-4493-8123-b8243f0f5287 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.421334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ec255-6c99-4493-8123-b8243f0f5287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:47.423116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ec255-6c99-4493-8123-b8243f0f5287 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:47.435893 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3043/6057] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:47.440591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cd612-d460-480d-a7ae-d5b23195c846 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:47.452958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cd612-d460-480d-a7ae-d5b23195c846 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:47.459747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:47.464376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.464376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.464376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] PATH_INFO: `/v3/projects/45f9519d2430470fbbe9b0e0d532f3fd/users/0478cb2d255a48ffaf9b68617db659b3/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.479782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f9519d2430470fbbe9b0e0d532f3fd, user_id=0478cb2d255a48ffaf9b68617db659b3, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:47.482554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:47.501881 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3015/6058] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:47 2022] PUT /identity/v3/projects/45f9519d2430470fbbe9b0e0d532f3fd/users/0478cb2d255a48ffaf9b68617db659b3/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:47.513582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4b44-8ad0-484f-a434-a7a3f68a13f7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.513951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4b44-8ad0-484f-a434-a7a3f68a13f7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.514162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4b44-8ad0-484f-a434-a7a3f68a13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.544815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f62d4b44-8ad0-484f-a434-a7a3f68a13f7 None None] MFA Rules not processed for user `0478cb2d255a48ffaf9b68617db659b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:47.546205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f62d4b44-8ad0-484f-a434-a7a3f68a13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:47.622005 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3044/6059] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:47.633198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:47.635646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:47.701385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb75d-0d42-444f-bae4-0b3b05374690 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:47.704759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f3bb-c60e-4ab7-9ddc-da0762de690a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:47.705267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f3bb-c60e-4ab7-9ddc-da0762de690a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:47.705586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f3bb-c60e-4ab7-9ddc-da0762de690a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:47.705862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f3bb-c60e-4ab7-9ddc-da0762de690a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:47.716506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3f3bb-c60e-4ab7-9ddc-da0762de690a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:47.718203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3f3bb-c60e-4ab7-9ddc-da0762de690a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:47.732257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3016/6060] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:49.989119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d4b44-8ad0-484f-a434-a7a3f68a13f7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:49.991027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f62d4b44-8ad0-484f-a434-a7a3f68a13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:50.195105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d4b44-8ad0-484f-a434-a7a3f68a13f7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:50.213632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:50.214629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:50.214980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:50.215325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] PATH_INFO: `/v3/users/52c7a837477849768d5a90636fddf7b4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:50.216917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c7a837477849768d5a90636fddf7b4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:50.219163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:50.297257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c7a837477849768d5a90636fddf7b4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.314248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c7a837477849768d5a90636fddf7b4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.332112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c7a837477849768d5a90636fddf7b4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.333203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c7a837477849768d5a90636fddf7b4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.334302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c7a837477849768d5a90636fddf7b4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.355051 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3045/6061] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:49 2022] DELETE /identity/v3/users/52c7a837477849768d5a90636fddf7b4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:50.356462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddccb6c-f32a-4253-9c99-0c314d1543b3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:50.357302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddccb6c-f32a-4253-9c99-0c314d1543b3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:50.357767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddccb6c-f32a-4253-9c99-0c314d1543b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:50.366246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:50.368069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:50.395216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6ddccb6c-f32a-4253-9c99-0c314d1543b3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:50.396566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6ddccb6c-f32a-4253-9c99-0c314d1543b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:50.583563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95901e-94b0-43c1-aa55-31d4c535660b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:50.598923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:50.600645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:50.602252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:50.602792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] PATH_INFO: `/v3/users/ce0a2626431d46a893675223ae24885a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:50.605118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0a2626431d46a893675223ae24885a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:50.608556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:50.622954 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3017/6062] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:50.638461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddccb6c-f32a-4253-9c99-0c314d1543b3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:50.641295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6ddccb6c-f32a-4253-9c99-0c314d1543b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:50.776701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0a2626431d46a893675223ae24885a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.798624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0a2626431d46a893675223ae24885a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.799860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddccb6c-f32a-4253-9c99-0c314d1543b3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:50.804511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee7f81-70cc-460a-acef-4ec43fea1a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:50.806234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7f81-70cc-460a-acef-4ec43fea1a0f service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:50.806234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7f81-70cc-460a-acef-4ec43fea1a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:50.806572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7f81-70cc-460a-acef-4ec43fea1a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:50.823045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee7f81-70cc-460a-acef-4ec43fea1a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:50.825241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee7f81-70cc-460a-acef-4ec43fea1a0f service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:50.833868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0a2626431d46a893675223ae24885a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.834649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0a2626431d46a893675223ae24885a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.839754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0a2626431d46a893675223ae24885a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:50.878686 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3018/6063] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:50.891124 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3046/6064] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:50 2022] DELETE /identity/v3/users/ce0a2626431d46a893675223ae24885a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:50.896389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603c2c7-addd-4219-8951-9fab3a947b63 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:50.896808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603c2c7-addd-4219-8951-9fab3a947b63 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:50.897055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603c2c7-addd-4219-8951-9fab3a947b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:50.953877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4603c2c7-addd-4219-8951-9fab3a947b63 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:50.962266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4603c2c7-addd-4219-8951-9fab3a947b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:51.128429 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3019/6065] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:51.142456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:51.145755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:51.246160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52308-435d-479c-aaa2-3b1702d9826b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:51.251554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3e826-1a8c-4161-9b3f-7032304e1d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:51.253807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e826-1a8c-4161-9b3f-7032304e1d12 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:51.254096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e826-1a8c-4161-9b3f-7032304e1d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:51.254668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3e826-1a8c-4161-9b3f-7032304e1d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:51.269207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3e826-1a8c-4161-9b3f-7032304e1d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:51.270683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3e826-1a8c-4161-9b3f-7032304e1d12 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:51.288538 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3047/6066] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:51.513170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603c2c7-addd-4219-8951-9fab3a947b63 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:51.514741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4603c2c7-addd-4219-8951-9fab3a947b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:51.540973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603c2c7-addd-4219-8951-9fab3a947b63 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:51.553116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:51.554777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:51.555288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:51.556925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] PATH_INFO: `/v3/projects/463a97fa588d4fc2bb01401ca0fcb8aa` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:51.559487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] RBAC: Authorizing `identity:delete_project(project_id=463a97fa588d4fc2bb01401ca0fcb8aa)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:51.562296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:51.652928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463a97fa588d4fc2bb01401ca0fcb8aa', 'request_id': 'req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:51.660402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463a97fa588d4fc2bb01401ca0fcb8aa', 'request_id': 'req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:51.676067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463a97fa588d4fc2bb01401ca0fcb8aa', 'request_id': 'req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:51.691979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] The token cache is being invalidate because project 463a97fa588d4fc2bb01401ca0fcb8aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:51.692380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:51.693328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:51.699394 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3020/6067] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:51 2022] DELETE /identity/v3/projects/463a97fa588d4fc2bb01401ca0fcb8aa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:51.700938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54343-2f89-4db2-b7b2-6bae0895654c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:51.701233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54343-2f89-4db2-b7b2-6bae0895654c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:51.701512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54343-2f89-4db2-b7b2-6bae0895654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:51.743391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-27f54343-2f89-4db2-b7b2-6bae0895654c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:51.747152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-27f54343-2f89-4db2-b7b2-6bae0895654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:51.772470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:51.776500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:51.957030 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3048/6068] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:51.962921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e33788-38e0-4370-b445-8cad78ead0af None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:51.963318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e33788-38e0-4370-b445-8cad78ead0af None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:51.963696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e33788-38e0-4370-b445-8cad78ead0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:51.966125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f5d9-6e0c-48b5-acd8-2356e5b2152b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:51.980939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:51.981952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:51.982380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:51.982720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] PATH_INFO: `/v3/projects/afea26862aa14ee295839accbd0eb214` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:51.985095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afea26862aa14ee295839accbd0eb214)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:51.988601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.001849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-05e33788-38e0-4370-b445-8cad78ead0af None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:52.005297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-05e33788-38e0-4370-b445-8cad78ead0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:52.025440 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3049/6069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:52.029800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e33788-38e0-4370-b445-8cad78ead0af None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.047482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e33788-38e0-4370-b445-8cad78ead0af None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:52.055518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:52.057381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.057381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.057381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.058029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:52.058435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:52.064081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.095517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afea26862aa14ee295839accbd0eb214', 'request_id': 'req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:52.095717 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3050/6070] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:52.097201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.104692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afea26862aa14ee295839accbd0eb214', 'request_id': 'req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:52.119120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afea26862aa14ee295839accbd0eb214', 'request_id': 'req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:52.123136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2ae6-4897-4b05-b730-1cd587371337 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:52.174137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] The token cache is being invalidate because project afea26862aa14ee295839accbd0eb214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:52.176124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:52.183399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-36c39cb5-2c5c-4b9e-a1b2-2a76be49d0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:52.191466 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3021/6071] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:51 2022] DELETE /identity/v3/projects/afea26862aa14ee295839accbd0eb214 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:52.197988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77aec6-c4ea-4ee9-b2b8-ef80178157e5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.207488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77aec6-c4ea-4ee9-b2b8-ef80178157e5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.210230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77aec6-c4ea-4ee9-b2b8-ef80178157e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.267512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fa77aec6-c4ea-4ee9-b2b8-ef80178157e5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:52.269875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa77aec6-c4ea-4ee9-b2b8-ef80178157e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:52.343394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:52.344301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.345036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.345201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.346932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:52.352884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.411165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3051/6072] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:52 2022] POST /identity/v3/projects => generated 371 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:52.415782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.422664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:52.433841 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3022/6073] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:52.445978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7885d9-ae70-4620-8aa2-7c56f2824308 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.446436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7885d9-ae70-4620-8aa2-7c56f2824308 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.447442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7885d9-ae70-4620-8aa2-7c56f2824308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.491048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0e7885d9-ae70-4620-8aa2-7c56f2824308 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:52.494021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0e7885d9-ae70-4620-8aa2-7c56f2824308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:52.537729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d42d2-5af8-44a0-a50a-73e97b0135fd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:52.551411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d027-a50c-4f9a-8a0e-017d28c39d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:52.552216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d027-a50c-4f9a-8a0e-017d28c39d19 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.552610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d027-a50c-4f9a-8a0e-017d28c39d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.552956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d027-a50c-4f9a-8a0e-017d28c39d19 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.553882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6d027-a50c-4f9a-8a0e-017d28c39d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:52.566949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6d027-a50c-4f9a-8a0e-017d28c39d19 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.603539 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3052/6074] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:52 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:52.610134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d027-a50c-4f9a-8a0e-017d28c39d19 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.632209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d027-a50c-4f9a-8a0e-017d28c39d19 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:52.656518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe256a-4270-4850-972c-6d906cbe7d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:52.657157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe256a-4270-4850-972c-6d906cbe7d38 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.657501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe256a-4270-4850-972c-6d906cbe7d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.657936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe256a-4270-4850-972c-6d906cbe7d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.660105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe256a-4270-4850-972c-6d906cbe7d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:52.661792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe256a-4270-4850-972c-6d906cbe7d38 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.665957 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3023/6075] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:52.670572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7885d9-ae70-4620-8aa2-7c56f2824308 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.683445 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3053/6076] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:52.684496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe256a-4270-4850-972c-6d906cbe7d38 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.694230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7885d9-ae70-4620-8aa2-7c56f2824308 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:52.698215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe256a-4270-4850-972c-6d906cbe7d38 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:52.711385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d24f40-07b0-44ff-8820-1b8e03a3cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:52.712644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24f40-07b0-44ff-8820-1b8e03a3cb97 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.713027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24f40-07b0-44ff-8820-1b8e03a3cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.713317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24f40-07b0-44ff-8820-1b8e03a3cb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.720110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:52.721828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.721828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.721828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.722149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:52.722519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:52.724225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.728515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d24f40-07b0-44ff-8820-1b8e03a3cb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:52.735771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d24f40-07b0-44ff-8820-1b8e03a3cb97 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.749802 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3024/6077] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:52.755107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.760668 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3054/6078] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:52.763008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d24f40-07b0-44ff-8820-1b8e03a3cb97 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.775855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d6309-f351-4bf6-af93-bd7706421b57 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:52.776596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d24f40-07b0-44ff-8820-1b8e03a3cb97 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:52.782424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc43df-c6b1-4b05-9ca7-d22bfa7b5eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:52.783345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc43df-c6b1-4b05-9ca7-d22bfa7b5eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.784799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc43df-c6b1-4b05-9ca7-d22bfa7b5eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.787573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc43df-c6b1-4b05-9ca7-d22bfa7b5eb9 admin admin] PATH_INFO: `/v3/projects/da6216f26c814fceaa94fc64e78c8efc/users/9f1e1cafad4f475dad7bc93b50312279/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.794098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34516b-4ede-4b4e-a3a3-c7f28c990b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:52.794784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34516b-4ede-4b4e-a3a3-c7f28c990b11 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.795082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34516b-4ede-4b4e-a3a3-c7f28c990b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.795453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34516b-4ede-4b4e-a3a3-c7f28c990b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.796036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34516b-4ede-4b4e-a3a3-c7f28c990b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:52.798011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34516b-4ede-4b4e-a3a3-c7f28c990b11 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.817225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc43df-c6b1-4b05-9ca7-d22bfa7b5eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6216f26c814fceaa94fc64e78c8efc, user_id=9f1e1cafad4f475dad7bc93b50312279, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:52.821968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc43df-c6b1-4b05-9ca7-d22bfa7b5eb9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:52.844016 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3025/6079] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:52 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:52.849799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34516b-4ede-4b4e-a3a3-c7f28c990b11 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:52.850995 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3055/6080] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:52 2022] PUT /identity/v3/projects/da6216f26c814fceaa94fc64e78c8efc/users/9f1e1cafad4f475dad7bc93b50312279/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:52.857648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376a13-88e0-42ad-ba50-8208cf54be4e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:52.857967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376a13-88e0-42ad-ba50-8208cf54be4e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:52.858252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376a13-88e0-42ad-ba50-8208cf54be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:52.881541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d4376a13-88e0-42ad-ba50-8208cf54be4e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:52.885299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4376a13-88e0-42ad-ba50-8208cf54be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:52.986313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34516b-4ede-4b4e-a3a3-c7f28c990b11 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:53.042952 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3056/6081] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:53.061441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4376a13-88e0-42ad-ba50-8208cf54be4e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:53.064306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4376a13-88e0-42ad-ba50-8208cf54be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:53.072167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f3e1f-6b3a-4cb1-aac2-bec9f96bb8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:53.073253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3e1f-6b3a-4cb1-aac2-bec9f96bb8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:53.073722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3e1f-6b3a-4cb1-aac2-bec9f96bb8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:53.074144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3e1f-6b3a-4cb1-aac2-bec9f96bb8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:53.075037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f3e1f-6b3a-4cb1-aac2-bec9f96bb8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:53.077500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f3e1f-6b3a-4cb1-aac2-bec9f96bb8b5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:53.107607 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3026/6082] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:52 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:53.116466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f3e1f-6b3a-4cb1-aac2-bec9f96bb8b5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:53.139875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f3e1f-6b3a-4cb1-aac2-bec9f96bb8b5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:53.148192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86db38-00e4-4ef5-a8d5-d7484c904fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:53.149186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86db38-00e4-4ef5-a8d5-d7484c904fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:53.150051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86db38-00e4-4ef5-a8d5-d7484c904fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:53.150539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86db38-00e4-4ef5-a8d5-d7484c904fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:53.151516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86db38-00e4-4ef5-a8d5-d7484c904fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:53.154626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86db38-00e4-4ef5-a8d5-d7484c904fd7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:53.171008 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3027/6083] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:53.177044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86db38-00e4-4ef5-a8d5-d7484c904fd7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:53.198756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86db38-00e4-4ef5-a8d5-d7484c904fd7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:53.200594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4376a13-88e0-42ad-ba50-8208cf54be4e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:53.207101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec21c9-4094-46ae-ab8f-24281946888c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:53.208114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec21c9-4094-46ae-ab8f-24281946888c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:53.208765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec21c9-4094-46ae-ab8f-24281946888c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:53.208973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb2f43-f060-43d2-b25c-411214c92f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:53.209513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec21c9-4094-46ae-ab8f-24281946888c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:53.209923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb2f43-f060-43d2-b25c-411214c92f2e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:53.210421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb2f43-f060-43d2-b25c-411214c92f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:53.210899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb2f43-f060-43d2-b25c-411214c92f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:53.212012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb2f43-f060-43d2-b25c-411214c92f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:53.214947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb2f43-f060-43d2-b25c-411214c92f2e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:53.223496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec21c9-4094-46ae-ab8f-24281946888c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:53.225155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec21c9-4094-46ae-ab8f-24281946888c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:53.241347 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3028/6084] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:53.241568 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3057/6085] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:53.245250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb2f43-f060-43d2-b25c-411214c92f2e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:53.259160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb2f43-f060-43d2-b25c-411214c92f2e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:53.267249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:53.268033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:53.269595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:53.269988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] PATH_INFO: `/v3/projects/8c53bad5f514451b9feb29bed8b38cc1/users/9724fcf1010649fe9a0e89b7681a07d5/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:53.312618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c53bad5f514451b9feb29bed8b38cc1, user_id=9724fcf1010649fe9a0e89b7681a07d5, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:53.320772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:53.351450 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3029/6086] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:53 2022] PUT /identity/v3/projects/8c53bad5f514451b9feb29bed8b38cc1/users/9724fcf1010649fe9a0e89b7681a07d5/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:53.371488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090394-e327-43ec-9b8f-275e05886136 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:53.372280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090394-e327-43ec-9b8f-275e05886136 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:53.372696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090394-e327-43ec-9b8f-275e05886136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:53.452129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f8090394-e327-43ec-9b8f-275e05886136 None None] MFA Rules not processed for user `9724fcf1010649fe9a0e89b7681a07d5`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:53.454085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8090394-e327-43ec-9b8f-275e05886136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:53.626791 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3058/6087] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:53.654018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:53.660120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:53.881034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f733be-38ea-486e-9b96-6377b930688b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:53.895321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646af59-92b8-4fd2-a63c-f05d9d599437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:53.896098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646af59-92b8-4fd2-a63c-f05d9d599437 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:53.896429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646af59-92b8-4fd2-a63c-f05d9d599437 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:53.896721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646af59-92b8-4fd2-a63c-f05d9d599437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:53.906431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646af59-92b8-4fd2-a63c-f05d9d599437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:53.909273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646af59-92b8-4fd2-a63c-f05d9d599437 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:53.923304 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3030/6088] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:54.234551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090394-e327-43ec-9b8f-275e05886136 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:54.345788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090394-e327-43ec-9b8f-275e05886136 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:54.351737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:54.352945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:54.353319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:54.353674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] PATH_INFO: `/v3/users/9724fcf1010649fe9a0e89b7681a07d5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:54.355090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9724fcf1010649fe9a0e89b7681a07d5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:54.357349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:54.456214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9724fcf1010649fe9a0e89b7681a07d5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:54.474139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9724fcf1010649fe9a0e89b7681a07d5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:54.492243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9724fcf1010649fe9a0e89b7681a07d5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:54.495000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9724fcf1010649fe9a0e89b7681a07d5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:54.496237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9724fcf1010649fe9a0e89b7681a07d5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:54.526067 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3059/6089] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:54 2022] DELETE /identity/v3/users/9724fcf1010649fe9a0e89b7681a07d5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:54.530916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f925e-7643-4f99-9d4b-eacc7b564e7f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:54.531220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f925e-7643-4f99-9d4b-eacc7b564e7f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:54.531480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f925e-7643-4f99-9d4b-eacc7b564e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:54.577721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-014f925e-7643-4f99-9d4b-eacc7b564e7f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:54.578898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-014f925e-7643-4f99-9d4b-eacc7b564e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:54.707982 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3031/6090] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:54.726376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:54.728969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:54.858390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca29e2-5193-4bd0-acb5-37bb8b73a0f6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:54.868421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6b45-c251-46af-88f9-63306f265fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:54.869982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6b45-c251-46af-88f9-63306f265fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:54.869982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6b45-c251-46af-88f9-63306f265fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:54.869982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6b45-c251-46af-88f9-63306f265fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:54.890461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6b45-c251-46af-88f9-63306f265fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:54.892508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6b45-c251-46af-88f9-63306f265fb2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:54.928655 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3060/6091] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:55.656369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f925e-7643-4f99-9d4b-eacc7b564e7f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:55.657935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-014f925e-7643-4f99-9d4b-eacc7b564e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:55.681077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f925e-7643-4f99-9d4b-eacc7b564e7f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:55.707951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:55.709065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:55.709757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:55.710050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] PATH_INFO: `/v3/projects/8c53bad5f514451b9feb29bed8b38cc1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:55.713309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c53bad5f514451b9feb29bed8b38cc1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:55.716229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:55.851119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c53bad5f514451b9feb29bed8b38cc1', 'request_id': 'req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:55.856637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c53bad5f514451b9feb29bed8b38cc1', 'request_id': 'req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:55.870848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c53bad5f514451b9feb29bed8b38cc1', 'request_id': 'req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:55.899799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] The token cache is being invalidate because project 8c53bad5f514451b9feb29bed8b38cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:55.900115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:55.901886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89b85e11-cc78-4354-a4d2-8dc6ebaede2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:55.904728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3032/6092] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:55 2022] DELETE /identity/v3/projects/8c53bad5f514451b9feb29bed8b38cc1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:55.911755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e53b0-378c-4d4f-8dc9-1f3fa245d6de None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:55.912808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e53b0-378c-4d4f-8dc9-1f3fa245d6de None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:55.913295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e53b0-378c-4d4f-8dc9-1f3fa245d6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:55.947932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a11e53b0-378c-4d4f-8dc9-1f3fa245d6de None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:55.949941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a11e53b0-378c-4d4f-8dc9-1f3fa245d6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:56.117986 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3061/6093] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:56.120480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15527-c78c-4adc-8af2-7e852c8c456c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.120790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15527-c78c-4adc-8af2-7e852c8c456c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.121222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15527-c78c-4adc-8af2-7e852c8c456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.161600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-acd15527-c78c-4adc-8af2-7e852c8c456c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:56.162845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-acd15527-c78c-4adc-8af2-7e852c8c456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:56.183767 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3033/6094] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:56.192605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e53b0-378c-4d4f-8dc9-1f3fa245d6de None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:56.213266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e53b0-378c-4d4f-8dc9-1f3fa245d6de None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:56.219998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:56.229306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.229306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.229306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.229306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:56.229306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:56.229306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:56.247413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15527-c78c-4adc-8af2-7e852c8c456c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:56.248855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-acd15527-c78c-4adc-8af2-7e852c8c456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:56.265245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15527-c78c-4adc-8af2-7e852c8c456c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:56.271193 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3062/6095] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:56.272793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:56.275184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:56.277317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.277827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.278524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] PATH_INFO: `/v3/users/0478cb2d255a48ffaf9b68617db659b3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.281402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0478cb2d255a48ffaf9b68617db659b3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:56.284452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:56.296724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481bcd9-66e2-4627-abdf-94909e2310eb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:56.310538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b586e-8a80-4cc2-80ed-16b81a7de43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:56.311235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b586e-8a80-4cc2-80ed-16b81a7de43d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.311520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b586e-8a80-4cc2-80ed-16b81a7de43d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.311798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b586e-8a80-4cc2-80ed-16b81a7de43d admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.312547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b586e-8a80-4cc2-80ed-16b81a7de43d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:56.314499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b586e-8a80-4cc2-80ed-16b81a7de43d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:56.366628 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3063/6096] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:56 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:11:56.373098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b586e-8a80-4cc2-80ed-16b81a7de43d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:56.382745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0478cb2d255a48ffaf9b68617db659b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:56.383577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0478cb2d255a48ffaf9b68617db659b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:56.384091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0478cb2d255a48ffaf9b68617db659b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:56.403545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0478cb2d255a48ffaf9b68617db659b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:56.417481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-57c71e90-957f-4714-917e-9ef91de16e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0478cb2d255a48ffaf9b68617db659b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:56.446233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3034/6097] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:56 2022] DELETE /identity/v3/users/0478cb2d255a48ffaf9b68617db659b3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:56.448032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c8762-a7f9-4246-8fbe-a6f194667e44 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.448795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c8762-a7f9-4246-8fbe-a6f194667e44 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.449081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c8762-a7f9-4246-8fbe-a6f194667e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.476144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-108c8762-a7f9-4246-8fbe-a6f194667e44 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:56.478449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-108c8762-a7f9-4246-8fbe-a6f194667e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:56.490257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b586e-8a80-4cc2-80ed-16b81a7de43d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:56.556321 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3035/6098] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:56.566823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c8762-a7f9-4246-8fbe-a6f194667e44 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:56.571138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-108c8762-a7f9-4246-8fbe-a6f194667e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:56.630002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:56.631094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.631682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.631990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.632705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:56.634757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:56.717919 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3064/6099] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:56 2022] POST /identity/v3/users => generated 302 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:56.719236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:56.723936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:56.733131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c8762-a7f9-4246-8fbe-a6f194667e44 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:56.738682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68932b6b-4bc5-4635-ab7b-1947aaedb381 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:56.739120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718353-75a5-4079-807a-020ae14703b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:56.740402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718353-75a5-4079-807a-020ae14703b5 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.740919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718353-75a5-4079-807a-020ae14703b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.741538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718353-75a5-4079-807a-020ae14703b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.745219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8e5fa-4328-46ef-9655-d5dd3699f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:56.746962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8e5fa-4328-46ef-9655-d5dd3699f56e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.747251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8e5fa-4328-46ef-9655-d5dd3699f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.747530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8e5fa-4328-46ef-9655-d5dd3699f56e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.748418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8e5fa-4328-46ef-9655-d5dd3699f56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:56.750080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8e5fa-4328-46ef-9655-d5dd3699f56e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:56.757449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718353-75a5-4079-807a-020ae14703b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:56.759201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718353-75a5-4079-807a-020ae14703b5 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:56.771396 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3036/6100] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:56.780438 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3065/6101] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:11:56.781743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718353-75a5-4079-807a-020ae14703b5 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:56.804214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718353-75a5-4079-807a-020ae14703b5 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:56.809576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ff638-72cb-4ffe-8180-de1222d8e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:56.811371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff638-72cb-4ffe-8180-de1222d8e5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.811857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff638-72cb-4ffe-8180-de1222d8e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.812397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff638-72cb-4ffe-8180-de1222d8e5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.814286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ff638-72cb-4ffe-8180-de1222d8e5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:56.816957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ff638-72cb-4ffe-8180-de1222d8e5c2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:56.840221 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3037/6102] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:56.841573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8e5fa-4328-46ef-9655-d5dd3699f56e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:56.857176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8e5fa-4328-46ef-9655-d5dd3699f56e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:56.865037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35792853-73ca-4f25-b08a-b183ed003a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:56.865805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792853-73ca-4f25-b08a-b183ed003a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.866682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792853-73ca-4f25-b08a-b183ed003a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.866682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792853-73ca-4f25-b08a-b183ed003a3a admin admin] PATH_INFO: `/v3/projects/673865c7f46444c58c30ed82ee236c37/users/d19f9efdb87f46e3bee8d59abc34a514/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.894997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35792853-73ca-4f25-b08a-b183ed003a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=673865c7f46444c58c30ed82ee236c37, user_id=d19f9efdb87f46e3bee8d59abc34a514, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:56.897997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35792853-73ca-4f25-b08a-b183ed003a3a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:56.922773 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3066/6103] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:56 2022] PUT /identity/v3/projects/673865c7f46444c58c30ed82ee236c37/users/d19f9efdb87f46e3bee8d59abc34a514/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:11:56.934241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbc2d-c5f1-40a2-afe1-a9e01b8e4cd3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:56.934579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbc2d-c5f1-40a2-afe1-a9e01b8e4cd3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:56.934793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbbc2d-c5f1-40a2-afe1-a9e01b8e4cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:56.974172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-05dbbc2d-c5f1-40a2-afe1-a9e01b8e4cd3 None None] MFA Rules not processed for user `d19f9efdb87f46e3bee8d59abc34a514`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:56.975431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-05dbbc2d-c5f1-40a2-afe1-a9e01b8e4cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:57.076729 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3038/6104] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:57.080363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35792853-73ca-4f25-b08a-b183ed003a3a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.119234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbbc2d-c5f1-40a2-afe1-a9e01b8e4cd3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.120978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-05dbbc2d-c5f1-40a2-afe1-a9e01b8e4cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:57.180423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35792853-73ca-4f25-b08a-b183ed003a3a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.186995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a038-0f4a-47bd-8b61-f8177744501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.187951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a038-0f4a-47bd-8b61-f8177744501f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.188159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a038-0f4a-47bd-8b61-f8177744501f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.188479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a038-0f4a-47bd-8b61-f8177744501f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.189200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a038-0f4a-47bd-8b61-f8177744501f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.194616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a038-0f4a-47bd-8b61-f8177744501f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.238937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbbc2d-c5f1-40a2-afe1-a9e01b8e4cd3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.250530 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3067/6105] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:57 2022] POST /identity/v3/projects => generated 397 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:57.255071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a038-0f4a-47bd-8b61-f8177744501f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.256029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.256921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.258030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.258301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] PATH_INFO: `/v3/projects/45f9519d2430470fbbe9b0e0d532f3fd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.261232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f9519d2430470fbbe9b0e0d532f3fd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.268857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.362373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f9519d2430470fbbe9b0e0d532f3fd', 'request_id': 'req-a6c4c799-6c5c-4275-b14f-e26ea7801a27'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:57.371159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f9519d2430470fbbe9b0e0d532f3fd', 'request_id': 'req-a6c4c799-6c5c-4275-b14f-e26ea7801a27'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:57.375850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a038-0f4a-47bd-8b61-f8177744501f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.382662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f9519d2430470fbbe9b0e0d532f3fd', 'request_id': 'req-a6c4c799-6c5c-4275-b14f-e26ea7801a27'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:57.397133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] The token cache is being invalidate because project 45f9519d2430470fbbe9b0e0d532f3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:57.397524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:57.398596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a6c4c799-6c5c-4275-b14f-e26ea7801a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:57.400841 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3039/6106] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:11:57 2022] DELETE /identity/v3/projects/45f9519d2430470fbbe9b0e0d532f3fd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:57.405696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6fb41-03a7-4d94-af41-c956a36b8ac4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.405931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6fb41-03a7-4d94-af41-c956a36b8ac4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.406357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6fb41-03a7-4d94-af41-c956a36b8ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.435676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d8b6fb41-03a7-4d94-af41-c956a36b8ac4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:57.437117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d8b6fb41-03a7-4d94-af41-c956a36b8ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:57.460461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.461163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.461447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.461726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.462921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.465753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.497576 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3068/6107] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:57 2022] POST /identity/v3/users => generated 305 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:57.502060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.504386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:57.524948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c6cdc-76d4-4f59-baf4-84c24afdb108 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.530760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288882c8-fdc3-4ec4-a3de-b761427b657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.531868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288882c8-fdc3-4ec4-a3de-b761427b657c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.532301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288882c8-fdc3-4ec4-a3de-b761427b657c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.532629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288882c8-fdc3-4ec4-a3de-b761427b657c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.533446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288882c8-fdc3-4ec4-a3de-b761427b657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.535875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288882c8-fdc3-4ec4-a3de-b761427b657c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.546159 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3040/6108] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:57.547733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba087-87bb-4370-8abd-76589436508b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.548028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba087-87bb-4370-8abd-76589436508b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.548313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba087-87bb-4370-8abd-76589436508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.560167 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3069/6109] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:57.561085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288882c8-fdc3-4ec4-a3de-b761427b657c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.571747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9a0ba087-87bb-4370-8abd-76589436508b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:57.572757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288882c8-fdc3-4ec4-a3de-b761427b657c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.573016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9a0ba087-87bb-4370-8abd-76589436508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:57.577986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f014-54e6-4e2e-b69b-f5cbb16036fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.578890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f014-54e6-4e2e-b69b-f5cbb16036fe admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.579178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f014-54e6-4e2e-b69b-f5cbb16036fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.579457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f014-54e6-4e2e-b69b-f5cbb16036fe admin admin] PATH_INFO: `/v3/projects/d735d7aa34924e1897ca32cb8a2c040e/users/e6d00e77a9a047028690f01f523255af/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.587184 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3041/6110] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:57.587730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba087-87bb-4370-8abd-76589436508b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.607828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba087-87bb-4370-8abd-76589436508b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.614288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f014-54e6-4e2e-b69b-f5cbb16036fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d735d7aa34924e1897ca32cb8a2c040e, user_id=e6d00e77a9a047028690f01f523255af, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.614790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.615514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.615804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.616077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.616910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:11:57.617218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.618957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.619904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f014-54e6-4e2e-b69b-f5cbb16036fe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.638784 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3042/6111] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:11:57.640209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.651243 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3070/6112] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:57 2022] PUT /identity/v3/projects/d735d7aa34924e1897ca32cb8a2c040e/users/e6d00e77a9a047028690f01f523255af/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:57.657156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f014-54e6-4e2e-b69b-f5cbb16036fe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.662529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f11e4-1718-4587-8e02-e8c641f1e80e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.747119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f014-54e6-4e2e-b69b-f5cbb16036fe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.752212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b080bb7-14e1-4806-aa61-a5ef524b2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.753629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080bb7-14e1-4806-aa61-a5ef524b2637 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.753922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080bb7-14e1-4806-aa61-a5ef524b2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.754204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080bb7-14e1-4806-aa61-a5ef524b2637 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.755081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b080bb7-14e1-4806-aa61-a5ef524b2637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.757047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b080bb7-14e1-4806-aa61-a5ef524b2637 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.771739 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3071/6113] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:57.773002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b080bb7-14e1-4806-aa61-a5ef524b2637 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.779031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c208-77c0-4a18-b232-9b9d421b2194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.780121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c208-77c0-4a18-b232-9b9d421b2194 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.780774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c208-77c0-4a18-b232-9b9d421b2194 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.781695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c208-77c0-4a18-b232-9b9d421b2194 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.783207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7c208-77c0-4a18-b232-9b9d421b2194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.784393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b080bb7-14e1-4806-aa61-a5ef524b2637 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.790049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7c208-77c0-4a18-b232-9b9d421b2194 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.790883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026e17a-961c-4ec6-827e-529a4ac109c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.792139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e17a-961c-4ec6-827e-529a4ac109c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.792533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e17a-961c-4ec6-827e-529a4ac109c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.793077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e17a-961c-4ec6-827e-529a4ac109c4 admin admin] PATH_INFO: `/v3/projects/d735d7aa34924e1897ca32cb8a2c040e/users/e6d00e77a9a047028690f01f523255af/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.795505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026e17a-961c-4ec6-827e-529a4ac109c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d735d7aa34924e1897ca32cb8a2c040e, user_id=e6d00e77a9a047028690f01f523255af, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.798765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026e17a-961c-4ec6-827e-529a4ac109c4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:57.832379 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3072/6114] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:57 2022] PUT /identity/v3/projects/d735d7aa34924e1897ca32cb8a2c040e/users/e6d00e77a9a047028690f01f523255af/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:57.842954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f3699-0aa6-4ef5-a859-14dbeb23fb62 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.843639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f3699-0aa6-4ef5-a859-14dbeb23fb62 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.844214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f3699-0aa6-4ef5-a859-14dbeb23fb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.849657 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3043/6115] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:11:57 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:57.855069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c208-77c0-4a18-b232-9b9d421b2194 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:57.926932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-929f3699-0aa6-4ef5-a859-14dbeb23fb62 None None] MFA Rules not processed for user `e6d00e77a9a047028690f01f523255af`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:57.928099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-929f3699-0aa6-4ef5-a859-14dbeb23fb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:57.975204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c208-77c0-4a18-b232-9b9d421b2194 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:57.988210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e5bb7-b38f-4558-acf8-30969c9087e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:57.989692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e5bb7-b38f-4558-acf8-30969c9087e8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:57.991486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e5bb7-b38f-4558-acf8-30969c9087e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:57.992233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e5bb7-b38f-4558-acf8-30969c9087e8 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:57.993342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e5bb7-b38f-4558-acf8-30969c9087e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:57.999866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e5bb7-b38f-4558-acf8-30969c9087e8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:58.036377 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3073/6116] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:58.041269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f3699-0aa6-4ef5-a859-14dbeb23fb62 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:58.056659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f3699-0aa6-4ef5-a859-14dbeb23fb62 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:58.058489 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3044/6117] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:11:57 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:58.062249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e5bb7-b38f-4558-acf8-30969c9087e8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:58.068019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2a3c0-349f-476e-aef9-339eee461bee tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d00e77a9a047028690f01f523255af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd735d7aa34924e1897ca32cb8a2c040e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:58.071588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2a3c0-349f-476e-aef9-339eee461bee tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.073143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2a3c0-349f-476e-aef9-339eee461bee tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.073503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2a3c0-349f-476e-aef9-339eee461bee tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.074365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2a3c0-349f-476e-aef9-339eee461bee tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:58.078822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2a3c0-349f-476e-aef9-339eee461bee tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:58.086912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e5bb7-b38f-4558-acf8-30969c9087e8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:58.104221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8d3b2-9fcd-4280-b5a0-7b01dffebb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:58.105072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8d3b2-9fcd-4280-b5a0-7b01dffebb59 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.105619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8d3b2-9fcd-4280-b5a0-7b01dffebb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.106000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8d3b2-9fcd-4280-b5a0-7b01dffebb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.106979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8d3b2-9fcd-4280-b5a0-7b01dffebb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:58.110506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8d3b2-9fcd-4280-b5a0-7b01dffebb59 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:58.115369 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3074/6118] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:11:58 2022] POST /identity/v3/roles => generated 240 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:11:58.116825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2a3c0-349f-476e-aef9-339eee461bee tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:58.136268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2a3c0-349f-476e-aef9-339eee461bee tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:58.139546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3045/6119] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:58 2022] GET /identity/v3/roles => generated 1651 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:11:58.144111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8d3b2-9fcd-4280-b5a0-7b01dffebb59 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:58.152234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d00e77a9a047028690f01f523255af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd735d7aa34924e1897ca32cb8a2c040e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:58.157702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.158129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.158532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] PATH_INFO: `/v3/projects/673865c7f46444c58c30ed82ee236c37/users/d19f9efdb87f46e3bee8d59abc34a514/roles/ddd5da93de854eb088c3fc4fc8091a54` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.163861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: Authorizing `identity:create_grant(project_id=673865c7f46444c58c30ed82ee236c37, user_id=d19f9efdb87f46e3bee8d59abc34a514, role_id=ddd5da93de854eb088c3fc4fc8091a54)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:58.167148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:58.174428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8d3b2-9fcd-4280-b5a0-7b01dffebb59 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:58.182910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a2d2-7aed-4d04-b881-086151e87c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:58.183987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a2d2-7aed-4d04-b881-086151e87c8d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.185236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a2d2-7aed-4d04-b881-086151e87c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.186887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a2d2-7aed-4d04-b881-086151e87c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.192046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a2d2-7aed-4d04-b881-086151e87c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:58.195973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a2d2-7aed-4d04-b881-086151e87c8d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:58.202765 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3075/6120] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:58 2022] PUT /identity/v3/projects/673865c7f46444c58c30ed82ee236c37/users/d19f9efdb87f46e3bee8d59abc34a514/roles/ddd5da93de854eb088c3fc4fc8091a54 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:58.207637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:58.210797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:58.224845 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3046/6121] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:11:58 2022] GET /identity/v3/roles => generated 1651 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:11:58.227567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a2d2-7aed-4d04-b881-086151e87c8d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:58.247488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a2d2-7aed-4d04-b881-086151e87c8d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:58.346104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62d27e-af90-4b4b-be9d-d3a355b386ac tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:58.355324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c273-6d8d-49de-8fab-eebbf50fa088 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19f9efdb87f46e3bee8d59abc34a514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673865c7f46444c58c30ed82ee236c37', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1658135493', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:58.356633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c273-6d8d-49de-8fab-eebbf50fa088 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.357091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c273-6d8d-49de-8fab-eebbf50fa088 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.357932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c273-6d8d-49de-8fab-eebbf50fa088 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] PATH_INFO: `/v3/users/d19f9efdb87f46e3bee8d59abc34a514/application_credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.360160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c273-6d8d-49de-8fab-eebbf50fa088 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] RBAC: Authorizing `identity:create_application_credential(user_id=d19f9efdb87f46e3bee8d59abc34a514)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:58.362026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c273-6d8d-49de-8fab-eebbf50fa088 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:58.364074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9021f5-ea51-4a49-86e7-a69e5f89f75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:58.365070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9021f5-ea51-4a49-86e7-a69e5f89f75d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.365356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9021f5-ea51-4a49-86e7-a69e5f89f75d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.365638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9021f5-ea51-4a49-86e7-a69e5f89f75d admin admin] PATH_INFO: `/v3/projects/cee4744beaf9494c8d9acc68770cec52/users/ef193c97843640f2a608cf7cf1123c2e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.404543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9021f5-ea51-4a49-86e7-a69e5f89f75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee4744beaf9494c8d9acc68770cec52, user_id=ef193c97843640f2a608cf7cf1123c2e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:58.410379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9021f5-ea51-4a49-86e7-a69e5f89f75d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:58.451060 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3047/6122] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:11:58 2022] PUT /identity/v3/projects/cee4744beaf9494c8d9acc68770cec52/users/ef193c97843640f2a608cf7cf1123c2e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:58.474368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ddb44-3f63-4ee3-a0dd-565f716542f9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.475077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ddb44-3f63-4ee3-a0dd-565f716542f9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.475570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ddb44-3f63-4ee3-a0dd-565f716542f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.510782 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3076/6123] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Feb 19 21:11:58 2022] POST /identity/v3/users/d19f9efdb87f46e3bee8d59abc34a514/application_credentials => generated 659 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:11:58.514802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb0e79-9df9-40d5-b5a1-c57930f04569 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.515105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb0e79-9df9-40d5-b5a1-c57930f04569 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.515905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb0e79-9df9-40d5-b5a1-c57930f04569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.547961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-028ddb44-3f63-4ee3-a0dd-565f716542f9 None None] MFA Rules not processed for user `ef193c97843640f2a608cf7cf1123c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:58.549462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-028ddb44-3f63-4ee3-a0dd-565f716542f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:58.559871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ecdb0e79-9df9-40d5-b5a1-c57930f04569 None None] MFA Rules not processed for user `d19f9efdb87f46e3bee8d59abc34a514`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:58.562371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ecdb0e79-9df9-40d5-b5a1-c57930f04569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:58.724063 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3048/6124] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:11:58.742621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ddb44-3f63-4ee3-a0dd-565f716542f9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:58.744254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-028ddb44-3f63-4ee3-a0dd-565f716542f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:58.852710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ddb44-3f63-4ee3-a0dd-565f716542f9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:58.857720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4c190-773f-45ec-8b9d-fc02510a159e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:58.859105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4c190-773f-45ec-8b9d-fc02510a159e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.859395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4c190-773f-45ec-8b9d-fc02510a159e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.859673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4c190-773f-45ec-8b9d-fc02510a159e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.870814 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3077/6125] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3386 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Feb 19 21:11:58.872163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb0e79-9df9-40d5-b5a1-c57930f04569 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:58.878933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4c190-773f-45ec-8b9d-fc02510a159e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:58.882501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4c190-773f-45ec-8b9d-fc02510a159e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:58.904487 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3049/6126] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:11:58.969729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb0e79-9df9-40d5-b5a1-c57930f04569 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:58.976823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19f9efdb87f46e3bee8d59abc34a514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673865c7f46444c58c30ed82ee236c37', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1658135493', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:58.977779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:58.978206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:58.989512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] PATH_INFO: `/v3/users/d19f9efdb87f46e3bee8d59abc34a514/application_credentials/5aae9e5421ee4285b9f4457cf22c7723` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:58.990062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d19f9efdb87f46e3bee8d59abc34a514, application_credential_id=5aae9e5421ee4285b9f4457cf22c7723)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:58.991602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:59.030556 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3078/6127] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:11:58 2022] DELETE /identity/v3/users/d19f9efdb87f46e3bee8d59abc34a514/application_credentials/5aae9e5421ee4285b9f4457cf22c7723 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:59.035565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4c190-773f-45ec-8b9d-fc02510a159e service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:59.181893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4c190-773f-45ec-8b9d-fc02510a159e service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:59.192470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d00e77a9a047028690f01f523255af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd735d7aa34924e1897ca32cb8a2c040e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:59.194025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:59.195041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:59.195618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] PATH_INFO: `/v3/roles/ddd5da93de854eb088c3fc4fc8091a54` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:59.197765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ddd5da93de854eb088c3fc4fc8091a54)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:59.199643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:59.288064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] Invalidating the token cache because role ddd5da93de854eb088c3fc4fc8091a54 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:11:59.288682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:59.289667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-37b6ad3e-2981-4307-8faf-49c98557751e tempest-ApplicationCredentialsV3AdminTest-2216652 tempest-ApplicationCredentialsV3AdminTest-2216652-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:59.297129 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3050/6128] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:59 2022] DELETE /identity/v3/roles/ddd5da93de854eb088c3fc4fc8091a54 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:59.298330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:59.300879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:59.389096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5505c-05c5-4c32-8f64-5325c10a7709 tempest-ApplicationCredentialsV3AdminTest-1701842732 tempest-ApplicationCredentialsV3AdminTest-1701842732-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:59.474246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:59.475626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:59.476220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:59.476540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] PATH_INFO: `/v3/users/d19f9efdb87f46e3bee8d59abc34a514` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:59.477919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19f9efdb87f46e3bee8d59abc34a514)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:59.481202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:59.564055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19f9efdb87f46e3bee8d59abc34a514'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:59.584264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19f9efdb87f46e3bee8d59abc34a514'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:59.602071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19f9efdb87f46e3bee8d59abc34a514'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:59.605290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19f9efdb87f46e3bee8d59abc34a514'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:59.606445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19f9efdb87f46e3bee8d59abc34a514'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:11:59.645383 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3079/6129] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:11:59 2022] DELETE /identity/v3/users/d19f9efdb87f46e3bee8d59abc34a514 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:11:59.649748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6c43-bfde-4c27-bd55-c9e4b843b0e4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:59.650283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6c43-bfde-4c27-bd55-c9e4b843b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:59.650283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6c43-bfde-4c27-bd55-c9e4b843b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:59.687315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-59ec6c43-bfde-4c27-bd55-c9e4b843b0e4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:11:59.687610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-59ec6c43-bfde-4c27-bd55-c9e4b843b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:59.821488 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3051/6130] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:11:59.844528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:11:59.847782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:11:59.948843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b8b0-00de-4518-818b-8062d9d300ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:11:59.953420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1b6b-b3f4-4ab4-8d74-e6fbe0a1c3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:11:59.954274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1b6b-b3f4-4ab4-8d74-e6fbe0a1c3ab service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:11:59.954662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1b6b-b3f4-4ab4-8d74-e6fbe0a1c3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:11:59.955180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1b6b-b3f4-4ab4-8d74-e6fbe0a1c3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:11:59.967955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1b6b-b3f4-4ab4-8d74-e6fbe0a1c3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:11:59.970441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1b6b-b3f4-4ab4-8d74-e6fbe0a1c3ab service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:11:59.984271 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3080/6131] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:01.157577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec6c43-bfde-4c27-bd55-c9e4b843b0e4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:01.159124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-59ec6c43-bfde-4c27-bd55-c9e4b843b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:01.173480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec6c43-bfde-4c27-bd55-c9e4b843b0e4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:01.178496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:01.179462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:01.179815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:01.180231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] PATH_INFO: `/v3/projects/673865c7f46444c58c30ed82ee236c37` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:01.181576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673865c7f46444c58c30ed82ee236c37)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:01.183586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:01.242521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673865c7f46444c58c30ed82ee236c37', 'request_id': 'req-e18f3502-7cce-446d-ad93-e9f736b3f6a9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.248100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673865c7f46444c58c30ed82ee236c37', 'request_id': 'req-e18f3502-7cce-446d-ad93-e9f736b3f6a9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.256966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673865c7f46444c58c30ed82ee236c37', 'request_id': 'req-e18f3502-7cce-446d-ad93-e9f736b3f6a9'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.269190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] The token cache is being invalidate because project 673865c7f46444c58c30ed82ee236c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:01.269482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.270195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.271785 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3052/6132] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:01 2022] DELETE /identity/v3/projects/673865c7f46444c58c30ed82ee236c37 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:01.276063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1b6b-b3f4-4ab4-8d74-e6fbe0a1c3ab service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:01.287246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1b6b-b3f4-4ab4-8d74-e6fbe0a1c3ab service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:01.369722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:01.371686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:01.373073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:01.373717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] PATH_INFO: `/v3/users/e6d00e77a9a047028690f01f523255af` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:01.376299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d00e77a9a047028690f01f523255af)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:01.379221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:01.463958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d00e77a9a047028690f01f523255af'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.491586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d00e77a9a047028690f01f523255af'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.506312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d00e77a9a047028690f01f523255af'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.507105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d00e77a9a047028690f01f523255af'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.507798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cac33a33-d8ad-40ad-947c-5d858514d821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d00e77a9a047028690f01f523255af'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:01.530667 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3081/6133] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:01 2022] DELETE /identity/v3/users/e6d00e77a9a047028690f01f523255af => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:02.028463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.031144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:02.080935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f3502-7cce-446d-ad93-e9f736b3f6a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:02.136699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf79cd-1ccc-40bc-a81a-7c660f0a08af None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.138534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf79cd-1ccc-40bc-a81a-7c660f0a08af None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.138812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf79cd-1ccc-40bc-a81a-7c660f0a08af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.199771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0fdf79cd-1ccc-40bc-a81a-7c660f0a08af None None] MFA Rules not processed for user `9f1e1cafad4f475dad7bc93b50312279`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:02.201484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0fdf79cd-1ccc-40bc-a81a-7c660f0a08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:02.231930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:02.232850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.233290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.233575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] PATH_INFO: `/v3/projects/d735d7aa34924e1897ca32cb8a2c040e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.235941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d735d7aa34924e1897ca32cb8a2c040e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:02.238590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:02.294108 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3082/6134] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:02.299899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf79cd-1ccc-40bc-a81a-7c660f0a08af None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.303091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0fdf79cd-1ccc-40bc-a81a-7c660f0a08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:02.332666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf79cd-1ccc-40bc-a81a-7c660f0a08af None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:02.354111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd735d7aa34924e1897ca32cb8a2c040e', 'request_id': 'req-195c39c4-4439-41b0-882a-b92e6597f194'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:02.361473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd735d7aa34924e1897ca32cb8a2c040e', 'request_id': 'req-195c39c4-4439-41b0-882a-b92e6597f194'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:02.371042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd735d7aa34924e1897ca32cb8a2c040e', 'request_id': 'req-195c39c4-4439-41b0-882a-b92e6597f194'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:02.388420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] The token cache is being invalidate because project d735d7aa34924e1897ca32cb8a2c040e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:02.389365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:02.391891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-195c39c4-4439-41b0-882a-b92e6597f194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:02.395041 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3053/6135] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:02 2022] DELETE /identity/v3/projects/d735d7aa34924e1897ca32cb8a2c040e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:02.402541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b296-8738-4ab9-89ce-ea0ee4fd59ac None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.403100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b296-8738-4ab9-89ce-ea0ee4fd59ac None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.403524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b296-8738-4ab9-89ce-ea0ee4fd59ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.427445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:02.428295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.428744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.429211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.429945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:02.432186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:02.435773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fd99b296-8738-4ab9-89ce-ea0ee4fd59ac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:02.438967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fd99b296-8738-4ab9-89ce-ea0ee4fd59ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:02.451884 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3054/6136] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:02.462509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53fdb2-9241-402d-bb4f-76b0a712f171 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.463462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53fdb2-9241-402d-bb4f-76b0a712f171 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.463904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53fdb2-9241-402d-bb4f-76b0a712f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.470519 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3083/6137] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:02 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:02.475035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.477429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:02.504469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7f53fdb2-9241-402d-bb4f-76b0a712f171 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:02.505732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7f53fdb2-9241-402d-bb4f-76b0a712f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:02.562756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c69c5-d5d3-4571-ab46-a25424e06572 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:02.569958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ad44-0952-4a58-8127-c94027ff7822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:02.571207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ad44-0952-4a58-8127-c94027ff7822 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.571719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ad44-0952-4a58-8127-c94027ff7822 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.572207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ad44-0952-4a58-8127-c94027ff7822 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.573177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701ad44-0952-4a58-8127-c94027ff7822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:02.576039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701ad44-0952-4a58-8127-c94027ff7822 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:02.604852 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3084/6138] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:02 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:02.609525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ad44-0952-4a58-8127-c94027ff7822 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.633302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ad44-0952-4a58-8127-c94027ff7822 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:02.646078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc32af-67e2-4776-a8b2-5f83b9d56afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:02.647765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc32af-67e2-4776-a8b2-5f83b9d56afc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.648554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc32af-67e2-4776-a8b2-5f83b9d56afc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.651739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc32af-67e2-4776-a8b2-5f83b9d56afc admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.653727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc32af-67e2-4776-a8b2-5f83b9d56afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:02.654333 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3055/6139] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:02.656464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53fdb2-9241-402d-bb4f-76b0a712f171 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.659551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc32af-67e2-4776-a8b2-5f83b9d56afc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:02.678610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53fdb2-9241-402d-bb4f-76b0a712f171 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:02.684454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:02.685686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.686644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.686644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.687129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:02.687442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:02.691039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:02.707769 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3056/6140] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:02.713450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.717050 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3085/6141] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:02.720356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc32af-67e2-4776-a8b2-5f83b9d56afc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.728601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d659931-7f48-4754-9efb-402d7d811393 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:02.734184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f68cd-7f2c-4c56-9be6-4db9a30a47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:02.735146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f68cd-7f2c-4c56-9be6-4db9a30a47ff admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.735701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f68cd-7f2c-4c56-9be6-4db9a30a47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.736196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f68cd-7f2c-4c56-9be6-4db9a30a47ff admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.737698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f68cd-7f2c-4c56-9be6-4db9a30a47ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:02.739997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f68cd-7f2c-4c56-9be6-4db9a30a47ff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:02.766063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc32af-67e2-4776-a8b2-5f83b9d56afc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:02.782166 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3057/6142] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:02 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:02.787593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cb118-927e-4895-92dc-6aa703b00463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:02.789011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb118-927e-4895-92dc-6aa703b00463 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.789497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb118-927e-4895-92dc-6aa703b00463 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.790010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb118-927e-4895-92dc-6aa703b00463 admin admin] PATH_INFO: `/v3/projects/aeb441a7b0094cc59af51b60a7f101a9/users/e261613761bb44609c8aa5b7bc3d7d90/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.790799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f68cd-7f2c-4c56-9be6-4db9a30a47ff admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.842886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cb118-927e-4895-92dc-6aa703b00463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb441a7b0094cc59af51b60a7f101a9, user_id=e261613761bb44609c8aa5b7bc3d7d90, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:02.848650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cb118-927e-4895-92dc-6aa703b00463 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:02.885895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f68cd-7f2c-4c56-9be6-4db9a30a47ff admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:02.887344 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3086/6143] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:02 2022] PUT /identity/v3/projects/aeb441a7b0094cc59af51b60a7f101a9/users/e261613761bb44609c8aa5b7bc3d7d90/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:02.891357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cb118-927e-4895-92dc-6aa703b00463 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:02.980882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfb0d5-3a5c-4bcb-906c-e3b96b1cd435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:02.984887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb0d5-3a5c-4bcb-906c-e3b96b1cd435 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:02.985182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb0d5-3a5c-4bcb-906c-e3b96b1cd435 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:02.985616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb0d5-3a5c-4bcb-906c-e3b96b1cd435 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:02.986895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfb0d5-3a5c-4bcb-906c-e3b96b1cd435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:02.990739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfb0d5-3a5c-4bcb-906c-e3b96b1cd435 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:03.018902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cb118-927e-4895-92dc-6aa703b00463 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:03.027358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f46b26-4442-4d9a-9f32-f3bd1a72aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:03.030751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f46b26-4442-4d9a-9f32-f3bd1a72aec2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:03.034494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f46b26-4442-4d9a-9f32-f3bd1a72aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:03.035022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f46b26-4442-4d9a-9f32-f3bd1a72aec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:03.038799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f46b26-4442-4d9a-9f32-f3bd1a72aec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:03.040494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f46b26-4442-4d9a-9f32-f3bd1a72aec2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:03.052834 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3058/6144] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:02 2022] POST /identity/v3/users => generated 284 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:03.054417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfb0d5-3a5c-4bcb-906c-e3b96b1cd435 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:03.066165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3087/6145] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:03.071091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f46b26-4442-4d9a-9f32-f3bd1a72aec2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:03.071630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfb0d5-3a5c-4bcb-906c-e3b96b1cd435 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:03.079730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c7faa-71d4-48de-946e-04d208ebcdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:03.080996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c7faa-71d4-48de-946e-04d208ebcdbe admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:03.081285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c7faa-71d4-48de-946e-04d208ebcdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:03.081562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c7faa-71d4-48de-946e-04d208ebcdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:03.082306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c7faa-71d4-48de-946e-04d208ebcdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:03.084072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c7faa-71d4-48de-946e-04d208ebcdbe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:03.090470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f46b26-4442-4d9a-9f32-f3bd1a72aec2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:03.101240 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3059/6146] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:03.104148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c7faa-71d4-48de-946e-04d208ebcdbe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:03.109274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724165-07d1-47db-a731-fc6910a121d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:03.110650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724165-07d1-47db-a731-fc6910a121d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:03.110942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724165-07d1-47db-a731-fc6910a121d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:03.111247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724165-07d1-47db-a731-fc6910a121d7 admin admin] PATH_INFO: `/v3/projects/aeb441a7b0094cc59af51b60a7f101a9/users/e261613761bb44609c8aa5b7bc3d7d90/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:03.114893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af724165-07d1-47db-a731-fc6910a121d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb441a7b0094cc59af51b60a7f101a9, user_id=e261613761bb44609c8aa5b7bc3d7d90, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:03.117926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af724165-07d1-47db-a731-fc6910a121d7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:03.126478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c7faa-71d4-48de-946e-04d208ebcdbe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:03.132419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:03.133791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:03.134083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:03.134364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:03.135149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:03.137617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:03.143398 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3088/6147] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:03 2022] PUT /identity/v3/projects/aeb441a7b0094cc59af51b60a7f101a9/users/e261613761bb44609c8aa5b7bc3d7d90/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:03.159571 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3060/6148] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:03.160203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724165-07d1-47db-a731-fc6910a121d7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:03.235386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:03.238168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:03.299207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f29934-1edf-46e3-878d-819a9159b779 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:03.376996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724165-07d1-47db-a731-fc6910a121d7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:03.384869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80573ded-4b00-4035-bba8-4a761c8a3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:03.386872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80573ded-4b00-4035-bba8-4a761c8a3ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:03.387164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80573ded-4b00-4035-bba8-4a761c8a3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:03.387446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80573ded-4b00-4035-bba8-4a761c8a3ea8 admin admin] PATH_INFO: `/v3/projects/6149c0df02cc4e4abf6d239f8234b289/users/fb7439fa265b4c07874e71ea4338ee69/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:03.413121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80573ded-4b00-4035-bba8-4a761c8a3ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6149c0df02cc4e4abf6d239f8234b289, user_id=fb7439fa265b4c07874e71ea4338ee69, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:03.424817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80573ded-4b00-4035-bba8-4a761c8a3ea8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:03.466066 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3089/6149] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:03 2022] PUT /identity/v3/projects/6149c0df02cc4e4abf6d239f8234b289/users/fb7439fa265b4c07874e71ea4338ee69/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:03.467740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9940-ac1f-432a-9f95-91a8023dfd93 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:03.468047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9940-ac1f-432a-9f95-91a8023dfd93 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:03.469566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9940-ac1f-432a-9f95-91a8023dfd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:03.500007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:03.501348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:03.502969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:03.503420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] PATH_INFO: `/v3/users/664f926973a242fcad5a2f1a02f773d7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:03.505468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=664f926973a242fcad5a2f1a02f773d7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:03.511134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:03.517316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0a3d9940-ac1f-432a-9f95-91a8023dfd93 None None] MFA Rules not processed for user `fb7439fa265b4c07874e71ea4338ee69`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:03.519396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0a3d9940-ac1f-432a-9f95-91a8023dfd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:03.635580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664f926973a242fcad5a2f1a02f773d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:03.636860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664f926973a242fcad5a2f1a02f773d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:03.637780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664f926973a242fcad5a2f1a02f773d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:03.656408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664f926973a242fcad5a2f1a02f773d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:03.666952 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3090/6150] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:03.672256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664f926973a242fcad5a2f1a02f773d7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:03.672782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9940-ac1f-432a-9f95-91a8023dfd93 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:03.697081 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3061/6151] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:03 2022] DELETE /identity/v3/users/664f926973a242fcad5a2f1a02f773d7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:03.803521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9940-ac1f-432a-9f95-91a8023dfd93 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:03.903088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb54868-a852-4ee8-9054-ad3f466d874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:03.904128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb54868-a852-4ee8-9054-ad3f466d874c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:03.904602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb54868-a852-4ee8-9054-ad3f466d874c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:03.905048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb54868-a852-4ee8-9054-ad3f466d874c admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:03.906429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb54868-a852-4ee8-9054-ad3f466d874c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:03.910364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb54868-a852-4ee8-9054-ad3f466d874c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:03.967877 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3091/6152] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:03 2022] POST /identity/v3/projects => generated 365 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:03.973524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:03.975008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:03.990461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f32901-5718-40ed-836f-3264ac8ad180 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:04.072380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10290693-306f-49a5-b996-ad522063dcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:04.072380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290693-306f-49a5-b996-ad522063dcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.072843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290693-306f-49a5-b996-ad522063dcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.072983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290693-306f-49a5-b996-ad522063dcb3 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:04.081428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10290693-306f-49a5-b996-ad522063dcb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:04.081428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10290693-306f-49a5-b996-ad522063dcb3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:04.106282 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3062/6153] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:03 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:04.110641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb54868-a852-4ee8-9054-ad3f466d874c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:04.133993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb54868-a852-4ee8-9054-ad3f466d874c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:04.145997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503d26c-3dd7-4263-886a-79a07cd399ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:04.146945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503d26c-3dd7-4263-886a-79a07cd399ec admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.147242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503d26c-3dd7-4263-886a-79a07cd399ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.147590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503d26c-3dd7-4263-886a-79a07cd399ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:04.155061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503d26c-3dd7-4263-886a-79a07cd399ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:04.160218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503d26c-3dd7-4263-886a-79a07cd399ec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:04.188146 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3092/6154] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:04.191551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10290693-306f-49a5-b996-ad522063dcb3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:04.210233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10290693-306f-49a5-b996-ad522063dcb3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:04.225702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e360e6-bd39-47af-8602-b20f570c3bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:04.226899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e360e6-bd39-47af-8602-b20f570c3bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.227182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e360e6-bd39-47af-8602-b20f570c3bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.227658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e360e6-bd39-47af-8602-b20f570c3bfe admin admin] PATH_INFO: `/v3/projects/f41b18de6fb749f0ad17a43235dd4432/users/f29270b0b4614ca1b5f36fbf771ae68a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:04.262897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e360e6-bd39-47af-8602-b20f570c3bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41b18de6fb749f0ad17a43235dd4432, user_id=f29270b0b4614ca1b5f36fbf771ae68a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:04.269847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e360e6-bd39-47af-8602-b20f570c3bfe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:04.290945 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3063/6155] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:04 2022] PUT /identity/v3/projects/f41b18de6fb749f0ad17a43235dd4432/users/f29270b0b4614ca1b5f36fbf771ae68a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:04.294882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503d26c-3dd7-4263-886a-79a07cd399ec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:04.311998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503d26c-3dd7-4263-886a-79a07cd399ec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:04.420549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:04.421704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.422252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.422782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:04.425415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:04.428782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:04.450362 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3093/6156] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:12:04.455559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e360e6-bd39-47af-8602-b20f570c3bfe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:04.478650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e360e6-bd39-47af-8602-b20f570c3bfe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:04.485153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfb405-069c-4090-a253-378ddfa46227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:04.488627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfb405-069c-4090-a253-378ddfa46227 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.492061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfb405-069c-4090-a253-378ddfa46227 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.492967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfb405-069c-4090-a253-378ddfa46227 admin admin] PATH_INFO: `/v3/projects/f41b18de6fb749f0ad17a43235dd4432/users/f29270b0b4614ca1b5f36fbf771ae68a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:04.498474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfb405-069c-4090-a253-378ddfa46227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41b18de6fb749f0ad17a43235dd4432, user_id=f29270b0b4614ca1b5f36fbf771ae68a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:04.510235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfb405-069c-4090-a253-378ddfa46227 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:04.529772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:04.532562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:04.536860 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3064/6157] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:04 2022] PUT /identity/v3/projects/f41b18de6fb749f0ad17a43235dd4432/users/f29270b0b4614ca1b5f36fbf771ae68a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:04.548058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a593848-0696-497c-b751-fb5d008554a3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.548272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a593848-0696-497c-b751-fb5d008554a3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.548589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a593848-0696-497c-b751-fb5d008554a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:04.579316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a6c76-da3c-450d-a9dc-4a3d95c59db9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:04.608208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0a593848-0696-497c-b751-fb5d008554a3 None None] MFA Rules not processed for user `f29270b0b4614ca1b5f36fbf771ae68a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:04.609609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0a593848-0696-497c-b751-fb5d008554a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:04.774169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:04.775730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.776117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.776540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] PATH_INFO: `/v3/projects/85755c1b89f44eb0a4db800f8bf319f0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:04.780998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85755c1b89f44eb0a4db800f8bf319f0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:04.783330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:04.820603 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3065/6158] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:04.825252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a593848-0696-497c-b751-fb5d008554a3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:04.839494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a593848-0696-497c-b751-fb5d008554a3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:04.850175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f555-f061-45cb-8d4f-f4beb319372e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:04.852850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f555-f061-45cb-8d4f-f4beb319372e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.855322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f555-f061-45cb-8d4f-f4beb319372e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.856072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f555-f061-45cb-8d4f-f4beb319372e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:04.857462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44f555-f061-45cb-8d4f-f4beb319372e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:04.860823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44f555-f061-45cb-8d4f-f4beb319372e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:04.894371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85755c1b89f44eb0a4db800f8bf319f0', 'request_id': 'req-6d5cf060-221c-4fd3-bc80-ec88f8237c44'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:04.895027 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3066/6159] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Feb 19 21:12:04 2022] POST /identity/v3/domains => generated 277 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:04.899702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f555-f061-45cb-8d4f-f4beb319372e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:04.910314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85755c1b89f44eb0a4db800f8bf319f0', 'request_id': 'req-6d5cf060-221c-4fd3-bc80-ec88f8237c44'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:04.924509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85755c1b89f44eb0a4db800f8bf319f0', 'request_id': 'req-6d5cf060-221c-4fd3-bc80-ec88f8237c44'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:04.947844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] The token cache is being invalidate because project 85755c1b89f44eb0a4db800f8bf319f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:04.948295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:04.952821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6d5cf060-221c-4fd3-bc80-ec88f8237c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:04.954718 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3094/6160] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:04 2022] DELETE /identity/v3/projects/85755c1b89f44eb0a4db800f8bf319f0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:04.960427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4277a2e-8a02-4767-9e4e-3801d469cdfe None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:04.960855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4277a2e-8a02-4767-9e4e-3801d469cdfe None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:04.961237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4277a2e-8a02-4767-9e4e-3801d469cdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.004790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b4277a2e-8a02-4767-9e4e-3801d469cdfe None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:05.006190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b4277a2e-8a02-4767-9e4e-3801d469cdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:05.030284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f555-f061-45cb-8d4f-f4beb319372e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:05.039933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:05.042600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:05.043233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:05.043823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.044999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:05.048565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:05.082262 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3067/6161] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Feb 19 21:12:04 2022] POST /identity/v3/domains => generated 276 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:05.085582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:05.092079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:05.160837 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3095/6162] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:05.165442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800b81-ca6f-4fc5-8b1b-098dd2238049 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:05.166009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800b81-ca6f-4fc5-8b1b-098dd2238049 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:05.166557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800b81-ca6f-4fc5-8b1b-098dd2238049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.197321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-34800b81-ca6f-4fc5-8b1b-098dd2238049 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:05.198594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-34800b81-ca6f-4fc5-8b1b-098dd2238049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:05.254964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8e457-fbff-451f-8b05-b822b636d4bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:05.275149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee85c8-398e-4ad6-8d36-4d625ba43c29 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:05.276777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee85c8-398e-4ad6-8d36-4d625ba43c29 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:05.277214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee85c8-398e-4ad6-8d36-4d625ba43c29 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:05.277755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee85c8-398e-4ad6-8d36-4d625ba43c29 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.278661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee85c8-398e-4ad6-8d36-4d625ba43c29 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:05.280508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee85c8-398e-4ad6-8d36-4d625ba43c29 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:05.312843 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3068/6163] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Feb 19 21:12:05 2022] POST /identity/v3/domains => generated 276 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:05.317618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee85c8-398e-4ad6-8d36-4d625ba43c29 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:05.326030 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3096/6164] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:05.327024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34800b81-ca6f-4fc5-8b1b-098dd2238049 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:05.344755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34800b81-ca6f-4fc5-8b1b-098dd2238049 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:05.459403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee85c8-398e-4ad6-8d36-4d625ba43c29 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:05.472648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac30cf-7609-42d8-b719-b16f65a77c77 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:05.473577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac30cf-7609-42d8-b719-b16f65a77c77 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:05.473863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac30cf-7609-42d8-b719-b16f65a77c77 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:05.474242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac30cf-7609-42d8-b719-b16f65a77c77 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.475060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac30cf-7609-42d8-b719-b16f65a77c77 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:05.478109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac30cf-7609-42d8-b719-b16f65a77c77 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:05.486850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:05.489913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:05.490539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:05.491165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.493692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:05.494506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:05.497258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:05.514482 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3069/6165] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Feb 19 21:12:05 2022] POST /identity/v3/domains => generated 280 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:05.519178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac30cf-7609-42d8-b719-b16f65a77c77 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:05.528379 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3097/6166] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:05.532235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:05.563430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f81eb-0d56-45c6-93fe-c91a15823598 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:05.638924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac30cf-7609-42d8-b719-b16f65a77c77 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:05.654049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:05.654930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:05.655218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:05.655493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/bc8e47d4316d4a8ca8ea933113738561` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.673146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bc8e47d4316d4a8ca8ea933113738561)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:05.675020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:05.689293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116a65-8774-42da-bdb4-98fe461656aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:05.690007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116a65-8774-42da-bdb4-98fe461656aa admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:05.690287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116a65-8774-42da-bdb4-98fe461656aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:05.690609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116a65-8774-42da-bdb4-98fe461656aa admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.691313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db116a65-8774-42da-bdb4-98fe461656aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:05.693306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db116a65-8774-42da-bdb4-98fe461656aa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:05.736028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bc8e47d4316d4a8ca8ea933113738561'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.740453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bc8e47d4316d4a8ca8ea933113738561'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.744169 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3098/6167] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:05 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:05.748118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116a65-8774-42da-bdb4-98fe461656aa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:05.803408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8e47d4316d4a8ca8ea933113738561', 'request_id': 'req-76e30d7b-da67-4495-9e1d-eea0f66f2009'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.810729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8e47d4316d4a8ca8ea933113738561', 'request_id': 'req-76e30d7b-da67-4495-9e1d-eea0f66f2009'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.824532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8e47d4316d4a8ca8ea933113738561', 'request_id': 'req-76e30d7b-da67-4495-9e1d-eea0f66f2009'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.853363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] The token cache is being invalidate because project bc8e47d4316d4a8ca8ea933113738561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:05.854067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.855039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.868447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bc8e47d4316d4a8ca8ea933113738561', 'request_id': 'req-76e30d7b-da67-4495-9e1d-eea0f66f2009'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.870784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116a65-8774-42da-bdb4-98fe461656aa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:05.872579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bc8e47d4316d4a8ca8ea933113738561', 'request_id': 'req-76e30d7b-da67-4495-9e1d-eea0f66f2009'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.890672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bc8e47d4316d4a8ca8ea933113738561', 'request_id': 'req-76e30d7b-da67-4495-9e1d-eea0f66f2009'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:05.907111 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3070/6168] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:12:05 2022] DELETE /identity/v3/domains/bc8e47d4316d4a8ca8ea933113738561 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:05.908151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:05.912230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:05.966096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:05.966726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:05.967010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:05.967340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:05.968043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:05.970799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:06.023848 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3099/6169] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:05 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:06.029259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:06.034878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:06.066229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c06fd-2cca-4c0d-8a87-b57e28603bb5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:06.079010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30d7b-da67-4495-9e1d-eea0f66f2009 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:06.082125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652abfe-e393-403d-aca3-9a9e60468cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:06.083836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652abfe-e393-403d-aca3-9a9e60468cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:06.086391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652abfe-e393-403d-aca3-9a9e60468cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:06.087012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652abfe-e393-403d-aca3-9a9e60468cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:06.089709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652abfe-e393-403d-aca3-9a9e60468cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:06.095355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0153c5c-5a83-49a0-b20a-9bc4629fa515 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:06.096624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652abfe-e393-403d-aca3-9a9e60468cc7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:06.099296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0153c5c-5a83-49a0-b20a-9bc4629fa515 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:06.099723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0153c5c-5a83-49a0-b20a-9bc4629fa515 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:06.100666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0153c5c-5a83-49a0-b20a-9bc4629fa515 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:06.106436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0153c5c-5a83-49a0-b20a-9bc4629fa515 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:06.110847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0153c5c-5a83-49a0-b20a-9bc4629fa515 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:06.122707 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3100/6170] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:06.127820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652abfe-e393-403d-aca3-9a9e60468cc7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:06.141277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652abfe-e393-403d-aca3-9a9e60468cc7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:06.146608 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3071/6171] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:12:05 2022] POST /identity/v3/domains => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:06.147962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0153c5c-5a83-49a0-b20a-9bc4629fa515 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:06.270869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14cc4-4b2f-4c4c-a7fe-95c8dbcd74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:06.272367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14cc4-4b2f-4c4c-a7fe-95c8dbcd74d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:06.273783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14cc4-4b2f-4c4c-a7fe-95c8dbcd74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:06.274184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14cc4-4b2f-4c4c-a7fe-95c8dbcd74d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:06.276868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0153c5c-5a83-49a0-b20a-9bc4629fa515 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:06.277647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc14cc4-4b2f-4c4c-a7fe-95c8dbcd74d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:06.279324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc14cc4-4b2f-4c4c-a7fe-95c8dbcd74d6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:06.282662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:06.283606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:06.283896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:06.284425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/178ee148a3314dd9aa3391e002357cc3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:06.297901 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3101/6172] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:06.299147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14cc4-4b2f-4c4c-a7fe-95c8dbcd74d6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:06.301710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=178ee148a3314dd9aa3391e002357cc3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:06.303599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:06.313382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14cc4-4b2f-4c4c-a7fe-95c8dbcd74d6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:06.323902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a81e2-7ceb-41cd-b604-912330e4fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:06.325075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a81e2-7ceb-41cd-b604-912330e4fd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:06.325474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a81e2-7ceb-41cd-b604-912330e4fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:06.325859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a81e2-7ceb-41cd-b604-912330e4fd46 admin admin] PATH_INFO: `/v3/projects/96ce8f5b3827425fa697e340178b84c6/users/cab2d6ba2dfb4adfa951ce21075a3b20/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:06.333244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '178ee148a3314dd9aa3391e002357cc3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.334248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '178ee148a3314dd9aa3391e002357cc3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.348018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a81e2-7ceb-41cd-b604-912330e4fd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ce8f5b3827425fa697e340178b84c6, user_id=cab2d6ba2dfb4adfa951ce21075a3b20, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:06.351411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a81e2-7ceb-41cd-b604-912330e4fd46 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:06.376942 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3102/6173] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:06 2022] PUT /identity/v3/projects/96ce8f5b3827425fa697e340178b84c6/users/cab2d6ba2dfb4adfa951ce21075a3b20/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:06.387688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86be1f-7896-4187-beb7-5ed88a53d129 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:06.387979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86be1f-7896-4187-beb7-5ed88a53d129 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:06.388264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86be1f-7896-4187-beb7-5ed88a53d129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:06.388783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '178ee148a3314dd9aa3391e002357cc3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.389592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '178ee148a3314dd9aa3391e002357cc3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.394247 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3072/6174] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:12:06 2022] PATCH /identity/v3/domains/178ee148a3314dd9aa3391e002357cc3 => generated 250 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:06.398037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:06.400239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:06.454806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0f86be1f-7896-4187-beb7-5ed88a53d129 None None] MFA Rules not processed for user `cab2d6ba2dfb4adfa951ce21075a3b20`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:06.456566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f86be1f-7896-4187-beb7-5ed88a53d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:06.516687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f71e-613e-4d20-bb8d-6b4f1b84a788 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:06.609940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:06.610845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:06.611136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:06.611419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/178ee148a3314dd9aa3391e002357cc3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:06.628846 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3103/6175] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:06.645262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354ce57-f01c-4ea3-b428-89db39871fb4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:06.645488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354ce57-f01c-4ea3-b428-89db39871fb4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:06.645775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354ce57-f01c-4ea3-b428-89db39871fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:06.701039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=178ee148a3314dd9aa3391e002357cc3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:06.702959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:06.763576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f354ce57-f01c-4ea3-b428-89db39871fb4 None None] MFA Rules not processed for user `cab2d6ba2dfb4adfa951ce21075a3b20`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:06.765975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f354ce57-f01c-4ea3-b428-89db39871fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:06.784576 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3104/6176] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:06.790227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '178ee148a3314dd9aa3391e002357cc3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.795460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '178ee148a3314dd9aa3391e002357cc3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.801132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354ce57-f01c-4ea3-b428-89db39871fb4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:06.802690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f354ce57-f01c-4ea3-b428-89db39871fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:06.915515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178ee148a3314dd9aa3391e002357cc3', 'request_id': 'req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.936286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178ee148a3314dd9aa3391e002357cc3', 'request_id': 'req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.961194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354ce57-f01c-4ea3-b428-89db39871fb4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:06.964817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178ee148a3314dd9aa3391e002357cc3', 'request_id': 'req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.985136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] The token cache is being invalidate because project 178ee148a3314dd9aa3391e002357cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:06.985436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:06.987774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:07.008639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '178ee148a3314dd9aa3391e002357cc3', 'request_id': 'req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:07.010328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '178ee148a3314dd9aa3391e002357cc3', 'request_id': 'req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:07.018800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '178ee148a3314dd9aa3391e002357cc3', 'request_id': 'req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:07.035692 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3073/6177] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:12:06 2022] DELETE /identity/v3/domains/178ee148a3314dd9aa3391e002357cc3 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:07.041449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:07.047938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:07.099521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:07.101593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:07.102461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:07.102820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:07.105783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:07.236417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eedb8-cd95-4152-b1ec-3b31c32dc9c5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:07.249668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:07.251318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:07.251615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:07.251819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:07.251933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:07.254235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:07.257467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:07.260197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:07.275796 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3105/6178] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:07.325789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:07.328313 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3074/6179] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:12:07 2022] POST /identity/v3/domains => generated 279 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:07.348994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32099e-d1d3-463a-a7c4-2553c9b23eae service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:07.529930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:07.531630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:07.532099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:07.532552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/7bbc6eb1d1004ff88e02983afcaf24ef` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:07.566757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7bbc6eb1d1004ff88e02983afcaf24ef)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:07.569196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:07.674528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:07.678427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:07.770560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:07.772322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce8d7cb2-3677-43f2-8959-9b4ab5a3d459 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:07.779495 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3106/6180] 10.222.0.30 () {60 vars in 1249 bytes} [Sat Feb 19 21:12:07 2022] PATCH /identity/v3/domains/7bbc6eb1d1004ff88e02983afcaf24ef => generated 278 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:12:07.784180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:07.787642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:07.809239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc1ff-593d-4cf4-941e-7085bf814852 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:08.052259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148752-f062-4aa5-929b-8e10beb4e089 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:08.053177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148752-f062-4aa5-929b-8e10beb4e089 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:08.053457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148752-f062-4aa5-929b-8e10beb4e089 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:08.053732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148752-f062-4aa5-929b-8e10beb4e089 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/7bbc6eb1d1004ff88e02983afcaf24ef` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:08.061897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a02d-613a-450a-8518-3f374f7cd084 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:08.062684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a02d-613a-450a-8518-3f374f7cd084 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:08.063102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a02d-613a-450a-8518-3f374f7cd084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:08.098927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148752-f062-4aa5-929b-8e10beb4e089 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=7bbc6eb1d1004ff88e02983afcaf24ef)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:08.102291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148752-f062-4aa5-929b-8e10beb4e089 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:08.103542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fdc9a02d-613a-450a-8518-3f374f7cd084 None None] MFA Rules not processed for user `cab2d6ba2dfb4adfa951ce21075a3b20`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:08.106772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fdc9a02d-613a-450a-8518-3f374f7cd084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:08.108133 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3075/6181] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:12:07 2022] GET /identity/v3/domains/7bbc6eb1d1004ff88e02983afcaf24ef => generated 278 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:08.112302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148752-f062-4aa5-929b-8e10beb4e089 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:08.157287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148752-f062-4aa5-929b-8e10beb4e089 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:08.201226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:08.207997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:08.212985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:08.215802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/7bbc6eb1d1004ff88e02983afcaf24ef` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:08.225479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7bbc6eb1d1004ff88e02983afcaf24ef)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:08.236520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:08.347118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.352423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.402376 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3107/6182] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:08.498915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef', 'request_id': 'req-ae6a8ec1-6000-4f5e-8895-11820b7deb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.530838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef', 'request_id': 'req-ae6a8ec1-6000-4f5e-8895-11820b7deb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.559988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef', 'request_id': 'req-ae6a8ec1-6000-4f5e-8895-11820b7deb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.600705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] The token cache is being invalidate because project 7bbc6eb1d1004ff88e02983afcaf24ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:08.601401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.602273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.626320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef', 'request_id': 'req-ae6a8ec1-6000-4f5e-8895-11820b7deb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.627190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef', 'request_id': 'req-ae6a8ec1-6000-4f5e-8895-11820b7deb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.630963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7bbc6eb1d1004ff88e02983afcaf24ef', 'request_id': 'req-ae6a8ec1-6000-4f5e-8895-11820b7deb95'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:08.641333 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3076/6183] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:12:08 2022] DELETE /identity/v3/domains/7bbc6eb1d1004ff88e02983afcaf24ef => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:08.641922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9a02d-613a-450a-8518-3f374f7cd084 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:08.660925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9a02d-613a-450a-8518-3f374f7cd084 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:08.840026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4025c0-b101-4f14-9d17-714eed285474 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:08.840994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4025c0-b101-4f14-9d17-714eed285474 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:08.841396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4025c0-b101-4f14-9d17-714eed285474 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:08.841787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4025c0-b101-4f14-9d17-714eed285474 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:08.844291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4025c0-b101-4f14-9d17-714eed285474 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:08.849616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4025c0-b101-4f14-9d17-714eed285474 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:08.892047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:08.893721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:08.904427 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3108/6184] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 21:12:08 2022] GET /identity/v3/domains => generated 1347 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:12:08.915690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8ec1-6000-4f5e-8895-11820b7deb95 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:08.929344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f80a-eca8-4242-b39d-d40a0140ea78 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:08.933333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f80a-eca8-4242-b39d-d40a0140ea78 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:08.935268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f80a-eca8-4242-b39d-d40a0140ea78 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:08.935764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f80a-eca8-4242-b39d-d40a0140ea78 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/7bbc6eb1d1004ff88e02983afcaf24ef` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:08.966264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10f80a-eca8-4242-b39d-d40a0140ea78 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:12:08.990581 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-4b10f80a-eca8-4242-b39d-d40a0140ea78 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Could not find domain: 7bbc6eb1d1004ff88e02983afcaf24ef.: keystone.exception.DomainNotFound: Could not find domain: 7bbc6eb1d1004ff88e02983afcaf24ef. Feb 19 21:12:08.999061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4025c0-b101-4f14-9d17-714eed285474 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:09.011578 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3077/6185] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:12:08 2022] PATCH /identity/v3/domains/7bbc6eb1d1004ff88e02983afcaf24ef => generated 112 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:12:09.047725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4025c0-b101-4f14-9d17-714eed285474 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:09.076601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b5d59-2962-4bd9-a443-30703657f641 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:09.080899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b5d59-2962-4bd9-a443-30703657f641 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:09.084876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b5d59-2962-4bd9-a443-30703657f641 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:09.087488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b5d59-2962-4bd9-a443-30703657f641 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:09.089356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b5d59-2962-4bd9-a443-30703657f641 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:09.101455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b5d59-2962-4bd9-a443-30703657f641 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:09.166301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f80a-eca8-4242-b39d-d40a0140ea78 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:09.182758 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3109/6186] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:12:08 2022] POST /identity/v3/domains => generated 276 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:09.185575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f80a-eca8-4242-b39d-d40a0140ea78 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:09.405168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12ba8-15db-4370-a268-700dd7449cf0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:09.406069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12ba8-15db-4370-a268-700dd7449cf0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:09.406469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12ba8-15db-4370-a268-700dd7449cf0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:09.406858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12ba8-15db-4370-a268-700dd7449cf0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:09.407857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12ba8-15db-4370-a268-700dd7449cf0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:09.411737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12ba8-15db-4370-a268-700dd7449cf0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:09.530138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b5d59-2962-4bd9-a443-30703657f641 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:09.540367 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3078/6187] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:09 2022] POST /identity/v3/users => generated 348 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:09.547171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b5d59-2962-4bd9-a443-30703657f641 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:09.571101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:09.572139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:09.572828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:09.576174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:09.577450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:09.584910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:09.625058 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3110/6188] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:12:09 2022] POST /identity/v3/groups => generated 324 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:09.625696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12ba8-15db-4370-a268-700dd7449cf0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:09.691062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12ba8-15db-4370-a268-700dd7449cf0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:09.712507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:09.713813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:09.715171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:09.717311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/af8b9d4b70ba4595b0a50dfea550158a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:09.720849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=af8b9d4b70ba4595b0a50dfea550158a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:09.723374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:09.776526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:09.777538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:09.890825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:09.892060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:09.906443 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3079/6189] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:12:09 2022] PATCH /identity/v3/domains/af8b9d4b70ba4595b0a50dfea550158a => generated 277 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:09.911250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:09.915346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:09.957435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b54a-6518-4d0f-a92e-79bf8242e5e3 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:10.129044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:10.129700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:10.129990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:10.130272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/af8b9d4b70ba4595b0a50dfea550158a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:10.157667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=af8b9d4b70ba4595b0a50dfea550158a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:10.162187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:10.310491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.325295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.687862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b328fa1e6b4885a14925571a1ce3ac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.731161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b328fa1e6b4885a14925571a1ce3ac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.749216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b328fa1e6b4885a14925571a1ce3ac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.750580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b328fa1e6b4885a14925571a1ce3ac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.752657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b328fa1e6b4885a14925571a1ce3ac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.876251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a', 'request_id': 'req-baf19706-96fa-4e98-adab-08df932f1166'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.890939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a', 'request_id': 'req-baf19706-96fa-4e98-adab-08df932f1166'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.910938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a', 'request_id': 'req-baf19706-96fa-4e98-adab-08df932f1166'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.928132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] The token cache is being invalidate because project af8b9d4b70ba4595b0a50dfea550158a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:10.929355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.930438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:10.989645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a', 'request_id': 'req-baf19706-96fa-4e98-adab-08df932f1166'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:11.009080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a', 'request_id': 'req-baf19706-96fa-4e98-adab-08df932f1166'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:11.015417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'af8b9d4b70ba4595b0a50dfea550158a', 'request_id': 'req-baf19706-96fa-4e98-adab-08df932f1166'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:11.032834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:11.045871 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3111/6190] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:12:09 2022] DELETE /identity/v3/domains/af8b9d4b70ba4595b0a50dfea550158a => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:11.052431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037712eb-6333-456a-8904-4d8e107b8cdd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:11.288784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:11.289681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:11.289973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:11.291406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/af8b9d4b70ba4595b0a50dfea550158a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:11.304978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=af8b9d4b70ba4595b0a50dfea550158a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:11.307218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:11.325532 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Could not find domain: af8b9d4b70ba4595b0a50dfea550158a.: keystone.exception.DomainNotFound: Could not find domain: af8b9d4b70ba4595b0a50dfea550158a. Feb 19 21:12:11.328095 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3080/6191] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:12:11 2022] GET /identity/v3/domains/af8b9d4b70ba4595b0a50dfea550158a => generated 112 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:12:11.332164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:11.334575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:11.364790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf19706-96fa-4e98-adab-08df932f1166 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:11.377867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:11.378782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:11.379070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:11.379351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/users/c2b328fa1e6b4885a14925571a1ce3ac` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:11.398320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:get_user(user_id=c2b328fa1e6b4885a14925571a1ce3ac)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:11.400445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:11.451536 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Could not find user: c2b328fa1e6b4885a14925571a1ce3ac.: keystone.exception.UserNotFound: Could not find user: c2b328fa1e6b4885a14925571a1ce3ac. Feb 19 21:12:11.453556 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3112/6192] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:12:11 2022] GET /identity/v3/users/c2b328fa1e6b4885a14925571a1ce3ac => generated 110 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:12:11.460233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:11.479750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641cd1-32b6-4ffd-bcf4-40844767e1a6 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:11.488116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:11.489942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:11.490973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:11.491717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/groups/114ca64a41c64306b12e3afe12f1e804` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:11.498741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:get_group(group_id=114ca64a41c64306b12e3afe12f1e804)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:11.502076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:11.531112 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Could not find group: 114ca64a41c64306b12e3afe12f1e804.: keystone.exception.GroupNotFound: Could not find group: 114ca64a41c64306b12e3afe12f1e804. Feb 19 21:12:11.537639 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3081/6193] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:11 2022] GET /identity/v3/groups/114ca64a41c64306b12e3afe12f1e804 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:12:11.538782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:11.555508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff438e-f9c4-417c-99ac-1fade5e9496e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:11.571253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a87c9-5626-4a2f-9290-f1c24f3b49bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:11.572284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a87c9-5626-4a2f-9290-f1c24f3b49bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:11.572695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a87c9-5626-4a2f-9290-f1c24f3b49bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:11.573256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a87c9-5626-4a2f-9290-f1c24f3b49bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/groups/114ca64a41c64306b12e3afe12f1e804` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:11.582173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a87c9-5626-4a2f-9290-f1c24f3b49bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:12:11.605549 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-1f1a87c9-5626-4a2f-9290-f1c24f3b49bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Could not find group: 114ca64a41c64306b12e3afe12f1e804.: keystone.exception.GroupNotFound: Could not find group: 114ca64a41c64306b12e3afe12f1e804. Feb 19 21:12:11.614437 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3113/6194] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:12:11 2022] DELETE /identity/v3/groups/114ca64a41c64306b12e3afe12f1e804 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:12:11.615879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:11.635217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33019a5-fb57-4f60-8d04-e775786b61c8 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:11.641832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:11.643433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:11.643890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:11.644304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/users/c2b328fa1e6b4885a14925571a1ce3ac` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:11.663222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c2b328fa1e6b4885a14925571a1ce3ac)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:11.665244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:11.703820 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Could not find user: c2b328fa1e6b4885a14925571a1ce3ac.: keystone.exception.UserNotFound: Could not find user: c2b328fa1e6b4885a14925571a1ce3ac. Feb 19 21:12:11.711386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a87c9-5626-4a2f-9290-f1c24f3b49bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:11.711987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3082/6195] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:11 2022] DELETE /identity/v3/users/c2b328fa1e6b4885a14925571a1ce3ac => generated 110 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:12:11.729572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a87c9-5626-4a2f-9290-f1c24f3b49bd tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:11.744524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528f9fc-bc7e-4727-b1ec-7d15206fdafe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:11.745567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f9fc-bc7e-4727-b1ec-7d15206fdafe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:11.746087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f9fc-bc7e-4727-b1ec-7d15206fdafe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:11.746607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f9fc-bc7e-4727-b1ec-7d15206fdafe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/af8b9d4b70ba4595b0a50dfea550158a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:11.766305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528f9fc-bc7e-4727-b1ec-7d15206fdafe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:12:11.791220 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d528f9fc-bc7e-4727-b1ec-7d15206fdafe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Could not find domain: af8b9d4b70ba4595b0a50dfea550158a.: keystone.exception.DomainNotFound: Could not find domain: af8b9d4b70ba4595b0a50dfea550158a. Feb 19 21:12:11.794743 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3114/6196] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:12:11 2022] PATCH /identity/v3/domains/af8b9d4b70ba4595b0a50dfea550158a => generated 112 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:12:11.798751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:11.815951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9177b0-cf5d-402c-9941-be35761ef9b5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:11.831048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1668e1-6ff6-4153-907a-b51d083322b4 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:11.831901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1668e1-6ff6-4153-907a-b51d083322b4 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:11.832719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1668e1-6ff6-4153-907a-b51d083322b4 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:11.832719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1668e1-6ff6-4153-907a-b51d083322b4 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:11.833520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1668e1-6ff6-4153-907a-b51d083322b4 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:11.835331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1668e1-6ff6-4153-907a-b51d083322b4 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:11.871909 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3083/6197] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 21:12:11 2022] GET /identity/v3/domains => generated 1347 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:12:11.873364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528f9fc-bc7e-4727-b1ec-7d15206fdafe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:11.885905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528f9fc-bc7e-4727-b1ec-7d15206fdafe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:11.900619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:11.907815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:11.909654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:11.909983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:11.911226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:11.911226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:11.913621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:11.963221 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3115/6198] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:11 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:11.967494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1668e1-6ff6-4153-907a-b51d083322b4 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:12.001190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1668e1-6ff6-4153-907a-b51d083322b4 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:12.007897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:12.009083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:12.009749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:12.010259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:12.011206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-2007216436) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:12.011740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:12.013627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:12.042644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3084/6199] 10.222.0.30 () {58 vars in 1198 bytes} [Sat Feb 19 21:12:11 2022] GET /identity/v3/domains?name=tempest-test_domain-2007216436 => generated 409 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:12.048130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:12.063356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0ed64-e166-4ed9-813b-50447b27f2fe tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:12.071943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886b864-a66e-4935-adb9-593948daf7ca tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:12.072174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b864-a66e-4935-adb9-593948daf7ca tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:12.072429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b864-a66e-4935-adb9-593948daf7ca tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:12.072721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b864-a66e-4935-adb9-593948daf7ca tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/af8b9d4b70ba4595b0a50dfea550158a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:12.083975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886b864-a66e-4935-adb9-593948daf7ca tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:12:12.095946 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-6886b864-a66e-4935-adb9-593948daf7ca tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Could not find domain: af8b9d4b70ba4595b0a50dfea550158a.: keystone.exception.DomainNotFound: Could not find domain: af8b9d4b70ba4595b0a50dfea550158a. Feb 19 21:12:12.102587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:12.117335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcac4e7-b42d-4abc-9b03-6d13922ae254 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:12.117593 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3116/6200] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:12:12 2022] PATCH /identity/v3/domains/af8b9d4b70ba4595b0a50dfea550158a => generated 112 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:12:12.124076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:12.125517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:12.125959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:12.126485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/62e2386386f84ea9b3d1967fc4989b57` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:12.145708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=62e2386386f84ea9b3d1967fc4989b57)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:12.147779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:12.239297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886b864-a66e-4935-adb9-593948daf7ca tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:12.250252 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3085/6201] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:12:12 2022] PATCH /identity/v3/domains/62e2386386f84ea9b3d1967fc4989b57 => generated 276 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:12.260251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886b864-a66e-4935-adb9-593948daf7ca tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:12.270424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:12.272755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:12.273300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:12.273740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/62e2386386f84ea9b3d1967fc4989b57` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:12.291981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=62e2386386f84ea9b3d1967fc4989b57)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:12.294948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:12.342720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '62e2386386f84ea9b3d1967fc4989b57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.353537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '62e2386386f84ea9b3d1967fc4989b57'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.469588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e2386386f84ea9b3d1967fc4989b57', 'request_id': 'req-8c4e309b-049d-4d96-a852-5a473eb0950c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.481013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e2386386f84ea9b3d1967fc4989b57', 'request_id': 'req-8c4e309b-049d-4d96-a852-5a473eb0950c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.499469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e2386386f84ea9b3d1967fc4989b57', 'request_id': 'req-8c4e309b-049d-4d96-a852-5a473eb0950c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.519442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] The token cache is being invalidate because project 62e2386386f84ea9b3d1967fc4989b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:12.519737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.520797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.532886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '62e2386386f84ea9b3d1967fc4989b57', 'request_id': 'req-8c4e309b-049d-4d96-a852-5a473eb0950c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.542343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '62e2386386f84ea9b3d1967fc4989b57', 'request_id': 'req-8c4e309b-049d-4d96-a852-5a473eb0950c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.544134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '62e2386386f84ea9b3d1967fc4989b57', 'request_id': 'req-8c4e309b-049d-4d96-a852-5a473eb0950c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.561583 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3117/6202] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:12:12 2022] DELETE /identity/v3/domains/62e2386386f84ea9b3d1967fc4989b57 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:12.570824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:12.573433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:12.601019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7f85-bc13-41d4-a4e9-866a1ba496a0 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:12.744791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:12.745974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:12.746260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:12.746549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/783387c566c6421f9aa177c9299128b8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:12.760655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=783387c566c6421f9aa177c9299128b8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:12.762318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:12.790301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '783387c566c6421f9aa177c9299128b8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.790301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '783387c566c6421f9aa177c9299128b8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.860249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '783387c566c6421f9aa177c9299128b8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.860989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '783387c566c6421f9aa177c9299128b8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:12.866293 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3086/6203] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:12:12 2022] PATCH /identity/v3/domains/783387c566c6421f9aa177c9299128b8 => generated 277 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:12.870169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:12.888854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e309b-049d-4d96-a852-5a473eb0950c tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:13.039875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:13.045702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:13.046277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:13.046769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/783387c566c6421f9aa177c9299128b8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:13.067393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=783387c566c6421f9aa177c9299128b8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:13.074183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:13.138168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '783387c566c6421f9aa177c9299128b8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.148553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '783387c566c6421f9aa177c9299128b8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.228872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783387c566c6421f9aa177c9299128b8', 'request_id': 'req-7055707e-7ab9-4e2e-af79-c3c516510a0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.237978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783387c566c6421f9aa177c9299128b8', 'request_id': 'req-7055707e-7ab9-4e2e-af79-c3c516510a0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.260397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783387c566c6421f9aa177c9299128b8', 'request_id': 'req-7055707e-7ab9-4e2e-af79-c3c516510a0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.281510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] The token cache is being invalidate because project 783387c566c6421f9aa177c9299128b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:13.282241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.284168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.314316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '783387c566c6421f9aa177c9299128b8', 'request_id': 'req-7055707e-7ab9-4e2e-af79-c3c516510a0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.322591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '783387c566c6421f9aa177c9299128b8', 'request_id': 'req-7055707e-7ab9-4e2e-af79-c3c516510a0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.323760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '783387c566c6421f9aa177c9299128b8', 'request_id': 'req-7055707e-7ab9-4e2e-af79-c3c516510a0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.362242 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3118/6204] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:12:12 2022] DELETE /identity/v3/domains/783387c566c6421f9aa177c9299128b8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:13.363969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:13.370300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:13.416862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58da8ac-5a7d-4bda-925e-585128592582 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:13.575236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:13.576734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:13.577482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:13.578095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/13e61945772a423aade64a87b8ec7ca0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:13.616482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=13e61945772a423aade64a87b8ec7ca0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:13.620183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:13.675561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '13e61945772a423aade64a87b8ec7ca0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.676845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '13e61945772a423aade64a87b8ec7ca0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.789190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '13e61945772a423aade64a87b8ec7ca0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.790553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '13e61945772a423aade64a87b8ec7ca0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:13.801073 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3087/6205] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:12:13 2022] PATCH /identity/v3/domains/13e61945772a423aade64a87b8ec7ca0 => generated 278 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:13.803007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:13.809814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:13.873071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055707e-7ab9-4e2e-af79-c3c516510a0e tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:13.978384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29270b0b4614ca1b5f36fbf771ae68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f41b18de6fb749f0ad17a43235dd4432', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:13.979207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:13.979494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:13.980037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] PATH_INFO: `/v3/domains/13e61945772a423aade64a87b8ec7ca0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:13.994455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=13e61945772a423aade64a87b8ec7ca0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:13.996157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:14.027372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '13e61945772a423aade64a87b8ec7ca0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.031199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '13e61945772a423aade64a87b8ec7ca0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.171158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e61945772a423aade64a87b8ec7ca0', 'request_id': 'req-02c3558e-e36a-46c2-9ed9-563df06dddc5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.217325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e61945772a423aade64a87b8ec7ca0', 'request_id': 'req-02c3558e-e36a-46c2-9ed9-563df06dddc5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.239148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e61945772a423aade64a87b8ec7ca0', 'request_id': 'req-02c3558e-e36a-46c2-9ed9-563df06dddc5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.263509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] The token cache is being invalidate because project 13e61945772a423aade64a87b8ec7ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:14.263851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.265515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.285997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '13e61945772a423aade64a87b8ec7ca0', 'request_id': 'req-02c3558e-e36a-46c2-9ed9-563df06dddc5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.314097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '13e61945772a423aade64a87b8ec7ca0', 'request_id': 'req-02c3558e-e36a-46c2-9ed9-563df06dddc5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.320452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-02c3558e-e36a-46c2-9ed9-563df06dddc5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '13e61945772a423aade64a87b8ec7ca0', 'request_id': 'req-02c3558e-e36a-46c2-9ed9-563df06dddc5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.335625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:14.337075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:14.340458 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3119/6206] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:12:13 2022] DELETE /identity/v3/domains/13e61945772a423aade64a87b8ec7ca0 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:14.438089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f52bb-de77-423f-b849-db8bb9a5d4e5 tempest-DomainsTestJSON-320820145 tempest-DomainsTestJSON-320820145-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:14.541772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:14.543412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:14.543959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:14.546265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] PATH_INFO: `/v3/users/fb7439fa265b4c07874e71ea4338ee69` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:14.547534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7439fa265b4c07874e71ea4338ee69)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:14.550310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:14.638583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7439fa265b4c07874e71ea4338ee69'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.639828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7439fa265b4c07874e71ea4338ee69'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.648000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7439fa265b4c07874e71ea4338ee69'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.670826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7439fa265b4c07874e71ea4338ee69'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.684355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7439fa265b4c07874e71ea4338ee69'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:14.724607 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3088/6207] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:14 2022] DELETE /identity/v3/users/fb7439fa265b4c07874e71ea4338ee69 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:14.728679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b0a88-e4c1-48c2-a9ca-c01061347d85 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:14.729403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b0a88-e4c1-48c2-a9ca-c01061347d85 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:14.729871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b0a88-e4c1-48c2-a9ca-c01061347d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:14.753929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1c7b0a88-e4c1-48c2-a9ca-c01061347d85 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:14.756730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1c7b0a88-e4c1-48c2-a9ca-c01061347d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:14.847651 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3120/6208] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:14.857850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:14.860646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:14.980217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d080d8-acd4-47b3-9f8c-aa141d69acf4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:14.988709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:14.989533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:14.989915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:14.990308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:15.013694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:15.015221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:15.059296 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3089/6209] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:15.359341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb228b-9e70-429b-8ea9-ebaa59d866c7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:15.360265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb228b-9e70-429b-8ea9-ebaa59d866c7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:15.360832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb228b-9e70-429b-8ea9-ebaa59d866c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:15.426684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-32bb228b-9e70-429b-8ea9-ebaa59d866c7 None None] MFA Rules not processed for user `e261613761bb44609c8aa5b7bc3d7d90`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:15.428035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-32bb228b-9e70-429b-8ea9-ebaa59d866c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:15.602345 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3121/6210] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:15.614660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:15.616742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:15.790268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef47e7c-8aa7-4685-ab5d-b95b396e0710 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:15.799242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:15.800072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:15.800486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:15.800859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:15.803923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:15.940542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:15.944732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:15.968718 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3090/6211] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:16.166903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb228b-9e70-429b-8ea9-ebaa59d866c7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:16.168791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-32bb228b-9e70-429b-8ea9-ebaa59d866c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:16.216099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb228b-9e70-429b-8ea9-ebaa59d866c7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:16.228826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:16.230325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:16.232637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:16.233234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] PATH_INFO: `/v3/projects/6149c0df02cc4e4abf6d239f8234b289` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:16.234879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6149c0df02cc4e4abf6d239f8234b289)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:16.238481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:16.374967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6149c0df02cc4e4abf6d239f8234b289', 'request_id': 'req-bdeeb178-58ab-4638-af45-48b4ae39067c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.384731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6149c0df02cc4e4abf6d239f8234b289', 'request_id': 'req-bdeeb178-58ab-4638-af45-48b4ae39067c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.400027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6149c0df02cc4e4abf6d239f8234b289', 'request_id': 'req-bdeeb178-58ab-4638-af45-48b4ae39067c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.429324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] The token cache is being invalidate because project 6149c0df02cc4e4abf6d239f8234b289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:16.429631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.431335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.435496 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3122/6212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:16 2022] DELETE /identity/v3/projects/6149c0df02cc4e4abf6d239f8234b289 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:16.441276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:16.473786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47aa605-668a-4a4b-be24-885ff6dd98d7 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:16.590101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:16.591625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:16.592095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:16.592694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] PATH_INFO: `/v3/users/f29270b0b4614ca1b5f36fbf771ae68a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:16.595238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29270b0b4614ca1b5f36fbf771ae68a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:16.603501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:16.743450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29270b0b4614ca1b5f36fbf771ae68a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.747713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29270b0b4614ca1b5f36fbf771ae68a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.754531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29270b0b4614ca1b5f36fbf771ae68a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.797921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29270b0b4614ca1b5f36fbf771ae68a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.817055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-18605fbe-5893-4430-8fc3-c3b1d2d295dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29270b0b4614ca1b5f36fbf771ae68a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:16.832270 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3091/6213] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:16 2022] DELETE /identity/v3/users/f29270b0b4614ca1b5f36fbf771ae68a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:17.783940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:17.785468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:17.810283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeb178-58ab-4638-af45-48b4ae39067c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:18.011591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:18.012295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:18.013236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:18.013687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] PATH_INFO: `/v3/projects/f41b18de6fb749f0ad17a43235dd4432` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:18.015108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41b18de6fb749f0ad17a43235dd4432)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:18.017098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:18.112750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41b18de6fb749f0ad17a43235dd4432', 'request_id': 'req-0f179b0c-b540-482f-a032-f2e1aee1400e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:18.122484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41b18de6fb749f0ad17a43235dd4432', 'request_id': 'req-0f179b0c-b540-482f-a032-f2e1aee1400e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:18.134189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41b18de6fb749f0ad17a43235dd4432', 'request_id': 'req-0f179b0c-b540-482f-a032-f2e1aee1400e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:18.158199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] The token cache is being invalidate because project f41b18de6fb749f0ad17a43235dd4432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:18.159118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:18.159947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0f179b0c-b540-482f-a032-f2e1aee1400e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:18.162269 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3123/6214] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:17 2022] DELETE /identity/v3/projects/f41b18de6fb749f0ad17a43235dd4432 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:18.173777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779c28-f601-4ec5-a1fb-8881f83d4044 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:18.174259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779c28-f601-4ec5-a1fb-8881f83d4044 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:18.174396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779c28-f601-4ec5-a1fb-8881f83d4044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:18.219238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-60779c28-f601-4ec5-a1fb-8881f83d4044 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:18.221147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-60779c28-f601-4ec5-a1fb-8881f83d4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:18.359474 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3092/6215] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:18.368384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff45f4-6c7d-4e04-b594-5367a285a5df None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:18.369046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff45f4-6c7d-4e04-b594-5367a285a5df None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:18.369422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff45f4-6c7d-4e04-b594-5367a285a5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:18.390237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d784c-a558-49e9-89b7-dbf028d55190 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:18.390730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d784c-a558-49e9-89b7-dbf028d55190 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:18.391187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d784c-a558-49e9-89b7-dbf028d55190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:18.455006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2fff45f4-6c7d-4e04-b594-5367a285a5df None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:18.456733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2fff45f4-6c7d-4e04-b594-5367a285a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:18.464146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-246d784c-a558-49e9-89b7-dbf028d55190 None None] MFA Rules not processed for user `b9e2bf42ef6446c69f1775a25ef76a92`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:18.465724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-246d784c-a558-49e9-89b7-dbf028d55190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:18.476680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3124/6216] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:18.483186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff45f4-6c7d-4e04-b594-5367a285a5df None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:18.495699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff45f4-6c7d-4e04-b594-5367a285a5df None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:18.515042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:18.516206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:18.516717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:18.521501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:18.523564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:18.524705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:18.527556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:18.568506 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3125/6217] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:18.572630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:18.599098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ab17d-b8b4-4c5f-b812-2be064a621f0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:18.618963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563c51f-9331-4af2-910c-4d79122aa12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:18.619988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563c51f-9331-4af2-910c-4d79122aa12f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:18.620557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563c51f-9331-4af2-910c-4d79122aa12f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:18.621020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563c51f-9331-4af2-910c-4d79122aa12f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:18.623472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563c51f-9331-4af2-910c-4d79122aa12f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:18.624483 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3093/6218] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:18.648939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563c51f-9331-4af2-910c-4d79122aa12f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:18.754661 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3126/6219] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:18 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:18.755863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d784c-a558-49e9-89b7-dbf028d55190 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:18.769187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d784c-a558-49e9-89b7-dbf028d55190 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:18.880451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c96db-e897-478a-a82d-5e34c0e641bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:18.881800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c96db-e897-478a-a82d-5e34c0e641bd admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:18.882201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c96db-e897-478a-a82d-5e34c0e641bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:18.882728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c96db-e897-478a-a82d-5e34c0e641bd admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:18.883539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c96db-e897-478a-a82d-5e34c0e641bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:18.885690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c96db-e897-478a-a82d-5e34c0e641bd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:18.934398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3094/6220] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:18 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:18.938112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563c51f-9331-4af2-910c-4d79122aa12f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:18.951345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563c51f-9331-4af2-910c-4d79122aa12f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:18.965028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7f1d7-dc00-407d-ab3e-b5b80a044a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:18.968100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f1d7-dc00-407d-ab3e-b5b80a044a28 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:18.969471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f1d7-dc00-407d-ab3e-b5b80a044a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:18.972533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f1d7-dc00-407d-ab3e-b5b80a044a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:18.974724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7f1d7-dc00-407d-ab3e-b5b80a044a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:18.978758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7f1d7-dc00-407d-ab3e-b5b80a044a28 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:19.001587 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3127/6221] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:19.006288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c96db-e897-478a-a82d-5e34c0e641bd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:19.027723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c96db-e897-478a-a82d-5e34c0e641bd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:19.045586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358e959-6639-4bbc-9eee-d25140d42ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:19.046894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e959-6639-4bbc-9eee-d25140d42ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:19.047284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e959-6639-4bbc-9eee-d25140d42ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:19.047807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e959-6639-4bbc-9eee-d25140d42ed9 admin admin] PATH_INFO: `/v3/projects/52e137da767946fd82dcc728a2cc58a3/users/8ac6ca74e12a472eba140ed648c04d0d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:19.093503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358e959-6639-4bbc-9eee-d25140d42ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e137da767946fd82dcc728a2cc58a3, user_id=8ac6ca74e12a472eba140ed648c04d0d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:19.097705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358e959-6639-4bbc-9eee-d25140d42ed9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:19.137117 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3095/6222] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:19 2022] PUT /identity/v3/projects/52e137da767946fd82dcc728a2cc58a3/users/8ac6ca74e12a472eba140ed648c04d0d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:19.141499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7f1d7-dc00-407d-ab3e-b5b80a044a28 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:19.154740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7f1d7-dc00-407d-ab3e-b5b80a044a28 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:19.238499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44334768-5cec-44d6-9e30-d511840ed1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:19.240631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44334768-5cec-44d6-9e30-d511840ed1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:19.241908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44334768-5cec-44d6-9e30-d511840ed1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:19.242438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44334768-5cec-44d6-9e30-d511840ed1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:19.245346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44334768-5cec-44d6-9e30-d511840ed1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:19.253540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44334768-5cec-44d6-9e30-d511840ed1f5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:19.275909 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3128/6223] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:19.281247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358e959-6639-4bbc-9eee-d25140d42ed9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:19.303902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358e959-6639-4bbc-9eee-d25140d42ed9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:19.317746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:19.319600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:19.320109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:19.320630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] PATH_INFO: `/v3/projects/52e137da767946fd82dcc728a2cc58a3/users/8ac6ca74e12a472eba140ed648c04d0d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:19.323114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e137da767946fd82dcc728a2cc58a3, user_id=8ac6ca74e12a472eba140ed648c04d0d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:19.326779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:19.358831 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3096/6224] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:19 2022] PUT /identity/v3/projects/52e137da767946fd82dcc728a2cc58a3/users/8ac6ca74e12a472eba140ed648c04d0d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:19.370836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98786b-b585-4f78-8784-bfab8a5cad12 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:19.371631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98786b-b585-4f78-8784-bfab8a5cad12 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:19.372139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98786b-b585-4f78-8784-bfab8a5cad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:19.445561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2d98786b-b585-4f78-8784-bfab8a5cad12 None None] MFA Rules not processed for user `8ac6ca74e12a472eba140ed648c04d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:19.448640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2d98786b-b585-4f78-8784-bfab8a5cad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:19.564623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:19.567067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:19.653445 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3129/6225] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:19.654724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a67cb-f50b-4fb5-940e-43d761af9c0e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:19.655120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a67cb-f50b-4fb5-940e-43d761af9c0e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:19.655527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a67cb-f50b-4fb5-940e-43d761af9c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:19.692826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d51de-e5b0-4096-8c31-9e5d7db9baa9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:19.695524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5a7a67cb-f50b-4fb5-940e-43d761af9c0e None None] MFA Rules not processed for user `9f1e1cafad4f475dad7bc93b50312279`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:19.698803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5a7a67cb-f50b-4fb5-940e-43d761af9c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:19.723150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:19.724099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:19.725054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:19.725683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:19.729896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:19.760907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:19.762648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:19.780271 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3097/6226] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:12:19.787784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:19.801695 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3130/6227] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:19.937987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac1fe-54a7-425d-86b4-80a55497a105 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:19.955984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeff29-7217-4cbc-abb2-8c01e239f08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:19.956868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeff29-7217-4cbc-abb2-8c01e239f08f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:19.957255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeff29-7217-4cbc-abb2-8c01e239f08f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:19.957858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeff29-7217-4cbc-abb2-8c01e239f08f admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:19.958681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeff29-7217-4cbc-abb2-8c01e239f08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:19.960803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeff29-7217-4cbc-abb2-8c01e239f08f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:20.026926 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3098/6228] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:19 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:20.029035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a67cb-f50b-4fb5-940e-43d761af9c0e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:20.046526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a67cb-f50b-4fb5-940e-43d761af9c0e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:20.150311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6fa1c-05ad-4148-9454-4a8782ee7ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:20.151244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fa1c-05ad-4148-9454-4a8782ee7ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:20.151675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fa1c-05ad-4148-9454-4a8782ee7ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:20.152193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fa1c-05ad-4148-9454-4a8782ee7ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:20.153277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6fa1c-05ad-4148-9454-4a8782ee7ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:20.156436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6fa1c-05ad-4148-9454-4a8782ee7ad4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:20.189258 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3131/6229] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:20 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:20.191885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeff29-7217-4cbc-abb2-8c01e239f08f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:20.215629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeff29-7217-4cbc-abb2-8c01e239f08f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:20.228781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754f671-40f8-461d-bffd-a44db95f1d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:20.230145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f671-40f8-461d-bffd-a44db95f1d38 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:20.231248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f671-40f8-461d-bffd-a44db95f1d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:20.231890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f671-40f8-461d-bffd-a44db95f1d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:20.233495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754f671-40f8-461d-bffd-a44db95f1d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:20.235747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754f671-40f8-461d-bffd-a44db95f1d38 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:20.265130 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3099/6230] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:20.273351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6fa1c-05ad-4148-9454-4a8782ee7ad4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:20.290497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6fa1c-05ad-4148-9454-4a8782ee7ad4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:20.296951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dc5e2-609d-4375-bc5c-9a9ff33d3b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:20.298012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dc5e2-609d-4375-bc5c-9a9ff33d3b12 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:20.298531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dc5e2-609d-4375-bc5c-9a9ff33d3b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:20.299291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dc5e2-609d-4375-bc5c-9a9ff33d3b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:20.300752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dc5e2-609d-4375-bc5c-9a9ff33d3b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:20.305581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dc5e2-609d-4375-bc5c-9a9ff33d3b12 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:20.320263 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3132/6231] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:20.324281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754f671-40f8-461d-bffd-a44db95f1d38 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:20.344200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754f671-40f8-461d-bffd-a44db95f1d38 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:20.371764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:20.372988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:20.374421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:20.375456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] PATH_INFO: `/v3/projects/08356910b496401f980e63c53a3c9c18/users/2139749361124a599baf5d5a952eab30/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:20.415503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08356910b496401f980e63c53a3c9c18, user_id=2139749361124a599baf5d5a952eab30, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:20.418879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:20.442651 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3100/6232] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:20 2022] PUT /identity/v3/projects/08356910b496401f980e63c53a3c9c18/users/2139749361124a599baf5d5a952eab30/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:20.460440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55e37-740c-4bec-b2da-29b589588d4a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:20.460736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55e37-740c-4bec-b2da-29b589588d4a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:20.461018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55e37-740c-4bec-b2da-29b589588d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:20.539480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e9b55e37-740c-4bec-b2da-29b589588d4a None None] MFA Rules not processed for user `2139749361124a599baf5d5a952eab30`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:20.544554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e9b55e37-740c-4bec-b2da-29b589588d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:20.685088 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3133/6233] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:20.685764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:20.687783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:20.790689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50123e9-0645-482e-8093-7cd83f1b7884 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:20.795906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:20.797309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:20.798690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:20.799849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:20.823870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b55e37-740c-4bec-b2da-29b589588d4a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:20.895125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:20.897519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:20.917472 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3101/6234] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:12:20.971700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b55e37-740c-4bec-b2da-29b589588d4a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:20.999898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91cfed-b267-4bb2-b146-fe85bcc319ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:21.001130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91cfed-b267-4bb2-b146-fe85bcc319ce service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:21.001624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91cfed-b267-4bb2-b146-fe85bcc319ce service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:21.002015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91cfed-b267-4bb2-b146-fe85bcc319ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:21.006205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2c91cfed-b267-4bb2-b146-fe85bcc319ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:21.045370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91cfed-b267-4bb2-b146-fe85bcc319ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:21.049687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91cfed-b267-4bb2-b146-fe85bcc319ce service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:21.079584 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3134/6235] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:21.273600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:21.275145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:21.469888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3aac5-ca16-4785-9bd3-bb61a2bae9d2 service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:21.478345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:21.479542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:21.479837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:21.480115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] PATH_INFO: `/v3/users/ef193c97843640f2a608cf7cf1123c2e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:21.489544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef193c97843640f2a608cf7cf1123c2e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:21.491731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:21.630854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef193c97843640f2a608cf7cf1123c2e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:21.631878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef193c97843640f2a608cf7cf1123c2e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:21.636025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef193c97843640f2a608cf7cf1123c2e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:21.662511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef193c97843640f2a608cf7cf1123c2e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:21.686044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef193c97843640f2a608cf7cf1123c2e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:21.713618 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3102/6236] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:21 2022] DELETE /identity/v3/users/ef193c97843640f2a608cf7cf1123c2e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:21.715498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaff42-b4ca-4c19-b73c-9230b319d4f2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:21.715798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaff42-b4ca-4c19-b73c-9230b319d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:21.716083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaff42-b4ca-4c19-b73c-9230b319d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:21.757351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8deaff42-b4ca-4c19-b73c-9230b319d4f2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:21.762849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8deaff42-b4ca-4c19-b73c-9230b319d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:21.932747 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3135/6237] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:21.954422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:21.956522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:22.103748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e109cb7-7d15-4b5d-b155-3fafc78c42b8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:22.114138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8cdb-ed93-4ba4-a6c1-47b278f92945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:22.114822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8cdb-ed93-4ba4-a6c1-47b278f92945 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:22.115100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8cdb-ed93-4ba4-a6c1-47b278f92945 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:22.115376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8cdb-ed93-4ba4-a6c1-47b278f92945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:22.160664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8cdb-ed93-4ba4-a6c1-47b278f92945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:22.162222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8cdb-ed93-4ba4-a6c1-47b278f92945 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:22.198902 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3103/6238] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:12:22.234773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaff42-b4ca-4c19-b73c-9230b319d4f2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:22.236415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8deaff42-b4ca-4c19-b73c-9230b319d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:22.257519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaff42-b4ca-4c19-b73c-9230b319d4f2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:22.275896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:22.278867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:22.280653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:22.281203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] PATH_INFO: `/v3/users/8ac6ca74e12a472eba140ed648c04d0d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:22.286517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac6ca74e12a472eba140ed648c04d0d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:22.304298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:22.465193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac6ca74e12a472eba140ed648c04d0d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:22.505066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac6ca74e12a472eba140ed648c04d0d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:22.525256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac6ca74e12a472eba140ed648c04d0d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:22.526268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac6ca74e12a472eba140ed648c04d0d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:22.527085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac6ca74e12a472eba140ed648c04d0d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:22.550355 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3136/6239] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:22 2022] DELETE /identity/v3/users/8ac6ca74e12a472eba140ed648c04d0d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:22.555211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf367c-2b57-4bb2-a0e0-1372a7728569 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:22.556819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf367c-2b57-4bb2-a0e0-1372a7728569 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:22.556819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf367c-2b57-4bb2-a0e0-1372a7728569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:22.620585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0dcf367c-2b57-4bb2-a0e0-1372a7728569 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:22.623998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0dcf367c-2b57-4bb2-a0e0-1372a7728569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:22.782582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:22.785016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:22.856652 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3104/6240] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:22.867350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf367c-2b57-4bb2-a0e0-1372a7728569 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:22.869909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0dcf367c-2b57-4bb2-a0e0-1372a7728569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:22.992723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf367c-2b57-4bb2-a0e0-1372a7728569 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:23.005760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:23.006441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:23.006726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:23.007007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:23.031783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6a647-42aa-4d94-b656-6b73afdc8304 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:23.038981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f48d-84c5-4325-8d67-d280e7326cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:23.039958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f48d-84c5-4325-8d67-d280e7326cbd service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:23.040600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f48d-84c5-4325-8d67-d280e7326cbd service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:23.041220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f48d-84c5-4325-8d67-d280e7326cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:23.043748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4317f48d-84c5-4325-8d67-d280e7326cbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:23.050396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:23.054871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:23.071046 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3105/6241] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:12:23.167501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317f48d-84c5-4325-8d67-d280e7326cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:23.169719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317f48d-84c5-4325-8d67-d280e7326cbd service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:23.193717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:23.195432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:23.215276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13552a9-a5f1-4d9a-b025-c18b1400348c service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:23.223818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:23.227003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:23.227805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:23.229233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] PATH_INFO: `/v3/projects/cee4744beaf9494c8d9acc68770cec52` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:23.234694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee4744beaf9494c8d9acc68770cec52)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:23.243301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:23.289169 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3137/6242] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:12:23.355676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee4744beaf9494c8d9acc68770cec52', 'request_id': 'req-63da952d-0fff-4a22-b310-990a996c3c54'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:23.405315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee4744beaf9494c8d9acc68770cec52', 'request_id': 'req-63da952d-0fff-4a22-b310-990a996c3c54'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:23.449895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee4744beaf9494c8d9acc68770cec52', 'request_id': 'req-63da952d-0fff-4a22-b310-990a996c3c54'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:23.487696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] The token cache is being invalidate because project cee4744beaf9494c8d9acc68770cec52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:23.492093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:23.495140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-63da952d-0fff-4a22-b310-990a996c3c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:23.500057 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3106/6243] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:23 2022] DELETE /identity/v3/projects/cee4744beaf9494c8d9acc68770cec52 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:23.506054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842ce0-967e-493a-ba82-0302e5d16aaf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:23.506351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842ce0-967e-493a-ba82-0302e5d16aaf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:23.506642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842ce0-967e-493a-ba82-0302e5d16aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:23.567874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-68842ce0-967e-493a-ba82-0302e5d16aaf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:23.580609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-68842ce0-967e-493a-ba82-0302e5d16aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:23.832762 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3138/6244] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:23.840147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12a5b-b5e0-4774-83c6-26f334b7e389 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:23.842259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12a5b-b5e0-4774-83c6-26f334b7e389 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:23.842740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12a5b-b5e0-4774-83c6-26f334b7e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:23.873115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-18f12a5b-b5e0-4774-83c6-26f334b7e389 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:23.875023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-18f12a5b-b5e0-4774-83c6-26f334b7e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:23.894474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68842ce0-967e-493a-ba82-0302e5d16aaf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:23.905447 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3107/6245] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:23.918612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68842ce0-967e-493a-ba82-0302e5d16aaf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:23.925854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:23.927612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:23.928063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:23.928843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:23.930418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:23.930890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:23.932777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:23.953397 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3139/6246] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:23.960316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12a5b-b5e0-4774-83c6-26f334b7e389 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:23.990127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12a5b-b5e0-4774-83c6-26f334b7e389 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:23.998075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aed28c-6350-427d-8bf7-4a5124961299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:24.000206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed28c-6350-427d-8bf7-4a5124961299 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:24.000862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed28c-6350-427d-8bf7-4a5124961299 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:24.001301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed28c-6350-427d-8bf7-4a5124961299 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:24.003317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aed28c-6350-427d-8bf7-4a5124961299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:24.005693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aed28c-6350-427d-8bf7-4a5124961299 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:24.042720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:24.044928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:24.052728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3108/6247] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:23 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:24.056092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aed28c-6350-427d-8bf7-4a5124961299 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:24.085631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef302f14-df7b-4770-9f01-236b6d64f12c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:24.214908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aed28c-6350-427d-8bf7-4a5124961299 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:24.220026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:24.225928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:24.228277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:24.229250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] PATH_INFO: `/v3/projects/52e137da767946fd82dcc728a2cc58a3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:24.234164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e137da767946fd82dcc728a2cc58a3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:24.239571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6a242-e274-4a1b-92e7-5266a894ad71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:24.240625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a242-e274-4a1b-92e7-5266a894ad71 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:24.241044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a242-e274-4a1b-92e7-5266a894ad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:24.241586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:24.245359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6a242-e274-4a1b-92e7-5266a894ad71 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:24.247068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6a242-e274-4a1b-92e7-5266a894ad71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:24.250536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6a242-e274-4a1b-92e7-5266a894ad71 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:24.287187 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3109/6248] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:24 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:24.291749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6a242-e274-4a1b-92e7-5266a894ad71 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:24.311357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6a242-e274-4a1b-92e7-5266a894ad71 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:24.318411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a646000-934c-42ed-b45e-94d1c027a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:24.319665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646000-934c-42ed-b45e-94d1c027a7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:24.320136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646000-934c-42ed-b45e-94d1c027a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:24.320595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646000-934c-42ed-b45e-94d1c027a7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:24.321748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a646000-934c-42ed-b45e-94d1c027a7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:24.323658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a646000-934c-42ed-b45e-94d1c027a7b7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:24.339106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e137da767946fd82dcc728a2cc58a3', 'request_id': 'req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.341796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3110/6249] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:12:24.342750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a646000-934c-42ed-b45e-94d1c027a7b7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:24.363310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e137da767946fd82dcc728a2cc58a3', 'request_id': 'req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.370596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a646000-934c-42ed-b45e-94d1c027a7b7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:24.394075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e137da767946fd82dcc728a2cc58a3', 'request_id': 'req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.410636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] The token cache is being invalidate because project 52e137da767946fd82dcc728a2cc58a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:24.411275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.412174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.414494 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3140/6250] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:24 2022] DELETE /identity/v3/projects/52e137da767946fd82dcc728a2cc58a3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:24.422088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:24.423708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:24.459209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:24.460363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:24.461019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:24.461591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:24.462641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:24.464745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:24.506996 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3111/6251] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:24.521842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:24.524364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:24.551490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a80c6-1392-4c41-9ec9-ce67a8e0c1b7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:24.552199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaff4-802d-4e92-9e93-b405acee2c83 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:24.559616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727756d-a03a-434d-b441-e3513a51b339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:24.560859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727756d-a03a-434d-b441-e3513a51b339 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:24.561241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727756d-a03a-434d-b441-e3513a51b339 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:24.561527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727756d-a03a-434d-b441-e3513a51b339 admin admin] PATH_INFO: `/v3/projects/dfacc4277e4443cdb5d2b7a87c49908a/users/6666f8c29ad543b4b0ab2289c09e930c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:24.569589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:24.570490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:24.570772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:24.571047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] PATH_INFO: `/v3/users/2139749361124a599baf5d5a952eab30` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:24.577526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2139749361124a599baf5d5a952eab30)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:24.581984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:24.596743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727756d-a03a-434d-b441-e3513a51b339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfacc4277e4443cdb5d2b7a87c49908a, user_id=6666f8c29ad543b4b0ab2289c09e930c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:24.605345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727756d-a03a-434d-b441-e3513a51b339 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:24.626955 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3112/6252] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:24 2022] PUT /identity/v3/projects/dfacc4277e4443cdb5d2b7a87c49908a/users/6666f8c29ad543b4b0ab2289c09e930c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:24.640266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300dff1-cb9d-4186-9c54-c690cb81f87a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:24.640598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300dff1-cb9d-4186-9c54-c690cb81f87a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:24.643439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300dff1-cb9d-4186-9c54-c690cb81f87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:24.775359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8300dff1-cb9d-4186-9c54-c690cb81f87a None None] MFA Rules not processed for user `6666f8c29ad543b4b0ab2289c09e930c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:24.778722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8300dff1-cb9d-4186-9c54-c690cb81f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:24.797223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2139749361124a599baf5d5a952eab30'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.827018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2139749361124a599baf5d5a952eab30'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.847679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2139749361124a599baf5d5a952eab30'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.848651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2139749361124a599baf5d5a952eab30'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.849276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2139749361124a599baf5d5a952eab30'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:24.897352 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3141/6253] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:24 2022] DELETE /identity/v3/users/2139749361124a599baf5d5a952eab30 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:25.013733 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3113/6254] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:25.050114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:25.053701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:25.227138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7c77c-1a62-4d7c-a124-2d0cda78da91 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:25.242279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77192be4-1cb8-472c-9fc5-29b1e79f91d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:25.243118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77192be4-1cb8-472c-9fc5-29b1e79f91d0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:25.243505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77192be4-1cb8-472c-9fc5-29b1e79f91d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:25.244762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77192be4-1cb8-472c-9fc5-29b1e79f91d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:25.353477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77192be4-1cb8-472c-9fc5-29b1e79f91d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:25.355378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77192be4-1cb8-472c-9fc5-29b1e79f91d0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:25.368009 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3142/6255] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:26.597293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300dff1-cb9d-4186-9c54-c690cb81f87a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:26.598975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8300dff1-cb9d-4186-9c54-c690cb81f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:26.752309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300dff1-cb9d-4186-9c54-c690cb81f87a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:26.850751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:26.852240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:26.852749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:26.853128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] PATH_INFO: `/v3/projects/08356910b496401f980e63c53a3c9c18` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:26.854957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=08356910b496401f980e63c53a3c9c18)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:26.857237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:26.926430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08356910b496401f980e63c53a3c9c18', 'request_id': 'req-b8005426-2588-4336-bed3-6a80ef3af3cf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:26.934339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08356910b496401f980e63c53a3c9c18', 'request_id': 'req-b8005426-2588-4336-bed3-6a80ef3af3cf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:26.947242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08356910b496401f980e63c53a3c9c18', 'request_id': 'req-b8005426-2588-4336-bed3-6a80ef3af3cf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:26.964502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] The token cache is being invalidate because project 08356910b496401f980e63c53a3c9c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:26.965255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:26.966832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b8005426-2588-4336-bed3-6a80ef3af3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:26.968957 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3114/6256] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:26 2022] DELETE /identity/v3/projects/08356910b496401f980e63c53a3c9c18 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:26.976085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5de4-75d8-4e3f-9008-d5d95eb6bfaa None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:26.976827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5de4-75d8-4e3f-9008-d5d95eb6bfaa None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:26.976827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5de4-75d8-4e3f-9008-d5d95eb6bfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.009871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-eb8f5de4-75d8-4e3f-9008-d5d95eb6bfaa None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:27.011108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eb8f5de4-75d8-4e3f-9008-d5d95eb6bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:27.149134 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3143/6257] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:27.156974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2288-727e-4bff-b4fe-b375a3a9f85b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:27.157503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2288-727e-4bff-b4fe-b375a3a9f85b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:27.158243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2288-727e-4bff-b4fe-b375a3a9f85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.216542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-aa8c2288-727e-4bff-b4fe-b375a3a9f85b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:27.218242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aa8c2288-727e-4bff-b4fe-b375a3a9f85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:27.232108 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3115/6258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:27.236266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f5de4-75d8-4e3f-9008-d5d95eb6bfaa None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:27.254780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f5de4-75d8-4e3f-9008-d5d95eb6bfaa None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:27.262608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:27.263551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:27.264047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:27.264572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.265875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:27.266409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:27.269220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:27.285283 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3144/6259] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:27.289484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c2288-727e-4bff-b4fe-b375a3a9f85b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:27.309944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c2288-727e-4bff-b4fe-b375a3a9f85b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:27.316807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b293f5-599b-4a29-905f-fb4fcaad3ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:27.317901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b293f5-599b-4a29-905f-fb4fcaad3ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:27.318450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b293f5-599b-4a29-905f-fb4fcaad3ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:27.318876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b293f5-599b-4a29-905f-fb4fcaad3ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.320798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b293f5-599b-4a29-905f-fb4fcaad3ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:27.323509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b293f5-599b-4a29-905f-fb4fcaad3ee6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:27.365689 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3116/6260] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:27 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:27.371293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:27.383897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc12ea-76d4-49c3-8f4a-5d80b59a5618 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:27.471898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c368d7-7d35-4778-a36e-99f80a3f8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:27.473072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c368d7-7d35-4778-a36e-99f80a3f8aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:27.473525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c368d7-7d35-4778-a36e-99f80a3f8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:27.474171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c368d7-7d35-4778-a36e-99f80a3f8aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.475463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c368d7-7d35-4778-a36e-99f80a3f8aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:27.478611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c368d7-7d35-4778-a36e-99f80a3f8aa8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:27.509681 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3145/6261] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:27 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:27.513878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b293f5-599b-4a29-905f-fb4fcaad3ee6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:27.533783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b293f5-599b-4a29-905f-fb4fcaad3ee6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:27.544134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efac7f-80ec-4ea4-bfb3-bb7f74d0af15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:27.544931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efac7f-80ec-4ea4-bfb3-bb7f74d0af15 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:27.545215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efac7f-80ec-4ea4-bfb3-bb7f74d0af15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:27.545494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efac7f-80ec-4ea4-bfb3-bb7f74d0af15 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.546463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efac7f-80ec-4ea4-bfb3-bb7f74d0af15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:27.548351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efac7f-80ec-4ea4-bfb3-bb7f74d0af15 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:27.565006 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3117/6262] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:27.568934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c368d7-7d35-4778-a36e-99f80a3f8aa8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:27.584982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c368d7-7d35-4778-a36e-99f80a3f8aa8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:27.605214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80e0ba-e72d-411d-8b49-5d613a8ce2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:27.606008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e0ba-e72d-411d-8b49-5d613a8ce2cd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:27.606371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e0ba-e72d-411d-8b49-5d613a8ce2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:27.606715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e0ba-e72d-411d-8b49-5d613a8ce2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.607544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80e0ba-e72d-411d-8b49-5d613a8ce2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:27.610196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80e0ba-e72d-411d-8b49-5d613a8ce2cd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:27.636817 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3146/6263] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:27.637019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efac7f-80ec-4ea4-bfb3-bb7f74d0af15 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:27.663641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efac7f-80ec-4ea4-bfb3-bb7f74d0af15 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:27.677426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:27.678349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:27.678634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:27.678922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] PATH_INFO: `/v3/projects/a098755065344f6ea1dd33391d4eaafe/users/90a3b0f7ba654c7eb25df81c7f345600/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.717669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a098755065344f6ea1dd33391d4eaafe, user_id=90a3b0f7ba654c7eb25df81c7f345600, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:27.723695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:27.762242 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3118/6264] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:27 2022] PUT /identity/v3/projects/a098755065344f6ea1dd33391d4eaafe/users/90a3b0f7ba654c7eb25df81c7f345600/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:27.776230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e654d-1a3a-4a17-bf74-a58252d891b5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:27.776572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e654d-1a3a-4a17-bf74-a58252d891b5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:27.776818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e654d-1a3a-4a17-bf74-a58252d891b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:27.823649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-028e654d-1a3a-4a17-bf74-a58252d891b5 None None] MFA Rules not processed for user `90a3b0f7ba654c7eb25df81c7f345600`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:27.826297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-028e654d-1a3a-4a17-bf74-a58252d891b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:27.922514 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3147/6265] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:27.939792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:27.944608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:28.080930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe28cbc-7fde-4c71-bbc3-ebbc04545e2b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:28.086087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc42a9-caf1-4564-93b6-a6742585ebf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:28.086877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc42a9-caf1-4564-93b6-a6742585ebf2 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:28.087407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc42a9-caf1-4564-93b6-a6742585ebf2 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:28.087783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc42a9-caf1-4564-93b6-a6742585ebf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:28.101721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc42a9-caf1-4564-93b6-a6742585ebf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:28.103326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc42a9-caf1-4564-93b6-a6742585ebf2 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:28.136773 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3119/6266] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:29.417740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e654d-1a3a-4a17-bf74-a58252d891b5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:29.525270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e654d-1a3a-4a17-bf74-a58252d891b5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:29.532613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:29.534039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:29.537791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:29.538314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] PATH_INFO: `/v3/users/90a3b0f7ba654c7eb25df81c7f345600` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:29.542988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a3b0f7ba654c7eb25df81c7f345600)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:29.547701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:29.640084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a3b0f7ba654c7eb25df81c7f345600'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:29.653954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a3b0f7ba654c7eb25df81c7f345600'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:29.664697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a3b0f7ba654c7eb25df81c7f345600'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:29.665681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a3b0f7ba654c7eb25df81c7f345600'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:29.667828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a3b0f7ba654c7eb25df81c7f345600'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:29.685323 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3148/6267] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:29 2022] DELETE /identity/v3/users/90a3b0f7ba654c7eb25df81c7f345600 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:29.691501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166388c-9304-4b4b-ac5f-0538cc51f3ce None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:29.692047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166388c-9304-4b4b-ac5f-0538cc51f3ce None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:29.692153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166388c-9304-4b4b-ac5f-0538cc51f3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:29.723541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a166388c-9304-4b4b-ac5f-0538cc51f3ce None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:29.725310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a166388c-9304-4b4b-ac5f-0538cc51f3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:29.837653 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3120/6268] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:29.886617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:29.888644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:30.043935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85c480-1764-4e9e-9330-86e50a7e9266 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:30.067931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:30.068641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:30.068780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166388c-9304-4b4b-ac5f-0538cc51f3ce None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:30.069028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:30.071840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a166388c-9304-4b4b-ac5f-0538cc51f3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:30.075247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:30.118642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:30.123013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:30.155345 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3149/6269] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:30.274819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166388c-9304-4b4b-ac5f-0538cc51f3ce None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:30.282969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd53fd-855f-4ffb-b4cd-1228b396601b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:30.283885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd53fd-855f-4ffb-b4cd-1228b396601b service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:30.284176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd53fd-855f-4ffb-b4cd-1228b396601b service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:30.284545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd53fd-855f-4ffb-b4cd-1228b396601b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:30.290838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-45dd53fd-855f-4ffb-b4cd-1228b396601b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:30.310975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd53fd-855f-4ffb-b4cd-1228b396601b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:30.313706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd53fd-855f-4ffb-b4cd-1228b396601b service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:30.334608 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3121/6270] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:32.168212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:32.170611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:32.249302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a49750-1a56-4dde-b0a5-af1c20e0e77f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:32.267910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:32.269035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:32.269562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:32.270190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] PATH_INFO: `/v3/projects/a098755065344f6ea1dd33391d4eaafe` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:32.271685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a098755065344f6ea1dd33391d4eaafe)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:32.275670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:32.351969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a098755065344f6ea1dd33391d4eaafe', 'request_id': 'req-afdb0cc6-1255-4e0a-b433-734b6717f41f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:32.362597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a098755065344f6ea1dd33391d4eaafe', 'request_id': 'req-afdb0cc6-1255-4e0a-b433-734b6717f41f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:32.380464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a098755065344f6ea1dd33391d4eaafe', 'request_id': 'req-afdb0cc6-1255-4e0a-b433-734b6717f41f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:32.416491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] The token cache is being invalidate because project a098755065344f6ea1dd33391d4eaafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:32.417549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:32.418440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afdb0cc6-1255-4e0a-b433-734b6717f41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:32.427660 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3150/6271] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:32 2022] DELETE /identity/v3/projects/a098755065344f6ea1dd33391d4eaafe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:32.429696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5460a4-322c-47af-a0a1-a12e5b6547b9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:32.430192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5460a4-322c-47af-a0a1-a12e5b6547b9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:32.430291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5460a4-322c-47af-a0a1-a12e5b6547b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:32.473306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9d5460a4-322c-47af-a0a1-a12e5b6547b9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:32.474557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9d5460a4-322c-47af-a0a1-a12e5b6547b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:32.635230 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3122/6272] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:32.649735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce699c6b-9f1b-4f0a-b88e-153c191df8d6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:32.650088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce699c6b-9f1b-4f0a-b88e-153c191df8d6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:32.650321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce699c6b-9f1b-4f0a-b88e-153c191df8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:32.721378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ce699c6b-9f1b-4f0a-b88e-153c191df8d6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:32.722752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce699c6b-9f1b-4f0a-b88e-153c191df8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:32.752792 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3151/6273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:32.756987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5460a4-322c-47af-a0a1-a12e5b6547b9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:32.775584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5460a4-322c-47af-a0a1-a12e5b6547b9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:32.812223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:32.813408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:32.813876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:32.814152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:32.815823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:32.816159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:32.819493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:32.882817 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3123/6274] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:32.893521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce699c6b-9f1b-4f0a-b88e-153c191df8d6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:32.909499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce699c6b-9f1b-4f0a-b88e-153c191df8d6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:32.923449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29728460-e2db-4a23-a763-5bb4f8803bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:32.926625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29728460-e2db-4a23-a763-5bb4f8803bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:32.927104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29728460-e2db-4a23-a763-5bb4f8803bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:32.927387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29728460-e2db-4a23-a763-5bb4f8803bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:32.931513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29728460-e2db-4a23-a763-5bb4f8803bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:32.935085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29728460-e2db-4a23-a763-5bb4f8803bf9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:33.023889 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3152/6275] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:32 2022] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:33.028648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:33.047843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b08e8-2372-4245-85c7-e1d013d4f583 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:33.167641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df14940-4c5a-422b-9854-b08328a8096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:33.168446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df14940-4c5a-422b-9854-b08328a8096d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:33.168817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df14940-4c5a-422b-9854-b08328a8096d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:33.169165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df14940-4c5a-422b-9854-b08328a8096d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:33.169938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df14940-4c5a-422b-9854-b08328a8096d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:33.171883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df14940-4c5a-422b-9854-b08328a8096d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:33.219897 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3124/6276] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:33 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:33.224692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29728460-e2db-4a23-a763-5bb4f8803bf9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:33.259085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29728460-e2db-4a23-a763-5bb4f8803bf9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:33.283847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd2f6-c54c-4ddd-a390-f7c97aca56b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:33.286194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd2f6-c54c-4ddd-a390-f7c97aca56b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:33.288088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd2f6-c54c-4ddd-a390-f7c97aca56b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:33.288732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd2f6-c54c-4ddd-a390-f7c97aca56b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:33.292266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bd2f6-c54c-4ddd-a390-f7c97aca56b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:33.300765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bd2f6-c54c-4ddd-a390-f7c97aca56b8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:33.373484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df14940-4c5a-422b-9854-b08328a8096d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:33.373712 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3153/6277] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:33.391819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df14940-4c5a-422b-9854-b08328a8096d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:33.419766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebd6a6-e164-4f65-aa0a-1ef09759be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:33.420734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebd6a6-e164-4f65-aa0a-1ef09759be8d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:33.432046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebd6a6-e164-4f65-aa0a-1ef09759be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:33.433104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebd6a6-e164-4f65-aa0a-1ef09759be8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:33.434107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebd6a6-e164-4f65-aa0a-1ef09759be8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:33.435998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebd6a6-e164-4f65-aa0a-1ef09759be8d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:33.460816 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3125/6278] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:12:33.468391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd2f6-c54c-4ddd-a390-f7c97aca56b8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:33.491301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd2f6-c54c-4ddd-a390-f7c97aca56b8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:33.506547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca285-323c-45e4-9b6d-b8222c936e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:33.507786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca285-323c-45e4-9b6d-b8222c936e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:33.508158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca285-323c-45e4-9b6d-b8222c936e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:33.508732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca285-323c-45e4-9b6d-b8222c936e6b admin admin] PATH_INFO: `/v3/projects/d1ce8051b2b045a191037e9f87cbc83b/users/ac3c118fb2dc4990a6e8136dc52738c2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:33.535082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca285-323c-45e4-9b6d-b8222c936e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ce8051b2b045a191037e9f87cbc83b, user_id=ac3c118fb2dc4990a6e8136dc52738c2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:33.538674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca285-323c-45e4-9b6d-b8222c936e6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:33.568482 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3154/6279] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:33 2022] PUT /identity/v3/projects/d1ce8051b2b045a191037e9f87cbc83b/users/ac3c118fb2dc4990a6e8136dc52738c2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:33.579279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cbbc4-99d2-466d-a22c-7d55db0e5941 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:33.580416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cbbc4-99d2-466d-a22c-7d55db0e5941 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:33.581042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cbbc4-99d2-466d-a22c-7d55db0e5941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:33.616503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a33cbbc4-99d2-466d-a22c-7d55db0e5941 None None] MFA Rules not processed for user `ac3c118fb2dc4990a6e8136dc52738c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:33.619425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a33cbbc4-99d2-466d-a22c-7d55db0e5941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:33.791736 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3126/6280] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:33.796712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca285-323c-45e4-9b6d-b8222c936e6b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:33.954244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca285-323c-45e4-9b6d-b8222c936e6b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:33.979812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252991e-335d-41d2-94fb-77c2f20c4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:33.980810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252991e-335d-41d2-94fb-77c2f20c4d60 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:33.981100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252991e-335d-41d2-94fb-77c2f20c4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:33.981681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252991e-335d-41d2-94fb-77c2f20c4d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:33.982716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252991e-335d-41d2-94fb-77c2f20c4d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:33.985643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252991e-335d-41d2-94fb-77c2f20c4d60 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:34.074761 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3155/6281] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:33 2022] POST /identity/v3/projects => generated 391 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:34.078675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cbbc4-99d2-466d-a22c-7d55db0e5941 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:34.114634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cbbc4-99d2-466d-a22c-7d55db0e5941 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:34.343558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e72ad-574e-4642-8ba3-72034dc0ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:34.344584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e72ad-574e-4642-8ba3-72034dc0ad78 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:34.345095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e72ad-574e-4642-8ba3-72034dc0ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:34.345827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e72ad-574e-4642-8ba3-72034dc0ad78 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:34.347420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e72ad-574e-4642-8ba3-72034dc0ad78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:34.350491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e72ad-574e-4642-8ba3-72034dc0ad78 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:34.399035 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3127/6282] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:34 2022] POST /identity/v3/users => generated 302 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:34.400755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252991e-335d-41d2-94fb-77c2f20c4d60 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:34.421138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252991e-335d-41d2-94fb-77c2f20c4d60 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:34.428638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a59a5d-2388-44c2-8cd7-516993709682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:34.429474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a59a5d-2388-44c2-8cd7-516993709682 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:34.430004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a59a5d-2388-44c2-8cd7-516993709682 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:34.430516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a59a5d-2388-44c2-8cd7-516993709682 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:34.431459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a59a5d-2388-44c2-8cd7-516993709682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:34.436674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a59a5d-2388-44c2-8cd7-516993709682 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:34.458917 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3156/6283] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:34.461242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e72ad-574e-4642-8ba3-72034dc0ad78 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:34.480170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e72ad-574e-4642-8ba3-72034dc0ad78 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:34.509027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79093bc0-0dd2-4abf-b3e2-9aa6c3e17938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:34.511706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79093bc0-0dd2-4abf-b3e2-9aa6c3e17938 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:34.512181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79093bc0-0dd2-4abf-b3e2-9aa6c3e17938 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:34.513296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79093bc0-0dd2-4abf-b3e2-9aa6c3e17938 admin admin] PATH_INFO: `/v3/projects/8354b2489536487499fb720b6fb970e7/users/ac0dbc7944364bcea145f5a609a3c43b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:34.539868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79093bc0-0dd2-4abf-b3e2-9aa6c3e17938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8354b2489536487499fb720b6fb970e7, user_id=ac0dbc7944364bcea145f5a609a3c43b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:34.543137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79093bc0-0dd2-4abf-b3e2-9aa6c3e17938 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:34.567861 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3128/6284] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:34 2022] PUT /identity/v3/projects/8354b2489536487499fb720b6fb970e7/users/ac0dbc7944364bcea145f5a609a3c43b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:34.571903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a59a5d-2388-44c2-8cd7-516993709682 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:34.598453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a59a5d-2388-44c2-8cd7-516993709682 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:34.785799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a735-4a46-4138-b650-308a8b81174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:34.786802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a735-4a46-4138-b650-308a8b81174e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:34.787201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a735-4a46-4138-b650-308a8b81174e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:34.787565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a735-4a46-4138-b650-308a8b81174e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:34.788528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a735-4a46-4138-b650-308a8b81174e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:34.790252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a735-4a46-4138-b650-308a8b81174e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:34.806507 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3157/6285] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:34.810601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79093bc0-0dd2-4abf-b3e2-9aa6c3e17938 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:34.826722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79093bc0-0dd2-4abf-b3e2-9aa6c3e17938 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:34.851458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:34.859082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:34.859082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:34.859464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] PATH_INFO: `/v3/projects/8354b2489536487499fb720b6fb970e7/users/ac0dbc7944364bcea145f5a609a3c43b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:34.862725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8354b2489536487499fb720b6fb970e7, user_id=ac0dbc7944364bcea145f5a609a3c43b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:34.867185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:34.889023 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3129/6286] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:34 2022] PUT /identity/v3/projects/8354b2489536487499fb720b6fb970e7/users/ac0dbc7944364bcea145f5a609a3c43b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:34.900480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0811b-cdf6-4e2b-a2fe-bd740d126659 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:34.900904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0811b-cdf6-4e2b-a2fe-bd740d126659 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:34.901278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0811b-cdf6-4e2b-a2fe-bd740d126659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:34.940036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3cd0811b-cdf6-4e2b-a2fe-bd740d126659 None None] MFA Rules not processed for user `ac0dbc7944364bcea145f5a609a3c43b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:34.941799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3cd0811b-cdf6-4e2b-a2fe-bd740d126659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:35.138488 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3158/6287] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:35.182679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:35.184806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:35.326934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271660c-e3f9-42e4-b7f1-b39537edc934 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:35.335080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:35.335936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:35.336415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:35.336862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:35.526890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:35.529549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:35.546199 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3130/6288] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:41.775935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0811b-cdf6-4e2b-a2fe-bd740d126659 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:41.790265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0811b-cdf6-4e2b-a2fe-bd740d126659 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:41.794761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9139f-22b9-451b-8671-4a5648d6f41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:41.795445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9139f-22b9-451b-8671-4a5648d6f41f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:41.795736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9139f-22b9-451b-8671-4a5648d6f41f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:41.796016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9139f-22b9-451b-8671-4a5648d6f41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:41.809722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9139f-22b9-451b-8671-4a5648d6f41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:41.811199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9139f-22b9-451b-8671-4a5648d6f41f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:41.843704 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3159/6289] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:46.160990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:46.169738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:46.199340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664b74-23a4-40b3-be2f-44762d37a6e0 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:46.209213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3d87f-55d2-4ebb-9795-456d06e7732d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:46.210433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3d87f-55d2-4ebb-9795-456d06e7732d service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:46.210982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3d87f-55d2-4ebb-9795-456d06e7732d service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:46.213128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3d87f-55d2-4ebb-9795-456d06e7732d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:46.221005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25a3d87f-55d2-4ebb-9795-456d06e7732d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:46.462978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3d87f-55d2-4ebb-9795-456d06e7732d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:46.465788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3d87f-55d2-4ebb-9795-456d06e7732d service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:46.492510 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3131/6290] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:47.424415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9139f-22b9-451b-8671-4a5648d6f41f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:47.571513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9139f-22b9-451b-8671-4a5648d6f41f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:47.584974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:47.586139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:47.586902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:47.587360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] PATH_INFO: `/v3/users/ac3c118fb2dc4990a6e8136dc52738c2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:47.589497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3c118fb2dc4990a6e8136dc52738c2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:47.591994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:47.704542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3c118fb2dc4990a6e8136dc52738c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:47.779470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3c118fb2dc4990a6e8136dc52738c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:47.804559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3c118fb2dc4990a6e8136dc52738c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:47.805758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3c118fb2dc4990a6e8136dc52738c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:47.806278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3c118fb2dc4990a6e8136dc52738c2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:47.839768 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3160/6291] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:47 2022] DELETE /identity/v3/users/ac3c118fb2dc4990a6e8136dc52738c2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:47.846382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800f4bc-9fc4-4f8c-bce8-e99b4529ddf6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:47.846952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800f4bc-9fc4-4f8c-bce8-e99b4529ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:47.846952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800f4bc-9fc4-4f8c-bce8-e99b4529ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:47.903532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4800f4bc-9fc4-4f8c-bce8-e99b4529ddf6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:47.905242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4800f4bc-9fc4-4f8c-bce8-e99b4529ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:48.041200 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3132/6292] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:48.057795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:48.059371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:48.176529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e0ab-f72f-429e-976f-b962cf4d68ca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:48.184780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cfa61-055f-4edc-95cb-f9a6343c3088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:48.186000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfa61-055f-4edc-95cb-f9a6343c3088 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:48.186502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfa61-055f-4edc-95cb-f9a6343c3088 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:48.187052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfa61-055f-4edc-95cb-f9a6343c3088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:48.209384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cfa61-055f-4edc-95cb-f9a6343c3088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:48.211752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cfa61-055f-4edc-95cb-f9a6343c3088 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:48.256266 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3161/6293] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:49.006412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800f4bc-9fc4-4f8c-bce8-e99b4529ddf6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:49.011300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4800f4bc-9fc4-4f8c-bce8-e99b4529ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:49.031824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800f4bc-9fc4-4f8c-bce8-e99b4529ddf6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:49.038276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:49.039332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:49.040008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:49.040406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] PATH_INFO: `/v3/projects/d1ce8051b2b045a191037e9f87cbc83b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:49.043753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ce8051b2b045a191037e9f87cbc83b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:49.047363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:49.127868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ce8051b2b045a191037e9f87cbc83b', 'request_id': 'req-6b6dcc4d-d69f-402e-a33b-276e3618fc91'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.138492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ce8051b2b045a191037e9f87cbc83b', 'request_id': 'req-6b6dcc4d-d69f-402e-a33b-276e3618fc91'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.154612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ce8051b2b045a191037e9f87cbc83b', 'request_id': 'req-6b6dcc4d-d69f-402e-a33b-276e3618fc91'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.174171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] The token cache is being invalidate because project d1ce8051b2b045a191037e9f87cbc83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:49.174782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.178567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.182995 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3133/6294] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:49 2022] DELETE /identity/v3/projects/d1ce8051b2b045a191037e9f87cbc83b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:49.188631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cfa61-055f-4edc-95cb-f9a6343c3088 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:49.201263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cfa61-055f-4edc-95cb-f9a6343c3088 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:49.296370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:49.297437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:49.297764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:49.298050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] PATH_INFO: `/v3/users/ac0dbc7944364bcea145f5a609a3c43b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:49.300096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0dbc7944364bcea145f5a609a3c43b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:49.302223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:49.380703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0dbc7944364bcea145f5a609a3c43b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.406020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0dbc7944364bcea145f5a609a3c43b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.417300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0dbc7944364bcea145f5a609a3c43b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.418136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0dbc7944364bcea145f5a609a3c43b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.419477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b245b8f-5c4b-44d5-842d-98fafc272cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0dbc7944364bcea145f5a609a3c43b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:49.446521 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3162/6295] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:49 2022] DELETE /identity/v3/users/ac0dbc7944364bcea145f5a609a3c43b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:50.639092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:50.640568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:50.661054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dcc4d-d69f-402e-a33b-276e3618fc91 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:50.841790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:50.843131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:50.843569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:50.843848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] PATH_INFO: `/v3/projects/8354b2489536487499fb720b6fb970e7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:50.846160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8354b2489536487499fb720b6fb970e7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:50.848473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:50.962807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8354b2489536487499fb720b6fb970e7', 'request_id': 'req-6970c0a7-29f0-4375-a819-59fb7bfa6208'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:50.980849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8354b2489536487499fb720b6fb970e7', 'request_id': 'req-6970c0a7-29f0-4375-a819-59fb7bfa6208'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:50.999743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8354b2489536487499fb720b6fb970e7', 'request_id': 'req-6970c0a7-29f0-4375-a819-59fb7bfa6208'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:51.017996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] The token cache is being invalidate because project 8354b2489536487499fb720b6fb970e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:51.018392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:51.020078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6970c0a7-29f0-4375-a819-59fb7bfa6208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:51.022189 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3134/6296] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:50 2022] DELETE /identity/v3/projects/8354b2489536487499fb720b6fb970e7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:51.028960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336803b-5c09-49db-89a9-ecb621ce529e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:51.028960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336803b-5c09-49db-89a9-ecb621ce529e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:51.028960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336803b-5c09-49db-89a9-ecb621ce529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:51.096502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1336803b-5c09-49db-89a9-ecb621ce529e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:51.098657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1336803b-5c09-49db-89a9-ecb621ce529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:51.263826 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3163/6297] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:51.273380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f037d3-7163-43d2-b576-97b9f5e0792c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:51.273903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f037d3-7163-43d2-b576-97b9f5e0792c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:51.274197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f037d3-7163-43d2-b576-97b9f5e0792c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:51.322639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-49f037d3-7163-43d2-b576-97b9f5e0792c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:51.324607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-49f037d3-7163-43d2-b576-97b9f5e0792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:51.350190 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3135/6298] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:51.356050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336803b-5c09-49db-89a9-ecb621ce529e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:51.374043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336803b-5c09-49db-89a9-ecb621ce529e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:51.384085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:51.386290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:51.386916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:51.387367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:51.388597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:51.389119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:51.393514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:51.421860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f037d3-7163-43d2-b576-97b9f5e0792c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:51.423219 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3164/6299] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:51.434129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f037d3-7163-43d2-b576-97b9f5e0792c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:51.441426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bb56d-323c-41d9-8eb0-997a550fafb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:51.442571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bb56d-323c-41d9-8eb0-997a550fafb2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:51.442862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bb56d-323c-41d9-8eb0-997a550fafb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:51.443200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bb56d-323c-41d9-8eb0-997a550fafb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:51.443928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bb56d-323c-41d9-8eb0-997a550fafb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:51.446287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bb56d-323c-41d9-8eb0-997a550fafb2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:51.495870 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3136/6300] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:51 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:51.500616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:51.554835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347edd33-2a3b-4174-9b9b-bbf59996caed admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:51.758035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d62e-6804-4833-8b08-1b54b1fa89fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:51.759422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d62e-6804-4833-8b08-1b54b1fa89fd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:51.760138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d62e-6804-4833-8b08-1b54b1fa89fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:51.760769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d62e-6804-4833-8b08-1b54b1fa89fd admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:51.763360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913d62e-6804-4833-8b08-1b54b1fa89fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:51.767795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913d62e-6804-4833-8b08-1b54b1fa89fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:51.851432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3165/6301] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:51 2022] POST /identity/v3/users => generated 288 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:51.855265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bb56d-323c-41d9-8eb0-997a550fafb2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:51.879641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bb56d-323c-41d9-8eb0-997a550fafb2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:51.914441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f55f0-9aae-4caa-ac76-9570670a6d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:51.915571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f55f0-9aae-4caa-ac76-9570670a6d62 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:51.918671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f55f0-9aae-4caa-ac76-9570670a6d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:51.922549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f55f0-9aae-4caa-ac76-9570670a6d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:51.927574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f55f0-9aae-4caa-ac76-9570670a6d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:51.929765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f55f0-9aae-4caa-ac76-9570670a6d62 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:52.009022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d62e-6804-4833-8b08-1b54b1fa89fd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:52.010025 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3137/6302] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:52.024699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d62e-6804-4833-8b08-1b54b1fa89fd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:52.040718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd5786-6c5a-4e89-9c40-1c3952ceb5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:52.043967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5786-6c5a-4e89-9c40-1c3952ceb5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:52.045087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5786-6c5a-4e89-9c40-1c3952ceb5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:52.045087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5786-6c5a-4e89-9c40-1c3952ceb5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:52.045763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd5786-6c5a-4e89-9c40-1c3952ceb5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:52.051422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd5786-6c5a-4e89-9c40-1c3952ceb5b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:52.092092 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3166/6303] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:52.093951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f55f0-9aae-4caa-ac76-9570670a6d62 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:52.120376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f55f0-9aae-4caa-ac76-9570670a6d62 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:52.155129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c27e4e-e01f-4a94-ad2b-b5874207b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:52.158631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c27e4e-e01f-4a94-ad2b-b5874207b1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:52.159829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c27e4e-e01f-4a94-ad2b-b5874207b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:52.160725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c27e4e-e01f-4a94-ad2b-b5874207b1d8 admin admin] PATH_INFO: `/v3/projects/a34ff7849324473194b9e82fe3284c47/users/e25421bf262e41959c8fc0af991f256e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:52.244627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c27e4e-e01f-4a94-ad2b-b5874207b1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34ff7849324473194b9e82fe3284c47, user_id=e25421bf262e41959c8fc0af991f256e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:52.260792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c27e4e-e01f-4a94-ad2b-b5874207b1d8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:52.318065 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3138/6304] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:52 2022] PUT /identity/v3/projects/a34ff7849324473194b9e82fe3284c47/users/e25421bf262e41959c8fc0af991f256e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:52.319833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229068c1-9a21-46a1-b0f6-a45384b6f1a3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:52.320346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229068c1-9a21-46a1-b0f6-a45384b6f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:52.320817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229068c1-9a21-46a1-b0f6-a45384b6f1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:52.388561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-229068c1-9a21-46a1-b0f6-a45384b6f1a3 None None] MFA Rules not processed for user `e25421bf262e41959c8fc0af991f256e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:52.390096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-229068c1-9a21-46a1-b0f6-a45384b6f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:52.614891 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3167/6305] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:52.619434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c27e4e-e01f-4a94-ad2b-b5874207b1d8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:52.738118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c27e4e-e01f-4a94-ad2b-b5874207b1d8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:52.757401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457554-e51f-4510-889a-fc1875a4e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:52.758239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457554-e51f-4510-889a-fc1875a4e27a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:52.758608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457554-e51f-4510-889a-fc1875a4e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:52.758907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b457554-e51f-4510-889a-fc1875a4e27a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:52.759690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b457554-e51f-4510-889a-fc1875a4e27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:52.761726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b457554-e51f-4510-889a-fc1875a4e27a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:52.827000 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3139/6306] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:52 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:52.829998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229068c1-9a21-46a1-b0f6-a45384b6f1a3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:52.848917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229068c1-9a21-46a1-b0f6-a45384b6f1a3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:53.044735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7c783-eaaa-4928-9b98-0259b7ec0f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:53.046646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c783-eaaa-4928-9b98-0259b7ec0f1f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:53.047095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c783-eaaa-4928-9b98-0259b7ec0f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:53.047684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c783-eaaa-4928-9b98-0259b7ec0f1f admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:53.049247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7c783-eaaa-4928-9b98-0259b7ec0f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:53.055395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7c783-eaaa-4928-9b98-0259b7ec0f1f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:53.122871 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3168/6307] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:52 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:53.125123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457554-e51f-4510-889a-fc1875a4e27a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:53.159833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b457554-e51f-4510-889a-fc1875a4e27a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:53.176991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bab912-a6a8-4ded-9d4c-505a949270b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:53.182561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab912-a6a8-4ded-9d4c-505a949270b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:53.183087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab912-a6a8-4ded-9d4c-505a949270b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:53.183518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab912-a6a8-4ded-9d4c-505a949270b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:53.184467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bab912-a6a8-4ded-9d4c-505a949270b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:53.186454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bab912-a6a8-4ded-9d4c-505a949270b2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:53.223474 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3140/6308] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:53.227948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7c783-eaaa-4928-9b98-0259b7ec0f1f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:53.243263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7c783-eaaa-4928-9b98-0259b7ec0f1f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:53.257102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:53.258979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:53.260043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:53.262935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] PATH_INFO: `/v3/projects/91954cfd424e47c1898a537a3dec9d1e/users/fa63408f432c48989c9fd4d943e1eaf0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:53.299666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91954cfd424e47c1898a537a3dec9d1e, user_id=fa63408f432c48989c9fd4d943e1eaf0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:53.307345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:53.342762 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3169/6309] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:53 2022] PUT /identity/v3/projects/91954cfd424e47c1898a537a3dec9d1e/users/fa63408f432c48989c9fd4d943e1eaf0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:12:53.348093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bab912-a6a8-4ded-9d4c-505a949270b2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:53.364252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bab912-a6a8-4ded-9d4c-505a949270b2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:53.478699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:53.480876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:53.490183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09578531-93f2-40a4-9465-c6aa71605677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:53.491045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09578531-93f2-40a4-9465-c6aa71605677 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:53.491448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09578531-93f2-40a4-9465-c6aa71605677 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:53.491828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09578531-93f2-40a4-9465-c6aa71605677 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:53.492848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09578531-93f2-40a4-9465-c6aa71605677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:53.494813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09578531-93f2-40a4-9465-c6aa71605677 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:53.511566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3140da-bd1e-465d-b366-3d274f736986 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:53.519679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:53.521254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:53.521708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:53.522128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] PATH_INFO: `/v3/users/cab2d6ba2dfb4adfa951ce21075a3b20` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:53.523594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab2d6ba2dfb4adfa951ce21075a3b20)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:53.525843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:53.530344 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3141/6310] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:12:53.535780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09578531-93f2-40a4-9465-c6aa71605677 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:53.584199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09578531-93f2-40a4-9465-c6aa71605677 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:53.594834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6d129-54a6-4319-a34a-bad781fec810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:53.596427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d129-54a6-4319-a34a-bad781fec810 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:53.598036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d129-54a6-4319-a34a-bad781fec810 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:53.602292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d129-54a6-4319-a34a-bad781fec810 admin admin] PATH_INFO: `/v3/projects/91954cfd424e47c1898a537a3dec9d1e/users/fa63408f432c48989c9fd4d943e1eaf0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:53.605244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6d129-54a6-4319-a34a-bad781fec810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91954cfd424e47c1898a537a3dec9d1e, user_id=fa63408f432c48989c9fd4d943e1eaf0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:53.617258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6d129-54a6-4319-a34a-bad781fec810 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:53.634406 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3142/6311] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:53 2022] PUT /identity/v3/projects/91954cfd424e47c1898a537a3dec9d1e/users/fa63408f432c48989c9fd4d943e1eaf0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:53.636242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab2d6ba2dfb4adfa951ce21075a3b20'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:53.647922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd109c-5282-4c0c-993c-784a48e1d95f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:53.648253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd109c-5282-4c0c-993c-784a48e1d95f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:53.649469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd109c-5282-4c0c-993c-784a48e1d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:53.666952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab2d6ba2dfb4adfa951ce21075a3b20'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:53.690554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab2d6ba2dfb4adfa951ce21075a3b20'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:53.691891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab2d6ba2dfb4adfa951ce21075a3b20'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:53.692814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-50c77f7e-e09a-4438-8ff6-3f0a5080effa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab2d6ba2dfb4adfa951ce21075a3b20'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:53.715088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cecd109c-5282-4c0c-993c-784a48e1d95f None None] MFA Rules not processed for user `fa63408f432c48989c9fd4d943e1eaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:53.716854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cecd109c-5282-4c0c-993c-784a48e1d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:53.717106 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3170/6312] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:53 2022] DELETE /identity/v3/users/cab2d6ba2dfb4adfa951ce21075a3b20 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:53.728003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b854-dcb8-4d17-bcf8-59de9c658ef7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:53.728536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b854-dcb8-4d17-bcf8-59de9c658ef7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:53.732548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b854-dcb8-4d17-bcf8-59de9c658ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:53.770764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7a23b854-dcb8-4d17-bcf8-59de9c658ef7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:53.772277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7a23b854-dcb8-4d17-bcf8-59de9c658ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:53.890859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3143/6313] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:53.902905 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3171/6314] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:53.903210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd109c-5282-4c0c-993c-784a48e1d95f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:53.906935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cecd109c-5282-4c0c-993c-784a48e1d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:53.913920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23b854-dcb8-4d17-bcf8-59de9c658ef7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:53.916185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7a23b854-dcb8-4d17-bcf8-59de9c658ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:54.031957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23b854-dcb8-4d17-bcf8-59de9c658ef7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:54.040810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:54.043251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:54.043715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:54.044664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:54.070744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:54.073540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:54.088620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd109c-5282-4c0c-993c-784a48e1d95f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:54.101673 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3172/6315] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:54.106008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06a47b-55ad-4959-8deb-060a2fbc7cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:54.107473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06a47b-55ad-4959-8deb-060a2fbc7cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:54.107473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06a47b-55ad-4959-8deb-060a2fbc7cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:54.108660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06a47b-55ad-4959-8deb-060a2fbc7cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:54.138402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06a47b-55ad-4959-8deb-060a2fbc7cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:54.143233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06a47b-55ad-4959-8deb-060a2fbc7cd4 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:54.179613 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3144/6316] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:54.584993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:54.592392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:54.609700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bb311-3e1e-4196-b3d4-f1c6285a4e04 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:54.616279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:54.617197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:54.617471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:54.618006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] PATH_INFO: `/v3/projects/96ce8f5b3827425fa697e340178b84c6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:54.620085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ce8f5b3827425fa697e340178b84c6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:54.622060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:54.680860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ce8f5b3827425fa697e340178b84c6', 'request_id': 'req-362b4293-7aff-4192-b669-e3a449560865'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:54.687805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ce8f5b3827425fa697e340178b84c6', 'request_id': 'req-362b4293-7aff-4192-b669-e3a449560865'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:54.701397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ce8f5b3827425fa697e340178b84c6', 'request_id': 'req-362b4293-7aff-4192-b669-e3a449560865'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:54.714370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] The token cache is being invalidate because project 96ce8f5b3827425fa697e340178b84c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:54.714821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:54.715534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-362b4293-7aff-4192-b669-e3a449560865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:54.717345 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3173/6317] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:54 2022] DELETE /identity/v3/projects/96ce8f5b3827425fa697e340178b84c6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:54.722406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8fee-f1d4-43cf-a8c6-82edcd8b9d27 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:54.722690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8fee-f1d4-43cf-a8c6-82edcd8b9d27 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:54.722972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8fee-f1d4-43cf-a8c6-82edcd8b9d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:54.747713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-25ba8fee-f1d4-43cf-a8c6-82edcd8b9d27 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:54.748992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25ba8fee-f1d4-43cf-a8c6-82edcd8b9d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:54.821253 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3145/6318] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:12:54.830386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa1db-e49a-4055-86f0-e043176074cd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:54.830685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa1db-e49a-4055-86f0-e043176074cd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:54.830966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa1db-e49a-4055-86f0-e043176074cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:54.856433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8e9fa1db-e49a-4055-86f0-e043176074cd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:54.857834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8e9fa1db-e49a-4055-86f0-e043176074cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:54.870912 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3174/6319] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:54.875599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba8fee-f1d4-43cf-a8c6-82edcd8b9d27 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:54.886299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba8fee-f1d4-43cf-a8c6-82edcd8b9d27 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:54.891020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:54.891690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:54.892013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:54.892290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:54.893234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:12:54.893562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:54.895205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:54.915376 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3146/6320] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:12:54.916694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa1db-e49a-4055-86f0-e043176074cd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:54.926875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa1db-e49a-4055-86f0-e043176074cd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:54.932813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca02dc-b415-497c-89a7-932ffd3035aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:54.933422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca02dc-b415-497c-89a7-932ffd3035aa admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:54.933711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca02dc-b415-497c-89a7-932ffd3035aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:54.933976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca02dc-b415-497c-89a7-932ffd3035aa admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:54.934667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca02dc-b415-497c-89a7-932ffd3035aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:54.937077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca02dc-b415-497c-89a7-932ffd3035aa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:54.975205 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3175/6321] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:12:54 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:12:54.976887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:54.995615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0691aa-fcd1-4815-a7a6-c4489abfe13c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:55.091183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2f86a-a5be-4cb2-bade-0aeb11c9c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:55.114364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2f86a-a5be-4cb2-bade-0aeb11c9c861 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:55.114732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2f86a-a5be-4cb2-bade-0aeb11c9c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:55.115142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2f86a-a5be-4cb2-bade-0aeb11c9c861 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:55.115877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2f86a-a5be-4cb2-bade-0aeb11c9c861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:55.117888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2f86a-a5be-4cb2-bade-0aeb11c9c861 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:55.170097 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3147/6322] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:12:54 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:12:55.174516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca02dc-b415-497c-89a7-932ffd3035aa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:55.192119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca02dc-b415-497c-89a7-932ffd3035aa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:55.213387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2921b38-dd2f-41b7-96b4-00ed32f09eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:55.214357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2921b38-dd2f-41b7-96b4-00ed32f09eaf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:55.214795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2921b38-dd2f-41b7-96b4-00ed32f09eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:55.215268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2921b38-dd2f-41b7-96b4-00ed32f09eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:55.216374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2921b38-dd2f-41b7-96b4-00ed32f09eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:55.217679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2921b38-dd2f-41b7-96b4-00ed32f09eaf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:55.236937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2f86a-a5be-4cb2-bade-0aeb11c9c861 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:55.245942 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3176/6323] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:12:55.247939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2f86a-a5be-4cb2-bade-0aeb11c9c861 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:55.270221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73429c82-a250-422b-856b-26593d1a7082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:55.271107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429c82-a250-422b-856b-26593d1a7082 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:55.271543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429c82-a250-422b-856b-26593d1a7082 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:55.272004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73429c82-a250-422b-856b-26593d1a7082 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:55.273006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73429c82-a250-422b-856b-26593d1a7082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:55.278159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73429c82-a250-422b-856b-26593d1a7082 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:55.306279 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3148/6324] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:12:55.310694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2921b38-dd2f-41b7-96b4-00ed32f09eaf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:55.329417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2921b38-dd2f-41b7-96b4-00ed32f09eaf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:55.347129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:55.349673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:55.352424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:55.353242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] PATH_INFO: `/v3/projects/ab36d6d50f8f40408962ab92e9cd1671/users/614b36c5d1d64be3a2432a59a05c3dca/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:55.382657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab36d6d50f8f40408962ab92e9cd1671, user_id=614b36c5d1d64be3a2432a59a05c3dca, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:55.386329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:55.411644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd942dad-7521-4340-996b-63b84c354fac None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:55.412256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd942dad-7521-4340-996b-63b84c354fac None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:55.413289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd942dad-7521-4340-996b-63b84c354fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:55.418709 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3177/6325] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:12:55 2022] PUT /identity/v3/projects/ab36d6d50f8f40408962ab92e9cd1671/users/614b36c5d1d64be3a2432a59a05c3dca/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:55.441262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fd942dad-7521-4340-996b-63b84c354fac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:55.442724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fd942dad-7521-4340-996b-63b84c354fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:55.535876 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3149/6326] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:55.544510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:55.547634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:55.645610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b974-aafb-4e32-965d-033e487048a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:55.650417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:55.651614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:55.654371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:55.654776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:55.668198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:55.669795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:55.680764 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3178/6327] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:56.486615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd942dad-7521-4340-996b-63b84c354fac None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:56.489863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fd942dad-7521-4340-996b-63b84c354fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:56.512888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd942dad-7521-4340-996b-63b84c354fac None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:56.530739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cff4a0-7d64-4734-9dd0-688d7d8bd66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:56.533650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff4a0-7d64-4734-9dd0-688d7d8bd66f service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:56.534330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff4a0-7d64-4734-9dd0-688d7d8bd66f service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:56.534823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff4a0-7d64-4734-9dd0-688d7d8bd66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:56.549828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-84cff4a0-7d64-4734-9dd0-688d7d8bd66f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:56.569996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cff4a0-7d64-4734-9dd0-688d7d8bd66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:56.572169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cff4a0-7d64-4734-9dd0-688d7d8bd66f service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:56.600262 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3150/6328] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:57.912761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:57.915947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:57.931163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aafd8-72a2-440a-aecb-a4b8436769fd service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:57.936903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:57.937919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:57.938304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:57.938684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] PATH_INFO: `/v3/users/e25421bf262e41959c8fc0af991f256e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:57.940704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25421bf262e41959c8fc0af991f256e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:57.942732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:57.999828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25421bf262e41959c8fc0af991f256e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:58.016003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25421bf262e41959c8fc0af991f256e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:58.028703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25421bf262e41959c8fc0af991f256e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:58.029520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25421bf262e41959c8fc0af991f256e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:58.030289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25421bf262e41959c8fc0af991f256e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:58.055292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3179/6329] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:57 2022] DELETE /identity/v3/users/e25421bf262e41959c8fc0af991f256e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:58.060728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7fa3e-2218-4e14-820d-5fe087215b42 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:58.061283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7fa3e-2218-4e14-820d-5fe087215b42 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:58.061283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7fa3e-2218-4e14-820d-5fe087215b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:58.087635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-02f7fa3e-2218-4e14-820d-5fe087215b42 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:58.089329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-02f7fa3e-2218-4e14-820d-5fe087215b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:58.247465 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3151/6330] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:58.261556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:58.264637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:58.342623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ad028-ad82-4f8d-b1bf-a91a81ed9559 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:58.349710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dced53-05c8-45e0-a7d4-c4382337c1f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:58.350923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dced53-05c8-45e0-a7d4-c4382337c1f0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:58.351554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dced53-05c8-45e0-a7d4-c4382337c1f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:58.351955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dced53-05c8-45e0-a7d4-c4382337c1f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:58.363481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dced53-05c8-45e0-a7d4-c4382337c1f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:58.365235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dced53-05c8-45e0-a7d4-c4382337c1f0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:58.388767 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3180/6331] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:12:58.475286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe48cec-f432-4930-90ed-bb4b557e9c3f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:58.477596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe48cec-f432-4930-90ed-bb4b557e9c3f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:58.478098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe48cec-f432-4930-90ed-bb4b557e9c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:58.529708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bfe48cec-f432-4930-90ed-bb4b557e9c3f None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:58.531297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bfe48cec-f432-4930-90ed-bb4b557e9c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:58.709286 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3152/6332] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:58.721292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057cdc9-9e75-4cc4-9940-d98ad66be6e6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:58.721843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057cdc9-9e75-4cc4-9940-d98ad66be6e6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:58.722197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057cdc9-9e75-4cc4-9940-d98ad66be6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:58.757480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2057cdc9-9e75-4cc4-9940-d98ad66be6e6 None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:12:58.759212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2057cdc9-9e75-4cc4-9940-d98ad66be6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:58.770544 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3181/6333] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:12:58.781690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe48cec-f432-4930-90ed-bb4b557e9c3f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:58.784507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bfe48cec-f432-4930-90ed-bb4b557e9c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:58.910532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe48cec-f432-4930-90ed-bb4b557e9c3f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:58.917212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591258fb-b9f3-4e5b-bef8-c46be447c207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:58.917890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591258fb-b9f3-4e5b-bef8-c46be447c207 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:58.918240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591258fb-b9f3-4e5b-bef8-c46be447c207 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:58.918588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591258fb-b9f3-4e5b-bef8-c46be447c207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:58.929289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591258fb-b9f3-4e5b-bef8-c46be447c207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:58.931532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591258fb-b9f3-4e5b-bef8-c46be447c207 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:58.945874 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3153/6334] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:12:59.287122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057cdc9-9e75-4cc4-9940-d98ad66be6e6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:59.291871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2057cdc9-9e75-4cc4-9940-d98ad66be6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:12:59.376249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057cdc9-9e75-4cc4-9940-d98ad66be6e6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:59.382704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:59.384239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:59.384776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:59.385251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] PATH_INFO: `/v3/projects/a34ff7849324473194b9e82fe3284c47` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:59.386818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34ff7849324473194b9e82fe3284c47)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:59.389218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:59.479793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34ff7849324473194b9e82fe3284c47', 'request_id': 'req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.487212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34ff7849324473194b9e82fe3284c47', 'request_id': 'req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.496645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34ff7849324473194b9e82fe3284c47', 'request_id': 'req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.514102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] The token cache is being invalidate because project a34ff7849324473194b9e82fe3284c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:12:59.514668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.515577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.518233 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3182/6335] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:12:59 2022] DELETE /identity/v3/projects/a34ff7849324473194b9e82fe3284c47 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:12:59.523265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591258fb-b9f3-4e5b-bef8-c46be447c207 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:12:59.550030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591258fb-b9f3-4e5b-bef8-c46be447c207 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:12:59.649339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:12:59.653403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:12:59.653976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:12:59.654479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] PATH_INFO: `/v3/users/fa63408f432c48989c9fd4d943e1eaf0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:12:59.656481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa63408f432c48989c9fd4d943e1eaf0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:12:59.663858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:12:59.788669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa63408f432c48989c9fd4d943e1eaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.794394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa63408f432c48989c9fd4d943e1eaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.795730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa63408f432c48989c9fd4d943e1eaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.829835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa63408f432c48989c9fd4d943e1eaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.847441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a792b6a1-106c-4f6a-8bbd-b82aaba8de74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa63408f432c48989c9fd4d943e1eaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:12:59.895688 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3154/6336] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:12:59 2022] DELETE /identity/v3/users/fa63408f432c48989c9fd4d943e1eaf0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:13:01.444115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:01.445857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:01.472544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dfed3-cec8-4c6b-b56e-97b3f09e0e24 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:01.582143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:01.583078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:01.583352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:01.583827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] PATH_INFO: `/v3/projects/91954cfd424e47c1898a537a3dec9d1e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:01.591773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=91954cfd424e47c1898a537a3dec9d1e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:01.615844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:01.748475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91954cfd424e47c1898a537a3dec9d1e', 'request_id': 'req-5f060c2f-9265-48cd-9247-4142e8f9d4df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:01.776055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91954cfd424e47c1898a537a3dec9d1e', 'request_id': 'req-5f060c2f-9265-48cd-9247-4142e8f9d4df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:01.797998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91954cfd424e47c1898a537a3dec9d1e', 'request_id': 'req-5f060c2f-9265-48cd-9247-4142e8f9d4df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:01.824144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] The token cache is being invalidate because project 91954cfd424e47c1898a537a3dec9d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:01.824730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:01.825629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f060c2f-9265-48cd-9247-4142e8f9d4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:01.839846 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3183/6337] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:01 2022] DELETE /identity/v3/projects/91954cfd424e47c1898a537a3dec9d1e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:01.844218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd6a27-ef1f-456d-8801-fdc71d846b22 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:01.844808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd6a27-ef1f-456d-8801-fdc71d846b22 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:01.844808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd6a27-ef1f-456d-8801-fdc71d846b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:01.865356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-20bd6a27-ef1f-456d-8801-fdc71d846b22 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:01.866617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-20bd6a27-ef1f-456d-8801-fdc71d846b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:01.941047 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3155/6338] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:01.943149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864c321-f5c6-46a5-a33d-d376b2f24f25 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:01.943685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864c321-f5c6-46a5-a33d-d376b2f24f25 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:01.944190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864c321-f5c6-46a5-a33d-d376b2f24f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:01.964737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5864c321-f5c6-46a5-a33d-d376b2f24f25 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:01.966694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5864c321-f5c6-46a5-a33d-d376b2f24f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:01.985278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd6a27-ef1f-456d-8801-fdc71d846b22 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:01.998457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd6a27-ef1f-456d-8801-fdc71d846b22 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:01.999052 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3184/6339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:02.006561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:02.007837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:02.008443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:02.008975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:02.010787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:13:02.011370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:02.013480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:02.036165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864c321-f5c6-46a5-a33d-d376b2f24f25 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:02.050955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864c321-f5c6-46a5-a33d-d376b2f24f25 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:02.051855 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3156/6340] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:13:02.065443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056064c-ee38-4605-a332-ab4be1909e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:02.066592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056064c-ee38-4605-a332-ab4be1909e9b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:02.067058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056064c-ee38-4605-a332-ab4be1909e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:02.067890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056064c-ee38-4605-a332-ab4be1909e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:02.068866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056064c-ee38-4605-a332-ab4be1909e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:02.071283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056064c-ee38-4605-a332-ab4be1909e9b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:02.146170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:02.157462 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3185/6341] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:13:02 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:02.163509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65794e68-8c46-456f-a5f6-092a37fda131 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:02.282557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33d602-96c2-469a-bc59-2133c8051e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:02.284228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d602-96c2-469a-bc59-2133c8051e2f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:02.286719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d602-96c2-469a-bc59-2133c8051e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:02.287329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d602-96c2-469a-bc59-2133c8051e2f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:02.290276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33d602-96c2-469a-bc59-2133c8051e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:02.292761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33d602-96c2-469a-bc59-2133c8051e2f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:02.332019 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3157/6342] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:13:02 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:02.335983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056064c-ee38-4605-a332-ab4be1909e9b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:02.359622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056064c-ee38-4605-a332-ab4be1909e9b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:02.367880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0494-3aad-445b-b959-2581c3f7baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:02.368605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0494-3aad-445b-b959-2581c3f7baa2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:02.368898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0494-3aad-445b-b959-2581c3f7baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:02.369180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0494-3aad-445b-b959-2581c3f7baa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:02.369917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a0494-3aad-445b-b959-2581c3f7baa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:02.371695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a0494-3aad-445b-b959-2581c3f7baa2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:02.389939 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3186/6343] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:02.390928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33d602-96c2-469a-bc59-2133c8051e2f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:02.405518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33d602-96c2-469a-bc59-2133c8051e2f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:02.414618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014f189-0f92-4b9f-9c3c-6a9d92262ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:02.415607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f189-0f92-4b9f-9c3c-6a9d92262ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:02.416717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f189-0f92-4b9f-9c3c-6a9d92262ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:02.417167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f189-0f92-4b9f-9c3c-6a9d92262ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:02.418217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014f189-0f92-4b9f-9c3c-6a9d92262ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:02.420045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014f189-0f92-4b9f-9c3c-6a9d92262ca5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:02.440953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0494-3aad-445b-b959-2581c3f7baa2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:02.449312 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3158/6344] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:13:02.456203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0494-3aad-445b-b959-2581c3f7baa2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:02.463498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8a73-edc6-49d3-8a14-ae7e675c9aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:02.465315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8a73-edc6-49d3-8a14-ae7e675c9aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:02.465766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8a73-edc6-49d3-8a14-ae7e675c9aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:02.466198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8a73-edc6-49d3-8a14-ae7e675c9aa4 admin admin] PATH_INFO: `/v3/projects/08562590a797421dad0397f8d6fc8f14/users/e09836938a574927bc0e14a4b3ef7ae4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:02.492659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f8a73-edc6-49d3-8a14-ae7e675c9aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08562590a797421dad0397f8d6fc8f14, user_id=e09836938a574927bc0e14a4b3ef7ae4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:02.496641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f8a73-edc6-49d3-8a14-ae7e675c9aa4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:02.530281 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3187/6345] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:13:02 2022] PUT /identity/v3/projects/08562590a797421dad0397f8d6fc8f14/users/e09836938a574927bc0e14a4b3ef7ae4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:02.542623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaf23-5d28-4ae2-950d-d2b6316a9630 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:02.542966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaf23-5d28-4ae2-950d-d2b6316a9630 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:02.543458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaf23-5d28-4ae2-950d-d2b6316a9630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:02.599112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-68deaf23-5d28-4ae2-950d-d2b6316a9630 None None] MFA Rules not processed for user `e09836938a574927bc0e14a4b3ef7ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:02.607590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-68deaf23-5d28-4ae2-950d-d2b6316a9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:02.807654 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3159/6346] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:02.812586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8a73-edc6-49d3-8a14-ae7e675c9aa4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:02.977472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8a73-edc6-49d3-8a14-ae7e675c9aa4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:02.985290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f3333-a1dc-450d-8f37-37f1ca0aaff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:02.986657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3333-a1dc-450d-8f37-37f1ca0aaff5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:02.987714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3333-a1dc-450d-8f37-37f1ca0aaff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:02.988001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3333-a1dc-450d-8f37-37f1ca0aaff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:02.988759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f3333-a1dc-450d-8f37-37f1ca0aaff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:02.990722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f3333-a1dc-450d-8f37-37f1ca0aaff5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:03.026222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deaf23-5d28-4ae2-950d-d2b6316a9630 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:03.037267 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3188/6347] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:13:02 2022] POST /identity/v3/projects => generated 405 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:03.039242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deaf23-5d28-4ae2-950d-d2b6316a9630 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:03.116535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78c00a-5e3f-43de-9e2a-6eff57d0a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:03.117378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78c00a-5e3f-43de-9e2a-6eff57d0a4ac admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:03.117674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78c00a-5e3f-43de-9e2a-6eff57d0a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:03.117958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78c00a-5e3f-43de-9e2a-6eff57d0a4ac admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:03.118663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78c00a-5e3f-43de-9e2a-6eff57d0a4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:03.120962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78c00a-5e3f-43de-9e2a-6eff57d0a4ac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:03.165599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f3333-a1dc-450d-8f37-37f1ca0aaff5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:03.166999 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3160/6348] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:13:03 2022] POST /identity/v3/users => generated 309 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:13:03.179087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f3333-a1dc-450d-8f37-37f1ca0aaff5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:03.190688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac10b2-f4c4-4eb2-986a-c1bb6ec6f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:03.191583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac10b2-f4c4-4eb2-986a-c1bb6ec6f5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:03.191868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac10b2-f4c4-4eb2-986a-c1bb6ec6f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:03.195343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac10b2-f4c4-4eb2-986a-c1bb6ec6f5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:03.198252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac10b2-f4c4-4eb2-986a-c1bb6ec6f5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:03.201731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac10b2-f4c4-4eb2-986a-c1bb6ec6f5e3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:03.233926 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3189/6349] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:03.238227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78c00a-5e3f-43de-9e2a-6eff57d0a4ac admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:03.250332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78c00a-5e3f-43de-9e2a-6eff57d0a4ac admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:03.256046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922f17-aebb-411a-a16d-1b9514b82ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:03.259049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922f17-aebb-411a-a16d-1b9514b82ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:03.259337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922f17-aebb-411a-a16d-1b9514b82ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:03.259622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922f17-aebb-411a-a16d-1b9514b82ccd admin admin] PATH_INFO: `/v3/projects/eea896ffc50940ef87a51d8401ee7cf7/users/d9eff8b9a1a445449a0e13064dc824c5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:03.285915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7922f17-aebb-411a-a16d-1b9514b82ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea896ffc50940ef87a51d8401ee7cf7, user_id=d9eff8b9a1a445449a0e13064dc824c5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:03.289798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7922f17-aebb-411a-a16d-1b9514b82ccd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:03.308125 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3161/6350] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:13:03 2022] PUT /identity/v3/projects/eea896ffc50940ef87a51d8401ee7cf7/users/d9eff8b9a1a445449a0e13064dc824c5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:03.313067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac10b2-f4c4-4eb2-986a-c1bb6ec6f5e3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:03.354478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac10b2-f4c4-4eb2-986a-c1bb6ec6f5e3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:03.482132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced469a-275d-4ce5-95c6-380c881bd7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:03.482772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced469a-275d-4ce5-95c6-380c881bd7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:03.483016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced469a-275d-4ce5-95c6-380c881bd7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:03.483523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced469a-275d-4ce5-95c6-380c881bd7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:03.485279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced469a-275d-4ce5-95c6-380c881bd7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:03.487303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced469a-275d-4ce5-95c6-380c881bd7e0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:03.515983 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3190/6351] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:03.521622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922f17-aebb-411a-a16d-1b9514b82ccd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:03.545068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922f17-aebb-411a-a16d-1b9514b82ccd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:03.556217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:03.557570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:03.557703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:03.558065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] PATH_INFO: `/v3/projects/eea896ffc50940ef87a51d8401ee7cf7/users/d9eff8b9a1a445449a0e13064dc824c5/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:03.562799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea896ffc50940ef87a51d8401ee7cf7, user_id=d9eff8b9a1a445449a0e13064dc824c5, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:03.575617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:03.610651 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3162/6352] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:13:03 2022] PUT /identity/v3/projects/eea896ffc50940ef87a51d8401ee7cf7/users/d9eff8b9a1a445449a0e13064dc824c5/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:13:03.612393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077009d-8f5e-4548-8725-c435b8edb569 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:03.613029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077009d-8f5e-4548-8725-c435b8edb569 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:03.613475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077009d-8f5e-4548-8725-c435b8edb569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:03.697087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d077009d-8f5e-4548-8725-c435b8edb569 None None] MFA Rules not processed for user `d9eff8b9a1a445449a0e13064dc824c5`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:03.698810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d077009d-8f5e-4548-8725-c435b8edb569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:03.880604 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3191/6353] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:13:03.911198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:03.913744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:04.039342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55477cf-f7b8-477d-9b66-6eac7ac9d211 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:04.046169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:04.047002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:04.047435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:04.047882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:04.126838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:04.128366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:04.149278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3163/6354] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:05.783301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077009d-8f5e-4548-8725-c435b8edb569 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:05.787443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d077009d-8f5e-4548-8725-c435b8edb569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:05.957637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077009d-8f5e-4548-8725-c435b8edb569 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:05.965035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:05.965852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:05.966156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:05.971871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:05.988752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:05.990827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:06.009406 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3192/6355] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:05 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:15.398489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:15.400892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:15.421041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725902c-93fd-4550-a565-7b6093ec2deb service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:15.429578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:15.430660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:15.432530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:15.432996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:15.435877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:15.550567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:15.552190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:15.579898 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3164/6356] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:16.748501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:16.750114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:16.793245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683570-61df-4459-aae4-00833e2747b6 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:16.801031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:16.802337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:16.802787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:16.803390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] PATH_INFO: `/v3/users/2ee3e5caf3e44b21b66cf9ad197e5999` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:16.805606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee3e5caf3e44b21b66cf9ad197e5999)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:16.808016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:16.870348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee3e5caf3e44b21b66cf9ad197e5999'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:16.884627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee3e5caf3e44b21b66cf9ad197e5999'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:16.893763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee3e5caf3e44b21b66cf9ad197e5999'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:16.894414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee3e5caf3e44b21b66cf9ad197e5999'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:16.895352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee3e5caf3e44b21b66cf9ad197e5999'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:16.915504 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3193/6357] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:16 2022] DELETE /identity/v3/users/2ee3e5caf3e44b21b66cf9ad197e5999 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:17.899979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:17.911089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5663-70ec-4c78-b6dc-43449c56e292 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:17.982906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:17.984043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:17.984508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:17.985029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] PATH_INFO: `/v3/projects/f260ed47c5994487a4cc293c33dae3ea` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:17.987116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f260ed47c5994487a4cc293c33dae3ea)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:17.989317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:18.067922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f260ed47c5994487a4cc293c33dae3ea', 'request_id': 'req-1531768b-b36e-4d1f-8947-0671e28b8b01'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.076252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f260ed47c5994487a4cc293c33dae3ea', 'request_id': 'req-1531768b-b36e-4d1f-8947-0671e28b8b01'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.097777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f260ed47c5994487a4cc293c33dae3ea', 'request_id': 'req-1531768b-b36e-4d1f-8947-0671e28b8b01'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.122833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] The token cache is being invalidate because project f260ed47c5994487a4cc293c33dae3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:18.123187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.124048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1531768b-b36e-4d1f-8947-0671e28b8b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.127090 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3165/6358] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:17 2022] DELETE /identity/v3/projects/f260ed47c5994487a4cc293c33dae3ea => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:18.130799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:18.132627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:18.156084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04f756-6ada-4eb3-b761-749111866f01 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:18.235256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:18.237287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:18.237720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:18.238308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] PATH_INFO: `/v3/users/a73996b5997a4daf83a013ceee247542` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:18.239862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73996b5997a4daf83a013ceee247542)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:18.244017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:18.312536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ebb15-3879-41a2-a69b-069b79f948ec None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:18.313299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ebb15-3879-41a2-a69b-069b79f948ec None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:18.314421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ebb15-3879-41a2-a69b-069b79f948ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:18.339544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9e3ebb15-3879-41a2-a69b-069b79f948ec None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:18.341300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e3ebb15-3879-41a2-a69b-069b79f948ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:18.357578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73996b5997a4daf83a013ceee247542'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.375685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73996b5997a4daf83a013ceee247542'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.388607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73996b5997a4daf83a013ceee247542'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.390301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73996b5997a4daf83a013ceee247542'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.390839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73996b5997a4daf83a013ceee247542'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:18.406884 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3194/6359] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:18 2022] DELETE /identity/v3/users/a73996b5997a4daf83a013ceee247542 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:18.436398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3166/6360] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:18.823556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:18.825031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:18.937882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427d578-f2d6-4e07-8b7c-77613e80ffda admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:18.948270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:18.948270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:18.948270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:18.948270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] PATH_INFO: `/v3/users/b9e2bf42ef6446c69f1775a25ef76a92` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:18.949459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e2bf42ef6446c69f1775a25ef76a92)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:18.952586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:18.981521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ebb15-3879-41a2-a69b-069b79f948ec None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:18.983206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e3ebb15-3879-41a2-a69b-069b79f948ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:19.042166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ebb15-3879-41a2-a69b-069b79f948ec None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:19.064437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e2bf42ef6446c69f1775a25ef76a92'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.064958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:19.067647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:19.069000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:19.069311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] PATH_INFO: `/v3/projects/2eb68cf3f53d44348dc921e15fd8fb0d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:19.073052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb68cf3f53d44348dc921e15fd8fb0d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:19.078154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:19.100887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e2bf42ef6446c69f1775a25ef76a92'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.118198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e2bf42ef6446c69f1775a25ef76a92'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.119356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e2bf42ef6446c69f1775a25ef76a92'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.121241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-32d241c1-2b6e-462e-8f75-fd9ad54e8411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e2bf42ef6446c69f1775a25ef76a92'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.155407 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3195/6361] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:18 2022] DELETE /identity/v3/users/b9e2bf42ef6446c69f1775a25ef76a92 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:19.161776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65da44-9348-452a-b413-6bcb45095667 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:19.162295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65da44-9348-452a-b413-6bcb45095667 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:19.162773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65da44-9348-452a-b413-6bcb45095667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:19.187697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aa65da44-9348-452a-b413-6bcb45095667 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:19.189697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aa65da44-9348-452a-b413-6bcb45095667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:19.235648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb68cf3f53d44348dc921e15fd8fb0d', 'request_id': 'req-d33bbd56-bf56-4679-9d3c-40a989cac287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.263140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb68cf3f53d44348dc921e15fd8fb0d', 'request_id': 'req-d33bbd56-bf56-4679-9d3c-40a989cac287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.281815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb68cf3f53d44348dc921e15fd8fb0d', 'request_id': 'req-d33bbd56-bf56-4679-9d3c-40a989cac287'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.295202 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3196/6362] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:19.306365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] The token cache is being invalidate because project 2eb68cf3f53d44348dc921e15fd8fb0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:19.306948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.307820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:19.310233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3167/6363] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:18 2022] DELETE /identity/v3/projects/2eb68cf3f53d44348dc921e15fd8fb0d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:13:19.319055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898c1d-900a-4d52-a80d-5d5dc0cdb7ce None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:19.319533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898c1d-900a-4d52-a80d-5d5dc0cdb7ce None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:19.320478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b898c1d-900a-4d52-a80d-5d5dc0cdb7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:19.348393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:19.350163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3b898c1d-900a-4d52-a80d-5d5dc0cdb7ce None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:19.351580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3b898c1d-900a-4d52-a80d-5d5dc0cdb7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:19.352835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:19.472911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bbd56-bf56-4679-9d3c-40a989cac287 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:19.499344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:19.499974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:19.500261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:19.501286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:19.511722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:19.547377 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3197/6364] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:19.560508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52e2e-8886-426f-af16-948d12d4bf66 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:19.561131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52e2e-8886-426f-af16-948d12d4bf66 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:19.561284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52e2e-8886-426f-af16-948d12d4bf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:19.621008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3dd52e2e-8886-426f-af16-948d12d4bf66 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:19.623205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3dd52e2e-8886-426f-af16-948d12d4bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:19.639857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:19.641392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:19.649025 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3198/6365] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:19.650065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd52e2e-8886-426f-af16-948d12d4bf66 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:19.655796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3168/6366] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:19.682112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd52e2e-8886-426f-af16-948d12d4bf66 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:19.697603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:19.698293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:19.698573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:19.698854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:19.699591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:13:19.699897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:19.701562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:19.730235 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3199/6367] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:13:19.731560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:19.749594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b02d78-60b0-488f-b082-321da91292a0 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:19.777264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac02889-79e9-4f33-95b1-186afb9ceb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:19.779127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac02889-79e9-4f33-95b1-186afb9ceb8e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:19.779414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac02889-79e9-4f33-95b1-186afb9ceb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:19.779721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac02889-79e9-4f33-95b1-186afb9ceb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:19.780465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac02889-79e9-4f33-95b1-186afb9ceb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:19.785484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac02889-79e9-4f33-95b1-186afb9ceb8e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:19.827939 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3169/6368] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:13:19 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:19.831804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:19.846270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fef1cc-33ae-4991-ae81-3b57f4b23c4a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:19.955192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aeca9-4a8a-48b9-baf1-29061f6e0aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:19.956311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aeca9-4a8a-48b9-baf1-29061f6e0aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:19.956837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aeca9-4a8a-48b9-baf1-29061f6e0aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:19.957314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aeca9-4a8a-48b9-baf1-29061f6e0aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:19.958406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aeca9-4a8a-48b9-baf1-29061f6e0aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:19.960773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aeca9-4a8a-48b9-baf1-29061f6e0aa6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:20.000053 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3200/6369] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:13:19 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:20.005336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac02889-79e9-4f33-95b1-186afb9ceb8e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:20.020396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290cce2-79ac-4cdc-ba3a-90a716ce2123 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.020808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290cce2-79ac-4cdc-ba3a-90a716ce2123 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.020939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290cce2-79ac-4cdc-ba3a-90a716ce2123 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.024436 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3201/6370] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:13:20.025512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac02889-79e9-4f33-95b1-186afb9ceb8e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:20.039998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe66bc-95a2-410d-a050-a2695b75b42b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.040434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe66bc-95a2-410d-a050-a2695b75b42b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.040612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe66bc-95a2-410d-a050-a2695b75b42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.054178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c334b-8575-4a11-858a-c15e3d254403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:20.056039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c334b-8575-4a11-858a-c15e3d254403 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.056510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c334b-8575-4a11-858a-c15e3d254403 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.062015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c334b-8575-4a11-858a-c15e3d254403 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.065149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c334b-8575-4a11-858a-c15e3d254403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:20.068940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c334b-8575-4a11-858a-c15e3d254403 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:20.109089 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3170/6371] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:20.112277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c334b-8575-4a11-858a-c15e3d254403 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:20.149744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c334b-8575-4a11-858a-c15e3d254403 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:20.168683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec73ca-c017-4dda-87f0-ad91a75eba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:20.172162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec73ca-c017-4dda-87f0-ad91a75eba57 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.172483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec73ca-c017-4dda-87f0-ad91a75eba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.173661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec73ca-c017-4dda-87f0-ad91a75eba57 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.175528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec73ca-c017-4dda-87f0-ad91a75eba57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:20.182143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec73ca-c017-4dda-87f0-ad91a75eba57 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:20.182398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8ebe66bc-95a2-410d-a050-a2695b75b42b None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:20.184405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8ebe66bc-95a2-410d-a050-a2695b75b42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:20.211920 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3171/6372] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:20.214171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec73ca-c017-4dda-87f0-ad91a75eba57 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:20.242479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec73ca-c017-4dda-87f0-ad91a75eba57 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:20.257359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:20.258570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.258847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.259132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] PATH_INFO: `/v3/projects/1c438bd56e19499a91a00c3757b6f9f0/users/1d25416fd67e4dd08da5ed2408649327/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.301622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c438bd56e19499a91a00c3757b6f9f0, user_id=1d25416fd67e4dd08da5ed2408649327, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:20.307406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:20.338639 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3172/6373] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:13:20 2022] PUT /identity/v3/projects/1c438bd56e19499a91a00c3757b6f9f0/users/1d25416fd67e4dd08da5ed2408649327/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:13:20.340921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:20.344903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:20.392165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3202/6374] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:20.407254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe66bc-95a2-410d-a050-a2695b75b42b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:20.424570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8ebe66bc-95a2-410d-a050-a2695b75b42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:20.446255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe66bc-95a2-410d-a050-a2695b75b42b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:20.562707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac860a-1d56-4017-9aba-ae63246fa8e0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:20.577960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6ad0a-6280-4159-b7e0-e4a34c841844 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:20.580692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ad0a-6280-4159-b7e0-e4a34c841844 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.581197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ad0a-6280-4159-b7e0-e4a34c841844 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.582271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ad0a-6280-4159-b7e0-e4a34c841844 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.585078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-83e6ad0a-6280-4159-b7e0-e4a34c841844 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:20.605537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6ad0a-6280-4159-b7e0-e4a34c841844 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:20.609560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6ad0a-6280-4159-b7e0-e4a34c841844 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:20.621640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:20.623078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.623302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.623588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] PATH_INFO: `/v3/projects/9f4ed687e80941d9a5befe1031923ed5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.625188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4ed687e80941d9a5befe1031923ed5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:20.629195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:20.663589 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3173/6375] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:20.665975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796acf86-2172-4a21-99a7-20bb225ccee0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.666275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796acf86-2172-4a21-99a7-20bb225ccee0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.666561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796acf86-2172-4a21-99a7-20bb225ccee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.703805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-796acf86-2172-4a21-99a7-20bb225ccee0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:20.705427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-796acf86-2172-4a21-99a7-20bb225ccee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:20.730062 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3174/6376] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:20.731023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796acf86-2172-4a21-99a7-20bb225ccee0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:20.737644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-796acf86-2172-4a21-99a7-20bb225ccee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:20.764030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796acf86-2172-4a21-99a7-20bb225ccee0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:20.781927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4ed687e80941d9a5befe1031923ed5', 'request_id': 'req-382c7c67-640c-42d8-b519-5994f8f2c98a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:20.796826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4ed687e80941d9a5befe1031923ed5', 'request_id': 'req-382c7c67-640c-42d8-b519-5994f8f2c98a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:20.827633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4ed687e80941d9a5befe1031923ed5', 'request_id': 'req-382c7c67-640c-42d8-b519-5994f8f2c98a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:20.855341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] The token cache is being invalidate because project 9f4ed687e80941d9a5befe1031923ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:20.856683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:20.858826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:20.864595 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3203/6377] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:20 2022] DELETE /identity/v3/projects/9f4ed687e80941d9a5befe1031923ed5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:20.869387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:20.873497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:20.920181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:20.921404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.927832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.928263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.932792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:20.969917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:20.972246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:20.984110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7c67-640c-42d8-b519-5994f8f2c98a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:20.990261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccf412-0bf6-44c0-a2a1-240dc56e43bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:20.991143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf412-0bf6-44c0-a2a1-240dc56e43bf service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:20.991497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf412-0bf6-44c0-a2a1-240dc56e43bf service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:20.991783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf412-0bf6-44c0-a2a1-240dc56e43bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:20.994748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-44ccf412-0bf6-44c0-a2a1-240dc56e43bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:21.007948 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3175/6378] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:21.010712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:21.014230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:21.162120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccf412-0bf6-44c0-a2a1-240dc56e43bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:21.165103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccf412-0bf6-44c0-a2a1-240dc56e43bf service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:21.170793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3e8e-6371-466d-b16a-4dd2dd9e530b service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:21.183022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:21.183563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3204/6379] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:21.184020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:21.184115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:21.184494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] PATH_INFO: `/v3/users/3e7e07d3b583452386242a42cd87acc1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:21.185418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517730-4620-49da-8db0-0ca54c0528fb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:21.185711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517730-4620-49da-8db0-0ca54c0528fb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:21.185987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517730-4620-49da-8db0-0ca54c0528fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:21.186975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7e07d3b583452386242a42cd87acc1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:21.192141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:21.211175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bb517730-4620-49da-8db0-0ca54c0528fb None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:21.212962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bb517730-4620-49da-8db0-0ca54c0528fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:21.294711 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3205/6380] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:21.297821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7e07d3b583452386242a42cd87acc1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:21.298614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7e07d3b583452386242a42cd87acc1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:21.299449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7e07d3b583452386242a42cd87acc1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:21.316177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7e07d3b583452386242a42cd87acc1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:21.333182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08bed54c-8af0-4194-944c-30f74ca71fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7e07d3b583452386242a42cd87acc1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:21.352149 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3176/6381] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:21 2022] DELETE /identity/v3/users/3e7e07d3b583452386242a42cd87acc1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:22.252147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb517730-4620-49da-8db0-0ca54c0528fb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:22.254292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bb517730-4620-49da-8db0-0ca54c0528fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:22.291674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb517730-4620-49da-8db0-0ca54c0528fb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:22.365798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:22.367249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:22.367249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:22.367249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] PATH_INFO: `/v3/users/e09836938a574927bc0e14a4b3ef7ae4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:22.368507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09836938a574927bc0e14a4b3ef7ae4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:22.370467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:22.458491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09836938a574927bc0e14a4b3ef7ae4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.476702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09836938a574927bc0e14a4b3ef7ae4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.499145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09836938a574927bc0e14a4b3ef7ae4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.499926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09836938a574927bc0e14a4b3ef7ae4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.502819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09836938a574927bc0e14a4b3ef7ae4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.546844 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3206/6382] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:22 2022] DELETE /identity/v3/users/e09836938a574927bc0e14a4b3ef7ae4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:22.551239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9e0b-edac-4603-b3bd-d49dd6ba5fb7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:22.553570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9e0b-edac-4603-b3bd-d49dd6ba5fb7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:22.555781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9e0b-edac-4603-b3bd-d49dd6ba5fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:22.586601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:22.588742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:22.617767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3c9e9e0b-edac-4603-b3bd-d49dd6ba5fb7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:22.626209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3c9e9e0b-edac-4603-b3bd-d49dd6ba5fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:22.711557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666cdd0-fbaf-46da-8f5e-23fd6ccc9495 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:22.721933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:22.735758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:22.735758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:22.735758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] PATH_INFO: `/v3/projects/d7a70abff20548db85811d1b374387b3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:22.738176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a70abff20548db85811d1b374387b3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:22.739726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:22.829140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a70abff20548db85811d1b374387b3', 'request_id': 'req-7d5367ba-fab4-4484-a975-6ac4524bb499'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.830411 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3177/6383] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:22.831980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a6ef-4b0b-4466-b7ad-52b748b17ed3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:22.832520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a6ef-4b0b-4466-b7ad-52b748b17ed3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:22.833037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a6ef-4b0b-4466-b7ad-52b748b17ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:22.846206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a70abff20548db85811d1b374387b3', 'request_id': 'req-7d5367ba-fab4-4484-a975-6ac4524bb499'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.866627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a70abff20548db85811d1b374387b3', 'request_id': 'req-7d5367ba-fab4-4484-a975-6ac4524bb499'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.877145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-20a6a6ef-4b0b-4466-b7ad-52b748b17ed3 None None] MFA Rules not processed for user `1d25416fd67e4dd08da5ed2408649327`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:22.879891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-20a6a6ef-4b0b-4466-b7ad-52b748b17ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:22.886501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] The token cache is being invalidate because project d7a70abff20548db85811d1b374387b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:22.887040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.888019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:22.890973 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3207/6384] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:22 2022] DELETE /identity/v3/projects/d7a70abff20548db85811d1b374387b3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:13:22.896801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:22.898909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:22.996487 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3178/6385] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:22.996487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a6ef-4b0b-4466-b7ad-52b748b17ed3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:22.996487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-20a6a6ef-4b0b-4466-b7ad-52b748b17ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:23.000051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5367ba-fab4-4484-a975-6ac4524bb499 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:23.004938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbd504-5312-405b-a456-3a3db26aaf5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:23.005976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd504-5312-405b-a456-3a3db26aaf5e service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:23.006463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd504-5312-405b-a456-3a3db26aaf5e service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:23.007347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd504-5312-405b-a456-3a3db26aaf5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:23.011549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-37fbd504-5312-405b-a456-3a3db26aaf5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:23.181467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a6ef-4b0b-4466-b7ad-52b748b17ed3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:23.199109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:23.200038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:23.200290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:23.200596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] PATH_INFO: `/v3/users/744c8535c989444e99ceedccdfe9c2be` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:23.204214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbd504-5312-405b-a456-3a3db26aaf5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:23.205768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbd504-5312-405b-a456-3a3db26aaf5e service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:23.213428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744c8535c989444e99ceedccdfe9c2be)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:23.215431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:23.238557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3208/6386] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:23.239926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be79b34-03ae-40b4-81d6-b440e9acec85 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:23.240214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be79b34-03ae-40b4-81d6-b440e9acec85 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:23.240537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be79b34-03ae-40b4-81d6-b440e9acec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:23.285795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9be79b34-03ae-40b4-81d6-b440e9acec85 None None] MFA Rules not processed for user `1d25416fd67e4dd08da5ed2408649327`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:23.295560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9be79b34-03ae-40b4-81d6-b440e9acec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:23.327820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3209/6387] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:23.345809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be79b34-03ae-40b4-81d6-b440e9acec85 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:23.353826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9be79b34-03ae-40b4-81d6-b440e9acec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:23.366370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744c8535c989444e99ceedccdfe9c2be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.368175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744c8535c989444e99ceedccdfe9c2be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.370300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744c8535c989444e99ceedccdfe9c2be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.425136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744c8535c989444e99ceedccdfe9c2be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.450359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744c8535c989444e99ceedccdfe9c2be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.471987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3179/6388] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:22 2022] DELETE /identity/v3/users/744c8535c989444e99ceedccdfe9c2be => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:23.583528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:23.585307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:23.590853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be79b34-03ae-40b4-81d6-b440e9acec85 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:23.738307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:23.738996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:23.739690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:23.739690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:23.741863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:23.802298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e84e-df54-4e97-8bb8-cbef0b229c95 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:23.822734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:23.823640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:23.823942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:23.824193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] PATH_INFO: `/v3/users/7132cae4ebd549d491f5d0dcf83394ed` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:23.825538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7132cae4ebd549d491f5d0dcf83394ed)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:23.827811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:23.862704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:23.864987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:23.891168 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3210/6389] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:23.900851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:23.912606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:23.947505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7132cae4ebd549d491f5d0dcf83394ed'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.949193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7132cae4ebd549d491f5d0dcf83394ed'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.950628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7132cae4ebd549d491f5d0dcf83394ed'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.963375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3095bc0-ccbe-4319-8a1a-25fb7d8ac0e9 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:23.987801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7132cae4ebd549d491f5d0dcf83394ed'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:23.993376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:23.996848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:23.998304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:23.998700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] PATH_INFO: `/v3/projects/08562590a797421dad0397f8d6fc8f14` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:24.002908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08562590a797421dad0397f8d6fc8f14)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:24.004907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:24.010886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7132cae4ebd549d491f5d0dcf83394ed'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.043372 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3180/6390] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:23 2022] DELETE /identity/v3/users/7132cae4ebd549d491f5d0dcf83394ed => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:24.045896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:24.056048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:24.078926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08562590a797421dad0397f8d6fc8f14', 'request_id': 'req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.087278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08562590a797421dad0397f8d6fc8f14', 'request_id': 'req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.103683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08562590a797421dad0397f8d6fc8f14', 'request_id': 'req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.123015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] The token cache is being invalidate because project 08562590a797421dad0397f8d6fc8f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:24.123846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.125473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.133051 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3211/6391] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:23 2022] DELETE /identity/v3/projects/08562590a797421dad0397f8d6fc8f14 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:24.134894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:24.136674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:24.209220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81940c-b08c-437d-b527-8c33da496048 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:24.252432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975b60e-4ec2-4dfd-81d8-cffb1c0e7eb8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:24.257760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:24.258171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:24.258446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:24.258731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] PATH_INFO: `/v3/users/d9eff8b9a1a445449a0e13064dc824c5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:24.260196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9eff8b9a1a445449a0e13064dc824c5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:24.262197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:24.291277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:24.293294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:24.294041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:24.294601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] PATH_INFO: `/v3/projects/1113a42ca18c4dc6aebfed897b6cdfbf` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:24.296294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1113a42ca18c4dc6aebfed897b6cdfbf)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:24.299367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:24.347365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9eff8b9a1a445449a0e13064dc824c5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.365808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9eff8b9a1a445449a0e13064dc824c5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.368102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1113a42ca18c4dc6aebfed897b6cdfbf', 'request_id': 'req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.373040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9eff8b9a1a445449a0e13064dc824c5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.374239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9eff8b9a1a445449a0e13064dc824c5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.375234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9eff8b9a1a445449a0e13064dc824c5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.376787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1113a42ca18c4dc6aebfed897b6cdfbf', 'request_id': 'req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.390040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1113a42ca18c4dc6aebfed897b6cdfbf', 'request_id': 'req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.406892 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3212/6392] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:24 2022] DELETE /identity/v3/users/d9eff8b9a1a445449a0e13064dc824c5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:24.406892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:24.407785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:24.420187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] The token cache is being invalidate because project 1113a42ca18c4dc6aebfed897b6cdfbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:24.421022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.422126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:24.440374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3181/6393] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:24 2022] DELETE /identity/v3/projects/1113a42ca18c4dc6aebfed897b6cdfbf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:24.440374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:24.440374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:24.499568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94501b4b-26f2-4861-8d2f-0cac6b225716 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:24.515457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:24.515457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:24.515457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:24.515457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:24.515917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:24.528569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:24.531644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:24.547122 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3213/6394] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:24.570918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3ee8f-3b3f-4dd0-b57d-df7c61a3370c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:24.582221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:24.597151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:24.598342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:24.598789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:24.603393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:24.630544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:24.647102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:24.667111 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3182/6395] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:24.827306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:24.828940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:24.929875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd2728-754b-46b5-9ff8-47e8d17f904a service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:24.932724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:24.934371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:24.934692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:24.935704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:24.936111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:24.936452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] PATH_INFO: `/v3/projects/eea896ffc50940ef87a51d8401ee7cf7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:24.937820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea896ffc50940ef87a51d8401ee7cf7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:24.939851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:24.968109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550932a-9830-44a8-aaf4-5adb0ca76eaa service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:24.995098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:24.997471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:24.997994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:24.998475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] PATH_INFO: `/v3/projects/adecc012aca243138d03c189f5623f73` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:24.999846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] RBAC: Authorizing `identity:delete_project(project_id=adecc012aca243138d03c189f5623f73)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.003211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.046636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea896ffc50940ef87a51d8401ee7cf7', 'request_id': 'req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.053704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea896ffc50940ef87a51d8401ee7cf7', 'request_id': 'req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.062829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea896ffc50940ef87a51d8401ee7cf7', 'request_id': 'req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.078930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] The token cache is being invalidate because project eea896ffc50940ef87a51d8401ee7cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:25.080497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.085778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5c45c810-bb61-4d5d-a7fc-36f5c7eb1773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.087988 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3214/6396] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:24 2022] DELETE /identity/v3/projects/eea896ffc50940ef87a51d8401ee7cf7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:25.094109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fdde-0e34-46de-b8eb-c6c08c507f9a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.094493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fdde-0e34-46de-b8eb-c6c08c507f9a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.095410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fdde-0e34-46de-b8eb-c6c08c507f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.111171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adecc012aca243138d03c189f5623f73', 'request_id': 'req-16db3028-a9cc-49b8-9c04-19bf4d19879c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.119797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1889fdde-0e34-46de-b8eb-c6c08c507f9a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:25.121133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adecc012aca243138d03c189f5623f73', 'request_id': 'req-16db3028-a9cc-49b8-9c04-19bf4d19879c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.123825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1889fdde-0e34-46de-b8eb-c6c08c507f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:25.144582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adecc012aca243138d03c189f5623f73', 'request_id': 'req-16db3028-a9cc-49b8-9c04-19bf4d19879c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.163235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] The token cache is being invalidate because project adecc012aca243138d03c189f5623f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:25.163466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.164066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-16db3028-a9cc-49b8-9c04-19bf4d19879c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:25.166056 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3183/6397] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:24 2022] DELETE /identity/v3/projects/adecc012aca243138d03c189f5623f73 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:25.171182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75856f-96c9-4b9d-8cab-243bffdf008e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.171523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75856f-96c9-4b9d-8cab-243bffdf008e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.171882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75856f-96c9-4b9d-8cab-243bffdf008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.198565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4d75856f-96c9-4b9d-8cab-243bffdf008e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:25.199826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4d75856f-96c9-4b9d-8cab-243bffdf008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:25.215692 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3215/6398] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:25.225741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1f7a-653f-4ff4-8b28-0a579fd8d834 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.226300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1f7a-653f-4ff4-8b28-0a579fd8d834 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.226784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1f7a-653f-4ff4-8b28-0a579fd8d834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.250247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-426d1f7a-653f-4ff4-8b28-0a579fd8d834 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:25.252249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-426d1f7a-653f-4ff4-8b28-0a579fd8d834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:25.262205 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3216/6399] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:25.267806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d1f7a-653f-4ff4-8b28-0a579fd8d834 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.274101 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3184/6400] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:25.279504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d1f7a-653f-4ff4-8b28-0a579fd8d834 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.282402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb24779-4857-4e8b-be4a-72980e097e58 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.282805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb24779-4857-4e8b-be4a-72980e097e58 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.283158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb24779-4857-4e8b-be4a-72980e097e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.284060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.284800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.285088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.285475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.286273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:13:25.286587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.288218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.303574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3217/6401] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:13:25.309877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.312833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-adb24779-4857-4e8b-be4a-72980e097e58 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:25.312987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-adb24779-4857-4e8b-be4a-72980e097e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:25.325337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873b16e-06d5-4ba3-8901-f4fdb6d9f813 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.326109 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3185/6402] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:25.329655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb24779-4857-4e8b-be4a-72980e097e58 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.331817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9cad-a866-47d5-b2f2-6616085e2062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.332631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9cad-a866-47d5-b2f2-6616085e2062 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.332983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9cad-a866-47d5-b2f2-6616085e2062 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.333331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9cad-a866-47d5-b2f2-6616085e2062 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.334155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b9cad-a866-47d5-b2f2-6616085e2062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.336426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b9cad-a866-47d5-b2f2-6616085e2062 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.340915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb24779-4857-4e8b-be4a-72980e097e58 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.346488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.347206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.347547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.347829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.348595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:13:25.348904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.350540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.366098 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3186/6403] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:13:25.370414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.375788 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3218/6404] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:25.379102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9cad-a866-47d5-b2f2-6616085e2062 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.383092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdabed3-8966-49bd-9495-b11b66077825 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.456144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451dec0-75e3-4ceb-9069-07696c08a14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.456881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451dec0-75e3-4ceb-9069-07696c08a14e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.457186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451dec0-75e3-4ceb-9069-07696c08a14e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.457457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451dec0-75e3-4ceb-9069-07696c08a14e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.458160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451dec0-75e3-4ceb-9069-07696c08a14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.460291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451dec0-75e3-4ceb-9069-07696c08a14e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.462983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9cad-a866-47d5-b2f2-6616085e2062 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.469377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368b10-4eb8-4629-82a5-14148658f183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.470648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368b10-4eb8-4629-82a5-14148658f183 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.471206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368b10-4eb8-4629-82a5-14148658f183 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.471622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368b10-4eb8-4629-82a5-14148658f183 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.472561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34368b10-4eb8-4629-82a5-14148658f183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.476234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34368b10-4eb8-4629-82a5-14148658f183 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.510421 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3219/6405] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:25.512376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368b10-4eb8-4629-82a5-14148658f183 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.534025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368b10-4eb8-4629-82a5-14148658f183 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.535075 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3187/6406] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:13:25.539161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451dec0-75e3-4ceb-9069-07696c08a14e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.625935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce8c9b-b570-4ea6-99d1-a8da720e4bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.627153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8c9b-b570-4ea6-99d1-a8da720e4bef admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.627440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8c9b-b570-4ea6-99d1-a8da720e4bef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.627720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8c9b-b570-4ea6-99d1-a8da720e4bef admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.628488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce8c9b-b570-4ea6-99d1-a8da720e4bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.630150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce8c9b-b570-4ea6-99d1-a8da720e4bef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.659887 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3220/6407] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:25.663522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce8c9b-b570-4ea6-99d1-a8da720e4bef admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.677914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce8c9b-b570-4ea6-99d1-a8da720e4bef admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.681094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451dec0-75e3-4ceb-9069-07696c08a14e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.688072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9749f6b-4a31-409b-9796-4e81440c1164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.689457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749f6b-4a31-409b-9796-4e81440c1164 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.689839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749f6b-4a31-409b-9796-4e81440c1164 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.690441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749f6b-4a31-409b-9796-4e81440c1164 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.691358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9749f6b-4a31-409b-9796-4e81440c1164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.709811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9749f6b-4a31-409b-9796-4e81440c1164 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.717901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a9bc5-4563-42aa-b687-381a38713c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.718596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9bc5-4563-42aa-b687-381a38713c6b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.718878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9bc5-4563-42aa-b687-381a38713c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.719153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9bc5-4563-42aa-b687-381a38713c6b admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.721205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a9bc5-4563-42aa-b687-381a38713c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.723212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a9bc5-4563-42aa-b687-381a38713c6b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.734921 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3221/6408] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:25.740642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9749f6b-4a31-409b-9796-4e81440c1164 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.760943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9749f6b-4a31-409b-9796-4e81440c1164 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.763765 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3188/6409] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:25.767584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a9bc5-4563-42aa-b687-381a38713c6b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.768394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4754f9b-1d8e-476e-a507-83c3edb6e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.769609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754f9b-1d8e-476e-a507-83c3edb6e1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.770236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754f9b-1d8e-476e-a507-83c3edb6e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.770452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754f9b-1d8e-476e-a507-83c3edb6e1ec admin admin] PATH_INFO: `/v3/projects/71b8f054c56b4b679894bdbfd17692ef/users/9b67c1699f4c4d099ca2f293ab1f24ce/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.791355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a9bc5-4563-42aa-b687-381a38713c6b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.795712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4754f9b-1d8e-476e-a507-83c3edb6e1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b8f054c56b4b679894bdbfd17692ef, user_id=9b67c1699f4c4d099ca2f293ab1f24ce, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.801752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4754f9b-1d8e-476e-a507-83c3edb6e1ec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.802178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e137ff-8987-42ff-beb8-0ba1f92740bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:25.802904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e137ff-8987-42ff-beb8-0ba1f92740bf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.803189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e137ff-8987-42ff-beb8-0ba1f92740bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.803470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e137ff-8987-42ff-beb8-0ba1f92740bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.804217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e137ff-8987-42ff-beb8-0ba1f92740bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:25.806293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e137ff-8987-42ff-beb8-0ba1f92740bf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:25.829949 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3222/6410] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:13:25 2022] PUT /identity/v3/projects/71b8f054c56b4b679894bdbfd17692ef/users/9b67c1699f4c4d099ca2f293ab1f24ce/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:25.841012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687a99d-bb33-4276-85c0-c684a1b5fca8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:25.841585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687a99d-bb33-4276-85c0-c684a1b5fca8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:25.841946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687a99d-bb33-4276-85c0-c684a1b5fca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:25.847120 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3189/6411] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:13:25.848156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e137ff-8987-42ff-beb8-0ba1f92740bf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:25.877888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e137ff-8987-42ff-beb8-0ba1f92740bf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:25.907492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2687a99d-bb33-4276-85c0-c684a1b5fca8 None None] MFA Rules not processed for user `9b67c1699f4c4d099ca2f293ab1f24ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:25.908895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2687a99d-bb33-4276-85c0-c684a1b5fca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:26.028523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:26.031528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:26.031719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:26.032050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:26.033599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:26.036381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:26.066405 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3223/6412] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:26.072007 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3190/6413] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:26.077247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687a99d-bb33-4276-85c0-c684a1b5fca8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:26.095454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687a99d-bb33-4276-85c0-c684a1b5fca8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:26.102208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2fe4c-aa2b-4ef5-956d-38dfcaea960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:26.103217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2fe4c-aa2b-4ef5-956d-38dfcaea960d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:26.103533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2fe4c-aa2b-4ef5-956d-38dfcaea960d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:26.103889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2fe4c-aa2b-4ef5-956d-38dfcaea960d admin admin] PATH_INFO: `/v3/projects/9f7a8678732a40b383cedd20600e102e/users/5e825e0ef42743238263e6758e53e28c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:26.106509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:26.108629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:26.124752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2fe4c-aa2b-4ef5-956d-38dfcaea960d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7a8678732a40b383cedd20600e102e, user_id=5e825e0ef42743238263e6758e53e28c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:26.128193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2fe4c-aa2b-4ef5-956d-38dfcaea960d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:26.152642 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3224/6414] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:13:26 2022] PUT /identity/v3/projects/9f7a8678732a40b383cedd20600e102e/users/5e825e0ef42743238263e6758e53e28c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:13:26.154705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba530-1c44-4143-8b23-9c31bef47c4e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:26.155741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba530-1c44-4143-8b23-9c31bef47c4e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:26.156245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba530-1c44-4143-8b23-9c31bef47c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:26.208877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-15aba530-1c44-4143-8b23-9c31bef47c4e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:26.210149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-15aba530-1c44-4143-8b23-9c31bef47c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:26.297563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445de94e-f847-43a0-99f4-cd5988b33118 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:26.366491 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3225/6415] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:26.389482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aba530-1c44-4143-8b23-9c31bef47c4e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:26.391026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-15aba530-1c44-4143-8b23-9c31bef47c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:26.412195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a52f1-744f-4145-898f-93dbe4d2a4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:26.413030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a52f1-744f-4145-898f-93dbe4d2a4ba service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:26.413437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a52f1-744f-4145-898f-93dbe4d2a4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:26.413599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a52f1-744f-4145-898f-93dbe4d2a4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:26.504735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aba530-1c44-4143-8b23-9c31bef47c4e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:26.518816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54851-9ac7-4a3f-a8ce-2a88e231752a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:26.520055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54851-9ac7-4a3f-a8ce-2a88e231752a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:26.520373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54851-9ac7-4a3f-a8ce-2a88e231752a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:26.520676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54851-9ac7-4a3f-a8ce-2a88e231752a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:26.523915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a52f1-744f-4145-898f-93dbe4d2a4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:26.525845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a52f1-744f-4145-898f-93dbe4d2a4ba service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:26.533323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54851-9ac7-4a3f-a8ce-2a88e231752a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:26.534966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54851-9ac7-4a3f-a8ce-2a88e231752a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:26.540899 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3191/6416] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:26.547001 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3226/6417] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:26.653965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a52f1-744f-4145-898f-93dbe4d2a4ba service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:26.677371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a52f1-744f-4145-898f-93dbe4d2a4ba service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:26.690116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:26.692818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:26.694144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:26.694705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] PATH_INFO: `/v3/users/9b67c1699f4c4d099ca2f293ab1f24ce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:26.697464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b67c1699f4c4d099ca2f293ab1f24ce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:26.700013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:26.785196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b67c1699f4c4d099ca2f293ab1f24ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:26.786480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b67c1699f4c4d099ca2f293ab1f24ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:26.787130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b67c1699f4c4d099ca2f293ab1f24ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:26.804196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b67c1699f4c4d099ca2f293ab1f24ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:26.815511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b67c1699f4c4d099ca2f293ab1f24ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:26.840320 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3192/6418] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:26 2022] DELETE /identity/v3/users/9b67c1699f4c4d099ca2f293ab1f24ce => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:26.842053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383da7b-f2f8-4c4b-b5dd-c0285f310614 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:26.842372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383da7b-f2f8-4c4b-b5dd-c0285f310614 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:26.842672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383da7b-f2f8-4c4b-b5dd-c0285f310614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:26.863292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1383da7b-f2f8-4c4b-b5dd-c0285f310614 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:26.865026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1383da7b-f2f8-4c4b-b5dd-c0285f310614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:26.985283 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3227/6419] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:26.997920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:26.999889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:27.097343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35335b-e50a-4da4-bc3c-7b54872b68fc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:27.102651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3730bc1-c8ee-4be5-a95a-b0ab1283c4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:27.104146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730bc1-c8ee-4be5-a95a-b0ab1283c4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:27.104688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730bc1-c8ee-4be5-a95a-b0ab1283c4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:27.105183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730bc1-c8ee-4be5-a95a-b0ab1283c4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:27.118062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3730bc1-c8ee-4be5-a95a-b0ab1283c4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:27.121165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3730bc1-c8ee-4be5-a95a-b0ab1283c4f6 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:27.134860 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3193/6420] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:13:28.258693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383da7b-f2f8-4c4b-b5dd-c0285f310614 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:28.260572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1383da7b-f2f8-4c4b-b5dd-c0285f310614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:28.293524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383da7b-f2f8-4c4b-b5dd-c0285f310614 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:28.302112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:28.303174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:28.303613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:28.304095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] PATH_INFO: `/v3/projects/71b8f054c56b4b679894bdbfd17692ef` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:28.306387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b8f054c56b4b679894bdbfd17692ef)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:28.310046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:28.379667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b8f054c56b4b679894bdbfd17692ef', 'request_id': 'req-ec604cfa-a3d3-4daf-813a-b4f847128d2e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:28.402210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b8f054c56b4b679894bdbfd17692ef', 'request_id': 'req-ec604cfa-a3d3-4daf-813a-b4f847128d2e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:28.445513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b8f054c56b4b679894bdbfd17692ef', 'request_id': 'req-ec604cfa-a3d3-4daf-813a-b4f847128d2e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:28.477729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] The token cache is being invalidate because project 71b8f054c56b4b679894bdbfd17692ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:28.478034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:28.479805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec604cfa-a3d3-4daf-813a-b4f847128d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:28.484024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3228/6421] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:28 2022] DELETE /identity/v3/projects/71b8f054c56b4b679894bdbfd17692ef => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:28.489389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299608-3a1c-4c6b-ac35-f323e08b4d62 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:28.489974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299608-3a1c-4c6b-ac35-f323e08b4d62 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:28.490083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299608-3a1c-4c6b-ac35-f323e08b4d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:28.526341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-88299608-3a1c-4c6b-ac35-f323e08b4d62 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:28.527560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-88299608-3a1c-4c6b-ac35-f323e08b4d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:28.679752 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3194/6422] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:28.680710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44b022-edf4-4f8f-b73e-dead9d92ad3a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:28.681039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44b022-edf4-4f8f-b73e-dead9d92ad3a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:28.681393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44b022-edf4-4f8f-b73e-dead9d92ad3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:28.736802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fc44b022-edf4-4f8f-b73e-dead9d92ad3a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:28.738125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fc44b022-edf4-4f8f-b73e-dead9d92ad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:28.762337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299608-3a1c-4c6b-ac35-f323e08b4d62 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:28.775618 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3229/6423] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:28.782783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299608-3a1c-4c6b-ac35-f323e08b4d62 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:28.791032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e660d-7b3e-4c15-b603-a758056c2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:28.791772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e660d-7b3e-4c15-b603-a758056c2a46 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:28.792061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e660d-7b3e-4c15-b603-a758056c2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:28.792610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e660d-7b3e-4c15-b603-a758056c2a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:28.793489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e660d-7b3e-4c15-b603-a758056c2a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:13:28.793710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e660d-7b3e-4c15-b603-a758056c2a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:28.795993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e660d-7b3e-4c15-b603-a758056c2a46 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:28.822052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44b022-edf4-4f8f-b73e-dead9d92ad3a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:28.825926 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3195/6424] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:13:28.841824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885410-1170-49e6-b046-87ef725b3d49 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:28.842241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885410-1170-49e6-b046-87ef725b3d49 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:28.842624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885410-1170-49e6-b046-87ef725b3d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:28.850241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44b022-edf4-4f8f-b73e-dead9d92ad3a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:28.860420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935d816-d80b-4534-869e-4b0763da7462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:28.861686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935d816-d80b-4534-869e-4b0763da7462 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:28.862126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935d816-d80b-4534-869e-4b0763da7462 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:28.863126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935d816-d80b-4534-869e-4b0763da7462 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:28.864499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935d816-d80b-4534-869e-4b0763da7462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:28.869236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935d816-d80b-4534-869e-4b0763da7462 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:28.918395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-27885410-1170-49e6-b046-87ef725b3d49 None None] MFA Rules not processed for user `5e825e0ef42743238263e6758e53e28c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:28.920150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-27885410-1170-49e6-b046-87ef725b3d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:28.924544 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3230/6425] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:13:28 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:28.930189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935d816-d80b-4534-869e-4b0763da7462 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:29.083937 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3196/6426] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:29.128863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935d816-d80b-4534-869e-4b0763da7462 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:29.140822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b4226-cf4d-4bbf-ac4a-18e6b5b7e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:29.143393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4226-cf4d-4bbf-ac4a-18e6b5b7e4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:29.145205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4226-cf4d-4bbf-ac4a-18e6b5b7e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:29.145781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4226-cf4d-4bbf-ac4a-18e6b5b7e4e5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:29.146965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b4226-cf4d-4bbf-ac4a-18e6b5b7e4e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:29.149554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b4226-cf4d-4bbf-ac4a-18e6b5b7e4e5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:29.179718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09814f-db63-41a0-8398-08f8bf54e892 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:29.180297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09814f-db63-41a0-8398-08f8bf54e892 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:29.180842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09814f-db63-41a0-8398-08f8bf54e892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:29.201229 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3231/6427] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:13:28 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:29.207680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b4226-cf4d-4bbf-ac4a-18e6b5b7e4e5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:29.222669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9f09814f-db63-41a0-8398-08f8bf54e892 None None] MFA Rules not processed for user `5e825e0ef42743238263e6758e53e28c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:29.228777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f09814f-db63-41a0-8398-08f8bf54e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:29.241340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b4226-cf4d-4bbf-ac4a-18e6b5b7e4e5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:29.253419 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3197/6428] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:13:29.258696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcee75c-b052-4291-8dd0-9b340f9b5aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:29.260111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee75c-b052-4291-8dd0-9b340f9b5aeb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:29.260720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee75c-b052-4291-8dd0-9b340f9b5aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:29.261377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee75c-b052-4291-8dd0-9b340f9b5aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:29.262409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcee75c-b052-4291-8dd0-9b340f9b5aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:29.264345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcee75c-b052-4291-8dd0-9b340f9b5aeb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:29.267530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09814f-db63-41a0-8398-08f8bf54e892 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:29.269540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f09814f-db63-41a0-8398-08f8bf54e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:29.280242 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3232/6429] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:29.284824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcee75c-b052-4291-8dd0-9b340f9b5aeb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:29.310394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcee75c-b052-4291-8dd0-9b340f9b5aeb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:29.317101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee06ad9-ca6a-447f-813f-8595cf59776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:29.319177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee06ad9-ca6a-447f-813f-8595cf59776f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:29.320257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee06ad9-ca6a-447f-813f-8595cf59776f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:29.321085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee06ad9-ca6a-447f-813f-8595cf59776f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:29.322584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee06ad9-ca6a-447f-813f-8595cf59776f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:29.324899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee06ad9-ca6a-447f-813f-8595cf59776f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:29.347203 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3233/6430] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:13:29.349790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee06ad9-ca6a-447f-813f-8595cf59776f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:29.361084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee06ad9-ca6a-447f-813f-8595cf59776f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:29.366626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5619f-eb8f-44a8-95d9-6c3878888be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:29.368596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5619f-eb8f-44a8-95d9-6c3878888be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:29.369261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5619f-eb8f-44a8-95d9-6c3878888be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:29.369793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5619f-eb8f-44a8-95d9-6c3878888be6 admin admin] PATH_INFO: `/v3/projects/84363f32bef641678d7acc182491641f/users/5753da912e144e6984a973d1a5293037/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:29.390117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09814f-db63-41a0-8398-08f8bf54e892 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:29.403846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:29.408041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:29.408772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:29.409963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5619f-eb8f-44a8-95d9-6c3878888be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84363f32bef641678d7acc182491641f, user_id=5753da912e144e6984a973d1a5293037, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:29.412970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5619f-eb8f-44a8-95d9-6c3878888be6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:29.413583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:29.434653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:29.452480 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3234/6431] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:13:29 2022] PUT /identity/v3/projects/84363f32bef641678d7acc182491641f/users/5753da912e144e6984a973d1a5293037/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:29.457571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:29.458538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421236-9869-43c4-98f0-a2200bf22675 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:29.458788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421236-9869-43c4-98f0-a2200bf22675 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:29.459078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421236-9869-43c4-98f0-a2200bf22675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:29.485893 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3198/6432] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:13:29.510569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0f421236-9869-43c4-98f0-a2200bf22675 None None] MFA Rules not processed for user `5753da912e144e6984a973d1a5293037`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:29.512097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f421236-9869-43c4-98f0-a2200bf22675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:29.634830 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3235/6433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:13:29.658517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:29.660679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:29.748809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03de01-f130-4a4a-932c-a4099ee6c026 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:29.807969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905881a-c939-4bcb-8650-3cf3107eef46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:29.808755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905881a-c939-4bcb-8650-3cf3107eef46 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:29.809015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905881a-c939-4bcb-8650-3cf3107eef46 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:29.809220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905881a-c939-4bcb-8650-3cf3107eef46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:29.826031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905881a-c939-4bcb-8650-3cf3107eef46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:29.829063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905881a-c939-4bcb-8650-3cf3107eef46 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:29.842322 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3199/6434] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:46.414929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657864f-dd74-4e7f-9504-f24eec28bd88 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:46.415949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657864f-dd74-4e7f-9504-f24eec28bd88 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:46.416236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657864f-dd74-4e7f-9504-f24eec28bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:46.450429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b657864f-dd74-4e7f-9504-f24eec28bd88 None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:46.457142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b657864f-dd74-4e7f-9504-f24eec28bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:46.538851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3236/6435] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:53.915433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905881a-c939-4bcb-8650-3cf3107eef46 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:54.041722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905881a-c939-4bcb-8650-3cf3107eef46 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:54.047906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:54.048925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:54.049284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:54.049630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] PATH_INFO: `/v3/users/5753da912e144e6984a973d1a5293037` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:54.051192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5753da912e144e6984a973d1a5293037)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:54.053308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:54.155202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5753da912e144e6984a973d1a5293037'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:54.156054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5753da912e144e6984a973d1a5293037'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:54.157403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5753da912e144e6984a973d1a5293037'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:54.191856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5753da912e144e6984a973d1a5293037'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:54.225951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a9de365-27fb-4e92-89a5-4b60a672b840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5753da912e144e6984a973d1a5293037'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:54.251344 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3200/6436] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:13:53 2022] DELETE /identity/v3/users/5753da912e144e6984a973d1a5293037 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:54.255932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a586c3-c6af-4a25-a5a4-f774380621a4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:54.256403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a586c3-c6af-4a25-a5a4-f774380621a4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:54.256606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a586c3-c6af-4a25-a5a4-f774380621a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:54.315789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-97a586c3-c6af-4a25-a5a4-f774380621a4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:54.332265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-97a586c3-c6af-4a25-a5a4-f774380621a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:54.583949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bb91-4988-432d-a163-246043ea00e9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:54.584553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bb91-4988-432d-a163-246043ea00e9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:54.585265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bb91-4988-432d-a163-246043ea00e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:54.615956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-45e0bb91-4988-432d-a163-246043ea00e9 None None] MFA Rules not processed for user `5e825e0ef42743238263e6758e53e28c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:54.617388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-45e0bb91-4988-432d-a163-246043ea00e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:54.621471 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3237/6437] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:54.656713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a586c3-c6af-4a25-a5a4-f774380621a4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:54.660241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-97a586c3-c6af-4a25-a5a4-f774380621a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:54.701937 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3201/6438] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:54.791400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a586c3-c6af-4a25-a5a4-f774380621a4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:54.799271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a93c73-4a5e-4d37-83a4-4b9a5117ec63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:54.800761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93c73-4a5e-4d37-83a4-4b9a5117ec63 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:54.801277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93c73-4a5e-4d37-83a4-4b9a5117ec63 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:54.801768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93c73-4a5e-4d37-83a4-4b9a5117ec63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:54.812602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a93c73-4a5e-4d37-83a4-4b9a5117ec63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:54.815465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a93c73-4a5e-4d37-83a4-4b9a5117ec63 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:54.833333 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3238/6439] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:55.557697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0bb91-4988-432d-a163-246043ea00e9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:55.559818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-45e0bb91-4988-432d-a163-246043ea00e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:55.645142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0bb91-4988-432d-a163-246043ea00e9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:55.655068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:55.660627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:55.677803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:55.678268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] PATH_INFO: `/v3/projects/84363f32bef641678d7acc182491641f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:55.714321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84363f32bef641678d7acc182491641f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:55.717666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:55.848468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84363f32bef641678d7acc182491641f', 'request_id': 'req-1500086f-e88f-47f3-81c6-be09d9891fb3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:55.861741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84363f32bef641678d7acc182491641f', 'request_id': 'req-1500086f-e88f-47f3-81c6-be09d9891fb3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:55.877970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84363f32bef641678d7acc182491641f', 'request_id': 'req-1500086f-e88f-47f3-81c6-be09d9891fb3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:55.894013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] The token cache is being invalidate because project 84363f32bef641678d7acc182491641f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:13:55.894941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:55.895837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1500086f-e88f-47f3-81c6-be09d9891fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:13:55.899878 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3202/6440] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:13:55 2022] DELETE /identity/v3/projects/84363f32bef641678d7acc182491641f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:55.904839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d89712-c700-4f84-92db-25bd6e39e577 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:55.905764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d89712-c700-4f84-92db-25bd6e39e577 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:55.906248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d89712-c700-4f84-92db-25bd6e39e577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:55.936964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-19d89712-c700-4f84-92db-25bd6e39e577 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:55.939900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19d89712-c700-4f84-92db-25bd6e39e577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:56.074643 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3239/6441] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:13:56.076737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff809fe-1a4e-4e44-a70e-dd9eb39c7f65 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:56.077936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff809fe-1a4e-4e44-a70e-dd9eb39c7f65 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:56.078428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff809fe-1a4e-4e44-a70e-dd9eb39c7f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:56.127978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eff809fe-1a4e-4e44-a70e-dd9eb39c7f65 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:56.136047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eff809fe-1a4e-4e44-a70e-dd9eb39c7f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:56.184166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d89712-c700-4f84-92db-25bd6e39e577 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:56.191040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3203/6442] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:56.206956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d89712-c700-4f84-92db-25bd6e39e577 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:56.222277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:56.223375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:56.223818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:56.224286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:56.225195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:13:56.226514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:56.231752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:56.265009 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3240/6443] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:13:56.270473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff809fe-1a4e-4e44-a70e-dd9eb39c7f65 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:56.281608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff809fe-1a4e-4e44-a70e-dd9eb39c7f65 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:56.307519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3df2d7-f360-45df-8625-eff0404570f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:56.308411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3df2d7-f360-45df-8625-eff0404570f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:56.308800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3df2d7-f360-45df-8625-eff0404570f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:56.309182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3df2d7-f360-45df-8625-eff0404570f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:56.310099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3df2d7-f360-45df-8625-eff0404570f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:56.313391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3df2d7-f360-45df-8625-eff0404570f9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:56.385739 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3204/6444] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:13:56 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:56.386498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:56.405056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b45acb-3236-4ef5-8d47-a4e341cb1ae3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:56.581156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca735d8-bcc8-4dd0-8ef6-eff1caca6334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:56.581945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca735d8-bcc8-4dd0-8ef6-eff1caca6334 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:56.582238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca735d8-bcc8-4dd0-8ef6-eff1caca6334 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:56.582588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca735d8-bcc8-4dd0-8ef6-eff1caca6334 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:56.583220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca735d8-bcc8-4dd0-8ef6-eff1caca6334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:56.598790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca735d8-bcc8-4dd0-8ef6-eff1caca6334 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:56.665144 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3241/6445] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:13:56 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:13:56.671733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3df2d7-f360-45df-8625-eff0404570f9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:56.694197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3df2d7-f360-45df-8625-eff0404570f9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:56.707445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73e12f-e1f8-46b1-95d0-2ab9a5389e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:56.708149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73e12f-e1f8-46b1-95d0-2ab9a5389e80 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:56.708535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73e12f-e1f8-46b1-95d0-2ab9a5389e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:56.708821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73e12f-e1f8-46b1-95d0-2ab9a5389e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:56.710111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73e12f-e1f8-46b1-95d0-2ab9a5389e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:56.712880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73e12f-e1f8-46b1-95d0-2ab9a5389e80 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:56.736772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca735d8-bcc8-4dd0-8ef6-eff1caca6334 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:56.738085 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3205/6446] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:56.751916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca735d8-bcc8-4dd0-8ef6-eff1caca6334 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:56.759750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0e0b5-5903-4d9f-ae6c-66d52c558656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:56.760900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e0b5-5903-4d9f-ae6c-66d52c558656 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:56.760900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e0b5-5903-4d9f-ae6c-66d52c558656 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:56.761085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e0b5-5903-4d9f-ae6c-66d52c558656 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:56.761853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0e0b5-5903-4d9f-ae6c-66d52c558656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:56.773277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0e0b5-5903-4d9f-ae6c-66d52c558656 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:56.798365 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3242/6447] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:13:56.802661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73e12f-e1f8-46b1-95d0-2ab9a5389e80 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:56.820964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73e12f-e1f8-46b1-95d0-2ab9a5389e80 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:56.826361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:56.827485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:56.827898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:56.828180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] PATH_INFO: `/v3/projects/33103c83f46943e4a338d8cbf97510e6/users/a31357c10cd24c5f9a13de31291b85f8/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:56.855360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33103c83f46943e4a338d8cbf97510e6, user_id=a31357c10cd24c5f9a13de31291b85f8, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:56.858532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:56.886559 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3206/6448] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:13:56 2022] PUT /identity/v3/projects/33103c83f46943e4a338d8cbf97510e6/users/a31357c10cd24c5f9a13de31291b85f8/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:13:56.902613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a77b4-1b25-4f89-b43f-bda26079f067 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:56.903019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a77b4-1b25-4f89-b43f-bda26079f067 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:56.903187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a77b4-1b25-4f89-b43f-bda26079f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:56.955581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-893a77b4-1b25-4f89-b43f-bda26079f067 None None] MFA Rules not processed for user `a31357c10cd24c5f9a13de31291b85f8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:13:56.957974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-893a77b4-1b25-4f89-b43f-bda26079f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:57.117743 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3243/6449] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:13:57.160909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:57.163285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:57.320607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794632e6-6a54-4729-b676-3c4331c7eae4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:57.331967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:57.334805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:57.335090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:57.336764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:57.375965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:57.389016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:57.432863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3207/6450] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:13:59.864037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a77b4-1b25-4f89-b43f-bda26079f067 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:13:59.866455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-893a77b4-1b25-4f89-b43f-bda26079f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:59.891260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a77b4-1b25-4f89-b43f-bda26079f067 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:13:59.904903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:13:59.905783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:13:59.906066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:13:59.906338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:13:59.911489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:13:59.940858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:13:59.947171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:13:59.968140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3244/6451] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:02.042731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:02.044278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:02.186120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176fb48-d9d2-4311-aeca-21e1256be634 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:02.199551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:02.200613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:02.200992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:02.201410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] PATH_INFO: `/v3/users/1d25416fd67e4dd08da5ed2408649327` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:02.205070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d25416fd67e4dd08da5ed2408649327)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:02.207149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:02.379203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d25416fd67e4dd08da5ed2408649327'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:02.386829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d25416fd67e4dd08da5ed2408649327'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:02.387941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d25416fd67e4dd08da5ed2408649327'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:02.416552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d25416fd67e4dd08da5ed2408649327'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:02.434831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e7e7585d-1fa0-4d5e-8260-5f215fcb22f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d25416fd67e4dd08da5ed2408649327'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:02.458369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3208/6452] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:14:02 2022] DELETE /identity/v3/users/1d25416fd67e4dd08da5ed2408649327 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:03.558003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:03.576577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fae26-0de8-4f4d-a58c-5bf90156348b service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:03.669930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:03.670872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:03.671177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:03.671613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] PATH_INFO: `/v3/projects/1c438bd56e19499a91a00c3757b6f9f0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:03.673678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c438bd56e19499a91a00c3757b6f9f0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:03.676495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:03.765320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c438bd56e19499a91a00c3757b6f9f0', 'request_id': 'req-22fe4f59-63eb-4519-aa41-37423cb03cd9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:03.800019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c438bd56e19499a91a00c3757b6f9f0', 'request_id': 'req-22fe4f59-63eb-4519-aa41-37423cb03cd9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:03.829919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c438bd56e19499a91a00c3757b6f9f0', 'request_id': 'req-22fe4f59-63eb-4519-aa41-37423cb03cd9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:03.871950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] The token cache is being invalidate because project 1c438bd56e19499a91a00c3757b6f9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:14:03.873146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:03.874040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22fe4f59-63eb-4519-aa41-37423cb03cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:03.877012 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3245/6453] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:14:03 2022] DELETE /identity/v3/projects/1c438bd56e19499a91a00c3757b6f9f0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:03.883242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e5725-39f2-4e37-81b2-f452ce1ec991 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:03.884239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e5725-39f2-4e37-81b2-f452ce1ec991 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:03.884576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e5725-39f2-4e37-81b2-f452ce1ec991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:03.908162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ec1e5725-39f2-4e37-81b2-f452ce1ec991 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:03.909489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ec1e5725-39f2-4e37-81b2-f452ce1ec991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:03.981297 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3209/6454] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:03.989715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c8f6-547a-4159-9fe5-204e942c9230 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:03.990227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c8f6-547a-4159-9fe5-204e942c9230 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:03.990677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c8f6-547a-4159-9fe5-204e942c9230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:04.024394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4257c8f6-547a-4159-9fe5-204e942c9230 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:04.026707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4257c8f6-547a-4159-9fe5-204e942c9230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:04.044642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e5725-39f2-4e37-81b2-f452ce1ec991 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:04.050237 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3246/6455] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:04.056387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e5725-39f2-4e37-81b2-f452ce1ec991 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:04.062018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:04.064096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:04.064599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:04.065049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:04.066427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:14:04.066928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:04.068845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:04.088698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257c8f6-547a-4159-9fe5-204e942c9230 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:04.095977 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3210/6456] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:14:04.101031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257c8f6-547a-4159-9fe5-204e942c9230 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:04.106542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535108de-0760-4dcd-a616-1009b4c9a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:04.107524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535108de-0760-4dcd-a616-1009b4c9a657 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:04.108625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535108de-0760-4dcd-a616-1009b4c9a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:04.109084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535108de-0760-4dcd-a616-1009b4c9a657 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:04.110094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535108de-0760-4dcd-a616-1009b4c9a657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:04.112222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535108de-0760-4dcd-a616-1009b4c9a657 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:04.184012 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3247/6457] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:14:04 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:14:04.189149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:04.211039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792641d5-3367-4f45-b948-2961dc0ce4a2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:04.385197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeebc62-ecf7-4e54-b784-7b8aa0ec70ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:04.386519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeebc62-ecf7-4e54-b784-7b8aa0ec70ec admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:04.386909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeebc62-ecf7-4e54-b784-7b8aa0ec70ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:04.389080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeebc62-ecf7-4e54-b784-7b8aa0ec70ec admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:04.393674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeebc62-ecf7-4e54-b784-7b8aa0ec70ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:04.396614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeebc62-ecf7-4e54-b784-7b8aa0ec70ec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:04.463772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3211/6458] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:14:04 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:14:04.470037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535108de-0760-4dcd-a616-1009b4c9a657 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:04.491086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535108de-0760-4dcd-a616-1009b4c9a657 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:04.509776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ce982-3a75-4a62-97b3-ac04d839e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:04.510757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ce982-3a75-4a62-97b3-ac04d839e11b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:04.511233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ce982-3a75-4a62-97b3-ac04d839e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:04.511677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ce982-3a75-4a62-97b3-ac04d839e11b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:04.512621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ce982-3a75-4a62-97b3-ac04d839e11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:04.514441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ce982-3a75-4a62-97b3-ac04d839e11b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:04.558506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeebc62-ecf7-4e54-b784-7b8aa0ec70ec admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:04.580361 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3248/6459] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:04.587889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeebc62-ecf7-4e54-b784-7b8aa0ec70ec admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:04.610102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876e628-599d-40d1-930b-3b12024e2f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:04.610809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e628-599d-40d1-930b-3b12024e2f74 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:04.611102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e628-599d-40d1-930b-3b12024e2f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:04.611379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e628-599d-40d1-930b-3b12024e2f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:04.614754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876e628-599d-40d1-930b-3b12024e2f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:04.619900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876e628-599d-40d1-930b-3b12024e2f74 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:04.660808 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3212/6460] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:04.665529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ce982-3a75-4a62-97b3-ac04d839e11b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:04.684949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ce982-3a75-4a62-97b3-ac04d839e11b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:04.694993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:04.696476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:04.696942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:04.697386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] PATH_INFO: `/v3/projects/03bf8706a07449ecbf023ba907fd7c38/users/2ed46d2f9d344a398d541d54ae22b626/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:04.761950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bf8706a07449ecbf023ba907fd7c38, user_id=2ed46d2f9d344a398d541d54ae22b626, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:04.765230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:04.799851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3249/6461] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:14:04 2022] PUT /identity/v3/projects/03bf8706a07449ecbf023ba907fd7c38/users/2ed46d2f9d344a398d541d54ae22b626/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:04.801907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d080d-95cf-4eea-ab62-a0cab067bdc1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:04.802202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d080d-95cf-4eea-ab62-a0cab067bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:04.802468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d080d-95cf-4eea-ab62-a0cab067bdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:04.836039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b83d080d-95cf-4eea-ab62-a0cab067bdc1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:04.837478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b83d080d-95cf-4eea-ab62-a0cab067bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:04.940603 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3213/6462] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:04.953209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:04.956564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:05.071083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a2bed-1f4c-4914-b3f3-1b1db2e9cc30 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:05.077070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0ecb9-1815-4417-9eac-0f20091329bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:05.079437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ecb9-1815-4417-9eac-0f20091329bf service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:05.079888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ecb9-1815-4417-9eac-0f20091329bf service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:05.080174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ecb9-1815-4417-9eac-0f20091329bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:05.092996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0ecb9-1815-4417-9eac-0f20091329bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:05.095657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0ecb9-1815-4417-9eac-0f20091329bf service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:05.109773 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3250/6463] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:06.240846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8f1b-5612-4e03-b7e0-85d838c56464 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:06.245312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8f1b-5612-4e03-b7e0-85d838c56464 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:06.245618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a8f1b-5612-4e03-b7e0-85d838c56464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:06.317091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-472a8f1b-5612-4e03-b7e0-85d838c56464 None None] MFA Rules not processed for user `2ed46d2f9d344a398d541d54ae22b626`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:06.319135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-472a8f1b-5612-4e03-b7e0-85d838c56464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:06.482772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3214/6464] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:06.498884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da592c-81bf-41de-9529-018c755f98ac None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:06.499364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da592c-81bf-41de-9529-018c755f98ac None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:06.499636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da592c-81bf-41de-9529-018c755f98ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:06.557762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d7da592c-81bf-41de-9529-018c755f98ac None None] MFA Rules not processed for user `2ed46d2f9d344a398d541d54ae22b626`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:06.563503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d7da592c-81bf-41de-9529-018c755f98ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:06.586165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3251/6465] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:06.606744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a8f1b-5612-4e03-b7e0-85d838c56464 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:06.608717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-472a8f1b-5612-4e03-b7e0-85d838c56464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:06.779857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a8f1b-5612-4e03-b7e0-85d838c56464 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:06.789197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bb2d2-d759-4d4f-863d-b07f47aa33ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:06.790133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bb2d2-d759-4d4f-863d-b07f47aa33ee service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:06.790635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bb2d2-d759-4d4f-863d-b07f47aa33ee service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:06.791444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bb2d2-d759-4d4f-863d-b07f47aa33ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:06.802550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bb2d2-d759-4d4f-863d-b07f47aa33ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:06.804239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bb2d2-d759-4d4f-863d-b07f47aa33ee service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:06.818479 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3215/6466] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:13.228134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b060b7-0013-407b-b822-636c1c352e0a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:13.228702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b060b7-0013-407b-b822-636c1c352e0a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:13.228702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b060b7-0013-407b-b822-636c1c352e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:13.249057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-86b060b7-0013-407b-b822-636c1c352e0a None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:13.250665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-86b060b7-0013-407b-b822-636c1c352e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:13.381301 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3252/6467] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:15.998299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc61c-759b-407c-8bf4-d1f337678910 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:15.998801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc61c-759b-407c-8bf4-d1f337678910 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:15.999044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc61c-759b-407c-8bf4-d1f337678910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:16.021338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2ebdc61c-759b-407c-8bf4-d1f337678910 None None] MFA Rules not processed for user `5e825e0ef42743238263e6758e53e28c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:16.022895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2ebdc61c-759b-407c-8bf4-d1f337678910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:16.109625 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3216/6468] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:23.742558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e103ab-32a1-42e3-8ffa-33149ad5aba6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:23.743122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e103ab-32a1-42e3-8ffa-33149ad5aba6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:23.743475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e103ab-32a1-42e3-8ffa-33149ad5aba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:23.763422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b4e103ab-32a1-42e3-8ffa-33149ad5aba6 None None] MFA Rules not processed for user `2ed46d2f9d344a398d541d54ae22b626`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:23.764420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b4e103ab-32a1-42e3-8ffa-33149ad5aba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:23.773608 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3253/6469] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:23.821853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec3c6-dcd2-4462-a545-019e5046405b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:23.822390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec3c6-dcd2-4462-a545-019e5046405b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:23.822390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec3c6-dcd2-4462-a545-019e5046405b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:23.843357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9deec3c6-dcd2-4462-a545-019e5046405b None None] MFA Rules not processed for user `2ed46d2f9d344a398d541d54ae22b626`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:23.846443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9deec3c6-dcd2-4462-a545-019e5046405b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:23.867695 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3217/6470] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:23.886562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68991a-11a9-47ee-ad54-8fa7f8ab5e5b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:23.887029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68991a-11a9-47ee-ad54-8fa7f8ab5e5b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:23.887461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68991a-11a9-47ee-ad54-8fa7f8ab5e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:23.908319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec3c6-dcd2-4462-a545-019e5046405b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:23.909939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9deec3c6-dcd2-4462-a545-019e5046405b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:23.916701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8f68991a-11a9-47ee-ad54-8fa7f8ab5e5b None None] MFA Rules not processed for user `2ed46d2f9d344a398d541d54ae22b626`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:23.918508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8f68991a-11a9-47ee-ad54-8fa7f8ab5e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:23.933146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec3c6-dcd2-4462-a545-019e5046405b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:23.939481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:23.940664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:23.941137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:23.941598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] PATH_INFO: `/v3/users/a31357c10cd24c5f9a13de31291b85f8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:23.945190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31357c10cd24c5f9a13de31291b85f8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:23.948725 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3254/6471] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:23.950781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:23.989464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278abaa-9cb8-4efa-8066-305a89707054 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:23.990523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278abaa-9cb8-4efa-8066-305a89707054 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:23.990992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278abaa-9cb8-4efa-8066-305a89707054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:24.021392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2278abaa-9cb8-4efa-8066-305a89707054 None None] MFA Rules not processed for user `2ed46d2f9d344a398d541d54ae22b626`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:24.022953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2278abaa-9cb8-4efa-8066-305a89707054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:24.033494 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3255/6472] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:14:24.056633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31357c10cd24c5f9a13de31291b85f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.057457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31357c10cd24c5f9a13de31291b85f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.058180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31357c10cd24c5f9a13de31291b85f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.060935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486efd1-7d2a-4cb9-902c-130600a2b3e2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:24.061482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486efd1-7d2a-4cb9-902c-130600a2b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:24.062103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486efd1-7d2a-4cb9-902c-130600a2b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:24.074897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31357c10cd24c5f9a13de31291b85f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.088030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4cca4f32-1e8b-4b6e-a54d-e7b66c4c1596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31357c10cd24c5f9a13de31291b85f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.108757 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3218/6473] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:14:23 2022] DELETE /identity/v3/users/a31357c10cd24c5f9a13de31291b85f8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:24.115016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987c2a-06db-4f33-bcc4-bb35ab9e8347 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:24.115642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987c2a-06db-4f33-bcc4-bb35ab9e8347 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:24.117393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987c2a-06db-4f33-bcc4-bb35ab9e8347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:24.127754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9486efd1-7d2a-4cb9-902c-130600a2b3e2 None None] MFA Rules not processed for user `2ed46d2f9d344a398d541d54ae22b626`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:24.130670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9486efd1-7d2a-4cb9-902c-130600a2b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:24.139462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ee987c2a-06db-4f33-bcc4-bb35ab9e8347 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:24.141509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ee987c2a-06db-4f33-bcc4-bb35ab9e8347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:24.201073 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3256/6474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:14:24.236448 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3219/6475] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:24.273853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486efd1-7d2a-4cb9-902c-130600a2b3e2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:24.275372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9486efd1-7d2a-4cb9-902c-130600a2b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:24.349961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486efd1-7d2a-4cb9-902c-130600a2b3e2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:24.354590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3d329-0e08-4902-a261-371088b85559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:24.355266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d329-0e08-4902-a261-371088b85559 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:24.355618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d329-0e08-4902-a261-371088b85559 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:24.355950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d329-0e08-4902-a261-371088b85559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:24.377350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3d329-0e08-4902-a261-371088b85559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:24.378943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3d329-0e08-4902-a261-371088b85559 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:24.397863 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3257/6476] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:24.854302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987c2a-06db-4f33-bcc4-bb35ab9e8347 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:24.855880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ee987c2a-06db-4f33-bcc4-bb35ab9e8347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:24.869923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987c2a-06db-4f33-bcc4-bb35ab9e8347 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:24.877644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:24.878922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:24.879423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:24.880529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] PATH_INFO: `/v3/projects/33103c83f46943e4a338d8cbf97510e6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:24.882318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=33103c83f46943e4a338d8cbf97510e6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:24.884607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:24.952808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33103c83f46943e4a338d8cbf97510e6', 'request_id': 'req-31dcc292-5e57-4647-8657-0d52da6077bf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.959333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33103c83f46943e4a338d8cbf97510e6', 'request_id': 'req-31dcc292-5e57-4647-8657-0d52da6077bf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.972750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33103c83f46943e4a338d8cbf97510e6', 'request_id': 'req-31dcc292-5e57-4647-8657-0d52da6077bf'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.991955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] The token cache is being invalidate because project 33103c83f46943e4a338d8cbf97510e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:14:24.992462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.993221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-31dcc292-5e57-4647-8657-0d52da6077bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:24.995143 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3220/6477] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:14:24 2022] DELETE /identity/v3/projects/33103c83f46943e4a338d8cbf97510e6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:24.999872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337c24e-57a3-42fc-a6a9-ad8d8fc61e63 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.000968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337c24e-57a3-42fc-a6a9-ad8d8fc61e63 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.000968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337c24e-57a3-42fc-a6a9-ad8d8fc61e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.021089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9337c24e-57a3-42fc-a6a9-ad8d8fc61e63 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:25.023472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9337c24e-57a3-42fc-a6a9-ad8d8fc61e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:25.115975 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3258/6478] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:25.117706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b529fc-dde6-4865-8630-5ec74f56c57d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.118041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b529fc-dde6-4865-8630-5ec74f56c57d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.118322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b529fc-dde6-4865-8630-5ec74f56c57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.142264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e4b529fc-dde6-4865-8630-5ec74f56c57d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:25.144245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e4b529fc-dde6-4865-8630-5ec74f56c57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:25.162853 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3221/6479] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:14:25.163187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337c24e-57a3-42fc-a6a9-ad8d8fc61e63 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:25.173564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337c24e-57a3-42fc-a6a9-ad8d8fc61e63 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:25.179183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:25.180155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.180533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.180880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.181680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:14:25.182900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:25.185303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:25.200142 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3259/6480] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:14:25.205647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b529fc-dde6-4865-8630-5ec74f56c57d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:25.215089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b529fc-dde6-4865-8630-5ec74f56c57d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:25.220683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942e4f4-19cf-478c-b42d-8c77ad32e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:25.221334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e4f4-19cf-478c-b42d-8c77ad32e67f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.221616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e4f4-19cf-478c-b42d-8c77ad32e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.221888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e4f4-19cf-478c-b42d-8c77ad32e67f admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.222579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942e4f4-19cf-478c-b42d-8c77ad32e67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:25.224491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942e4f4-19cf-478c-b42d-8c77ad32e67f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:25.255690 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3222/6481] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:14:25 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:14:25.257227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:25.268829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54c5c5-ae07-48e6-beef-1269fdfab177 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:25.328221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320051a-e0dc-4533-a76f-b8bda20c8465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:25.328814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320051a-e0dc-4533-a76f-b8bda20c8465 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.329093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320051a-e0dc-4533-a76f-b8bda20c8465 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.329468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320051a-e0dc-4533-a76f-b8bda20c8465 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.330167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320051a-e0dc-4533-a76f-b8bda20c8465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:25.332095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320051a-e0dc-4533-a76f-b8bda20c8465 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:25.358073 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3260/6482] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:14:25 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:14:25.359950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942e4f4-19cf-478c-b42d-8c77ad32e67f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:25.370514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942e4f4-19cf-478c-b42d-8c77ad32e67f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:25.375904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed337-6912-467f-8b75-77b9f51ed2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:25.376731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed337-6912-467f-8b75-77b9f51ed2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.377009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed337-6912-467f-8b75-77b9f51ed2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.377277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed337-6912-467f-8b75-77b9f51ed2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.378002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ed337-6912-467f-8b75-77b9f51ed2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:25.379617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ed337-6912-467f-8b75-77b9f51ed2c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:25.392508 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3223/6483] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:25.396624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320051a-e0dc-4533-a76f-b8bda20c8465 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:25.407068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320051a-e0dc-4533-a76f-b8bda20c8465 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:25.413288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9207e-0e8a-4982-9168-af5ea8e8215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:25.413986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9207e-0e8a-4982-9168-af5ea8e8215c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.414355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9207e-0e8a-4982-9168-af5ea8e8215c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.414713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9207e-0e8a-4982-9168-af5ea8e8215c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.415543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9207e-0e8a-4982-9168-af5ea8e8215c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:25.417289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9207e-0e8a-4982-9168-af5ea8e8215c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:25.429953 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3261/6484] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:25.433915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed337-6912-467f-8b75-77b9f51ed2c1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:25.444935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed337-6912-467f-8b75-77b9f51ed2c1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:25.450802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:25.451713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.451993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.452263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] PATH_INFO: `/v3/projects/239a5f2432724ad78c4d9ec2d3d17b4b/users/665c9956ff3b409fa942294f752c53f9/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.468493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239a5f2432724ad78c4d9ec2d3d17b4b, user_id=665c9956ff3b409fa942294f752c53f9, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:25.471391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:25.487412 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3224/6485] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:14:25 2022] PUT /identity/v3/projects/239a5f2432724ad78c4d9ec2d3d17b4b/users/665c9956ff3b409fa942294f752c53f9/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:25.497847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3204e4-b4e5-4130-a00e-26c93d5b1d21 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.498142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3204e4-b4e5-4130-a00e-26c93d5b1d21 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.498428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3204e4-b4e5-4130-a00e-26c93d5b1d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.535508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4b3204e4-b4e5-4130-a00e-26c93d5b1d21 None None] MFA Rules not processed for user `665c9956ff3b409fa942294f752c53f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:25.537251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4b3204e4-b4e5-4130-a00e-26c93d5b1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:25.615357 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3262/6486] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:25.623819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:25.625891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:25.776621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5dc6b-698d-47a2-8666-61aff5e366e3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:25.790393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6fd8-d687-4234-8c47-0a91ba2fe8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:25.790583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6fd8-d687-4234-8c47-0a91ba2fe8ae service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:25.790736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6fd8-d687-4234-8c47-0a91ba2fe8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:25.791029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6fd8-d687-4234-8c47-0a91ba2fe8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:25.808665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e6fd8-d687-4234-8c47-0a91ba2fe8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:25.810600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e6fd8-d687-4234-8c47-0a91ba2fe8ae service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:25.823872 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3225/6487] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:28.328702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3204e4-b4e5-4130-a00e-26c93d5b1d21 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:28.330799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4b3204e4-b4e5-4130-a00e-26c93d5b1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:28.425090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3204e4-b4e5-4130-a00e-26c93d5b1d21 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:28.431271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:28.433031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:28.433471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:28.433896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] PATH_INFO: `/v3/users/2ed46d2f9d344a398d541d54ae22b626` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:28.436472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed46d2f9d344a398d541d54ae22b626)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:28.438925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:28.495929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed46d2f9d344a398d541d54ae22b626'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:28.507823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed46d2f9d344a398d541d54ae22b626'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:28.515396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed46d2f9d344a398d541d54ae22b626'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:28.516701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed46d2f9d344a398d541d54ae22b626'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:28.517423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0de1f87c-765f-4d78-8ecd-2f7afccd3c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed46d2f9d344a398d541d54ae22b626'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:28.535155 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3263/6488] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:14:28 2022] DELETE /identity/v3/users/2ed46d2f9d344a398d541d54ae22b626 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:28.841494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6fd8-d687-4234-8c47-0a91ba2fe8ae service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:28.866824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6fd8-d687-4234-8c47-0a91ba2fe8ae service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:28.955258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:28.956593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:28.957108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:28.957594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] PATH_INFO: `/v3/projects/03bf8706a07449ecbf023ba907fd7c38` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:28.960238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bf8706a07449ecbf023ba907fd7c38)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:28.962530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:29.027150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bf8706a07449ecbf023ba907fd7c38', 'request_id': 'req-df81d1b8-58f0-49c0-a45c-5460433987cb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:29.035010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bf8706a07449ecbf023ba907fd7c38', 'request_id': 'req-df81d1b8-58f0-49c0-a45c-5460433987cb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:29.050900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bf8706a07449ecbf023ba907fd7c38', 'request_id': 'req-df81d1b8-58f0-49c0-a45c-5460433987cb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:29.066843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] The token cache is being invalidate because project 03bf8706a07449ecbf023ba907fd7c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:14:29.067511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:29.068668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-df81d1b8-58f0-49c0-a45c-5460433987cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:29.071374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3226/6489] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:14:28 2022] DELETE /identity/v3/projects/03bf8706a07449ecbf023ba907fd7c38 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:29.077706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902275e-b888-4cfe-a9a3-b4698c980108 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.078551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902275e-b888-4cfe-a9a3-b4698c980108 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.078808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902275e-b888-4cfe-a9a3-b4698c980108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.101300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2902275e-b888-4cfe-a9a3-b4698c980108 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:29.102741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2902275e-b888-4cfe-a9a3-b4698c980108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:29.196920 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3264/6490] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:29.206534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d341-7472-49a9-8097-2a5d56f90ab4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.206849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d341-7472-49a9-8097-2a5d56f90ab4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.207105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d341-7472-49a9-8097-2a5d56f90ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.230715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ba09d341-7472-49a9-8097-2a5d56f90ab4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:29.231960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ba09d341-7472-49a9-8097-2a5d56f90ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:29.240707 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3227/6491] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:14:29.244943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902275e-b888-4cfe-a9a3-b4698c980108 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:29.255636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902275e-b888-4cfe-a9a3-b4698c980108 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:29.260661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:29.261354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.261637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.261915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.262656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:14:29.262967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:29.264626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:29.278474 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3265/6492] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:14:29.283658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09d341-7472-49a9-8097-2a5d56f90ab4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:29.297054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09d341-7472-49a9-8097-2a5d56f90ab4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:29.303547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0f85-1c99-48ba-8976-8df6dfe6884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:29.304656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0f85-1c99-48ba-8976-8df6dfe6884d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.305157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0f85-1c99-48ba-8976-8df6dfe6884d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.305755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0f85-1c99-48ba-8976-8df6dfe6884d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.306697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c0f85-1c99-48ba-8976-8df6dfe6884d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:29.309184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c0f85-1c99-48ba-8976-8df6dfe6884d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:29.343489 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3228/6493] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:14:29 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:14:29.348887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:29.359526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7395ff-eaa8-497a-87de-6170b262c565 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:29.436028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937af4-620e-4bbf-a60c-9ad77f4f72e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:29.437027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937af4-620e-4bbf-a60c-9ad77f4f72e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.438113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937af4-620e-4bbf-a60c-9ad77f4f72e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.438554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937af4-620e-4bbf-a60c-9ad77f4f72e0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.439509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937af4-620e-4bbf-a60c-9ad77f4f72e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:29.441639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937af4-620e-4bbf-a60c-9ad77f4f72e0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:29.483681 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3266/6494] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:14:29 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:14:29.487604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0f85-1c99-48ba-8976-8df6dfe6884d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:29.510064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0f85-1c99-48ba-8976-8df6dfe6884d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:29.516552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864c03a-937b-4a92-b98a-e1cb6dfd48ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:29.517124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864c03a-937b-4a92-b98a-e1cb6dfd48ce admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.517448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864c03a-937b-4a92-b98a-e1cb6dfd48ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.517883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864c03a-937b-4a92-b98a-e1cb6dfd48ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.518653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864c03a-937b-4a92-b98a-e1cb6dfd48ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:29.520310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864c03a-937b-4a92-b98a-e1cb6dfd48ce admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:29.535572 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3229/6495] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:29.543220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937af4-620e-4bbf-a60c-9ad77f4f72e0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:29.570126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937af4-620e-4bbf-a60c-9ad77f4f72e0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:29.583683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a6c6e-29ed-4766-856a-d62b1638e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:29.584798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6c6e-29ed-4766-856a-d62b1638e4fd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.585760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6c6e-29ed-4766-856a-d62b1638e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.586245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6c6e-29ed-4766-856a-d62b1638e4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.587168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a6c6e-29ed-4766-856a-d62b1638e4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:29.589042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a6c6e-29ed-4766-856a-d62b1638e4fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:29.602154 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3267/6496] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:29.606207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864c03a-937b-4a92-b98a-e1cb6dfd48ce admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:29.622973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864c03a-937b-4a92-b98a-e1cb6dfd48ce admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:29.636079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7a4f6-df7f-4042-b41d-95fc7262cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:29.636999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7a4f6-df7f-4042-b41d-95fc7262cb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.637278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7a4f6-df7f-4042-b41d-95fc7262cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.637553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7a4f6-df7f-4042-b41d-95fc7262cb64 admin admin] PATH_INFO: `/v3/projects/a918d8dc64fe475f9f79a25749df103f/users/5263c2242ebb4de49dcefd4cdf52ffa4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.677263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7a4f6-df7f-4042-b41d-95fc7262cb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a918d8dc64fe475f9f79a25749df103f, user_id=5263c2242ebb4de49dcefd4cdf52ffa4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:29.680722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7a4f6-df7f-4042-b41d-95fc7262cb64 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:29.710679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3230/6497] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:14:29 2022] PUT /identity/v3/projects/a918d8dc64fe475f9f79a25749df103f/users/5263c2242ebb4de49dcefd4cdf52ffa4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:29.715014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44994-f08b-4de7-9a3e-f0f6abd3b350 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.715309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44994-f08b-4de7-9a3e-f0f6abd3b350 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.715587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44994-f08b-4de7-9a3e-f0f6abd3b350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.762100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-19f44994-f08b-4de7-9a3e-f0f6abd3b350 None None] MFA Rules not processed for user `5263c2242ebb4de49dcefd4cdf52ffa4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:29.763436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19f44994-f08b-4de7-9a3e-f0f6abd3b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:29.888389 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3268/6498] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:29.891036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9358-51bc-4363-85b0-203b01f462d2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:29.891529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9358-51bc-4363-85b0-203b01f462d2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:29.891615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9358-51bc-4363-85b0-203b01f462d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:29.922817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a5dd9358-51bc-4363-85b0-203b01f462d2 None None] MFA Rules not processed for user `5263c2242ebb4de49dcefd4cdf52ffa4`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:29.924383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a5dd9358-51bc-4363-85b0-203b01f462d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:29.942027 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3231/6499] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:29.954321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44994-f08b-4de7-9a3e-f0f6abd3b350 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:29.956043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19f44994-f08b-4de7-9a3e-f0f6abd3b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:30.058238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44994-f08b-4de7-9a3e-f0f6abd3b350 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:30.067900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:30.068650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:30.068936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:30.069225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:30.085381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:30.087048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:30.104078 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3269/6500] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:30.255476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608c6e-228b-4725-a898-3b28c3ba3c5e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:30.255760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608c6e-228b-4725-a898-3b28c3ba3c5e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:30.256043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608c6e-228b-4725-a898-3b28c3ba3c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:30.280783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6e608c6e-228b-4725-a898-3b28c3ba3c5e None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:30.282634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6e608c6e-228b-4725-a898-3b28c3ba3c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:30.386554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3232/6501] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:36.707920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:36.709532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:36.800794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f4b4c-f9a3-49a8-878e-9cc8b9dfd20f service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:36.806175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:36.807511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:36.808006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:36.808555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] PATH_INFO: `/v3/users/6666f8c29ad543b4b0ab2289c09e930c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:36.810577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6666f8c29ad543b4b0ab2289c09e930c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:36.813712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:36.876375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6666f8c29ad543b4b0ab2289c09e930c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:36.892987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6666f8c29ad543b4b0ab2289c09e930c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:36.904145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6666f8c29ad543b4b0ab2289c09e930c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:36.904871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6666f8c29ad543b4b0ab2289c09e930c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:36.905634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6666f8c29ad543b4b0ab2289c09e930c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:36.928720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3270/6502] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:14:36 2022] DELETE /identity/v3/users/6666f8c29ad543b4b0ab2289c09e930c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:36.934009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7f96-9516-4245-871c-71896198b6f0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:36.934595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7f96-9516-4245-871c-71896198b6f0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:36.934595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7f96-9516-4245-871c-71896198b6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:36.957415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9c7d7f96-9516-4245-871c-71896198b6f0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:36.958982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9c7d7f96-9516-4245-871c-71896198b6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:37.044304 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3233/6503] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:14:37.085997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:37.088108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:37.179057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ece83-e498-4cfb-8a18-678000730d82 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:37.185319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a870a-dbe3-4af9-a189-a08524af5e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:37.186051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a870a-dbe3-4af9-a189-a08524af5e6f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:37.186668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a870a-dbe3-4af9-a189-a08524af5e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:37.187005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a870a-dbe3-4af9-a189-a08524af5e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:37.211307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a870a-dbe3-4af9-a189-a08524af5e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:37.213135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a870a-dbe3-4af9-a189-a08524af5e6f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:37.229838 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3271/6504] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:37.722027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d7f96-9516-4245-871c-71896198b6f0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:37.723638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9c7d7f96-9516-4245-871c-71896198b6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:37.746764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d7f96-9516-4245-871c-71896198b6f0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:37.755911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:37.757236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:37.757590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:37.757938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] PATH_INFO: `/v3/projects/dfacc4277e4443cdb5d2b7a87c49908a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:37.759228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfacc4277e4443cdb5d2b7a87c49908a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:37.761433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:37.830128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfacc4277e4443cdb5d2b7a87c49908a', 'request_id': 'req-6af285fe-d7f5-4a6b-9c4c-3d70009be965'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:37.838467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfacc4277e4443cdb5d2b7a87c49908a', 'request_id': 'req-6af285fe-d7f5-4a6b-9c4c-3d70009be965'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:37.847440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfacc4277e4443cdb5d2b7a87c49908a', 'request_id': 'req-6af285fe-d7f5-4a6b-9c4c-3d70009be965'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:37.863008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] The token cache is being invalidate because project dfacc4277e4443cdb5d2b7a87c49908a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:14:37.863387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:37.864135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af285fe-d7f5-4a6b-9c4c-3d70009be965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:37.866595 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3234/6505] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:14:37 2022] DELETE /identity/v3/projects/dfacc4277e4443cdb5d2b7a87c49908a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:37.871598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19de0f-90fc-4e80-a3e3-d2a8d49a1e97 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:37.872110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19de0f-90fc-4e80-a3e3-d2a8d49a1e97 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:37.872260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19de0f-90fc-4e80-a3e3-d2a8d49a1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:37.900899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dd19de0f-90fc-4e80-a3e3-d2a8d49a1e97 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:37.902377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd19de0f-90fc-4e80-a3e3-d2a8d49a1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:38.037848 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3272/6506] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:38.039776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d86c7-c6e5-4f27-b7ee-a5acc119c130 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.040934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d86c7-c6e5-4f27-b7ee-a5acc119c130 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.041626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d86c7-c6e5-4f27-b7ee-a5acc119c130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.079810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7c7d86c7-c6e5-4f27-b7ee-a5acc119c130 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:38.081378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c7d86c7-c6e5-4f27-b7ee-a5acc119c130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:38.099256 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3235/6507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:38.107974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19de0f-90fc-4e80-a3e3-d2a8d49a1e97 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:38.123119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19de0f-90fc-4e80-a3e3-d2a8d49a1e97 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:38.128202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:38.129056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.129311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.129740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.130503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:14:38.130824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:38.132642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:38.150640 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3273/6508] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:14:38.152576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d86c7-c6e5-4f27-b7ee-a5acc119c130 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:38.163279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d86c7-c6e5-4f27-b7ee-a5acc119c130 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:38.171225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956189b-c926-4214-8d9c-d7502651277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:38.173020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956189b-c926-4214-8d9c-d7502651277c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.174688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956189b-c926-4214-8d9c-d7502651277c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.175164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956189b-c926-4214-8d9c-d7502651277c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.176524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956189b-c926-4214-8d9c-d7502651277c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:38.180240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956189b-c926-4214-8d9c-d7502651277c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:38.270957 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3236/6509] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:14:38 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:14:38.271419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:38.284424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9869d-c410-42da-bae1-6b78c61e0864 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:38.388547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6a8d6-9e26-43ea-a7c8-32b972faaaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:38.390053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6a8d6-9e26-43ea-a7c8-32b972faaaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.391122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6a8d6-9e26-43ea-a7c8-32b972faaaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.392791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6a8d6-9e26-43ea-a7c8-32b972faaaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.393540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6a8d6-9e26-43ea-a7c8-32b972faaaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:38.396666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6a8d6-9e26-43ea-a7c8-32b972faaaf0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:38.440914 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3274/6510] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:14:38 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:14:38.446224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956189b-c926-4214-8d9c-d7502651277c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:38.471100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956189b-c926-4214-8d9c-d7502651277c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:38.478532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf23d78-5354-47ec-bef0-30aa0a9bb49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:38.480214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf23d78-5354-47ec-bef0-30aa0a9bb49a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.480542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf23d78-5354-47ec-bef0-30aa0a9bb49a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.481595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf23d78-5354-47ec-bef0-30aa0a9bb49a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.482724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf23d78-5354-47ec-bef0-30aa0a9bb49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:38.486390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf23d78-5354-47ec-bef0-30aa0a9bb49a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:38.506713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3237/6511] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:38.508212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6a8d6-9e26-43ea-a7c8-32b972faaaf0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:38.544528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6a8d6-9e26-43ea-a7c8-32b972faaaf0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:38.553540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590733e7-20a9-4528-9f9c-96ba3b494cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:38.554414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590733e7-20a9-4528-9f9c-96ba3b494cfa admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.554925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590733e7-20a9-4528-9f9c-96ba3b494cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.556856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590733e7-20a9-4528-9f9c-96ba3b494cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.556856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590733e7-20a9-4528-9f9c-96ba3b494cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:38.558359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590733e7-20a9-4528-9f9c-96ba3b494cfa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:38.582946 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3275/6512] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:38.587106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf23d78-5354-47ec-bef0-30aa0a9bb49a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:38.602876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf23d78-5354-47ec-bef0-30aa0a9bb49a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:38.614024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:38.614933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.615216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.615512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] PATH_INFO: `/v3/projects/cbaab2a15847495d88759aa3a98df71a/users/9bfe760bc97147cfb825ba12a00d50bd/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.648693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbaab2a15847495d88759aa3a98df71a, user_id=9bfe760bc97147cfb825ba12a00d50bd, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:38.651931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:38.715318 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3238/6513] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:14:38 2022] PUT /identity/v3/projects/cbaab2a15847495d88759aa3a98df71a/users/9bfe760bc97147cfb825ba12a00d50bd/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:38.726451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83b2f3-3d9b-4142-a1f7-9c835f0aebb4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.729508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83b2f3-3d9b-4142-a1f7-9c835f0aebb4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.729893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83b2f3-3d9b-4142-a1f7-9c835f0aebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.785246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6a83b2f3-3d9b-4142-a1f7-9c835f0aebb4 None None] MFA Rules not processed for user `9bfe760bc97147cfb825ba12a00d50bd`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:38.788460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6a83b2f3-3d9b-4142-a1f7-9c835f0aebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:38.874056 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3276/6514] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:38.885263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:38.887759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:38.965049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42be7be-fb4a-475d-ac4c-5b7944e29992 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:38.970237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbcffc-0b8e-4871-8f84-15581a309bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:38.971173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcffc-0b8e-4871-8f84-15581a309bff service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:38.971676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcffc-0b8e-4871-8f84-15581a309bff service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:38.972144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcffc-0b8e-4871-8f84-15581a309bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:38.983925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbcffc-0b8e-4871-8f84-15581a309bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:38.986302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbcffc-0b8e-4871-8f84-15581a309bff service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:38.997075 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3239/6515] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:39.013335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83b2f3-3d9b-4142-a1f7-9c835f0aebb4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:39.101138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83b2f3-3d9b-4142-a1f7-9c835f0aebb4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:39.108188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:39.113114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:39.113652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:39.114795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] PATH_INFO: `/v3/users/9bfe760bc97147cfb825ba12a00d50bd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:39.116544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bfe760bc97147cfb825ba12a00d50bd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:39.119847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:39.196188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bfe760bc97147cfb825ba12a00d50bd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:39.226782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bfe760bc97147cfb825ba12a00d50bd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:39.241978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bfe760bc97147cfb825ba12a00d50bd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:39.243165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bfe760bc97147cfb825ba12a00d50bd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:39.244497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bfe760bc97147cfb825ba12a00d50bd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:39.268217 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3277/6516] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:14:39 2022] DELETE /identity/v3/users/9bfe760bc97147cfb825ba12a00d50bd => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:39.273223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f15c-fb6e-4844-bf52-7fb1e7a8b97c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:39.274041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f15c-fb6e-4844-bf52-7fb1e7a8b97c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:39.274041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f15c-fb6e-4844-bf52-7fb1e7a8b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:39.293152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c016f15c-fb6e-4844-bf52-7fb1e7a8b97c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:39.294403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c016f15c-fb6e-4844-bf52-7fb1e7a8b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:39.369899 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3240/6517] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:39.381988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:39.382747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:39.490336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdfe1c-af36-4750-bc7c-4b9644cbeff8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:39.499090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bde43-4eea-4c00-a484-1ee01dc54e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:39.501392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bde43-4eea-4c00-a484-1ee01dc54e15 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:39.502504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bde43-4eea-4c00-a484-1ee01dc54e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:39.503249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bde43-4eea-4c00-a484-1ee01dc54e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:39.519711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bde43-4eea-4c00-a484-1ee01dc54e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:39.521670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bde43-4eea-4c00-a484-1ee01dc54e15 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:39.546096 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3278/6518] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:40.241502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f15c-fb6e-4844-bf52-7fb1e7a8b97c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:40.243505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c016f15c-fb6e-4844-bf52-7fb1e7a8b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:40.268731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f15c-fb6e-4844-bf52-7fb1e7a8b97c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:40.278643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:40.279904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:40.280202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:40.280568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] PATH_INFO: `/v3/projects/cbaab2a15847495d88759aa3a98df71a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:40.284946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbaab2a15847495d88759aa3a98df71a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:40.284946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:40.349490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbaab2a15847495d88759aa3a98df71a', 'request_id': 'req-ec90715d-89bf-413c-b69c-7f16418acb64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:40.372565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbaab2a15847495d88759aa3a98df71a', 'request_id': 'req-ec90715d-89bf-413c-b69c-7f16418acb64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:40.383411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbaab2a15847495d88759aa3a98df71a', 'request_id': 'req-ec90715d-89bf-413c-b69c-7f16418acb64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:40.412295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] The token cache is being invalidate because project cbaab2a15847495d88759aa3a98df71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:14:40.412980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:40.414052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec90715d-89bf-413c-b69c-7f16418acb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:14:40.416641 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3241/6519] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:14:40 2022] DELETE /identity/v3/projects/cbaab2a15847495d88759aa3a98df71a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:40.421335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74dfea-b696-4e93-8109-8851a1c34fed None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:40.422035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74dfea-b696-4e93-8109-8851a1c34fed None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:40.422314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74dfea-b696-4e93-8109-8851a1c34fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:40.446097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dd74dfea-b696-4e93-8109-8851a1c34fed None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:40.448023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd74dfea-b696-4e93-8109-8851a1c34fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:40.521315 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3279/6520] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:14:40.529507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fde2-2ae1-4476-b094-d9d1a72049d1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:40.530091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fde2-2ae1-4476-b094-d9d1a72049d1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:40.530683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fde2-2ae1-4476-b094-d9d1a72049d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:40.556510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e6f2fde2-2ae1-4476-b094-d9d1a72049d1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:40.558367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e6f2fde2-2ae1-4476-b094-d9d1a72049d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:40.571987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3242/6521] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:14:40.586646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74dfea-b696-4e93-8109-8851a1c34fed None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:40.600520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74dfea-b696-4e93-8109-8851a1c34fed None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:40.609667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:40.610854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:40.611412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:40.617935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:40.619565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:14:40.620067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:40.623117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:40.645537 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3280/6522] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:14:40.646282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fde2-2ae1-4476-b094-d9d1a72049d1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:40.670957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fde2-2ae1-4476-b094-d9d1a72049d1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:40.678976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f52330-5e7c-47cf-947b-2c2429f044ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:40.679868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f52330-5e7c-47cf-947b-2c2429f044ad admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:40.680263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f52330-5e7c-47cf-947b-2c2429f044ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:40.680646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f52330-5e7c-47cf-947b-2c2429f044ad admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:40.681674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f52330-5e7c-47cf-947b-2c2429f044ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:40.683925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f52330-5e7c-47cf-947b-2c2429f044ad admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:40.743252 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3243/6523] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:14:40 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:14:40.744814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:40.758561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3268414-117b-4cef-9140-ca7f118338b5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:40.837055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765f3d-fbbc-4c14-8dfd-36f474cb696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:40.838735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765f3d-fbbc-4c14-8dfd-36f474cb696a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:40.839300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765f3d-fbbc-4c14-8dfd-36f474cb696a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:40.840002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765f3d-fbbc-4c14-8dfd-36f474cb696a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:40.841888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44765f3d-fbbc-4c14-8dfd-36f474cb696a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:40.845922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44765f3d-fbbc-4c14-8dfd-36f474cb696a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:40.902008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3281/6524] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:14:40 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:14:40.905102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f52330-5e7c-47cf-947b-2c2429f044ad admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:40.950439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f52330-5e7c-47cf-947b-2c2429f044ad admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:40.970472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6a7d-4ab5-41e9-8ef6-e743e21ca60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:40.972753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6a7d-4ab5-41e9-8ef6-e743e21ca60f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:40.973209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6a7d-4ab5-41e9-8ef6-e743e21ca60f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:40.973652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6a7d-4ab5-41e9-8ef6-e743e21ca60f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:40.974859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd6a7d-4ab5-41e9-8ef6-e743e21ca60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:40.983964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd6a7d-4ab5-41e9-8ef6-e743e21ca60f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:41.006832 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3244/6525] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:41.008082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765f3d-fbbc-4c14-8dfd-36f474cb696a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:41.026989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765f3d-fbbc-4c14-8dfd-36f474cb696a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:41.042140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f25832-a5a9-4434-822f-1b8723fe4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:41.043037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25832-a5a9-4434-822f-1b8723fe4e4f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:41.043367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25832-a5a9-4434-822f-1b8723fe4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:41.043672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25832-a5a9-4434-822f-1b8723fe4e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:41.047609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f25832-a5a9-4434-822f-1b8723fe4e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:41.049324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f25832-a5a9-4434-822f-1b8723fe4e4f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:41.061888 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3282/6526] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:14:41.066825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6a7d-4ab5-41e9-8ef6-e743e21ca60f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:41.093391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6a7d-4ab5-41e9-8ef6-e743e21ca60f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:41.116207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:41.118040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:41.118537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:41.119161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] PATH_INFO: `/v3/projects/03249dd317564fa1b7cab9087d57e2ab/users/586f7ca28d7b4060886d1bce42fe0f4b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:41.144100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03249dd317564fa1b7cab9087d57e2ab, user_id=586f7ca28d7b4060886d1bce42fe0f4b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:41.147508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:41.177649 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3245/6527] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:14:41 2022] PUT /identity/v3/projects/03249dd317564fa1b7cab9087d57e2ab/users/586f7ca28d7b4060886d1bce42fe0f4b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:14:41.186858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1583c-e9a5-4a8b-a9a5-8860c91207c5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:41.187157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1583c-e9a5-4a8b-a9a5-8860c91207c5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:41.188070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1583c-e9a5-4a8b-a9a5-8860c91207c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:41.242759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dfb1583c-e9a5-4a8b-a9a5-8860c91207c5 None None] MFA Rules not processed for user `586f7ca28d7b4060886d1bce42fe0f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:41.245372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dfb1583c-e9a5-4a8b-a9a5-8860c91207c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:41.403073 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3283/6528] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:41.422653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:14:41.424417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:41.516364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8adf03-5bc5-40ca-9420-f5851b9ebb6c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:14:41.529857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562f355-725b-4693-a03f-0c736ec0f32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:14:41.530625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562f355-725b-4693-a03f-0c736ec0f32c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:41.530926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562f355-725b-4693-a03f-0c736ec0f32c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:41.532436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562f355-725b-4693-a03f-0c736ec0f32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:41.545051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562f355-725b-4693-a03f-0c736ec0f32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:14:41.547729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562f355-725b-4693-a03f-0c736ec0f32c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:14:41.561691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3246/6529] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:14:45.150794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3251b-6b21-435d-9dcd-e5c059f31437 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:45.150794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3251b-6b21-435d-9dcd-e5c059f31437 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:45.150794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3251b-6b21-435d-9dcd-e5c059f31437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:45.241620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-97a3251b-6b21-435d-9dcd-e5c059f31437 None None] MFA Rules not processed for user `5e825e0ef42743238263e6758e53e28c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:45.243837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-97a3251b-6b21-435d-9dcd-e5c059f31437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:45.349431 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3284/6530] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:14:56.128674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd1d7-99a5-405d-a1e0-5284b375c035 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:14:56.129550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd1d7-99a5-405d-a1e0-5284b375c035 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:14:56.130092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd1d7-99a5-405d-a1e0-5284b375c035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:14:56.177381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b6ebd1d7-99a5-405d-a1e0-5284b375c035 None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:14:56.189522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b6ebd1d7-99a5-405d-a1e0-5284b375c035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:14:56.347365 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3247/6531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:06.603593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3251b-6b21-435d-9dcd-e5c059f31437 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:06.606317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-97a3251b-6b21-435d-9dcd-e5c059f31437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:06.695295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3251b-6b21-435d-9dcd-e5c059f31437 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:06.710227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:06.711139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:06.711643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:06.712035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] PATH_INFO: `/v3/users/665c9956ff3b409fa942294f752c53f9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:06.713525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665c9956ff3b409fa942294f752c53f9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:06.715641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:06.784280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665c9956ff3b409fa942294f752c53f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:06.798313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665c9956ff3b409fa942294f752c53f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:06.807549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665c9956ff3b409fa942294f752c53f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:06.808740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665c9956ff3b409fa942294f752c53f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:06.809446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665c9956ff3b409fa942294f752c53f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:06.823939 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3285/6532] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:06 2022] DELETE /identity/v3/users/665c9956ff3b409fa942294f752c53f9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:06.829992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46481035-ee3a-4453-be77-a1783c1b45c8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:06.830555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46481035-ee3a-4453-be77-a1783c1b45c8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:06.830670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46481035-ee3a-4453-be77-a1783c1b45c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:06.851103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-46481035-ee3a-4453-be77-a1783c1b45c8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:06.852494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-46481035-ee3a-4453-be77-a1783c1b45c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:06.934680 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3248/6533] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:06.945694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:06.947834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:07.040156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6159e-2f77-43d7-8207-d1c23c01e9f6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:07.051440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f445e15-3ae2-4fbe-b907-d0db3cfe1d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:07.052368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445e15-3ae2-4fbe-b907-d0db3cfe1d0a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:07.052860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445e15-3ae2-4fbe-b907-d0db3cfe1d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:07.053342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445e15-3ae2-4fbe-b907-d0db3cfe1d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:07.064266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f445e15-3ae2-4fbe-b907-d0db3cfe1d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:07.066492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f445e15-3ae2-4fbe-b907-d0db3cfe1d0a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:07.092846 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3286/6534] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:07.372057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46481035-ee3a-4453-be77-a1783c1b45c8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:07.375584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-46481035-ee3a-4453-be77-a1783c1b45c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:07.394817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46481035-ee3a-4453-be77-a1783c1b45c8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:07.403413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:07.405318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:07.405637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:07.406741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] PATH_INFO: `/v3/projects/239a5f2432724ad78c4d9ec2d3d17b4b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:07.408291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] RBAC: Authorizing `identity:delete_project(project_id=239a5f2432724ad78c4d9ec2d3d17b4b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:07.411163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:07.492078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239a5f2432724ad78c4d9ec2d3d17b4b', 'request_id': 'req-75df8ba4-8ce6-40a3-9383-892e128b522a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:07.501816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239a5f2432724ad78c4d9ec2d3d17b4b', 'request_id': 'req-75df8ba4-8ce6-40a3-9383-892e128b522a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:07.514282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239a5f2432724ad78c4d9ec2d3d17b4b', 'request_id': 'req-75df8ba4-8ce6-40a3-9383-892e128b522a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:07.533113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] The token cache is being invalidate because project 239a5f2432724ad78c4d9ec2d3d17b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:07.533742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:07.535079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-75df8ba4-8ce6-40a3-9383-892e128b522a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:07.542035 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3249/6535] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:07 2022] DELETE /identity/v3/projects/239a5f2432724ad78c4d9ec2d3d17b4b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:07.546978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6f9e-ec02-46af-b6e0-a32770cfe16e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:07.547418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6f9e-ec02-46af-b6e0-a32770cfe16e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:07.547674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6f9e-ec02-46af-b6e0-a32770cfe16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:07.568555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3e6e6f9e-ec02-46af-b6e0-a32770cfe16e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:07.570035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3e6e6f9e-ec02-46af-b6e0-a32770cfe16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:07.699783 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3287/6536] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:07.705954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7210-32f9-468d-9830-08e2547369af None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:07.706240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7210-32f9-468d-9830-08e2547369af None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:07.706520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7210-32f9-468d-9830-08e2547369af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:07.735468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-580e7210-32f9-468d-9830-08e2547369af None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:07.737005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-580e7210-32f9-468d-9830-08e2547369af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:07.751959 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3250/6537] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:07.755823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6f9e-ec02-46af-b6e0-a32770cfe16e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:07.766602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6f9e-ec02-46af-b6e0-a32770cfe16e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:07.772525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:07.773221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:07.773491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:07.774144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:07.775032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:07.775525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:07.777332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:07.791047 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3288/6538] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:07.805058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7210-32f9-468d-9830-08e2547369af None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:07.819102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7210-32f9-468d-9830-08e2547369af None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:07.826575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d6cc4-e27c-4918-a579-d007d83dc06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:07.827252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d6cc4-e27c-4918-a579-d007d83dc06c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:07.828071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d6cc4-e27c-4918-a579-d007d83dc06c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:07.828457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d6cc4-e27c-4918-a579-d007d83dc06c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:07.829160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d6cc4-e27c-4918-a579-d007d83dc06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:07.831077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d6cc4-e27c-4918-a579-d007d83dc06c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:07.918120 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3251/6539] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:07 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:07.918751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:07.935674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009bc4-1219-4212-883b-aa285892ff45 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:08.009703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beee0c-9f26-4bb3-a7a0-15161399e6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:08.010463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beee0c-9f26-4bb3-a7a0-15161399e6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.010754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beee0c-9f26-4bb3-a7a0-15161399e6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.011217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beee0c-9f26-4bb3-a7a0-15161399e6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.011943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beee0c-9f26-4bb3-a7a0-15161399e6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:08.013915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beee0c-9f26-4bb3-a7a0-15161399e6c5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:08.050193 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3289/6540] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:07 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:08.053805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d6cc4-e27c-4918-a579-d007d83dc06c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:08.067629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d6cc4-e27c-4918-a579-d007d83dc06c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:08.073469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964aea-614f-4a6d-9630-a87b7808a819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:08.074144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964aea-614f-4a6d-9630-a87b7808a819 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.074431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964aea-614f-4a6d-9630-a87b7808a819 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.074712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964aea-614f-4a6d-9630-a87b7808a819 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.075441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964aea-614f-4a6d-9630-a87b7808a819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:08.077086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964aea-614f-4a6d-9630-a87b7808a819 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:08.103301 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3252/6541] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:08.108234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beee0c-9f26-4bb3-a7a0-15161399e6c5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:08.132435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beee0c-9f26-4bb3-a7a0-15161399e6c5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:08.138577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56168a22-6001-46c3-ac61-14b6fad62fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:08.139576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168a22-6001-46c3-ac61-14b6fad62fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.140703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168a22-6001-46c3-ac61-14b6fad62fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.141294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168a22-6001-46c3-ac61-14b6fad62fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.142322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56168a22-6001-46c3-ac61-14b6fad62fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:08.144295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56168a22-6001-46c3-ac61-14b6fad62fd1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:08.159894 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3290/6542] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:15:08.164427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964aea-614f-4a6d-9630-a87b7808a819 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:08.179059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964aea-614f-4a6d-9630-a87b7808a819 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:08.185502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:08.187542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.187992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.188476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] PATH_INFO: `/v3/projects/112e97082e95498a8696f7ffe38c1071/users/36817e7e06a845dead7cc3a1c4082fe2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.212159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112e97082e95498a8696f7ffe38c1071, user_id=36817e7e06a845dead7cc3a1c4082fe2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:08.215641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:08.234703 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3253/6543] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:08 2022] PUT /identity/v3/projects/112e97082e95498a8696f7ffe38c1071/users/36817e7e06a845dead7cc3a1c4082fe2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:08.245602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b766-495c-47e7-833c-99c3238571d6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.246442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b766-495c-47e7-833c-99c3238571d6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.246442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b766-495c-47e7-833c-99c3238571d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.290863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dea7b766-495c-47e7-833c-99c3238571d6 None None] MFA Rules not processed for user `36817e7e06a845dead7cc3a1c4082fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:08.292307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dea7b766-495c-47e7-833c-99c3238571d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:08.328605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:08.332468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:08.383252 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3291/6544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:08.393999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7b766-495c-47e7-833c-99c3238571d6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:08.395854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dea7b766-495c-47e7-833c-99c3238571d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:08.425134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e120f2-6269-4453-abc4-a8e97554f8b4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:08.432963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:08.433865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.434138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.434414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] PATH_INFO: `/v3/users/586f7ca28d7b4060886d1bce42fe0f4b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.435762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586f7ca28d7b4060886d1bce42fe0f4b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:08.438381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:08.470344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7b766-495c-47e7-833c-99c3238571d6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:08.474682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd0b19-081f-4c89-838f-64a1f55bf770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:08.475389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0b19-081f-4c89-838f-64a1f55bf770 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.475747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0b19-081f-4c89-838f-64a1f55bf770 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.476013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0b19-081f-4c89-838f-64a1f55bf770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.493943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586f7ca28d7b4060886d1bce42fe0f4b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.494667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586f7ca28d7b4060886d1bce42fe0f4b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.495629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586f7ca28d7b4060886d1bce42fe0f4b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.497733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd0b19-081f-4c89-838f-64a1f55bf770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:08.500658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd0b19-081f-4c89-838f-64a1f55bf770 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:08.514033 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3292/6545] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:08.530976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586f7ca28d7b4060886d1bce42fe0f4b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.545831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586f7ca28d7b4060886d1bce42fe0f4b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.566646 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3254/6546] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:08 2022] DELETE /identity/v3/users/586f7ca28d7b4060886d1bce42fe0f4b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:08.571515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17925-2446-4e33-8089-4a839850045d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.572416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17925-2446-4e33-8089-4a839850045d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.572416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17925-2446-4e33-8089-4a839850045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.592699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aac17925-2446-4e33-8089-4a839850045d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:08.594291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aac17925-2446-4e33-8089-4a839850045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:08.650001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:08.652643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:08.744405 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3293/6547] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:08.750485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45670-e052-4cbe-a2fb-7e6294b302b9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:08.756168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:08.757251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.758200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.758200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] PATH_INFO: `/v3/users/5263c2242ebb4de49dcefd4cdf52ffa4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.759410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5263c2242ebb4de49dcefd4cdf52ffa4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:08.761497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:08.767339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17925-2446-4e33-8089-4a839850045d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:08.770679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aac17925-2446-4e33-8089-4a839850045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:08.837017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5263c2242ebb4de49dcefd4cdf52ffa4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.838752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5263c2242ebb4de49dcefd4cdf52ffa4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.840526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5263c2242ebb4de49dcefd4cdf52ffa4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.860015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5263c2242ebb4de49dcefd4cdf52ffa4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.861094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17925-2446-4e33-8089-4a839850045d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:08.866459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:08.867544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.867960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.868460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.870612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:08.872368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cb7d946-e04a-4289-8f44-b1138d403d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5263c2242ebb4de49dcefd4cdf52ffa4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:08.886948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:08.889013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:08.891944 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3255/6548] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:08 2022] DELETE /identity/v3/users/5263c2242ebb4de49dcefd4cdf52ffa4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:08.897287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da28a-1e3b-4f98-8020-35c419fe7118 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:08.897863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da28a-1e3b-4f98-8020-35c419fe7118 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:08.898336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da28a-1e3b-4f98-8020-35c419fe7118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:08.914218 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3294/6549] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:08.921025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1f2da28a-1e3b-4f98-8020-35c419fe7118 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:08.923084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1f2da28a-1e3b-4f98-8020-35c419fe7118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:09.165408 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3256/6550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:09.216157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:09.218053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:09.236377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161379a-639a-4769-9f61-396a457b3966 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:09.328313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2da28a-1e3b-4f98-8020-35c419fe7118 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:09.330065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1f2da28a-1e3b-4f98-8020-35c419fe7118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:09.337606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf24e9-d78f-4ec9-bd9b-b6e1fd5ac6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:09.338414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf24e9-d78f-4ec9-bd9b-b6e1fd5ac6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:09.338931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf24e9-d78f-4ec9-bd9b-b6e1fd5ac6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:09.339224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf24e9-d78f-4ec9-bd9b-b6e1fd5ac6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:09.350509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf24e9-d78f-4ec9-bd9b-b6e1fd5ac6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:09.352381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf24e9-d78f-4ec9-bd9b-b6e1fd5ac6a2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:09.362912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2da28a-1e3b-4f98-8020-35c419fe7118 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:09.363225 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3295/6551] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:09.370453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:09.371366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:09.371655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:09.371926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] PATH_INFO: `/v3/projects/03249dd317564fa1b7cab9087d57e2ab` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:09.373206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03249dd317564fa1b7cab9087d57e2ab)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:09.375916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:09.443344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03249dd317564fa1b7cab9087d57e2ab', 'request_id': 'req-8880626f-3ba6-4416-89f6-6bc37dccc7a1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:09.455408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03249dd317564fa1b7cab9087d57e2ab', 'request_id': 'req-8880626f-3ba6-4416-89f6-6bc37dccc7a1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:09.479847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03249dd317564fa1b7cab9087d57e2ab', 'request_id': 'req-8880626f-3ba6-4416-89f6-6bc37dccc7a1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:09.494444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] The token cache is being invalidate because project 03249dd317564fa1b7cab9087d57e2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:09.494738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:09.495603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8880626f-3ba6-4416-89f6-6bc37dccc7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:09.498040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3257/6552] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:09 2022] DELETE /identity/v3/projects/03249dd317564fa1b7cab9087d57e2ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:09.504123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf5e2-d937-4490-905d-bd647bb23227 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:09.504550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf5e2-d937-4490-905d-bd647bb23227 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:09.504827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf5e2-d937-4490-905d-bd647bb23227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:09.525916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5acaf5e2-d937-4490-905d-bd647bb23227 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:09.527142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5acaf5e2-d937-4490-905d-bd647bb23227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:09.621119 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3296/6553] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:09.628610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d03df-7751-47d0-99f5-67c25053f0dc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:09.628892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d03df-7751-47d0-99f5-67c25053f0dc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:09.629167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d03df-7751-47d0-99f5-67c25053f0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:09.650144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2a4d03df-7751-47d0-99f5-67c25053f0dc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:09.651385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a4d03df-7751-47d0-99f5-67c25053f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:09.665729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaf5e2-d937-4490-905d-bd647bb23227 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:09.666306 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3258/6554] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:09.678719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaf5e2-d937-4490-905d-bd647bb23227 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:09.686426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:09.687934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:09.688100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:09.688285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:09.689066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:09.689571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:09.691202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:09.711697 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3297/6555] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:09.713578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d03df-7751-47d0-99f5-67c25053f0dc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:09.724275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d03df-7751-47d0-99f5-67c25053f0dc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:09.746105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:09.746959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:09.747249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:09.748566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:09.749099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:09.751604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:09.784656 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3259/6556] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:09 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:09.786106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:09.798771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10d8e1-5dea-41ea-b071-cc3c80034f3b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:09.910162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:09.912874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:09.933671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5b0c-0627-4a2f-b349-b4072ca24c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:09.934686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5b0c-0627-4a2f-b349-b4072ca24c01 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:09.934982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5b0c-0627-4a2f-b349-b4072ca24c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:09.935267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5b0c-0627-4a2f-b349-b4072ca24c01 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:09.936172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff5b0c-0627-4a2f-b349-b4072ca24c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:09.940690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff5b0c-0627-4a2f-b349-b4072ca24c01 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:09.970545 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3298/6557] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:09 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:09.975326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5b0c-0627-4a2f-b349-b4072ca24c01 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:10.000662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5b0c-0627-4a2f-b349-b4072ca24c01 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.008505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f685674-6ba1-4a74-a4ca-1ab66ee8bae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:10.009337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f685674-6ba1-4a74-a4ca-1ab66ee8bae0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.009719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f685674-6ba1-4a74-a4ca-1ab66ee8bae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.010075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f685674-6ba1-4a74-a4ca-1ab66ee8bae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.010974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f685674-6ba1-4a74-a4ca-1ab66ee8bae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:10.013054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f685674-6ba1-4a74-a4ca-1ab66ee8bae0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:10.036241 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3299/6558] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:10.043271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f685674-6ba1-4a74-a4ca-1ab66ee8bae0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:10.048321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eab965-b576-4cc7-afee-11569f936fce admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.065076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:10.066264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.066679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.067234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] PATH_INFO: `/v3/projects/a918d8dc64fe475f9f79a25749df103f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.072281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a918d8dc64fe475f9f79a25749df103f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:10.076710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f685674-6ba1-4a74-a4ca-1ab66ee8bae0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.081219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:10.100002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fa5f5-a158-4618-9701-806db31b55f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:10.101877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fa5f5-a158-4618-9701-806db31b55f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.102423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fa5f5-a158-4618-9701-806db31b55f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.102733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fa5f5-a158-4618-9701-806db31b55f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.104076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fa5f5-a158-4618-9701-806db31b55f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:10.107271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fa5f5-a158-4618-9701-806db31b55f3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:10.132006 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3300/6559] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:10.137316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fa5f5-a158-4618-9701-806db31b55f3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:10.168525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fa5f5-a158-4618-9701-806db31b55f3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.195838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a918d8dc64fe475f9f79a25749df103f', 'request_id': 'req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.203588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a918d8dc64fe475f9f79a25749df103f', 'request_id': 'req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.217539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a918d8dc64fe475f9f79a25749df103f', 'request_id': 'req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.233763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] The token cache is being invalidate because project a918d8dc64fe475f9f79a25749df103f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:10.234586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.236280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ad551d0c-3a65-4c01-9c52-ed1e48fb5997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.239546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3260/6560] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:09 2022] DELETE /identity/v3/projects/a918d8dc64fe475f9f79a25749df103f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:10.246060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96675e9f-d80c-421f-9ba8-de8744f9def6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.246707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96675e9f-d80c-421f-9ba8-de8744f9def6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.247232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96675e9f-d80c-421f-9ba8-de8744f9def6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.292505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-96675e9f-d80c-421f-9ba8-de8744f9def6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:10.296010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-96675e9f-d80c-421f-9ba8-de8744f9def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:10.320612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3db557-a92c-49e9-85ba-c02bd79d10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:10.322111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3db557-a92c-49e9-85ba-c02bd79d10aa admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.322582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3db557-a92c-49e9-85ba-c02bd79d10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.323012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3db557-a92c-49e9-85ba-c02bd79d10aa admin admin] PATH_INFO: `/v3/projects/bc0fe7526c4b42049f01fa0829a5d5b0/users/f49791bd78ee4b7e9eb98db156365a2c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.342868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3db557-a92c-49e9-85ba-c02bd79d10aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0fe7526c4b42049f01fa0829a5d5b0, user_id=f49791bd78ee4b7e9eb98db156365a2c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:10.348359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3db557-a92c-49e9-85ba-c02bd79d10aa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:10.379796 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3301/6561] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:10 2022] PUT /identity/v3/projects/bc0fe7526c4b42049f01fa0829a5d5b0/users/f49791bd78ee4b7e9eb98db156365a2c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:10.391028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f107e5-5a8e-43a8-9de7-e8bac244f0e4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.391478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f107e5-5a8e-43a8-9de7-e8bac244f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.392026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f107e5-5a8e-43a8-9de7-e8bac244f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.431913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-20f107e5-5a8e-43a8-9de7-e8bac244f0e4 None None] MFA Rules not processed for user `f49791bd78ee4b7e9eb98db156365a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:10.431913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-20f107e5-5a8e-43a8-9de7-e8bac244f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:10.433223 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3261/6562] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:10.434878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c9fd-cebe-4c9b-b695-20286c19c3ea None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.435358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c9fd-cebe-4c9b-b695-20286c19c3ea None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.435792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c9fd-cebe-4c9b-b695-20286c19c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.458531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b1e1c9fd-cebe-4c9b-b695-20286c19c3ea None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:10.460236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b1e1c9fd-cebe-4c9b-b695-20286c19c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:10.524367 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3302/6563] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:10.532238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f107e5-5a8e-43a8-9de7-e8bac244f0e4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:10.535934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-20f107e5-5a8e-43a8-9de7-e8bac244f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:10.544546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3262/6564] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:10.547984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1c9fd-cebe-4c9b-b695-20286c19c3ea None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:10.566713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1c9fd-cebe-4c9b-b695-20286c19c3ea None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.568235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:10.570647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.570647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.570647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.572620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:10.573615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:10.576553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:10.603370 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3263/6565] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:10.608528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:10.630376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f00ed-46bf-441b-b3ba-d6d4222f5823 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.641019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f107e5-5a8e-43a8-9de7-e8bac244f0e4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.645062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae5cfc-3ddd-4e52-a239-48e64956349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:10.645404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:10.646055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.646189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae5cfc-3ddd-4e52-a239-48e64956349b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.646334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.646610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.646723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae5cfc-3ddd-4e52-a239-48e64956349b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.647124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae5cfc-3ddd-4e52-a239-48e64956349b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.648433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae5cfc-3ddd-4e52-a239-48e64956349b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:10.652763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae5cfc-3ddd-4e52-a239-48e64956349b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:10.658125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:10.659778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:10.671256 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3303/6566] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:10.692224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:10.694432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:10.717496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213f9f-bf39-442d-b055-871365484649 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.725800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:10.727196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.727487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.727818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] PATH_INFO: `/v3/users/f49791bd78ee4b7e9eb98db156365a2c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.733042 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3264/6567] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:10 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:10.735911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae5cfc-3ddd-4e52-a239-48e64956349b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:10.739991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49791bd78ee4b7e9eb98db156365a2c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:10.742793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:10.819873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49791bd78ee4b7e9eb98db156365a2c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.850504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49791bd78ee4b7e9eb98db156365a2c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.862570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49791bd78ee4b7e9eb98db156365a2c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.864195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49791bd78ee4b7e9eb98db156365a2c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.866137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6dff4ed2-2737-40ae-9966-2a39c17fa27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49791bd78ee4b7e9eb98db156365a2c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:10.889570 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3304/6568] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:10 2022] DELETE /identity/v3/users/f49791bd78ee4b7e9eb98db156365a2c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:10.892794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17afb3b-481b-41cb-9e73-7b7ea16e2d3f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:10.893288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17afb3b-481b-41cb-9e73-7b7ea16e2d3f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:10.893763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17afb3b-481b-41cb-9e73-7b7ea16e2d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:10.930259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f17afb3b-481b-41cb-9e73-7b7ea16e2d3f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:10.932426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae5cfc-3ddd-4e52-a239-48e64956349b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:10.935973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f17afb3b-481b-41cb-9e73-7b7ea16e2d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:11.059063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:11.059896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:11.060640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:11.060992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:11.061743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:11.064456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:11.067775 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3305/6569] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:11.081787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17afb3b-481b-41cb-9e73-7b7ea16e2d3f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:11.083255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f17afb3b-481b-41cb-9e73-7b7ea16e2d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:11.092888 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3265/6570] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:10 2022] POST /identity/v3/users => generated 282 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:11.097310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:11.099425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:11.124446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f333-6d8c-4b0d-8e77-d3cf0e85fd20 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:11.131143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c8a2-2c30-4335-9d88-7de30ea6d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:11.131977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c8a2-2c30-4335-9d88-7de30ea6d1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:11.132160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c8a2-2c30-4335-9d88-7de30ea6d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:11.132372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c8a2-2c30-4335-9d88-7de30ea6d1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:11.133093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55c8a2-2c30-4335-9d88-7de30ea6d1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:11.134812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55c8a2-2c30-4335-9d88-7de30ea6d1f3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:11.146902 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3266/6571] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:11.152498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c8a2-2c30-4335-9d88-7de30ea6d1f3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:11.165065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c8a2-2c30-4335-9d88-7de30ea6d1f3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:11.178678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc49925-e5bf-4eae-b3a1-528824e17011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:11.181317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc49925-e5bf-4eae-b3a1-528824e17011 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:11.181478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc49925-e5bf-4eae-b3a1-528824e17011 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:11.181629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc49925-e5bf-4eae-b3a1-528824e17011 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:11.185224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc49925-e5bf-4eae-b3a1-528824e17011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:11.186958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc49925-e5bf-4eae-b3a1-528824e17011 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:11.191519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17afb3b-481b-41cb-9e73-7b7ea16e2d3f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:11.200959 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3267/6572] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:11.203514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a79f69-e59d-4ac4-bb90-f458c2bfadc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:11.204486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79f69-e59d-4ac4-bb90-f458c2bfadc7 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:11.205791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc49925-e5bf-4eae-b3a1-528824e17011 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:11.206355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79f69-e59d-4ac4-bb90-f458c2bfadc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:11.206735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79f69-e59d-4ac4-bb90-f458c2bfadc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:11.223880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a79f69-e59d-4ac4-bb90-f458c2bfadc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:11.226167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a79f69-e59d-4ac4-bb90-f458c2bfadc7 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:11.234559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc49925-e5bf-4eae-b3a1-528824e17011 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:11.241094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:11.242047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:11.242429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:11.242712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] PATH_INFO: `/v3/projects/32337605c9cb4c6ba712ff427bca399a/users/237f52842ab243bcaa472043ac740848/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:11.244446 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3306/6573] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:11.266888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32337605c9cb4c6ba712ff427bca399a, user_id=237f52842ab243bcaa472043ac740848, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:11.269783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:11.310405 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3268/6574] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:11 2022] PUT /identity/v3/projects/32337605c9cb4c6ba712ff427bca399a/users/237f52842ab243bcaa472043ac740848/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:11.314697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393132-291f-43f3-ba5d-427d018197b8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:11.314994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393132-291f-43f3-ba5d-427d018197b8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:11.315277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393132-291f-43f3-ba5d-427d018197b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:11.367931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-85393132-291f-43f3-ba5d-427d018197b8 None None] MFA Rules not processed for user `237f52842ab243bcaa472043ac740848`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:11.372159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-85393132-291f-43f3-ba5d-427d018197b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:11.638966 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3307/6575] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:11.651508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:11.694950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:11.856874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85393132-291f-43f3-ba5d-427d018197b8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:11.861034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-85393132-291f-43f3-ba5d-427d018197b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:11.961716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573a9eb-30b9-4970-8a70-9b450094b4f8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:11.973087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3524f-2699-422c-8648-8cb7f57be998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:11.974368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3524f-2699-422c-8648-8cb7f57be998 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:11.975164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3524f-2699-422c-8648-8cb7f57be998 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:11.975865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3524f-2699-422c-8648-8cb7f57be998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.001235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85393132-291f-43f3-ba5d-427d018197b8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:12.001842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3524f-2699-422c-8648-8cb7f57be998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.006259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3524f-2699-422c-8648-8cb7f57be998 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:12.009123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:12.010207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.010648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.011262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] PATH_INFO: `/v3/projects/bc0fe7526c4b42049f01fa0829a5d5b0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.013053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0fe7526c4b42049f01fa0829a5d5b0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.015304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:12.026061 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3269/6576] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:12.084485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0fe7526c4b42049f01fa0829a5d5b0', 'request_id': 'req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.096379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0fe7526c4b42049f01fa0829a5d5b0', 'request_id': 'req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.109403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0fe7526c4b42049f01fa0829a5d5b0', 'request_id': 'req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.127560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] The token cache is being invalidate because project bc0fe7526c4b42049f01fa0829a5d5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:12.127560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.128382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.130182 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3308/6577] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:11 2022] DELETE /identity/v3/projects/bc0fe7526c4b42049f01fa0829a5d5b0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:12.135404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e5dc-dbd6-4d27-bfa7-120b2c16107a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.135693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e5dc-dbd6-4d27-bfa7-120b2c16107a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.135971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e5dc-dbd6-4d27-bfa7-120b2c16107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.189729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6eb3e5dc-dbd6-4d27-bfa7-120b2c16107a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:12.194543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6eb3e5dc-dbd6-4d27-bfa7-120b2c16107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:12.220126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:12.221762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:12.280390 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3270/6578] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:12.287476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae7b8b-b3f9-47f8-84ee-171dddd14a3f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.288171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae7b8b-b3f9-47f8-84ee-171dddd14a3f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.288769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae7b8b-b3f9-47f8-84ee-171dddd14a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.318330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-28ae7b8b-b3f9-47f8-84ee-171dddd14a3f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:12.319846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-28ae7b8b-b3f9-47f8-84ee-171dddd14a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:12.359599 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3271/6579] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:12.361872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae7b8b-b3f9-47f8-84ee-171dddd14a3f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:12.362724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1ce5-08ea-4f9f-95da-2795fa64e7fc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:12.375239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:12.376721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.377226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.377821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] PATH_INFO: `/v3/users/237f52842ab243bcaa472043ac740848` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.379428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237f52842ab243bcaa472043ac740848)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.379562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae7b8b-b3f9-47f8-84ee-171dddd14a3f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:12.382425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:12.385923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:12.386690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.386953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.387227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.388040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:12.388351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.390560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:12.404148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3272/6580] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:12.412597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:12.434821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca324-b26a-43d9-995f-e341ab7b6c5d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:12.445115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d0265-c991-4be9-9083-3d8fe7d1dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:12.446133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d0265-c991-4be9-9083-3d8fe7d1dbbf admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.446692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d0265-c991-4be9-9083-3d8fe7d1dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.447081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d0265-c991-4be9-9083-3d8fe7d1dbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.450185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d0265-c991-4be9-9083-3d8fe7d1dbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.454667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d0265-c991-4be9-9083-3d8fe7d1dbbf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:12.486830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237f52842ab243bcaa472043ac740848'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.514704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237f52842ab243bcaa472043ac740848'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.524999 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3273/6581] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:12 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:12.526422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d0265-c991-4be9-9083-3d8fe7d1dbbf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:12.538040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237f52842ab243bcaa472043ac740848'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.538860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237f52842ab243bcaa472043ac740848'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.540078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b768eb4a-0510-4ab7-b4b1-ce98b71f4a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237f52842ab243bcaa472043ac740848'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:12.576307 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3309/6582] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:12 2022] DELETE /identity/v3/users/237f52842ab243bcaa472043ac740848 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:12.582204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0946-7551-492c-8638-77326f7d5418 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.582658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0946-7551-492c-8638-77326f7d5418 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.584577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0946-7551-492c-8638-77326f7d5418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.644818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-81cb0946-7551-492c-8638-77326f7d5418 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:12.646114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-81cb0946-7551-492c-8638-77326f7d5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:12.670301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d0265-c991-4be9-9083-3d8fe7d1dbbf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:12.813065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:12.813774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.814057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.814340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.815044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.819891 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3310/6583] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:12.820026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:12.829039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb0946-7551-492c-8638-77326f7d5418 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:12.830512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-81cb0946-7551-492c-8638-77326f7d5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:12.878546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3274/6584] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:12 2022] POST /identity/v3/users => generated 291 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:12.880512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:12.891804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:12.926993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e62be-e916-4462-9bdc-00955aaf76d2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:12.934002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bea72-3871-4270-9966-4639a0770bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:12.934880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bea72-3871-4270-9966-4639a0770bfc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.935274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bea72-3871-4270-9966-4639a0770bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.935676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bea72-3871-4270-9966-4639a0770bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.937737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bea72-3871-4270-9966-4639a0770bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.939570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bea72-3871-4270-9966-4639a0770bfc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:12.950088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb0946-7551-492c-8638-77326f7d5418 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:12.955676 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3275/6585] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:12.956931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bea72-3871-4270-9966-4639a0770bfc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:12.969436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d746-5529-46ee-bdc3-131725993d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:12.969644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bea72-3871-4270-9966-4639a0770bfc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:12.970074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d746-5529-46ee-bdc3-131725993d10 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.970378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d746-5529-46ee-bdc3-131725993d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.970580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d746-5529-46ee-bdc3-131725993d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.980873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4907b-eed9-47d6-9594-ae304fcbc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:12.981715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4907b-eed9-47d6-9594-ae304fcbc4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:12.982109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4907b-eed9-47d6-9594-ae304fcbc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:12.982455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4907b-eed9-47d6-9594-ae304fcbc4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:12.983350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4907b-eed9-47d6-9594-ae304fcbc4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.985975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4907b-eed9-47d6-9594-ae304fcbc4b7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:12.992760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d746-5529-46ee-bdc3-131725993d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:12.995455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d746-5529-46ee-bdc3-131725993d10 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:13.012388 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3276/6586] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:15:13.017726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4907b-eed9-47d6-9594-ae304fcbc4b7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:13.018955 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3311/6587] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:13.044541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4907b-eed9-47d6-9594-ae304fcbc4b7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:13.057225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946015f-d09e-4319-a87f-637e9a049498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:13.058131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946015f-d09e-4319-a87f-637e9a049498 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:13.058418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946015f-d09e-4319-a87f-637e9a049498 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:13.058698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946015f-d09e-4319-a87f-637e9a049498 admin admin] PATH_INFO: `/v3/projects/545bf459f4a445c289d13de55cf2c4eb/users/58d5d98aeb214bd38ce193d7c3f82ac6/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:13.103925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946015f-d09e-4319-a87f-637e9a049498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545bf459f4a445c289d13de55cf2c4eb, user_id=58d5d98aeb214bd38ce193d7c3f82ac6, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:13.113261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946015f-d09e-4319-a87f-637e9a049498 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:13.153441 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3277/6588] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:13 2022] PUT /identity/v3/projects/545bf459f4a445c289d13de55cf2c4eb/users/58d5d98aeb214bd38ce193d7c3f82ac6/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:13.166931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80567-08c8-43a3-b8ae-1cd577b45855 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:13.167599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80567-08c8-43a3-b8ae-1cd577b45855 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:13.168792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80567-08c8-43a3-b8ae-1cd577b45855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:13.240984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e2b80567-08c8-43a3-b8ae-1cd577b45855 None None] MFA Rules not processed for user `58d5d98aeb214bd38ce193d7c3f82ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:13.244167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2b80567-08c8-43a3-b8ae-1cd577b45855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:13.464433 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3312/6589] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:13.466830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946015f-d09e-4319-a87f-637e9a049498 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:13.595583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80567-08c8-43a3-b8ae-1cd577b45855 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:13.598556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2b80567-08c8-43a3-b8ae-1cd577b45855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:13.635020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946015f-d09e-4319-a87f-637e9a049498 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:13.645345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7e2e4-ece8-4c2e-a198-9b0ed2d35032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:13.646037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7e2e4-ece8-4c2e-a198-9b0ed2d35032 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:13.646381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7e2e4-ece8-4c2e-a198-9b0ed2d35032 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:13.646665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7e2e4-ece8-4c2e-a198-9b0ed2d35032 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:13.647998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7e2e4-ece8-4c2e-a198-9b0ed2d35032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:13.650119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7e2e4-ece8-4c2e-a198-9b0ed2d35032 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:13.718992 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3278/6590] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:13 2022] POST /identity/v3/projects => generated 379 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:13.734419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7e2e4-ece8-4c2e-a198-9b0ed2d35032 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:13.742833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80567-08c8-43a3-b8ae-1cd577b45855 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:13.871743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:13.875173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:13.875490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:13.875833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] PATH_INFO: `/v3/projects/32337605c9cb4c6ba712ff427bca399a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:13.878128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32337605c9cb4c6ba712ff427bca399a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:13.882700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:13.884023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7e2e4-ece8-4c2e-a198-9b0ed2d35032 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:13.901443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895599b-d29f-4af9-8726-6fcf69ff0ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:13.902259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895599b-d29f-4af9-8726-6fcf69ff0ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:13.902647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895599b-d29f-4af9-8726-6fcf69ff0ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:13.903031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895599b-d29f-4af9-8726-6fcf69ff0ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:13.904376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895599b-d29f-4af9-8726-6fcf69ff0ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:13.909201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895599b-d29f-4af9-8726-6fcf69ff0ad7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:13.968824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32337605c9cb4c6ba712ff427bca399a', 'request_id': 'req-d840cc3a-5643-4554-9377-26a31621bfe7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:13.979001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32337605c9cb4c6ba712ff427bca399a', 'request_id': 'req-d840cc3a-5643-4554-9377-26a31621bfe7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:13.981165 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3279/6591] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:13 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:13.983388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895599b-d29f-4af9-8726-6fcf69ff0ad7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.005933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32337605c9cb4c6ba712ff427bca399a', 'request_id': 'req-d840cc3a-5643-4554-9377-26a31621bfe7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:14.011129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895599b-d29f-4af9-8726-6fcf69ff0ad7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.027642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] The token cache is being invalidate because project 32337605c9cb4c6ba712ff427bca399a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:14.028186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:14.029160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d840cc3a-5643-4554-9377-26a31621bfe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:14.039895 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3313/6592] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:13 2022] DELETE /identity/v3/projects/32337605c9cb4c6ba712ff427bca399a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:14.041856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4609e11-7857-4289-a730-24d441fb959a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.042286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4609e11-7857-4289-a730-24d441fb959a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.042612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4609e11-7857-4289-a730-24d441fb959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.072654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d4609e11-7857-4289-a730-24d441fb959a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:14.073897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4609e11-7857-4289-a730-24d441fb959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:14.126702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.128104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.128579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.129045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.130481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.132792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.148943 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3280/6593] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:14.156478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.160135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:14.190424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9541001-6ca1-4e15-b8af-816514e348ae admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.210819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021fcc-4f52-4771-bebf-4e16156a6228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.212746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021fcc-4f52-4771-bebf-4e16156a6228 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.213425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021fcc-4f52-4771-bebf-4e16156a6228 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.214270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021fcc-4f52-4771-bebf-4e16156a6228 admin admin] PATH_INFO: `/v3/projects/02d9465dd7504a7a9317fd19af8f61dd/users/2953edb52195416da7496525a410927a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.220045 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3314/6594] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:14.228649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bf3f-dc0f-49b6-bc71-666df50aaaa4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.229189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bf3f-dc0f-49b6-bc71-666df50aaaa4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.229721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bf3f-dc0f-49b6-bc71-666df50aaaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.247230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021fcc-4f52-4771-bebf-4e16156a6228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d9465dd7504a7a9317fd19af8f61dd, user_id=2953edb52195416da7496525a410927a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.261065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021fcc-4f52-4771-bebf-4e16156a6228 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.271398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dbb5bf3f-dc0f-49b6-bc71-666df50aaaa4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:14.274228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dbb5bf3f-dc0f-49b6-bc71-666df50aaaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:14.292773 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3281/6595] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:14 2022] PUT /identity/v3/projects/02d9465dd7504a7a9317fd19af8f61dd/users/2953edb52195416da7496525a410927a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:14.299455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021fcc-4f52-4771-bebf-4e16156a6228 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.445015 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3315/6596] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:14.446116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bf3f-dc0f-49b6-bc71-666df50aaaa4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.451393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021fcc-4f52-4771-bebf-4e16156a6228 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.463091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f230-221b-4427-965c-f06f1ed997ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.464658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f230-221b-4427-965c-f06f1ed997ea admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.465297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f230-221b-4427-965c-f06f1ed997ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.466011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f230-221b-4427-965c-f06f1ed997ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.467444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74f230-221b-4427-965c-f06f1ed997ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.468192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bf3f-dc0f-49b6-bc71-666df50aaaa4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.471704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74f230-221b-4427-965c-f06f1ed997ea admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.478455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.481882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.482394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.483042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.484402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:14.485920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.493109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.495944 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3282/6597] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:14.502070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f230-221b-4427-965c-f06f1ed997ea admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.512424 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3316/6598] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:15:14.519648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f230-221b-4427-965c-f06f1ed997ea admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.521149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.533858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3437186-1022-44ff-80ce-66a8b148a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.534927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437186-1022-44ff-80ce-66a8b148a579 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.535260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437186-1022-44ff-80ce-66a8b148a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.535589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437186-1022-44ff-80ce-66a8b148a579 admin admin] PATH_INFO: `/v3/projects/02d9465dd7504a7a9317fd19af8f61dd/users/2953edb52195416da7496525a410927a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.538614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3437186-1022-44ff-80ce-66a8b148a579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d9465dd7504a7a9317fd19af8f61dd, user_id=2953edb52195416da7496525a410927a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.540318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157457dd-f847-4f52-a635-1106a80f45be admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.542781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3437186-1022-44ff-80ce-66a8b148a579 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.560230 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3283/6599] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:14 2022] PUT /identity/v3/projects/02d9465dd7504a7a9317fd19af8f61dd/users/2953edb52195416da7496525a410927a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:14.561943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d582203-5f33-4e2c-af51-bacbefbbb5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.563054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d582203-5f33-4e2c-af51-bacbefbbb5db admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.563054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d582203-5f33-4e2c-af51-bacbefbbb5db admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.563409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d582203-5f33-4e2c-af51-bacbefbbb5db admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.563893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d582203-5f33-4e2c-af51-bacbefbbb5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.566003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d582203-5f33-4e2c-af51-bacbefbbb5db admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.576622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899157-4573-4d16-b8f9-ecbd32eca0b6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.577049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899157-4573-4d16-b8f9-ecbd32eca0b6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.577206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899157-4573-4d16-b8f9-ecbd32eca0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.610860 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3317/6600] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:14 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:14.615664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d582203-5f33-4e2c-af51-bacbefbbb5db admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.629010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-df899157-4573-4d16-b8f9-ecbd32eca0b6 None None] MFA Rules not processed for user `2953edb52195416da7496525a410927a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:14.630365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-df899157-4573-4d16-b8f9-ecbd32eca0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:14.743766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d582203-5f33-4e2c-af51-bacbefbbb5db admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.750151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665213-4523-4d54-a527-deae1597908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.751506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665213-4523-4d54-a527-deae1597908a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.751927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665213-4523-4d54-a527-deae1597908a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.752555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665213-4523-4d54-a527-deae1597908a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.753157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71665213-4523-4d54-a527-deae1597908a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.755479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71665213-4523-4d54-a527-deae1597908a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.770088 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3284/6601] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:14.772089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc9b6-7991-4e37-a25e-f9bc553f18f1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.772617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc9b6-7991-4e37-a25e-f9bc553f18f1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.773039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc9b6-7991-4e37-a25e-f9bc553f18f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.806498 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3318/6602] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:14 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:14.810993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-835fc9b6-7991-4e37-a25e-f9bc553f18f1 None None] MFA Rules not processed for user `614b36c5d1d64be3a2432a59a05c3dca`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:14.814233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-835fc9b6-7991-4e37-a25e-f9bc553f18f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:14.816481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665213-4523-4d54-a527-deae1597908a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.820914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-71665213-4523-4d54-a527-deae1597908a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:14.899841 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3285/6603] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:14.901915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc9b6-7991-4e37-a25e-f9bc553f18f1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.922401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc9b6-7991-4e37-a25e-f9bc553f18f1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.931634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548854-6ad9-4df5-916f-ea9752a83057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.932804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548854-6ad9-4df5-916f-ea9752a83057 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.933315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548854-6ad9-4df5-916f-ea9752a83057 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.933853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548854-6ad9-4df5-916f-ea9752a83057 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.935142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50548854-6ad9-4df5-916f-ea9752a83057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.937947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50548854-6ad9-4df5-916f-ea9752a83057 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.950447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665213-4523-4d54-a527-deae1597908a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.955136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3286/6604] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:14.956305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335add58-b422-4918-a540-e085548af481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.957000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335add58-b422-4918-a540-e085548af481 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.957288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335add58-b422-4918-a540-e085548af481 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.957569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335add58-b422-4918-a540-e085548af481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:14.961052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548854-6ad9-4df5-916f-ea9752a83057 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:14.970290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335add58-b422-4918-a540-e085548af481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:14.971407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335add58-b422-4918-a540-e085548af481 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:14.981538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548854-6ad9-4df5-916f-ea9752a83057 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:14.984501 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3319/6605] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:14.996069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e37343-2380-48e7-8f28-cc444828e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:14.997626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37343-2380-48e7-8f28-cc444828e118 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:14.997936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37343-2380-48e7-8f28-cc444828e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:14.998353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37343-2380-48e7-8f28-cc444828e118 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.000603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e37343-2380-48e7-8f28-cc444828e118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.003343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e37343-2380-48e7-8f28-cc444828e118 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.022916 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3287/6606] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:15:15.029684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335add58-b422-4918-a540-e085548af481 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.059144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335add58-b422-4918-a540-e085548af481 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.079999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434edca-8ac7-4102-9b24-33a0a3b5973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.081067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434edca-8ac7-4102-9b24-33a0a3b5973a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.081357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434edca-8ac7-4102-9b24-33a0a3b5973a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.081637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434edca-8ac7-4102-9b24-33a0a3b5973a admin admin] PATH_INFO: `/v3/projects/3abc3163ed05468aa27630c0271482e5/users/f7857feb584f4ddb91736d7fc6c99c76/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.115248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434edca-8ac7-4102-9b24-33a0a3b5973a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abc3163ed05468aa27630c0271482e5, user_id=f7857feb584f4ddb91736d7fc6c99c76, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.119015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434edca-8ac7-4102-9b24-33a0a3b5973a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.149741 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3320/6607] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:15 2022] PUT /identity/v3/projects/3abc3163ed05468aa27630c0271482e5/users/f7857feb584f4ddb91736d7fc6c99c76/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:15.165621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456e83-a739-4fe8-ab56-a7e5e43bb6c0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.165955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456e83-a739-4fe8-ab56-a7e5e43bb6c0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.166320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456e83-a739-4fe8-ab56-a7e5e43bb6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.226648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ed456e83-a739-4fe8-ab56-a7e5e43bb6c0 None None] MFA Rules not processed for user `f7857feb584f4ddb91736d7fc6c99c76`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:15.228281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ed456e83-a739-4fe8-ab56-a7e5e43bb6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:15.399802 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3288/6608] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:15.406551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434edca-8ac7-4102-9b24-33a0a3b5973a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.500174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434edca-8ac7-4102-9b24-33a0a3b5973a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.505163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca76521-4185-41ed-9d31-5169cdd09595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.505995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76521-4185-41ed-9d31-5169cdd09595 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.506279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76521-4185-41ed-9d31-5169cdd09595 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.506573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76521-4185-41ed-9d31-5169cdd09595 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.507259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca76521-4185-41ed-9d31-5169cdd09595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.509200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca76521-4185-41ed-9d31-5169cdd09595 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.544457 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3321/6609] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:15 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:15.545786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456e83-a739-4fe8-ab56-a7e5e43bb6c0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.559106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456e83-a739-4fe8-ab56-a7e5e43bb6c0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.582710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca76521-4185-41ed-9d31-5169cdd09595 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.629179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24da886-b755-414a-bb4d-6b618cc3b145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.630562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da886-b755-414a-bb4d-6b618cc3b145 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.631199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da886-b755-414a-bb4d-6b618cc3b145 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.631859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da886-b755-414a-bb4d-6b618cc3b145 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.633203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24da886-b755-414a-bb4d-6b618cc3b145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.636753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24da886-b755-414a-bb4d-6b618cc3b145 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.673850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca76521-4185-41ed-9d31-5169cdd09595 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.674812 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3289/6610] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:15 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:15.676150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24da886-b755-414a-bb4d-6b618cc3b145 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.678479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2953edb52195416da7496525a410927a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02d9465dd7504a7a9317fd19af8f61dd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.679238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.679606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.679964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.680829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:15.681150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.682775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.693254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24da886-b755-414a-bb4d-6b618cc3b145 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.703683 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3322/6611] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:15:15.708866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.711757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dca41-05c7-4846-8e32-d19fd20ad94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.712290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dca41-05c7-4846-8e32-d19fd20ad94f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.712822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dca41-05c7-4846-8e32-d19fd20ad94f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.713267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dca41-05c7-4846-8e32-d19fd20ad94f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.714324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dca41-05c7-4846-8e32-d19fd20ad94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.716586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dca41-05c7-4846-8e32-d19fd20ad94f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.723471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc0bf8-3810-4abb-accb-0c0fa70ed42d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.739409 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3290/6612] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:15.740731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e2470-cb8e-434f-8c06-ebe7326d845d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2953edb52195416da7496525a410927a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02d9465dd7504a7a9317fd19af8f61dd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.741318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dca41-05c7-4846-8e32-d19fd20ad94f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.741614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2470-cb8e-434f-8c06-ebe7326d845d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.743127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2470-cb8e-434f-8c06-ebe7326d845d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.743424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2470-cb8e-434f-8c06-ebe7326d845d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.744363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e2470-cb8e-434f-8c06-ebe7326d845d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.746527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e2470-cb8e-434f-8c06-ebe7326d845d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.756765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dca41-05c7-4846-8e32-d19fd20ad94f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.761907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e7cc3-7b04-47ff-ba98-1f3596900fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.762827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7cc3-7b04-47ff-ba98-1f3596900fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.763094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7cc3-7b04-47ff-ba98-1f3596900fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.763402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7cc3-7b04-47ff-ba98-1f3596900fe3 admin admin] PATH_INFO: `/v3/projects/be9b20bebfd2460e904335c7c42132fe/users/27b4efba9d2247da85a78f22570c1fcb/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.782757 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3323/6613] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:15 2022] POST /identity/v3/projects => generated 353 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:15.785606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e7cc3-7b04-47ff-ba98-1f3596900fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9b20bebfd2460e904335c7c42132fe, user_id=27b4efba9d2247da85a78f22570c1fcb, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.787063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e2470-cb8e-434f-8c06-ebe7326d845d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.792598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e7cc3-7b04-47ff-ba98-1f3596900fe3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.826389 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3291/6614] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:15 2022] PUT /identity/v3/projects/be9b20bebfd2460e904335c7c42132fe/users/27b4efba9d2247da85a78f22570c1fcb/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:15.829005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e7cc3-7b04-47ff-ba98-1f3596900fe3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:15.861137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e2470-cb8e-434f-8c06-ebe7326d845d tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.971831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e7cc3-7b04-47ff-ba98-1f3596900fe3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:15.975452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2953edb52195416da7496525a410927a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02d9465dd7504a7a9317fd19af8f61dd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.976409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.976799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.977200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.978069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:15.978512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c108b-c6e6-4332-81ae-dd33ea9ad1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:15.978696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.979469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c108b-c6e6-4332-81ae-dd33ea9ad1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:15.979757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c108b-c6e6-4332-81ae-dd33ea9ad1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:15.980102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c108b-c6e6-4332-81ae-dd33ea9ad1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:15.980876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c108b-c6e6-4332-81ae-dd33ea9ad1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:15.981041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.982500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c108b-c6e6-4332-81ae-dd33ea9ad1a3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:15.995253 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3324/6615] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:15:16.000850 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3292/6616] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:16.001923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:16.045619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86daf03-f787-4c72-8ce3-85c558da7906 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:16.060246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf9da6-a3fd-4e97-817a-9f69bd45f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:16.061298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf9da6-a3fd-4e97-817a-9f69bd45f3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:16.064767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf9da6-a3fd-4e97-817a-9f69bd45f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:16.065214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf9da6-a3fd-4e97-817a-9f69bd45f3b1 admin admin] PATH_INFO: `/v3/projects/be9b20bebfd2460e904335c7c42132fe/users/27b4efba9d2247da85a78f22570c1fcb/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:16.071217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf9da6-a3fd-4e97-817a-9f69bd45f3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9b20bebfd2460e904335c7c42132fe, user_id=27b4efba9d2247da85a78f22570c1fcb, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:16.077253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf9da6-a3fd-4e97-817a-9f69bd45f3b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:16.086409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c108b-c6e6-4332-81ae-dd33ea9ad1a3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:16.116363 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3325/6617] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:16 2022] PUT /identity/v3/projects/be9b20bebfd2460e904335c7c42132fe/users/27b4efba9d2247da85a78f22570c1fcb/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:16.116630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c108b-c6e6-4332-81ae-dd33ea9ad1a3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:16.123276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff30eb-0c47-44c4-b7b7-37e1815d83ef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:16.123669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff30eb-0c47-44c4-b7b7-37e1815d83ef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:16.124054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff30eb-0c47-44c4-b7b7-37e1815d83ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:16.165870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4eff30eb-0c47-44c4-b7b7-37e1815d83ef None None] MFA Rules not processed for user `27b4efba9d2247da85a78f22570c1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:16.167206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4eff30eb-0c47-44c4-b7b7-37e1815d83ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:16.254683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2953edb52195416da7496525a410927a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02d9465dd7504a7a9317fd19af8f61dd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:16.256593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:16.257479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:16.258118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] PATH_INFO: `/v3/projects/a528f560f1ff4e21805ac5bb68d6a42e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:16.260956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a528f560f1ff4e21805ac5bb68d6a42e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:16.265843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:16.371304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a528f560f1ff4e21805ac5bb68d6a42e', 'request_id': 'req-9e59de4e-8f15-487f-8001-9a1d03084648'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:16.379240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a528f560f1ff4e21805ac5bb68d6a42e', 'request_id': 'req-9e59de4e-8f15-487f-8001-9a1d03084648'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:16.397830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a528f560f1ff4e21805ac5bb68d6a42e', 'request_id': 'req-9e59de4e-8f15-487f-8001-9a1d03084648'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:16.404852 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3326/6618] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:16.411913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff30eb-0c47-44c4-b7b7-37e1815d83ef None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:16.423800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff30eb-0c47-44c4-b7b7-37e1815d83ef None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:16.429348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] The token cache is being invalidate because project a528f560f1ff4e21805ac5bb68d6a42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:16.429647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:16.432151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:16.436833 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3293/6619] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:16 2022] DELETE /identity/v3/projects/a528f560f1ff4e21805ac5bb68d6a42e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:16.542296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b4efba9d2247da85a78f22570c1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b20bebfd2460e904335c7c42132fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:16.543428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:16.547062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:16.547535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:16.548316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:16.552410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:16.611148 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3327/6620] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:16 2022] POST /identity/v3/projects => generated 360 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:16.612613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:16.617025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:16.651467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59de4e-8f15-487f-8001-9a1d03084648 tempest-VolumeQuotaClassesTest-310355599 tempest-VolumeQuotaClassesTest-310355599-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:16.802714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:16.802981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911820d7-f765-477a-840c-ec54df53c9c0 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b4efba9d2247da85a78f22570c1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b20bebfd2460e904335c7c42132fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:16.804043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911820d7-f765-477a-840c-ec54df53c9c0 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:16.804043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911820d7-f765-477a-840c-ec54df53c9c0 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:16.804272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911820d7-f765-477a-840c-ec54df53c9c0 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:16.804909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:16.805026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911820d7-f765-477a-840c-ec54df53c9c0 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:16.806957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911820d7-f765-477a-840c-ec54df53c9c0 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:16.839798 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3294/6621] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:16 2022] POST /identity/v3/users => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:16.844735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911820d7-f765-477a-840c-ec54df53c9c0 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:16.859999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911820d7-f765-477a-840c-ec54df53c9c0 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:16.866320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b4efba9d2247da85a78f22570c1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b20bebfd2460e904335c7c42132fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:16.867406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:16.868281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:16.868648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:16.869547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:16.870417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:16.873745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:16.928699 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3295/6622] 10.222.0.30 () {58 vars in 1156 bytes} [Sat Feb 19 21:15:16 2022] GET /identity/v3/users?domain_id=default => generated 7715 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:16.931881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:16.932999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06040-05c2-4592-8024-15044c5d7946 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:16.941206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:16.942828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:16.943313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:16.943791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] PATH_INFO: `/v3/users/58d5d98aeb214bd38ce193d7c3f82ac6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:16.945911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d5d98aeb214bd38ce193d7c3f82ac6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:16.950052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:16.964583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e7ceb-9270-46c8-b904-fc095829cd30 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:16.972195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b4efba9d2247da85a78f22570c1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b20bebfd2460e904335c7c42132fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:16.973316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:16.973709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:16.974798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] PATH_INFO: `/v3/users/4d1412c3d302444787ca06991de970f8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:17.000654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorizing `identity:update_user(user_id=4d1412c3d302444787ca06991de970f8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:17.002439 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:17.002439 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:15:17.002439 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:15:17.003774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:17.037993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d5d98aeb214bd38ce193d7c3f82ac6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.049687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4d1412c3d302444787ca06991de970f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.064080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invalidating the token cache because user 4d1412c3d302444787ca06991de970f8 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:17.065307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.065307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66b2bb2c-6f7a-4139-b8b7-c49e33591a9d tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.067863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3296/6623] 10.222.0.30 () {60 vars in 1243 bytes} [Sat Feb 19 21:15:16 2022] PATCH /identity/v3/users/4d1412c3d302444787ca06991de970f8 => generated 485 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:17.072979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91cc34-731d-467e-a64c-a2fd460e1602 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:17.073271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91cc34-731d-467e-a64c-a2fd460e1602 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:17.073552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91cc34-731d-467e-a64c-a2fd460e1602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:17.082374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d5d98aeb214bd38ce193d7c3f82ac6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.099498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d5d98aeb214bd38ce193d7c3f82ac6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.099872 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.auth.plugins.core [None req-2a91cc34-731d-467e-a64c-a2fd460e1602 None None] User is disabled: 4d1412c3d302444787ca06991de970f8: AssertionError: User is disabled: 4d1412c3d302444787ca06991de970f8 Feb 19 21:15:17.101190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d5d98aeb214bd38ce193d7c3f82ac6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.101977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2f492eef-ef21-4a9f-ac2a-f341c8f8d720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d5d98aeb214bd38ce193d7c3f82ac6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.120309 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-2a91cc34-731d-467e-a64c-a2fd460e1602 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Feb 19 21:15:17.123077 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3297/6624] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:17 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 51 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Feb 19 21:15:17.127016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91cc34-731d-467e-a64c-a2fd460e1602 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:17.131252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a91cc34-731d-467e-a64c-a2fd460e1602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:17.157734 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3328/6625] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:16 2022] DELETE /identity/v3/users/58d5d98aeb214bd38ce193d7c3f82ac6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:17.162407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fc44-7564-485a-bf63-095823ba6f13 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:17.162773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fc44-7564-485a-bf63-095823ba6f13 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:17.163054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fc44-7564-485a-bf63-095823ba6f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:17.203076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4307fc44-7564-485a-bf63-095823ba6f13 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:17.204371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4307fc44-7564-485a-bf63-095823ba6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:17.289019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91cc34-731d-467e-a64c-a2fd460e1602 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:17.296682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b4efba9d2247da85a78f22570c1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b20bebfd2460e904335c7c42132fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:17.298695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:17.299180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:17.299659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] PATH_INFO: `/v3/users/4d1412c3d302444787ca06991de970f8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:17.330010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4d1412c3d302444787ca06991de970f8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:17.334471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:17.347207 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3329/6626] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:17.366025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307fc44-7564-485a-bf63-095823ba6f13 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:17.369072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4307fc44-7564-485a-bf63-095823ba6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:17.446678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1412c3d302444787ca06991de970f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.447820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1412c3d302444787ca06991de970f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.448878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1412c3d302444787ca06991de970f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.489391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1412c3d302444787ca06991de970f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.511413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1412c3d302444787ca06991de970f8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.522561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307fc44-7564-485a-bf63-095823ba6f13 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:17.530245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:17.531850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:17.532263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:17.532768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:17.533656 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3298/6627] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:17 2022] DELETE /identity/v3/users/4d1412c3d302444787ca06991de970f8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:17.534930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:17.536056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:17.537295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:17.558742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:17.562321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:17.588315 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3330/6628] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:17.694800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f351829-3229-41d2-8b07-3fd7dde219b3 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:17.741685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b4efba9d2247da85a78f22570c1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b20bebfd2460e904335c7c42132fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:17.744214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:17.746808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:17.747796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] PATH_INFO: `/v3/projects/0a07a2f82aa0418a84decb4b2ef19c48` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:17.752252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a07a2f82aa0418a84decb4b2ef19c48)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:17.757885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:17.840923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a07a2f82aa0418a84decb4b2ef19c48', 'request_id': 'req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.850215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a07a2f82aa0418a84decb4b2ef19c48', 'request_id': 'req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.870274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a07a2f82aa0418a84decb4b2ef19c48', 'request_id': 'req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.900318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] The token cache is being invalidate because project 0a07a2f82aa0418a84decb4b2ef19c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:17.901152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.902029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:17.904823 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3299/6629] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:17 2022] DELETE /identity/v3/projects/0a07a2f82aa0418a84decb4b2ef19c48 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:17.910610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:17.940035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6251a-2a6d-4dae-8b30-d6b8359015cd service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:18.066954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b4efba9d2247da85a78f22570c1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b20bebfd2460e904335c7c42132fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:18.068429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:18.069175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:18.069717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:18.070953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:18.076569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:18.101603 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Could not find domain: d607f80e9c684c2f8af707ac0878cd9d.: keystone.exception.DomainNotFound: Could not find domain: d607f80e9c684c2f8af707ac0878cd9d. Feb 19 21:15:18.105116 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3331/6630] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:17 2022] POST /identity/v3/users => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:15:18.111367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:18.113760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:18.208068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:18.211373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:18.240232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d2f6d-e79e-4b80-849a-f59c7a8b9a64 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:18.245878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:18.246906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:18.247201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:18.247483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] PATH_INFO: `/v3/users/f7857feb584f4ddb91736d7fc6c99c76` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:18.248773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7857feb584f4ddb91736d7fc6c99c76)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:18.251975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:18.354117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7857feb584f4ddb91736d7fc6c99c76'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.356456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7857feb584f4ddb91736d7fc6c99c76'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.357306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7857feb584f4ddb91736d7fc6c99c76'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.379671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e4f06-36a3-455a-b424-840b94849c71 tempest-UsersNegativeTest-1205887092 tempest-UsersNegativeTest-1205887092-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:18.391492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:18.392995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:18.393276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:18.393562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] PATH_INFO: `/v3/projects/545bf459f4a445c289d13de55cf2c4eb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:18.393881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7857feb584f4ddb91736d7fc6c99c76'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.394976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=545bf459f4a445c289d13de55cf2c4eb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:18.397738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:18.414509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3096a071-8ed5-4641-aa1e-9c42174698f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7857feb584f4ddb91736d7fc6c99c76'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.455750 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3300/6631] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:18 2022] DELETE /identity/v3/users/f7857feb584f4ddb91736d7fc6c99c76 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:18.464524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81877fa-b0dc-4cf2-9ffd-f390a9610dbf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:18.465323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81877fa-b0dc-4cf2-9ffd-f390a9610dbf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:18.469053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81877fa-b0dc-4cf2-9ffd-f390a9610dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:18.535726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b81877fa-b0dc-4cf2-9ffd-f390a9610dbf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:18.541159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b81877fa-b0dc-4cf2-9ffd-f390a9610dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:18.542311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545bf459f4a445c289d13de55cf2c4eb', 'request_id': 'req-9b338ce5-13b5-4793-9969-2fa00a32ba9c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.566986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545bf459f4a445c289d13de55cf2c4eb', 'request_id': 'req-9b338ce5-13b5-4793-9969-2fa00a32ba9c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.606729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545bf459f4a445c289d13de55cf2c4eb', 'request_id': 'req-9b338ce5-13b5-4793-9969-2fa00a32ba9c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.622936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] The token cache is being invalidate because project 545bf459f4a445c289d13de55cf2c4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:18.623353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.629854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.644200 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3332/6632] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:18 2022] DELETE /identity/v3/projects/545bf459f4a445c289d13de55cf2c4eb => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:18.646070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:18.646911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:18.721672 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3301/6633] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:18.755175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81877fa-b0dc-4cf2-9ffd-f390a9610dbf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:18.756783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b81877fa-b0dc-4cf2-9ffd-f390a9610dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:18.809034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b338ce5-13b5-4793-9969-2fa00a32ba9c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:18.825201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:18.826274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:18.826585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:18.827954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] PATH_INFO: `/v3/users/2953edb52195416da7496525a410927a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:18.831941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2953edb52195416da7496525a410927a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:18.834202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:18.875167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81877fa-b0dc-4cf2-9ffd-f390a9610dbf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:18.881405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ec037-9e12-44b9-ad1a-0c1feb572545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:18.883378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ec037-9e12-44b9-ad1a-0c1feb572545 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:18.883821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ec037-9e12-44b9-ad1a-0c1feb572545 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:18.885114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ec037-9e12-44b9-ad1a-0c1feb572545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:18.908322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ec037-9e12-44b9-ad1a-0c1feb572545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:18.910015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ec037-9e12-44b9-ad1a-0c1feb572545 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:18.925381 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3302/6634] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:18.943251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2953edb52195416da7496525a410927a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.963627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2953edb52195416da7496525a410927a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.974788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2953edb52195416da7496525a410927a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.975729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2953edb52195416da7496525a410927a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.977420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2953edb52195416da7496525a410927a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:18.996128 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3333/6635] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:18 2022] DELETE /identity/v3/users/2953edb52195416da7496525a410927a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:19.892053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ec037-9e12-44b9-ad1a-0c1feb572545 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:19.917643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ec037-9e12-44b9-ad1a-0c1feb572545 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:19.926677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:19.929137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:20.074514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.075659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.076040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.076437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] PATH_INFO: `/v3/projects/02d9465dd7504a7a9317fd19af8f61dd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.079921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d9465dd7504a7a9317fd19af8f61dd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:20.083971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:20.121446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f984b-70a1-4f16-8f8b-33b887495bf7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:20.129998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.131512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.132037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.132598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] PATH_INFO: `/v3/projects/3abc3163ed05468aa27630c0271482e5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.134864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abc3163ed05468aa27630c0271482e5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:20.138758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:20.160183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d9465dd7504a7a9317fd19af8f61dd', 'request_id': 'req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.166096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d9465dd7504a7a9317fd19af8f61dd', 'request_id': 'req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.176215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d9465dd7504a7a9317fd19af8f61dd', 'request_id': 'req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.191835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] The token cache is being invalidate because project 02d9465dd7504a7a9317fd19af8f61dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:20.192204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.193491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a9b7371-44e7-42e5-8e90-de8408ee9e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.197034 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3303/6636] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:19 2022] DELETE /identity/v3/projects/02d9465dd7504a7a9317fd19af8f61dd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:20.206133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ee2d6-a002-44c2-bd7c-f5ea6371464d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.206395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ee2d6-a002-44c2-bd7c-f5ea6371464d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.206567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ee2d6-a002-44c2-bd7c-f5ea6371464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.231607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-906ee2d6-a002-44c2-bd7c-f5ea6371464d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:20.234018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-906ee2d6-a002-44c2-bd7c-f5ea6371464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:20.241826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abc3163ed05468aa27630c0271482e5', 'request_id': 'req-4b944cd0-8981-42b4-8228-e54d2d30c56c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.252459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abc3163ed05468aa27630c0271482e5', 'request_id': 'req-4b944cd0-8981-42b4-8228-e54d2d30c56c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.266867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abc3163ed05468aa27630c0271482e5', 'request_id': 'req-4b944cd0-8981-42b4-8228-e54d2d30c56c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.308633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] The token cache is being invalidate because project 3abc3163ed05468aa27630c0271482e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:20.308633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.308633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.308633 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3334/6637] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:19 2022] DELETE /identity/v3/projects/3abc3163ed05468aa27630c0271482e5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:20.314584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:20.316089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:20.389191 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3304/6638] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:20.398115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb50c5b-d043-4af5-8409-fe3a1c068a92 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.398987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb50c5b-d043-4af5-8409-fe3a1c068a92 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.399374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb50c5b-d043-4af5-8409-fe3a1c068a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.428002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ddb50c5b-d043-4af5-8409-fe3a1c068a92 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:20.430690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ddb50c5b-d043-4af5-8409-fe3a1c068a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:20.445205 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3305/6639] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:20.450694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb50c5b-d043-4af5-8409-fe3a1c068a92 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:20.462088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb50c5b-d043-4af5-8409-fe3a1c068a92 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:20.462515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944cd0-8981-42b4-8228-e54d2d30c56c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:20.467954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.468825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.469222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.469503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.470239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:20.470544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:20.472193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.473073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:20.473505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.473887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.474418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] PATH_INFO: `/v3/users/27b4efba9d2247da85a78f22570c1fcb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.477232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b4efba9d2247da85a78f22570c1fcb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:20.480360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:20.516377 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3306/6640] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:15:20.523045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:20.541398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0e5ec-26fc-423b-87a7-afdc23a773b9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:20.551186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c48532-67f4-4f9b-bb13-ac1f4b515313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.553278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c48532-67f4-4f9b-bb13-ac1f4b515313 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.554049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c48532-67f4-4f9b-bb13-ac1f4b515313 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.554595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c48532-67f4-4f9b-bb13-ac1f4b515313 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.555842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c48532-67f4-4f9b-bb13-ac1f4b515313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:20.559330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c48532-67f4-4f9b-bb13-ac1f4b515313 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:20.574064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b4efba9d2247da85a78f22570c1fcb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.593029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b4efba9d2247da85a78f22570c1fcb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.605457 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3307/6641] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:20 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:20.610475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c48532-67f4-4f9b-bb13-ac1f4b515313 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:20.611295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b4efba9d2247da85a78f22570c1fcb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.612273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b4efba9d2247da85a78f22570c1fcb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.612993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b4efba9d2247da85a78f22570c1fcb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:20.629253 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3335/6642] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:20 2022] DELETE /identity/v3/users/27b4efba9d2247da85a78f22570c1fcb => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:20.726955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c48532-67f4-4f9b-bb13-ac1f4b515313 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:20.801704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d5bb-72ed-49d1-bef0-7a5d00198dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.802957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d5bb-72ed-49d1-bef0-7a5d00198dbd admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.803626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d5bb-72ed-49d1-bef0-7a5d00198dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.804153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d5bb-72ed-49d1-bef0-7a5d00198dbd admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.805797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1d5bb-72ed-49d1-bef0-7a5d00198dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:20.809572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1d5bb-72ed-49d1-bef0-7a5d00198dbd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:20.843911 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3308/6643] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:20 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:20.849089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:20.850844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:20.866895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e338dd-4c69-432f-adcf-4de284aec09a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:20.872584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe1e42-17dd-4841-b110-d946d16065ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.873418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe1e42-17dd-4841-b110-d946d16065ea admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.873812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe1e42-17dd-4841-b110-d946d16065ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.875458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe1e42-17dd-4841-b110-d946d16065ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.876323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe1e42-17dd-4841-b110-d946d16065ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:20.878394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe1e42-17dd-4841-b110-d946d16065ea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:20.900880 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3336/6644] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:15:20.904685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d5bb-72ed-49d1-bef0-7a5d00198dbd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:20.923031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d5bb-72ed-49d1-bef0-7a5d00198dbd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:20.930955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10643-7af4-4396-bbf2-069734ed4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.932134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10643-7af4-4396-bbf2-069734ed4190 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.932728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10643-7af4-4396-bbf2-069734ed4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.933293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10643-7af4-4396-bbf2-069734ed4190 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:20.934535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10643-7af4-4396-bbf2-069734ed4190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:20.937873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10643-7af4-4396-bbf2-069734ed4190 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:20.957104 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3309/6645] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:20.961644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe1e42-17dd-4841-b110-d946d16065ea admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:20.978108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe1e42-17dd-4841-b110-d946d16065ea admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:20.989613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc111ef-ec52-4e03-a1d9-9da5c1cd3179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:20.989613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc111ef-ec52-4e03-a1d9-9da5c1cd3179 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:20.989613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc111ef-ec52-4e03-a1d9-9da5c1cd3179 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:20.989613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc111ef-ec52-4e03-a1d9-9da5c1cd3179 admin admin] PATH_INFO: `/v3/projects/f9780e37cefb40688394abf1793095b8/users/5a8ad5662e6148538fe3905314b9dc62/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:21.019908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc111ef-ec52-4e03-a1d9-9da5c1cd3179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9780e37cefb40688394abf1793095b8, user_id=5a8ad5662e6148538fe3905314b9dc62, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:21.025048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc111ef-ec52-4e03-a1d9-9da5c1cd3179 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:21.055348 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3337/6646] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:20 2022] PUT /identity/v3/projects/f9780e37cefb40688394abf1793095b8/users/5a8ad5662e6148538fe3905314b9dc62/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:21.070981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024b17-22bc-4b70-8afe-36d1e634ead1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:21.071667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024b17-22bc-4b70-8afe-36d1e634ead1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:21.072126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024b17-22bc-4b70-8afe-36d1e634ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:21.123630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fa024b17-22bc-4b70-8afe-36d1e634ead1 None None] MFA Rules not processed for user `5a8ad5662e6148538fe3905314b9dc62`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:21.126107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa024b17-22bc-4b70-8afe-36d1e634ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:21.254839 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3310/6647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:21.261427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc111ef-ec52-4e03-a1d9-9da5c1cd3179 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:21.327890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa024b17-22bc-4b70-8afe-36d1e634ead1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:21.334300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa024b17-22bc-4b70-8afe-36d1e634ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:21.474157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc111ef-ec52-4e03-a1d9-9da5c1cd3179 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:21.485272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6b55-03d7-452f-9031-b71a56a344cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:21.486068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6b55-03d7-452f-9031-b71a56a344cd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:21.486574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6b55-03d7-452f-9031-b71a56a344cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:21.487147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6b55-03d7-452f-9031-b71a56a344cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:21.488085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a6b55-03d7-452f-9031-b71a56a344cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:21.492473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a6b55-03d7-452f-9031-b71a56a344cd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:21.547999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa024b17-22bc-4b70-8afe-36d1e634ead1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:21.560032 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3338/6648] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:21 2022] POST /identity/v3/projects => generated 393 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:21.563341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:21.564317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:21.565053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:21.565435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] PATH_INFO: `/v3/projects/be9b20bebfd2460e904335c7c42132fe` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:21.567057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6b55-03d7-452f-9031-b71a56a344cd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:21.569816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9b20bebfd2460e904335c7c42132fe)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:21.572494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:21.684247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6b55-03d7-452f-9031-b71a56a344cd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:21.708749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9b20bebfd2460e904335c7c42132fe', 'request_id': 'req-30642f75-e270-42a6-8302-8967fe20b9fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:21.724130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9b20bebfd2460e904335c7c42132fe', 'request_id': 'req-30642f75-e270-42a6-8302-8967fe20b9fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:21.754723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9b20bebfd2460e904335c7c42132fe', 'request_id': 'req-30642f75-e270-42a6-8302-8967fe20b9fb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:21.779245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] The token cache is being invalidate because project be9b20bebfd2460e904335c7c42132fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:21.779716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:21.780571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30642f75-e270-42a6-8302-8967fe20b9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:21.785989 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3311/6649] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:21 2022] DELETE /identity/v3/projects/be9b20bebfd2460e904335c7c42132fe => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:21.791594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23779b2-9a0c-4bed-b592-1ddfe88f3918 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:21.792105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23779b2-9a0c-4bed-b592-1ddfe88f3918 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:21.792452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23779b2-9a0c-4bed-b592-1ddfe88f3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:21.843629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:21.844819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:21.845700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:21.846732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:21.849362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:21.855300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:21.907268 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3339/6650] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:21 2022] POST /identity/v3/users => generated 303 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:21.912433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:21.917421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b23779b2-9a0c-4bed-b592-1ddfe88f3918 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:21.920509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:21.921620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b23779b2-9a0c-4bed-b592-1ddfe88f3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:21.937417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a115589-0162-4802-891f-0d6f61c6eb4f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:21.940834 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3312/6651] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:21.950220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d46f4a-3100-4e3d-8895-c7d73aa16322 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:21.950983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d46f4a-3100-4e3d-8895-c7d73aa16322 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:21.951796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d46f4a-3100-4e3d-8895-c7d73aa16322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:21.957020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf20f-59e5-4c5e-aec4-3c5c675028ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:21.957722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf20f-59e5-4c5e-aec4-3c5c675028ee admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:21.958004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf20f-59e5-4c5e-aec4-3c5c675028ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:21.958282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf20f-59e5-4c5e-aec4-3c5c675028ee admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:21.959056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf20f-59e5-4c5e-aec4-3c5c675028ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:21.961695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf20f-59e5-4c5e-aec4-3c5c675028ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:21.992444 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3340/6652] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:21.997944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf20f-59e5-4c5e-aec4-3c5c675028ee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.021482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf20f-59e5-4c5e-aec4-3c5c675028ee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.024745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-14d46f4a-3100-4e3d-8895-c7d73aa16322 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:22.027478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-14d46f4a-3100-4e3d-8895-c7d73aa16322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:22.033919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac89934-1aef-4fc8-8705-d60e345cf4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.034841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89934-1aef-4fc8-8705-d60e345cf4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.035124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89934-1aef-4fc8-8705-d60e345cf4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.035402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89934-1aef-4fc8-8705-d60e345cf4c3 admin admin] PATH_INFO: `/v3/projects/6f6a906556254a72b4f4d311378e5a26/users/a599c2f505c74fb0920f041a19713e6d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.054129 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3313/6653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:22.058371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d46f4a-3100-4e3d-8895-c7d73aa16322 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.079071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac89934-1aef-4fc8-8705-d60e345cf4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6a906556254a72b4f4d311378e5a26, user_id=a599c2f505c74fb0920f041a19713e6d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.083293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d46f4a-3100-4e3d-8895-c7d73aa16322 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.085598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac89934-1aef-4fc8-8705-d60e345cf4c3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.093931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.094782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.095063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.095338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.096198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:22.096575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.098967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.110439 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3341/6654] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:21 2022] PUT /identity/v3/projects/6f6a906556254a72b4f4d311378e5a26/users/a599c2f505c74fb0920f041a19713e6d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:22.115408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac89934-1aef-4fc8-8705-d60e345cf4c3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.134909 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3314/6655] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:22.136183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.160431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc970-df7a-4660-8437-96442fcae575 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.270402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac89934-1aef-4fc8-8705-d60e345cf4c3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.288642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f00813-3041-4252-b7e1-b6c8122ee1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.291440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00813-3041-4252-b7e1-b6c8122ee1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.292155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00813-3041-4252-b7e1-b6c8122ee1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.292670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00813-3041-4252-b7e1-b6c8122ee1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.293905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f00813-3041-4252-b7e1-b6c8122ee1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.298012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f00813-3041-4252-b7e1-b6c8122ee1b0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.317055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f1af3-b5f6-44b8-9bc3-a22fb559bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.319664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f1af3-b5f6-44b8-9bc3-a22fb559bdfb admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.320018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f1af3-b5f6-44b8-9bc3-a22fb559bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.321006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f1af3-b5f6-44b8-9bc3-a22fb559bdfb admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.321925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f1af3-b5f6-44b8-9bc3-a22fb559bdfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.330460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f1af3-b5f6-44b8-9bc3-a22fb559bdfb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.334136 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3342/6656] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:22.338807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f00813-3041-4252-b7e1-b6c8122ee1b0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.358786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f00813-3041-4252-b7e1-b6c8122ee1b0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.370210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56bb30-efa1-41d3-a47c-85a550fe121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.371379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb30-efa1-41d3-a47c-85a550fe121d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.371622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb30-efa1-41d3-a47c-85a550fe121d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.372667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb30-efa1-41d3-a47c-85a550fe121d admin admin] PATH_INFO: `/v3/projects/6f6a906556254a72b4f4d311378e5a26/users/a599c2f505c74fb0920f041a19713e6d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.374662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56bb30-efa1-41d3-a47c-85a550fe121d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6a906556254a72b4f4d311378e5a26, user_id=a599c2f505c74fb0920f041a19713e6d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.381573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56bb30-efa1-41d3-a47c-85a550fe121d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.402464 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3315/6657] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:22 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:22.410871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f1af3-b5f6-44b8-9bc3-a22fb559bdfb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.411784 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3343/6658] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:22 2022] PUT /identity/v3/projects/6f6a906556254a72b4f4d311378e5a26/users/a599c2f505c74fb0920f041a19713e6d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:22.429787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258ef2-4e54-4170-9374-55324cf05b13 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.430098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258ef2-4e54-4170-9374-55324cf05b13 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.430517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258ef2-4e54-4170-9374-55324cf05b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.499721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b1258ef2-4e54-4170-9374-55324cf05b13 None None] MFA Rules not processed for user `a599c2f505c74fb0920f041a19713e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:22.499930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b1258ef2-4e54-4170-9374-55324cf05b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:22.596658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f1af3-b5f6-44b8-9bc3-a22fb559bdfb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.605788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f855-28b1-426e-940f-f9e7b9742475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.608184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f855-28b1-426e-940f-f9e7b9742475 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.608881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f855-28b1-426e-940f-f9e7b9742475 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.609492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f855-28b1-426e-940f-f9e7b9742475 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.610873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441f855-28b1-426e-940f-f9e7b9742475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.616264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441f855-28b1-426e-940f-f9e7b9742475 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.703657 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3316/6659] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:22 2022] POST /identity/v3/users => generated 288 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:22.703657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f855-28b1-426e-940f-f9e7b9742475 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.726951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f855-28b1-426e-940f-f9e7b9742475 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.737485 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3344/6660] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:22.739061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1258ef2-4e54-4170-9374-55324cf05b13 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.741498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b1258ef2-4e54-4170-9374-55324cf05b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:22.746860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91e98f-2fa9-421f-8e12-65a1c6ce67a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.747653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91e98f-2fa9-421f-8e12-65a1c6ce67a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.748068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91e98f-2fa9-421f-8e12-65a1c6ce67a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.748540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91e98f-2fa9-421f-8e12-65a1c6ce67a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.749331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91e98f-2fa9-421f-8e12-65a1c6ce67a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.751277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91e98f-2fa9-421f-8e12-65a1c6ce67a3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.782559 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3317/6661] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:15:22.789350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91e98f-2fa9-421f-8e12-65a1c6ce67a3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.808643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91e98f-2fa9-421f-8e12-65a1c6ce67a3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.822918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56cc04-f962-48c7-84c3-848bb2942949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.823648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56cc04-f962-48c7-84c3-848bb2942949 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.823937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56cc04-f962-48c7-84c3-848bb2942949 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.824213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56cc04-f962-48c7-84c3-848bb2942949 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.825213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56cc04-f962-48c7-84c3-848bb2942949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.829847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56cc04-f962-48c7-84c3-848bb2942949 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.859884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1258ef2-4e54-4170-9374-55324cf05b13 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.860970 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3318/6662] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:22.866546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56cc04-f962-48c7-84c3-848bb2942949 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.869383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.870061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.870512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.871986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.881716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56cc04-f962-48c7-84c3-848bb2942949 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.889778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.892466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.895113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dc470-f608-428f-a492-a07e62248e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:22.896014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dc470-f608-428f-a492-a07e62248e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.896296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dc470-f608-428f-a492-a07e62248e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.896598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dc470-f608-428f-a492-a07e62248e25 admin admin] PATH_INFO: `/v3/projects/23cce192745a43c98a8df27b64943d2e/users/8d24b4f573114156b6978f00c295583c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:22.923083 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3345/6663] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:22.929549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dc470-f608-428f-a492-a07e62248e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cce192745a43c98a8df27b64943d2e, user_id=8d24b4f573114156b6978f00c295583c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:22.933140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dc470-f608-428f-a492-a07e62248e25 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:22.971418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:22.973030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:22.974761 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3319/6664] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:22 2022] PUT /identity/v3/projects/23cce192745a43c98a8df27b64943d2e/users/8d24b4f573114156b6978f00c295583c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:22.988347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd2fa0-4570-4d44-b3f1-97855614b848 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:22.996453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4ea5d-3d6d-4e07-ad05-1c68009e42e3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:22.997847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4ea5d-3d6d-4e07-ad05-1c68009e42e3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:22.999654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4ea5d-3d6d-4e07-ad05-1c68009e42e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:23.083574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6cf4ea5d-3d6d-4e07-ad05-1c68009e42e3 None None] MFA Rules not processed for user `8d24b4f573114156b6978f00c295583c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:23.085200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6cf4ea5d-3d6d-4e07-ad05-1c68009e42e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:23.101339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:23.106365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:23.106700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:23.107037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:23.111692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:23.259542 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3320/6665] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:23.265830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4ea5d-3d6d-4e07-ad05-1c68009e42e3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:23.277197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:23.277446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4ea5d-3d6d-4e07-ad05-1c68009e42e3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:23.279176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:23.285900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a7716-35e1-466e-bdb6-bff1dd4e1548 tempest-IdentityCatalogTest-1492490215 tempest-IdentityCatalogTest-1492490215-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d24b4f573114156b6978f00c295583c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23cce192745a43c98a8df27b64943d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:23.286758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a7716-35e1-466e-bdb6-bff1dd4e1548 tempest-IdentityCatalogTest-1492490215 tempest-IdentityCatalogTest-1492490215-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:23.287053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a7716-35e1-466e-bdb6-bff1dd4e1548 tempest-IdentityCatalogTest-1492490215 tempest-IdentityCatalogTest-1492490215-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:23.288136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a7716-35e1-466e-bdb6-bff1dd4e1548 tempest-IdentityCatalogTest-1492490215 tempest-IdentityCatalogTest-1492490215-project] PATH_INFO: `/v3/auth/catalog` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:23.288851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a7716-35e1-466e-bdb6-bff1dd4e1548 tempest-IdentityCatalogTest-1492490215 tempest-IdentityCatalogTest-1492490215-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:23.289948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a7716-35e1-466e-bdb6-bff1dd4e1548 tempest-IdentityCatalogTest-1492490215 tempest-IdentityCatalogTest-1492490215-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:23.292573 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3346/6666] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:23.303976 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3321/6667] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 21:15:23 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:23.305216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:23.425153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e537f7e-3a61-4728-b79f-f52ede12016a service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:23.435325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:23.440847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:23.441143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:23.441506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] PATH_INFO: `/v3/users/8d24b4f573114156b6978f00c295583c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:23.448509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d24b4f573114156b6978f00c295583c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:23.454443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:23.543836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d24b4f573114156b6978f00c295583c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:23.573549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d24b4f573114156b6978f00c295583c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:23.591386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d24b4f573114156b6978f00c295583c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:23.593380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d24b4f573114156b6978f00c295583c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:23.594853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d24b4f573114156b6978f00c295583c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:23.651393 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3347/6668] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:23 2022] DELETE /identity/v3/users/8d24b4f573114156b6978f00c295583c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:23.657807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2bae3-2ab5-47e0-aa5b-a8d68e169275 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:23.658686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2bae3-2ab5-47e0-aa5b-a8d68e169275 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:23.658686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2bae3-2ab5-47e0-aa5b-a8d68e169275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:23.685516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-03b2bae3-2ab5-47e0-aa5b-a8d68e169275 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:23.687990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-03b2bae3-2ab5-47e0-aa5b-a8d68e169275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:23.867378 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3322/6669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:23.882757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:23.884178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:24.005722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeb64d-3a32-411c-b8e1-781bddf3e45d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:24.011326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e583b-6702-4b28-9c28-d17d93e251ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:24.012248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e583b-6702-4b28-9c28-d17d93e251ea service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:24.012662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e583b-6702-4b28-9c28-d17d93e251ea service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:24.013042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e583b-6702-4b28-9c28-d17d93e251ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:24.023838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e583b-6702-4b28-9c28-d17d93e251ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:24.025403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e583b-6702-4b28-9c28-d17d93e251ea service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:24.040074 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3348/6670] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:24.655004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2bae3-2ab5-47e0-aa5b-a8d68e169275 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:24.657325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-03b2bae3-2ab5-47e0-aa5b-a8d68e169275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:24.670734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2bae3-2ab5-47e0-aa5b-a8d68e169275 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:24.676596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:24.677693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:24.678152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:24.678585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] PATH_INFO: `/v3/projects/23cce192745a43c98a8df27b64943d2e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:24.680000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23cce192745a43c98a8df27b64943d2e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:24.682454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:24.753526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23cce192745a43c98a8df27b64943d2e', 'request_id': 'req-a665120c-8c0d-484f-b751-a731d1be8d6a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:24.760454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23cce192745a43c98a8df27b64943d2e', 'request_id': 'req-a665120c-8c0d-484f-b751-a731d1be8d6a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:24.774530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23cce192745a43c98a8df27b64943d2e', 'request_id': 'req-a665120c-8c0d-484f-b751-a731d1be8d6a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:24.790261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] The token cache is being invalidate because project 23cce192745a43c98a8df27b64943d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:24.790662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:24.791334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a665120c-8c0d-484f-b751-a731d1be8d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:24.798747 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3323/6671] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:24 2022] DELETE /identity/v3/projects/23cce192745a43c98a8df27b64943d2e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:24.801449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a1cfa-a312-4e5a-9bd8-cfcf9c633773 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:24.804031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a1cfa-a312-4e5a-9bd8-cfcf9c633773 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:24.804819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a1cfa-a312-4e5a-9bd8-cfcf9c633773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:24.915714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-278a1cfa-a312-4e5a-9bd8-cfcf9c633773 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:24.920704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-278a1cfa-a312-4e5a-9bd8-cfcf9c633773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:25.193218 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3349/6672] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:25.203700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e22bb-0c04-4077-97ff-318b8907a881 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:25.204963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e22bb-0c04-4077-97ff-318b8907a881 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:25.204963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e22bb-0c04-4077-97ff-318b8907a881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:25.269544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-496e22bb-0c04-4077-97ff-318b8907a881 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:25.274307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-496e22bb-0c04-4077-97ff-318b8907a881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:25.293024 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3324/6673] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:25.298065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a1cfa-a312-4e5a-9bd8-cfcf9c633773 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:25.322654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a1cfa-a312-4e5a-9bd8-cfcf9c633773 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:25.332861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:25.335153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:25.336187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:25.337249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:25.339029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:25.340863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:25.346272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:25.390505 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3350/6674] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:25.395909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e22bb-0c04-4077-97ff-318b8907a881 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:25.417459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e22bb-0c04-4077-97ff-318b8907a881 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:25.442272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599609-364c-4a31-ab74-c488134ddf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:25.443473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599609-364c-4a31-ab74-c488134ddf6b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:25.443942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599609-364c-4a31-ab74-c488134ddf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:25.444443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599609-364c-4a31-ab74-c488134ddf6b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:25.445367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b599609-364c-4a31-ab74-c488134ddf6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:25.448283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b599609-364c-4a31-ab74-c488134ddf6b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:25.503205 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3325/6675] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:25 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:25.507368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:25.521447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6b800-2994-468b-b6e8-f1be4c192315 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:25.612626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02953d6f-d2b0-4170-b706-2162db0d8abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:25.613714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953d6f-d2b0-4170-b706-2162db0d8abe admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:25.614193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953d6f-d2b0-4170-b706-2162db0d8abe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:25.614757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953d6f-d2b0-4170-b706-2162db0d8abe admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:25.616101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02953d6f-d2b0-4170-b706-2162db0d8abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:25.618705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02953d6f-d2b0-4170-b706-2162db0d8abe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:25.650286 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3351/6676] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:25 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:25.652527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599609-364c-4a31-ab74-c488134ddf6b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:25.682210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599609-364c-4a31-ab74-c488134ddf6b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:25.691754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41785108-c6fa-4f6e-8cfd-d9a9525cfe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:25.693291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785108-c6fa-4f6e-8cfd-d9a9525cfe1f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:25.693558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785108-c6fa-4f6e-8cfd-d9a9525cfe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:25.694208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785108-c6fa-4f6e-8cfd-d9a9525cfe1f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:25.704791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41785108-c6fa-4f6e-8cfd-d9a9525cfe1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:25.707998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41785108-c6fa-4f6e-8cfd-d9a9525cfe1f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:25.746492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3326/6677] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:25.750986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02953d6f-d2b0-4170-b706-2162db0d8abe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:25.762430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02953d6f-d2b0-4170-b706-2162db0d8abe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:25.767579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ff0a5-dd01-4788-b9b2-6f1c6413948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:25.768255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ff0a5-dd01-4788-b9b2-6f1c6413948a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:25.768622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ff0a5-dd01-4788-b9b2-6f1c6413948a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:25.768981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ff0a5-dd01-4788-b9b2-6f1c6413948a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:25.769624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ff0a5-dd01-4788-b9b2-6f1c6413948a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:25.771566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ff0a5-dd01-4788-b9b2-6f1c6413948a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:25.806972 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3352/6678] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:15:25.808796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41785108-c6fa-4f6e-8cfd-d9a9525cfe1f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:25.837975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41785108-c6fa-4f6e-8cfd-d9a9525cfe1f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:25.862468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e61b-df81-4a85-a242-49f66476655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:25.864078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e61b-df81-4a85-a242-49f66476655d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:25.864624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e61b-df81-4a85-a242-49f66476655d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:25.865142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e61b-df81-4a85-a242-49f66476655d admin admin] PATH_INFO: `/v3/projects/1163087e58fb4b42adb9cb92d103d048/users/0980c9c53b624dd99d2a0c37de9d91c4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:25.923923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528e61b-df81-4a85-a242-49f66476655d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1163087e58fb4b42adb9cb92d103d048, user_id=0980c9c53b624dd99d2a0c37de9d91c4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:25.929810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528e61b-df81-4a85-a242-49f66476655d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:25.980847 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3327/6679] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:25 2022] PUT /identity/v3/projects/1163087e58fb4b42adb9cb92d103d048/users/0980c9c53b624dd99d2a0c37de9d91c4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:26.003806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40e6e-fc51-4e22-87ba-ba605659e30c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:26.004145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40e6e-fc51-4e22-87ba-ba605659e30c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:26.004432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40e6e-fc51-4e22-87ba-ba605659e30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:26.058857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8bd40e6e-fc51-4e22-87ba-ba605659e30c None None] MFA Rules not processed for user `0980c9c53b624dd99d2a0c37de9d91c4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:26.058857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8bd40e6e-fc51-4e22-87ba-ba605659e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:26.229043 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3353/6680] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:26.235472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e61b-df81-4a85-a242-49f66476655d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:26.361204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40e6e-fc51-4e22-87ba-ba605659e30c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:26.364788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8bd40e6e-fc51-4e22-87ba-ba605659e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:26.417107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e61b-df81-4a85-a242-49f66476655d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:26.438605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315330a-d6fb-4eaf-92da-fbd8973dbdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:26.439892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315330a-d6fb-4eaf-92da-fbd8973dbdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:26.446750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315330a-d6fb-4eaf-92da-fbd8973dbdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:26.447325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315330a-d6fb-4eaf-92da-fbd8973dbdd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:26.448616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315330a-d6fb-4eaf-92da-fbd8973dbdd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:26.458283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315330a-d6fb-4eaf-92da-fbd8973dbdd1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:26.528090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40e6e-fc51-4e22-87ba-ba605659e30c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:26.533662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:26.533917 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3328/6681] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:26 2022] POST /identity/v3/projects => generated 383 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:26.534593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:26.535608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:26.535608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:26.537871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:26.539387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315330a-d6fb-4eaf-92da-fbd8973dbdd1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:26.694520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:26.698982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:26.755676 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3354/6682] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:26.764361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315330a-d6fb-4eaf-92da-fbd8973dbdd1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:26.822756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36d89f-0c42-40a3-8c6c-4c521598ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:26.823504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36d89f-0c42-40a3-8c6c-4c521598ce70 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:26.831580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36d89f-0c42-40a3-8c6c-4c521598ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:26.832110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36d89f-0c42-40a3-8c6c-4c521598ce70 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:26.835817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36d89f-0c42-40a3-8c6c-4c521598ce70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:26.839278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36d89f-0c42-40a3-8c6c-4c521598ce70 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:26.909542 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3329/6683] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:26 2022] POST /identity/v3/users => generated 292 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:26.913737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:26.927833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d106b-2573-4f11-b373-de44e914a789 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:26.947242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e42a3-bdef-4996-88a3-05c87d2e9920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:26.949131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e42a3-bdef-4996-88a3-05c87d2e9920 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:26.949452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e42a3-bdef-4996-88a3-05c87d2e9920 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:26.950054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e42a3-bdef-4996-88a3-05c87d2e9920 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:26.951615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e42a3-bdef-4996-88a3-05c87d2e9920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:26.954560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e42a3-bdef-4996-88a3-05c87d2e9920 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:26.984069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36d89f-0c42-40a3-8c6c-4c521598ce70 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:26.995468 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3355/6684] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:27.005523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36d89f-0c42-40a3-8c6c-4c521598ce70 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:27.034727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2c7a-9872-4477-a961-825b749a36a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:27.035529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2c7a-9872-4477-a961-825b749a36a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:27.035971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2c7a-9872-4477-a961-825b749a36a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:27.036252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2c7a-9872-4477-a961-825b749a36a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:27.037031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e2c7a-9872-4477-a961-825b749a36a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:27.040157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e2c7a-9872-4477-a961-825b749a36a1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:27.056986 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3330/6685] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:27.060978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e42a3-bdef-4996-88a3-05c87d2e9920 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:27.074776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e42a3-bdef-4996-88a3-05c87d2e9920 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:27.080766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:27.081893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:27.082241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:27.082588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] PATH_INFO: `/v3/projects/c6bc677b62f74066b853ab15cdfd39c5/users/6b3563b7173d45879b620b94a96ee174/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:27.101903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bc677b62f74066b853ab15cdfd39c5, user_id=6b3563b7173d45879b620b94a96ee174, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:27.104733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:27.127853 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3356/6686] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:27 2022] PUT /identity/v3/projects/c6bc677b62f74066b853ab15cdfd39c5/users/6b3563b7173d45879b620b94a96ee174/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:27.138341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac42a1-2d02-4cc9-bd70-80418d0987f6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:27.139004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac42a1-2d02-4cc9-bd70-80418d0987f6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:27.139455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac42a1-2d02-4cc9-bd70-80418d0987f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:27.197212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-46ac42a1-2d02-4cc9-bd70-80418d0987f6 None None] MFA Rules not processed for user `6b3563b7173d45879b620b94a96ee174`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:27.197953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-46ac42a1-2d02-4cc9-bd70-80418d0987f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:27.277439 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3331/6687] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:27.303034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:27.306123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:27.454805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4300bf-5ce3-4949-a752-47c2c7b4e655 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:27.461581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:27.462756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:27.463264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:27.463777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:27.550738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:27.552669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:27.565030 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3357/6688] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:27.662493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac42a1-2d02-4cc9-bd70-80418d0987f6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:27.681430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac42a1-2d02-4cc9-bd70-80418d0987f6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:27.687184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f1ee3-eba4-41ba-ac6b-d76bacedadfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:27.688048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f1ee3-eba4-41ba-ac6b-d76bacedadfd service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:27.688506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f1ee3-eba4-41ba-ac6b-d76bacedadfd service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:27.688887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f1ee3-eba4-41ba-ac6b-d76bacedadfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:27.710043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f1ee3-eba4-41ba-ac6b-d76bacedadfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:27.712991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f1ee3-eba4-41ba-ac6b-d76bacedadfd service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:27.732677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3332/6689] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:28.204172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:28.207133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:28.298620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f1ee3-eba4-41ba-ac6b-d76bacedadfd service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:28.395828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aa58b-5e33-4f76-a98e-88e19889f6b0 service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:28.408642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:28.410476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:28.411154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:28.412249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] PATH_INFO: `/v3/users/5a8ad5662e6148538fe3905314b9dc62` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:28.415049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8ad5662e6148538fe3905314b9dc62)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:28.418346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:28.445675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f1ee3-eba4-41ba-ac6b-d76bacedadfd service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:28.463363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:28.464619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:28.465053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:28.465431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] PATH_INFO: `/v3/users/0980c9c53b624dd99d2a0c37de9d91c4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:28.468608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0980c9c53b624dd99d2a0c37de9d91c4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:28.473232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:28.509243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8ad5662e6148538fe3905314b9dc62'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.535639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8ad5662e6148538fe3905314b9dc62'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.548094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8ad5662e6148538fe3905314b9dc62'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.548942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8ad5662e6148538fe3905314b9dc62'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.549950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8ad5662e6148538fe3905314b9dc62'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.550741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0980c9c53b624dd99d2a0c37de9d91c4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.551689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0980c9c53b624dd99d2a0c37de9d91c4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.552779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0980c9c53b624dd99d2a0c37de9d91c4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.571040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0980c9c53b624dd99d2a0c37de9d91c4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.575348 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3358/6690] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:28 2022] DELETE /identity/v3/users/5a8ad5662e6148538fe3905314b9dc62 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:28.576720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:28.580353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:28.583101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9a85f085-b8c0-48f9-a288-387e5a40f027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0980c9c53b624dd99d2a0c37de9d91c4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:28.602526 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3333/6691] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:28 2022] DELETE /identity/v3/users/0980c9c53b624dd99d2a0c37de9d91c4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:28.604287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a245-cfda-4e89-b618-0cf6073c8ac9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:28.604858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a245-cfda-4e89-b618-0cf6073c8ac9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:28.605371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a245-cfda-4e89-b618-0cf6073c8ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:28.675342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f3f1a245-cfda-4e89-b618-0cf6073c8ac9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:28.677566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f3f1a245-cfda-4e89-b618-0cf6073c8ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:28.687599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430e10e-e9bc-4872-b885-087dd9e99e27 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:28.766989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:28.767765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:28.768127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:28.768510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:28.770688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:28.821042 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3334/6692] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:28.824066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56dd5-349f-49fa-9fa0-b4a692e61913 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:28.826623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56dd5-349f-49fa-9fa0-b4a692e61913 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:28.826850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56dd5-349f-49fa-9fa0-b4a692e61913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:28.876055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-11a56dd5-349f-49fa-9fa0-b4a692e61913 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:28.884252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-11a56dd5-349f-49fa-9fa0-b4a692e61913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:28.887778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:28.891171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:28.908485 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3359/6693] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:28.908895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:28.910362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:28.911197 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3335/6694] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:28.921601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56dd5-349f-49fa-9fa0-b4a692e61913 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:28.923259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-11a56dd5-349f-49fa-9fa0-b4a692e61913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:28.930257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c7c4-a4c6-4b68-876b-a92e96d5abd9 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:28.937126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:28.937956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:28.938311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:28.940124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56dd5-349f-49fa-9fa0-b4a692e61913 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:28.943649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:28.946255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:28.947321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:28.947697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:28.948070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:28.957979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:28.959522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:28.960373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:28.961191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:28.974345 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3336/6695] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:28.984629 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3360/6696] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:29.403859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:29.406479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:29.415524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:29.417724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:29.447096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9905bb-4dfe-49e5-9a76-700fbd259400 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:29.457500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df689b50-725a-4fba-b338-3d3e18398fbf service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:29.473406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:29.473668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:29.474797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:29.474797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:29.475163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] PATH_INFO: `/v3/projects/f9780e37cefb40688394abf1793095b8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:29.477675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:29.477875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9780e37cefb40688394abf1793095b8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:29.478672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:29.479464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] PATH_INFO: `/v3/projects/1163087e58fb4b42adb9cb92d103d048` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:29.479643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:29.486849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1163087e58fb4b42adb9cb92d103d048)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:29.492417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:29.590995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9780e37cefb40688394abf1793095b8', 'request_id': 'req-46ecda02-66c6-4042-879b-beb7e745dce6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.602185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9780e37cefb40688394abf1793095b8', 'request_id': 'req-46ecda02-66c6-4042-879b-beb7e745dce6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.631220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9780e37cefb40688394abf1793095b8', 'request_id': 'req-46ecda02-66c6-4042-879b-beb7e745dce6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.652585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] The token cache is being invalidate because project f9780e37cefb40688394abf1793095b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:29.653242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.655010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.659520 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3337/6697] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:29 2022] DELETE /identity/v3/projects/f9780e37cefb40688394abf1793095b8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:29.679247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:29.683121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:29.694368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1163087e58fb4b42adb9cb92d103d048', 'request_id': 'req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.708885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1163087e58fb4b42adb9cb92d103d048', 'request_id': 'req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.736703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1163087e58fb4b42adb9cb92d103d048', 'request_id': 'req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.773995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] The token cache is being invalidate because project 1163087e58fb4b42adb9cb92d103d048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:29.777298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.789152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:29.791903 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3361/6698] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:29 2022] DELETE /identity/v3/projects/1163087e58fb4b42adb9cb92d103d048 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:29.795937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:29.797571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:29.869424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecda02-66c6-4042-879b-beb7e745dce6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:29.897676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee48ef3-b9a2-489a-809c-1b1dd2e348f9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:29.920788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:29.922270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:29.922555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:29.922842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] PATH_INFO: `/v3/users/6b3563b7173d45879b620b94a96ee174` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:29.925307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3563b7173d45879b620b94a96ee174)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:29.927948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:29.958771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:29.960559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:29.960810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:29.961122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] PATH_INFO: `/v3/users/a599c2f505c74fb0920f041a19713e6d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:29.962468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a599c2f505c74fb0920f041a19713e6d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:29.964861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:30.070070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3563b7173d45879b620b94a96ee174'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.092156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a599c2f505c74fb0920f041a19713e6d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.094306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a599c2f505c74fb0920f041a19713e6d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.097551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a599c2f505c74fb0920f041a19713e6d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.123692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3563b7173d45879b620b94a96ee174'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.141530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a599c2f505c74fb0920f041a19713e6d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.143467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3563b7173d45879b620b94a96ee174'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.144854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3563b7173d45879b620b94a96ee174'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.146126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3563b7173d45879b620b94a96ee174'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.160663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a599c2f505c74fb0920f041a19713e6d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:30.174591 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3362/6699] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:29 2022] DELETE /identity/v3/users/6b3563b7173d45879b620b94a96ee174 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:30.184926 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3338/6700] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:29 2022] DELETE /identity/v3/users/a599c2f505c74fb0920f041a19713e6d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:30.850973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:30.857907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:31.032396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be4a79-bc18-4098-a943-33594dc80116 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:31.121800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:31.123386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:31.177461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:31.179217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.179902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.180523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] PATH_INFO: `/v3/projects/6f6a906556254a72b4f4d311378e5a26` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.183691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6a906556254a72b4f4d311378e5a26)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:31.189503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:31.226177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15684d-7196-43a8-98d6-41b824af9b76 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:31.232308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:31.234212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.234709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.235180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] PATH_INFO: `/v3/projects/c6bc677b62f74066b853ab15cdfd39c5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.239631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6bc677b62f74066b853ab15cdfd39c5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:31.241653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:31.297346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6a906556254a72b4f4d311378e5a26', 'request_id': 'req-e0b42586-44b6-482a-8434-02759004ae0f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.314993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6a906556254a72b4f4d311378e5a26', 'request_id': 'req-e0b42586-44b6-482a-8434-02759004ae0f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.332753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6bc677b62f74066b853ab15cdfd39c5', 'request_id': 'req-6cc666ba-a6ba-4831-be31-6de22f6854e0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.338369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6a906556254a72b4f4d311378e5a26', 'request_id': 'req-e0b42586-44b6-482a-8434-02759004ae0f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.355056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6bc677b62f74066b853ab15cdfd39c5', 'request_id': 'req-6cc666ba-a6ba-4831-be31-6de22f6854e0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.361432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] The token cache is being invalidate because project 6f6a906556254a72b4f4d311378e5a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:31.361733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.364435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e0b42586-44b6-482a-8434-02759004ae0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.366637 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3363/6701] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:30 2022] DELETE /identity/v3/projects/6f6a906556254a72b4f4d311378e5a26 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:31.371542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1987-0f9d-4f7c-8462-fe8a4938b154 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.371867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1987-0f9d-4f7c-8462-fe8a4938b154 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.372196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1987-0f9d-4f7c-8462-fe8a4938b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.376062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6bc677b62f74066b853ab15cdfd39c5', 'request_id': 'req-6cc666ba-a6ba-4831-be31-6de22f6854e0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.396823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] The token cache is being invalidate because project c6bc677b62f74066b853ab15cdfd39c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:31.398283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.399278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6cc666ba-a6ba-4831-be31-6de22f6854e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:31.402072 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3339/6702] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:31 2022] DELETE /identity/v3/projects/c6bc677b62f74066b853ab15cdfd39c5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:31.408718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d006-82b8-49ae-81b3-8a647566ade2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.409107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d006-82b8-49ae-81b3-8a647566ade2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.409297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122d006-82b8-49ae-81b3-8a647566ade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.416868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-164a1987-0f9d-4f7c-8462-fe8a4938b154 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:31.418363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-164a1987-0f9d-4f7c-8462-fe8a4938b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:31.445826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6122d006-82b8-49ae-81b3-8a647566ade2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:31.448409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6122d006-82b8-49ae-81b3-8a647566ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:31.503452 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3364/6703] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:31.512498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555609-0ca4-4b39-8cfd-b016babed358 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.512768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555609-0ca4-4b39-8cfd-b016babed358 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.513200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555609-0ca4-4b39-8cfd-b016babed358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.538525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8d555609-0ca4-4b39-8cfd-b016babed358 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:31.543335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8d555609-0ca4-4b39-8cfd-b016babed358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:31.562008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3365/6704] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:31.564238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555609-0ca4-4b39-8cfd-b016babed358 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:31.566059 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3340/6705] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:31.576540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7bfa2-c7a4-4a14-8272-9ea59fb167a6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.576750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7bfa2-c7a4-4a14-8272-9ea59fb167a6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.577544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7bfa2-c7a4-4a14-8272-9ea59fb167a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.597679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-83c7bfa2-c7a4-4a14-8272-9ea59fb167a6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:31.598937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-83c7bfa2-c7a4-4a14-8272-9ea59fb167a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:31.602344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555609-0ca4-4b39-8cfd-b016babed358 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:31.612582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:31.613267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.613555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.613833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.614761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:31.614876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:31.616653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:31.618867 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3341/6706] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:31.625842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7bfa2-c7a4-4a14-8272-9ea59fb167a6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:31.658369 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3366/6707] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:31.660956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7bfa2-c7a4-4a14-8272-9ea59fb167a6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:31.663368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:31.675663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:31.677794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.678289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.679016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.680832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:31.681366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:31.685473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:31.690629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291bd23-ff10-4d2f-af32-586f4ef3cb07 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:31.706518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc3841-59f7-45e0-ad3c-9b3615a31cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:31.707289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3841-59f7-45e0-ad3c-9b3615a31cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.707815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3841-59f7-45e0-ad3c-9b3615a31cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.708204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3841-59f7-45e0-ad3c-9b3615a31cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.709239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc3841-59f7-45e0-ad3c-9b3615a31cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:31.713779 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3342/6708] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:31.714901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc3841-59f7-45e0-ad3c-9b3615a31cf8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:31.720152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:31.737697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245059f3-bc1a-48b4-87d2-e9a45ab8d762 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:31.746863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5faa44-e0d7-4b5b-8574-0c590f664d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:31.747742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5faa44-e0d7-4b5b-8574-0c590f664d60 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.748016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5faa44-e0d7-4b5b-8574-0c590f664d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.748360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5faa44-e0d7-4b5b-8574-0c590f664d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.750635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5faa44-e0d7-4b5b-8574-0c590f664d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:31.753409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5faa44-e0d7-4b5b-8574-0c590f664d60 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:31.764097 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3367/6709] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:31 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:31.769746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc3841-59f7-45e0-ad3c-9b3615a31cf8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:31.835703 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3343/6710] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:31 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:31.837736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5faa44-e0d7-4b5b-8574-0c590f664d60 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:31.856507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc3841-59f7-45e0-ad3c-9b3615a31cf8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:31.943246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5faa44-e0d7-4b5b-8574-0c590f664d60 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:31.950941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256845a-f261-47ac-9425-34ea18274296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:31.952646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256845a-f261-47ac-9425-34ea18274296 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.953278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256845a-f261-47ac-9425-34ea18274296 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.953278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256845a-f261-47ac-9425-34ea18274296 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.954970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256845a-f261-47ac-9425-34ea18274296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:31.957624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256845a-f261-47ac-9425-34ea18274296 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:31.965088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539497a6-0611-438c-b03f-104d717ddff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:31.966980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539497a6-0611-438c-b03f-104d717ddff5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:31.967300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539497a6-0611-438c-b03f-104d717ddff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:31.968460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539497a6-0611-438c-b03f-104d717ddff5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:31.970198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539497a6-0611-438c-b03f-104d717ddff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:31.974654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539497a6-0611-438c-b03f-104d717ddff5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:31.988780 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3344/6711] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:31 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:31.997285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256845a-f261-47ac-9425-34ea18274296 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.015979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256845a-f261-47ac-9425-34ea18274296 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:32.021512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce3c63-4ac5-40a8-b980-9f1bf1211404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:32.022482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3c63-4ac5-40a8-b980-9f1bf1211404 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.022743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3c63-4ac5-40a8-b980-9f1bf1211404 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.023142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3c63-4ac5-40a8-b980-9f1bf1211404 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.023886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce3c63-4ac5-40a8-b980-9f1bf1211404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:32.025853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce3c63-4ac5-40a8-b980-9f1bf1211404 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:32.040896 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3368/6712] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:31 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:32.044148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539497a6-0611-438c-b03f-104d717ddff5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.056716 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3345/6713] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:32.057842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539497a6-0611-438c-b03f-104d717ddff5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:32.064310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce3c63-4ac5-40a8-b980-9f1bf1211404 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.065603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d1c3e-8e9c-4939-a08a-5285e182c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:32.066388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d1c3e-8e9c-4939-a08a-5285e182c3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.066766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d1c3e-8e9c-4939-a08a-5285e182c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.067358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d1c3e-8e9c-4939-a08a-5285e182c3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.067988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d1c3e-8e9c-4939-a08a-5285e182c3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:32.071119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d1c3e-8e9c-4939-a08a-5285e182c3f7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:32.090733 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3369/6714] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:32.096919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d1c3e-8e9c-4939-a08a-5285e182c3f7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.103104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce3c63-4ac5-40a8-b980-9f1bf1211404 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:32.107969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d1c3e-8e9c-4939-a08a-5285e182c3f7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:32.116922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90253-9eb1-49a7-ae67-23c674f8f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:32.118006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dfdd6-7a4d-4e52-b719-efaa148616e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:32.119640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dfdd6-7a4d-4e52-b719-efaa148616e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.120115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90253-9eb1-49a7-ae67-23c674f8f453 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.120312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dfdd6-7a4d-4e52-b719-efaa148616e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.120795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dfdd6-7a4d-4e52-b719-efaa148616e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.122386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dfdd6-7a4d-4e52-b719-efaa148616e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:32.123923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90253-9eb1-49a7-ae67-23c674f8f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.124261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90253-9eb1-49a7-ae67-23c674f8f453 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.125112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd90253-9eb1-49a7-ae67-23c674f8f453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:32.126093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dfdd6-7a4d-4e52-b719-efaa148616e7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:32.129024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd90253-9eb1-49a7-ae67-23c674f8f453 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:32.142208 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3370/6715] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:32.148251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90253-9eb1-49a7-ae67-23c674f8f453 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.160745 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3346/6716] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:32.173943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dfdd6-7a4d-4e52-b719-efaa148616e7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.182833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90253-9eb1-49a7-ae67-23c674f8f453 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:32.201882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dfdd6-7a4d-4e52-b719-efaa148616e7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:32.203447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc6c5c-fd51-431c-9852-bfebb514f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:32.205388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc6c5c-fd51-431c-9852-bfebb514f757 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.207791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc6c5c-fd51-431c-9852-bfebb514f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.208458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc6c5c-fd51-431c-9852-bfebb514f757 admin admin] PATH_INFO: `/v3/projects/f006e5b74b334c22a53c320ab95f9869/users/92d6e63a4fee428da9d800533bb95a3d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.217715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f23c0d-a76c-4f3e-aabd-fae6ec124e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:32.219645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f23c0d-a76c-4f3e-aabd-fae6ec124e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.220161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f23c0d-a76c-4f3e-aabd-fae6ec124e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.220649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f23c0d-a76c-4f3e-aabd-fae6ec124e5a admin admin] PATH_INFO: `/v3/projects/c1d8e5f9aeb646b198b8ee50da3d80af/users/0a421556aea44c64bc4440026e7b347f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.254550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f23c0d-a76c-4f3e-aabd-fae6ec124e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d8e5f9aeb646b198b8ee50da3d80af, user_id=0a421556aea44c64bc4440026e7b347f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:32.257005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc6c5c-fd51-431c-9852-bfebb514f757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f006e5b74b334c22a53c320ab95f9869, user_id=92d6e63a4fee428da9d800533bb95a3d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:32.259615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f23c0d-a76c-4f3e-aabd-fae6ec124e5a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:32.269073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc6c5c-fd51-431c-9852-bfebb514f757 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:32.287462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3347/6717] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:32 2022] PUT /identity/v3/projects/c1d8e5f9aeb646b198b8ee50da3d80af/users/0a421556aea44c64bc4440026e7b347f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:32.289484 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3371/6718] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:32 2022] PUT /identity/v3/projects/f006e5b74b334c22a53c320ab95f9869/users/92d6e63a4fee428da9d800533bb95a3d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:32.306548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff05e-41bd-411d-8b6d-ea8e4893493b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.307065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff05e-41bd-411d-8b6d-ea8e4893493b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.307359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f183-f06f-4d42-83c9-ecbb4f45fb8a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.307554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff05e-41bd-411d-8b6d-ea8e4893493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.307737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f183-f06f-4d42-83c9-ecbb4f45fb8a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.308135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f183-f06f-4d42-83c9-ecbb4f45fb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.384623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b54ff05e-41bd-411d-8b6d-ea8e4893493b None None] MFA Rules not processed for user `92d6e63a4fee428da9d800533bb95a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:32.387002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b54ff05e-41bd-411d-8b6d-ea8e4893493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:32.393278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6298f183-f06f-4d42-83c9-ecbb4f45fb8a None None] MFA Rules not processed for user `0a421556aea44c64bc4440026e7b347f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:32.395935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6298f183-f06f-4d42-83c9-ecbb4f45fb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:32.576658 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3348/6719] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:32.585126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff05e-41bd-411d-8b6d-ea8e4893493b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.588886 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3372/6720] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:32.602232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298f183-f06f-4d42-83c9-ecbb4f45fb8a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.607274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6298f183-f06f-4d42-83c9-ecbb4f45fb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:32.773372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff05e-41bd-411d-8b6d-ea8e4893493b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:32.791140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366baa22-cc39-4264-88e5-8b39856176b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:32.792093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baa22-cc39-4264-88e5-8b39856176b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.792585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baa22-cc39-4264-88e5-8b39856176b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.793082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baa22-cc39-4264-88e5-8b39856176b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.794425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366baa22-cc39-4264-88e5-8b39856176b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:32.797902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366baa22-cc39-4264-88e5-8b39856176b7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:32.803523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298f183-f06f-4d42-83c9-ecbb4f45fb8a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:32.814115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea079-475c-4baa-9383-fb4f0fd65df7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:32.815030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea079-475c-4baa-9383-fb4f0fd65df7 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:32.815468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea079-475c-4baa-9383-fb4f0fd65df7 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:32.816564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea079-475c-4baa-9383-fb4f0fd65df7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:32.833076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ea079-475c-4baa-9383-fb4f0fd65df7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:32.834822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ea079-475c-4baa-9383-fb4f0fd65df7 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:32.865030 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3373/6721] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:32.893128 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3349/6722] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:32 2022] POST /identity/v3/projects => generated 387 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:32.899308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea079-475c-4baa-9383-fb4f0fd65df7 service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:32.928866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea079-475c-4baa-9383-fb4f0fd65df7 service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:33.175700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d550d-e8f5-4198-b12f-df84c2f67314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:33.175700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d550d-e8f5-4198-b12f-df84c2f67314 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:33.175700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d550d-e8f5-4198-b12f-df84c2f67314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:33.175700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d550d-e8f5-4198-b12f-df84c2f67314 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:33.177077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d550d-e8f5-4198-b12f-df84c2f67314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:33.179676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d550d-e8f5-4198-b12f-df84c2f67314 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:33.217228 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3374/6723] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:32 2022] POST /identity/v3/users => generated 300 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:33.222661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366baa22-cc39-4264-88e5-8b39856176b7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:33.254453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366baa22-cc39-4264-88e5-8b39856176b7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:33.280123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926665-0c7e-4061-bb72-c6b054477677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:33.281309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926665-0c7e-4061-bb72-c6b054477677 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:33.281802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926665-0c7e-4061-bb72-c6b054477677 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:33.282315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926665-0c7e-4061-bb72-c6b054477677 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:33.283743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926665-0c7e-4061-bb72-c6b054477677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:33.286874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926665-0c7e-4061-bb72-c6b054477677 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:33.333930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d550d-e8f5-4198-b12f-df84c2f67314 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:33.350923 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3350/6724] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:33.359123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d550d-e8f5-4198-b12f-df84c2f67314 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:33.379508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00084806-7b89-4121-9199-9c33d7d9a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:33.381040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00084806-7b89-4121-9199-9c33d7d9a7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:33.381522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00084806-7b89-4121-9199-9c33d7d9a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:33.382005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00084806-7b89-4121-9199-9c33d7d9a7dc admin admin] PATH_INFO: `/v3/projects/e47108a7017f4d39b9abb0b3a97bc843/users/c7d69ed48a594d219bce3a68e493ab66/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:33.434812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00084806-7b89-4121-9199-9c33d7d9a7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47108a7017f4d39b9abb0b3a97bc843, user_id=c7d69ed48a594d219bce3a68e493ab66, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:33.449575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00084806-7b89-4121-9199-9c33d7d9a7dc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:33.507104 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3375/6725] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:33 2022] PUT /identity/v3/projects/e47108a7017f4d39b9abb0b3a97bc843/users/c7d69ed48a594d219bce3a68e493ab66/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:33.528569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926665-0c7e-4061-bb72-c6b054477677 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:33.557314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926665-0c7e-4061-bb72-c6b054477677 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:33.633854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00084806-7b89-4121-9199-9c33d7d9a7dc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:33.693236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb76f-4b28-423f-9636-c1f2bcacedfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:33.693984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb76f-4b28-423f-9636-c1f2bcacedfd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:33.694459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb76f-4b28-423f-9636-c1f2bcacedfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:33.694739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb76f-4b28-423f-9636-c1f2bcacedfd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:33.695464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cb76f-4b28-423f-9636-c1f2bcacedfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:33.697450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cb76f-4b28-423f-9636-c1f2bcacedfd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:33.710070 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3351/6726] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:33.714029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb76f-4b28-423f-9636-c1f2bcacedfd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:33.726142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb76f-4b28-423f-9636-c1f2bcacedfd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:33.736517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53640e-f191-43c2-a277-db7d886cd634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:33.737416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53640e-f191-43c2-a277-db7d886cd634 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:33.737700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53640e-f191-43c2-a277-db7d886cd634 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:33.738125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53640e-f191-43c2-a277-db7d886cd634 admin admin] PATH_INFO: `/v3/projects/e47108a7017f4d39b9abb0b3a97bc843/users/c7d69ed48a594d219bce3a68e493ab66/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:33.741044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53640e-f191-43c2-a277-db7d886cd634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47108a7017f4d39b9abb0b3a97bc843, user_id=c7d69ed48a594d219bce3a68e493ab66, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:33.743922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53640e-f191-43c2-a277-db7d886cd634 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:33.751083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00084806-7b89-4121-9199-9c33d7d9a7dc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:33.757897 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3352/6727] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:33 2022] PUT /identity/v3/projects/e47108a7017f4d39b9abb0b3a97bc843/users/c7d69ed48a594d219bce3a68e493ab66/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:33.769823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1cbf-5d8d-4bcf-83ac-fc35f11bde8e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:33.770082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1cbf-5d8d-4bcf-83ac-fc35f11bde8e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:33.770341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1cbf-5d8d-4bcf-83ac-fc35f11bde8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:33.803499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e0ee1cbf-5d8d-4bcf-83ac-fc35f11bde8e None None] MFA Rules not processed for user `c7d69ed48a594d219bce3a68e493ab66`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:33.804814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e0ee1cbf-5d8d-4bcf-83ac-fc35f11bde8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:33.829557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:33.831111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:33.831695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:33.832309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] PATH_INFO: `/v3/users/0a421556aea44c64bc4440026e7b347f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:33.834928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a421556aea44c64bc4440026e7b347f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:33.838884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:33.889766 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3353/6728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:33.901821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee1cbf-5d8d-4bcf-83ac-fc35f11bde8e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:33.903396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e0ee1cbf-5d8d-4bcf-83ac-fc35f11bde8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:33.919363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a421556aea44c64bc4440026e7b347f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:33.935215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a421556aea44c64bc4440026e7b347f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:33.946806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a421556aea44c64bc4440026e7b347f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:33.947474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a421556aea44c64bc4440026e7b347f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:33.948149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-322d908d-515b-4fe9-9cd0-f4aa4133f219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a421556aea44c64bc4440026e7b347f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:33.961880 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3376/6729] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:33 2022] DELETE /identity/v3/users/0a421556aea44c64bc4440026e7b347f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:33.966369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c91ae-c4f0-4eea-9db6-a831efb03580 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:33.966662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c91ae-c4f0-4eea-9db6-a831efb03580 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:33.966945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c91ae-c4f0-4eea-9db6-a831efb03580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:33.979917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee1cbf-5d8d-4bcf-83ac-fc35f11bde8e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:33.988784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aa6c91ae-c4f0-4eea-9db6-a831efb03580 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:33.990794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aa6c91ae-c4f0-4eea-9db6-a831efb03580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:34.044344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:34.045209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:34.045636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:34.046147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:34.051756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:34.075395 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3377/6730] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:34.086680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c91ae-c4f0-4eea-9db6-a831efb03580 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:34.088286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aa6c91ae-c4f0-4eea-9db6-a831efb03580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:34.137244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:34.138896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:34.149669 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3354/6731] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:34.166507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c91ae-c4f0-4eea-9db6-a831efb03580 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:34.173837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc83ae-5421-4d09-95fc-f5dddabed4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:34.174830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc83ae-5421-4d09-95fc-f5dddabed4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:34.175305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc83ae-5421-4d09-95fc-f5dddabed4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:34.175789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc83ae-5421-4d09-95fc-f5dddabed4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:34.188398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc83ae-5421-4d09-95fc-f5dddabed4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:34.190409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc83ae-5421-4d09-95fc-f5dddabed4a9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:34.204894 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3378/6732] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:34.578184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:34.579323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:34.612032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516026e1-ec77-452d-a818-e1decfe118ca service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:34.619139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:34.620161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:34.620716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:34.621234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] PATH_INFO: `/v3/projects/c1d8e5f9aeb646b198b8ee50da3d80af` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:34.622725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d8e5f9aeb646b198b8ee50da3d80af)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:34.625845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:34.734932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d8e5f9aeb646b198b8ee50da3d80af', 'request_id': 'req-ee3091b0-82d6-47ee-995e-67389a7c153c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:34.757183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d8e5f9aeb646b198b8ee50da3d80af', 'request_id': 'req-ee3091b0-82d6-47ee-995e-67389a7c153c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:34.782523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d8e5f9aeb646b198b8ee50da3d80af', 'request_id': 'req-ee3091b0-82d6-47ee-995e-67389a7c153c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:34.804786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] The token cache is being invalidate because project c1d8e5f9aeb646b198b8ee50da3d80af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:34.805473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:34.806437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ee3091b0-82d6-47ee-995e-67389a7c153c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:34.808740 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3355/6733] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:34 2022] DELETE /identity/v3/projects/c1d8e5f9aeb646b198b8ee50da3d80af => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:34.816473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c26018-2c44-48aa-9d9c-de4325e4a1be None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:34.817104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c26018-2c44-48aa-9d9c-de4325e4a1be None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:34.817784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c26018-2c44-48aa-9d9c-de4325e4a1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:34.866149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-72c26018-2c44-48aa-9d9c-de4325e4a1be None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:34.866149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-72c26018-2c44-48aa-9d9c-de4325e4a1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:34.978554 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3379/6734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:34.982729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd322-4f5e-44de-ba9d-fba32a64e35d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:34.983392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd322-4f5e-44de-ba9d-fba32a64e35d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:34.983919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd322-4f5e-44de-ba9d-fba32a64e35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:34.987252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c26018-2c44-48aa-9d9c-de4325e4a1be None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:34.989406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-72c26018-2c44-48aa-9d9c-de4325e4a1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:35.016206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c26018-2c44-48aa-9d9c-de4325e4a1be None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.021982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a3dcd322-4f5e-44de-ba9d-fba32a64e35d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:35.023975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a3dcd322-4f5e-44de-ba9d-fba32a64e35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:35.033438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.034429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.035791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.036301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] PATH_INFO: `/v3/users/92d6e63a4fee428da9d800533bb95a3d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.037633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d6e63a4fee428da9d800533bb95a3d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:35.040997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:35.053126 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3356/6735] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:35.056949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcd322-4f5e-44de-ba9d-fba32a64e35d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:35.074269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcd322-4f5e-44de-ba9d-fba32a64e35d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.082336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.083455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.083896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.084293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.085489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:35.085962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:35.089001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:35.110307 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3357/6736] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:35.115098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:35.116899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d6e63a4fee428da9d800533bb95a3d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:35.136681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d6e63a4fee428da9d800533bb95a3d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:35.138932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6727d3-4e66-45d8-93b3-63419d71a3b5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.148526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d6e63a4fee428da9d800533bb95a3d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:35.149356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d6e63a4fee428da9d800533bb95a3d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:35.150476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc82c624-5d5e-44af-9caa-72bf38fb32e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d6e63a4fee428da9d800533bb95a3d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:35.153150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.154829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.154829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.155833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.156996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:35.162000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:35.168445 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3380/6737] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:34 2022] DELETE /identity/v3/users/92d6e63a4fee428da9d800533bb95a3d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:35.172140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de995a-da6b-4f8f-8868-10bc42d97ad4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.172818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de995a-da6b-4f8f-8868-10bc42d97ad4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.173301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de995a-da6b-4f8f-8868-10bc42d97ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.200383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-24de995a-da6b-4f8f-8868-10bc42d97ad4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:35.203039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-24de995a-da6b-4f8f-8868-10bc42d97ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:35.226723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3358/6738] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:35 2022] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:35.232828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:35.236075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:35.309900 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3381/6739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:35.338499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef42730-3602-4924-be52-3cf61aca6c5a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.346268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb509f-2c7b-4564-909a-b2b123526bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.346965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb509f-2c7b-4564-909a-b2b123526bdd admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.354034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de995a-da6b-4f8f-8868-10bc42d97ad4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:35.361075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-24de995a-da6b-4f8f-8868-10bc42d97ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:35.361278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb509f-2c7b-4564-909a-b2b123526bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.361590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb509f-2c7b-4564-909a-b2b123526bdd admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.362397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb509f-2c7b-4564-909a-b2b123526bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:35.364480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb509f-2c7b-4564-909a-b2b123526bdd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:35.392429 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3359/6740] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:35 2022] POST /identity/v3/users => generated 278 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:35.397414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb509f-2c7b-4564-909a-b2b123526bdd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:35.410505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb509f-2c7b-4564-909a-b2b123526bdd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.419150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0127e9-0630-4a53-a89f-bc5f157aab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.419845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0127e9-0630-4a53-a89f-bc5f157aab6d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.420156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0127e9-0630-4a53-a89f-bc5f157aab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.420463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0127e9-0630-4a53-a89f-bc5f157aab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.422919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0127e9-0630-4a53-a89f-bc5f157aab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:35.428720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0127e9-0630-4a53-a89f-bc5f157aab6d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:35.451695 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3360/6741] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:35.453070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0127e9-0630-4a53-a89f-bc5f157aab6d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:35.466352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0127e9-0630-4a53-a89f-bc5f157aab6d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.474582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c9abe-c956-4930-a371-b9e16932b867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.475267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c9abe-c956-4930-a371-b9e16932b867 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.475558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c9abe-c956-4930-a371-b9e16932b867 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.475832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c9abe-c956-4930-a371-b9e16932b867 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.476606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c9abe-c956-4930-a371-b9e16932b867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:35.478493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c9abe-c956-4930-a371-b9e16932b867 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:35.484707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de995a-da6b-4f8f-8868-10bc42d97ad4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.497789 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3361/6742] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:35.499967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c9abe-c956-4930-a371-b9e16932b867 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:35.510542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c9abe-c956-4930-a371-b9e16932b867 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.519108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e206d-53a7-4823-ad8c-46a37fff7b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.520087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e206d-53a7-4823-ad8c-46a37fff7b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.520396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e206d-53a7-4823-ad8c-46a37fff7b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.520682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e206d-53a7-4823-ad8c-46a37fff7b50 admin admin] PATH_INFO: `/v3/projects/febb867c941d4dbab905f7b936ba4238/users/a830a1d0b0714d2cb614ccb04dcc0a74/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.543598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e206d-53a7-4823-ad8c-46a37fff7b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febb867c941d4dbab905f7b936ba4238, user_id=a830a1d0b0714d2cb614ccb04dcc0a74, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:35.549943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e206d-53a7-4823-ad8c-46a37fff7b50 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:35.557773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683308-6bf8-42a7-a10f-d2cde8fdf96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.558877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683308-6bf8-42a7-a10f-d2cde8fdf96f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.559365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683308-6bf8-42a7-a10f-d2cde8fdf96f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.559637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683308-6bf8-42a7-a10f-d2cde8fdf96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.576850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34683308-6bf8-42a7-a10f-d2cde8fdf96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:35.578482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34683308-6bf8-42a7-a10f-d2cde8fdf96f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:35.586999 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3362/6743] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:35 2022] PUT /identity/v3/projects/febb867c941d4dbab905f7b936ba4238/users/a830a1d0b0714d2cb614ccb04dcc0a74/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:35.600282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e87a-3dc3-4f16-9426-fff6f797d72d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.601084 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3382/6744] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:35.604036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e87a-3dc3-4f16-9426-fff6f797d72d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:35.604412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e87a-3dc3-4f16-9426-fff6f797d72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:35.652792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9780e87a-3dc3-4f16-9426-fff6f797d72d None None] MFA Rules not processed for user `a830a1d0b0714d2cb614ccb04dcc0a74`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:35.658495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9780e87a-3dc3-4f16-9426-fff6f797d72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:35.817063 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3363/6745] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:35.824638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683308-6bf8-42a7-a10f-d2cde8fdf96f service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:35.844585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683308-6bf8-42a7-a10f-d2cde8fdf96f service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:35.989067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:35.990369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:35.990804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.009861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.010839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:36.015972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:36.084535 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3383/6746] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:35 2022] POST /identity/v3/projects => generated 355 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:36.087992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e87a-3dc3-4f16-9426-fff6f797d72d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:36.113827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e87a-3dc3-4f16-9426-fff6f797d72d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:36.193758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:36.197455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:36.246867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb390952-6790-478e-ab56-1a8142eda2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:36.247902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390952-6790-478e-ab56-1a8142eda2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:36.248575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390952-6790-478e-ab56-1a8142eda2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.249566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390952-6790-478e-ab56-1a8142eda2d6 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.250461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb390952-6790-478e-ab56-1a8142eda2d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:36.253638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb390952-6790-478e-ab56-1a8142eda2d6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:36.314542 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3364/6747] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:36 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:36.316570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb390952-6790-478e-ab56-1a8142eda2d6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:36.344762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb390952-6790-478e-ab56-1a8142eda2d6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:36.357339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae871-c502-45aa-a39b-d252d4981db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:36.359758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae871-c502-45aa-a39b-d252d4981db5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:36.360562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae871-c502-45aa-a39b-d252d4981db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.361859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae871-c502-45aa-a39b-d252d4981db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.363742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ae871-c502-45aa-a39b-d252d4981db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:36.367752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ae871-c502-45aa-a39b-d252d4981db5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:36.369107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed2c26-f6cb-4d36-a360-43b0ff984c04 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:36.375836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:36.376826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:36.377137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.377559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] PATH_INFO: `/v3/projects/f006e5b74b334c22a53c320ab95f9869` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.379063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f006e5b74b334c22a53c320ab95f9869)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:36.381054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:36.395359 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3365/6748] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:36.402085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae871-c502-45aa-a39b-d252d4981db5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:36.434998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae871-c502-45aa-a39b-d252d4981db5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:36.440908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f006e5b74b334c22a53c320ab95f9869', 'request_id': 'req-d591deb1-6526-4e8f-b48b-99ed9b2fa256'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.448804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f006e5b74b334c22a53c320ab95f9869', 'request_id': 'req-d591deb1-6526-4e8f-b48b-99ed9b2fa256'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.458220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f006e5b74b334c22a53c320ab95f9869', 'request_id': 'req-d591deb1-6526-4e8f-b48b-99ed9b2fa256'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.472018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] The token cache is being invalidate because project f006e5b74b334c22a53c320ab95f9869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:36.472457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.477829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.482683 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3384/6749] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:36 2022] DELETE /identity/v3/projects/f006e5b74b334c22a53c320ab95f9869 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:36.484478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:36.486798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:36.531307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:36.533381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:36.534062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.534544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] PATH_INFO: `/v3/projects/32c0aa3a26d842ac8a46f12fe1073e54/users/62a645ac82114735b0fa9c4e5f054251/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.561241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c0aa3a26d842ac8a46f12fe1073e54, user_id=62a645ac82114735b0fa9c4e5f054251, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:36.565000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:36.576154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591deb1-6526-4e8f-b48b-99ed9b2fa256 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:36.583193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:36.584353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:36.584883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.587026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] PATH_INFO: `/v3/users/c7d69ed48a594d219bce3a68e493ab66` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.587026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d69ed48a594d219bce3a68e493ab66)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:36.588572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:36.594614 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3366/6750] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:36 2022] PUT /identity/v3/projects/32c0aa3a26d842ac8a46f12fe1073e54/users/62a645ac82114735b0fa9c4e5f054251/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:36.600637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:36.602691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:36.660772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d69ed48a594d219bce3a68e493ab66'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.675742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d69ed48a594d219bce3a68e493ab66'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.693859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d69ed48a594d219bce3a68e493ab66'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.694714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d69ed48a594d219bce3a68e493ab66'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.695681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d69ed48a594d219bce3a68e493ab66'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:36.698334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2400b-95b6-49c5-85f3-3fba0f46e73a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:36.709724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe825b-f2e5-4231-9a1a-0dd136d6b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:36.710029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe825b-f2e5-4231-9a1a-0dd136d6b7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:36.710317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe825b-f2e5-4231-9a1a-0dd136d6b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.710606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe825b-f2e5-4231-9a1a-0dd136d6b7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.711413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe825b-f2e5-4231-9a1a-0dd136d6b7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:36.713123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe825b-f2e5-4231-9a1a-0dd136d6b7c6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:36.716397 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3385/6751] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:36 2022] DELETE /identity/v3/users/c7d69ed48a594d219bce3a68e493ab66 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:36.729247 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3367/6752] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:36.735115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:36.741065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:36.869356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4ca9-c483-403b-93a1-ebd7ade9fd9b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:36.881085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b8577-c76e-49ef-8fbb-25160347142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:36.882769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8577-c76e-49ef-8fbb-25160347142d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:36.882769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8577-c76e-49ef-8fbb-25160347142d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.882769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8577-c76e-49ef-8fbb-25160347142d admin admin] PATH_INFO: `/v3/projects/32c0aa3a26d842ac8a46f12fe1073e54/users/62a645ac82114735b0fa9c4e5f054251/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.887395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b8577-c76e-49ef-8fbb-25160347142d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c0aa3a26d842ac8a46f12fe1073e54, user_id=62a645ac82114735b0fa9c4e5f054251, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:36.891965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b8577-c76e-49ef-8fbb-25160347142d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:36.912912 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3386/6753] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:36 2022] PUT /identity/v3/projects/32c0aa3a26d842ac8a46f12fe1073e54/users/62a645ac82114735b0fa9c4e5f054251/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:36.929110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfaafe-4544-49aa-b695-bfe6c3fb0efd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:36.929537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfaafe-4544-49aa-b695-bfe6c3fb0efd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:36.929954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfaafe-4544-49aa-b695-bfe6c3fb0efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:36.974352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-54bfaafe-4544-49aa-b695-bfe6c3fb0efd None None] MFA Rules not processed for user `62a645ac82114735b0fa9c4e5f054251`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:36.976218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-54bfaafe-4544-49aa-b695-bfe6c3fb0efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:37.097524 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3368/6754] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:37.104905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b8577-c76e-49ef-8fbb-25160347142d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:37.122787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b8577-c76e-49ef-8fbb-25160347142d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:37.131449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62a645ac82114735b0fa9c4e5f054251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32c0aa3a26d842ac8a46f12fe1073e54', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:37.132486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:37.132911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:37.133582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:37.134958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:37.135426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:37.138100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:37.162244 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3387/6755] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:37.165790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfaafe-4544-49aa-b695-bfe6c3fb0efd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:37.181039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfaafe-4544-49aa-b695-bfe6c3fb0efd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:37.185220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:37.189272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:37.191863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7aab1-10e3-45de-afd7-8f891725119b tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62a645ac82114735b0fa9c4e5f054251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32c0aa3a26d842ac8a46f12fe1073e54', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:37.192852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7aab1-10e3-45de-afd7-8f891725119b tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:37.193513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7aab1-10e3-45de-afd7-8f891725119b tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:37.193513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7aab1-10e3-45de-afd7-8f891725119b tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:37.194429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7aab1-10e3-45de-afd7-8f891725119b tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:37.196819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7aab1-10e3-45de-afd7-8f891725119b tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:37.237171 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3369/6756] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:37 2022] POST /identity/v3/projects => generated 349 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:37.240837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7aab1-10e3-45de-afd7-8f891725119b tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:37.320823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031030d3-134b-4bcc-af22-53159e4378d7 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:37.361122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7aab1-10e3-45de-afd7-8f891725119b tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:37.375584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62a645ac82114735b0fa9c4e5f054251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32c0aa3a26d842ac8a46f12fe1073e54', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:37.379648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:37.382799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:37.383638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:37.385605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:37.386581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:37.390871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:37.424722 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3370/6757] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:37.453808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:37.456849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:37.458809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:37.461238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:37.461857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:37.463787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] PATH_INFO: `/v3/projects/e47108a7017f4d39b9abb0b3a97bc843` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:37.468072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47108a7017f4d39b9abb0b3a97bc843)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:37.481611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:37.567889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a0ec7-4c5d-44af-ae60-4d79d3c7203a tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:37.586114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47108a7017f4d39b9abb0b3a97bc843', 'request_id': 'req-2e6ff564-187d-4e42-b9ca-db410a6f64a1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:37.596275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47108a7017f4d39b9abb0b3a97bc843', 'request_id': 'req-2e6ff564-187d-4e42-b9ca-db410a6f64a1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:37.614493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47108a7017f4d39b9abb0b3a97bc843', 'request_id': 'req-2e6ff564-187d-4e42-b9ca-db410a6f64a1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:37.663683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] The token cache is being invalidate because project e47108a7017f4d39b9abb0b3a97bc843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:37.664138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:37.665212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2e6ff564-187d-4e42-b9ca-db410a6f64a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:37.669698 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3388/6758] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:37 2022] DELETE /identity/v3/projects/e47108a7017f4d39b9abb0b3a97bc843 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:37.685842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8eb7d-ffa8-4417-bfae-cd5c415355bc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:37.686988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8eb7d-ffa8-4417-bfae-cd5c415355bc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:37.687606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8eb7d-ffa8-4417-bfae-cd5c415355bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:37.719401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:37.720239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:37.720422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:37.720613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:37.722746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:37.750895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2df8eb7d-ffa8-4417-bfae-cd5c415355bc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:37.752756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2df8eb7d-ffa8-4417-bfae-cd5c415355bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:37.863386 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3389/6759] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:37.876411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001764c-6333-44f9-bfea-b12e30488216 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:37.876411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001764c-6333-44f9-bfea-b12e30488216 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:37.876694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001764c-6333-44f9-bfea-b12e30488216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:37.881857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:37.884097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:37.898018 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3371/6760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:37 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:37.927777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e001764c-6333-44f9-bfea-b12e30488216 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:37.930094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e001764c-6333-44f9-bfea-b12e30488216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:37.943509 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3390/6761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:37.950197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:37.963144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283262-4b9b-4b0c-8ef1-ea68d9a448df service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:37.968311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:37.969323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:37.969682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:37.970270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:37.970833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:37.971210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:37.972958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:37.989523 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3372/6762] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:37.995752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001764c-6333-44f9-bfea-b12e30488216 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.010960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001764c-6333-44f9-bfea-b12e30488216 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.017383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdb975-2d2e-47e0-a956-a190de33ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.018059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdb975-2d2e-47e0-a956-a190de33ab2e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.018342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdb975-2d2e-47e0-a956-a190de33ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.018760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdb975-2d2e-47e0-a956-a190de33ab2e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.019462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdb975-2d2e-47e0-a956-a190de33ab2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.021689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdb975-2d2e-47e0-a956-a190de33ab2e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.063740 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3391/6763] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:37 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:38.065068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.076087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b324d8-229c-4fca-bad5-dcded7faffff admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.124238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdb975-2d2e-47e0-a956-a190de33ab2e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.159387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bef5-a301-4d63-bd77-52aa74a97441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.160482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bef5-a301-4d63-bd77-52aa74a97441 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.160990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bef5-a301-4d63-bd77-52aa74a97441 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.161444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134bef5-a301-4d63-bd77-52aa74a97441 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.162351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134bef5-a301-4d63-bd77-52aa74a97441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.165122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134bef5-a301-4d63-bd77-52aa74a97441 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.195843 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3373/6764] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:38 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:38.200533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bef5-a301-4d63-bd77-52aa74a97441 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.206199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdb975-2d2e-47e0-a956-a190de33ab2e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.212934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62a645ac82114735b0fa9c4e5f054251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32c0aa3a26d842ac8a46f12fe1073e54', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.213818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134bef5-a301-4d63-bd77-52aa74a97441 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.214585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.215106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.215672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] PATH_INFO: `/v3/projects/57f484787d8e4657b15dafdafd9d7a9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.217374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Authorizing `identity:delete_project(project_id=57f484787d8e4657b15dafdafd9d7a9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.220520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.221315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.221495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.221751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.222097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.222947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.224879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.240386 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3374/6765] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:38.240386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.241026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:38.256198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f8cbb-985c-4eb0-81fb-8f68d3ddec36 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.261957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.262943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.264885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.265200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] PATH_INFO: `/v3/users/5e825e0ef42743238263e6758e53e28c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.266750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e825e0ef42743238263e6758e53e28c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.268924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.286628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f484787d8e4657b15dafdafd9d7a9c', 'request_id': 'req-0050c05f-efd0-48e2-966f-65adc55264d4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.293821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f484787d8e4657b15dafdafd9d7a9c', 'request_id': 'req-0050c05f-efd0-48e2-966f-65adc55264d4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.315761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f484787d8e4657b15dafdafd9d7a9c', 'request_id': 'req-0050c05f-efd0-48e2-966f-65adc55264d4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.331508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e825e0ef42743238263e6758e53e28c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.332463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e825e0ef42743238263e6758e53e28c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.333429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e825e0ef42743238263e6758e53e28c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.334761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] The token cache is being invalidate because project 57f484787d8e4657b15dafdafd9d7a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:38.335434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.337606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.341168 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3392/6766] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:38 2022] DELETE /identity/v3/projects/57f484787d8e4657b15dafdafd9d7a9c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:38.343383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.345313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:38.357873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e825e0ef42743238263e6758e53e28c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.369988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e825e0ef42743238263e6758e53e28c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.394984 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3375/6767] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:38 2022] DELETE /identity/v3/users/5e825e0ef42743238263e6758e53e28c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:38.453046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050c05f-efd0-48e2-966f-65adc55264d4 tempest-QuotasTest-206984368 tempest-QuotasTest-206984368-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.534327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.537325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.538126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.539024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.540211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.542884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.568600 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3393/6768] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:38.572976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.574685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:38.591603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729855cb-8b38-4bb0-a63c-2f840dfe010a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.598652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600c95b-f9ce-4b5b-9e0d-809eef8374c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.599868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c95b-f9ce-4b5b-9e0d-809eef8374c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.600675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c95b-f9ce-4b5b-9e0d-809eef8374c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.601058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c95b-f9ce-4b5b-9e0d-809eef8374c9 admin admin] PATH_INFO: `/v3/projects/4929d77b858b4d848172346c97160377/users/ad93f38d6b384bcf9b1b190a9abb27ce/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.620486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600c95b-f9ce-4b5b-9e0d-809eef8374c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4929d77b858b4d848172346c97160377, user_id=ad93f38d6b384bcf9b1b190a9abb27ce, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.625223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600c95b-f9ce-4b5b-9e0d-809eef8374c9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.633720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.636027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:38.662763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edcb27-6994-45a5-a29c-c997ce13fb36 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.664198 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3376/6769] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:38 2022] PUT /identity/v3/projects/4929d77b858b4d848172346c97160377/users/ad93f38d6b384bcf9b1b190a9abb27ce/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:38.669363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a50d5-ee31-44ea-bdbd-e49e7c0cd3b6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.669968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a50d5-ee31-44ea-bdbd-e49e7c0cd3b6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.670545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a50d5-ee31-44ea-bdbd-e49e7c0cd3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.699806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8a5a50d5-ee31-44ea-bdbd-e49e7c0cd3b6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:38.703448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a5a50d5-ee31-44ea-bdbd-e49e7c0cd3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:38.746017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.747563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.748699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.748699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] PATH_INFO: `/v3/projects/9f7a8678732a40b383cedd20600e102e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.750901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7a8678732a40b383cedd20600e102e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.753376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.782133 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3377/6770] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:38.794300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a50d5-ee31-44ea-bdbd-e49e7c0cd3b6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.796570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8a5a50d5-ee31-44ea-bdbd-e49e7c0cd3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:38.813938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7a8678732a40b383cedd20600e102e', 'request_id': 'req-7541aa80-d668-4fdb-9863-cb852896818d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.827040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7a8678732a40b383cedd20600e102e', 'request_id': 'req-7541aa80-d668-4fdb-9863-cb852896818d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.845698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7a8678732a40b383cedd20600e102e', 'request_id': 'req-7541aa80-d668-4fdb-9863-cb852896818d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.859125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] The token cache is being invalidate because project 9f7a8678732a40b383cedd20600e102e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:38.859425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.860794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:38.862311 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3394/6771] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:38 2022] DELETE /identity/v3/projects/9f7a8678732a40b383cedd20600e102e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:38.867914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:38.869787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:38.891415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a50d5-ee31-44ea-bdbd-e49e7c0cd3b6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.945963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541aa80-d668-4fdb-9863-cb852896818d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:38.948437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfca4f-7208-48fc-a125-6c54fbda8b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.949562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfca4f-7208-48fc-a125-6c54fbda8b5a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.949845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfca4f-7208-48fc-a125-6c54fbda8b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.950201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfca4f-7208-48fc-a125-6c54fbda8b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.953699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d2cfca4f-7208-48fc-a125-6c54fbda8b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:38.959252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:38.960160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:38.960484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:38.960909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] PATH_INFO: `/v3/users/a830a1d0b0714d2cb614ccb04dcc0a74` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:38.962167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a830a1d0b0714d2cb614ccb04dcc0a74)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.965700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.981366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfca4f-7208-48fc-a125-6c54fbda8b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:38.983779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfca4f-7208-48fc-a125-6c54fbda8b5a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:38.997616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3378/6772] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:38.999336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3cfe6-757b-47dd-899b-2af5f7c369a7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.000031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3cfe6-757b-47dd-899b-2af5f7c369a7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.000434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3cfe6-757b-47dd-899b-2af5f7c369a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.034643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a830a1d0b0714d2cb614ccb04dcc0a74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:39.050358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a830a1d0b0714d2cb614ccb04dcc0a74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:39.054829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cab3cfe6-757b-47dd-899b-2af5f7c369a7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:39.056471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cab3cfe6-757b-47dd-899b-2af5f7c369a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:39.060635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a830a1d0b0714d2cb614ccb04dcc0a74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:39.061552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a830a1d0b0714d2cb614ccb04dcc0a74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:39.063022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e4848797-26ac-47e8-9320-498d12a09b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a830a1d0b0714d2cb614ccb04dcc0a74'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:39.068795 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3379/6773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:39.078891 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3395/6774] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:38 2022] DELETE /identity/v3/users/a830a1d0b0714d2cb614ccb04dcc0a74 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:39.089393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba094e-4251-4561-a2d8-69c38c359d76 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.089563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1ce42-15cb-43bf-961d-36736faa6a4f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.089856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1ce42-15cb-43bf-961d-36736faa6a4f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.090139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1ce42-15cb-43bf-961d-36736faa6a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.090654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba094e-4251-4561-a2d8-69c38c359d76 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.091004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba094e-4251-4561-a2d8-69c38c359d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.118341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-76ba094e-4251-4561-a2d8-69c38c359d76 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:39.119263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-91b1ce42-15cb-43bf-961d-36736faa6a4f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:39.120203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76ba094e-4251-4561-a2d8-69c38c359d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:39.120615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-91b1ce42-15cb-43bf-961d-36736faa6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:39.200544 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3396/6775] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:39.205773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1ce42-15cb-43bf-961d-36736faa6a4f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.215562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1ce42-15cb-43bf-961d-36736faa6a4f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.221097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:39.221774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.222070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.222331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.223130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:39.223439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:39.225076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:39.226663 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3380/6776] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:39.235797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba094e-4251-4561-a2d8-69c38c359d76 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.237681 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3397/6777] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:15:39.239261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76ba094e-4251-4561-a2d8-69c38c359d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:39.242549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.258300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3667-625d-4ebb-b863-a89091ca7d34 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.265236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cb92f-7f54-4577-a0f9-9f19bed1184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:39.266243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb92f-7f54-4577-a0f9-9f19bed1184a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.266601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb92f-7f54-4577-a0f9-9f19bed1184a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.267011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb92f-7f54-4577-a0f9-9f19bed1184a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.267907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cb92f-7f54-4577-a0f9-9f19bed1184a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:39.270019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cb92f-7f54-4577-a0f9-9f19bed1184a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:39.308778 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3398/6778] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:39 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:39.310442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cb92f-7f54-4577-a0f9-9f19bed1184a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.332900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba094e-4251-4561-a2d8-69c38c359d76 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.389258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cb92f-7f54-4577-a0f9-9f19bed1184a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.403477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6215006-5651-471c-abeb-9c84dfbd92c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:39.404961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6215006-5651-471c-abeb-9c84dfbd92c1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.405991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6215006-5651-471c-abeb-9c84dfbd92c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.415231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6215006-5651-471c-abeb-9c84dfbd92c1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.416661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6215006-5651-471c-abeb-9c84dfbd92c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:39.434134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcdd90-cc4c-4d8a-aa83-7545e307cc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:39.435166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcdd90-cc4c-4d8a-aa83-7545e307cc42 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.435455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcdd90-cc4c-4d8a-aa83-7545e307cc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.436181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcdd90-cc4c-4d8a-aa83-7545e307cc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.437871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6215006-5651-471c-abeb-9c84dfbd92c1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:39.449762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcdd90-cc4c-4d8a-aa83-7545e307cc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:39.451576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcdd90-cc4c-4d8a-aa83-7545e307cc42 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:39.466249 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3381/6779] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:39.488648 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3399/6780] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:39 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:39.489983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcdd90-cc4c-4d8a-aa83-7545e307cc42 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.502490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcdd90-cc4c-4d8a-aa83-7545e307cc42 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.509001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d309c22-52ba-41c1-bc6f-e895d5bc7bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:39.510096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309c22-52ba-41c1-bc6f-e895d5bc7bfa admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.510096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309c22-52ba-41c1-bc6f-e895d5bc7bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.510696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309c22-52ba-41c1-bc6f-e895d5bc7bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.511700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d309c22-52ba-41c1-bc6f-e895d5bc7bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:39.515552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d309c22-52ba-41c1-bc6f-e895d5bc7bfa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:39.529790 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3382/6781] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:39.531682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6215006-5651-471c-abeb-9c84dfbd92c1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.549294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6215006-5651-471c-abeb-9c84dfbd92c1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.557417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc06a77-02b4-4bb2-9caf-d979bbf8ee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:39.558830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc06a77-02b4-4bb2-9caf-d979bbf8ee4e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.559400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc06a77-02b4-4bb2-9caf-d979bbf8ee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.560167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc06a77-02b4-4bb2-9caf-d979bbf8ee4e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.562757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc06a77-02b4-4bb2-9caf-d979bbf8ee4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:39.565004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc06a77-02b4-4bb2-9caf-d979bbf8ee4e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:39.584729 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3400/6782] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:39.588228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d309c22-52ba-41c1-bc6f-e895d5bc7bfa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.602627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d309c22-52ba-41c1-bc6f-e895d5bc7bfa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.611292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7754958-d5b1-4ecd-9c10-1d2b825496d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:39.612550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754958-d5b1-4ecd-9c10-1d2b825496d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.614155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754958-d5b1-4ecd-9c10-1d2b825496d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.614618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754958-d5b1-4ecd-9c10-1d2b825496d0 admin admin] PATH_INFO: `/v3/projects/50e358b169d34c9abc0afe489b9863e3/users/8547e127157e446fae196f4627d66773/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.638414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7754958-d5b1-4ecd-9c10-1d2b825496d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e358b169d34c9abc0afe489b9863e3, user_id=8547e127157e446fae196f4627d66773, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:39.644656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7754958-d5b1-4ecd-9c10-1d2b825496d0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:39.669165 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3383/6783] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:39 2022] PUT /identity/v3/projects/50e358b169d34c9abc0afe489b9863e3/users/8547e127157e446fae196f4627d66773/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:39.680833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e474-fb17-42ca-a4c9-9954ce77b502 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.681047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e474-fb17-42ca-a4c9-9954ce77b502 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.681175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e474-fb17-42ca-a4c9-9954ce77b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.729843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-05a3e474-fb17-42ca-a4c9-9954ce77b502 None None] MFA Rules not processed for user `8547e127157e446fae196f4627d66773`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:39.731104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-05a3e474-fb17-42ca-a4c9-9954ce77b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:39.848050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7754958-d5b1-4ecd-9c10-1d2b825496d0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.856312 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3401/6784] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:39.932750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7754958-d5b1-4ecd-9c10-1d2b825496d0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.939092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48916-3621-4fb2-81f7-1c39b007a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:39.939773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48916-3621-4fb2-81f7-1c39b007a63c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:39.940057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48916-3621-4fb2-81f7-1c39b007a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:39.941627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48916-3621-4fb2-81f7-1c39b007a63c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:39.941627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f48916-3621-4fb2-81f7-1c39b007a63c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:39.943072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f48916-3621-4fb2-81f7-1c39b007a63c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:39.966737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3e474-fb17-42ca-a4c9-9954ce77b502 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:39.968318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-05a3e474-fb17-42ca-a4c9-9954ce77b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:39.983157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3e474-fb17-42ca-a4c9-9954ce77b502 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:39.984941 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3384/6785] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:39 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:39.989488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48916-3621-4fb2-81f7-1c39b007a63c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:40.057070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.058462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.058975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.059293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] PATH_INFO: `/v3/projects/febb867c941d4dbab905f7b936ba4238` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.061812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=febb867c941d4dbab905f7b936ba4238)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.065111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:40.073583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48916-3621-4fb2-81f7-1c39b007a63c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:40.079909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6dc76-1058-4c75-9220-f8f3a23e4612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.080635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dc76-1058-4c75-9220-f8f3a23e4612 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.080918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dc76-1058-4c75-9220-f8f3a23e4612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.081185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dc76-1058-4c75-9220-f8f3a23e4612 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.081892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6dc76-1058-4c75-9220-f8f3a23e4612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.083854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6dc76-1058-4c75-9220-f8f3a23e4612 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:40.107485 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3385/6786] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:39 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:40.111938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6dc76-1058-4c75-9220-f8f3a23e4612 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:40.124623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6dc76-1058-4c75-9220-f8f3a23e4612 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:40.152397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febb867c941d4dbab905f7b936ba4238', 'request_id': 'req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.163360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febb867c941d4dbab905f7b936ba4238', 'request_id': 'req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.181661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febb867c941d4dbab905f7b936ba4238', 'request_id': 'req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.196139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.197173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.197456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.197740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.198505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.200460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:40.201254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] The token cache is being invalidate because project febb867c941d4dbab905f7b936ba4238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:40.201941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.202996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.205178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3402/6787] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:39 2022] DELETE /identity/v3/projects/febb867c941d4dbab905f7b936ba4238 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:40.209114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:40.210810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:40.220146 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3386/6788] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:40.225465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ed01-05c8-42ef-b4eb-450fa8ffcf3f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:40.229937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:40.231334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.232352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.232742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.233122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] PATH_INFO: `/v3/users/62a645ac82114735b0fa9c4e5f054251` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.234601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a645ac82114735b0fa9c4e5f054251)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.236193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:40.236787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:40.254713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc4bd-0c4d-4875-bf54-720de97ee219 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:40.266993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.270309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.270809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.271559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] PATH_INFO: `/v3/projects/955ed9bd345e45899714e2a4d42accea/users/23a216720d8e41d4b53ebd1dd573fa52/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.306183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a645ac82114735b0fa9c4e5f054251'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.309836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=955ed9bd345e45899714e2a4d42accea, user_id=23a216720d8e41d4b53ebd1dd573fa52, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.317444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:40.333349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a645ac82114735b0fa9c4e5f054251'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.338111 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3387/6789] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:40 2022] PUT /identity/v3/projects/955ed9bd345e45899714e2a4d42accea/users/23a216720d8e41d4b53ebd1dd573fa52/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:40.342628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a645ac82114735b0fa9c4e5f054251'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.343741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a645ac82114735b0fa9c4e5f054251'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.343942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:40.344834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a645ac82114735b0fa9c4e5f054251'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:40.349436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:40.362811 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3403/6790] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:40 2022] DELETE /identity/v3/users/62a645ac82114735b0fa9c4e5f054251 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:40.457008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf689-6c5f-4da2-8d35-f61b581ff61c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:40.534692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ab942-13f9-48d0-882d-b53966bd51b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.535155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ab942-13f9-48d0-882d-b53966bd51b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.535456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ab942-13f9-48d0-882d-b53966bd51b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.535754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ab942-13f9-48d0-882d-b53966bd51b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.536570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ab942-13f9-48d0-882d-b53966bd51b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.538686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ab942-13f9-48d0-882d-b53966bd51b6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:40.549732 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3388/6791] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:40.554158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:40.568491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96727f-8df0-4abb-b586-8fedbc81f8cc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:40.573968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87748d-97ad-48b0-a80f-9ce8ac13fd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.575825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87748d-97ad-48b0-a80f-9ce8ac13fd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.575825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87748d-97ad-48b0-a80f-9ce8ac13fd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.575825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87748d-97ad-48b0-a80f-9ce8ac13fd5b admin admin] PATH_INFO: `/v3/projects/955ed9bd345e45899714e2a4d42accea/users/23a216720d8e41d4b53ebd1dd573fa52/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.578485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87748d-97ad-48b0-a80f-9ce8ac13fd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=955ed9bd345e45899714e2a4d42accea, user_id=23a216720d8e41d4b53ebd1dd573fa52, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.582477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87748d-97ad-48b0-a80f-9ce8ac13fd5b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:40.606325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f1fe1-6a09-4fd4-8213-e487977e672b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.606762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f1fe1-6a09-4fd4-8213-e487977e672b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.607076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f1fe1-6a09-4fd4-8213-e487977e672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.608564 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3404/6792] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:40 2022] PUT /identity/v3/projects/955ed9bd345e45899714e2a4d42accea/users/23a216720d8e41d4b53ebd1dd573fa52/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:40.636589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d45f1fe1-6a09-4fd4-8213-e487977e672b None None] MFA Rules not processed for user `23a216720d8e41d4b53ebd1dd573fa52`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:40.637960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d45f1fe1-6a09-4fd4-8213-e487977e672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:40.756379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87748d-97ad-48b0-a80f-9ce8ac13fd5b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:40.759233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3389/6793] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:40.770669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87748d-97ad-48b0-a80f-9ce8ac13fd5b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:40.776843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e169e2-272f-481b-a5d3-02dd8979899d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.777907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e169e2-272f-481b-a5d3-02dd8979899d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.778477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e169e2-272f-481b-a5d3-02dd8979899d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.778760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e169e2-272f-481b-a5d3-02dd8979899d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.779621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e169e2-272f-481b-a5d3-02dd8979899d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.782225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e169e2-272f-481b-a5d3-02dd8979899d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:40.821073 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3405/6794] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:40 2022] POST /identity/v3/projects => generated 351 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:40.831520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f1fe1-6a09-4fd4-8213-e487977e672b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:40.845426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f1fe1-6a09-4fd4-8213-e487977e672b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:40.858902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461808a-24c2-4515-8f46-cf084c335dc3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.859574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461808a-24c2-4515-8f46-cf084c335dc3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.859909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461808a-24c2-4515-8f46-cf084c335dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.897027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4461808a-24c2-4515-8f46-cf084c335dc3 None None] MFA Rules not processed for user `ad93f38d6b384bcf9b1b190a9abb27ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:40.899332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4461808a-24c2-4515-8f46-cf084c335dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:40.946113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:40.948062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:40.948386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:40.948659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:40.949371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:40.951577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.001287 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3390/6795] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:40 2022] POST /identity/v3/projects => generated 350 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:41.006025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.008789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:41.023815 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3406/6796] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:41.024880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461808a-24c2-4515-8f46-cf084c335dc3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.036599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461808a-24c2-4515-8f46-cf084c335dc3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.105876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb30984-0e99-4df3-8b02-64fdd390458d tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.114295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.116014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.116717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.117383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] PATH_INFO: `/v3/projects/32c0aa3a26d842ac8a46f12fe1073e54` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.118957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.119339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c0aa3a26d842ac8a46f12fe1073e54)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.120175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.120507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.120901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/users/8547e127157e446fae196f4627d66773` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.121894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.122649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:get_user(user_id=8547e127157e446fae196f4627d66773)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.125804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.128900 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3407/6797] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:15:41 2022] GET /identity/v3/users/8547e127157e446fae196f4627d66773 => generated 288 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:41.129537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.131264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:41.147674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aad90-fd2e-4de5-a68a-400633318984 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.153521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157b9e8-bcbe-4f90-90df-97686b2c8f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.154329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157b9e8-bcbe-4f90-90df-97686b2c8f0f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.154659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157b9e8-bcbe-4f90-90df-97686b2c8f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.155598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157b9e8-bcbe-4f90-90df-97686b2c8f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.156789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157b9e8-bcbe-4f90-90df-97686b2c8f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.158502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157b9e8-bcbe-4f90-90df-97686b2c8f0f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.194894 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3408/6798] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:41 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:41.194894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157b9e8-bcbe-4f90-90df-97686b2c8f0f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.215276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c0aa3a26d842ac8a46f12fe1073e54', 'request_id': 'req-94f67779-1b0b-4de6-8bc3-c9d16a969821'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:41.221819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c0aa3a26d842ac8a46f12fe1073e54', 'request_id': 'req-94f67779-1b0b-4de6-8bc3-c9d16a969821'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:41.234877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c0aa3a26d842ac8a46f12fe1073e54', 'request_id': 'req-94f67779-1b0b-4de6-8bc3-c9d16a969821'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:41.260001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] The token cache is being invalidate because project 32c0aa3a26d842ac8a46f12fe1073e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:41.260413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:41.261170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:41.269674 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3391/6799] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:41 2022] DELETE /identity/v3/projects/32c0aa3a26d842ac8a46f12fe1073e54 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:41.270977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.274735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:41.291538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157b9e8-bcbe-4f90-90df-97686b2c8f0f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.297466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12010da5-ca1b-493e-8150-d82a03cea613 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.297962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010da5-ca1b-493e-8150-d82a03cea613 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.298251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010da5-ca1b-493e-8150-d82a03cea613 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.298536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010da5-ca1b-493e-8150-d82a03cea613 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.299260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12010da5-ca1b-493e-8150-d82a03cea613 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.301073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12010da5-ca1b-493e-8150-d82a03cea613 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.319397 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3409/6800] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Feb 19 21:15:41 2022] POST /identity/v3/credentials => generated 429 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:41.320802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e6b5-7b22-4e1b-a55a-1b1a5ecbef68 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.321092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e6b5-7b22-4e1b-a55a-1b1a5ecbef68 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.321407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e6b5-7b22-4e1b-a55a-1b1a5ecbef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.344373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0f62e6b5-7b22-4e1b-a55a-1b1a5ecbef68 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:41.347365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f62e6b5-7b22-4e1b-a55a-1b1a5ecbef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:41.374703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f67779-1b0b-4de6-8bc3-c9d16a969821 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.471429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f44a2c-56c1-4bbb-ab60-e284b07a43c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.472690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f44a2c-56c1-4bbb-ab60-e284b07a43c1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.473150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f44a2c-56c1-4bbb-ab60-e284b07a43c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.473436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f44a2c-56c1-4bbb-ab60-e284b07a43c1 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.474205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f44a2c-56c1-4bbb-ab60-e284b07a43c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.476250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f44a2c-56c1-4bbb-ab60-e284b07a43c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.488940 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3410/6801] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:41.492577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e6b5-7b22-4e1b-a55a-1b1a5ecbef68 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.492577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f62e6b5-7b22-4e1b-a55a-1b1a5ecbef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:41.512901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e6b5-7b22-4e1b-a55a-1b1a5ecbef68 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.518864 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3392/6802] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:41 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:41.518864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030afbe-526f-4b2b-ab35-adc049e14d8b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.518864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030afbe-526f-4b2b-ab35-adc049e14d8b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.518864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030afbe-526f-4b2b-ab35-adc049e14d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.519498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.519859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.520122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.520439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials/bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.522750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.524529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.526446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.528390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.540049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b030afbe-526f-4b2b-ab35-adc049e14d8b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:41.542037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b030afbe-526f-4b2b-ab35-adc049e14d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:41.552939 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3393/6803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:41.558100 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3411/6804] 10.222.0.30 () {60 vars in 1357 bytes} [Sat Feb 19 21:15:41 2022] PATCH /identity/v3/credentials/bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3 => generated 436 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:41.558347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030afbe-526f-4b2b-ab35-adc049e14d8b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.559001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.568748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030afbe-526f-4b2b-ab35-adc049e14d8b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.574785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d010d8-a285-42b6-a044-e4b57505c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.576442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d010d8-a285-42b6-a044-e4b57505c69f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.576442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d010d8-a285-42b6-a044-e4b57505c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.576442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d010d8-a285-42b6-a044-e4b57505c69f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.577301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d010d8-a285-42b6-a044-e4b57505c69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.579543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d010d8-a285-42b6-a044-e4b57505c69f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.585592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac542-ee3f-4b3d-894a-e2d4fb7f5505 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.596136 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3394/6805] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:41.596136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d010d8-a285-42b6-a044-e4b57505c69f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.601342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.602759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.603392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.604006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.605499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:41.606205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.610953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d010d8-a285-42b6-a044-e4b57505c69f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.611513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.617029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab1be6-d192-4507-885a-7ea1fd09f6df tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.618574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab1be6-d192-4507-885a-7ea1fd09f6df tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.618960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab1be6-d192-4507-885a-7ea1fd09f6df tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.620110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab1be6-d192-4507-885a-7ea1fd09f6df tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials/bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.627572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab1be6-d192-4507-885a-7ea1fd09f6df tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.629812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab1be6-d192-4507-885a-7ea1fd09f6df tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.632679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3395/6806] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Feb 19 21:15:41 2022] GET /identity/v3/credentials/bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3 => generated 436 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:41.633844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab1be6-d192-4507-885a-7ea1fd09f6df tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.640120 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3412/6807] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:41.642033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.646250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab1be6-d192-4507-885a-7ea1fd09f6df tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.652735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f714cf-c355-4038-8caa-87f2ded9cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.653813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f714cf-c355-4038-8caa-87f2ded9cd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.654100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f714cf-c355-4038-8caa-87f2ded9cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.654505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f714cf-c355-4038-8caa-87f2ded9cd41 admin admin] PATH_INFO: `/v3/projects/93ca6669fa674f74abb94f9f1eb19426/users/cb9d52fae3fd4bb8b3e995990ccc9c2e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.669943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001160e-51fd-4bd8-9e83-529cf07c053f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.675310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f714cf-c355-4038-8caa-87f2ded9cd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ca6669fa674f74abb94f9f1eb19426, user_id=cb9d52fae3fd4bb8b3e995990ccc9c2e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.678149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ac1d2-5af9-4af7-ae37-5690cdf4eafc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.678329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f714cf-c355-4038-8caa-87f2ded9cd41 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.679718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac1d2-5af9-4af7-ae37-5690cdf4eafc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.680185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac1d2-5af9-4af7-ae37-5690cdf4eafc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.680753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac1d2-5af9-4af7-ae37-5690cdf4eafc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials/bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.685325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac1d2-5af9-4af7-ae37-5690cdf4eafc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.688416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac1d2-5af9-4af7-ae37-5690cdf4eafc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.694653 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3396/6808] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:41 2022] PUT /identity/v3/projects/93ca6669fa674f74abb94f9f1eb19426/users/cb9d52fae3fd4bb8b3e995990ccc9c2e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:41.695533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f714cf-c355-4038-8caa-87f2ded9cd41 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.720685 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3413/6809] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Feb 19 21:15:41 2022] DELETE /identity/v3/credentials/bf9e37319231f637b21c52fd10c907d426a307fb28c0a78532ed3cf3fb013de3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:41.722772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ac1d2-5af9-4af7-ae37-5690cdf4eafc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.758583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ac1d2-5af9-4af7-ae37-5690cdf4eafc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.823031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f714cf-c355-4038-8caa-87f2ded9cd41 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.829519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c603851-6cda-4074-a3bf-6b4e20275c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.830199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c603851-6cda-4074-a3bf-6b4e20275c68 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.830484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c603851-6cda-4074-a3bf-6b4e20275c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.830767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c603851-6cda-4074-a3bf-6b4e20275c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.831554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c603851-6cda-4074-a3bf-6b4e20275c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.834414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c603851-6cda-4074-a3bf-6b4e20275c68 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.863045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3251-2823-4943-af5f-f0c3024a9928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.863931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3251-2823-4943-af5f-f0c3024a9928 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.864373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3251-2823-4943-af5f-f0c3024a9928 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.864758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3251-2823-4943-af5f-f0c3024a9928 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.865569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3251-2823-4943-af5f-f0c3024a9928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.867456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3251-2823-4943-af5f-f0c3024a9928 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.875591 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3397/6810] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:41 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:41.876649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c603851-6cda-4074-a3bf-6b4e20275c68 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.885652 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3414/6811] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:41.886262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3251-2823-4943-af5f-f0c3024a9928 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:41.897142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3251-2823-4943-af5f-f0c3024a9928 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.971276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f31ac-1e71-4f82-bdd7-53f8bb8eac48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.972179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f31ac-1e71-4f82-bdd7-53f8bb8eac48 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.972521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f31ac-1e71-4f82-bdd7-53f8bb8eac48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.972802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f31ac-1e71-4f82-bdd7-53f8bb8eac48 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:41.973502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f31ac-1e71-4f82-bdd7-53f8bb8eac48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:41.975623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f31ac-1e71-4f82-bdd7-53f8bb8eac48 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:41.990130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c603851-6cda-4074-a3bf-6b4e20275c68 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:41.997572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe436d-9521-4fe6-8ce1-8578136180a7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:41.998737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe436d-9521-4fe6-8ce1-8578136180a7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:41.999599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe436d-9521-4fe6-8ce1-8578136180a7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:41.999961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe436d-9521-4fe6-8ce1-8578136180a7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.000820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe436d-9521-4fe6-8ce1-8578136180a7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.003569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe436d-9521-4fe6-8ce1-8578136180a7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.005884 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3415/6812] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:41 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:42.007244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f31ac-1e71-4f82-bdd7-53f8bb8eac48 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.019165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f31ac-1e71-4f82-bdd7-53f8bb8eac48 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.024711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f326e6-5c1d-45a6-948b-d6ef449e7835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.025869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f326e6-5c1d-45a6-948b-d6ef449e7835 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.026221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f326e6-5c1d-45a6-948b-d6ef449e7835 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.026452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f326e6-5c1d-45a6-948b-d6ef449e7835 admin admin] PATH_INFO: `/v3/projects/93ca6669fa674f74abb94f9f1eb19426/users/cb9d52fae3fd4bb8b3e995990ccc9c2e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.028895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f326e6-5c1d-45a6-948b-d6ef449e7835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ca6669fa674f74abb94f9f1eb19426, user_id=cb9d52fae3fd4bb8b3e995990ccc9c2e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.031819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f326e6-5c1d-45a6-948b-d6ef449e7835 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.041494 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3398/6813] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Feb 19 21:15:41 2022] POST /identity/v3/credentials => generated 430 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:42.041494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe436d-9521-4fe6-8ce1-8578136180a7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.049715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3416/6814] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:42 2022] PUT /identity/v3/projects/93ca6669fa674f74abb94f9f1eb19426/users/cb9d52fae3fd4bb8b3e995990ccc9c2e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:42.050735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f326e6-5c1d-45a6-948b-d6ef449e7835 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.057955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe436d-9521-4fe6-8ce1-8578136180a7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.142155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08bdfd-8ad1-45f4-93fe-79f18ac282cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.142833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08bdfd-8ad1-45f4-93fe-79f18ac282cb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.143039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08bdfd-8ad1-45f4-93fe-79f18ac282cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.143319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08bdfd-8ad1-45f4-93fe-79f18ac282cb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.144055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08bdfd-8ad1-45f4-93fe-79f18ac282cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.146118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08bdfd-8ad1-45f4-93fe-79f18ac282cb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.164785 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3399/6815] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:42.166768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08bdfd-8ad1-45f4-93fe-79f18ac282cb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.178138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08bdfd-8ad1-45f4-93fe-79f18ac282cb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.182739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f326e6-5c1d-45a6-948b-d6ef449e7835 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.184903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972279b6-8039-4cc1-bee7-5d18be01e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.185581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972279b6-8039-4cc1-bee7-5d18be01e03d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.185865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972279b6-8039-4cc1-bee7-5d18be01e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.186143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972279b6-8039-4cc1-bee7-5d18be01e03d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.187592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972279b6-8039-4cc1-bee7-5d18be01e03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.189542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972279b6-8039-4cc1-bee7-5d18be01e03d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.190465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747dd26-9995-4dba-a2ad-78d8c43c7de7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.191576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747dd26-9995-4dba-a2ad-78d8c43c7de7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.191576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747dd26-9995-4dba-a2ad-78d8c43c7de7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.191860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747dd26-9995-4dba-a2ad-78d8c43c7de7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.192578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747dd26-9995-4dba-a2ad-78d8c43c7de7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.194343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747dd26-9995-4dba-a2ad-78d8c43c7de7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.201707 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3400/6816] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:42.205895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972279b6-8039-4cc1-bee7-5d18be01e03d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.221803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972279b6-8039-4cc1-bee7-5d18be01e03d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.225221 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3417/6817] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Feb 19 21:15:42 2022] POST /identity/v3/credentials => generated 429 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:42.231739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8942-5fdf-4e42-9ecb-c49ff9e835ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.232781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8942-5fdf-4e42-9ecb-c49ff9e835ad admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.233127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8942-5fdf-4e42-9ecb-c49ff9e835ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.233362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea8942-5fdf-4e42-9ecb-c49ff9e835ad admin admin] PATH_INFO: `/v3/projects/ee1f38ceb0d34c39af97d64199951236/users/38327ff993634f09ba329d92e58c9576/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.237046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747dd26-9995-4dba-a2ad-78d8c43c7de7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.265592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea8942-5fdf-4e42-9ecb-c49ff9e835ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1f38ceb0d34c39af97d64199951236, user_id=38327ff993634f09ba329d92e58c9576, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.268442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea8942-5fdf-4e42-9ecb-c49ff9e835ad admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.276614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747dd26-9995-4dba-a2ad-78d8c43c7de7 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.288955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.290154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.290768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.291557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.293212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.299301 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3401/6818] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:42 2022] PUT /identity/v3/projects/ee1f38ceb0d34c39af97d64199951236/users/38327ff993634f09ba329d92e58c9576/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:42.299887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.314343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.318312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.330105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.334377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f2d2-d3dc-498e-8b0d-b1880635ae81 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.339255 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3418/6819] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Feb 19 21:15:42 2022] GET /identity/v3/credentials => generated 944 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:42.344344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8942-5fdf-4e42-9ecb-c49ff9e835ad admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.402222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d141d2-6ed8-40a9-a401-12531badc86f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.402515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d141d2-6ed8-40a9-a401-12531badc86f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.402780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d141d2-6ed8-40a9-a401-12531badc86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.437440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-01d141d2-6ed8-40a9-a401-12531badc86f None None] MFA Rules not processed for user `38327ff993634f09ba329d92e58c9576`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:42.438765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-01d141d2-6ed8-40a9-a401-12531badc86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:42.492481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea8942-5fdf-4e42-9ecb-c49ff9e835ad admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.498526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa556f-5f71-4294-82fa-70d27245beb6 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.500104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa556f-5f71-4294-82fa-70d27245beb6 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.501245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa556f-5f71-4294-82fa-70d27245beb6 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.501730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa556f-5f71-4294-82fa-70d27245beb6 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials/b2c561d54c23a983d1960bd4bec3130a503745acd246c23bcd967e96e5d70730` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.504105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa556f-5f71-4294-82fa-70d27245beb6 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=b2c561d54c23a983d1960bd4bec3130a503745acd246c23bcd967e96e5d70730)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.506432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa556f-5f71-4294-82fa-70d27245beb6 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.538711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3402/6820] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Feb 19 21:15:42 2022] DELETE /identity/v3/credentials/b2c561d54c23a983d1960bd4bec3130a503745acd246c23bcd967e96e5d70730 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:42.543609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa556f-5f71-4294-82fa-70d27245beb6 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.575083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa556f-5f71-4294-82fa-70d27245beb6 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.582210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb42f59-ce8d-4eaa-816e-cd8b1844a0b3 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.583148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb42f59-ce8d-4eaa-816e-cd8b1844a0b3 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.583685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb42f59-ce8d-4eaa-816e-cd8b1844a0b3 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.583974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb42f59-ce8d-4eaa-816e-cd8b1844a0b3 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/credentials/726ee9722c9cec00d232d53314f45dca89376fab457b612e6ac69e85153cf8ef` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.586457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb42f59-ce8d-4eaa-816e-cd8b1844a0b3 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=726ee9722c9cec00d232d53314f45dca89376fab457b612e6ac69e85153cf8ef)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.588321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb42f59-ce8d-4eaa-816e-cd8b1844a0b3 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.597044 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3419/6821] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:42.617920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d141d2-6ed8-40a9-a401-12531badc86f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.622331 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3403/6822] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Feb 19 21:15:42 2022] DELETE /identity/v3/credentials/726ee9722c9cec00d232d53314f45dca89376fab457b612e6ac69e85153cf8ef => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:42.623495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-01d141d2-6ed8-40a9-a401-12531badc86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:42.623840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb42f59-ce8d-4eaa-816e-cd8b1844a0b3 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.645582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb42f59-ce8d-4eaa-816e-cd8b1844a0b3 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:42.651732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:42.653084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:42.653686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:42.654149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/projects/a303eea7d61f48a6820c7444a9bb2987` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:42.656005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a303eea7d61f48a6820c7444a9bb2987)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:42.658327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:42.755722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a303eea7d61f48a6820c7444a9bb2987', 'request_id': 'req-4eba0a43-ece0-4d29-b430-b4e088e81701'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:42.765393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a303eea7d61f48a6820c7444a9bb2987', 'request_id': 'req-4eba0a43-ece0-4d29-b430-b4e088e81701'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:42.779034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a303eea7d61f48a6820c7444a9bb2987', 'request_id': 'req-4eba0a43-ece0-4d29-b430-b4e088e81701'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:42.806930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] The token cache is being invalidate because project a303eea7d61f48a6820c7444a9bb2987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:42.807731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:42.811008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:42.815250 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3404/6823] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:42 2022] DELETE /identity/v3/projects/a303eea7d61f48a6820c7444a9bb2987 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:42.820018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:42.827582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:42.880235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d141d2-6ed8-40a9-a401-12531badc86f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:43.017635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0a43-ece0-4d29-b430-b4e088e81701 tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:43.037618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:43.038203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a216720d8e41d4b53ebd1dd573fa52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955ed9bd345e45899714e2a4d42accea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:43.039596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:43.040064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:43.040434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:43.040621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] PATH_INFO: `/v3/projects/577bb8609ce3439498d89b37391a72be` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:43.041280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:43.041860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:43.042669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorizing `identity:delete_project(project_id=577bb8609ce3439498d89b37391a72be)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:43.044920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:43.046355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:43.123033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:43.124997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:43.138281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577bb8609ce3439498d89b37391a72be', 'request_id': 'req-e0057e9c-9777-48a3-8eca-49add02b0dcc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.147689 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3420/6824] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:43.149976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577bb8609ce3439498d89b37391a72be', 'request_id': 'req-e0057e9c-9777-48a3-8eca-49add02b0dcc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.165321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577bb8609ce3439498d89b37391a72be', 'request_id': 'req-e0057e9c-9777-48a3-8eca-49add02b0dcc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.196262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] The token cache is being invalidate because project 577bb8609ce3439498d89b37391a72be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:43.197349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.198723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e0057e9c-9777-48a3-8eca-49add02b0dcc tempest-CredentialsTestJSON-1585325884 tempest-CredentialsTestJSON-1585325884-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.204795 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3405/6825] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:42 2022] DELETE /identity/v3/projects/577bb8609ce3439498d89b37391a72be => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:43.208127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:43.209986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:43.265707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0011-721c-4330-8100-91df8cdf9083 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:43.266542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0011-721c-4330-8100-91df8cdf9083 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:43.267277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0011-721c-4330-8100-91df8cdf9083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:43.320844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1b4b0011-721c-4330-8100-91df8cdf9083 None None] MFA Rules not processed for user `cb9d52fae3fd4bb8b3e995990ccc9c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:43.322503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1b4b0011-721c-4330-8100-91df8cdf9083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:43.345119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455330c9-b764-461d-8796-1fdec89db614 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:43.456657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:43.458576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:43.458869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:43.459122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] PATH_INFO: `/v3/users/8547e127157e446fae196f4627d66773` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:43.460746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8547e127157e446fae196f4627d66773)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:43.463700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:43.534326 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3406/6826] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:43.548722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8547e127157e446fae196f4627d66773'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.557567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd19a3-429a-4938-9028-d9b80e3d5e2e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:43.558329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd19a3-429a-4938-9028-d9b80e3d5e2e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:43.559033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd19a3-429a-4938-9028-d9b80e3d5e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:43.562820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8547e127157e446fae196f4627d66773'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.576492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8547e127157e446fae196f4627d66773'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.577971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8547e127157e446fae196f4627d66773'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.578832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-808fca9e-7c30-4628-b445-ef3f76363ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8547e127157e446fae196f4627d66773'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:43.599688 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3421/6827] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:43 2022] DELETE /identity/v3/users/8547e127157e446fae196f4627d66773 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:43.602836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02142-694c-4c0f-8042-b84e8e6f7c07 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:43.603189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02142-694c-4c0f-8042-b84e8e6f7c07 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:43.603907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02142-694c-4c0f-8042-b84e8e6f7c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:43.610613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-28fd19a3-429a-4938-9028-d9b80e3d5e2e None None] MFA Rules not processed for user `ad93f38d6b384bcf9b1b190a9abb27ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:43.615876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-28fd19a3-429a-4938-9028-d9b80e3d5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:43.627162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d7c02142-694c-4c0f-8042-b84e8e6f7c07 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:43.628411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d7c02142-694c-4c0f-8042-b84e8e6f7c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:43.737666 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3422/6828] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:43.747618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02142-694c-4c0f-8042-b84e8e6f7c07 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:43.750600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d7c02142-694c-4c0f-8042-b84e8e6f7c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:43.759556 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3407/6829] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:43.779382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd19a3-429a-4938-9028-d9b80e3d5e2e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:43.785402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-28fd19a3-429a-4938-9028-d9b80e3d5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:43.864605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02142-694c-4c0f-8042-b84e8e6f7c07 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:43.872776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:43.874675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:43.875180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:43.875717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:43.893718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:43.896368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:43.915335 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3423/6830] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:43.982744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd19a3-429a-4938-9028-d9b80e3d5e2e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:43.991065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:43.992299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:43.992638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:43.993119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:43.995356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:44.015239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:44.017362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:44.035471 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3408/6831] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:45.385322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:45.387738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:45.443893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ffcc9-2bbf-4c24-9d4a-12fdebd9d449 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:45.458864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:45.460200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:45.460679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:45.461150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] PATH_INFO: `/v3/projects/50e358b169d34c9abc0afe489b9863e3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:45.463201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e358b169d34c9abc0afe489b9863e3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:45.470929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:45.589781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e358b169d34c9abc0afe489b9863e3', 'request_id': 'req-9f256d87-1d70-488f-9734-7205a0433787'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:45.604762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e358b169d34c9abc0afe489b9863e3', 'request_id': 'req-9f256d87-1d70-488f-9734-7205a0433787'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:45.648175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e358b169d34c9abc0afe489b9863e3', 'request_id': 'req-9f256d87-1d70-488f-9734-7205a0433787'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:45.669975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] The token cache is being invalidate because project 50e358b169d34c9abc0afe489b9863e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:45.670625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:45.671748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:45.673987 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3424/6832] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:45 2022] DELETE /identity/v3/projects/50e358b169d34c9abc0afe489b9863e3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:45.679855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:45.715076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb84c56-1f54-4ab3-902a-1954e5261d28 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:45.726153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:45.728229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:45.887268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:45.888955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:45.889712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:45.890195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] PATH_INFO: `/v3/users/23a216720d8e41d4b53ebd1dd573fa52` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:45.892250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a216720d8e41d4b53ebd1dd573fa52)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:45.895920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:45.926508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256d87-1d70-488f-9734-7205a0433787 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:45.948993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:45.950469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:45.951144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:45.951639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:45.955469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:45.992322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:45.997993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:46.008368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a216720d8e41d4b53ebd1dd573fa52'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:46.009426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a216720d8e41d4b53ebd1dd573fa52'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:46.010559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a216720d8e41d4b53ebd1dd573fa52'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:46.036693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a216720d8e41d4b53ebd1dd573fa52'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:46.040128 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3425/6833] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:46.049845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6af74cad-038b-4ec3-a0d9-f2514bf0c9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a216720d8e41d4b53ebd1dd573fa52'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:46.087056 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3409/6834] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:45 2022] DELETE /identity/v3/users/23a216720d8e41d4b53ebd1dd573fa52 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:46.849336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:46.850864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:46.874655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537134d8-c5d6-4dd4-ae53-9609c1815692 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:46.997657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:46.999173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:46.999539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.000913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] PATH_INFO: `/v3/projects/955ed9bd345e45899714e2a4d42accea` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.002374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=955ed9bd345e45899714e2a4d42accea)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:47.005076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:47.122444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955ed9bd345e45899714e2a4d42accea', 'request_id': 'req-af1ad25d-7847-423c-bd52-45b539e2b28c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:47.134104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955ed9bd345e45899714e2a4d42accea', 'request_id': 'req-af1ad25d-7847-423c-bd52-45b539e2b28c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:47.145080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955ed9bd345e45899714e2a4d42accea', 'request_id': 'req-af1ad25d-7847-423c-bd52-45b539e2b28c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:47.160563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] The token cache is being invalidate because project 955ed9bd345e45899714e2a4d42accea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:47.160906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:47.161782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-af1ad25d-7847-423c-bd52-45b539e2b28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:47.164623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3426/6835] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:46 2022] DELETE /identity/v3/projects/955ed9bd345e45899714e2a4d42accea => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:47.169425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275c29-2127-42ab-93d6-885bcafc2bb9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.170283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275c29-2127-42ab-93d6-885bcafc2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.171160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275c29-2127-42ab-93d6-885bcafc2bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.192968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-21275c29-2127-42ab-93d6-885bcafc2bb9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:47.194536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-21275c29-2127-42ab-93d6-885bcafc2bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:47.282167 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3410/6836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:47.289859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ebbef-4db0-4a88-96d3-e8b2f7615b76 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.290155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ebbef-4db0-4a88-96d3-e8b2f7615b76 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.290836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ebbef-4db0-4a88-96d3-e8b2f7615b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.318733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b49ebbef-4db0-4a88-96d3-e8b2f7615b76 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:47.320205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b49ebbef-4db0-4a88-96d3-e8b2f7615b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:47.344973 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3427/6837] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:47.349055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21275c29-2127-42ab-93d6-885bcafc2bb9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:47.362183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21275c29-2127-42ab-93d6-885bcafc2bb9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:47.371976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:47.373199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.374210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.374752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.375758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:47.376321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:47.378642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:47.399404 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3411/6838] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:47.402904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ebbef-4db0-4a88-96d3-e8b2f7615b76 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:47.413112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ebbef-4db0-4a88-96d3-e8b2f7615b76 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:47.419376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9f763-779d-4b56-8942-f277cbe0e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:47.420530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f763-779d-4b56-8942-f277cbe0e853 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.420530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f763-779d-4b56-8942-f277cbe0e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.421109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f763-779d-4b56-8942-f277cbe0e853 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.421922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9f763-779d-4b56-8942-f277cbe0e853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:47.424125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9f763-779d-4b56-8942-f277cbe0e853 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:47.473602 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3428/6839] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:47 2022] POST /identity/v3/projects => generated 389 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:47.477666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:47.494897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979e3ac-02aa-4025-8c7e-6117586d80c4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:47.669170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2951-8de3-4b89-87dc-7cb17b483e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:47.669908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2951-8de3-4b89-87dc-7cb17b483e3d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.670193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2951-8de3-4b89-87dc-7cb17b483e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.670649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2951-8de3-4b89-87dc-7cb17b483e3d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.671941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e2951-8de3-4b89-87dc-7cb17b483e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:47.682279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e2951-8de3-4b89-87dc-7cb17b483e3d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:47.745968 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3412/6840] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:47 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:47.746182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9f763-779d-4b56-8942-f277cbe0e853 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:47.764993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9f763-779d-4b56-8942-f277cbe0e853 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:47.777348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03171d69-b9d7-4eb7-a9f4-1472b596c8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:47.778040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03171d69-b9d7-4eb7-a9f4-1472b596c8bb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.778313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03171d69-b9d7-4eb7-a9f4-1472b596c8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.778594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03171d69-b9d7-4eb7-a9f4-1472b596c8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.779373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03171d69-b9d7-4eb7-a9f4-1472b596c8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:47.781742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03171d69-b9d7-4eb7-a9f4-1472b596c8bb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:47.801876 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3429/6841] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:47.805559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2951-8de3-4b89-87dc-7cb17b483e3d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:47.817941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2951-8de3-4b89-87dc-7cb17b483e3d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:47.824404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707b95d-5ebc-4c0b-8d77-ef52858ce7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:47.825102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707b95d-5ebc-4c0b-8d77-ef52858ce7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.825408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707b95d-5ebc-4c0b-8d77-ef52858ce7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.825671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707b95d-5ebc-4c0b-8d77-ef52858ce7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.826417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707b95d-5ebc-4c0b-8d77-ef52858ce7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:47.828633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707b95d-5ebc-4c0b-8d77-ef52858ce7a0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:47.856109 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3413/6842] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:47.857340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03171d69-b9d7-4eb7-a9f4-1472b596c8bb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:47.869245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03171d69-b9d7-4eb7-a9f4-1472b596c8bb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:47.876921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fcef-2c1f-49c9-ad69-74d4eeaaa00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:47.897329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fcef-2c1f-49c9-ad69-74d4eeaaa00e admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.898107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fcef-2c1f-49c9-ad69-74d4eeaaa00e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.907733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fcef-2c1f-49c9-ad69-74d4eeaaa00e admin admin] PATH_INFO: `/v3/projects/62137beb723b4b14b1811628e3f259f0/users/bf11ec37f4e341e6b45045030a0cca71/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:47.927951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324fcef-2c1f-49c9-ad69-74d4eeaaa00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62137beb723b4b14b1811628e3f259f0, user_id=bf11ec37f4e341e6b45045030a0cca71, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:47.932480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324fcef-2c1f-49c9-ad69-74d4eeaaa00e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:47.958225 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3430/6843] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:47 2022] PUT /identity/v3/projects/62137beb723b4b14b1811628e3f259f0/users/bf11ec37f4e341e6b45045030a0cca71/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:47.977845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832621a4-ab00-4a9b-935a-b4d14e1772fd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:47.978582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832621a4-ab00-4a9b-935a-b4d14e1772fd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:47.979319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832621a4-ab00-4a9b-935a-b4d14e1772fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:48.022851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-832621a4-ab00-4a9b-935a-b4d14e1772fd None None] MFA Rules not processed for user `bf11ec37f4e341e6b45045030a0cca71`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:48.024977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-832621a4-ab00-4a9b-935a-b4d14e1772fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:48.171242 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3414/6844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:48.176170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fcef-2c1f-49c9-ad69-74d4eeaaa00e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:48.286787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fcef-2c1f-49c9-ad69-74d4eeaaa00e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:48.293570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb233c4a-cdc5-4459-b397-572c4c650c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:48.294606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233c4a-cdc5-4459-b397-572c4c650c12 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:48.294963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233c4a-cdc5-4459-b397-572c4c650c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:48.295316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233c4a-cdc5-4459-b397-572c4c650c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:48.296306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb233c4a-cdc5-4459-b397-572c4c650c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:48.299401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb233c4a-cdc5-4459-b397-572c4c650c12 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:48.337081 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3431/6845] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:48 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:48.343586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832621a4-ab00-4a9b-935a-b4d14e1772fd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:48.366377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832621a4-ab00-4a9b-935a-b4d14e1772fd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:48.494198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0491bf2-fb52-47c5-835e-4bba71df803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:48.495134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491bf2-fb52-47c5-835e-4bba71df803a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:48.495622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491bf2-fb52-47c5-835e-4bba71df803a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:48.495908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491bf2-fb52-47c5-835e-4bba71df803a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:48.497508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0491bf2-fb52-47c5-835e-4bba71df803a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:48.500380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0491bf2-fb52-47c5-835e-4bba71df803a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:48.527064 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3415/6846] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:48 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:48.531417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb233c4a-cdc5-4459-b397-572c4c650c12 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:48.546831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb233c4a-cdc5-4459-b397-572c4c650c12 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:48.553045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee4ea0-a5d8-4b5b-95aa-0ffc4f5ea237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:48.554065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4ea0-a5d8-4b5b-95aa-0ffc4f5ea237 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:48.554353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4ea0-a5d8-4b5b-95aa-0ffc4f5ea237 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:48.554636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4ea0-a5d8-4b5b-95aa-0ffc4f5ea237 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:48.555369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee4ea0-a5d8-4b5b-95aa-0ffc4f5ea237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:48.557139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee4ea0-a5d8-4b5b-95aa-0ffc4f5ea237 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:48.572405 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3432/6847] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:48.578455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0491bf2-fb52-47c5-835e-4bba71df803a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:48.594432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0491bf2-fb52-47c5-835e-4bba71df803a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:48.600127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8a2f3-4816-4202-90ca-e3aa6e66a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:48.601329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a2f3-4816-4202-90ca-e3aa6e66a77d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:48.601482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a2f3-4816-4202-90ca-e3aa6e66a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:48.601758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a2f3-4816-4202-90ca-e3aa6e66a77d admin admin] PATH_INFO: `/v3/projects/a0450196f463407598eaab1a7abb3913/users/6fa439ce4d22487b8c2de38d074d69ef/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:48.627237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8a2f3-4816-4202-90ca-e3aa6e66a77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0450196f463407598eaab1a7abb3913, user_id=6fa439ce4d22487b8c2de38d074d69ef, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:48.630439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8a2f3-4816-4202-90ca-e3aa6e66a77d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:48.666741 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3416/6848] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:48 2022] PUT /identity/v3/projects/a0450196f463407598eaab1a7abb3913/users/6fa439ce4d22487b8c2de38d074d69ef/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:48.668463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee4ea0-a5d8-4b5b-95aa-0ffc4f5ea237 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:48.679756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee4ea0-a5d8-4b5b-95aa-0ffc4f5ea237 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:48.794487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa67cf-0636-4eca-9910-9c1f445fa064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:48.795188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa67cf-0636-4eca-9910-9c1f445fa064 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:48.795699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa67cf-0636-4eca-9910-9c1f445fa064 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:48.795814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa67cf-0636-4eca-9910-9c1f445fa064 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:48.796708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa67cf-0636-4eca-9910-9c1f445fa064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:48.798398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa67cf-0636-4eca-9910-9c1f445fa064 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:48.822727 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3433/6849] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:15:48.830053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8a2f3-4816-4202-90ca-e3aa6e66a77d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:48.844589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8a2f3-4816-4202-90ca-e3aa6e66a77d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:48.850828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5aabf-b220-431c-8c76-60e9ec553624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:48.852227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5aabf-b220-431c-8c76-60e9ec553624 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:48.852762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5aabf-b220-431c-8c76-60e9ec553624 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:48.853203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5aabf-b220-431c-8c76-60e9ec553624 admin admin] PATH_INFO: `/v3/projects/a0450196f463407598eaab1a7abb3913/users/6fa439ce4d22487b8c2de38d074d69ef/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:48.855545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5aabf-b220-431c-8c76-60e9ec553624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0450196f463407598eaab1a7abb3913, user_id=6fa439ce4d22487b8c2de38d074d69ef, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:48.858719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5aabf-b220-431c-8c76-60e9ec553624 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:48.885432 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3417/6850] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:48 2022] PUT /identity/v3/projects/a0450196f463407598eaab1a7abb3913/users/6fa439ce4d22487b8c2de38d074d69ef/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:48.896286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bdda-bed6-4b00-ae2b-7d42ee848a6a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:48.896919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bdda-bed6-4b00-ae2b-7d42ee848a6a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:48.897006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997bdda-bed6-4b00-ae2b-7d42ee848a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:48.939735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c997bdda-bed6-4b00-ae2b-7d42ee848a6a None None] MFA Rules not processed for user `6fa439ce4d22487b8c2de38d074d69ef`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:48.941187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c997bdda-bed6-4b00-ae2b-7d42ee848a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:49.064372 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3434/6851] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:49.075303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5aabf-b220-431c-8c76-60e9ec553624 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.094702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5aabf-b220-431c-8c76-60e9ec553624 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.106790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351ccea-6734-41e5-9a0d-09c011e1eca4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.109017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ccea-6734-41e5-9a0d-09c011e1eca4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.110220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ccea-6734-41e5-9a0d-09c011e1eca4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.110703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ccea-6734-41e5-9a0d-09c011e1eca4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.111787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351ccea-6734-41e5-9a0d-09c011e1eca4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.113839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351ccea-6734-41e5-9a0d-09c011e1eca4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.165587 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3418/6852] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:15:49 2022] POST /identity/v3/domains => generated 277 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:49.168750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997bdda-bed6-4b00-ae2b-7d42ee848a6a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.183309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997bdda-bed6-4b00-ae2b-7d42ee848a6a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.421218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.422471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.422770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.423054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992/config` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.423834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=2501b931e6744546a031a67654c46992)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.424895 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:49.424895 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:15:49.424895 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:15:49.425794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.492272 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3435/6853] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:15:49 2022] PUT /identity/v3/domains/2501b931e6744546a031a67654c46992/config => generated 138 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:49.493905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351ccea-6734-41e5-9a0d-09c011e1eca4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.505310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351ccea-6734-41e5-9a0d-09c011e1eca4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.510277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.511157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.511445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.511730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992/config/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.513018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2501b931e6744546a031a67654c46992, group=identity)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.514787 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:49.514787 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:15:49.514787 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:15:49.516012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.523813 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3419/6854] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:15:49 2022] GET /identity/v3/domains/2501b931e6744546a031a67654c46992/config/identity => generated 45 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:49.527664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.539792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bcb0e-838a-4a42-b6e7-e73a027ecea4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.548794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.550421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.550758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.551121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992/config/identity/driver` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.552891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2501b931e6744546a031a67654c46992, group=identity, option=driver)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.553615 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:49.553615 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:15:49.553615 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:15:49.559223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.569969 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3436/6855] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Feb 19 21:15:49 2022] GET /identity/v3/domains/2501b931e6744546a031a67654c46992/config/identity/driver => generated 31 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:49.574535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.586298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5c11-fa48-431d-9124-be43309a274f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.593435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81b6b-450d-46ff-b86e-a422b97a09aa tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.594410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81b6b-450d-46ff-b86e-a422b97a09aa tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.594946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81b6b-450d-46ff-b86e-a422b97a09aa tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.595440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81b6b-450d-46ff-b86e-a422b97a09aa tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992/config/ldap` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.597266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c81b6b-450d-46ff-b86e-a422b97a09aa tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2501b931e6744546a031a67654c46992, group=ldap)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.599847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c81b6b-450d-46ff-b86e-a422b97a09aa tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.618722 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3420/6856] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:15:49 2022] GET /identity/v3/domains/2501b931e6744546a031a67654c46992/config/ldap => generated 106 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:49.621026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.647242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fc0da-14be-472d-a5f1-3dfb087418fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.662574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c2e2a-8fe1-4ef5-8fea-9289c9e22c63 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.664253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c2e2a-8fe1-4ef5-8fea-9289c9e22c63 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.664745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c2e2a-8fe1-4ef5-8fea-9289c9e22c63 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.665174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c2e2a-8fe1-4ef5-8fea-9289c9e22c63 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992/config/ldap/url` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.669273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c2e2a-8fe1-4ef5-8fea-9289c9e22c63 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2501b931e6744546a031a67654c46992, group=ldap, option=url)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.672092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c2e2a-8fe1-4ef5-8fea-9289c9e22c63 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.679381 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3437/6857] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:15:49 2022] GET /identity/v3/domains/2501b931e6744546a031a67654c46992/config/ldap/url => generated 46 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:49.689196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81b6b-450d-46ff-b86e-a422b97a09aa tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.719929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81b6b-450d-46ff-b86e-a422b97a09aa tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.737202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16ffad-dbed-4bfa-bb54-8cc43779c525 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.741322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16ffad-dbed-4bfa-bb54-8cc43779c525 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.742083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16ffad-dbed-4bfa-bb54-8cc43779c525 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.742968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16ffad-dbed-4bfa-bb54-8cc43779c525 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992/config/ldap/user_tree_dn` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.744988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16ffad-dbed-4bfa-bb54-8cc43779c525 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2501b931e6744546a031a67654c46992, group=ldap, option=user_tree_dn)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.747511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16ffad-dbed-4bfa-bb54-8cc43779c525 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.769729 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3421/6858] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:15:49 2022] GET /identity/v3/domains/2501b931e6744546a031a67654c46992/config/ldap/user_tree_dn => generated 63 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:49.773776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c2e2a-8fe1-4ef5-8fea-9289c9e22c63 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.793923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c2e2a-8fe1-4ef5-8fea-9289c9e22c63 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.805706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.806640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.806933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.807547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992/config` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.808206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2501b931e6744546a031a67654c46992)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.809380 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:49.809380 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:15:49.809380 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:15:49.810345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.824777 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3438/6859] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:15:49 2022] DELETE /identity/v3/domains/2501b931e6744546a031a67654c46992/config => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:49.830188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16ffad-dbed-4bfa-bb54-8cc43779c525 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:49.856798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16ffad-dbed-4bfa-bb54-8cc43779c525 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:49.868720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:49.870070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:49.872447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:49.872934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:49.877509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2501b931e6744546a031a67654c46992)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:49.880610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:49.916642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2501b931e6744546a031a67654c46992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:49.918218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2501b931e6744546a031a67654c46992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.006118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2501b931e6744546a031a67654c46992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.007347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2501b931e6744546a031a67654c46992'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.029943 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3422/6860] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:15:49 2022] PATCH /identity/v3/domains/2501b931e6744546a031a67654c46992 => generated 278 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:50.036598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:50.041805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:50.085064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b13c45-7074-48a1-8a00-0aa1e243b3e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:50.216418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:50.217284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:50.218124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:50.218402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:50.247907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2501b931e6744546a031a67654c46992)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:50.250120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:50.283774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2501b931e6744546a031a67654c46992'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.287393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2501b931e6744546a031a67654c46992'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.363617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2501b931e6744546a031a67654c46992', 'request_id': 'req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.372992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2501b931e6744546a031a67654c46992', 'request_id': 'req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.383028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2501b931e6744546a031a67654c46992', 'request_id': 'req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.411855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] The token cache is being invalidate because project 2501b931e6744546a031a67654c46992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:50.412154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.412931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.423748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2501b931e6744546a031a67654c46992', 'request_id': 'req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.428250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2501b931e6744546a031a67654c46992', 'request_id': 'req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.429153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2501b931e6744546a031a67654c46992', 'request_id': 'req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:50.447828 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3439/6861] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:15:50 2022] DELETE /identity/v3/domains/2501b931e6744546a031a67654c46992 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:50.455467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:50.476381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1bf93-6337-4291-992c-d8c422a80b89 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:50.556881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d717c3b-7ac4-4d2e-ab7c-701db0462f31 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:50.558596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717c3b-7ac4-4d2e-ab7c-701db0462f31 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:50.559048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717c3b-7ac4-4d2e-ab7c-701db0462f31 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:50.559492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717c3b-7ac4-4d2e-ab7c-701db0462f31 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:50.560689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d717c3b-7ac4-4d2e-ab7c-701db0462f31 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:50.563289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d717c3b-7ac4-4d2e-ab7c-701db0462f31 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:50.605369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:50.607649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:50.610068 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3423/6862] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:15:50 2022] POST /identity/v3/domains => generated 276 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:50.635962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbc16c-f38a-45e7-8d2a-b2fab196b6c7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:50.755484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318dbc5-7c8c-4d05-89dc-19f6fb25e7fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:50.756474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318dbc5-7c8c-4d05-89dc-19f6fb25e7fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:50.756829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318dbc5-7c8c-4d05-89dc-19f6fb25e7fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:50.757196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318dbc5-7c8c-4d05-89dc-19f6fb25e7fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:50.758011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318dbc5-7c8c-4d05-89dc-19f6fb25e7fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=9e963f181afb4637a71c9e9d802e8cf8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:50.761658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318dbc5-7c8c-4d05-89dc-19f6fb25e7fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:50.805673 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3440/6863] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:15:50 2022] PUT /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config => generated 138 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:50.809771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d717c3b-7ac4-4d2e-ab7c-701db0462f31 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:50.823607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d717c3b-7ac4-4d2e-ab7c-701db0462f31 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:50.833067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:50.835511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:50.836056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:50.836676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:50.837861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=9e963f181afb4637a71c9e9d802e8cf8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:50.840010 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:50.840010 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:15:50.840010 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:15:50.841475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:50.889036 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3424/6864] 10.222.0.30 () {60 vars in 1270 bytes} [Sat Feb 19 21:15:50 2022] PATCH /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config => generated 142 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:50.893021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318dbc5-7c8c-4d05-89dc-19f6fb25e7fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:50.906013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318dbc5-7c8c-4d05-89dc-19f6fb25e7fe tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:50.912850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454bf1d-b707-4749-a00d-aac1dc017e32 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:50.913991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454bf1d-b707-4749-a00d-aac1dc017e32 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:50.914629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454bf1d-b707-4749-a00d-aac1dc017e32 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:50.916069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454bf1d-b707-4749-a00d-aac1dc017e32 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:50.917793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454bf1d-b707-4749-a00d-aac1dc017e32 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9e963f181afb4637a71c9e9d802e8cf8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:50.919915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454bf1d-b707-4749-a00d-aac1dc017e32 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:50.927807 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3441/6865] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:15:50 2022] GET /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config => generated 142 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:15:50.932583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:50.949077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3238cfb-ab7c-4d47-8bf7-06b09a91097b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:50.955560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:50.956981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:50.957470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:50.957948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:50.959176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=9e963f181afb4637a71c9e9d802e8cf8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:50.960846 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:50.960846 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:15:50.960846 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:15:50.962266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:50.981469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3425/6866] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:15:50 2022] DELETE /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:50.987009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454bf1d-b707-4749-a00d-aac1dc017e32 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:51.003558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454bf1d-b707-4749-a00d-aac1dc017e32 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:51.012054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:51.013387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:51.014037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:51.016383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:51.031665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9e963f181afb4637a71c9e9d802e8cf8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:51.036406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:51.060474 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Could not find any options in domain configuration for domain 9e963f181afb4637a71c9e9d802e8cf8.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 9e963f181afb4637a71c9e9d802e8cf8. Feb 19 21:15:51.064908 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3442/6867] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:15:50 2022] GET /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config => generated 151 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:15:51.068046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:51.079943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0c3e9-9b79-4045-af97-f8c6e4a53243 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:51.093765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:51.095689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:51.104715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:51.105273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:51.106274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=9e963f181afb4637a71c9e9d802e8cf8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:51.108643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:51.140616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3426/6868] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:15:51 2022] DELETE /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8/config => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:51.147310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:51.181479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc247-b0ea-405a-90c6-b46a2af9f851 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:51.195302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:51.197164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:51.198028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:51.199345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:51.203589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9e963f181afb4637a71c9e9d802e8cf8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:51.206367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:51.244189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.245294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.301651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.302743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.322888 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3443/6869] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:15:51 2022] PATCH /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8 => generated 277 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:51.323110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:51.324578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:51.350354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9479-1509-4e5a-8a43-298b7062f70b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:51.471458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:51.472743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:51.473753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:51.474260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:51.493475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9e963f181afb4637a71c9e9d802e8cf8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:51.507873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:51.543073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.551470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.648608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8', 'request_id': 'req-c8d23a35-0d65-432c-8996-adb019c6a493'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.680506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8', 'request_id': 'req-c8d23a35-0d65-432c-8996-adb019c6a493'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.718415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8', 'request_id': 'req-c8d23a35-0d65-432c-8996-adb019c6a493'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.738356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] The token cache is being invalidate because project 9e963f181afb4637a71c9e9d802e8cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:51.740042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.741097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.761214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8', 'request_id': 'req-c8d23a35-0d65-432c-8996-adb019c6a493'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.761214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8', 'request_id': 'req-c8d23a35-0d65-432c-8996-adb019c6a493'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.765778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9e963f181afb4637a71c9e9d802e8cf8', 'request_id': 'req-c8d23a35-0d65-432c-8996-adb019c6a493'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:51.777341 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3427/6870] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:15:51 2022] DELETE /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:51.791506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:51.810280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69821314-8e7f-4df6-b388-0fcfe82c750c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:51.938687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82888252-7691-459e-aad5-c511ecadb089 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:51.939961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82888252-7691-459e-aad5-c511ecadb089 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:51.939961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82888252-7691-459e-aad5-c511ecadb089 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:51.940180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82888252-7691-459e-aad5-c511ecadb089 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:51.945217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82888252-7691-459e-aad5-c511ecadb089 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:51.947980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82888252-7691-459e-aad5-c511ecadb089 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:51.979715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3444/6871] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Feb 19 21:15:51 2022] POST /identity/v3/domains => generated 276 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:51.984374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:51.986908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:52.017469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23a35-0d65-432c-8996-adb019c6a493 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.094206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.095080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.095404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.095677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.096536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=a98f15e3e84a42258108081b02dcbf3f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.097589 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:52.097589 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:15:52.097589 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:15:52.098535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.150044 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3428/6872] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:15:51 2022] PUT /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config => generated 138 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:52.153503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82888252-7691-459e-aad5-c511ecadb089 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.167047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82888252-7691-459e-aad5-c511ecadb089 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.172641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.173533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.173817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.174096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.175115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=a98f15e3e84a42258108081b02dcbf3f, group=identity)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.176140 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:52.176140 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:15:52.176140 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:15:52.177344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.249871 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3445/6873] 10.222.0.30 () {60 vars in 1296 bytes} [Sat Feb 19 21:15:52 2022] PATCH /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity => generated 177 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:52.257749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.271393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e99aa-dc9f-4114-aa32-c46bf9217adc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.286263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4071-7a18-476e-a03c-486d6de1066d tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.287596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4071-7a18-476e-a03c-486d6de1066d tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.288047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4071-7a18-476e-a03c-486d6de1066d tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.289349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4071-7a18-476e-a03c-486d6de1066d tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity/driver` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.290863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4071-7a18-476e-a03c-486d6de1066d tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=a98f15e3e84a42258108081b02dcbf3f, group=identity, option=driver)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.292939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4071-7a18-476e-a03c-486d6de1066d tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.323637 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3429/6874] 10.222.0.30 () {60 vars in 1317 bytes} [Sat Feb 19 21:15:52 2022] PATCH /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity/driver => generated 177 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:52.329159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.342013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2b099-3af8-42b2-97df-1b95978347d5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.351636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6071e-5c6a-4a3c-b771-24fee8124deb tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.352898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6071e-5c6a-4a3c-b771-24fee8124deb tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.353397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6071e-5c6a-4a3c-b771-24fee8124deb tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.354056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6071e-5c6a-4a3c-b771-24fee8124deb tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity/driver` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.355214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6071e-5c6a-4a3c-b771-24fee8124deb tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a98f15e3e84a42258108081b02dcbf3f, group=identity, option=driver)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.359095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6071e-5c6a-4a3c-b771-24fee8124deb tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.379677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3446/6875] 10.222.0.30 () {58 vars in 1298 bytes} [Sat Feb 19 21:15:52 2022] DELETE /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity/driver => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:52.385083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4071-7a18-476e-a03c-486d6de1066d tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.400063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4071-7a18-476e-a03c-486d6de1066d tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.410530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.410817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.411080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.411381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity/driver` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.413091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a98f15e3e84a42258108081b02dcbf3f, group=identity, option=driver)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.414814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.435888 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Could not find option driver in group identity in domain configuration for domain a98f15e3e84a42258108081b02dcbf3f.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain a98f15e3e84a42258108081b02dcbf3f. Feb 19 21:15:52.438416 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3430/6876] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Feb 19 21:15:52 2022] GET /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity/driver => generated 171 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:15:52.442651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6071e-5c6a-4a3c-b771-24fee8124deb tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.458229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6071e-5c6a-4a3c-b771-24fee8124deb tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.471450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22fb57-0216-4204-b327-de9ec1caea1b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.472988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22fb57-0216-4204-b327-de9ec1caea1b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.474068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22fb57-0216-4204-b327-de9ec1caea1b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.475231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22fb57-0216-4204-b327-de9ec1caea1b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.476227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22fb57-0216-4204-b327-de9ec1caea1b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a98f15e3e84a42258108081b02dcbf3f, group=identity)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.478688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22fb57-0216-4204-b327-de9ec1caea1b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.510055 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3447/6877] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Feb 19 21:15:52 2022] DELETE /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:52.516301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.532991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce4b50-bd4e-43ae-b522-bc211c1130a2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.539733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.541950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.542256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.542542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.543872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a98f15e3e84a42258108081b02dcbf3f, group=identity)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.546061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.564242 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Could not find group identity in domain configuration for domain a98f15e3e84a42258108081b02dcbf3f.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain a98f15e3e84a42258108081b02dcbf3f. Feb 19 21:15:52.568013 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3431/6878] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:15:52 2022] GET /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config/identity => generated 154 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:15:52.570079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22fb57-0216-4204-b327-de9ec1caea1b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.588395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22fb57-0216-4204-b327-de9ec1caea1b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.594098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.594963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.595306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.595599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.596262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a98f15e3e84a42258108081b02dcbf3f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.599145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.619238 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3448/6879] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:15:52 2022] DELETE /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f/config => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:52.620718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.633126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083513d-5146-47ec-bed7-776c669755ac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.638637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.639550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.639834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.640112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.642372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a98f15e3e84a42258108081b02dcbf3f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.647081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.707767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:52.708723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:52.752284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:52.753085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:52.755669 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3432/6880] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:15:52 2022] PATCH /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f => generated 277 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:52.760291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:52.766822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:52.780740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3df7b-73aa-4f52-bd73-c9e33d5e4282 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:52.879624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:52.880655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:52.881028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:52.881389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:52.896438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a98f15e3e84a42258108081b02dcbf3f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:52.898718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:52.957954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:52.965946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.048516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f', 'request_id': 'req-a12b268e-3091-4a63-8576-df6899c64dce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.055184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f', 'request_id': 'req-a12b268e-3091-4a63-8576-df6899c64dce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.067257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f', 'request_id': 'req-a12b268e-3091-4a63-8576-df6899c64dce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.084636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] The token cache is being invalidate because project a98f15e3e84a42258108081b02dcbf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:53.084975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.085951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.096288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f', 'request_id': 'req-a12b268e-3091-4a63-8576-df6899c64dce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.100161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f', 'request_id': 'req-a12b268e-3091-4a63-8576-df6899c64dce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.101304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a98f15e3e84a42258108081b02dcbf3f', 'request_id': 'req-a12b268e-3091-4a63-8576-df6899c64dce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:53.107647 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3449/6881] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:15:52 2022] DELETE /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:53.114900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.136203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063f82-0aa6-4a0a-8eb1-3695f61b3c7f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.244371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.245219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.250274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.256423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.265013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.267551 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:53.267551 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:15:53.267551 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:15:53.268486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.287788 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3433/6882] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:53.289206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.299434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:53.330698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b268e-3091-4a63-8576-df6899c64dce tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.343408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.353313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.353522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.353808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.354711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.358002 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:53.358002 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:15:53.358002 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:15:53.358918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.368988 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3450/6883] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:53.371125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.388377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29484909-b700-40c8-8a1d-8fdd07bf8c16 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.397768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546dabe-b4f9-41e7-99f3-342d211a7734 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.398584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546dabe-b4f9-41e7-99f3-342d211a7734 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.398874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546dabe-b4f9-41e7-99f3-342d211a7734 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.399212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546dabe-b4f9-41e7-99f3-342d211a7734 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.400664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546dabe-b4f9-41e7-99f3-342d211a7734 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.402364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546dabe-b4f9-41e7-99f3-342d211a7734 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.406079 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3434/6884] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:53.411385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.431002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192003-41e7-4874-88cc-d4e5fd81dd01 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.441257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0b2cc-04bb-4b2c-8092-b399fc836bac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.442560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0b2cc-04bb-4b2c-8092-b399fc836bac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.443320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0b2cc-04bb-4b2c-8092-b399fc836bac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.444134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0b2cc-04bb-4b2c-8092-b399fc836bac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.445548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0b2cc-04bb-4b2c-8092-b399fc836bac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.450442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0b2cc-04bb-4b2c-8092-b399fc836bac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.460037 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3451/6885] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:53.466671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546dabe-b4f9-41e7-99f3-342d211a7734 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.488072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546dabe-b4f9-41e7-99f3-342d211a7734 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.518467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13355f28-a846-49bf-a5db-215762f1fe28 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.522407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355f28-a846-49bf-a5db-215762f1fe28 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.541153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355f28-a846-49bf-a5db-215762f1fe28 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.543724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355f28-a846-49bf-a5db-215762f1fe28 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.549750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13355f28-a846-49bf-a5db-215762f1fe28 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.558234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13355f28-a846-49bf-a5db-215762f1fe28 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.568110 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3435/6886] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:53.572038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0b2cc-04bb-4b2c-8092-b399fc836bac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.593746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0b2cc-04bb-4b2c-8092-b399fc836bac tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.617040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1a07b-b5ff-4f2d-a304-e924b87cf786 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.618190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1a07b-b5ff-4f2d-a304-e924b87cf786 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.618668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1a07b-b5ff-4f2d-a304-e924b87cf786 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.619137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1a07b-b5ff-4f2d-a304-e924b87cf786 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.620050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1a07b-b5ff-4f2d-a304-e924b87cf786 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.621972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1a07b-b5ff-4f2d-a304-e924b87cf786 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.624486 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3452/6887] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:53.638639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13355f28-a846-49bf-a5db-215762f1fe28 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.749398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13355f28-a846-49bf-a5db-215762f1fe28 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.769988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059cfcb-d66e-4a9b-9ca7-c16ae95bb2be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.770789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cfcb-d66e-4a9b-9ca7-c16ae95bb2be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.771067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cfcb-d66e-4a9b-9ca7-c16ae95bb2be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.771341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cfcb-d66e-4a9b-9ca7-c16ae95bb2be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.772000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059cfcb-d66e-4a9b-9ca7-c16ae95bb2be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.789633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059cfcb-d66e-4a9b-9ca7-c16ae95bb2be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.790424 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3436/6888] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:53.795196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1a07b-b5ff-4f2d-a304-e924b87cf786 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.810818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1a07b-b5ff-4f2d-a304-e924b87cf786 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.818500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1b3d-7b29-49b1-8797-744a2e52d937 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.819779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1b3d-7b29-49b1-8797-744a2e52d937 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.820206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1b3d-7b29-49b1-8797-744a2e52d937 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.820796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1b3d-7b29-49b1-8797-744a2e52d937 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.821676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a1b3d-7b29-49b1-8797-744a2e52d937 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.825308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a1b3d-7b29-49b1-8797-744a2e52d937 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.827949 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3453/6889] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:53.831960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059cfcb-d66e-4a9b-9ca7-c16ae95bb2be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.857369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059cfcb-d66e-4a9b-9ca7-c16ae95bb2be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.863691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb04d0-a6e6-4851-95c4-89c3d3cbda6b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.864558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb04d0-a6e6-4851-95c4-89c3d3cbda6b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.864843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb04d0-a6e6-4851-95c4-89c3d3cbda6b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.865126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb04d0-a6e6-4851-95c4-89c3d3cbda6b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.865799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb04d0-a6e6-4851-95c4-89c3d3cbda6b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.867535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb04d0-a6e6-4851-95c4-89c3d3cbda6b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.873422 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3437/6890] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:53.874266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1b3d-7b29-49b1-8797-744a2e52d937 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.887903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1b3d-7b29-49b1-8797-744a2e52d937 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.899377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd8c2-fd78-4db2-b928-d45bf22a8ba8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.900179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd8c2-fd78-4db2-b928-d45bf22a8ba8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.900924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd8c2-fd78-4db2-b928-d45bf22a8ba8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.900924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd8c2-fd78-4db2-b928-d45bf22a8ba8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.903896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd8c2-fd78-4db2-b928-d45bf22a8ba8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.908076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd8c2-fd78-4db2-b928-d45bf22a8ba8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.915588 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3454/6891] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:53.916638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb04d0-a6e6-4851-95c4-89c3d3cbda6b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.934481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb04d0-a6e6-4851-95c4-89c3d3cbda6b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.945372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff7ed-6ceb-4557-9f88-ef002cebbd72 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.946398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff7ed-6ceb-4557-9f88-ef002cebbd72 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.947498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff7ed-6ceb-4557-9f88-ef002cebbd72 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.948010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff7ed-6ceb-4557-9f88-ef002cebbd72 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.951062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ff7ed-6ceb-4557-9f88-ef002cebbd72 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.953935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ff7ed-6ceb-4557-9f88-ef002cebbd72 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.956009 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3438/6892] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:53.959760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd8c2-fd78-4db2-b928-d45bf22a8ba8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:53.971900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd8c2-fd78-4db2-b928-d45bf22a8ba8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:53.978741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d728bc0-70f9-477f-8ae8-0c382b7cf0fc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:53.979657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728bc0-70f9-477f-8ae8-0c382b7cf0fc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:53.980014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728bc0-70f9-477f-8ae8-0c382b7cf0fc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:53.980304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728bc0-70f9-477f-8ae8-0c382b7cf0fc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:53.981039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d728bc0-70f9-477f-8ae8-0c382b7cf0fc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:53.982676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d728bc0-70f9-477f-8ae8-0c382b7cf0fc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:53.987963 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3455/6893] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:53.988991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff7ed-6ceb-4557-9f88-ef002cebbd72 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.002300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff7ed-6ceb-4557-9f88-ef002cebbd72 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.009685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf193ad-a4d6-4ebd-bb84-03ddfd679b8e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.010486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf193ad-a4d6-4ebd-bb84-03ddfd679b8e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.010778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf193ad-a4d6-4ebd-bb84-03ddfd679b8e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.011056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf193ad-a4d6-4ebd-bb84-03ddfd679b8e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.011770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf193ad-a4d6-4ebd-bb84-03ddfd679b8e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.013431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf193ad-a4d6-4ebd-bb84-03ddfd679b8e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.014636 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3439/6894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:53 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:54.018972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d728bc0-70f9-477f-8ae8-0c382b7cf0fc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.031114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d728bc0-70f9-477f-8ae8-0c382b7cf0fc tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.036426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbaf58-e054-43d3-bfc7-ef7d80f25aaf tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.037528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbaf58-e054-43d3-bfc7-ef7d80f25aaf tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.038056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbaf58-e054-43d3-bfc7-ef7d80f25aaf tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.038519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbaf58-e054-43d3-bfc7-ef7d80f25aaf tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.039366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbaf58-e054-43d3-bfc7-ef7d80f25aaf tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.042221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbaf58-e054-43d3-bfc7-ef7d80f25aaf tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.048353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf193ad-a4d6-4ebd-bb84-03ddfd679b8e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.054199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3456/6895] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.064034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf193ad-a4d6-4ebd-bb84-03ddfd679b8e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.070307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4e90-70ad-4d20-b38a-35bb13fd37b3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.071526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4e90-70ad-4d20-b38a-35bb13fd37b3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.072307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4e90-70ad-4d20-b38a-35bb13fd37b3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.073113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4e90-70ad-4d20-b38a-35bb13fd37b3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.073982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4e90-70ad-4d20-b38a-35bb13fd37b3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.075893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4e90-70ad-4d20-b38a-35bb13fd37b3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.078223 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3440/6896] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:54.082503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbaf58-e054-43d3-bfc7-ef7d80f25aaf tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.095560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbaf58-e054-43d3-bfc7-ef7d80f25aaf tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.101604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22426ccd-eeeb-4abc-bbf8-dbe7064e640f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.102841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22426ccd-eeeb-4abc-bbf8-dbe7064e640f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.103444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22426ccd-eeeb-4abc-bbf8-dbe7064e640f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.103883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22426ccd-eeeb-4abc-bbf8-dbe7064e640f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.104766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22426ccd-eeeb-4abc-bbf8-dbe7064e640f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.107486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22426ccd-eeeb-4abc-bbf8-dbe7064e640f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.109741 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3457/6897] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:54.114542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4e90-70ad-4d20-b38a-35bb13fd37b3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.127804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4e90-70ad-4d20-b38a-35bb13fd37b3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.133558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84bcd-44fb-41c3-88ff-10e921332bb1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.135128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84bcd-44fb-41c3-88ff-10e921332bb1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.135914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84bcd-44fb-41c3-88ff-10e921332bb1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.136387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84bcd-44fb-41c3-88ff-10e921332bb1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.140082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa84bcd-44fb-41c3-88ff-10e921332bb1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.142940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa84bcd-44fb-41c3-88ff-10e921332bb1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.144832 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3441/6898] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:54.150220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22426ccd-eeeb-4abc-bbf8-dbe7064e640f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.164550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22426ccd-eeeb-4abc-bbf8-dbe7064e640f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.172369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5dd8d-8fb2-4fa9-913c-c3ae6cc2d424 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.173307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5dd8d-8fb2-4fa9-913c-c3ae6cc2d424 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.173704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5dd8d-8fb2-4fa9-913c-c3ae6cc2d424 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.174109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5dd8d-8fb2-4fa9-913c-c3ae6cc2d424 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.176307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5dd8d-8fb2-4fa9-913c-c3ae6cc2d424 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.178203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5dd8d-8fb2-4fa9-913c-c3ae6cc2d424 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.185989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84bcd-44fb-41c3-88ff-10e921332bb1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.195343 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3458/6899] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.206202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84bcd-44fb-41c3-88ff-10e921332bb1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.214424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615f0cb-8ce2-4796-b227-92d9b9fc8233 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.215825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615f0cb-8ce2-4796-b227-92d9b9fc8233 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.216274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615f0cb-8ce2-4796-b227-92d9b9fc8233 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.216599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615f0cb-8ce2-4796-b227-92d9b9fc8233 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.217951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615f0cb-8ce2-4796-b227-92d9b9fc8233 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.220321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615f0cb-8ce2-4796-b227-92d9b9fc8233 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.224562 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3442/6900] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.228432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5dd8d-8fb2-4fa9-913c-c3ae6cc2d424 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.243249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5dd8d-8fb2-4fa9-913c-c3ae6cc2d424 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.248319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be5104-2a01-40da-bd0a-17fd50a0cb56 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.250038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be5104-2a01-40da-bd0a-17fd50a0cb56 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.250397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be5104-2a01-40da-bd0a-17fd50a0cb56 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.250752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be5104-2a01-40da-bd0a-17fd50a0cb56 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.251516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be5104-2a01-40da-bd0a-17fd50a0cb56 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.253268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be5104-2a01-40da-bd0a-17fd50a0cb56 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.258506 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3459/6901] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.260423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615f0cb-8ce2-4796-b227-92d9b9fc8233 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.276901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615f0cb-8ce2-4796-b227-92d9b9fc8233 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.282844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6728fee-8eee-4e56-8c4c-e17863d0eb71 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.283813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6728fee-8eee-4e56-8c4c-e17863d0eb71 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.283997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6728fee-8eee-4e56-8c4c-e17863d0eb71 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.284289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6728fee-8eee-4e56-8c4c-e17863d0eb71 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.285656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6728fee-8eee-4e56-8c4c-e17863d0eb71 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.288482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6728fee-8eee-4e56-8c4c-e17863d0eb71 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.290015 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3443/6902] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:54.294628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be5104-2a01-40da-bd0a-17fd50a0cb56 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.308369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be5104-2a01-40da-bd0a-17fd50a0cb56 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.318434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92edd18-ecc6-4999-93a9-c81ff96f6d83 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.319412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92edd18-ecc6-4999-93a9-c81ff96f6d83 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.319809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92edd18-ecc6-4999-93a9-c81ff96f6d83 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.320263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92edd18-ecc6-4999-93a9-c81ff96f6d83 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.321087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92edd18-ecc6-4999-93a9-c81ff96f6d83 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.323288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92edd18-ecc6-4999-93a9-c81ff96f6d83 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.329042 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3460/6903] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.329958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6728fee-8eee-4e56-8c4c-e17863d0eb71 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.341737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6728fee-8eee-4e56-8c4c-e17863d0eb71 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.348313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a835d-a2f6-4875-91d0-fcf977e9678b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.349395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a835d-a2f6-4875-91d0-fcf977e9678b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.350274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a835d-a2f6-4875-91d0-fcf977e9678b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.350577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a835d-a2f6-4875-91d0-fcf977e9678b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.351685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a835d-a2f6-4875-91d0-fcf977e9678b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.353201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a835d-a2f6-4875-91d0-fcf977e9678b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.354595 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3444/6904] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.359007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92edd18-ecc6-4999-93a9-c81ff96f6d83 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.372557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92edd18-ecc6-4999-93a9-c81ff96f6d83 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.379155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cddf7-bf13-4c57-b370-c7ed3f01a574 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.380032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cddf7-bf13-4c57-b370-c7ed3f01a574 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.380508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cddf7-bf13-4c57-b370-c7ed3f01a574 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.380800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cddf7-bf13-4c57-b370-c7ed3f01a574 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.381472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cddf7-bf13-4c57-b370-c7ed3f01a574 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.383287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cddf7-bf13-4c57-b370-c7ed3f01a574 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.384922 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3461/6905] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.389299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a835d-a2f6-4875-91d0-fcf977e9678b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.401554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a835d-a2f6-4875-91d0-fcf977e9678b tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.408818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200bab0-35a6-4b7e-9235-b2fa8a45673a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.409777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bab0-35a6-4b7e-9235-b2fa8a45673a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.409986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bab0-35a6-4b7e-9235-b2fa8a45673a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.410280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bab0-35a6-4b7e-9235-b2fa8a45673a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.411262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200bab0-35a6-4b7e-9235-b2fa8a45673a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.413224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200bab0-35a6-4b7e-9235-b2fa8a45673a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.414661 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3445/6906] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.419180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cddf7-bf13-4c57-b370-c7ed3f01a574 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.431513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cddf7-bf13-4c57-b370-c7ed3f01a574 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.441706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa54a5-fe4b-4c1f-b772-82c5cc3f97e2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.442791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa54a5-fe4b-4c1f-b772-82c5cc3f97e2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.443851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa54a5-fe4b-4c1f-b772-82c5cc3f97e2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.444136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa54a5-fe4b-4c1f-b772-82c5cc3f97e2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.444923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa54a5-fe4b-4c1f-b772-82c5cc3f97e2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.447603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa54a5-fe4b-4c1f-b772-82c5cc3f97e2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.454004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200bab0-35a6-4b7e-9235-b2fa8a45673a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.461075 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3462/6907] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.467055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200bab0-35a6-4b7e-9235-b2fa8a45673a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.473958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b207b-b2ed-4755-8d74-9951bd0ba307 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.475146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b207b-b2ed-4755-8d74-9951bd0ba307 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.475525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b207b-b2ed-4755-8d74-9951bd0ba307 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.475874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b207b-b2ed-4755-8d74-9951bd0ba307 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.481375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b207b-b2ed-4755-8d74-9951bd0ba307 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.482808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b207b-b2ed-4755-8d74-9951bd0ba307 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.490326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa54a5-fe4b-4c1f-b772-82c5cc3f97e2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.497267 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3446/6908] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.504652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa54a5-fe4b-4c1f-b772-82c5cc3f97e2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.510891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca19ccf-a115-4fc3-9705-f18fc6ec29d2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.512674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca19ccf-a115-4fc3-9705-f18fc6ec29d2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.513209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca19ccf-a115-4fc3-9705-f18fc6ec29d2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.513735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca19ccf-a115-4fc3-9705-f18fc6ec29d2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.515802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca19ccf-a115-4fc3-9705-f18fc6ec29d2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.517727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca19ccf-a115-4fc3-9705-f18fc6ec29d2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.523745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b207b-b2ed-4755-8d74-9951bd0ba307 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.531147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3463/6909] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.539631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b207b-b2ed-4755-8d74-9951bd0ba307 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.549029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348e6e-ef8f-4a47-b5e3-afcd469b61e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.550619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348e6e-ef8f-4a47-b5e3-afcd469b61e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.551290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348e6e-ef8f-4a47-b5e3-afcd469b61e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.551958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348e6e-ef8f-4a47-b5e3-afcd469b61e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.553889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348e6e-ef8f-4a47-b5e3-afcd469b61e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.557188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348e6e-ef8f-4a47-b5e3-afcd469b61e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.563720 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3447/6910] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.566835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca19ccf-a115-4fc3-9705-f18fc6ec29d2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.585714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca19ccf-a115-4fc3-9705-f18fc6ec29d2 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.596525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974341e-2adc-4e58-a5ae-65bf8d94cf91 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.598041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974341e-2adc-4e58-a5ae-65bf8d94cf91 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.598554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974341e-2adc-4e58-a5ae-65bf8d94cf91 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.599056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974341e-2adc-4e58-a5ae-65bf8d94cf91 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.600006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974341e-2adc-4e58-a5ae-65bf8d94cf91 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.604155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974341e-2adc-4e58-a5ae-65bf8d94cf91 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.607620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3464/6911] 10.222.0.30 () {58 vars in 1307 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.611313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348e6e-ef8f-4a47-b5e3-afcd469b61e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.622494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348e6e-ef8f-4a47-b5e3-afcd469b61e8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.628162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaed4e6-c4ec-4d4c-be59-63f9d359de2a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.629977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed4e6-c4ec-4d4c-be59-63f9d359de2a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.630833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed4e6-c4ec-4d4c-be59-63f9d359de2a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.631347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed4e6-c4ec-4d4c-be59-63f9d359de2a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.632686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaed4e6-c4ec-4d4c-be59-63f9d359de2a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.635000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaed4e6-c4ec-4d4c-be59-63f9d359de2a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.636751 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3448/6912] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:54.641917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974341e-2adc-4e58-a5ae-65bf8d94cf91 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.656264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974341e-2adc-4e58-a5ae-65bf8d94cf91 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.664324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcddc7-aeda-42fb-b5ac-65146c305e88 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.666099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcddc7-aeda-42fb-b5ac-65146c305e88 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.666327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcddc7-aeda-42fb-b5ac-65146c305e88 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.666812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcddc7-aeda-42fb-b5ac-65146c305e88 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.668308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcddc7-aeda-42fb-b5ac-65146c305e88 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.671965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcddc7-aeda-42fb-b5ac-65146c305e88 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.678292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3465/6913] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.678565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaed4e6-c4ec-4d4c-be59-63f9d359de2a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.689647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaed4e6-c4ec-4d4c-be59-63f9d359de2a tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.696188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95cd11-ab1b-4c20-86c1-224642b6b16e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.697670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95cd11-ab1b-4c20-86c1-224642b6b16e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.698180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95cd11-ab1b-4c20-86c1-224642b6b16e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.698614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95cd11-ab1b-4c20-86c1-224642b6b16e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.699494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95cd11-ab1b-4c20-86c1-224642b6b16e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.706291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95cd11-ab1b-4c20-86c1-224642b6b16e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.708094 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3449/6914] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:54.716932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcddc7-aeda-42fb-b5ac-65146c305e88 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.730591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcddc7-aeda-42fb-b5ac-65146c305e88 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.739618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1073c3-dc8e-48e6-8d26-216d3ab404be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.740759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1073c3-dc8e-48e6-8d26-216d3ab404be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.741057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1073c3-dc8e-48e6-8d26-216d3ab404be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.741405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1073c3-dc8e-48e6-8d26-216d3ab404be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.742117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1073c3-dc8e-48e6-8d26-216d3ab404be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.744499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1073c3-dc8e-48e6-8d26-216d3ab404be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.746812 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3466/6915] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.753564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95cd11-ab1b-4c20-86c1-224642b6b16e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.767407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95cd11-ab1b-4c20-86c1-224642b6b16e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.773902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371b675-d3f7-4917-8d67-ffb83da256a3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.775901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371b675-d3f7-4917-8d67-ffb83da256a3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.776446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371b675-d3f7-4917-8d67-ffb83da256a3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.776968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371b675-d3f7-4917-8d67-ffb83da256a3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.778733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371b675-d3f7-4917-8d67-ffb83da256a3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.781007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371b675-d3f7-4917-8d67-ffb83da256a3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.782709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3450/6916] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.786737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1073c3-dc8e-48e6-8d26-216d3ab404be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.798550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1073c3-dc8e-48e6-8d26-216d3ab404be tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.808927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e0de-97dd-44b7-8799-309d0c57061e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.816919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e0de-97dd-44b7-8799-309d0c57061e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.817640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e0de-97dd-44b7-8799-309d0c57061e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.818008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e0de-97dd-44b7-8799-309d0c57061e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.820060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776e0de-97dd-44b7-8799-309d0c57061e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.831518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776e0de-97dd-44b7-8799-309d0c57061e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.838435 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3467/6917] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.839166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371b675-d3f7-4917-8d67-ffb83da256a3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.854319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371b675-d3f7-4917-8d67-ffb83da256a3 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.882009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bb410-4c16-4dec-af74-335849e18b92 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.882850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bb410-4c16-4dec-af74-335849e18b92 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.883012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bb410-4c16-4dec-af74-335849e18b92 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.883221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bb410-4c16-4dec-af74-335849e18b92 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.884884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bb410-4c16-4dec-af74-335849e18b92 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.894330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bb410-4c16-4dec-af74-335849e18b92 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.896179 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3451/6918] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.900510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e0de-97dd-44b7-8799-309d0c57061e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.922213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e0de-97dd-44b7-8799-309d0c57061e tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.935058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fabd5-3874-4c85-846b-66bfc89a01ba tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.938523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fabd5-3874-4c85-846b-66bfc89a01ba tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.940291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fabd5-3874-4c85-846b-66bfc89a01ba tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.940767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fabd5-3874-4c85-846b-66bfc89a01ba tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.942300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fabd5-3874-4c85-846b-66bfc89a01ba tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.947158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fabd5-3874-4c85-846b-66bfc89a01ba tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.952988 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3468/6919] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.954770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bb410-4c16-4dec-af74-335849e18b92 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:54.969493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bb410-4c16-4dec-af74-335849e18b92 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:54.978218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a06b9f-e5a0-47e2-b544-2e5e33dd9db4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:54.979169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06b9f-e5a0-47e2-b544-2e5e33dd9db4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:54.980201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06b9f-e5a0-47e2-b544-2e5e33dd9db4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:54.980699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06b9f-e5a0-47e2-b544-2e5e33dd9db4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:54.982217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a06b9f-e5a0-47e2-b544-2e5e33dd9db4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:54.984757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a06b9f-e5a0-47e2-b544-2e5e33dd9db4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:54.988094 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3452/6920] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:54.991554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fabd5-3874-4c85-846b-66bfc89a01ba tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.005111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fabd5-3874-4c85-846b-66bfc89a01ba tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.014816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c0788-554f-49ed-bbba-1c5db85799ee tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.015676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0788-554f-49ed-bbba-1c5db85799ee tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.015963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0788-554f-49ed-bbba-1c5db85799ee tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.016635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0788-554f-49ed-bbba-1c5db85799ee tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.018648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c0788-554f-49ed-bbba-1c5db85799ee tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.021722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c0788-554f-49ed-bbba-1c5db85799ee tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.023209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3469/6921] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 21:15:54 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.027107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a06b9f-e5a0-47e2-b544-2e5e33dd9db4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.038812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a06b9f-e5a0-47e2-b544-2e5e33dd9db4 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.045491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b8301-cc7d-4cec-8f71-b6fbfa31ff4c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.046446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b8301-cc7d-4cec-8f71-b6fbfa31ff4c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.046733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b8301-cc7d-4cec-8f71-b6fbfa31ff4c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.047109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b8301-cc7d-4cec-8f71-b6fbfa31ff4c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.047962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b8301-cc7d-4cec-8f71-b6fbfa31ff4c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.049878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b8301-cc7d-4cec-8f71-b6fbfa31ff4c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.057343 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3453/6922] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.063749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c0788-554f-49ed-bbba-1c5db85799ee tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.078430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c0788-554f-49ed-bbba-1c5db85799ee tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.084117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24b813-ff23-4161-a412-8a9cb570c9f7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.085788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24b813-ff23-4161-a412-8a9cb570c9f7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.086532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24b813-ff23-4161-a412-8a9cb570c9f7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.087021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24b813-ff23-4161-a412-8a9cb570c9f7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.088927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24b813-ff23-4161-a412-8a9cb570c9f7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.093286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24b813-ff23-4161-a412-8a9cb570c9f7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.095412 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3470/6923] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.099678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b8301-cc7d-4cec-8f71-b6fbfa31ff4c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.113966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b8301-cc7d-4cec-8f71-b6fbfa31ff4c tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.130784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302509b3-53fb-435e-a2e6-db3b5fbe4f39 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.131592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302509b3-53fb-435e-a2e6-db3b5fbe4f39 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.133933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302509b3-53fb-435e-a2e6-db3b5fbe4f39 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.145766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302509b3-53fb-435e-a2e6-db3b5fbe4f39 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.149627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302509b3-53fb-435e-a2e6-db3b5fbe4f39 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.157331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302509b3-53fb-435e-a2e6-db3b5fbe4f39 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.158915 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3454/6924] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.163369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24b813-ff23-4161-a412-8a9cb570c9f7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.190601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24b813-ff23-4161-a412-8a9cb570c9f7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.199690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e54ec7-69c0-4264-b6de-2fc0b9ee2f73 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.200527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e54ec7-69c0-4264-b6de-2fc0b9ee2f73 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.200812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e54ec7-69c0-4264-b6de-2fc0b9ee2f73 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.201093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e54ec7-69c0-4264-b6de-2fc0b9ee2f73 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.202290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e54ec7-69c0-4264-b6de-2fc0b9ee2f73 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.204253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e54ec7-69c0-4264-b6de-2fc0b9ee2f73 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.207168 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3471/6925] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.210893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302509b3-53fb-435e-a2e6-db3b5fbe4f39 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.221613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302509b3-53fb-435e-a2e6-db3b5fbe4f39 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.227180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe4a0-bdc1-4bb6-884d-1fc76a2d73a1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.228318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe4a0-bdc1-4bb6-884d-1fc76a2d73a1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.229045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe4a0-bdc1-4bb6-884d-1fc76a2d73a1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.229045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe4a0-bdc1-4bb6-884d-1fc76a2d73a1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.229568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe4a0-bdc1-4bb6-884d-1fc76a2d73a1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.231523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe4a0-bdc1-4bb6-884d-1fc76a2d73a1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.233317 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3455/6926] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.237534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e54ec7-69c0-4264-b6de-2fc0b9ee2f73 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.252202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e54ec7-69c0-4264-b6de-2fc0b9ee2f73 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.259035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ff52-23d0-480f-964c-d3151194ea08 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.259941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ff52-23d0-480f-964c-d3151194ea08 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.260239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ff52-23d0-480f-964c-d3151194ea08 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.260567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ff52-23d0-480f-964c-d3151194ea08 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.261482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049ff52-23d0-480f-964c-d3151194ea08 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.263730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049ff52-23d0-480f-964c-d3151194ea08 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.268543 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3472/6927] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:55.270039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe4a0-bdc1-4bb6-884d-1fc76a2d73a1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.283367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe4a0-bdc1-4bb6-884d-1fc76a2d73a1 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.293355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550addc-8ddf-4022-8e6d-bdf985b3f197 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.294331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550addc-8ddf-4022-8e6d-bdf985b3f197 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.294613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550addc-8ddf-4022-8e6d-bdf985b3f197 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.294887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550addc-8ddf-4022-8e6d-bdf985b3f197 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.296268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550addc-8ddf-4022-8e6d-bdf985b3f197 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.298134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550addc-8ddf-4022-8e6d-bdf985b3f197 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.303173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ff52-23d0-480f-964c-d3151194ea08 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.304757 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3456/6928] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.315783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ff52-23d0-480f-964c-d3151194ea08 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.323419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e9e4f-0545-4ae9-bb1f-8dce66a79ce5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.324370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e9e4f-0545-4ae9-bb1f-8dce66a79ce5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.324739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e9e4f-0545-4ae9-bb1f-8dce66a79ce5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.325116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e9e4f-0545-4ae9-bb1f-8dce66a79ce5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.325863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e9e4f-0545-4ae9-bb1f-8dce66a79ce5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.328296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e9e4f-0545-4ae9-bb1f-8dce66a79ce5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.334323 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3473/6929] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.335400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550addc-8ddf-4022-8e6d-bdf985b3f197 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.351881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550addc-8ddf-4022-8e6d-bdf985b3f197 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.358493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaddb9-b8e6-4b77-a9c9-b50e2482c13f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.359574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaddb9-b8e6-4b77-a9c9-b50e2482c13f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.360059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaddb9-b8e6-4b77-a9c9-b50e2482c13f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.360584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaddb9-b8e6-4b77-a9c9-b50e2482c13f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.361476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaddb9-b8e6-4b77-a9c9-b50e2482c13f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.363870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaddb9-b8e6-4b77-a9c9-b50e2482c13f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.365752 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3457/6930] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:55.369780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e9e4f-0545-4ae9-bb1f-8dce66a79ce5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.386016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e9e4f-0545-4ae9-bb1f-8dce66a79ce5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.401108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.402114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.402758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.403258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.404165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.407948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.410088 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3474/6931] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.413530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaddb9-b8e6-4b77-a9c9-b50e2482c13f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.428950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaddb9-b8e6-4b77-a9c9-b50e2482c13f tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.433775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.438721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:55.450652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f529f89-412b-4dfe-8920-229cddb35617 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.452299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529f89-412b-4dfe-8920-229cddb35617 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.454372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529f89-412b-4dfe-8920-229cddb35617 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.455820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f529f89-412b-4dfe-8920-229cddb35617 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.456639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f529f89-412b-4dfe-8920-229cddb35617 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.458558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f529f89-412b-4dfe-8920-229cddb35617 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.463079 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3458/6932] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.463940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f529f89-412b-4dfe-8920-229cddb35617 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.474817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f529f89-412b-4dfe-8920-229cddb35617 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.481064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2b911-bffe-41e1-be32-6c376f406da7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.481874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2b911-bffe-41e1-be32-6c376f406da7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.482157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2b911-bffe-41e1-be32-6c376f406da7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.482439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2b911-bffe-41e1-be32-6c376f406da7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.483752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2b911-bffe-41e1-be32-6c376f406da7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.485666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2b911-bffe-41e1-be32-6c376f406da7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.487310 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3459/6933] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.491731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2b911-bffe-41e1-be32-6c376f406da7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.507268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2b911-bffe-41e1-be32-6c376f406da7 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.518852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a9285-c81e-4b74-a516-1b2b360dd9a8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.520280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9285-c81e-4b74-a516-1b2b360dd9a8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.520752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9285-c81e-4b74-a516-1b2b360dd9a8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.521217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9285-c81e-4b74-a516-1b2b360dd9a8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.522405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a9285-c81e-4b74-a516-1b2b360dd9a8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.524089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a9285-c81e-4b74-a516-1b2b360dd9a8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.526142 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3460/6934] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Feb 19 21:15:55.530713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cdeab-5254-44e2-8ab4-aa1ca2db2563 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.530938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a9285-c81e-4b74-a516-1b2b360dd9a8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.537519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.539063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.539804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.540394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] PATH_INFO: `/v3/users/36817e7e06a845dead7cc3a1c4082fe2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.542939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36817e7e06a845dead7cc3a1c4082fe2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.544140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a9285-c81e-4b74-a516-1b2b360dd9a8 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.547144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.549999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28f8d7-9a7a-4eef-bc5a-00b5a28c9427 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.550861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f8d7-9a7a-4eef-bc5a-00b5a28c9427 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.551138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f8d7-9a7a-4eef-bc5a-00b5a28c9427 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.551421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f8d7-9a7a-4eef-bc5a-00b5a28c9427 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.552081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28f8d7-9a7a-4eef-bc5a-00b5a28c9427 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.553751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28f8d7-9a7a-4eef-bc5a-00b5a28c9427 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.561521 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3461/6935] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Feb 19 21:15:55.563427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28f8d7-9a7a-4eef-bc5a-00b5a28c9427 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.573963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28f8d7-9a7a-4eef-bc5a-00b5a28c9427 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.579538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3be7f9-178b-41d8-8b1a-073ec175e0f6 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.580601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be7f9-178b-41d8-8b1a-073ec175e0f6 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.580883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be7f9-178b-41d8-8b1a-073ec175e0f6 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.581163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be7f9-178b-41d8-8b1a-073ec175e0f6 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/a98f15e3e84a42258108081b02dcbf3f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.590403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3be7f9-178b-41d8-8b1a-073ec175e0f6 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:15:55.600773 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-7b3be7f9-178b-41d8-8b1a-073ec175e0f6 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Could not find domain: a98f15e3e84a42258108081b02dcbf3f.: keystone.exception.DomainNotFound: Could not find domain: a98f15e3e84a42258108081b02dcbf3f. Feb 19 21:15:55.602260 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3462/6936] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:15:55 2022] PATCH /identity/v3/domains/a98f15e3e84a42258108081b02dcbf3f => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:15:55.606902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3be7f9-178b-41d8-8b1a-073ec175e0f6 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.622417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3be7f9-178b-41d8-8b1a-073ec175e0f6 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.628676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b98f-fb35-405b-940c-e5b301b44fa5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.629566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b98f-fb35-405b-940c-e5b301b44fa5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.629861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b98f-fb35-405b-940c-e5b301b44fa5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.630103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b98f-fb35-405b-940c-e5b301b44fa5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/9e963f181afb4637a71c9e9d802e8cf8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.632111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36817e7e06a845dead7cc3a1c4082fe2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.638380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2b98f-fb35-405b-940c-e5b301b44fa5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:15:55.650236 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b5e2b98f-fb35-405b-940c-e5b301b44fa5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Could not find domain: 9e963f181afb4637a71c9e9d802e8cf8.: keystone.exception.DomainNotFound: Could not find domain: 9e963f181afb4637a71c9e9d802e8cf8. Feb 19 21:15:55.652202 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3463/6937] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:15:55 2022] PATCH /identity/v3/domains/9e963f181afb4637a71c9e9d802e8cf8 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:15:55.656067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b98f-fb35-405b-940c-e5b301b44fa5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.657905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36817e7e06a845dead7cc3a1c4082fe2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.668009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b98f-fb35-405b-940c-e5b301b44fa5 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.668187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36817e7e06a845dead7cc3a1c4082fe2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.669633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36817e7e06a845dead7cc3a1c4082fe2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.670773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b099c63b-cff9-4dca-8251-27dc4ec10678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36817e7e06a845dead7cc3a1c4082fe2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.673382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa439ce4d22487b8c2de38d074d69ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0450196f463407598eaab1a7abb3913', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.674444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.674916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.675385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] PATH_INFO: `/v3/domains/2501b931e6744546a031a67654c46992` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.684585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:15:55.694648 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Could not find domain: 2501b931e6744546a031a67654c46992.: keystone.exception.DomainNotFound: Could not find domain: 2501b931e6744546a031a67654c46992. Feb 19 21:15:55.696535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3464/6938] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Feb 19 21:15:55 2022] PATCH /identity/v3/domains/2501b931e6744546a031a67654c46992 => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:15:55.700488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.702455 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3475/6939] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:55 2022] DELETE /identity/v3/users/36817e7e06a845dead7cc3a1c4082fe2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:55.707499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716a4a-23ab-475d-88d1-9deb5f0c9ab5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.707701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716a4a-23ab-475d-88d1-9deb5f0c9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.707996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716a4a-23ab-475d-88d1-9deb5f0c9ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.709637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:55.725158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0751e67-2488-4181-8955-3aede07f6333 tempest-DomainConfigurationTestJSON-1680017490 tempest-DomainConfigurationTestJSON-1680017490-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.750441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1e716a4a-23ab-475d-88d1-9deb5f0c9ab5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:55.755060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e716a4a-23ab-475d-88d1-9deb5f0c9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:55.830227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.831766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.832225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.832904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] PATH_INFO: `/v3/users/bf11ec37f4e341e6b45045030a0cca71` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.834702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf11ec37f4e341e6b45045030a0cca71)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.837184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:55.859418 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3476/6940] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:55.874470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716a4a-23ab-475d-88d1-9deb5f0c9ab5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:55.877680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e716a4a-23ab-475d-88d1-9deb5f0c9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:55.903053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf11ec37f4e341e6b45045030a0cca71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.904304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf11ec37f4e341e6b45045030a0cca71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.905785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf11ec37f4e341e6b45045030a0cca71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.930784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf11ec37f4e341e6b45045030a0cca71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.944398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40e0bc9c-8d21-41b0-bda1-6d0bc30fb41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf11ec37f4e341e6b45045030a0cca71'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:55.962601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716a4a-23ab-475d-88d1-9deb5f0c9ab5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:55.968113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:55.969126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.969556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.969966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.973014 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3465/6941] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:55 2022] DELETE /identity/v3/users/bf11ec37f4e341e6b45045030a0cca71 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:55.973964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:55.974974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c4f3-e866-460a-b785-4d4d3469cb5a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:55.975370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c4f3-e866-460a-b785-4d4d3469cb5a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:55.975763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c4f3-e866-460a-b785-4d4d3469cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:55.989508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:55.991620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:56.004581 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3477/6942] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:56.008964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1266c4f3-e866-460a-b785-4d4d3469cb5a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:56.010591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1266c4f3-e866-460a-b785-4d4d3469cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:56.089688 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3466/6943] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:56.105637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:56.107799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:56.127872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32aeb5-544c-4c57-a095-f4f5e709e5c6 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:56.227552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf5c0b-71e4-4c78-822d-f6cc96c3f8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:56.228495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5c0b-71e4-4c78-822d-f6cc96c3f8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:56.240647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5c0b-71e4-4c78-822d-f6cc96c3f8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:56.243317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5c0b-71e4-4c78-822d-f6cc96c3f8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:56.271878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266c4f3-e866-460a-b785-4d4d3469cb5a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:56.274005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1266c4f3-e866-460a-b785-4d4d3469cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:56.289230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf5c0b-71e4-4c78-822d-f6cc96c3f8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:56.298222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf5c0b-71e4-4c78-822d-f6cc96c3f8e1 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:56.301359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266c4f3-e866-460a-b785-4d4d3469cb5a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:56.315110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:56.316528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:56.316822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:56.317102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] PATH_INFO: `/v3/projects/112e97082e95498a8696f7ffe38c1071` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:56.327758 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3478/6944] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:15:56.332262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112e97082e95498a8696f7ffe38c1071)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:56.340429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:56.461133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112e97082e95498a8696f7ffe38c1071', 'request_id': 'req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.467404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112e97082e95498a8696f7ffe38c1071', 'request_id': 'req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.485282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112e97082e95498a8696f7ffe38c1071', 'request_id': 'req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.524166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] The token cache is being invalidate because project 112e97082e95498a8696f7ffe38c1071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:56.525069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.534792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b936a2bc-26a7-4090-8ecc-def6f0c9d6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.539168 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3467/6945] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:56 2022] DELETE /identity/v3/projects/112e97082e95498a8696f7ffe38c1071 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:56.545073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da74e-f12f-4644-96bd-60db68c4270e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:56.546352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da74e-f12f-4644-96bd-60db68c4270e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:56.546588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da74e-f12f-4644-96bd-60db68c4270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:56.572567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-672da74e-f12f-4644-96bd-60db68c4270e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:56.573925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-672da74e-f12f-4644-96bd-60db68c4270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:56.672938 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3479/6946] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:56.681136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a632-8ebb-4385-bfc7-cd1d4ab18f31 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:56.682080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a632-8ebb-4385-bfc7-cd1d4ab18f31 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:56.682441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a632-8ebb-4385-bfc7-cd1d4ab18f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:56.718055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4162a632-8ebb-4385-bfc7-cd1d4ab18f31 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:56.719474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4162a632-8ebb-4385-bfc7-cd1d4ab18f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:56.742537 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3468/6947] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:15:56.746958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da74e-f12f-4644-96bd-60db68c4270e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:56.759724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da74e-f12f-4644-96bd-60db68c4270e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:56.766725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:56.767788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:56.768541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:56.768541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:56.769425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:56.770163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:56.776445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:56.782934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a632-8ebb-4385-bfc7-cd1d4ab18f31 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:56.784475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4162a632-8ebb-4385-bfc7-cd1d4ab18f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:56.808916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a632-8ebb-4385-bfc7-cd1d4ab18f31 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:56.814199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3480/6948] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:15:56.819172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:56.821462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:56.827644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:56.827947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:56.828308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] PATH_INFO: `/v3/projects/62137beb723b4b14b1811628e3f259f0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:56.832798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=62137beb723b4b14b1811628e3f259f0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:56.834746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:56.853007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5feb06-3f4e-4ed1-b506-674725424890 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:56.859190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2f4b-1890-47bc-a137-cb4763926b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:56.859883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2f4b-1890-47bc-a137-cb4763926b15 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:56.860153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2f4b-1890-47bc-a137-cb4763926b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:56.860466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2f4b-1890-47bc-a137-cb4763926b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:56.861176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c2f4b-1890-47bc-a137-cb4763926b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:56.863392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c2f4b-1890-47bc-a137-cb4763926b15 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:56.905153 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3481/6949] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:56 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:56.909894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2f4b-1890-47bc-a137-cb4763926b15 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:56.915926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62137beb723b4b14b1811628e3f259f0', 'request_id': 'req-b1692236-5f95-4a39-a656-dc07d3077d6d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.926150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62137beb723b4b14b1811628e3f259f0', 'request_id': 'req-b1692236-5f95-4a39-a656-dc07d3077d6d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.943402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62137beb723b4b14b1811628e3f259f0', 'request_id': 'req-b1692236-5f95-4a39-a656-dc07d3077d6d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.960158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] The token cache is being invalidate because project 62137beb723b4b14b1811628e3f259f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:56.960883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.961849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:56.964157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3469/6950] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:56 2022] DELETE /identity/v3/projects/62137beb723b4b14b1811628e3f259f0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:56.968265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:56.969918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:57.029957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2f4b-1890-47bc-a137-cb4763926b15 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:57.035351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:57.036051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:57.036371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:57.036651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:57.037508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:57.039642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:57.087474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692236-5f95-4a39-a656-dc07d3077d6d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:57.095098 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3482/6951] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:56 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:57.096691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:57.097330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:57.098359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:57.099314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:57.099449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:57.099449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] PATH_INFO: `/v3/users/6fa439ce4d22487b8c2de38d074d69ef` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:57.100754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa439ce4d22487b8c2de38d074d69ef)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:57.102797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:57.114871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330591d3-e1a6-4ac5-a616-42cfb5216644 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:57.120503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3045-4960-4da5-977b-010390eba55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:57.121536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3045-4960-4da5-977b-010390eba55c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:57.121536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3045-4960-4da5-977b-010390eba55c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:57.121998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3045-4960-4da5-977b-010390eba55c admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:57.122755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c3045-4960-4da5-977b-010390eba55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:57.125200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c3045-4960-4da5-977b-010390eba55c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:57.155435 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3483/6952] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:15:57.156702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3045-4960-4da5-977b-010390eba55c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:57.178111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3045-4960-4da5-977b-010390eba55c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:57.189676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:57.190638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:57.191387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:57.191387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:57.192107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:57.193392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa439ce4d22487b8c2de38d074d69ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:57.194139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:57.195069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa439ce4d22487b8c2de38d074d69ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:57.201620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa439ce4d22487b8c2de38d074d69ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:57.219994 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3484/6953] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:57.222748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:57.228402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:57.237319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa439ce4d22487b8c2de38d074d69ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:57.253114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c8b1a4c4-3f1f-46e3-959c-e57d84a2ce68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa439ce4d22487b8c2de38d074d69ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:57.268156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b360d5-cc22-4a77-a9ee-e8093dbc9e34 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:57.278360 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3470/6954] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:15:56 2022] DELETE /identity/v3/users/6fa439ce4d22487b8c2de38d074d69ef => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:15:57.413058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:57.415681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:57.416156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:57.417610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] PATH_INFO: `/v3/projects/e896604882924927a86fea7b4fdfb56b/users/0ad2e1d07d8449eca1700217ee91df37/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:57.453126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e896604882924927a86fea7b4fdfb56b, user_id=0ad2e1d07d8449eca1700217ee91df37, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:57.457415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:57.494716 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3485/6955] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:57 2022] PUT /identity/v3/projects/e896604882924927a86fea7b4fdfb56b/users/0ad2e1d07d8449eca1700217ee91df37/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:57.498528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ffbe-bbe0-4b0b-9194-013ac005da2a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:57.498982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ffbe-bbe0-4b0b-9194-013ac005da2a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:57.499258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ffbe-bbe0-4b0b-9194-013ac005da2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:57.548212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-82c3ffbe-bbe0-4b0b-9194-013ac005da2a None None] MFA Rules not processed for user `0ad2e1d07d8449eca1700217ee91df37`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:57.549638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-82c3ffbe-bbe0-4b0b-9194-013ac005da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:57.681048 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3471/6956] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:57.691308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:57.693103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:57.770168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8084ce-ed7a-413a-920f-30101e2c7d9f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:57.775714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02e907-8c4e-4230-910c-f3a83cfb3ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:57.776267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02e907-8c4e-4230-910c-f3a83cfb3ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:57.780922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02e907-8c4e-4230-910c-f3a83cfb3ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:57.781222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02e907-8c4e-4230-910c-f3a83cfb3ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:57.795025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02e907-8c4e-4230-910c-f3a83cfb3ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:57.797646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02e907-8c4e-4230-910c-f3a83cfb3ba6 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:57.810193 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3486/6957] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:15:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:15:57.990188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ffbe-bbe0-4b0b-9194-013ac005da2a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:57.993871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-82c3ffbe-bbe0-4b0b-9194-013ac005da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:58.119681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ffbe-bbe0-4b0b-9194-013ac005da2a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:58.127227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:58.128511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.128799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.129078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] PATH_INFO: `/v3/projects/a0450196f463407598eaab1a7abb3913` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:58.130512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0450196f463407598eaab1a7abb3913)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:58.133447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:58.201102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0450196f463407598eaab1a7abb3913', 'request_id': 'req-c982805e-a46a-4fbc-a161-a75fa666d8ee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:58.210384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0450196f463407598eaab1a7abb3913', 'request_id': 'req-c982805e-a46a-4fbc-a161-a75fa666d8ee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:58.227106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0450196f463407598eaab1a7abb3913', 'request_id': 'req-c982805e-a46a-4fbc-a161-a75fa666d8ee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:58.255605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] The token cache is being invalidate because project a0450196f463407598eaab1a7abb3913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:15:58.256472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:58.259494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c982805e-a46a-4fbc-a161-a75fa666d8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:15:58.262110 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3472/6958] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:15:57 2022] DELETE /identity/v3/projects/a0450196f463407598eaab1a7abb3913 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:58.268250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5922d8-0228-458f-adee-88ef27177ad9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.268647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5922d8-0228-458f-adee-88ef27177ad9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.268901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5922d8-0228-458f-adee-88ef27177ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:58.301538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5f5922d8-0228-458f-adee-88ef27177ad9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:58.303170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5f5922d8-0228-458f-adee-88ef27177ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:58.400710 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3487/6959] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:58.413235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38cac4-8f31-4016-a713-9eddb11cacaf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.413700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38cac4-8f31-4016-a713-9eddb11cacaf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.414161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38cac4-8f31-4016-a713-9eddb11cacaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:58.457875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cd38cac4-8f31-4016-a713-9eddb11cacaf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:58.459991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cd38cac4-8f31-4016-a713-9eddb11cacaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:58.488451 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3473/6960] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:58.503791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5922d8-0228-458f-adee-88ef27177ad9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:58.525731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5922d8-0228-458f-adee-88ef27177ad9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:58.544423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:58.545106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.545431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.545730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:58.546551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:15:58.546945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:58.553800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:58.583147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3488/6961] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:15:58.588253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38cac4-8f31-4016-a713-9eddb11cacaf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:58.603682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38cac4-8f31-4016-a713-9eddb11cacaf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:58.628592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb9fba-e3b9-476d-aa76-bb6695e169d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:58.629443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb9fba-e3b9-476d-aa76-bb6695e169d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.629732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb9fba-e3b9-476d-aa76-bb6695e169d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.630174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb9fba-e3b9-476d-aa76-bb6695e169d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:58.631212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb9fba-e3b9-476d-aa76-bb6695e169d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:58.633167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb9fba-e3b9-476d-aa76-bb6695e169d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:58.682995 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3474/6962] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:58 2022] POST /identity/v3/projects => generated 395 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:15:58.683628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:58.717477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dded985-8449-420b-afe4-4304513e0f24 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:58.810882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b170abe-f5e0-4000-a3c7-ce9262f7b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:58.812113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170abe-f5e0-4000-a3c7-ce9262f7b67f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.812408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170abe-f5e0-4000-a3c7-ce9262f7b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.812686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170abe-f5e0-4000-a3c7-ce9262f7b67f admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:58.813380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b170abe-f5e0-4000-a3c7-ce9262f7b67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:58.815488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b170abe-f5e0-4000-a3c7-ce9262f7b67f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:58.845066 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3489/6963] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:58 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:58.848218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb9fba-e3b9-476d-aa76-bb6695e169d1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:58.861652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb9fba-e3b9-476d-aa76-bb6695e169d1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:58.867255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e228303-694f-4c16-b565-01053678699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:58.867953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e228303-694f-4c16-b565-01053678699f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.868631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e228303-694f-4c16-b565-01053678699f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.868920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e228303-694f-4c16-b565-01053678699f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:58.869665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e228303-694f-4c16-b565-01053678699f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:58.871360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e228303-694f-4c16-b565-01053678699f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:58.888197 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3475/6964] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:58.893855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b170abe-f5e0-4000-a3c7-ce9262f7b67f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:58.908865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b170abe-f5e0-4000-a3c7-ce9262f7b67f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:58.914675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9e5dc-6afc-4df0-a44d-1d5d0d3f9480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:58.915411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9e5dc-6afc-4df0-a44d-1d5d0d3f9480 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.915682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9e5dc-6afc-4df0-a44d-1d5d0d3f9480 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.915964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9e5dc-6afc-4df0-a44d-1d5d0d3f9480 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:58.916760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9e5dc-6afc-4df0-a44d-1d5d0d3f9480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:58.918701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9e5dc-6afc-4df0-a44d-1d5d0d3f9480 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:58.933481 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3490/6965] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:58.938437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e228303-694f-4c16-b565-01053678699f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:58.959689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e228303-694f-4c16-b565-01053678699f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:58.969647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3cb34-3867-4f72-af74-0cf79ef03fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:58.971849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cb34-3867-4f72-af74-0cf79ef03fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:58.972028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cb34-3867-4f72-af74-0cf79ef03fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:58.972281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cb34-3867-4f72-af74-0cf79ef03fa7 admin admin] PATH_INFO: `/v3/projects/465b4f4d5a554a74936e3481110afbfd/users/cf2e798365e0474fa7fa006f134fdf3b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.009061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3cb34-3867-4f72-af74-0cf79ef03fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=465b4f4d5a554a74936e3481110afbfd, user_id=cf2e798365e0474fa7fa006f134fdf3b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:59.012484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3cb34-3867-4f72-af74-0cf79ef03fa7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:59.034644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3476/6966] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:58 2022] PUT /identity/v3/projects/465b4f4d5a554a74936e3481110afbfd/users/cf2e798365e0474fa7fa006f134fdf3b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:59.050818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578474ae-0f19-4a65-bdeb-82400bf94f7f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:59.051350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578474ae-0f19-4a65-bdeb-82400bf94f7f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:59.051875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578474ae-0f19-4a65-bdeb-82400bf94f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.112874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-578474ae-0f19-4a65-bdeb-82400bf94f7f None None] MFA Rules not processed for user `cf2e798365e0474fa7fa006f134fdf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:59.115496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-578474ae-0f19-4a65-bdeb-82400bf94f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:15:59.228358 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3491/6967] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:15:59.228833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3cb34-3867-4f72-af74-0cf79ef03fa7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:59.318772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3cb34-3867-4f72-af74-0cf79ef03fa7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:59.324038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f032-cdca-46f1-bf42-382e58b5541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:59.324789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f032-cdca-46f1-bf42-382e58b5541b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:59.325096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f032-cdca-46f1-bf42-382e58b5541b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:59.325465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f032-cdca-46f1-bf42-382e58b5541b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.326185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f032-cdca-46f1-bf42-382e58b5541b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:59.329432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f032-cdca-46f1-bf42-382e58b5541b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:59.370456 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3477/6968] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:15:59 2022] POST /identity/v3/projects => generated 395 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:59.371189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578474ae-0f19-4a65-bdeb-82400bf94f7f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:59.386796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578474ae-0f19-4a65-bdeb-82400bf94f7f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:59.505420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f73a5-a1eb-45ef-8ab7-a9b78b37b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:59.506964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f73a5-a1eb-45ef-8ab7-a9b78b37b7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:59.507367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f73a5-a1eb-45ef-8ab7-a9b78b37b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:59.507816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f73a5-a1eb-45ef-8ab7-a9b78b37b7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.508907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f73a5-a1eb-45ef-8ab7-a9b78b37b7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:59.511814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f73a5-a1eb-45ef-8ab7-a9b78b37b7b6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:59.544151 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3492/6969] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:15:59 2022] POST /identity/v3/users => generated 304 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:15:59.549808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f032-cdca-46f1-bf42-382e58b5541b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:59.564255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f032-cdca-46f1-bf42-382e58b5541b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:59.577472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8484c-4e7a-4f41-9cd7-9e6b8e67d70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:59.578554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8484c-4e7a-4f41-9cd7-9e6b8e67d70f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:59.579105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8484c-4e7a-4f41-9cd7-9e6b8e67d70f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:59.579620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8484c-4e7a-4f41-9cd7-9e6b8e67d70f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.581481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8484c-4e7a-4f41-9cd7-9e6b8e67d70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:59.584273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8484c-4e7a-4f41-9cd7-9e6b8e67d70f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:59.603320 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3478/6970] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:59.607366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f73a5-a1eb-45ef-8ab7-a9b78b37b7b6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:59.620291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f73a5-a1eb-45ef-8ab7-a9b78b37b7b6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:59.630067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b279-b140-4300-a3c7-7e6b8568adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:59.631166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b279-b140-4300-a3c7-7e6b8568adf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:59.631617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b279-b140-4300-a3c7-7e6b8568adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:59.632184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b279-b140-4300-a3c7-7e6b8568adf3 admin admin] PATH_INFO: `/v3/projects/d983b6eea3d1479b8282837f5b3a5a94/users/c5b979703dbd45f5a2dfe07c0e7337c6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.661630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3b279-b140-4300-a3c7-7e6b8568adf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d983b6eea3d1479b8282837f5b3a5a94, user_id=c5b979703dbd45f5a2dfe07c0e7337c6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:59.664865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3b279-b140-4300-a3c7-7e6b8568adf3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:59.683543 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3493/6971] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:59 2022] PUT /identity/v3/projects/d983b6eea3d1479b8282837f5b3a5a94/users/c5b979703dbd45f5a2dfe07c0e7337c6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:59.685764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8484c-4e7a-4f41-9cd7-9e6b8e67d70f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:59.702080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8484c-4e7a-4f41-9cd7-9e6b8e67d70f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:59.796994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99cf2-2cca-4720-a307-aa9c3979fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:59.797704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99cf2-2cca-4720-a307-aa9c3979fade admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:59.797998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99cf2-2cca-4720-a307-aa9c3979fade admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:59.798268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99cf2-2cca-4720-a307-aa9c3979fade admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.799113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99cf2-2cca-4720-a307-aa9c3979fade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:59.801977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99cf2-2cca-4720-a307-aa9c3979fade admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:59.836216 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3479/6972] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:15:59.840722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b279-b140-4300-a3c7-7e6b8568adf3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:15:59.855415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b279-b140-4300-a3c7-7e6b8568adf3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:15:59.862085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb034d70-164c-491d-824a-c98f4bf9a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:15:59.863151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034d70-164c-491d-824a-c98f4bf9a44b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:59.863515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034d70-164c-491d-824a-c98f4bf9a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:59.863937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034d70-164c-491d-824a-c98f4bf9a44b admin admin] PATH_INFO: `/v3/projects/d983b6eea3d1479b8282837f5b3a5a94/users/c5b979703dbd45f5a2dfe07c0e7337c6/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.866839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb034d70-164c-491d-824a-c98f4bf9a44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d983b6eea3d1479b8282837f5b3a5a94, user_id=c5b979703dbd45f5a2dfe07c0e7337c6, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:15:59.869634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb034d70-164c-491d-824a-c98f4bf9a44b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:15:59.884975 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3494/6973] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:15:59 2022] PUT /identity/v3/projects/d983b6eea3d1479b8282837f5b3a5a94/users/c5b979703dbd45f5a2dfe07c0e7337c6/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:15:59.895863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43336-1896-443e-ae0e-2ef6865e92cc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:15:59.896242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43336-1896-443e-ae0e-2ef6865e92cc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:15:59.896604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43336-1896-443e-ae0e-2ef6865e92cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:15:59.929323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f3c43336-1896-443e-ae0e-2ef6865e92cc None None] MFA Rules not processed for user `c5b979703dbd45f5a2dfe07c0e7337c6`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:15:59.931494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f3c43336-1896-443e-ae0e-2ef6865e92cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:00.095771 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3480/6974] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:00.103671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb034d70-164c-491d-824a-c98f4bf9a44b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.240820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb034d70-164c-491d-824a-c98f4bf9a44b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:00.255479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e214-5b02-4021-b4b3-b9e14a599e77 tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2e798365e0474fa7fa006f134fdf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '465b4f4d5a554a74936e3481110afbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:00.256200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e214-5b02-4021-b4b3-b9e14a599e77 tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:00.256568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e214-5b02-4021-b4b3-b9e14a599e77 tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:00.256883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e214-5b02-4021-b4b3-b9e14a599e77 tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:00.257619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5e214-5b02-4021-b4b3-b9e14a599e77 tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:00.267690 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-46a5e214-5b02-4021-b4b3-b9e14a599e77 tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Feb 19 21:16:00.273045 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3495/6975] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:16:00 2022] POST /identity/v3/projects => generated 136 bytes in 166 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:16:00.274475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43336-1896-443e-ae0e-2ef6865e92cc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.288508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43336-1896-443e-ae0e-2ef6865e92cc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:00.304186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5b979703dbd45f5a2dfe07c0e7337c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd983b6eea3d1479b8282837f5b3a5a94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:00.304864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:00.305187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:00.305580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:00.306411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:00.308360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:00.314876 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Invalid input for field 'name': '' is too short Feb 19 21:16:00.314876 ncdv-master-1 devstack@keystone.service[96909]: Failed validating 'minLength' in schema['properties']['name']: Feb 19 21:16:00.314876 ncdv-master-1 devstack@keystone.service[96909]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Feb 19 21:16:00.314876 ncdv-master-1 devstack@keystone.service[96909]: On instance['name']: Feb 19 21:16:00.314876 ncdv-master-1 devstack@keystone.service[96909]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Feb 19 21:16:00.320153 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3481/6976] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:16:00 2022] POST /identity/v3/projects => generated 283 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Feb 19 21:16:00.321376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e214-5b02-4021-b4b3-b9e14a599e77 tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.336891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e214-5b02-4021-b4b3-b9e14a599e77 tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:00.341953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5b979703dbd45f5a2dfe07c0e7337c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd983b6eea3d1479b8282837f5b3a5a94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:00.342811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:00.343197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:00.343628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:00.344486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:00.346796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:00.352374 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Feb 19 21:16:00.352374 ncdv-master-1 devstack@keystone.service[96910]: Failed validating 'maxLength' in schema['properties']['name']: Feb 19 21:16:00.352374 ncdv-master-1 devstack@keystone.service[96910]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Feb 19 21:16:00.352374 ncdv-master-1 devstack@keystone.service[96910]: On instance['name']: Feb 19 21:16:00.352374 ncdv-master-1 devstack@keystone.service[96910]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Feb 19 21:16:00.354272 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3496/6977] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:16:00 2022] POST /identity/v3/projects => generated 412 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Feb 19 21:16:00.359911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.371678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835195cd-8714-4942-8549-579ace1b59aa tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:00.377185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5b979703dbd45f5a2dfe07c0e7337c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd983b6eea3d1479b8282837f5b3a5a94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:00.378049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:00.378333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:00.378611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] PATH_INFO: `/v3/projects/86846a98b9274851b17be036d9f0da03` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:00.388211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorizing `identity:delete_project(project_id=86846a98b9274851b17be036d9f0da03)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:00.395437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:00.414033 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Could not find project: 86846a98b9274851b17be036d9f0da03.: keystone.exception.ProjectNotFound: Could not find project: 86846a98b9274851b17be036d9f0da03. Feb 19 21:16:00.415489 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3482/6978] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:00 2022] DELETE /identity/v3/projects/86846a98b9274851b17be036d9f0da03 => generated 113 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:16:00.420687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.433903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1202c39-6b9b-47f2-b319-272581f3c030 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:00.441248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d793-be01-4b36-8247-587ca895902a tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2e798365e0474fa7fa006f134fdf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '465b4f4d5a554a74936e3481110afbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:00.441908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d793-be01-4b36-8247-587ca895902a tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:00.442194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d793-be01-4b36-8247-587ca895902a tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:00.442474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d793-be01-4b36-8247-587ca895902a tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:00.443212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5d793-be01-4b36-8247-587ca895902a tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] RBAC: Authorizing `identity:list_projects()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:00.449976 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-61a5d793-be01-4b36-8247-587ca895902a tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Feb 19 21:16:00.451646 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3497/6979] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Feb 19 21:16:00 2022] GET /identity/v3/projects => generated 135 bytes in 31 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:16:00.458455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.474760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2d309-d607-4517-af61-bfe1af7337fd tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:00.485911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f438-00d0-466e-ac6d-e8cbfec6d057 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5b979703dbd45f5a2dfe07c0e7337c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd983b6eea3d1479b8282837f5b3a5a94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:00.487142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f438-00d0-466e-ac6d-e8cbfec6d057 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:00.487672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f438-00d0-466e-ac6d-e8cbfec6d057 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:00.488182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f438-00d0-466e-ac6d-e8cbfec6d057 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:00.489308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8f438-00d0-466e-ac6d-e8cbfec6d057 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:00.493153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8f438-00d0-466e-ac6d-e8cbfec6d057 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:00.546559 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3483/6980] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:00 2022] POST /identity/v3/projects => generated 358 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:00.550727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d793-be01-4b36-8247-587ca895902a tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.564662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d793-be01-4b36-8247-587ca895902a tempest-ProjectsNegativeStaticTestJSON-917692675 tempest-ProjectsNegativeStaticTestJSON-917692675-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:00.630929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5b979703dbd45f5a2dfe07c0e7337c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd983b6eea3d1479b8282837f5b3a5a94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:00.631900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:00.632287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:00.632702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:00.633540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:00.636447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:00.663730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.sql.core [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-651584872' for key 'project.ixu_project_name_domain_id'") Feb 19 21:16:00.663730 ncdv-master-1 devstack@keystone.service[96910]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 19 21:16:00.663730 ncdv-master-1 devstack@keystone.service[96910]: [parameters: {'id': '0adcad7cbe814bf2840f55752a03b5d2', 'name': 'tempest-project-dup-651584872', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 19 21:16:00.663730 ncdv-master-1 devstack@keystone.service[96910]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96910) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 19 21:16:00.673525 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-651584872, project id 0adcad7cbe814bf2840f55752a03b5d2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-651584872, project id 0adcad7cbe814bf2840f55752a03b5d2. Feb 19 21:16:00.678081 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3498/6981] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:16:00 2022] POST /identity/v3/projects => generated 284 bytes in 128 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 19 21:16:00.683927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f438-00d0-466e-ac6d-e8cbfec6d057 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.697500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f438-00d0-466e-ac6d-e8cbfec6d057 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:00.702575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5b979703dbd45f5a2dfe07c0e7337c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd983b6eea3d1479b8282837f5b3a5a94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:00.703476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:00.703779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:00.704050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] PATH_INFO: `/v3/projects/e88fb61849cc4b9da0f288793460f981` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:00.705530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e88fb61849cc4b9da0f288793460f981)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:00.708197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:00.782713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88fb61849cc4b9da0f288793460f981', 'request_id': 'req-17f7e906-0762-486b-a8f0-e264c39ed1e0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:00.789382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88fb61849cc4b9da0f288793460f981', 'request_id': 'req-17f7e906-0762-486b-a8f0-e264c39ed1e0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:00.802208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88fb61849cc4b9da0f288793460f981', 'request_id': 'req-17f7e906-0762-486b-a8f0-e264c39ed1e0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:00.835324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] The token cache is being invalidate because project e88fb61849cc4b9da0f288793460f981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:00.835670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:00.836680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-17f7e906-0762-486b-a8f0-e264c39ed1e0 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:00.845457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:00.849273 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3484/6982] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:00 2022] DELETE /identity/v3/projects/e88fb61849cc4b9da0f288793460f981 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:00.851139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:00.958571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a457b-d77c-46a0-95b8-c0f0a1d64278 tempest-ProjectsNegativeStaticTestJSON-456123699 tempest-ProjectsNegativeStaticTestJSON-456123699-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:01.042821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:01.043998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:01.044280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:01.044591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] PATH_INFO: `/v3/users/cf2e798365e0474fa7fa006f134fdf3b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:01.046501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2e798365e0474fa7fa006f134fdf3b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:01.049046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:01.146503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2e798365e0474fa7fa006f134fdf3b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:01.189856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2e798365e0474fa7fa006f134fdf3b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:01.218831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2e798365e0474fa7fa006f134fdf3b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:01.221657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2e798365e0474fa7fa006f134fdf3b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:01.222117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2e798365e0474fa7fa006f134fdf3b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:01.253127 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3499/6983] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:00 2022] DELETE /identity/v3/users/cf2e798365e0474fa7fa006f134fdf3b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:01.260442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407961-42d7-46fb-a49c-a627ced814da None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:01.260935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407961-42d7-46fb-a49c-a627ced814da None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:01.261036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407961-42d7-46fb-a49c-a627ced814da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:01.320843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e8407961-42d7-46fb-a49c-a627ced814da None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:01.323202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e8407961-42d7-46fb-a49c-a627ced814da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:01.469420 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3485/6984] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:01.525170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:01.527293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:01.619366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5cd91-2a42-4075-8a6a-1bdfafea9291 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:01.624764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:01.626265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:01.626792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:01.627197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:01.638705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:01.640948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:01.660002 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3500/6985] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:01.954214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8407961-42d7-46fb-a49c-a627ced814da None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:01.957890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e8407961-42d7-46fb-a49c-a627ced814da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:02.185649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8407961-42d7-46fb-a49c-a627ced814da None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:02.203480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:02.206187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:02.206751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:02.207222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:02.211357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:02.238612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:02.242286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:02.264584 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3486/6986] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:02.497675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:02.499610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:02.528957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf985c07-e4a1-4cda-956e-d0776f2212c4 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:02.541312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:02.543002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:02.544625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:02.544933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] PATH_INFO: `/v3/projects/465b4f4d5a554a74936e3481110afbfd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:02.547782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=465b4f4d5a554a74936e3481110afbfd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:02.549888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:02.666181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '465b4f4d5a554a74936e3481110afbfd', 'request_id': 'req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.675282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '465b4f4d5a554a74936e3481110afbfd', 'request_id': 'req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.689689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '465b4f4d5a554a74936e3481110afbfd', 'request_id': 'req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.725867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] The token cache is being invalidate because project 465b4f4d5a554a74936e3481110afbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:02.728274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.729218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.735480 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3501/6987] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:02 2022] DELETE /identity/v3/projects/465b4f4d5a554a74936e3481110afbfd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:02.739717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:02.758799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff57104-f9f5-4ff9-8bb7-d22b77563f1a service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:02.865627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:02.867416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:02.867713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:02.867984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] PATH_INFO: `/v3/users/c5b979703dbd45f5a2dfe07c0e7337c6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:02.870147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b979703dbd45f5a2dfe07c0e7337c6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:02.872372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:02.965638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b979703dbd45f5a2dfe07c0e7337c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.966649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b979703dbd45f5a2dfe07c0e7337c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.967685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b979703dbd45f5a2dfe07c0e7337c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.982554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b979703dbd45f5a2dfe07c0e7337c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:02.994575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b979703dbd45f5a2dfe07c0e7337c6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:03.012730 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3487/6988] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:02 2022] DELETE /identity/v3/users/c5b979703dbd45f5a2dfe07c0e7337c6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:03.751868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:03.753958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:03.844799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:03.846187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:03.871095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ebe9-2cd6-4f4a-9cbd-4416718081ad admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:04.003157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a915044-489f-40b3-b456-e963e45d2f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:04.003842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a915044-489f-40b3-b456-e963e45d2f55 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:04.004315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a915044-489f-40b3-b456-e963e45d2f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:04.005684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a915044-489f-40b3-b456-e963e45d2f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:04.012776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8a915044-489f-40b3-b456-e963e45d2f55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:04.026693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8cdd0-6253-417f-a7d1-46fc7400d494 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:04.039365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:04.040921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:04.041212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:04.041500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] PATH_INFO: `/v3/projects/d983b6eea3d1479b8282837f5b3a5a94` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:04.043632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d983b6eea3d1479b8282837f5b3a5a94)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:04.051200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:04.162199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd983b6eea3d1479b8282837f5b3a5a94', 'request_id': 'req-35b7177b-70e9-4587-ad3a-43f964b6912c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:04.164459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a915044-489f-40b3-b456-e963e45d2f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:04.166411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a915044-489f-40b3-b456-e963e45d2f55 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:04.180860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd983b6eea3d1479b8282837f5b3a5a94', 'request_id': 'req-35b7177b-70e9-4587-ad3a-43f964b6912c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:04.193345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd983b6eea3d1479b8282837f5b3a5a94', 'request_id': 'req-35b7177b-70e9-4587-ad3a-43f964b6912c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:04.195638 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3502/6989] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:04.229944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] The token cache is being invalidate because project d983b6eea3d1479b8282837f5b3a5a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:04.234120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:04.237677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-35b7177b-70e9-4587-ad3a-43f964b6912c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:04.241779 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3488/6990] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:03 2022] DELETE /identity/v3/projects/d983b6eea3d1479b8282837f5b3a5a94 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:04.247412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0648e1-7809-4a42-944e-e80fe6ebd1cd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:04.247852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0648e1-7809-4a42-944e-e80fe6ebd1cd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:04.248312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0648e1-7809-4a42-944e-e80fe6ebd1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:04.308619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2c0648e1-7809-4a42-944e-e80fe6ebd1cd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:04.312434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2c0648e1-7809-4a42-944e-e80fe6ebd1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:04.466999 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3503/6991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:04.479665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5631a-c5c4-48b2-b29c-7530bacd38f1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:04.480264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5631a-c5c4-48b2-b29c-7530bacd38f1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:04.480783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5631a-c5c4-48b2-b29c-7530bacd38f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:04.546160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7eb5631a-c5c4-48b2-b29c-7530bacd38f1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:04.548292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7eb5631a-c5c4-48b2-b29c-7530bacd38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:04.570833 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3489/6992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:04.575264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0648e1-7809-4a42-944e-e80fe6ebd1cd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:04.588306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0648e1-7809-4a42-944e-e80fe6ebd1cd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:04.595430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:04.596805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:04.597517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:04.598191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:04.600714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:04.601626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:04.603487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:04.627022 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3504/6993] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:04.632172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5631a-c5c4-48b2-b29c-7530bacd38f1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:04.645086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5631a-c5c4-48b2-b29c-7530bacd38f1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:04.654430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0f96e-2f3b-4ccd-bd02-a6573c60e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:04.656579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0f96e-2f3b-4ccd-bd02-a6573c60e71e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:04.658713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0f96e-2f3b-4ccd-bd02-a6573c60e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:04.660284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0f96e-2f3b-4ccd-bd02-a6573c60e71e admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:04.663639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0f96e-2f3b-4ccd-bd02-a6573c60e71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:04.671161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0f96e-2f3b-4ccd-bd02-a6573c60e71e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:04.733497 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3490/6994] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:04 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:04.734266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:04.761129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227358a9-0547-4d26-892b-e011337e5f8f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:04.916591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f5ed8-a82e-4192-9f66-81f1855da2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:04.919655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f5ed8-a82e-4192-9f66-81f1855da2fe admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:04.920052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f5ed8-a82e-4192-9f66-81f1855da2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:04.921023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f5ed8-a82e-4192-9f66-81f1855da2fe admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:04.922627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f5ed8-a82e-4192-9f66-81f1855da2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:04.928696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f5ed8-a82e-4192-9f66-81f1855da2fe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:05.031715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3505/6995] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:04 2022] POST /identity/v3/users => generated 285 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:05.035943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0f96e-2f3b-4ccd-bd02-a6573c60e71e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:05.055827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0f96e-2f3b-4ccd-bd02-a6573c60e71e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:05.069410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b2f76-87cc-4b64-af9d-a0483774e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:05.070327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b2f76-87cc-4b64-af9d-a0483774e54e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.070792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b2f76-87cc-4b64-af9d-a0483774e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.071247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b2f76-87cc-4b64-af9d-a0483774e54e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.073061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b2f76-87cc-4b64-af9d-a0483774e54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:05.075063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b2f76-87cc-4b64-af9d-a0483774e54e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:05.107121 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3491/6996] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:05.110985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f5ed8-a82e-4192-9f66-81f1855da2fe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:05.169407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f5ed8-a82e-4192-9f66-81f1855da2fe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:05.181175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f72a41-1674-4014-8416-85f92199c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:05.183718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72a41-1674-4014-8416-85f92199c144 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.184200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72a41-1674-4014-8416-85f92199c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.186860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72a41-1674-4014-8416-85f92199c144 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.192652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f72a41-1674-4014-8416-85f92199c144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:05.195050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f72a41-1674-4014-8416-85f92199c144 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:05.221404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b2f76-87cc-4b64-af9d-a0483774e54e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:05.229023 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3506/6997] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:05.236413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b2f76-87cc-4b64-af9d-a0483774e54e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:05.242099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c39a1-950c-4c35-a37c-64d86d17061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:05.243366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c39a1-950c-4c35-a37c-64d86d17061a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.244022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c39a1-950c-4c35-a37c-64d86d17061a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.244576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c39a1-950c-4c35-a37c-64d86d17061a admin admin] PATH_INFO: `/v3/projects/0a398ba37d43452e9279b71d58136e5b/users/94b59159238f41eba3a1c5eb43113421/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.267879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c39a1-950c-4c35-a37c-64d86d17061a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a398ba37d43452e9279b71d58136e5b, user_id=94b59159238f41eba3a1c5eb43113421, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:05.274526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c39a1-950c-4c35-a37c-64d86d17061a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:05.294072 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3492/6998] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:05 2022] PUT /identity/v3/projects/0a398ba37d43452e9279b71d58136e5b/users/94b59159238f41eba3a1c5eb43113421/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:05.304922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972229c-9929-4698-b513-f844755d7ba0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.305472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972229c-9929-4698-b513-f844755d7ba0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.305853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972229c-9929-4698-b513-f844755d7ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.349094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6972229c-9929-4698-b513-f844755d7ba0 None None] MFA Rules not processed for user `94b59159238f41eba3a1c5eb43113421`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:05.350872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6972229c-9929-4698-b513-f844755d7ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:05.472382 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3507/6999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:05.477345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c39a1-950c-4c35-a37c-64d86d17061a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:05.503299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c39a1-950c-4c35-a37c-64d86d17061a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:05.509462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76347011-7202-4d4e-aab4-aaa379b37278 tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b59159238f41eba3a1c5eb43113421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a398ba37d43452e9279b71d58136e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:05.511738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347011-7202-4d4e-aab4-aaa379b37278 tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.512215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347011-7202-4d4e-aab4-aaa379b37278 tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.512720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347011-7202-4d4e-aab4-aaa379b37278 tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] PATH_INFO: `/v3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.521151 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3493/7000] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Feb 19 21:16:05 2022] GET /identity/v3 => generated 255 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:05.522156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972229c-9929-4698-b513-f844755d7ba0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:05.535436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972229c-9929-4698-b513-f844755d7ba0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:05.542714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae0d2e-f856-415b-a7e8-8c61577e499f tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b59159238f41eba3a1c5eb43113421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a398ba37d43452e9279b71d58136e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:05.544257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae0d2e-f856-415b-a7e8-8c61577e499f tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.544898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae0d2e-f856-415b-a7e8-8c61577e499f tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.546132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae0d2e-f856-415b-a7e8-8c61577e499f tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] PATH_INFO: `/v3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.553581 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3508/7001] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Feb 19 21:16:05 2022] GET /identity/v3 => generated 255 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:05.555481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76347011-7202-4d4e-aab4-aaa379b37278 tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:05.583543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76347011-7202-4d4e-aab4-aaa379b37278 tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:05.598377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a5cc4-0643-431d-beb0-a279c796630c tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b59159238f41eba3a1c5eb43113421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a398ba37d43452e9279b71d58136e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:05.599542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a5cc4-0643-431d-beb0-a279c796630c tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.599832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a5cc4-0643-431d-beb0-a279c796630c tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.600112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a5cc4-0643-431d-beb0-a279c796630c tempest-TestApiDiscovery-1792016392 tempest-TestApiDiscovery-1792016392-project] PATH_INFO: `/v3` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.601953 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3494/7002] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Feb 19 21:16:05 2022] GET /identity/v3 => generated 255 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:05.609017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cdd6f-6e14-4f25-8221-9176403b4dfd None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.609304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cdd6f-6e14-4f25-8221-9176403b4dfd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.609585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cdd6f-6e14-4f25-8221-9176403b4dfd None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.611415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3509/7003] 10.222.0.30 () {56 vars in 894 bytes} [Sat Feb 19 21:16:05 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:16:05.616928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ac2d-84f6-437c-bdad-44ad61b3ea05 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.617448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ac2d-84f6-437c-bdad-44ad61b3ea05 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.617888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ac2d-84f6-437c-bdad-44ad61b3ea05 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.623535 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3495/7004] 10.222.0.30 () {56 vars in 894 bytes} [Sat Feb 19 21:16:05 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:16:05.624209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cdd6f-6e14-4f25-8221-9176403b4dfd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:05.715932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cdd6f-6e14-4f25-8221-9176403b4dfd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:05.721465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:05.722543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.722771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.723046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] PATH_INFO: `/v3/users/94b59159238f41eba3a1c5eb43113421` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.724291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b59159238f41eba3a1c5eb43113421)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:05.731300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:05.799123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b59159238f41eba3a1c5eb43113421'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:05.816101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b59159238f41eba3a1c5eb43113421'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:05.830053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b59159238f41eba3a1c5eb43113421'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:05.830981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b59159238f41eba3a1c5eb43113421'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:05.832001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b59159238f41eba3a1c5eb43113421'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:05.850762 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3510/7005] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:05 2022] DELETE /identity/v3/users/94b59159238f41eba3a1c5eb43113421 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:05.855408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5421af-9b91-4767-8f94-2bc58d0c761d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:05.855834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5421af-9b91-4767-8f94-2bc58d0c761d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:05.856174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5421af-9b91-4767-8f94-2bc58d0c761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:05.880388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-cf5421af-9b91-4767-8f94-2bc58d0c761d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:05.881998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cf5421af-9b91-4767-8f94-2bc58d0c761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:05.978553 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3496/7006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:05.986619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:05.988316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:06.098218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa81e-9f37-4844-bcd2-81a86d7e90e5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:06.103727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd118b-57e4-47b4-bc55-b24db9e17fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:06.104969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd118b-57e4-47b4-bc55-b24db9e17fca service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:06.105487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd118b-57e4-47b4-bc55-b24db9e17fca service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:06.105965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd118b-57e4-47b4-bc55-b24db9e17fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:06.124400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd118b-57e4-47b4-bc55-b24db9e17fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:06.127976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd118b-57e4-47b4-bc55-b24db9e17fca service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:06.144392 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3511/7007] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:06.514000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5421af-9b91-4767-8f94-2bc58d0c761d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:06.516058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cf5421af-9b91-4767-8f94-2bc58d0c761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:06.541332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5421af-9b91-4767-8f94-2bc58d0c761d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:06.551968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:06.554050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:06.554436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:06.554842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] PATH_INFO: `/v3/projects/0a398ba37d43452e9279b71d58136e5b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:06.557039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a398ba37d43452e9279b71d58136e5b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:06.559828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:06.672045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a398ba37d43452e9279b71d58136e5b', 'request_id': 'req-48111f57-5328-425e-8678-a56671b0b0a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:06.689070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a398ba37d43452e9279b71d58136e5b', 'request_id': 'req-48111f57-5328-425e-8678-a56671b0b0a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:06.706467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a398ba37d43452e9279b71d58136e5b', 'request_id': 'req-48111f57-5328-425e-8678-a56671b0b0a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:06.721000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] The token cache is being invalidate because project 0a398ba37d43452e9279b71d58136e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:06.721291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:06.722142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-48111f57-5328-425e-8678-a56671b0b0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:06.723963 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3497/7008] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:06 2022] DELETE /identity/v3/projects/0a398ba37d43452e9279b71d58136e5b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:06.730321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f233-e743-4ab1-bd07-e2c30fbacff3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:06.730507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f233-e743-4ab1-bd07-e2c30fbacff3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:06.730753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f233-e743-4ab1-bd07-e2c30fbacff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:06.765979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cc02f233-e743-4ab1-bd07-e2c30fbacff3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:06.767642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc02f233-e743-4ab1-bd07-e2c30fbacff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:06.857024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3512/7009] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:06.866462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cff3-9673-4ce3-8f36-152c05774cf4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:06.867066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cff3-9673-4ce3-8f36-152c05774cf4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:06.867357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cff3-9673-4ce3-8f36-152c05774cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:06.916898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-aa83cff3-9673-4ce3-8f36-152c05774cf4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:06.918730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aa83cff3-9673-4ce3-8f36-152c05774cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:06.930799 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3498/7010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:06.935295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02f233-e743-4ab1-bd07-e2c30fbacff3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:06.957945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02f233-e743-4ab1-bd07-e2c30fbacff3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:06.963259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:06.963935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:06.964447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:06.964923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:06.965832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:06.966553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:06.968595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:06.989850 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3513/7011] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:06.991266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83cff3-9673-4ce3-8f36-152c05774cf4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:07.015033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83cff3-9673-4ce3-8f36-152c05774cf4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:07.027739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354745b-d3f8-448c-890a-bc40db1faa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:07.029167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354745b-d3f8-448c-890a-bc40db1faa44 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:07.029970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354745b-d3f8-448c-890a-bc40db1faa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:07.030941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354745b-d3f8-448c-890a-bc40db1faa44 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:07.032257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354745b-d3f8-448c-890a-bc40db1faa44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:07.038127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354745b-d3f8-448c-890a-bc40db1faa44 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:07.082877 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3499/7012] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:06 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:07.087350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:07.118306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fbf00-10c8-4799-8b60-8949963726cf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:07.265482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abf67d-158b-4379-b499-558d0626d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:07.267438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abf67d-158b-4379-b499-558d0626d15e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:07.269762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abf67d-158b-4379-b499-558d0626d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:07.270626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abf67d-158b-4379-b499-558d0626d15e admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:07.271601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abf67d-158b-4379-b499-558d0626d15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:07.275131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abf67d-158b-4379-b499-558d0626d15e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:07.336527 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3514/7013] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:07 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:07.340262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354745b-d3f8-448c-890a-bc40db1faa44 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:07.367594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354745b-d3f8-448c-890a-bc40db1faa44 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:07.386536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7973d-aaa1-4660-8dd8-207f66d200c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:07.389317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7973d-aaa1-4660-8dd8-207f66d200c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:07.392303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7973d-aaa1-4660-8dd8-207f66d200c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:07.393120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7973d-aaa1-4660-8dd8-207f66d200c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:07.395407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7973d-aaa1-4660-8dd8-207f66d200c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:07.402008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7973d-aaa1-4660-8dd8-207f66d200c1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:07.419971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3500/7014] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:16:07.425023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abf67d-158b-4379-b499-558d0626d15e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:07.440501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abf67d-158b-4379-b499-558d0626d15e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:07.447622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41894528-ec8a-4b45-8c7a-b84a4da26440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:07.449194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41894528-ec8a-4b45-8c7a-b84a4da26440 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:07.449714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41894528-ec8a-4b45-8c7a-b84a4da26440 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:07.450299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41894528-ec8a-4b45-8c7a-b84a4da26440 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:07.463131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41894528-ec8a-4b45-8c7a-b84a4da26440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:07.469163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41894528-ec8a-4b45-8c7a-b84a4da26440 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:07.497125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7973d-aaa1-4660-8dd8-207f66d200c1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:07.505483 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3515/7015] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:07.515407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7973d-aaa1-4660-8dd8-207f66d200c1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:07.528826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd5b7-3425-4e7b-b46e-aae41a84ffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:07.531290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd5b7-3425-4e7b-b46e-aae41a84ffc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:07.536128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd5b7-3425-4e7b-b46e-aae41a84ffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:07.536727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd5b7-3425-4e7b-b46e-aae41a84ffc8 admin admin] PATH_INFO: `/v3/projects/069c3a58cce64235a7ab672b83c064eb/users/f327ad1ebf824fc6b099ef92e0dfc663/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:07.564927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffd5b7-3425-4e7b-b46e-aae41a84ffc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069c3a58cce64235a7ab672b83c064eb, user_id=f327ad1ebf824fc6b099ef92e0dfc663, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:07.571539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffd5b7-3425-4e7b-b46e-aae41a84ffc8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:07.611941 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3501/7016] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:07 2022] PUT /identity/v3/projects/069c3a58cce64235a7ab672b83c064eb/users/f327ad1ebf824fc6b099ef92e0dfc663/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:07.614525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a89a-b4e6-42da-a1c7-e3520d994f85 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:07.614937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a89a-b4e6-42da-a1c7-e3520d994f85 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:07.615500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a89a-b4e6-42da-a1c7-e3520d994f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:07.688927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-68f5a89a-b4e6-42da-a1c7-e3520d994f85 None None] MFA Rules not processed for user `f327ad1ebf824fc6b099ef92e0dfc663`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:07.690207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-68f5a89a-b4e6-42da-a1c7-e3520d994f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:07.862398 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3516/7017] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:07.868667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd5b7-3425-4e7b-b46e-aae41a84ffc8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:07.890766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd5b7-3425-4e7b-b46e-aae41a84ffc8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:07.896086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bc3e9-9d83-444f-8bcf-e61987b95868 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:07.898233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bc3e9-9d83-444f-8bcf-e61987b95868 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:07.898996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bc3e9-9d83-444f-8bcf-e61987b95868 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:07.899591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bc3e9-9d83-444f-8bcf-e61987b95868 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:07.901484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bc3e9-9d83-444f-8bcf-e61987b95868 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:create_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:07.903708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bc3e9-9d83-444f-8bcf-e61987b95868 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:08.041212 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3502/7018] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Feb 19 21:16:07 2022] POST /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials => generated 789 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:08.042129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a89a-b4e6-42da-a1c7-e3520d994f85 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:08.053116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a89a-b4e6-42da-a1c7-e3520d994f85 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:08.064145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da954d4e-1c1a-4545-b2bd-420340cdd0e5 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:08.065796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954d4e-1c1a-4545-b2bd-420340cdd0e5 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:08.066335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954d4e-1c1a-4545-b2bd-420340cdd0e5 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:08.066886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954d4e-1c1a-4545-b2bd-420340cdd0e5 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/7b1dedb089df4ca9bcc5af0bda4ee73e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:08.082013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da954d4e-1c1a-4545-b2bd-420340cdd0e5 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:get_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663, application_credential_id=7b1dedb089df4ca9bcc5af0bda4ee73e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:08.084217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da954d4e-1c1a-4545-b2bd-420340cdd0e5 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:08.086773 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3517/7019] 10.222.0.30 () {58 vars in 1391 bytes} [Sat Feb 19 21:16:08 2022] GET /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/7b1dedb089df4ca9bcc5af0bda4ee73e => generated 689 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:08.091619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc084-697d-4cf0-b617-50782c4265d5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:08.091928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc084-697d-4cf0-b617-50782c4265d5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:08.092396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc084-697d-4cf0-b617-50782c4265d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:08.120793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-310bc084-697d-4cf0-b617-50782c4265d5 None None] MFA Rules not processed for user `f327ad1ebf824fc6b099ef92e0dfc663`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:08.122245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-310bc084-697d-4cf0-b617-50782c4265d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:08.361086 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3503/7020] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3415 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Feb 19 21:16:08.366191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da954d4e-1c1a-4545-b2bd-420340cdd0e5 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:08.378069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da954d4e-1c1a-4545-b2bd-420340cdd0e5 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:08.386061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7c5db-773c-4b79-846e-233a283379d2 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:08.387742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7c5db-773c-4b79-846e-233a283379d2 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:08.388216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7c5db-773c-4b79-846e-233a283379d2 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:08.388843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7c5db-773c-4b79-846e-233a283379d2 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/7b1dedb089df4ca9bcc5af0bda4ee73e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:08.392167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7c5db-773c-4b79-846e-233a283379d2 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663, application_credential_id=7b1dedb089df4ca9bcc5af0bda4ee73e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:08.394080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7c5db-773c-4b79-846e-233a283379d2 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:08.437510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bc084-697d-4cf0-b617-50782c4265d5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:08.438108 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3518/7021] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:16:08 2022] DELETE /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/7b1dedb089df4ca9bcc5af0bda4ee73e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:08.450471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bc084-697d-4cf0-b617-50782c4265d5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:08.459580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dbe54-437f-4ae5-b90e-cc6e631a9ad6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:08.459948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dbe54-437f-4ae5-b90e-cc6e631a9ad6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:08.460236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dbe54-437f-4ae5-b90e-cc6e631a9ad6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:08.460590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dbe54-437f-4ae5-b90e-cc6e631a9ad6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:08.461345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dbe54-437f-4ae5-b90e-cc6e631a9ad6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:create_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:08.462947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dbe54-437f-4ae5-b90e-cc6e631a9ad6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:08.640315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7c5db-773c-4b79-846e-233a283379d2 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:08.642351 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3504/7022] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Feb 19 21:16:08 2022] POST /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials => generated 921 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:08.663090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7c5db-773c-4b79-846e-233a283379d2 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:08.671081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2732-5dd5-4fdf-a9a0-4780b510ba05 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:08.673018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2732-5dd5-4fdf-a9a0-4780b510ba05 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:08.673411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2732-5dd5-4fdf-a9a0-4780b510ba05 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:08.674369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2732-5dd5-4fdf-a9a0-4780b510ba05 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/5c8152b8bacd4febbb2cfa024afb7db4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:08.716712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e2732-5dd5-4fdf-a9a0-4780b510ba05 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663, application_credential_id=5c8152b8bacd4febbb2cfa024afb7db4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:08.721313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e2732-5dd5-4fdf-a9a0-4780b510ba05 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:08.778143 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3519/7023] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:16:08 2022] DELETE /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/5c8152b8bacd4febbb2cfa024afb7db4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:08.786755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dbe54-437f-4ae5-b90e-cc6e631a9ad6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:08.799512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dbe54-437f-4ae5-b90e-cc6e631a9ad6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:08.814614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3649a-8691-4185-ac1c-395a5b092ca6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:08.815668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3649a-8691-4185-ac1c-395a5b092ca6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:08.817136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3649a-8691-4185-ac1c-395a5b092ca6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:08.817428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3649a-8691-4185-ac1c-395a5b092ca6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:08.819370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3649a-8691-4185-ac1c-395a5b092ca6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:create_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:08.821472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3649a-8691-4185-ac1c-395a5b092ca6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:08.964303 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3505/7024] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Feb 19 21:16:08 2022] POST /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials => generated 811 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:08.966224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2732-5dd5-4fdf-a9a0-4780b510ba05 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:08.999869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2732-5dd5-4fdf-a9a0-4780b510ba05 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:09.013213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ff5d7-780c-4c52-b763-e1c698b88c79 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:09.015163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff5d7-780c-4c52-b763-e1c698b88c79 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:09.015454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff5d7-780c-4c52-b763-e1c698b88c79 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:09.015771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff5d7-780c-4c52-b763-e1c698b88c79 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/5c7bdd295ff64224a1c32e0b135c4757` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:09.037043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ff5d7-780c-4c52-b763-e1c698b88c79 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663, application_credential_id=5c7bdd295ff64224a1c32e0b135c4757)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:09.042694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ff5d7-780c-4c52-b763-e1c698b88c79 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:09.092743 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3520/7025] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:16:08 2022] DELETE /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/5c7bdd295ff64224a1c32e0b135c4757 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:09.094716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3649a-8691-4185-ac1c-395a5b092ca6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:09.107494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3649a-8691-4185-ac1c-395a5b092ca6 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:09.135349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d9603-9b57-46dd-819f-e9186b102736 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:09.136133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9603-9b57-46dd-819f-e9186b102736 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:09.136499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9603-9b57-46dd-819f-e9186b102736 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:09.136791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9603-9b57-46dd-819f-e9186b102736 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:09.138033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9603-9b57-46dd-819f-e9186b102736 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:create_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:09.139758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9603-9b57-46dd-819f-e9186b102736 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:09.331620 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3506/7026] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Feb 19 21:16:09 2022] POST /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials => generated 789 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:09.337507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ff5d7-780c-4c52-b763-e1c698b88c79 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:09.351071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ff5d7-780c-4c52-b763-e1c698b88c79 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:09.363105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b845b61-35c8-4e30-b967-cc2bb2cc14ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:09.364466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845b61-35c8-4e30-b967-cc2bb2cc14ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:09.364962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845b61-35c8-4e30-b967-cc2bb2cc14ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:09.365445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845b61-35c8-4e30-b967-cc2bb2cc14ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:09.366374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845b61-35c8-4e30-b967-cc2bb2cc14ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:create_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:09.367712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845b61-35c8-4e30-b967-cc2bb2cc14ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:09.554051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d9603-9b57-46dd-819f-e9186b102736 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:09.554424 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3521/7027] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Feb 19 21:16:09 2022] POST /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials => generated 788 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:09.567959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d9603-9b57-46dd-819f-e9186b102736 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:09.577467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb25a-c1c8-4139-9555-b6e955ae9d11 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:09.578671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb25a-c1c8-4139-9555-b6e955ae9d11 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:09.579127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb25a-c1c8-4139-9555-b6e955ae9d11 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:09.579741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb25a-c1c8-4139-9555-b6e955ae9d11 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:09.580387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eb25a-c1c8-4139-9555-b6e955ae9d11 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:list_application_credentials(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:09.593745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eb25a-c1c8-4139-9555-b6e955ae9d11 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:09.618980 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3507/7028] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 21:16:09 2022] GET /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials => generated 1501 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:16:09.624574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b845b61-35c8-4e30-b967-cc2bb2cc14ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:09.656679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b845b61-35c8-4e30-b967-cc2bb2cc14ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:09.672357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d381158-8b56-4308-a16b-398d7defe317 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:09.676863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d381158-8b56-4308-a16b-398d7defe317 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:09.677189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d381158-8b56-4308-a16b-398d7defe317 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:09.677762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d381158-8b56-4308-a16b-398d7defe317 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/f4e856a6c04240aeba591f579c0f59f9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:09.715731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d381158-8b56-4308-a16b-398d7defe317 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663, application_credential_id=f4e856a6c04240aeba591f579c0f59f9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:09.719504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d381158-8b56-4308-a16b-398d7defe317 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:09.767952 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3522/7029] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:16:09 2022] DELETE /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/f4e856a6c04240aeba591f579c0f59f9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:09.772498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb25a-c1c8-4139-9555-b6e955ae9d11 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:09.783671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb25a-c1c8-4139-9555-b6e955ae9d11 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:09.788152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ac25d-eb81-43dd-bbca-cdd1dbe6aa12 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:09.789665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ac25d-eb81-43dd-bbca-cdd1dbe6aa12 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:09.790051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ac25d-eb81-43dd-bbca-cdd1dbe6aa12 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:09.790438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ac25d-eb81-43dd-bbca-cdd1dbe6aa12 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/6be2d970605e4843a06a7ea391bbdc4a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:09.802835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ac25d-eb81-43dd-bbca-cdd1dbe6aa12 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663, application_credential_id=6be2d970605e4843a06a7ea391bbdc4a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:09.805033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ac25d-eb81-43dd-bbca-cdd1dbe6aa12 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:09.844021 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3508/7030] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:16:09 2022] DELETE /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/6be2d970605e4843a06a7ea391bbdc4a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:09.857582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d381158-8b56-4308-a16b-398d7defe317 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:09.886524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d381158-8b56-4308-a16b-398d7defe317 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:09.897617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c652d6-61b2-48e9-bd03-e34b381da598 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:09.898862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c652d6-61b2-48e9-bd03-e34b381da598 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:09.899146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c652d6-61b2-48e9-bd03-e34b381da598 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:09.899427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c652d6-61b2-48e9-bd03-e34b381da598 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:09.900615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c652d6-61b2-48e9-bd03-e34b381da598 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:create_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:09.901775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c652d6-61b2-48e9-bd03-e34b381da598 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:10.051014 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3523/7031] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Feb 19 21:16:09 2022] POST /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials => generated 789 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:10.055110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ac25d-eb81-43dd-bbca-cdd1dbe6aa12 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:10.069469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ac25d-eb81-43dd-bbca-cdd1dbe6aa12 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:10.080498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587ca25-317f-41ae-9c06-cbf22f6714ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:10.080926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587ca25-317f-41ae-9c06-cbf22f6714ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:10.081142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587ca25-317f-41ae-9c06-cbf22f6714ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:10.081421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587ca25-317f-41ae-9c06-cbf22f6714ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:10.082165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587ca25-317f-41ae-9c06-cbf22f6714ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:create_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:10.083315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587ca25-317f-41ae-9c06-cbf22f6714ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:10.272747 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3509/7032] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Feb 19 21:16:10 2022] POST /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials => generated 789 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:10.274925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c652d6-61b2-48e9-bd03-e34b381da598 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:10.286194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c652d6-61b2-48e9-bd03-e34b381da598 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:10.296049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:10.297229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:10.297502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:10.298736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:10.301456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Adding query filter params (name=tempest-application_credential-1720864941) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:10.301799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:list_application_credentials(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:10.304403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:10.336108 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3524/7033] 10.222.0.30 () {58 vars in 1385 bytes} [Sat Feb 19 21:16:10 2022] GET /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials?name=tempest-application_credential-1720864941 => generated 887 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:10.336919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587ca25-317f-41ae-9c06-cbf22f6714ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:10.356428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587ca25-317f-41ae-9c06-cbf22f6714ed tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:10.365217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621c319-15e4-4c0d-ab49-bc2deeb406cc tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:10.366299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c319-15e4-4c0d-ab49-bc2deeb406cc tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:10.366746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c319-15e4-4c0d-ab49-bc2deeb406cc tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:10.367466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c319-15e4-4c0d-ab49-bc2deeb406cc tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/53a708f7946a46adbf94f3930ad3976d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:10.386765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621c319-15e4-4c0d-ab49-bc2deeb406cc tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663, application_credential_id=53a708f7946a46adbf94f3930ad3976d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:10.387847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621c319-15e4-4c0d-ab49-bc2deeb406cc tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:10.427200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:10.433368 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3510/7034] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:16:10 2022] DELETE /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/53a708f7946a46adbf94f3930ad3976d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:10.448607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067158a-7f78-41ae-900a-bc282a362c77 tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:10.458599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f327ad1ebf824fc6b099ef92e0dfc663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069c3a58cce64235a7ab672b83c064eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:10.461507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:10.461507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:10.463086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/af561d2353844edaa061a83234d95ca5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:10.492616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f327ad1ebf824fc6b099ef92e0dfc663, application_credential_id=af561d2353844edaa061a83234d95ca5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:10.496704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:10.533524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3525/7035] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Feb 19 21:16:10 2022] DELETE /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663/application_credentials/af561d2353844edaa061a83234d95ca5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:10.538750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621c319-15e4-4c0d-ab49-bc2deeb406cc tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:10.641687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621c319-15e4-4c0d-ab49-bc2deeb406cc tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:10.652451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:10.657013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:10.657481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:10.657919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] PATH_INFO: `/v3/users/f327ad1ebf824fc6b099ef92e0dfc663` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:10.660138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:10.666004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:10.667762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f327ad1ebf824fc6b099ef92e0dfc663)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:10.669803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:10.688352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd40fa-8d97-4dec-a87d-bea26b82536f tempest-ApplicationCredentialsV3Test-615930737 tempest-ApplicationCredentialsV3Test-615930737-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:10.707083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:10.707997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:10.708284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:10.708612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] PATH_INFO: `/v3/users/614b36c5d1d64be3a2432a59a05c3dca` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:10.710780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=614b36c5d1d64be3a2432a59a05c3dca)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:10.712780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:10.774899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f327ad1ebf824fc6b099ef92e0dfc663'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.775982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f327ad1ebf824fc6b099ef92e0dfc663'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.778398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f327ad1ebf824fc6b099ef92e0dfc663'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.814768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f327ad1ebf824fc6b099ef92e0dfc663'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.832384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614b36c5d1d64be3a2432a59a05c3dca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.837025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cd67d0d9-6a11-45a7-ad8a-74e5465ebdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f327ad1ebf824fc6b099ef92e0dfc663'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.861148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614b36c5d1d64be3a2432a59a05c3dca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.862479 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3511/7036] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:10 2022] DELETE /identity/v3/users/f327ad1ebf824fc6b099ef92e0dfc663 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:10.867197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b396a8e-bf63-499d-bf53-a4775f67b1f3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:10.867676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b396a8e-bf63-499d-bf53-a4775f67b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:10.868235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b396a8e-bf63-499d-bf53-a4775f67b1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:10.879205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614b36c5d1d64be3a2432a59a05c3dca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.880047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614b36c5d1d64be3a2432a59a05c3dca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.880816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614b36c5d1d64be3a2432a59a05c3dca'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:10.892662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1b396a8e-bf63-499d-bf53-a4775f67b1f3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:10.894245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1b396a8e-bf63-499d-bf53-a4775f67b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:10.903113 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3526/7037] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:10 2022] DELETE /identity/v3/users/614b36c5d1d64be3a2432a59a05c3dca => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:10.972104 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3512/7038] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:10.987527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:10.989118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:11.103727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039866a5-77f4-4ff2-afcc-f69a779f48bb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:11.117406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa688-30ac-4d6b-b57b-cb857211ce1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:11.119003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa688-30ac-4d6b-b57b-cb857211ce1a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:11.119417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa688-30ac-4d6b-b57b-cb857211ce1a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:11.119773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa688-30ac-4d6b-b57b-cb857211ce1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:11.281790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa688-30ac-4d6b-b57b-cb857211ce1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:11.288983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa688-30ac-4d6b-b57b-cb857211ce1a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:11.306208 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3527/7039] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:11.310305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b396a8e-bf63-499d-bf53-a4775f67b1f3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:11.311917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1b396a8e-bf63-499d-bf53-a4775f67b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:11.326045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b396a8e-bf63-499d-bf53-a4775f67b1f3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:11.333133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:11.334210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:11.334516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:11.334928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] PATH_INFO: `/v3/projects/ab36d6d50f8f40408962ab92e9cd1671` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:11.337205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab36d6d50f8f40408962ab92e9cd1671)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:11.340292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:11.433382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab36d6d50f8f40408962ab92e9cd1671', 'request_id': 'req-7361dbc7-e016-4cec-bbc5-87581d7c2931'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:11.440293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab36d6d50f8f40408962ab92e9cd1671', 'request_id': 'req-7361dbc7-e016-4cec-bbc5-87581d7c2931'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:11.452453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab36d6d50f8f40408962ab92e9cd1671', 'request_id': 'req-7361dbc7-e016-4cec-bbc5-87581d7c2931'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:11.468516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] The token cache is being invalidate because project ab36d6d50f8f40408962ab92e9cd1671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:11.468787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:11.469468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7361dbc7-e016-4cec-bbc5-87581d7c2931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:11.476948 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3513/7040] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:11 2022] DELETE /identity/v3/projects/ab36d6d50f8f40408962ab92e9cd1671 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:11.479293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f25e-6ccc-445e-a7ab-85ec51f85671 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:11.479583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f25e-6ccc-445e-a7ab-85ec51f85671 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:11.479861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f25e-6ccc-445e-a7ab-85ec51f85671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:11.502550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d258f25e-6ccc-445e-a7ab-85ec51f85671 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:11.504160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d258f25e-6ccc-445e-a7ab-85ec51f85671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:11.607556 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3528/7041] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:11.616767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b4e1-65b9-414d-a553-d909eaad5499 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:11.619346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b4e1-65b9-414d-a553-d909eaad5499 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:11.619346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b4e1-65b9-414d-a553-d909eaad5499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:11.665933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4a31b4e1-65b9-414d-a553-d909eaad5499 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:11.667262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4a31b4e1-65b9-414d-a553-d909eaad5499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:11.723692 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3514/7042] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:11.728374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f25e-6ccc-445e-a7ab-85ec51f85671 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:11.747372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f25e-6ccc-445e-a7ab-85ec51f85671 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:11.765168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:11.768885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:11.769559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:11.769861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:11.773091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:11.773896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:11.783069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:11.815773 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3529/7043] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:11.823871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b4e1-65b9-414d-a553-d909eaad5499 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:11.862742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b4e1-65b9-414d-a553-d909eaad5499 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:11.886828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e917-014d-40a0-80b7-01674393fb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:11.887567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e917-014d-40a0-80b7-01674393fb25 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:11.887852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e917-014d-40a0-80b7-01674393fb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:11.888146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e917-014d-40a0-80b7-01674393fb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:11.894701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156e917-014d-40a0-80b7-01674393fb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:11.896781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156e917-014d-40a0-80b7-01674393fb25 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.000293 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3515/7044] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:11 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:12.001033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.014122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62f32-0667-44ff-a73c-10d9d09b4e4a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:12.113043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb5c46-336a-4c21-b102-c77c07f56144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:12.114809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb5c46-336a-4c21-b102-c77c07f56144 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.115093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb5c46-336a-4c21-b102-c77c07f56144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.115612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb5c46-336a-4c21-b102-c77c07f56144 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.116680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb5c46-336a-4c21-b102-c77c07f56144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:12.119903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb5c46-336a-4c21-b102-c77c07f56144 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.165181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e917-014d-40a0-80b7-01674393fb25 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.179746 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3530/7045] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:11 2022] POST /identity/v3/users => generated 282 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:12.182605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e917-014d-40a0-80b7-01674393fb25 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:12.215474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:12.216560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.218689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.219185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.220132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:12.223101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.253102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb5c46-336a-4c21-b102-c77c07f56144 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.254085 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3516/7046] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:12.255048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.260678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:12.274015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb5c46-336a-4c21-b102-c77c07f56144 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:12.282070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084a185-ff01-4b7c-b6ef-f5d8bd2e2844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:12.283146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084a185-ff01-4b7c-b6ef-f5d8bd2e2844 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.283701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084a185-ff01-4b7c-b6ef-f5d8bd2e2844 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.284100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084a185-ff01-4b7c-b6ef-f5d8bd2e2844 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.285444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084a185-ff01-4b7c-b6ef-f5d8bd2e2844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:12.287485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084a185-ff01-4b7c-b6ef-f5d8bd2e2844 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.287825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c981595-a6c0-420c-bc23-8b117c84a0d5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:12.300027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:12.301684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.302153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.302946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] PATH_INFO: `/v3/projects/069c3a58cce64235a7ab672b83c064eb` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.305303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069c3a58cce64235a7ab672b83c064eb)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:12.307856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.324656 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3531/7047] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:12.327412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084a185-ff01-4b7c-b6ef-f5d8bd2e2844 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.357672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084a185-ff01-4b7c-b6ef-f5d8bd2e2844 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:12.367721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa907bf-8e34-45dd-bbfc-78b6d2936f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:12.369689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa907bf-8e34-45dd-bbfc-78b6d2936f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.370201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa907bf-8e34-45dd-bbfc-78b6d2936f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.370996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa907bf-8e34-45dd-bbfc-78b6d2936f61 admin admin] PATH_INFO: `/v3/projects/e84fb425ca4049869c3cb1643d2097a7/users/f4440cb2216f470d8267320f3c14bc00/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.397673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa907bf-8e34-45dd-bbfc-78b6d2936f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84fb425ca4049869c3cb1643d2097a7, user_id=f4440cb2216f470d8267320f3c14bc00, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:12.397890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069c3a58cce64235a7ab672b83c064eb', 'request_id': 'req-88191598-26c6-4005-825d-a2b339add467'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:12.401868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa907bf-8e34-45dd-bbfc-78b6d2936f61 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.405098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069c3a58cce64235a7ab672b83c064eb', 'request_id': 'req-88191598-26c6-4005-825d-a2b339add467'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:12.425288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069c3a58cce64235a7ab672b83c064eb', 'request_id': 'req-88191598-26c6-4005-825d-a2b339add467'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:12.449222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3532/7048] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:12 2022] PUT /identity/v3/projects/e84fb425ca4049869c3cb1643d2097a7/users/f4440cb2216f470d8267320f3c14bc00/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:12.451692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36beb8c-c54a-4767-b15f-2fed439aaea6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.452034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36beb8c-c54a-4767-b15f-2fed439aaea6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.452258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36beb8c-c54a-4767-b15f-2fed439aaea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.455688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] The token cache is being invalidate because project 069c3a58cce64235a7ab672b83c064eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:12.455688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:12.455688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88191598-26c6-4005-825d-a2b339add467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:12.456996 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3517/7049] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:12 2022] DELETE /identity/v3/projects/069c3a58cce64235a7ab672b83c064eb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:12.462080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06512b8-86ce-4093-b23e-4469c2a99b3d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.462580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06512b8-86ce-4093-b23e-4469c2a99b3d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.462930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06512b8-86ce-4093-b23e-4469c2a99b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.496165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e06512b8-86ce-4093-b23e-4469c2a99b3d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:12.497480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e06512b8-86ce-4093-b23e-4469c2a99b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:12.510941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c36beb8c-c54a-4767-b15f-2fed439aaea6 None None] MFA Rules not processed for user `f4440cb2216f470d8267320f3c14bc00`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:12.514691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c36beb8c-c54a-4767-b15f-2fed439aaea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:12.651130 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3518/7050] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:12.659412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3d0e-382a-47df-ad93-aeba024a6372 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.659705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3d0e-382a-47df-ad93-aeba024a6372 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.664741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3d0e-382a-47df-ad93-aeba024a6372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.695284 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3533/7051] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:12.704507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36beb8c-c54a-4767-b15f-2fed439aaea6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.705969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c36beb8c-c54a-4767-b15f-2fed439aaea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:12.709657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7d4a3d0e-382a-47df-ad93-aeba024a6372 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:12.714923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7d4a3d0e-382a-47df-ad93-aeba024a6372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:12.734554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3519/7052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:12.738630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a3d0e-382a-47df-ad93-aeba024a6372 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.758631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a3d0e-382a-47df-ad93-aeba024a6372 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:12.778460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:12.780256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.781118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.782775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.785267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:12.785589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:12.791722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.831351 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3520/7053] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:12.837517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.867207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14806d-16dc-4f44-a06c-ddf87f3d74d1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:12.878452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344157cf-822b-4e73-abac-fc8a50755a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:12.879409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344157cf-822b-4e73-abac-fc8a50755a4c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.879850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344157cf-822b-4e73-abac-fc8a50755a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.880301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344157cf-822b-4e73-abac-fc8a50755a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.881605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344157cf-822b-4e73-abac-fc8a50755a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:12.885768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344157cf-822b-4e73-abac-fc8a50755a4c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.891276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36beb8c-c54a-4767-b15f-2fed439aaea6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:12.898205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fe9a2-dee4-4908-989a-b6ca8e60e68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:12.901183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe9a2-dee4-4908-989a-b6ca8e60e68e service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.901781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe9a2-dee4-4908-989a-b6ca8e60e68e service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.902298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe9a2-dee4-4908-989a-b6ca8e60e68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.914941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fe9a2-dee4-4908-989a-b6ca8e60e68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:12.918291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fe9a2-dee4-4908-989a-b6ca8e60e68e service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:12.929450 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3521/7054] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:12 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:12.933873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344157cf-822b-4e73-abac-fc8a50755a4c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:12.946834 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3534/7055] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:12.950183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05452-a3eb-45ad-87bc-d026ba72fe89 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:12.950579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05452-a3eb-45ad-87bc-d026ba72fe89 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:12.950978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05452-a3eb-45ad-87bc-d026ba72fe89 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:12.956396 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3535/7056] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:16:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:16:12.960825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05452-a3eb-45ad-87bc-d026ba72fe89 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 21:16:13.052151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344157cf-822b-4e73-abac-fc8a50755a4c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.061505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92301e7a-f27e-4c92-bd9c-bbc8da31e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.062439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92301e7a-f27e-4c92-bd9c-bbc8da31e456 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.063051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92301e7a-f27e-4c92-bd9c-bbc8da31e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.063489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92301e7a-f27e-4c92-bd9c-bbc8da31e456 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.064936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92301e7a-f27e-4c92-bd9c-bbc8da31e456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.069007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92301e7a-f27e-4c92-bd9c-bbc8da31e456 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.093847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05452-a3eb-45ad-87bc-d026ba72fe89 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.118688 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3522/7057] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:12 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:13.124720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92301e7a-f27e-4c92-bd9c-bbc8da31e456 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.150476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92301e7a-f27e-4c92-bd9c-bbc8da31e456 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.169688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9af96-522c-4e5b-80e1-1329761b127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.170713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9af96-522c-4e5b-80e1-1329761b127e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.171155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9af96-522c-4e5b-80e1-1329761b127e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.171604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9af96-522c-4e5b-80e1-1329761b127e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.173261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9af96-522c-4e5b-80e1-1329761b127e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.175281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9af96-522c-4e5b-80e1-1329761b127e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.194131 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3523/7058] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:13.199654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9af96-522c-4e5b-80e1-1329761b127e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.223380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05452-a3eb-45ad-87bc-d026ba72fe89 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.230098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef4b31-d0de-44ff-b351-a8632eb98d5a tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4440cb2216f470d8267320f3c14bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84fb425ca4049869c3cb1643d2097a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.232140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef4b31-d0de-44ff-b351-a8632eb98d5a tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.232140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef4b31-d0de-44ff-b351-a8632eb98d5a tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.232385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef4b31-d0de-44ff-b351-a8632eb98d5a tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] PATH_INFO: `/v3/projects/e84fb425ca4049869c3cb1643d2097a7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.232505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9af96-522c-4e5b-80e1-1329761b127e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.236398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef4b31-d0de-44ff-b351-a8632eb98d5a tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorizing `identity:get_project(project_id=e84fb425ca4049869c3cb1643d2097a7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.238518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef4b31-d0de-44ff-b351-a8632eb98d5a tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.244689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fd95c-b962-4f20-9951-ff417a83f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.245288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fd95c-b962-4f20-9951-ff417a83f1bb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.245575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fd95c-b962-4f20-9951-ff417a83f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.245855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fd95c-b962-4f20-9951-ff417a83f1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.246585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fd95c-b962-4f20-9951-ff417a83f1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.248232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fd95c-b962-4f20-9951-ff417a83f1bb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.257944 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3536/7059] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 21:16:12 2022] GET /identity/v3/projects/e84fb425ca4049869c3cb1643d2097a7 => generated 363 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:13.270919 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3524/7060] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:13.274611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fd95c-b962-4f20-9951-ff417a83f1bb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.275284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704789b2-6b8f-42b2-9c1f-e0c936de49e4 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.275584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704789b2-6b8f-42b2-9c1f-e0c936de49e4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.275867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704789b2-6b8f-42b2-9c1f-e0c936de49e4 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.278424 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3537/7061] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:16:13.285168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704789b2-6b8f-42b2-9c1f-e0c936de49e4 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 21:16:13.287808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-704789b2-6b8f-42b2-9c1f-e0c936de49e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:13.292082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fd95c-b962-4f20-9951-ff417a83f1bb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.311726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf0537-d9ec-4a0d-a74d-2cc17de23aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.312376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704789b2-6b8f-42b2-9c1f-e0c936de49e4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.312725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf0537-d9ec-4a0d-a74d-2cc17de23aec admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.313102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf0537-d9ec-4a0d-a74d-2cc17de23aec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.313391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf0537-d9ec-4a0d-a74d-2cc17de23aec admin admin] PATH_INFO: `/v3/projects/30668a142642467ea7dca6d881da1859/users/522d7ca62777450ca547c968ff2a0d8c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.332152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704789b2-6b8f-42b2-9c1f-e0c936de49e4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.338162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bea129-977b-4bd8-b3f0-a59a469e6ce8 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4440cb2216f470d8267320f3c14bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84fb425ca4049869c3cb1643d2097a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.338640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf0537-d9ec-4a0d-a74d-2cc17de23aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=30668a142642467ea7dca6d881da1859, user_id=522d7ca62777450ca547c968ff2a0d8c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.341607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bea129-977b-4bd8-b3f0-a59a469e6ce8 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.343486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf0537-d9ec-4a0d-a74d-2cc17de23aec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.346420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bea129-977b-4bd8-b3f0-a59a469e6ce8 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.346744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bea129-977b-4bd8-b3f0-a59a469e6ce8 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] PATH_INFO: `/v3/projects/e84fb425ca4049869c3cb1643d2097a7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.355081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bea129-977b-4bd8-b3f0-a59a469e6ce8 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorizing `identity:get_project(project_id=e84fb425ca4049869c3cb1643d2097a7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.356790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bea129-977b-4bd8-b3f0-a59a469e6ce8 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.370951 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3525/7062] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:13 2022] PUT /identity/v3/projects/30668a142642467ea7dca6d881da1859/users/522d7ca62777450ca547c968ff2a0d8c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:13.375574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3538/7063] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 21:16:13 2022] GET /identity/v3/projects/e84fb425ca4049869c3cb1643d2097a7 => generated 363 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:16:13.381859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fe45-19a9-458c-ade1-7a5bde5f84c1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.382861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fe45-19a9-458c-ade1-7a5bde5f84c1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.383646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fe45-19a9-458c-ade1-7a5bde5f84c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.409574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577798dc-d539-449a-8d14-f1ca3452e726 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.409883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577798dc-d539-449a-8d14-f1ca3452e726 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.410137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577798dc-d539-449a-8d14-f1ca3452e726 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.412207 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3539/7064] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 21:16:13.424971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577798dc-d539-449a-8d14-f1ca3452e726 None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 21:16:13.431272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5a57fe45-19a9-458c-ade1-7a5bde5f84c1 None None] MFA Rules not processed for user `522d7ca62777450ca547c968ff2a0d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:13.433360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5a57fe45-19a9-458c-ade1-7a5bde5f84c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:13.568713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3526/7065] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:13.570299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57fe45-19a9-458c-ade1-7a5bde5f84c1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.600267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577798dc-d539-449a-8d14-f1ca3452e726 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.700213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57fe45-19a9-458c-ade1-7a5bde5f84c1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.708306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6841d1-6971-4051-b3bd-beb3f28f1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.709443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6841d1-6971-4051-b3bd-beb3f28f1a19 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.709738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6841d1-6971-4051-b3bd-beb3f28f1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.710021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6841d1-6971-4051-b3bd-beb3f28f1a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.711557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6841d1-6971-4051-b3bd-beb3f28f1a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.714042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6841d1-6971-4051-b3bd-beb3f28f1a19 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.756941 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3527/7066] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:13 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:13.758747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577798dc-d539-449a-8d14-f1ca3452e726 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.760811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6841d1-6971-4051-b3bd-beb3f28f1a19 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.863960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6841d1-6971-4051-b3bd-beb3f28f1a19 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.871059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be70c0-3bd4-4445-b938-35cdd93f62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.873127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be70c0-3bd4-4445-b938-35cdd93f62a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.876396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be70c0-3bd4-4445-b938-35cdd93f62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.876755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be70c0-3bd4-4445-b938-35cdd93f62a1 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.878560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be70c0-3bd4-4445-b938-35cdd93f62a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.880727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be70c0-3bd4-4445-b938-35cdd93f62a1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.916204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899cf1b-3f4b-4e60-b20b-095721e3a62c tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4440cb2216f470d8267320f3c14bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84fb425ca4049869c3cb1643d2097a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.917204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899cf1b-3f4b-4e60-b20b-095721e3a62c tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.917539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899cf1b-3f4b-4e60-b20b-095721e3a62c tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.917819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899cf1b-3f4b-4e60-b20b-095721e3a62c tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] PATH_INFO: `/v3/projects/e84fb425ca4049869c3cb1643d2097a7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.918826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899cf1b-3f4b-4e60-b20b-095721e3a62c tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorizing `identity:get_project(project_id=e84fb425ca4049869c3cb1643d2097a7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.919018 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3528/7067] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:13 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:13.921697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899cf1b-3f4b-4e60-b20b-095721e3a62c tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:13.923006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be70c0-3bd4-4445-b938-35cdd93f62a1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:13.923636 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3540/7068] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 21:16:13 2022] GET /identity/v3/projects/e84fb425ca4049869c3cb1643d2097a7 => generated 363 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:16:13.956923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be70c0-3bd4-4445-b938-35cdd93f62a1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:13.963570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e6b8-86c7-4ecb-8636-9ccd9f9e50df None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.964153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e6b8-86c7-4ecb-8636-9ccd9f9e50df None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.964669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e6b8-86c7-4ecb-8636-9ccd9f9e50df None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.966869 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3541/7069] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 21:16:13.972553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae7440-298d-43cc-a03a-6926ebd23e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:13.973243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae7440-298d-43cc-a03a-6926ebd23e13 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:13.973524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae7440-298d-43cc-a03a-6926ebd23e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:13.973800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae7440-298d-43cc-a03a-6926ebd23e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:13.974192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3e6b8-86c7-4ecb-8636-9ccd9f9e50df None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 21:16:13.974688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae7440-298d-43cc-a03a-6926ebd23e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:13.976309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae7440-298d-43cc-a03a-6926ebd23e13 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:14.005420 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3529/7070] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:14.010848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae7440-298d-43cc-a03a-6926ebd23e13 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:14.037279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae7440-298d-43cc-a03a-6926ebd23e13 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:14.050654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba845e63-2579-40a3-b31b-19381f82c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:14.051336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba845e63-2579-40a3-b31b-19381f82c71b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.051618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba845e63-2579-40a3-b31b-19381f82c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.051897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba845e63-2579-40a3-b31b-19381f82c71b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.052659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba845e63-2579-40a3-b31b-19381f82c71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:14.054272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba845e63-2579-40a3-b31b-19381f82c71b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:14.085205 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3530/7071] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:14.089377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba845e63-2579-40a3-b31b-19381f82c71b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:14.106269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba845e63-2579-40a3-b31b-19381f82c71b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:14.115716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140c2b8-bb76-4ab5-82c4-d5ad96416a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:14.116795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c2b8-bb76-4ab5-82c4-d5ad96416a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.117584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c2b8-bb76-4ab5-82c4-d5ad96416a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.117584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c2b8-bb76-4ab5-82c4-d5ad96416a09 admin admin] PATH_INFO: `/v3/projects/6419494309f647738a2fc3e35f164791/users/f5fd661817e545aa8376c3889eba5a94/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.119306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3e6b8-86c7-4ecb-8636-9ccd9f9e50df None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:14.136549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140c2b8-bb76-4ab5-82c4-d5ad96416a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6419494309f647738a2fc3e35f164791, user_id=f5fd661817e545aa8376c3889eba5a94, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:14.138061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3e6b8-86c7-4ecb-8636-9ccd9f9e50df None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:14.141242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140c2b8-bb76-4ab5-82c4-d5ad96416a09 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:14.148155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d09968-74d2-4a03-9f03-409fedbe530f tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4440cb2216f470d8267320f3c14bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84fb425ca4049869c3cb1643d2097a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:14.149096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d09968-74d2-4a03-9f03-409fedbe530f tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.149392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d09968-74d2-4a03-9f03-409fedbe530f tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.149666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d09968-74d2-4a03-9f03-409fedbe530f tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] PATH_INFO: `/v3/projects/e84fb425ca4049869c3cb1643d2097a7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.151938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d09968-74d2-4a03-9f03-409fedbe530f tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorizing `identity:get_project(project_id=e84fb425ca4049869c3cb1643d2097a7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:14.153790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d09968-74d2-4a03-9f03-409fedbe530f tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:14.162680 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3531/7073] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:14 2022] PUT /identity/v3/projects/6419494309f647738a2fc3e35f164791/users/f5fd661817e545aa8376c3889eba5a94/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:14.180393 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3542/7072] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 21:16:13 2022] GET /identity/v3/projects/e84fb425ca4049869c3cb1643d2097a7 => generated 363 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:16:14.199474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9175-ee33-4f06-b57e-dfecc335b7f1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.205684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9175-ee33-4f06-b57e-dfecc335b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.206934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9175-ee33-4f06-b57e-dfecc335b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.215497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6d522-8352-48c0-852b-918752e8448e None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.215788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6d522-8352-48c0-852b-918752e8448e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.216070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6d522-8352-48c0-852b-918752e8448e None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.218701 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3543/7074] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:16:14 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:16:14.235919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6d522-8352-48c0-852b-918752e8448e None None] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 21:16:14.297778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1c7a9175-ee33-4f06-b57e-dfecc335b7f1 None None] MFA Rules not processed for user `f5fd661817e545aa8376c3889eba5a94`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:14.299008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1c7a9175-ee33-4f06-b57e-dfecc335b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:14.398207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6d522-8352-48c0-852b-918752e8448e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:14.449950 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3532/7075] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:14.455910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9175-ee33-4f06-b57e-dfecc335b7f1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:14.529478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6d522-8352-48c0-852b-918752e8448e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:14.538994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4440cb2216f470d8267320f3c14bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84fb425ca4049869c3cb1643d2097a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:14.540155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.540465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.540750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] PATH_INFO: `/v3/projects/e84fb425ca4049869c3cb1643d2097a7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.545661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorizing `identity:get_project(project_id=e84fb425ca4049869c3cb1643d2097a7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:14.547451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:14.549411 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3544/7076] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 21:16:14 2022] GET /identity/v3/projects/e84fb425ca4049869c3cb1643d2097a7 => generated 363 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:16:14.594961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9175-ee33-4f06-b57e-dfecc335b7f1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:14.615018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:14.617332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:14.620706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb264b-7578-4c10-92a4-c1592b7609ca tempest-IdentityV3ProjectsTest-176304085 tempest-IdentityV3ProjectsTest-176304085-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '522d7ca62777450ca547c968ff2a0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30668a142642467ea7dca6d881da1859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:14.624228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb264b-7578-4c10-92a4-c1592b7609ca tempest-IdentityV3ProjectsTest-176304085 tempest-IdentityV3ProjectsTest-176304085-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.624938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb264b-7578-4c10-92a4-c1592b7609ca tempest-IdentityV3ProjectsTest-176304085 tempest-IdentityV3ProjectsTest-176304085-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.625227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb264b-7578-4c10-92a4-c1592b7609ca tempest-IdentityV3ProjectsTest-176304085 tempest-IdentityV3ProjectsTest-176304085-project] PATH_INFO: `/v3/users/522d7ca62777450ca547c968ff2a0d8c/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.627586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb264b-7578-4c10-92a4-c1592b7609ca tempest-IdentityV3ProjectsTest-176304085 tempest-IdentityV3ProjectsTest-176304085-project] RBAC: Authorizing `identity:list_user_projects(user_id=522d7ca62777450ca547c968ff2a0d8c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:14.632008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb264b-7578-4c10-92a4-c1592b7609ca tempest-IdentityV3ProjectsTest-176304085 tempest-IdentityV3ProjectsTest-176304085-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:14.723203 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3533/7077] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:16:14 2022] GET /identity/v3/users/522d7ca62777450ca547c968ff2a0d8c/projects => generated 515 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:16:14.735457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f6f1b-fa89-434c-8f8f-31a9fe1b2b9a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.739159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f6f1b-fa89-434c-8f8f-31a9fe1b2b9a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.743922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f6f1b-fa89-434c-8f8f-31a9fe1b2b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.744727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763adbe-d696-4699-b811-1ca006b3a000 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:14.764592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:14.772454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.772454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.772454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] PATH_INFO: `/v3/users/f4440cb2216f470d8267320f3c14bc00` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.772454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4440cb2216f470d8267320f3c14bc00)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:14.772454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:14.809612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bf5f6f1b-fa89-434c-8f8f-31a9fe1b2b9a None None] MFA Rules not processed for user `522d7ca62777450ca547c968ff2a0d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:14.814631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bf5f6f1b-fa89-434c-8f8f-31a9fe1b2b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:14.844682 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3534/7078] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:14.849223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:14.849546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:14.849750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:14.886664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] MFA Rules not processed for user `522d7ca62777450ca547c968ff2a0d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:14.887894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:14.922466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4440cb2216f470d8267320f3c14bc00'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:14.966420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4440cb2216f470d8267320f3c14bc00'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:14.989068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.models.token_model [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] User 522d7ca62777450ca547c968ff2a0d8c has no access to project 6419494309f647738a2fc3e35f164791 {{(pid=96909) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Feb 19 21:16:15.000769 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Feb 19 21:16:15.006644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3535/7079] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 154 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Feb 19 21:16:15.006961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4440cb2216f470d8267320f3c14bc00'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:15.006961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4440cb2216f470d8267320f3c14bc00'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:15.007547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-198b47d5-198f-479c-8db8-e86927982b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4440cb2216f470d8267320f3c14bc00'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:15.010666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:15.015614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:15.026432 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3545/7080] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:14 2022] DELETE /identity/v3/users/f4440cb2216f470d8267320f3c14bc00 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:15.031373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4021a98-11cd-40d1-b7e7-6210200c05b7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:15.032032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4021a98-11cd-40d1-b7e7-6210200c05b7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:15.032803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4021a98-11cd-40d1-b7e7-6210200c05b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:15.057689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f22753-837a-455c-9b79-2f2cf4e7d235 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:15.066797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a4021a98-11cd-40d1-b7e7-6210200c05b7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:15.068229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4021a98-11cd-40d1-b7e7-6210200c05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:15.207264 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3546/7081] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:15.238289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4021a98-11cd-40d1-b7e7-6210200c05b7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:15.250772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4021a98-11cd-40d1-b7e7-6210200c05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:15.301675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:15.310242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:15.310539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:15.311311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] PATH_INFO: `/v3/users/522d7ca62777450ca547c968ff2a0d8c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:15.318374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522d7ca62777450ca547c968ff2a0d8c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:15.320647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:15.333394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4021a98-11cd-40d1-b7e7-6210200c05b7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:15.344432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7c7bc-1eba-4110-9a3b-3c1f5f2ab1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:15.345219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c7bc-1eba-4110-9a3b-3c1f5f2ab1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:15.345383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c7bc-1eba-4110-9a3b-3c1f5f2ab1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:15.345692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c7bc-1eba-4110-9a3b-3c1f5f2ab1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:15.390574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7c7bc-1eba-4110-9a3b-3c1f5f2ab1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:15.393008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7c7bc-1eba-4110-9a3b-3c1f5f2ab1c9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:15.419650 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3547/7082] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:15.458497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522d7ca62777450ca547c968ff2a0d8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:15.459664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522d7ca62777450ca547c968ff2a0d8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:15.459850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522d7ca62777450ca547c968ff2a0d8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:15.481263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522d7ca62777450ca547c968ff2a0d8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:15.494472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522d7ca62777450ca547c968ff2a0d8c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:15.522893 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3536/7083] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:15 2022] DELETE /identity/v3/users/522d7ca62777450ca547c968ff2a0d8c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:15.526876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f124-fd30-4c84-be5b-b0e8aae1f225 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:15.527163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f124-fd30-4c84-be5b-b0e8aae1f225 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:15.527443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f124-fd30-4c84-be5b-b0e8aae1f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:15.560901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aed6f124-fd30-4c84-be5b-b0e8aae1f225 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:15.562355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aed6f124-fd30-4c84-be5b-b0e8aae1f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:15.742720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3548/7084] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:15.749285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:15.751031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:15.837868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9f308-cf97-426c-bb13-9ea7337742a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:15.841777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436be70-1a61-434a-94b4-adeff01a64f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:15.843248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436be70-1a61-434a-94b4-adeff01a64f5 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:15.843577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436be70-1a61-434a-94b4-adeff01a64f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:15.844252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436be70-1a61-434a-94b4-adeff01a64f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:15.860132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436be70-1a61-434a-94b4-adeff01a64f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:15.861828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436be70-1a61-434a-94b4-adeff01a64f5 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:15.876544 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3537/7085] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:16.508243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6f124-fd30-4c84-be5b-b0e8aae1f225 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:16.509882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aed6f124-fd30-4c84-be5b-b0e8aae1f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:16.532063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6f124-fd30-4c84-be5b-b0e8aae1f225 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:16.538186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:16.540407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:16.541702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:16.541988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] PATH_INFO: `/v3/projects/30668a142642467ea7dca6d881da1859` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:16.543759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30668a142642467ea7dca6d881da1859)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:16.546838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:16.635507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30668a142642467ea7dca6d881da1859', 'request_id': 'req-169754cb-fa2e-48f7-a4c9-cc1750af077e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:16.677457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30668a142642467ea7dca6d881da1859', 'request_id': 'req-169754cb-fa2e-48f7-a4c9-cc1750af077e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:16.710214 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30668a142642467ea7dca6d881da1859', 'request_id': 'req-169754cb-fa2e-48f7-a4c9-cc1750af077e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:16.726326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] The token cache is being invalidate because project 30668a142642467ea7dca6d881da1859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:16.726681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:16.727418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:16.729199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3549/7086] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:16 2022] DELETE /identity/v3/projects/30668a142642467ea7dca6d881da1859 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:16.733481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436be70-1a61-434a-94b4-adeff01a64f5 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:16.743539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436be70-1a61-434a-94b4-adeff01a64f5 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:16.830965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:16.834442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:16.884876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:16.886286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:16.886752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:16.887466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] PATH_INFO: `/v3/users/f5fd661817e545aa8376c3889eba5a94` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:16.889469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5fd661817e545aa8376c3889eba5a94)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:16.892220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:16.962211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169754cb-fa2e-48f7-a4c9-cc1750af077e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:16.968137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:16.969307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:16.969818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:16.970271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] PATH_INFO: `/v3/projects/e84fb425ca4049869c3cb1643d2097a7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:16.971955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84fb425ca4049869c3cb1643d2097a7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:16.974218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:16.983747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5fd661817e545aa8376c3889eba5a94'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:16.984519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5fd661817e545aa8376c3889eba5a94'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:16.985392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5fd661817e545aa8376c3889eba5a94'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.001238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5fd661817e545aa8376c3889eba5a94'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.041846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b76f501d-6536-43bf-b75d-0d5bebef2c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5fd661817e545aa8376c3889eba5a94'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.049258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84fb425ca4049869c3cb1643d2097a7', 'request_id': 'req-23633163-79fc-463c-b0cb-09f3bd17d7d3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.055543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84fb425ca4049869c3cb1643d2097a7', 'request_id': 'req-23633163-79fc-463c-b0cb-09f3bd17d7d3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.060673 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3538/7087] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:16 2022] DELETE /identity/v3/users/f5fd661817e545aa8376c3889eba5a94 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:17.066230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84fb425ca4049869c3cb1643d2097a7', 'request_id': 'req-23633163-79fc-463c-b0cb-09f3bd17d7d3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.087526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] The token cache is being invalidate because project e84fb425ca4049869c3cb1643d2097a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:17.087911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.088763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-23633163-79fc-463c-b0cb-09f3bd17d7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.096913 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3550/7088] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:16 2022] DELETE /identity/v3/projects/e84fb425ca4049869c3cb1643d2097a7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:17.098273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674b5f-877c-4503-8198-91095755865d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:17.098569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674b5f-877c-4503-8198-91095755865d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:17.098848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674b5f-877c-4503-8198-91095755865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:17.134168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c5674b5f-877c-4503-8198-91095755865d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:17.136016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c5674b5f-877c-4503-8198-91095755865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:17.248859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3539/7089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:17.250145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc9d7b-9330-4b72-a5b9-53cf174aab37 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:17.250569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc9d7b-9330-4b72-a5b9-53cf174aab37 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:17.251067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc9d7b-9330-4b72-a5b9-53cf174aab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:17.297627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6cfc9d7b-9330-4b72-a5b9-53cf174aab37 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:17.299063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6cfc9d7b-9330-4b72-a5b9-53cf174aab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:17.324323 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3551/7090] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:17.324795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674b5f-877c-4503-8198-91095755865d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:17.359667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674b5f-877c-4503-8198-91095755865d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:17.373406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:17.373810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:17.374844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:17.374844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:17.375198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:17.375405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:17.376995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:17.390309 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3540/7091] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:17.394802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc9d7b-9330-4b72-a5b9-53cf174aab37 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:17.405168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc9d7b-9330-4b72-a5b9-53cf174aab37 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:17.410643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:17.410837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:17.411312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:17.411489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:17.412158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:17.414279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:17.455668 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3552/7092] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:17 2022] POST /identity/v3/projects => generated 359 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:17.462600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:17.486154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cf672-8ba3-472c-98a1-660ae9a3d657 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:17.642320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318a3ed-fa1c-4b0d-9422-53a3bd0d03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:17.645886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318a3ed-fa1c-4b0d-9422-53a3bd0d03d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:17.646380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318a3ed-fa1c-4b0d-9422-53a3bd0d03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:17.646914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318a3ed-fa1c-4b0d-9422-53a3bd0d03d5 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:17.647924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318a3ed-fa1c-4b0d-9422-53a3bd0d03d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:17.655325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318a3ed-fa1c-4b0d-9422-53a3bd0d03d5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:17.687017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:17.689741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:17.754644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3541/7093] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:17 2022] POST /identity/v3/users => generated 280 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:17.759892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318a3ed-fa1c-4b0d-9422-53a3bd0d03d5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:17.761491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1b8f7-0618-43a2-b637-eb0215f10a1e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:17.786072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:17.788835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:17.789124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:17.790605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] PATH_INFO: `/v3/projects/6419494309f647738a2fc3e35f164791` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:17.794504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6419494309f647738a2fc3e35f164791)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:17.799488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:17.804557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318a3ed-fa1c-4b0d-9422-53a3bd0d03d5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:17.825011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd035d-87a6-4c8e-a8bd-2ee5416f0cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:17.825751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd035d-87a6-4c8e-a8bd-2ee5416f0cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:17.826154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd035d-87a6-4c8e-a8bd-2ee5416f0cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:17.827150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd035d-87a6-4c8e-a8bd-2ee5416f0cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:17.828020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd035d-87a6-4c8e-a8bd-2ee5416f0cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:17.829669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd035d-87a6-4c8e-a8bd-2ee5416f0cf8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:17.857095 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3542/7094] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:17.862560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd035d-87a6-4c8e-a8bd-2ee5416f0cf8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:17.890002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd035d-87a6-4c8e-a8bd-2ee5416f0cf8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:17.922030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6419494309f647738a2fc3e35f164791', 'request_id': 'req-1543da80-3e10-4796-acab-cede48bc71d7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.938075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6419494309f647738a2fc3e35f164791', 'request_id': 'req-1543da80-3e10-4796-acab-cede48bc71d7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.975956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6419494309f647738a2fc3e35f164791', 'request_id': 'req-1543da80-3e10-4796-acab-cede48bc71d7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.996708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] The token cache is being invalidate because project 6419494309f647738a2fc3e35f164791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:17.997926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:17.999936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1543da80-3e10-4796-acab-cede48bc71d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:18.004127 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3553/7095] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:17 2022] DELETE /identity/v3/projects/6419494309f647738a2fc3e35f164791 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:18.010266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c30c84-0416-4646-b225-b7b74b97847c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.011747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c30c84-0416-4646-b225-b7b74b97847c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.012788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c30c84-0416-4646-b225-b7b74b97847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.021993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:18.022158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.027698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.028127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.029028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:18.031515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:18.059630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-53c30c84-0416-4646-b225-b7b74b97847c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:18.066028 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3543/7096] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:18.066233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53c30c84-0416-4646-b225-b7b74b97847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:18.067385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:18.070442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:18.083363 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3554/7097] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:18.091346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4f2a-c8d6-47a8-931f-7c79a7284fa7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.091724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4f2a-c8d6-47a8-931f-7c79a7284fa7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.092721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4f2a-c8d6-47a8-931f-7c79a7284fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.098649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe97a-5732-49a1-99de-5a0900911bf2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:18.107567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8441ca-6030-420c-ad81-94785500540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:18.112696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8441ca-6030-420c-ad81-94785500540c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.113341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8441ca-6030-420c-ad81-94785500540c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.113780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8441ca-6030-420c-ad81-94785500540c admin admin] PATH_INFO: `/v3/projects/e22920e252b0459095bd113adcca0495/users/f5283fe2f708406594daa219161aa778/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.139953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8441ca-6030-420c-ad81-94785500540c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22920e252b0459095bd113adcca0495, user_id=f5283fe2f708406594daa219161aa778, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:18.146282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8441ca-6030-420c-ad81-94785500540c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:18.156710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b05e4f2a-c8d6-47a8-931f-7c79a7284fa7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:18.158500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b05e4f2a-c8d6-47a8-931f-7c79a7284fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:18.175017 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3555/7098] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:18.176371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e4f2a-c8d6-47a8-931f-7c79a7284fa7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:18.185619 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3544/7099] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:18 2022] PUT /identity/v3/projects/e22920e252b0459095bd113adcca0495/users/f5283fe2f708406594daa219161aa778/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:18.195211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e4f2a-c8d6-47a8-931f-7c79a7284fa7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:18.198665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf32da8-8de4-42f8-91b2-2ea5189befe3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.198954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf32da8-8de4-42f8-91b2-2ea5189befe3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.199271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf32da8-8de4-42f8-91b2-2ea5189befe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.253793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ccf32da8-8de4-42f8-91b2-2ea5189befe3 None None] MFA Rules not processed for user `f5283fe2f708406594daa219161aa778`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:18.255957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ccf32da8-8de4-42f8-91b2-2ea5189befe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:18.311335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:18.313192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.313670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.314129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.315717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:18.316370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:18.318307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:18.337190 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3556/7100] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:18.342726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:18.356516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5e049-648e-41cb-953e-ed655c17f752 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:18.367883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555c0e5-2977-4c3d-be61-ae982be0c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:18.370634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555c0e5-2977-4c3d-be61-ae982be0c48e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.370634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555c0e5-2977-4c3d-be61-ae982be0c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.372034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555c0e5-2977-4c3d-be61-ae982be0c48e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.374206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555c0e5-2977-4c3d-be61-ae982be0c48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:18.379738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555c0e5-2977-4c3d-be61-ae982be0c48e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:18.413122 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3545/7101] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:18.421258 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3557/7102] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:18 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:18.430868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf32da8-8de4-42f8-91b2-2ea5189befe3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:18.449510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf32da8-8de4-42f8-91b2-2ea5189befe3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:18.463682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555c0e5-2977-4c3d-be61-ae982be0c48e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:18.605246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b0628-c719-4718-8ddb-9fbcd235493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:18.605995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b0628-c719-4718-8ddb-9fbcd235493d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.606284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b0628-c719-4718-8ddb-9fbcd235493d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.606566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b0628-c719-4718-8ddb-9fbcd235493d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.607458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b0628-c719-4718-8ddb-9fbcd235493d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:18.611173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b0628-c719-4718-8ddb-9fbcd235493d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:18.628276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555c0e5-2977-4c3d-be61-ae982be0c48e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:18.636241 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3546/7103] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:18 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:18.645680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b0628-c719-4718-8ddb-9fbcd235493d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:18.647414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:18.652868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.653188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.653442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] PATH_INFO: `/v3/users/f5283fe2f708406594daa219161aa778` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.657108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5283fe2f708406594daa219161aa778)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:18.659163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:18.678827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b0628-c719-4718-8ddb-9fbcd235493d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:18.691785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e5bc-5582-460a-9cf1-ef2f95dd62a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:18.693892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e5bc-5582-460a-9cf1-ef2f95dd62a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.694386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e5bc-5582-460a-9cf1-ef2f95dd62a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.694802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e5bc-5582-460a-9cf1-ef2f95dd62a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.696411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e5bc-5582-460a-9cf1-ef2f95dd62a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:18.698602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e5bc-5582-460a-9cf1-ef2f95dd62a4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:18.719954 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3547/7104] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:18.722301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e5bc-5582-460a-9cf1-ef2f95dd62a4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:18.738094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5283fe2f708406594daa219161aa778'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:18.743901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e5bc-5582-460a-9cf1-ef2f95dd62a4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:18.756107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5283fe2f708406594daa219161aa778'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:18.763938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:18.766198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.766776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.767055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] PATH_INFO: `/v3/projects/621ace9ddf7a4af8b554936b579e861d/users/ff6d9af619b042e79f7e36b98f3b3a41/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.768476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5283fe2f708406594daa219161aa778'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:18.769501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5283fe2f708406594daa219161aa778'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:18.770668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d06bf3e2-8918-44ae-8931-997a7a341177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5283fe2f708406594daa219161aa778'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:18.803677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3558/7105] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:18 2022] DELETE /identity/v3/users/f5283fe2f708406594daa219161aa778 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:18.808602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621ace9ddf7a4af8b554936b579e861d, user_id=ff6d9af619b042e79f7e36b98f3b3a41, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:18.810073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d26fc-6c64-419c-9a11-3aafd97ed3e3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:18.810370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d26fc-6c64-419c-9a11-3aafd97ed3e3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:18.811429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d26fc-6c64-419c-9a11-3aafd97ed3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:18.813323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:18.833300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-744d26fc-6c64-419c-9a11-3aafd97ed3e3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:18.834920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-744d26fc-6c64-419c-9a11-3aafd97ed3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:18.850419 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3548/7106] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:18 2022] PUT /identity/v3/projects/621ace9ddf7a4af8b554936b579e861d/users/ff6d9af619b042e79f7e36b98f3b3a41/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:18.858819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:18.865908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:18.955114 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3559/7107] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:19.027124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aff720-bed4-466d-bc2b-620666154f72 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:19.040967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e91c8-892c-4b76-be17-21b2ffba9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:19.041634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e91c8-892c-4b76-be17-21b2ffba9838 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.042031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e91c8-892c-4b76-be17-21b2ffba9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.042316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e91c8-892c-4b76-be17-21b2ffba9838 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.043064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e91c8-892c-4b76-be17-21b2ffba9838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:19.048650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e91c8-892c-4b76-be17-21b2ffba9838 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:19.068277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d26fc-6c64-419c-9a11-3aafd97ed3e3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:19.071025 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3549/7108] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:19.072029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-744d26fc-6c64-419c-9a11-3aafd97ed3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:19.078294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e91c8-892c-4b76-be17-21b2ffba9838 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:19.100636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e91c8-892c-4b76-be17-21b2ffba9838 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:19.112238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f205ab3-94fe-45b7-b038-7cd93360e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:19.114254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f205ab3-94fe-45b7-b038-7cd93360e4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.114674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f205ab3-94fe-45b7-b038-7cd93360e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.114866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f205ab3-94fe-45b7-b038-7cd93360e4cf admin admin] PATH_INFO: `/v3/projects/621ace9ddf7a4af8b554936b579e861d/users/ff6d9af619b042e79f7e36b98f3b3a41/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.122584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f205ab3-94fe-45b7-b038-7cd93360e4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=621ace9ddf7a4af8b554936b579e861d, user_id=ff6d9af619b042e79f7e36b98f3b3a41, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:19.140005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f205ab3-94fe-45b7-b038-7cd93360e4cf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:19.163605 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3550/7109] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:19 2022] PUT /identity/v3/projects/621ace9ddf7a4af8b554936b579e861d/users/ff6d9af619b042e79f7e36b98f3b3a41/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:19.177750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29413b28-db01-42c1-af58-637fc3573792 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.178039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29413b28-db01-42c1-af58-637fc3573792 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.178322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29413b28-db01-42c1-af58-637fc3573792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.190261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d26fc-6c64-419c-9a11-3aafd97ed3e3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:19.231864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-29413b28-db01-42c1-af58-637fc3573792 None None] MFA Rules not processed for user `ff6d9af619b042e79f7e36b98f3b3a41`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:19.233226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-29413b28-db01-42c1-af58-637fc3573792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:19.290941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127c637-7093-4189-a4a3-2912d2c7a9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:19.291705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c637-7093-4189-a4a3-2912d2c7a9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.292289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c637-7093-4189-a4a3-2912d2c7a9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.292289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c637-7093-4189-a4a3-2912d2c7a9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.390680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127c637-7093-4189-a4a3-2912d2c7a9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:19.393176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127c637-7093-4189-a4a3-2912d2c7a9b7 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:19.404802 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3551/7110] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:19.406108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29413b28-db01-42c1-af58-637fc3573792 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:19.409775 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3560/7111] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:19.422407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29413b28-db01-42c1-af58-637fc3573792 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:19.430990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc6747-e3d8-48b2-9d60-57560ba52470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:19.436680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6747-e3d8-48b2-9d60-57560ba52470 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.436680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6747-e3d8-48b2-9d60-57560ba52470 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.436680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6747-e3d8-48b2-9d60-57560ba52470 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.436680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc6747-e3d8-48b2-9d60-57560ba52470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:19.437670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc6747-e3d8-48b2-9d60-57560ba52470 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:19.481006 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3552/7112] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:19 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:19.486300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127c637-7093-4189-a4a3-2912d2c7a9b7 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:19.514647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127c637-7093-4189-a4a3-2912d2c7a9b7 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:19.584205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895d497-9784-4d79-b03e-a486fcce11f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:19.585057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895d497-9784-4d79-b03e-a486fcce11f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.585189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895d497-9784-4d79-b03e-a486fcce11f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.585564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895d497-9784-4d79-b03e-a486fcce11f0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.586353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895d497-9784-4d79-b03e-a486fcce11f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:19.589067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895d497-9784-4d79-b03e-a486fcce11f0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:19.613381 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3561/7113] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:19 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:19.617854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc6747-e3d8-48b2-9d60-57560ba52470 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:19.637437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc6747-e3d8-48b2-9d60-57560ba52470 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:19.647344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd852-62c3-4315-80b7-7f62a26b0e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:19.648639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd852-62c3-4315-80b7-7f62a26b0e1f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.649054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd852-62c3-4315-80b7-7f62a26b0e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.649340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd852-62c3-4315-80b7-7f62a26b0e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.650539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fd852-62c3-4315-80b7-7f62a26b0e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:19.653015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fd852-62c3-4315-80b7-7f62a26b0e1f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:19.666863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3553/7114] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:19.672197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895d497-9784-4d79-b03e-a486fcce11f0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:19.684229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895d497-9784-4d79-b03e-a486fcce11f0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:19.690258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4d345-ce56-4935-810c-f61476332635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:19.691172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4d345-ce56-4935-810c-f61476332635 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.691579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4d345-ce56-4935-810c-f61476332635 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.692123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4d345-ce56-4935-810c-f61476332635 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.693089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4d345-ce56-4935-810c-f61476332635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:19.694880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4d345-ce56-4935-810c-f61476332635 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:19.707513 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3562/7115] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:19.711737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd852-62c3-4315-80b7-7f62a26b0e1f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:19.723354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd852-62c3-4315-80b7-7f62a26b0e1f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:19.736969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:19.737971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.738319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.738666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] PATH_INFO: `/v3/projects/426fba5ebba24a95893b57dc00625638/users/d51a4731212c40318cfd2501629221dc/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.755812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=426fba5ebba24a95893b57dc00625638, user_id=d51a4731212c40318cfd2501629221dc, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:19.758653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:19.776799 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3554/7116] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:19 2022] PUT /identity/v3/projects/426fba5ebba24a95893b57dc00625638/users/d51a4731212c40318cfd2501629221dc/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:19.787750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a221-3d0d-4c1e-a1e3-9290b5c079be None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:19.788347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a221-3d0d-4c1e-a1e3-9290b5c079be None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:19.788475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a221-3d0d-4c1e-a1e3-9290b5c079be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:19.832468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1c54a221-3d0d-4c1e-a1e3-9290b5c079be None None] MFA Rules not processed for user `d51a4731212c40318cfd2501629221dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:19.834429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1c54a221-3d0d-4c1e-a1e3-9290b5c079be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:19.974988 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3563/7117] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:19.984162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:19.987210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:20.093818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c32e0-7f79-40b8-9df9-05e42222aa9d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:20.100764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff61f9-e43f-47d7-9f18-3a4b90b2feb2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:20.103838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff61f9-e43f-47d7-9f18-3a4b90b2feb2 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:20.104614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff61f9-e43f-47d7-9f18-3a4b90b2feb2 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:20.105292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff61f9-e43f-47d7-9f18-3a4b90b2feb2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:20.182409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff61f9-e43f-47d7-9f18-3a4b90b2feb2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:20.184856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff61f9-e43f-47d7-9f18-3a4b90b2feb2 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:20.209769 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3555/7118] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:20.490174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54a221-3d0d-4c1e-a1e3-9290b5c079be None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:20.493005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1c54a221-3d0d-4c1e-a1e3-9290b5c079be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:20.534932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff61f9-e43f-47d7-9f18-3a4b90b2feb2 service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:20.643760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54a221-3d0d-4c1e-a1e3-9290b5c079be None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:20.657731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:20.657731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:20.658256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:20.658903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] PATH_INFO: `/v3/projects/e22920e252b0459095bd113adcca0495` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:20.660989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22920e252b0459095bd113adcca0495)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:20.666890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:20.692827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff61f9-e43f-47d7-9f18-3a4b90b2feb2 service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:20.704210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:20.705362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:20.705880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:20.706320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] PATH_INFO: `/v3/users/ff6d9af619b042e79f7e36b98f3b3a41` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:20.708315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6d9af619b042e79f7e36b98f3b3a41)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:20.714346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:20.782924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22920e252b0459095bd113adcca0495', 'request_id': 'req-816e1230-26c4-48d9-a73f-7c4637badc71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.797947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22920e252b0459095bd113adcca0495', 'request_id': 'req-816e1230-26c4-48d9-a73f-7c4637badc71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.814719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22920e252b0459095bd113adcca0495', 'request_id': 'req-816e1230-26c4-48d9-a73f-7c4637badc71'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.832779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6d9af619b042e79f7e36b98f3b3a41'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.833873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6d9af619b042e79f7e36b98f3b3a41'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.835434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6d9af619b042e79f7e36b98f3b3a41'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.845783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] The token cache is being invalidate because project e22920e252b0459095bd113adcca0495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:20.848306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.849810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-816e1230-26c4-48d9-a73f-7c4637badc71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.855112 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3564/7119] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:20 2022] DELETE /identity/v3/projects/e22920e252b0459095bd113adcca0495 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:20.863667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef446-9efb-44cc-93de-1d502be51ff4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:20.864270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef446-9efb-44cc-93de-1d502be51ff4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:20.864878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef446-9efb-44cc-93de-1d502be51ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:20.875366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6d9af619b042e79f7e36b98f3b3a41'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.893249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fa5ef446-9efb-44cc-93de-1d502be51ff4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:20.895168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fa5ef446-9efb-44cc-93de-1d502be51ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:20.897651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-143656bd-e2df-44be-a2a6-911bdb0f7c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6d9af619b042e79f7e36b98f3b3a41'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:20.916160 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3556/7120] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:20 2022] DELETE /identity/v3/users/ff6d9af619b042e79f7e36b98f3b3a41 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:20.921465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4fb9-0865-40db-abb1-3d9a8bbdb32e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:20.922054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4fb9-0865-40db-abb1-3d9a8bbdb32e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:20.922742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4fb9-0865-40db-abb1-3d9a8bbdb32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:20.983735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-88bc4fb9-0865-40db-abb1-3d9a8bbdb32e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:20.985139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-88bc4fb9-0865-40db-abb1-3d9a8bbdb32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:21.027726 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3565/7121] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:21.027726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134d20a-4379-4db5-9654-eb606fcd8d39 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.027726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134d20a-4379-4db5-9654-eb606fcd8d39 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.027726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134d20a-4379-4db5-9654-eb606fcd8d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.055616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d134d20a-4379-4db5-9654-eb606fcd8d39 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:21.059519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d134d20a-4379-4db5-9654-eb606fcd8d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:21.147152 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3557/7122] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:21.192743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc4fb9-0865-40db-abb1-3d9a8bbdb32e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:21.194674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-88bc4fb9-0865-40db-abb1-3d9a8bbdb32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:21.209178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3566/7123] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:21.212311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134d20a-4379-4db5-9654-eb606fcd8d39 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:21.240752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134d20a-4379-4db5-9654-eb606fcd8d39 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:21.249370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:21.250242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.250566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.251009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.251900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:21.252421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:21.254733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:21.271122 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3567/7124] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:21.277288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:21.300842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492d0fa-806b-4ed3-8cc6-e780c55a1637 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:21.308672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae677a-0a5e-4b4f-b325-bb9ca1c35c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:21.311780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae677a-0a5e-4b4f-b325-bb9ca1c35c91 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.312377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae677a-0a5e-4b4f-b325-bb9ca1c35c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.313277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae677a-0a5e-4b4f-b325-bb9ca1c35c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.315282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae677a-0a5e-4b4f-b325-bb9ca1c35c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:21.318786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae677a-0a5e-4b4f-b325-bb9ca1c35c91 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:21.343487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc4fb9-0865-40db-abb1-3d9a8bbdb32e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:21.352354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee9517-8755-432d-b357-409d40923485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:21.353082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9517-8755-432d-b357-409d40923485 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.353361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9517-8755-432d-b357-409d40923485 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.353637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9517-8755-432d-b357-409d40923485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.365749 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3568/7125] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:21 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:21.370172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae677a-0a5e-4b4f-b325-bb9ca1c35c91 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:21.379608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee9517-8755-432d-b357-409d40923485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:21.383728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee9517-8755-432d-b357-409d40923485 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:21.407596 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3558/7126] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:21.478132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae677a-0a5e-4b4f-b325-bb9ca1c35c91 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:21.487799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782c28b-6ce5-495b-b8e3-d691ef03f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:21.489195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782c28b-6ce5-495b-b8e3-d691ef03f18f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.489815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782c28b-6ce5-495b-b8e3-d691ef03f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.490364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782c28b-6ce5-495b-b8e3-d691ef03f18f admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.491756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782c28b-6ce5-495b-b8e3-d691ef03f18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:21.496461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782c28b-6ce5-495b-b8e3-d691ef03f18f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:21.544823 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3569/7127] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:21 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:21.549916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee9517-8755-432d-b357-409d40923485 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:21.572615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee9517-8755-432d-b357-409d40923485 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:21.587975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e9562-5da4-4361-89e7-7794dfcef91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:21.588620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9562-5da4-4361-89e7-7794dfcef91f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.588906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9562-5da4-4361-89e7-7794dfcef91f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.589182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9562-5da4-4361-89e7-7794dfcef91f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.589917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e9562-5da4-4361-89e7-7794dfcef91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:21.591558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e9562-5da4-4361-89e7-7794dfcef91f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:21.610185 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3559/7128] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:21.612395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782c28b-6ce5-495b-b8e3-d691ef03f18f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:21.632689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782c28b-6ce5-495b-b8e3-d691ef03f18f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:21.649243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0950d-5d4c-485c-8606-897acf25aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:21.649776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0950d-5d4c-485c-8606-897acf25aa8a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.650061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0950d-5d4c-485c-8606-897acf25aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.650336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0950d-5d4c-485c-8606-897acf25aa8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.652163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0950d-5d4c-485c-8606-897acf25aa8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:21.653984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0950d-5d4c-485c-8606-897acf25aa8a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:21.681965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3570/7129] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:21.686254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e9562-5da4-4361-89e7-7794dfcef91f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:21.699964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e9562-5da4-4361-89e7-7794dfcef91f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:21.710898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848124dc-4d33-49f1-a3fb-7b94849b0060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:21.711810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848124dc-4d33-49f1-a3fb-7b94849b0060 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.712112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848124dc-4d33-49f1-a3fb-7b94849b0060 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.712662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848124dc-4d33-49f1-a3fb-7b94849b0060 admin admin] PATH_INFO: `/v3/projects/66d5978e30ce4cd59a5504018981fc52/users/115a86ef6f094d758d2b2f845afbfccd/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.742583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848124dc-4d33-49f1-a3fb-7b94849b0060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d5978e30ce4cd59a5504018981fc52, user_id=115a86ef6f094d758d2b2f845afbfccd, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:21.745377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848124dc-4d33-49f1-a3fb-7b94849b0060 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:21.772378 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3560/7130] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:21 2022] PUT /identity/v3/projects/66d5978e30ce4cd59a5504018981fc52/users/115a86ef6f094d758d2b2f845afbfccd/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:21.778791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20de762-dac7-4df2-a2c8-5b64b257dda3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:21.780215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20de762-dac7-4df2-a2c8-5b64b257dda3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:21.780698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20de762-dac7-4df2-a2c8-5b64b257dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:21.856844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f20de762-dac7-4df2-a2c8-5b64b257dda3 None None] MFA Rules not processed for user `115a86ef6f094d758d2b2f845afbfccd`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:21.859830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f20de762-dac7-4df2-a2c8-5b64b257dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:22.010568 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3571/7131] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:22.011466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848124dc-4d33-49f1-a3fb-7b94849b0060 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:22.130012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848124dc-4d33-49f1-a3fb-7b94849b0060 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:22.137390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:22.138505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.139561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.140452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.141410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:22.145761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:22.186696 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3561/7132] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:22 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:22.191770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20de762-dac7-4df2-a2c8-5b64b257dda3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:22.228740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20de762-dac7-4df2-a2c8-5b64b257dda3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:22.272128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:22.274669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:22.372635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d2037-7a0a-42cd-b9fa-9b02091c91d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:22.374493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d2037-7a0a-42cd-b9fa-9b02091c91d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.374859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d2037-7a0a-42cd-b9fa-9b02091c91d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.376754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d2037-7a0a-42cd-b9fa-9b02091c91d9 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.378151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d2037-7a0a-42cd-b9fa-9b02091c91d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:22.381702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d2037-7a0a-42cd-b9fa-9b02091c91d9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:22.423410 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3572/7133] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:22 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:22.432805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d2037-7a0a-42cd-b9fa-9b02091c91d9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:22.465703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc016f-2aa7-444a-bbe4-903b2f6586fe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:22.469835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d2037-7a0a-42cd-b9fa-9b02091c91d9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:22.481252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:22.481411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbce5f5-b776-4c14-895b-391494f7646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:22.481966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbce5f5-b776-4c14-895b-391494f7646a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.482334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbce5f5-b776-4c14-895b-391494f7646a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.482497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.482810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbce5f5-b776-4c14-895b-391494f7646a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.482928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.483089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] PATH_INFO: `/v3/projects/621ace9ddf7a4af8b554936b579e861d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.483586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbce5f5-b776-4c14-895b-391494f7646a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:22.485278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbce5f5-b776-4c14-895b-391494f7646a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:22.489662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621ace9ddf7a4af8b554936b579e861d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:22.492123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:22.504029 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3573/7134] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:22.509178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbce5f5-b776-4c14-895b-391494f7646a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:22.537991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbce5f5-b776-4c14-895b-391494f7646a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:22.552593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282b40a-a5fc-4eeb-95d2-32c4c51f45ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:22.553778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b40a-a5fc-4eeb-95d2-32c4c51f45ca admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.554851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b40a-a5fc-4eeb-95d2-32c4c51f45ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.555347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b40a-a5fc-4eeb-95d2-32c4c51f45ca admin admin] PATH_INFO: `/v3/projects/8b49d2044290478a9882e5427d79c923/users/241c67eff4484c72829aba08564d437c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.575810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282b40a-a5fc-4eeb-95d2-32c4c51f45ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b49d2044290478a9882e5427d79c923, user_id=241c67eff4484c72829aba08564d437c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:22.579639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282b40a-a5fc-4eeb-95d2-32c4c51f45ca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:22.604563 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3574/7135] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:22 2022] PUT /identity/v3/projects/8b49d2044290478a9882e5427d79c923/users/241c67eff4484c72829aba08564d437c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:22.606212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282b40a-a5fc-4eeb-95d2-32c4c51f45ca admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:22.615916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621ace9ddf7a4af8b554936b579e861d', 'request_id': 'req-c1caedfd-0e0a-484e-a361-84972d4681a6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:22.624124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621ace9ddf7a4af8b554936b579e861d', 'request_id': 'req-c1caedfd-0e0a-484e-a361-84972d4681a6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:22.636645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621ace9ddf7a4af8b554936b579e861d', 'request_id': 'req-c1caedfd-0e0a-484e-a361-84972d4681a6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:22.678851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] The token cache is being invalidate because project 621ace9ddf7a4af8b554936b579e861d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:22.679170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:22.680135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:22.685164 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3562/7136] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:22 2022] DELETE /identity/v3/projects/621ace9ddf7a4af8b554936b579e861d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:22.689587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:22.695097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:22.753228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282b40a-a5fc-4eeb-95d2-32c4c51f45ca admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:22.766444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:22.768513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.768872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.770152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.771507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:22.776134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:22.804614 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3575/7137] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:22.805850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:22.812035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:22.848020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd435-e09f-40a2-afc0-88a7bf61d9c7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:22.858279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae79e-053a-4275-a2fe-508917f6a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:22.860128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caedfd-0e0a-484e-a361-84972d4681a6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:22.861160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae79e-053a-4275-a2fe-508917f6a377 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.861514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae79e-053a-4275-a2fe-508917f6a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.862470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae79e-053a-4275-a2fe-508917f6a377 admin admin] PATH_INFO: `/v3/projects/8b49d2044290478a9882e5427d79c923/users/241c67eff4484c72829aba08564d437c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.867246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cae79e-053a-4275-a2fe-508917f6a377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b49d2044290478a9882e5427d79c923, user_id=241c67eff4484c72829aba08564d437c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:22.882545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cae79e-053a-4275-a2fe-508917f6a377 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:22.882847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340536-6e70-485e-907a-017858535bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:22.884184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340536-6e70-485e-907a-017858535bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.885704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340536-6e70-485e-907a-017858535bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.886204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340536-6e70-485e-907a-017858535bfd admin admin] PATH_INFO: `/v3/users/d51a4731212c40318cfd2501629221dc` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.892063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340536-6e70-485e-907a-017858535bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51a4731212c40318cfd2501629221dc)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:22.897488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340536-6e70-485e-907a-017858535bfd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:22.908769 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3576/7138] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:22 2022] PUT /identity/v3/projects/8b49d2044290478a9882e5427d79c923/users/241c67eff4484c72829aba08564d437c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:22.910954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feccd2b-4380-4bd8-b92d-2d0130b99501 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:22.913810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feccd2b-4380-4bd8-b92d-2d0130b99501 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:22.915212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feccd2b-4380-4bd8-b92d-2d0130b99501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:22.976180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3feccd2b-4380-4bd8-b92d-2d0130b99501 None None] MFA Rules not processed for user `241c67eff4484c72829aba08564d437c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:22.977643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3feccd2b-4380-4bd8-b92d-2d0130b99501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:23.010308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-54340536-6e70-485e-907a-017858535bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51a4731212c40318cfd2501629221dc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:23.012204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-54340536-6e70-485e-907a-017858535bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51a4731212c40318cfd2501629221dc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:23.013603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-54340536-6e70-485e-907a-017858535bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51a4731212c40318cfd2501629221dc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:23.042224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-54340536-6e70-485e-907a-017858535bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51a4731212c40318cfd2501629221dc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:23.058323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-54340536-6e70-485e-907a-017858535bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51a4731212c40318cfd2501629221dc'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:23.089891 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3563/7139] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:22 2022] DELETE /identity/v3/users/d51a4731212c40318cfd2501629221dc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:23.112667 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3577/7140] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:23.117108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340536-6e70-485e-907a-017858535bfd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.267299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340536-6e70-485e-907a-017858535bfd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:23.275984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72cfdb-0f96-4488-a71c-92ef829269a8 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:23.277136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cfdb-0f96-4488-a71c-92ef829269a8 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:23.277629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cfdb-0f96-4488-a71c-92ef829269a8 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:23.278033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cfdb-0f96-4488-a71c-92ef829269a8 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:23.280605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72cfdb-0f96-4488-a71c-92ef829269a8 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:23.283050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72cfdb-0f96-4488-a71c-92ef829269a8 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:23.330401 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3564/7141] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:23 2022] POST /identity/v3/services => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:23.331684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feccd2b-4380-4bd8-b92d-2d0130b99501 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.349367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feccd2b-4380-4bd8-b92d-2d0130b99501 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:23.405334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:23.409107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:23.409405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:23.409687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:23.412607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:23.415328 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:23.415328 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:16:23.415328 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:16:23.416272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:23.448987 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3578/7142] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Feb 19 21:16:23 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:23.450275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72cfdb-0f96-4488-a71c-92ef829269a8 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.467796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72cfdb-0f96-4488-a71c-92ef829269a8 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:23.485116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cb9d0-cb57-458a-a205-4f5572a79b0a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:23.485837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cb9d0-cb57-458a-a205-4f5572a79b0a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:23.486138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cb9d0-cb57-458a-a205-4f5572a79b0a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:23.486421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cb9d0-cb57-458a-a205-4f5572a79b0a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:23.487193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cb9d0-cb57-458a-a205-4f5572a79b0a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:23.488965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cb9d0-cb57-458a-a205-4f5572a79b0a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:23.514881 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3565/7143] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:23 2022] POST /identity/v3/services => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:23.520697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.547111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea6306-14ef-4c6a-85a6-cce5c1eb428c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:23.632754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069ff9-26d9-4cc1-933b-e413e2ef5f11 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:23.633420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069ff9-26d9-4cc1-933b-e413e2ef5f11 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:23.640770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069ff9-26d9-4cc1-933b-e413e2ef5f11 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:23.640770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069ff9-26d9-4cc1-933b-e413e2ef5f11 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:23.642944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069ff9-26d9-4cc1-933b-e413e2ef5f11 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:23.646811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069ff9-26d9-4cc1-933b-e413e2ef5f11 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:23.676695 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3579/7144] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Feb 19 21:16:23 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:23.677985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cb9d0-cb57-458a-a205-4f5572a79b0a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.695577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cb9d0-cb57-458a-a205-4f5572a79b0a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:23.705596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:23.706304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:23.706593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:23.706893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:23.707645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:23.708762 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:23.708762 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:16:23.708762 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:23.715920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:23.735394 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3566/7145] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Feb 19 21:16:23 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:23.736649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069ff9-26d9-4cc1-933b-e413e2ef5f11 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.753790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069ff9-26d9-4cc1-933b-e413e2ef5f11 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:23.769840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:23.770716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:23.772484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:23.773349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3adc4d9423914c33bda1375541d2d0c2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:23.774703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3adc4d9423914c33bda1375541d2d0c2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:23.777915 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:23.777915 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:16:23.777915 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:16:23.780650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:23.803995 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3580/7146] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Feb 19 21:16:23 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/3adc4d9423914c33bda1375541d2d0c2 => generated 334 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:23.808198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.825628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a5e07-5629-4b66-9aa6-68f43d2f7fb9 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:23.838052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.841236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:23.850288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:23.851306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:23.851431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:23.852141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3adc4d9423914c33bda1375541d2d0c2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:23.853238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3adc4d9423914c33bda1375541d2d0c2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:23.857870 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:23.857870 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:16:23.857870 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:23.859418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:23.902555 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3567/7147] 10.222.0.30 () {58 vars in 1290 bytes} [Sat Feb 19 21:16:23 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/3adc4d9423914c33bda1375541d2d0c2 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Feb 19 21:16:23.904282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:23.932007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb88cd-0d88-44d3-aa79-c808e21eda78 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:23.943323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:23.944190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:23.944542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:23.948792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3adc4d9423914c33bda1375541d2d0c2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:23.948792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3adc4d9423914c33bda1375541d2d0c2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:23.953775 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:23.953775 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:16:23.953775 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:23.957012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:23.995527 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3568/7148] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 21:16:23 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3adc4d9423914c33bda1375541d2d0c2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:23.996979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.020646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3a18a-c3f0-4978-a448-e7c01e2106b1 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.036153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138e8a-7977-4e4d-88a9-4e0f89a668e3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.037132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138e8a-7977-4e4d-88a9-4e0f89a668e3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.037759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138e8a-7977-4e4d-88a9-4e0f89a668e3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.039770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138e8a-7977-4e4d-88a9-4e0f89a668e3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.040805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb138e8a-7977-4e4d-88a9-4e0f89a668e3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.043762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb138e8a-7977-4e4d-88a9-4e0f89a668e3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.080047 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3569/7149] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Feb 19 21:16:23 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:16:24.089096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138e8a-7977-4e4d-88a9-4e0f89a668e3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.098005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38087008-7820-484f-8a72-8af4681c8c8a tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.113584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.114499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.114786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.115064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] PATH_INFO: `/v3/projects/426fba5ebba24a95893b57dc00625638` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.116608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426fba5ebba24a95893b57dc00625638)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.118550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.122535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138e8a-7977-4e4d-88a9-4e0f89a668e3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.147125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.150249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.150544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.150828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3adc4d9423914c33bda1375541d2d0c2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.151495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3adc4d9423914c33bda1375541d2d0c2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.153140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.175834 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Could not find Endpoint Group: 3adc4d9423914c33bda1375541d2d0c2.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3adc4d9423914c33bda1375541d2d0c2. Feb 19 21:16:24.197925 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3570/7150] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 21:16:24 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3adc4d9423914c33bda1375541d2d0c2 => generated 120 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:16:24.204291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.233835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94856c-45e7-437d-b91b-014f8199c185 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.284792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426fba5ebba24a95893b57dc00625638', 'request_id': 'req-5cd002ae-ab99-4b61-bbee-a0ac389cd578'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:24.300542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426fba5ebba24a95893b57dc00625638', 'request_id': 'req-5cd002ae-ab99-4b61-bbee-a0ac389cd578'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:24.316688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426fba5ebba24a95893b57dc00625638', 'request_id': 'req-5cd002ae-ab99-4b61-bbee-a0ac389cd578'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:24.339821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] The token cache is being invalidate because project 426fba5ebba24a95893b57dc00625638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:24.340291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:24.341181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5cd002ae-ab99-4b61-bbee-a0ac389cd578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:24.349890 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3581/7151] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:23 2022] DELETE /identity/v3/projects/426fba5ebba24a95893b57dc00625638 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:24.351794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8ea5-0727-4f89-8e67-a0ee9f433428 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.352219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8ea5-0727-4f89-8e67-a0ee9f433428 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.352640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8ea5-0727-4f89-8e67-a0ee9f433428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.401044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.402189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.402660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.403695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/services/4fa6557fd96f433da23993d911daff8d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.407402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4fa6557fd96f433da23993d911daff8d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.410145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.442581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f09a8ea5-0727-4f89-8e67-a0ee9f433428 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:24.445514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f09a8ea5-0727-4f89-8e67-a0ee9f433428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:24.469298 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3571/7152] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:24 2022] DELETE /identity/v3/services/4fa6557fd96f433da23993d911daff8d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:24.475043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.479782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:24.507433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611931d-4171-4006-beb0-7ac60f9de1ec tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.518650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6392a3e-cb05-4a0e-a951-c06e22c6dd44 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.519967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6392a3e-cb05-4a0e-a951-c06e22c6dd44 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.519967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6392a3e-cb05-4a0e-a951-c06e22c6dd44 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.521596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6392a3e-cb05-4a0e-a951-c06e22c6dd44 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.523419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6392a3e-cb05-4a0e-a951-c06e22c6dd44 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.526230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6392a3e-cb05-4a0e-a951-c06e22c6dd44 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.555870 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3572/7153] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:24 2022] POST /identity/v3/services => generated 287 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:24.560156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6392a3e-cb05-4a0e-a951-c06e22c6dd44 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.629136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6392a3e-cb05-4a0e-a951-c06e22c6dd44 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.641329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.642669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.643647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.647678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.647678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.650481 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:24.650481 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:16:24.650481 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:24.653174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.660274 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3582/7154] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3494 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:24.666759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f62d-56cf-456e-a549-987ad89045fc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.668187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f62d-56cf-456e-a549-987ad89045fc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.668187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f62d-56cf-456e-a549-987ad89045fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.675225 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3573/7155] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Feb 19 21:16:24 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:24.678738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.730562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84868-f439-46a7-a0dc-6b2c1b1b3bc3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.744939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0800f62d-56cf-456e-a549-987ad89045fc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:24.746881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0800f62d-56cf-456e-a549-987ad89045fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:24.751073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abf5cf-099b-465a-a04c-026070a9e682 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.751894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf5cf-099b-465a-a04c-026070a9e682 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.752532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf5cf-099b-465a-a04c-026070a9e682 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.752978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf5cf-099b-465a-a04c-026070a9e682 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.754010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abf5cf-099b-465a-a04c-026070a9e682 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.755746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abf5cf-099b-465a-a04c-026070a9e682 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.770324 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3583/7156] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3494 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:24.776475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f62d-56cf-456e-a549-987ad89045fc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.787254 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3574/7157] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:24 2022] POST /identity/v3/services => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:24.791474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abf5cf-099b-465a-a04c-026070a9e682 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.802910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f62d-56cf-456e-a549-987ad89045fc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.843762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abf5cf-099b-465a-a04c-026070a9e682 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.846449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.847882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.848901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.849856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.851291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:24.852045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.856453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.857352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.860835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.861384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.861939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5af1680719734e60b7e6e567db228e0d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.864102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=5af1680719734e60b7e6e567db228e0d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.870906 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:24.870906 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:16:24.870906 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:24.872434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.895349 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3584/7158] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:24.899977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.919902 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3575/7159] 10.222.0.30 () {60 vars in 1312 bytes} [Sat Feb 19 21:16:24 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/5af1680719734e60b7e6e567db228e0d => generated 334 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:24.921625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:24.925834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492be555-1b53-40a3-9a5e-57ce5778695a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.937117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddc2e3-d4bc-407c-8f77-497e9b190c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.938710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddc2e3-d4bc-407c-8f77-497e9b190c5a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.939439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddc2e3-d4bc-407c-8f77-497e9b190c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.940196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddc2e3-d4bc-407c-8f77-497e9b190c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.942609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddc2e3-d4bc-407c-8f77-497e9b190c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.948816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddc2e3-d4bc-407c-8f77-497e9b190c5a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:24.961253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd132f-1d87-40a1-a780-33a362c3b295 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:24.974838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a6176-1dc3-4a6a-b868-dc7fb827dcda tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:24.975851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6176-1dc3-4a6a-b868-dc7fb827dcda tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:24.976254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6176-1dc3-4a6a-b868-dc7fb827dcda tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:24.976669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6176-1dc3-4a6a-b868-dc7fb827dcda tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/services/fbf729bc61cc454f84bc249dd5930347` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:24.977452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a6176-1dc3-4a6a-b868-dc7fb827dcda tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fbf729bc61cc454f84bc249dd5930347)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:24.980613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a6176-1dc3-4a6a-b868-dc7fb827dcda tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.013217 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3585/7160] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:24 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:25.022044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddc2e3-d4bc-407c-8f77-497e9b190c5a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.028431 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3576/7161] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:24 2022] DELETE /identity/v3/services/fbf729bc61cc454f84bc249dd5930347 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:25.033926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a6176-1dc3-4a6a-b868-dc7fb827dcda tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.065097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a6176-1dc3-4a6a-b868-dc7fb827dcda tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.189889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddc2e3-d4bc-407c-8f77-497e9b190c5a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.210848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f793e-194f-4f63-913e-d1a354082d2c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.213796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f793e-194f-4f63-913e-d1a354082d2c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.215692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f793e-194f-4f63-913e-d1a354082d2c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.217605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f793e-194f-4f63-913e-d1a354082d2c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5af1680719734e60b7e6e567db228e0d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.220693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f793e-194f-4f63-913e-d1a354082d2c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=5af1680719734e60b7e6e567db228e0d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.226358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f793e-194f-4f63-913e-d1a354082d2c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.237548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc34602-01dc-41be-b361-f4c835ecb2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.238829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc34602-01dc-41be-b361-f4c835ecb2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.241099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc34602-01dc-41be-b361-f4c835ecb2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.241700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc34602-01dc-41be-b361-f4c835ecb2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.243451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc34602-01dc-41be-b361-f4c835ecb2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.253636 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3577/7162] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 21:16:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/5af1680719734e60b7e6e567db228e0d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:25.255107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f793e-194f-4f63-913e-d1a354082d2c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.256054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc34602-01dc-41be-b361-f4c835ecb2f0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.281356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f793e-194f-4f63-913e-d1a354082d2c tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.289773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5594-833d-4310-be71-a5ffb9d80806 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.291016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5594-833d-4310-be71-a5ffb9d80806 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.291526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5594-833d-4310-be71-a5ffb9d80806 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.292025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5594-833d-4310-be71-a5ffb9d80806 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/services/d327b0ac9a5f4ebe802467d29ebfee4c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.293176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5594-833d-4310-be71-a5ffb9d80806 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d327b0ac9a5f4ebe802467d29ebfee4c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.296630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5594-833d-4310-be71-a5ffb9d80806 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.314575 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3586/7163] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:25 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:25.315847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc34602-01dc-41be-b361-f4c835ecb2f0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.393583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc34602-01dc-41be-b361-f4c835ecb2f0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.394758 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3578/7164] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:25 2022] DELETE /identity/v3/services/d327b0ac9a5f4ebe802467d29ebfee4c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:25.400529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5594-833d-4310-be71-a5ffb9d80806 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.480235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5594-833d-4310-be71-a5ffb9d80806 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.486268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb10ab8-3b25-4472-b5be-95c9a53b08e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.489567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb10ab8-3b25-4472-b5be-95c9a53b08e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.489895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb10ab8-3b25-4472-b5be-95c9a53b08e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.492012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb10ab8-3b25-4472-b5be-95c9a53b08e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.493865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb10ab8-3b25-4472-b5be-95c9a53b08e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.503458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0080-7f80-44f7-b958-f97a789d306f tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.504850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0080-7f80-44f7-b958-f97a789d306f tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.505346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0080-7f80-44f7-b958-f97a789d306f tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.505829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0080-7f80-44f7-b958-f97a789d306f tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/7540dd23bbc54ce9bca9fbe7ca89762c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.507086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0080-7f80-44f7-b958-f97a789d306f tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=7540dd23bbc54ce9bca9fbe7ca89762c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.514732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb10ab8-3b25-4472-b5be-95c9a53b08e9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.522313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0080-7f80-44f7-b958-f97a789d306f tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.551095 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3587/7165] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:25.551731 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3579/7166] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 21:16:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/7540dd23bbc54ce9bca9fbe7ca89762c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:25.555991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0080-7f80-44f7-b958-f97a789d306f tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.558936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb10ab8-3b25-4472-b5be-95c9a53b08e9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.586905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb10ab8-3b25-4472-b5be-95c9a53b08e9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.587363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0080-7f80-44f7-b958-f97a789d306f tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.593797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d474816-e00b-4e49-841c-993431d751d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.594482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474816-e00b-4e49-841c-993431d751d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.594773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474816-e00b-4e49-841c-993431d751d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.595057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474816-e00b-4e49-841c-993431d751d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.596249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d474816-e00b-4e49-841c-993431d751d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.598088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '241c67eff4484c72829aba08564d437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b49d2044290478a9882e5427d79c923', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.600557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d474816-e00b-4e49-841c-993431d751d4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.602438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.603268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.603717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] PATH_INFO: `/v3/services/f58af9161aad4abda5a876e8dcaa8f30` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.605217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f58af9161aad4abda5a876e8dcaa8f30)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.610181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.631980 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3588/7167] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:25.633647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d474816-e00b-4e49-841c-993431d751d4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.657913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d474816-e00b-4e49-841c-993431d751d4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.666165 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3580/7168] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:25 2022] DELETE /identity/v3/services/f58af9161aad4abda5a876e8dcaa8f30 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:25.670621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:25.674832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:25.713186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a2912-124b-4bf8-8d32-6b78e45acbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.715093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a2912-124b-4bf8-8d32-6b78e45acbae admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.715394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a2912-124b-4bf8-8d32-6b78e45acbae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.715817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a2912-124b-4bf8-8d32-6b78e45acbae admin admin] PATH_INFO: `/v3/projects/cec3aa5c4f9e444bb1951f1b63e87804/users/26cda123283a4c04866835643d6d8ea6/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.727092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617903-11b0-40ae-a6a7-d9820d67a5a3 tempest-EndPointGroupsTest-2049302811 tempest-EndPointGroupsTest-2049302811-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:25.743374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:25.745173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.745798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.746022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] PATH_INFO: `/v3/users/115a86ef6f094d758d2b2f845afbfccd` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.751520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=115a86ef6f094d758d2b2f845afbfccd)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.776290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.810770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a2912-124b-4bf8-8d32-6b78e45acbae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec3aa5c4f9e444bb1951f1b63e87804, user_id=26cda123283a4c04866835643d6d8ea6, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:25.834193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a2912-124b-4bf8-8d32-6b78e45acbae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:25.901434 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3589/7169] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:25 2022] PUT /identity/v3/projects/cec3aa5c4f9e444bb1951f1b63e87804/users/26cda123283a4c04866835643d6d8ea6/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:25.913429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc2802-440e-4b1f-b893-f839079b39fb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:25.913723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc2802-440e-4b1f-b893-f839079b39fb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:25.914000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc2802-440e-4b1f-b893-f839079b39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:25.964730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-34fc2802-440e-4b1f-b893-f839079b39fb None None] MFA Rules not processed for user `26cda123283a4c04866835643d6d8ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:25.965478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-34fc2802-440e-4b1f-b893-f839079b39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:26.064751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115a86ef6f094d758d2b2f845afbfccd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:26.070211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115a86ef6f094d758d2b2f845afbfccd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:26.074570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115a86ef6f094d758d2b2f845afbfccd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:26.123363 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3590/7170] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:26.128690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc2802-440e-4b1f-b893-f839079b39fb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:26.143889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115a86ef6f094d758d2b2f845afbfccd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:26.179862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cda0f66b-c128-45b0-a2bf-90adc02af3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115a86ef6f094d758d2b2f845afbfccd'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:26.249564 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3581/7171] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:25 2022] DELETE /identity/v3/users/115a86ef6f094d758d2b2f845afbfccd => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:26.255582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0e207-2ca8-4f28-a620-8448f313fcc9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:26.268251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0e207-2ca8-4f28-a620-8448f313fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:26.269291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0e207-2ca8-4f28-a620-8448f313fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:26.305223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc2802-440e-4b1f-b893-f839079b39fb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:26.415817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-adc0e207-2ca8-4f28-a620-8448f313fcc9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:26.419575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-adc0e207-2ca8-4f28-a620-8448f313fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:26.468705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:26.469415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:26.469706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:26.469987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:26.470696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:26.478667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:26.577416 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3591/7172] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:26 2022] POST /identity/v3/projects => generated 377 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:26.581297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:26.612065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:26.729369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3582/7173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:26.768640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0e207-2ca8-4f28-a620-8448f313fcc9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:26.770176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-adc0e207-2ca8-4f28-a620-8448f313fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:26.911123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4095e-94c7-4343-b9cf-c1e6dd1ffb1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:26.911919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0e207-2ca8-4f28-a620-8448f313fcc9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:26.926091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df39667-24d3-4dd2-b2d7-cf6e634b8af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:26.928803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39667-24d3-4dd2-b2d7-cf6e634b8af0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:26.929354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39667-24d3-4dd2-b2d7-cf6e634b8af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:26.929856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df39667-24d3-4dd2-b2d7-cf6e634b8af0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:26.931462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df39667-24d3-4dd2-b2d7-cf6e634b8af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:26.937881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df39667-24d3-4dd2-b2d7-cf6e634b8af0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:26.996017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38bd7-fcbd-43b7-80ba-6277b3856bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:26.996727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38bd7-fcbd-43b7-80ba-6277b3856bae service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:26.997015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38bd7-fcbd-43b7-80ba-6277b3856bae service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:26.997294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38bd7-fcbd-43b7-80ba-6277b3856bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:27.015007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d38bd7-fcbd-43b7-80ba-6277b3856bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:27.016591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d38bd7-fcbd-43b7-80ba-6277b3856bae service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:27.037032 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3592/7174] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:26 2022] POST /identity/v3/users => generated 289 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:27.039221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df39667-24d3-4dd2-b2d7-cf6e634b8af0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:27.039706 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3583/7175] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:16:27.064177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df39667-24d3-4dd2-b2d7-cf6e634b8af0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:27.073289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49a78-5324-4388-9fee-a0f3214a9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:27.074266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49a78-5324-4388-9fee-a0f3214a9223 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:27.074796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49a78-5324-4388-9fee-a0f3214a9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:27.075309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49a78-5324-4388-9fee-a0f3214a9223 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:27.096881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b49a78-5324-4388-9fee-a0f3214a9223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:27.103193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b49a78-5324-4388-9fee-a0f3214a9223 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:27.137448 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3593/7176] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:27.141823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38bd7-fcbd-43b7-80ba-6277b3856bae service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:27.161923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38bd7-fcbd-43b7-80ba-6277b3856bae service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:27.187457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1673c1a-0791-456f-8092-e97f9e558246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:27.190695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673c1a-0791-456f-8092-e97f9e558246 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:27.191353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673c1a-0791-456f-8092-e97f9e558246 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:27.193459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1673c1a-0791-456f-8092-e97f9e558246 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:27.195695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1673c1a-0791-456f-8092-e97f9e558246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:27.203794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1673c1a-0791-456f-8092-e97f9e558246 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:27.243437 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3584/7177] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:27.243755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49a78-5324-4388-9fee-a0f3214a9223 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:27.258770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49a78-5324-4388-9fee-a0f3214a9223 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:27.266241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:27.267804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:27.269038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:27.269693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] PATH_INFO: `/v3/projects/9decc768dc74412c85e4108e5f217a58/users/0e619bf0f35a43ee90d1e14fd4d21f7e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:27.309858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9decc768dc74412c85e4108e5f217a58, user_id=0e619bf0f35a43ee90d1e14fd4d21f7e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:27.314955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:27.366094 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3594/7178] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:27 2022] PUT /identity/v3/projects/9decc768dc74412c85e4108e5f217a58/users/0e619bf0f35a43ee90d1e14fd4d21f7e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:27.385242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ae4a-8982-4c8e-8ea9-3bef4263319a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:27.385789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ae4a-8982-4c8e-8ea9-3bef4263319a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:27.386429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ae4a-8982-4c8e-8ea9-3bef4263319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:27.428772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-80b0ae4a-8982-4c8e-8ea9-3bef4263319a None None] MFA Rules not processed for user `0e619bf0f35a43ee90d1e14fd4d21f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:27.430719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-80b0ae4a-8982-4c8e-8ea9-3bef4263319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:27.602721 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3585/7179] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:27.629381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:27.634790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:27.786286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e88f-34eb-4456-9449-34fdcd3a37e8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:27.798082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:27.800167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:27.800602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:27.801100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:27.803608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:27.914557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:27.916144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:27.931428 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3595/7180] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:28.085959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5709-9606-452d-9ab9-bb459d2ed460 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:28.086504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5709-9606-452d-9ab9-bb459d2ed460 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:28.086937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5709-9606-452d-9ab9-bb459d2ed460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:28.200600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0d7b5709-9606-452d-9ab9-bb459d2ed460 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:28.203791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0d7b5709-9606-452d-9ab9-bb459d2ed460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:28.378981 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3586/7181] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:28.453033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:28.454732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:28.665754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd2c1-2d13-429a-9c38-15bda957596c service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:28.681297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:28.682455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:28.682973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:28.683581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:28.694629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:28.698019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:28.722285 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3596/7182] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:28.754376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b5709-9606-452d-9ab9-bb459d2ed460 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:28.756369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0d7b5709-9606-452d-9ab9-bb459d2ed460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:28.919730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b5709-9606-452d-9ab9-bb459d2ed460 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:28.926988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:28.928276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:28.928765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:28.929201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] PATH_INFO: `/v3/projects/66d5978e30ce4cd59a5504018981fc52` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:28.932299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d5978e30ce4cd59a5504018981fc52)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:28.942347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:28.971017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:28.972588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:28.997712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0fe8f-8336-42c2-b7fe-84306f807a2e service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:29.009394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121621c6-b898-484b-9812-d4ae5c000d55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:29.010061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121621c6-b898-484b-9812-d4ae5c000d55 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:29.010338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121621c6-b898-484b-9812-d4ae5c000d55 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:29.010797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121621c6-b898-484b-9812-d4ae5c000d55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:29.025611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121621c6-b898-484b-9812-d4ae5c000d55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:29.028824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121621c6-b898-484b-9812-d4ae5c000d55 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:29.037844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d5978e30ce4cd59a5504018981fc52', 'request_id': 'req-f9c77761-7427-4cfd-bc94-0c0a44b87a34'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.062422 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3597/7183] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:29.070581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d5978e30ce4cd59a5504018981fc52', 'request_id': 'req-f9c77761-7427-4cfd-bc94-0c0a44b87a34'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.085579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d5978e30ce4cd59a5504018981fc52', 'request_id': 'req-f9c77761-7427-4cfd-bc94-0c0a44b87a34'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.106713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] The token cache is being invalidate because project 66d5978e30ce4cd59a5504018981fc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:29.107335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.107982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f9c77761-7427-4cfd-bc94-0c0a44b87a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.109604 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3587/7184] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:28 2022] DELETE /identity/v3/projects/66d5978e30ce4cd59a5504018981fc52 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:29.113609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121621c6-b898-484b-9812-d4ae5c000d55 service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:29.130923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121621c6-b898-484b-9812-d4ae5c000d55 service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:29.168669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1ae3-1e06-49ae-aeb1-2de95d8922c3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:29.169313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1ae3-1e06-49ae-aeb1-2de95d8922c3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:29.169749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1ae3-1e06-49ae-aeb1-2de95d8922c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:29.197669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-73cb1ae3-1e06-49ae-aeb1-2de95d8922c3 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:29.199200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-73cb1ae3-1e06-49ae-aeb1-2de95d8922c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:29.222178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:29.223306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:29.223701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:29.224073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] PATH_INFO: `/v3/users/241c67eff4484c72829aba08564d437c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:29.225543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=241c67eff4484c72829aba08564d437c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:29.234273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:29.314097 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3588/7185] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:29.315217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1ae3-1e06-49ae-aeb1-2de95d8922c3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:29.316919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241c67eff4484c72829aba08564d437c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.317079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-73cb1ae3-1e06-49ae-aeb1-2de95d8922c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:29.339363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241c67eff4484c72829aba08564d437c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.363416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241c67eff4484c72829aba08564d437c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.366044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241c67eff4484c72829aba08564d437c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.366959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241c67eff4484c72829aba08564d437c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:29.391446 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3598/7186] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:29 2022] DELETE /identity/v3/users/241c67eff4484c72829aba08564d437c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:29.421771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1ae3-1e06-49ae-aeb1-2de95d8922c3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:29.500093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdacc9-441f-43fb-8b62-d4557be1877c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:29.500758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdacc9-441f-43fb-8b62-d4557be1877c service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:29.501228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdacc9-441f-43fb-8b62-d4557be1877c service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:29.501457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdacc9-441f-43fb-8b62-d4557be1877c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:29.504356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-94cdacc9-441f-43fb-8b62-d4557be1877c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:29.620164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdacc9-441f-43fb-8b62-d4557be1877c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:29.622602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdacc9-441f-43fb-8b62-d4557be1877c service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:29.637663 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3589/7187] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:29.891576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:29.893073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:30.043394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ea68-91cd-4f3e-acdc-6449288eb06e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:30.049230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:30.050434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:30.050882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:30.052463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] PATH_INFO: `/v3/users/26cda123283a4c04866835643d6d8ea6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:30.054349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cda123283a4c04866835643d6d8ea6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:30.058434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:30.143028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cda123283a4c04866835643d6d8ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.176907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cda123283a4c04866835643d6d8ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.195875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cda123283a4c04866835643d6d8ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.196967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cda123283a4c04866835643d6d8ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.199171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cda123283a4c04866835643d6d8ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.242140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3599/7188] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:29 2022] DELETE /identity/v3/users/26cda123283a4c04866835643d6d8ea6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:30.246613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d234ea-3da9-43c1-bec6-c70093b874ec None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:30.247192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d234ea-3da9-43c1-bec6-c70093b874ec None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:30.247628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d234ea-3da9-43c1-bec6-c70093b874ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:30.270554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-14d234ea-3da9-43c1-bec6-c70093b874ec None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:30.272212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-14d234ea-3da9-43c1-bec6-c70093b874ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:30.373859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3590/7189] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:30.412575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:30.414171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:30.517219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a509f-3188-4bc7-9c8f-a522b3be1024 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:30.523104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e2eb-9855-4e51-b452-c993f93f2d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:30.524279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e2eb-9855-4e51-b452-c993f93f2d32 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:30.524784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e2eb-9855-4e51-b452-c993f93f2d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:30.525270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e2eb-9855-4e51-b452-c993f93f2d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:30.538360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1e2eb-9855-4e51-b452-c993f93f2d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:30.540374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1e2eb-9855-4e51-b452-c993f93f2d32 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:30.560386 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3600/7190] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:30.569385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d234ea-3da9-43c1-bec6-c70093b874ec None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:30.570863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-14d234ea-3da9-43c1-bec6-c70093b874ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:30.597728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d234ea-3da9-43c1-bec6-c70093b874ec None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:30.620448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:30.622591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:30.623849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:30.624173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] PATH_INFO: `/v3/projects/8b49d2044290478a9882e5427d79c923` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:30.628081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b49d2044290478a9882e5427d79c923)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:30.632556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:30.731429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b49d2044290478a9882e5427d79c923', 'request_id': 'req-919b1460-4dd5-4a1f-bdce-90c07c7102e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.742876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b49d2044290478a9882e5427d79c923', 'request_id': 'req-919b1460-4dd5-4a1f-bdce-90c07c7102e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.759998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b49d2044290478a9882e5427d79c923', 'request_id': 'req-919b1460-4dd5-4a1f-bdce-90c07c7102e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.787225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] The token cache is being invalidate because project 8b49d2044290478a9882e5427d79c923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:30.787531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.788350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-919b1460-4dd5-4a1f-bdce-90c07c7102e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:30.791198 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3591/7191] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:30 2022] DELETE /identity/v3/projects/8b49d2044290478a9882e5427d79c923 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:30.797344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef79a1d-e99c-4133-a53a-230b4a014715 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:30.797882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef79a1d-e99c-4133-a53a-230b4a014715 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:30.798302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef79a1d-e99c-4133-a53a-230b4a014715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:30.833524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aef79a1d-e99c-4133-a53a-230b4a014715 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:30.836012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aef79a1d-e99c-4133-a53a-230b4a014715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:31.006244 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3601/7192] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:31.014510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95bdc5-1630-4431-a95b-e3dd2f267700 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.015030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95bdc5-1630-4431-a95b-e3dd2f267700 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.015576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95bdc5-1630-4431-a95b-e3dd2f267700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.075888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ea95bdc5-1630-4431-a95b-e3dd2f267700 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:31.078667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ea95bdc5-1630-4431-a95b-e3dd2f267700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:31.094421 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3592/7193] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:31.098204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef79a1d-e99c-4133-a53a-230b4a014715 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:31.126778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef79a1d-e99c-4133-a53a-230b4a014715 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:31.133152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:31.133840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.134358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.134648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.135401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:31.137077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:31.140434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:31.160949 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3602/7194] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:31.165216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95bdc5-1630-4431-a95b-e3dd2f267700 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:31.178543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95bdc5-1630-4431-a95b-e3dd2f267700 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:31.186484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:31.187432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.187898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.188415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.189292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:31.191460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:31.262142 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3593/7195] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:31 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:31.268279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:31.288159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d9786-e407-4084-a1b6-72bdd00f70d1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:31.373099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:31.377074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:31.492529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:31.495031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.495490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.495922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.496861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:31.502032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:31.521460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c95ae9-d20b-42c6-a737-eb46582826b1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:31.527785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:31.528869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.529840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.530128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] PATH_INFO: `/v3/users/ad93f38d6b384bcf9b1b190a9abb27ce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.531548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad93f38d6b384bcf9b1b190a9abb27ce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:31.533577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:31.542635 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3603/7196] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:31 2022] POST /identity/v3/users => generated 286 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:31.543917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:31.550101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:31.573575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444689c-5d73-434b-8c55-f33c5502e061 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:31.586537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:31.587781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.588073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.588428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] PATH_INFO: `/v3/projects/cec3aa5c4f9e444bb1951f1b63e87804` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.589814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec3aa5c4f9e444bb1951f1b63e87804)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:31.591835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:31.610137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad93f38d6b384bcf9b1b190a9abb27ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.617206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad93f38d6b384bcf9b1b190a9abb27ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.619008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad93f38d6b384bcf9b1b190a9abb27ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.663027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad93f38d6b384bcf9b1b190a9abb27ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.679547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec3aa5c4f9e444bb1951f1b63e87804', 'request_id': 'req-148164fd-2836-4ac4-b70c-a1234b475fff'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.681546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad93f38d6b384bcf9b1b190a9abb27ce'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.689325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec3aa5c4f9e444bb1951f1b63e87804', 'request_id': 'req-148164fd-2836-4ac4-b70c-a1234b475fff'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.703025 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3594/7197] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:31 2022] DELETE /identity/v3/users/ad93f38d6b384bcf9b1b190a9abb27ce => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:31.704043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:31.706355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:31.714968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec3aa5c4f9e444bb1951f1b63e87804', 'request_id': 'req-148164fd-2836-4ac4-b70c-a1234b475fff'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.755443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] The token cache is being invalidate because project cec3aa5c4f9e444bb1951f1b63e87804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:31.755793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.758399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:31.767310 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3604/7198] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:31 2022] DELETE /identity/v3/projects/cec3aa5c4f9e444bb1951f1b63e87804 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:31.771176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:31.773974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:31.834135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0898c0d-77b8-4678-ae01-e63cfa4d3d9b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:31.845151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:31.845935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.846292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.846642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.847523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:31.850012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:31.870020 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3595/7199] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:31.877335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:31.882589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:31.914561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148164fd-2836-4ac4-b70c-a1234b475fff admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:31.926863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:31.927123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42276-ee76-43e7-9019-f58cf3e2354e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:31.927911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.928268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.928653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] PATH_INFO: `/v3/users/0e619bf0f35a43ee90d1e14fd4d21f7e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.932701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e619bf0f35a43ee90d1e14fd4d21f7e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:31.935012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:31.957371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b2e6-c3a4-42de-a60b-b950f7967049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:31.958065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b2e6-c3a4-42de-a60b-b950f7967049 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:31.958353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b2e6-c3a4-42de-a60b-b950f7967049 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:31.958638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b2e6-c3a4-42de-a60b-b950f7967049 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:31.962989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b2e6-c3a4-42de-a60b-b950f7967049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:31.967531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b2e6-c3a4-42de-a60b-b950f7967049 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:32.001472 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3596/7200] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:32.008473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b2e6-c3a4-42de-a60b-b950f7967049 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:32.029459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e619bf0f35a43ee90d1e14fd4d21f7e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.035145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b2e6-c3a4-42de-a60b-b950f7967049 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:32.048761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4124-247d-4750-bada-1edbdd9020ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:32.049760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4124-247d-4750-bada-1edbdd9020ed admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:32.050112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4124-247d-4750-bada-1edbdd9020ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:32.050480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4124-247d-4750-bada-1edbdd9020ed admin admin] PATH_INFO: `/v3/projects/741b4d089111491bb927fa8b49ba36a0/users/bddc87f8705745ed8cf2c687a51a5fc5/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:32.054297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e619bf0f35a43ee90d1e14fd4d21f7e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.077001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e619bf0f35a43ee90d1e14fd4d21f7e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.077793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e619bf0f35a43ee90d1e14fd4d21f7e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.078770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e619bf0f35a43ee90d1e14fd4d21f7e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.081883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c4124-247d-4750-bada-1edbdd9020ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=741b4d089111491bb927fa8b49ba36a0, user_id=bddc87f8705745ed8cf2c687a51a5fc5, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:32.084822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c4124-247d-4750-bada-1edbdd9020ed admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:32.096012 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3605/7201] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:31 2022] DELETE /identity/v3/users/0e619bf0f35a43ee90d1e14fd4d21f7e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:32.097187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:32.102278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3597/7202] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:32 2022] PUT /identity/v3/projects/741b4d089111491bb927fa8b49ba36a0/users/bddc87f8705745ed8cf2c687a51a5fc5/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:32.113447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4029d1a-98e6-4a72-9fdb-321fb4f2e810 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:32.114102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:32.114257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4029d1a-98e6-4a72-9fdb-321fb4f2e810 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:32.114635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4029d1a-98e6-4a72-9fdb-321fb4f2e810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:32.152951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d4029d1a-98e6-4a72-9fdb-321fb4f2e810 None None] MFA Rules not processed for user `bddc87f8705745ed8cf2c687a51a5fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:32.155718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d4029d1a-98e6-4a72-9fdb-321fb4f2e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:32.210715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c59f1-95b2-40e0-9eef-ab6e902e41f2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:32.218775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:32.220466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:32.220970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:32.221425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] PATH_INFO: `/v3/projects/4929d77b858b4d848172346c97160377` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:32.223354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4929d77b858b4d848172346c97160377)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:32.225965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:32.272598 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3598/7203] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:32.277030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4029d1a-98e6-4a72-9fdb-321fb4f2e810 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:32.278992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d4029d1a-98e6-4a72-9fdb-321fb4f2e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:32.306746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4929d77b858b4d848172346c97160377', 'request_id': 'req-5684a1e5-e8c8-49b5-855a-06895d8da120'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.308445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4029d1a-98e6-4a72-9fdb-321fb4f2e810 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:32.329712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4929d77b858b4d848172346c97160377', 'request_id': 'req-5684a1e5-e8c8-49b5-855a-06895d8da120'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.346824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4929d77b858b4d848172346c97160377', 'request_id': 'req-5684a1e5-e8c8-49b5-855a-06895d8da120'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.374493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] The token cache is being invalidate because project 4929d77b858b4d848172346c97160377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:32.375750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.377865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.382880 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3606/7204] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:32 2022] DELETE /identity/v3/projects/4929d77b858b4d848172346c97160377 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:32.386901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:32.390383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:32.450789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:32.452295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:32.452704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:32.453212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:32.455543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:32.457655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:32.505046 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3599/7205] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:32 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:32.508796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:32.509705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a1e5-e8c8-49b5-855a-06895d8da120 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:32.514381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:32.708472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda052f-a354-42e4-9254-21813a309b66 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:32.718067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:32.720407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:32.720407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:32.720407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:32.720407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:32.723339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:32.764089 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3600/7206] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:32 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:32.764422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:32.768572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:32.783139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:32.784088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:32.784407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:32.784689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] PATH_INFO: `/v3/users/cb9d52fae3fd4bb8b3e995990ccc9c2e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:32.787327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9d52fae3fd4bb8b3e995990ccc9c2e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:32.789858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:32.806864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9aa86-e69e-4c19-8c46-1eaf7da49e2a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:32.815010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:32.816104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:32.816516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:32.817200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] PATH_INFO: `/v3/projects/9decc768dc74412c85e4108e5f217a58` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:32.829484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9decc768dc74412c85e4108e5f217a58)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:32.831443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:32.873638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9d52fae3fd4bb8b3e995990ccc9c2e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.891784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9d52fae3fd4bb8b3e995990ccc9c2e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.904917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9d52fae3fd4bb8b3e995990ccc9c2e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.905894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9d52fae3fd4bb8b3e995990ccc9c2e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.907189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9d52fae3fd4bb8b3e995990ccc9c2e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.933106 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3607/7207] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:32 2022] DELETE /identity/v3/users/cb9d52fae3fd4bb8b3e995990ccc9c2e => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:32.935258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:32.937781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:32.941128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9decc768dc74412c85e4108e5f217a58', 'request_id': 'req-871b5adc-d2c0-449c-a785-f896b19900a2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.954224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9decc768dc74412c85e4108e5f217a58', 'request_id': 'req-871b5adc-d2c0-449c-a785-f896b19900a2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.967543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9decc768dc74412c85e4108e5f217a58', 'request_id': 'req-871b5adc-d2c0-449c-a785-f896b19900a2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.989386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] The token cache is being invalidate because project 9decc768dc74412c85e4108e5f217a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:32.989686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.990407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-871b5adc-d2c0-449c-a785-f896b19900a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:32.992031 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3601/7208] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:32 2022] DELETE /identity/v3/projects/9decc768dc74412c85e4108e5f217a58 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:32.999537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7249-a28c-4a5a-bbb9-082d0e16c166 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:32.999537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7249-a28c-4a5a-bbb9-082d0e16c166 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:32.999537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7249-a28c-4a5a-bbb9-082d0e16c166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.038147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-37ce7249-a28c-4a5a-bbb9-082d0e16c166 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:33.039555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-37ce7249-a28c-4a5a-bbb9-082d0e16c166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:33.056789 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3602/7209] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:33.066172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7287b87-806a-4bca-85b4-0a406aa28d94 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.066824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7287b87-806a-4bca-85b4-0a406aa28d94 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.067336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7287b87-806a-4bca-85b4-0a406aa28d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.068206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2255e5-b3bb-425e-b5ce-486cc7110a68 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:33.077285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:33.078044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.078333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.078608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.092557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:33.096672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:33.111969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f7287b87-806a-4bca-85b4-0a406aa28d94 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:33.113524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f7287b87-806a-4bca-85b4-0a406aa28d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:33.124771 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3603/7210] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:33.129568 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3608/7211] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:33.140831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:33.141119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7287b87-806a-4bca-85b4-0a406aa28d94 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:33.143100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:33.163028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b041fd-3252-4ad0-ae91-371e9409e6fc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:33.168567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e5389-4733-4faf-a29b-3c2ee1283ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:33.169711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e5389-4733-4faf-a29b-3c2ee1283ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.170207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e5389-4733-4faf-a29b-3c2ee1283ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.170672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e5389-4733-4faf-a29b-3c2ee1283ab8 admin admin] PATH_INFO: `/v3/projects/13496872377f472b86ae6901f017bc3d/users/c6cb5989865146a2bfdf253019d10082/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.178872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7287b87-806a-4bca-85b4-0a406aa28d94 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:33.189464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e5389-4733-4faf-a29b-3c2ee1283ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13496872377f472b86ae6901f017bc3d, user_id=c6cb5989865146a2bfdf253019d10082, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:33.194072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e5389-4733-4faf-a29b-3c2ee1283ab8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:33.203216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:33.203901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.204179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.204490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.205348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:33.205517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:33.207149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:33.225266 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3609/7212] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:33 2022] PUT /identity/v3/projects/13496872377f472b86ae6901f017bc3d/users/c6cb5989865146a2bfdf253019d10082/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:33.229983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e5389-4733-4faf-a29b-3c2ee1283ab8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:33.230831 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3604/7213] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:33.234762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:33.260822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eb9b6-c98b-41c2-a8ee-2a3bb9dde330 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:33.396444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e5389-4733-4faf-a29b-3c2ee1283ab8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:33.411537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29079e81-1594-41ed-b921-572524dacb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:33.413681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019c753-b0b7-4105-8126-d5e0bb98f5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:33.414909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019c753-b0b7-4105-8126-d5e0bb98f5df admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.415662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019c753-b0b7-4105-8126-d5e0bb98f5df admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.416164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019c753-b0b7-4105-8126-d5e0bb98f5df admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.417055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019c753-b0b7-4105-8126-d5e0bb98f5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:33.421581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019c753-b0b7-4105-8126-d5e0bb98f5df admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:33.428535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29079e81-1594-41ed-b921-572524dacb11 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.430452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29079e81-1594-41ed-b921-572524dacb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.450054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29079e81-1594-41ed-b921-572524dacb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.450782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29079e81-1594-41ed-b921-572524dacb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:33.454911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29079e81-1594-41ed-b921-572524dacb11 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:33.486073 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3610/7214] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:33.491658 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3605/7215] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:33 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:33.493327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29079e81-1594-41ed-b921-572524dacb11 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:33.499333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019c753-b0b7-4105-8126-d5e0bb98f5df admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:33.536902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29079e81-1594-41ed-b921-572524dacb11 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:33.785609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:33.787085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019c753-b0b7-4105-8126-d5e0bb98f5df admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:33.787430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.787949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.788397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] PATH_INFO: `/v3/projects/13496872377f472b86ae6901f017bc3d/users/c6cb5989865146a2bfdf253019d10082/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.791613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13496872377f472b86ae6901f017bc3d, user_id=c6cb5989865146a2bfdf253019d10082, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:33.797618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:33.803286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16904989-638e-450d-892a-73141bd2fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:33.804390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904989-638e-450d-892a-73141bd2fa8e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.804790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904989-638e-450d-892a-73141bd2fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.805186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904989-638e-450d-892a-73141bd2fa8e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.806231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16904989-638e-450d-892a-73141bd2fa8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:33.809244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16904989-638e-450d-892a-73141bd2fa8e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:33.822109 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3611/7216] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:33 2022] PUT /identity/v3/projects/13496872377f472b86ae6901f017bc3d/users/c6cb5989865146a2bfdf253019d10082/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:33.823398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:33.827824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:33.876023 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3606/7217] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:33 2022] POST /identity/v3/users => generated 287 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:33.877964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afc59-f26b-4d73-96b2-ddce3074b2c0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:33.879807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afc59-f26b-4d73-96b2-ddce3074b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:33.880533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afc59-f26b-4d73-96b2-ddce3074b2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:33.937668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a46afc59-f26b-4d73-96b2-ddce3074b2c0 None None] MFA Rules not processed for user `c6cb5989865146a2bfdf253019d10082`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:33.940006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a46afc59-f26b-4d73-96b2-ddce3074b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:33.993394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77160a68-77d9-4bba-aa8a-151559bcd7e3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.000501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.002231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.003380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.003833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] PATH_INFO: `/v3/projects/93ca6669fa674f74abb94f9f1eb19426` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.006346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ca6669fa674f74abb94f9f1eb19426)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.011361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.046181 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3607/7218] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:34.047345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46afc59-f26b-4d73-96b2-ddce3074b2c0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.069409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46afc59-f26b-4d73-96b2-ddce3074b2c0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.078875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ca6669fa674f74abb94f9f1eb19426', 'request_id': 'req-17e1c36a-5550-415a-b4f5-85089f87c0b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:34.085692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ca6669fa674f74abb94f9f1eb19426', 'request_id': 'req-17e1c36a-5550-415a-b4f5-85089f87c0b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:34.099315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ca6669fa674f74abb94f9f1eb19426', 'request_id': 'req-17e1c36a-5550-415a-b4f5-85089f87c0b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:34.113138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] The token cache is being invalidate because project 93ca6669fa674f74abb94f9f1eb19426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:34.113452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:34.114162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:34.115889 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3612/7219] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:33 2022] DELETE /identity/v3/projects/93ca6669fa674f74abb94f9f1eb19426 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:34.120402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.122673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:34.206847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3a7bf-df86-4e8f-9623-1a5406a8e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.207667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3a7bf-df86-4e8f-9623-1a5406a8e2bb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.208012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3a7bf-df86-4e8f-9623-1a5406a8e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.208365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3a7bf-df86-4e8f-9623-1a5406a8e2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.211194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3a7bf-df86-4e8f-9623-1a5406a8e2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.211541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3a7bf-df86-4e8f-9623-1a5406a8e2bb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.226494 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3608/7220] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:34.228043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d473c00-b44c-4f40-952d-25ae89413c35 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.228620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d473c00-b44c-4f40-952d-25ae89413c35 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.229090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d473c00-b44c-4f40-952d-25ae89413c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.252491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8d473c00-b44c-4f40-952d-25ae89413c35 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:34.254022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8d473c00-b44c-4f40-952d-25ae89413c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:34.261459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c36a-5550-415a-b4f5-85089f87c0b9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.263111 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3609/7221] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:34.264762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d473c00-b44c-4f40-952d-25ae89413c35 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.271641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8d473c00-b44c-4f40-952d-25ae89413c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:34.283355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833198e-eb2c-4d86-951a-fbb268401902 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.284171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833198e-eb2c-4d86-951a-fbb268401902 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.284564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833198e-eb2c-4d86-951a-fbb268401902 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.284957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833198e-eb2c-4d86-951a-fbb268401902 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.285872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833198e-eb2c-4d86-951a-fbb268401902 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.287697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833198e-eb2c-4d86-951a-fbb268401902 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.299692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d473c00-b44c-4f40-952d-25ae89413c35 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.306883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c0ff-0e92-4da9-bf75-3326d2826dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.308166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c0ff-0e92-4da9-bf75-3326d2826dcf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.308810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c0ff-0e92-4da9-bf75-3326d2826dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.309329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c0ff-0e92-4da9-bf75-3326d2826dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.311127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c0ff-0e92-4da9-bf75-3326d2826dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.319298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c0ff-0e92-4da9-bf75-3326d2826dcf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.320134 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3613/7222] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:34 2022] POST /identity/v3/services => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:34.326643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259e29f-a6ed-480a-be7e-809c91ba0df9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.329908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259e29f-a6ed-480a-be7e-809c91ba0df9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.330342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259e29f-a6ed-480a-be7e-809c91ba0df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.344022 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3610/7223] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:34.345494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c0ff-0e92-4da9-bf75-3326d2826dcf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.368970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c0ff-0e92-4da9-bf75-3326d2826dcf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.379146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f259e29f-a6ed-480a-be7e-809c91ba0df9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:34.382331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f259e29f-a6ed-480a-be7e-809c91ba0df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:34.406908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.407993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.408518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.408982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.409903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.412143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.435637 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3614/7224] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:34.437062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259e29f-a6ed-480a-be7e-809c91ba0df9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.453686 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1027509513. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:16:34.453686 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:16:34.453686 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:34.454047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259e29f-a6ed-480a-be7e-809c91ba0df9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.489673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37bdbb-54d7-497a-a2c6-718687cdd2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.490583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37bdbb-54d7-497a-a2c6-718687cdd2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.490863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37bdbb-54d7-497a-a2c6-718687cdd2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.491139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37bdbb-54d7-497a-a2c6-718687cdd2d6 admin admin] PATH_INFO: `/v3/projects/50984b380928456a887bd08bbde86c5c/users/11ef251159ae4c748ffda898a3704754/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.516973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37bdbb-54d7-497a-a2c6-718687cdd2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50984b380928456a887bd08bbde86c5c, user_id=11ef251159ae4c748ffda898a3704754, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.527022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37bdbb-54d7-497a-a2c6-718687cdd2d6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.534927 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3611/7225] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:16:34 2022] POST /identity/v3/endpoints => generated 360 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:34.537525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.564115 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3615/7226] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:34 2022] PUT /identity/v3/projects/50984b380928456a887bd08bbde86c5c/users/11ef251159ae4c748ffda898a3704754/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:34.565579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37bdbb-54d7-497a-a2c6-718687cdd2d6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.587633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3ac55-6b2b-4b4b-87c1-cddd83fe347c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.677727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a58b6e-5b6a-48fc-87fa-9ae0501fb3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.678898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58b6e-5b6a-48fc-87fa-9ae0501fb3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.679226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58b6e-5b6a-48fc-87fa-9ae0501fb3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.679564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58b6e-5b6a-48fc-87fa-9ae0501fb3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.680917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a58b6e-5b6a-48fc-87fa-9ae0501fb3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:34.681285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a58b6e-5b6a-48fc-87fa-9ae0501fb3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.682943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a58b6e-5b6a-48fc-87fa-9ae0501fb3d8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.701821 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3612/7227] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:34.703004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a66cc-a908-42d1-a08e-f19c07510f0a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.703292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a66cc-a908-42d1-a08e-f19c07510f0a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.703570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a66cc-a908-42d1-a08e-f19c07510f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.726250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37bdbb-54d7-497a-a2c6-718687cdd2d6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.752709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e30a66cc-a908-42d1-a08e-f19c07510f0a None None] MFA Rules not processed for user `11ef251159ae4c748ffda898a3704754`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:34.753951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e30a66cc-a908-42d1-a08e-f19c07510f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:34.764485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6e5bf-bb7c-4eea-b669-7703306c5db5 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.765341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6e5bf-bb7c-4eea-b669-7703306c5db5 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.765635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6e5bf-bb7c-4eea-b669-7703306c5db5 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.766220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6e5bf-bb7c-4eea-b669-7703306c5db5 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-1027509513` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.767091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6e5bf-bb7c-4eea-b669-7703306c5db5 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1027509513)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.768446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6e5bf-bb7c-4eea-b669-7703306c5db5 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.775147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3616/7228] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Feb 19 21:16:34 2022] GET /identity/v3/regions/tempest-region-1027509513 => generated 180 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:34.775823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6e5bf-bb7c-4eea-b669-7703306c5db5 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.809848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6e5bf-bb7c-4eea-b669-7703306c5db5 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.824122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.825158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.825863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.826961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.827950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.830084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.845343 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3613/7229] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3555 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:34.846193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a66cc-a908-42d1-a08e-f19c07510f0a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.870925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a66cc-a908-42d1-a08e-f19c07510f0a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:34.877744 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3617/7230] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:34 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:34.878824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.882258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:34.884685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04470b0a-4dd5-4392-b54a-88aae2816aa9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:34.885618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04470b0a-4dd5-4392-b54a-88aae2816aa9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:34.886122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04470b0a-4dd5-4392-b54a-88aae2816aa9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:34.886409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04470b0a-4dd5-4392-b54a-88aae2816aa9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/services` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:34.887355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04470b0a-4dd5-4392-b54a-88aae2816aa9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:34.889948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04470b0a-4dd5-4392-b54a-88aae2816aa9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:34.918122 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3614/7231] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:34 2022] POST /identity/v3/services => generated 288 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:34.922187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04470b0a-4dd5-4392-b54a-88aae2816aa9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:34.947925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04470b0a-4dd5-4392-b54a-88aae2816aa9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.018192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a034652-9794-40a0-b8fa-608778ecbdfe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.033234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094110b-63e4-4863-8434-4c7878fc9c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.033934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094110b-63e4-4863-8434-4c7878fc9c17 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.034275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094110b-63e4-4863-8434-4c7878fc9c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.034585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094110b-63e4-4863-8434-4c7878fc9c17 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.035447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094110b-63e4-4863-8434-4c7878fc9c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.037948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094110b-63e4-4863-8434-4c7878fc9c17 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.039538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba66a-6bf0-4f57-a1e1-5b1fa8dfc425 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.040427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba66a-6bf0-4f57-a1e1-5b1fa8dfc425 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.040888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba66a-6bf0-4f57-a1e1-5b1fa8dfc425 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.041337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba66a-6bf0-4f57-a1e1-5b1fa8dfc425 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.084005 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3615/7232] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:34 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:35.088630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094110b-63e4-4863-8434-4c7878fc9c17 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:35.193302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ba66a-6bf0-4f57-a1e1-5b1fa8dfc425 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.194618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094110b-63e4-4863-8434-4c7878fc9c17 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.204992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ba66a-6bf0-4f57-a1e1-5b1fa8dfc425 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.205247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.205715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.206156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.206498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.207898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.209974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.233540 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-985729895. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:16:35.233540 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:16:35.233540 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:35.253183 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3618/7233] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:34 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:35.254367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba66a-6bf0-4f57-a1e1-5b1fa8dfc425 service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:35.277681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba66a-6bf0-4f57-a1e1-5b1fa8dfc425 service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.324428 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3616/7234] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:16:35 2022] POST /identity/v3/endpoints => generated 361 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:35.329729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070389b-c46f-470d-896b-ad873ccdde52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.331029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070389b-c46f-470d-896b-ad873ccdde52 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.331228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070389b-c46f-470d-896b-ad873ccdde52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.333855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070389b-c46f-470d-896b-ad873ccdde52 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.336021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070389b-c46f-470d-896b-ad873ccdde52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.338801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070389b-c46f-470d-896b-ad873ccdde52 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.364851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:35.369235 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3619/7235] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:35.374154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070389b-c46f-470d-896b-ad873ccdde52 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:35.396793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070389b-c46f-470d-896b-ad873ccdde52 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.452735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c4dfc-f0ea-4c72-a888-9e6269d66025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.453484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c4dfc-f0ea-4c72-a888-9e6269d66025 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.453766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c4dfc-f0ea-4c72-a888-9e6269d66025 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.456834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c4dfc-f0ea-4c72-a888-9e6269d66025 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.457724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c4dfc-f0ea-4c72-a888-9e6269d66025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.463061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c4dfc-f0ea-4c72-a888-9e6269d66025 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.476967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb65084-6c38-4d48-8a7e-c919312bb08a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.494699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e0161-c0bb-4a40-81c7-e34247d1f560 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.495649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e0161-c0bb-4a40-81c7-e34247d1f560 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.499223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e0161-c0bb-4a40-81c7-e34247d1f560 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.500452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e0161-c0bb-4a40-81c7-e34247d1f560 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-985729895` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.503112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e0161-c0bb-4a40-81c7-e34247d1f560 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-985729895)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.504318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e0161-c0bb-4a40-81c7-e34247d1f560 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.509324 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3620/7236] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:35.514339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c4dfc-f0ea-4c72-a888-9e6269d66025 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:35.516382 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3617/7237] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Feb 19 21:16:35 2022] GET /identity/v3/regions/tempest-region-985729895 => generated 178 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:35.517509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e0161-c0bb-4a40-81c7-e34247d1f560 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:35.556150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c4dfc-f0ea-4c72-a888-9e6269d66025 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.568063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e0161-c0bb-4a40-81c7-e34247d1f560 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.577294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.578252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.578550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.578836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.581329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.581531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02681c5-87a8-44d9-a238-b4550b925253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.583409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.588131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02681c5-87a8-44d9-a238-b4550b925253 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.590302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02681c5-87a8-44d9-a238-b4550b925253 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.590601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02681c5-87a8-44d9-a238-b4550b925253 admin admin] PATH_INFO: `/v3/projects/485f24939ca34525a63e45e52f4d8cfa/users/73abd5e75b5e4f549e59660ee17226c4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.614793 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-167679182. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:16:35.614793 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:16:35.614793 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:35.661391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02681c5-87a8-44d9-a238-b4550b925253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485f24939ca34525a63e45e52f4d8cfa, user_id=73abd5e75b5e4f549e59660ee17226c4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.664272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02681c5-87a8-44d9-a238-b4550b925253 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.708655 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3618/7238] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:16:35 2022] POST /identity/v3/endpoints => generated 359 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:35.709661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:35.725196 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3621/7239] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:35 2022] PUT /identity/v3/projects/485f24939ca34525a63e45e52f4d8cfa/users/73abd5e75b5e4f549e59660ee17226c4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:35.725196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93792-3479-4a41-ba94-730890b3ef3d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.725196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93792-3479-4a41-ba94-730890b3ef3d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.725196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93792-3479-4a41-ba94-730890b3ef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.765820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a4e93792-3479-4a41-ba94-730890b3ef3d None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:35.770652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4e93792-3479-4a41-ba94-730890b3ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:35.784864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5bb66-0c2e-4a1d-8c1d-8cf4ccf267fb tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:35.917057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0fe1f-8908-458f-a591-b5d72bb7db85 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:35.917924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0fe1f-8908-458f-a591-b5d72bb7db85 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.918207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0fe1f-8908-458f-a591-b5d72bb7db85 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.918485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0fe1f-8908-458f-a591-b5d72bb7db85 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-167679182` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.919159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0fe1f-8908-458f-a591-b5d72bb7db85 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-167679182)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:35.920822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0fe1f-8908-458f-a591-b5d72bb7db85 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:35.934553 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3619/7240] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Feb 19 21:16:35 2022] GET /identity/v3/regions/tempest-region-167679182 => generated 178 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:35.947112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529185-b0e9-46b8-8506-278532a8edfe None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:35.947682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529185-b0e9-46b8-8506-278532a8edfe None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:35.947952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529185-b0e9-46b8-8506-278532a8edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:35.985836 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3622/7241] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3999 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:35.986754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93792-3479-4a41-ba94-730890b3ef3d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.023240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-27529185-b0e9-46b8-8506-278532a8edfe None None] MFA Rules not processed for user `73abd5e75b5e4f549e59660ee17226c4`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:36.024612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-27529185-b0e9-46b8-8506-278532a8edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:36.038072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93792-3479-4a41-ba94-730890b3ef3d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.062198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.063441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.063899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.064536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.065693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.068373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.104729 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3623/7242] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Feb 19 21:16:35 2022] GET /identity/v3/endpoints => generated 4384 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:36.106195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.118115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:36.196054 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3620/7243] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:35 2022] POST /identity/v3/auth/tokens => generated 4062 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:36.197070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529185-b0e9-46b8-8506-278532a8edfe None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.229774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529185-b0e9-46b8-8506-278532a8edfe None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.247179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.248883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.249311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.249695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints/9bfb2decf5e444b68a4ccd8e1ed58ab7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.265581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=9bfb2decf5e444b68a4ccd8e1ed58ab7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.267085 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:36.267085 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:16:36.267085 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:36.268424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.271156 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3621/7244] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:36 2022] GET /identity/v3/endpoints/9bfb2decf5e444b68a4ccd8e1ed58ab7 => generated 359 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:36.273007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.311136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3bf8-36c6-48db-a922-69b841f3bf09 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.334755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db739d-8209-4a20-a75c-a726153ad0eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.336439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db739d-8209-4a20-a75c-a726153ad0eb service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.337699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db739d-8209-4a20-a75c-a726153ad0eb service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.338041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db739d-8209-4a20-a75c-a726153ad0eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.369533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db739d-8209-4a20-a75c-a726153ad0eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.376876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db739d-8209-4a20-a75c-a726153ad0eb service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.379390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c2a0-bb3d-4980-a7db-d07b879d5b27 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.385150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe33c44-ffc7-4747-b2ea-6971584d8a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.386486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe33c44-ffc7-4747-b2ea-6971584d8a18 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.387040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe33c44-ffc7-4747-b2ea-6971584d8a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.387535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe33c44-ffc7-4747-b2ea-6971584d8a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.389139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe33c44-ffc7-4747-b2ea-6971584d8a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.391495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe33c44-ffc7-4747-b2ea-6971584d8a18 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.410597 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3624/7245] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:36.416592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db739d-8209-4a20-a75c-a726153ad0eb service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.432019 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3622/7246] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:36 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:36.443091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe33c44-ffc7-4747-b2ea-6971584d8a18 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.471518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db739d-8209-4a20-a75c-a726153ad0eb service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.698791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe33c44-ffc7-4747-b2ea-6971584d8a18 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.705661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.707302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.707883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.708462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints/9bfb2decf5e444b68a4ccd8e1ed58ab7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.711948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6420-fb10-48e8-9215-f5245530e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.713250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9bfb2decf5e444b68a4ccd8e1ed58ab7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.713692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6420-fb10-48e8-9215-f5245530e0ca admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.713984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6420-fb10-48e8-9215-f5245530e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.714263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6420-fb10-48e8-9215-f5245530e0ca admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.714962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c6420-fb10-48e8-9215-f5245530e0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.718143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c6420-fb10-48e8-9215-f5245530e0ca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.719696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.770807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9bfb2decf5e444b68a4ccd8e1ed58ab7', 'request_id': 'req-560bca2f-8956-4c8b-ba48-4746a9b72b1b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:36.780258 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3623/7247] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:36 2022] POST /identity/v3/users => generated 298 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:36.789383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6420-fb10-48e8-9215-f5245530e0ca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.802106 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3625/7248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:36 2022] DELETE /identity/v3/endpoints/9bfb2decf5e444b68a4ccd8e1ed58ab7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:36.803783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.814339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6420-fb10-48e8-9215-f5245530e0ca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.851811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39469-6d97-495c-9309-ccea0af484a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.852829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39469-6d97-495c-9309-ccea0af484a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.853558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39469-6d97-495c-9309-ccea0af484a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.854070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39469-6d97-495c-9309-ccea0af484a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.854712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed39469-6d97-495c-9309-ccea0af484a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.856536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed39469-6d97-495c-9309-ccea0af484a5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.866198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bca2f-8956-4c8b-ba48-4746a9b72b1b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.877276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1034b7-4d5a-462b-b10a-406ff0d45809 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.880033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1034b7-4d5a-462b-b10a-406ff0d45809 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.880439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1034b7-4d5a-462b-b10a-406ff0d45809 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.880800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1034b7-4d5a-462b-b10a-406ff0d45809 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.881600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1034b7-4d5a-462b-b10a-406ff0d45809 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.883318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1034b7-4d5a-462b-b10a-406ff0d45809 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.894667 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3624/7249] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:36.897660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39469-6d97-495c-9309-ccea0af484a5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.907713 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3626/7250] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Feb 19 21:16:36 2022] GET /identity/v3/endpoints => generated 4038 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:36.909243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1034b7-4d5a-462b-b10a-406ff0d45809 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:36.923266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39469-6d97-495c-9309-ccea0af484a5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.928589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1034b7-4d5a-462b-b10a-406ff0d45809 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:36.929751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50a279-9e84-4ce5-9f7b-3830b8ac946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.930872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50a279-9e84-4ce5-9f7b-3830b8ac946e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.931694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50a279-9e84-4ce5-9f7b-3830b8ac946e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.931694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50a279-9e84-4ce5-9f7b-3830b8ac946e admin admin] PATH_INFO: `/v3/projects/d6cf3472e5d648f799b6eda84d47e969/users/7e871c1804964c999047d3ddfda8d54d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.937912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e0980-25fb-4791-bfdc-37905f0391ce tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:36.938940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0980-25fb-4791-bfdc-37905f0391ce tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.939350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0980-25fb-4791-bfdc-37905f0391ce tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.939734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0980-25fb-4791-bfdc-37905f0391ce tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints/9bfb2decf5e444b68a4ccd8e1ed58ab7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.952293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e0980-25fb-4791-bfdc-37905f0391ce tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 19 21:16:36.961435 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-130e0980-25fb-4791-bfdc-37905f0391ce tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Could not find endpoint: 9bfb2decf5e444b68a4ccd8e1ed58ab7.: keystone.exception.EndpointNotFound: Could not find endpoint: 9bfb2decf5e444b68a4ccd8e1ed58ab7. Feb 19 21:16:36.968295 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3627/7251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:36 2022] DELETE /identity/v3/endpoints/9bfb2decf5e444b68a4ccd8e1ed58ab7 => generated 114 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:16:36.968295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0bbc1-c8fa-450f-b570-308ea9decb8a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:36.968295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0bbc1-c8fa-450f-b570-308ea9decb8a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:36.968295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0bbc1-c8fa-450f-b570-308ea9decb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:36.968958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50a279-9e84-4ce5-9f7b-3830b8ac946e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cf3472e5d648f799b6eda84d47e969, user_id=7e871c1804964c999047d3ddfda8d54d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:36.970364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50a279-9e84-4ce5-9f7b-3830b8ac946e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:36.992116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-25e0bbc1-c8fa-450f-b570-308ea9decb8a None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:36.993885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-25e0bbc1-c8fa-450f-b570-308ea9decb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:37.001751 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3625/7252] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:36 2022] PUT /identity/v3/projects/d6cf3472e5d648f799b6eda84d47e969/users/7e871c1804964c999047d3ddfda8d54d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:37.002696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50a279-9e84-4ce5-9f7b-3830b8ac946e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:37.120164 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3628/7253] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3816 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:37.121603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0bbc1-c8fa-450f-b570-308ea9decb8a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:37.125365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50a279-9e84-4ce5-9f7b-3830b8ac946e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:37.141423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f694f-2e6f-4acb-b1dd-b8f412d71726 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:37.143066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f694f-2e6f-4acb-b1dd-b8f412d71726 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:37.143490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f694f-2e6f-4acb-b1dd-b8f412d71726 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:37.143891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f694f-2e6f-4acb-b1dd-b8f412d71726 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-167679182` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:37.144904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f694f-2e6f-4acb-b1dd-b8f412d71726 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-167679182)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:37.146728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f694f-2e6f-4acb-b1dd-b8f412d71726 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:37.191605 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3626/7254] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Feb 19 21:16:37 2022] DELETE /identity/v3/regions/tempest-region-167679182 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:37.193065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f694f-2e6f-4acb-b1dd-b8f412d71726 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:37.282793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0bbc1-c8fa-450f-b570-308ea9decb8a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:37.348772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d5d-37d0-4e6a-9c95-574d15c36f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:37.349762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d5d-37d0-4e6a-9c95-574d15c36f92 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:37.352158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d5d-37d0-4e6a-9c95-574d15c36f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:37.352694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d5d-37d0-4e6a-9c95-574d15c36f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:37.353740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b3d5d-37d0-4e6a-9c95-574d15c36f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:37.359215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b3d5d-37d0-4e6a-9c95-574d15c36f92 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:37.396567 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3629/7255] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:37.397851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d5d-37d0-4e6a-9c95-574d15c36f92 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:37.458310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f694f-2e6f-4acb-b1dd-b8f412d71726 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:37.475197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262db598-8948-4735-9419-232004df9410 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:37.478212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262db598-8948-4735-9419-232004df9410 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:37.479832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262db598-8948-4735-9419-232004df9410 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:37.480444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262db598-8948-4735-9419-232004df9410 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:37.491177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d5d-37d0-4e6a-9c95-574d15c36f92 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:37.504286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdeafa-f25d-496b-ac71-fea172832d95 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:37.505380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdeafa-f25d-496b-ac71-fea172832d95 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:37.505917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdeafa-f25d-496b-ac71-fea172832d95 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:37.506466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdeafa-f25d-496b-ac71-fea172832d95 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:37.507418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdeafa-f25d-496b-ac71-fea172832d95 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:37.509764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdeafa-f25d-496b-ac71-fea172832d95 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:37.517327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262db598-8948-4735-9419-232004df9410 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:37.518948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262db598-8948-4735-9419-232004df9410 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:37.526287 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3630/7256] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Feb 19 21:16:37 2022] GET /identity/v3/endpoints => generated 4038 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:37.528927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdeafa-f25d-496b-ac71-fea172832d95 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:37.556416 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3627/7257] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:37.557497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262db598-8948-4735-9419-232004df9410 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:37.570622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdeafa-f25d-496b-ac71-fea172832d95 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:37.578704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17649f3-ebfd-44c5-b7f3-1385b7d9a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:37.579822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17649f3-ebfd-44c5-b7f3-1385b7d9a588 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:37.580562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17649f3-ebfd-44c5-b7f3-1385b7d9a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:37.581054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17649f3-ebfd-44c5-b7f3-1385b7d9a588 admin admin] PATH_INFO: `/v3/projects/d6cf3472e5d648f799b6eda84d47e969/users/7e871c1804964c999047d3ddfda8d54d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:37.583734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17649f3-ebfd-44c5-b7f3-1385b7d9a588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cf3472e5d648f799b6eda84d47e969, user_id=7e871c1804964c999047d3ddfda8d54d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:37.603187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262db598-8948-4735-9419-232004df9410 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:37.615127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17649f3-ebfd-44c5-b7f3-1385b7d9a588 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:37.631548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d423-be23-4077-accd-d2af75e65f8e tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:37.633013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d423-be23-4077-accd-d2af75e65f8e tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:37.633323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d423-be23-4077-accd-d2af75e65f8e tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:37.633736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d423-be23-4077-accd-d2af75e65f8e tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:37.634303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22d423-be23-4077-accd-d2af75e65f8e tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Adding query filter params (service_id=a6b126b01c0c45db8502f550a7cbcc4c) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:37.634649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22d423-be23-4077-accd-d2af75e65f8e tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:37.639141 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3631/7258] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:37 2022] PUT /identity/v3/projects/d6cf3472e5d648f799b6eda84d47e969/users/7e871c1804964c999047d3ddfda8d54d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:37.686244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22d423-be23-4077-accd-d2af75e65f8e tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:37.728662 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3628/7259] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:16:37 2022] GET /identity/v3/endpoints?service_id=a6b126b01c0c45db8502f550a7cbcc4c => generated 502 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:37.734200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17649f3-ebfd-44c5-b7f3-1385b7d9a588 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:37.754823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb7e45-06c8-4f56-bf5c-7c8790a5bbfa None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:37.755110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb7e45-06c8-4f56-bf5c-7c8790a5bbfa None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:37.755397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb7e45-06c8-4f56-bf5c-7c8790a5bbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:37.808280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3dcb7e45-06c8-4f56-bf5c-7c8790a5bbfa None None] MFA Rules not processed for user `7e871c1804964c999047d3ddfda8d54d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:37.812083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3dcb7e45-06c8-4f56-bf5c-7c8790a5bbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:37.985470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17649f3-ebfd-44c5-b7f3-1385b7d9a588 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.001837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.002532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.002826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.003280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.003853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Adding query filter params (service_id=307f5ec6b7d04efea89ecb5d1b6155f5) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:38.004166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.010147 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3629/7260] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3948 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:38.010942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.030114 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3632/7261] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:16:37 2022] GET /identity/v3/endpoints?service_id=307f5ec6b7d04efea89ecb5d1b6155f5 => generated 503 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:38.031044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb7e45-06c8-4f56-bf5c-7c8790a5bbfa None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.041674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.043797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:38.060417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb7e45-06c8-4f56-bf5c-7c8790a5bbfa None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.095192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.095971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.096264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.099048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.099845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:38.100168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.106190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.144824 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3630/7262] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Feb 19 21:16:38 2022] GET /identity/v3/endpoints?interface=public => generated 3395 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:38.149386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.186295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fee12-4851-4775-8dbd-976a23299404 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.196531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e4a4c-0f7a-4be7-b523-df9093850775 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.202254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fc255-8e81-4b23-903e-23de50c15ef8 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.203903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fc255-8e81-4b23-903e-23de50c15ef8 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.204357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fc255-8e81-4b23-903e-23de50c15ef8 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.204827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fc255-8e81-4b23-903e-23de50c15ef8 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.206014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fc255-8e81-4b23-903e-23de50c15ef8 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:38.206491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fc255-8e81-4b23-903e-23de50c15ef8 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.210475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416afe-f884-460e-929d-01fcc9d2e0c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.211303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416afe-f884-460e-929d-01fcc9d2e0c6 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.211595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416afe-f884-460e-929d-01fcc9d2e0c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.211873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416afe-f884-460e-929d-01fcc9d2e0c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.212096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fc255-8e81-4b23-903e-23de50c15ef8 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.228512 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3631/7263] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Feb 19 21:16:38 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:38.231314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b16aa7-7085-4c36-8300-9fe5961d198b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.231741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b16aa7-7085-4c36-8300-9fe5961d198b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.231910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b16aa7-7085-4c36-8300-9fe5961d198b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.271353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-83b16aa7-7085-4c36-8300-9fe5961d198b None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:38.275101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-83b16aa7-7085-4c36-8300-9fe5961d198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:38.346034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1416afe-f884-460e-929d-01fcc9d2e0c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.347431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1416afe-f884-460e-929d-01fcc9d2e0c6 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.386191 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3633/7264] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3879 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:38.387827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416afe-f884-460e-929d-01fcc9d2e0c6 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.410571 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3632/7265] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3816 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:38.411868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b16aa7-7085-4c36-8300-9fe5961d198b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.416244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416afe-f884-460e-929d-01fcc9d2e0c6 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.426168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e078b-12b2-4a4d-9b2a-196e1e8107f9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.426859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e078b-12b2-4a4d-9b2a-196e1e8107f9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.427148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e078b-12b2-4a4d-9b2a-196e1e8107f9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.427433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e078b-12b2-4a4d-9b2a-196e1e8107f9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.428167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e078b-12b2-4a4d-9b2a-196e1e8107f9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.429954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e078b-12b2-4a4d-9b2a-196e1e8107f9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.470231 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3634/7266] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:38 2022] POST /identity/v3/services => generated 289 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:38.474915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e078b-12b2-4a4d-9b2a-196e1e8107f9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.507467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b16aa7-7085-4c36-8300-9fe5961d198b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.525577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e078b-12b2-4a4d-9b2a-196e1e8107f9 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.529804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc38d97-6213-4b48-9df4-c204017bfb94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.530894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc38d97-6213-4b48-9df4-c204017bfb94 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.531364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc38d97-6213-4b48-9df4-c204017bfb94 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.532118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc38d97-6213-4b48-9df4-c204017bfb94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.546645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc38d97-6213-4b48-9df4-c204017bfb94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.550906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc38d97-6213-4b48-9df4-c204017bfb94 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.554436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.555120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.555410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.555726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.556459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.558089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.579113 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3633/7267] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:38.604602 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1657364953. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:16:38.604602 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:16:38.604602 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:16:38.650041 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3635/7268] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:16:38 2022] POST /identity/v3/endpoints => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:38.655063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc38d97-6213-4b48-9df4-c204017bfb94 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.675435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc38d97-6213-4b48-9df4-c204017bfb94 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.712714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814722-81e5-4657-ad2e-898cf3fe839d tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.713881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814722-81e5-4657-ad2e-898cf3fe839d tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.714502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814722-81e5-4657-ad2e-898cf3fe839d tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.714901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814722-81e5-4657-ad2e-898cf3fe839d tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-1657364953` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.715778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac814722-81e5-4657-ad2e-898cf3fe839d tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1657364953)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.719286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac814722-81e5-4657-ad2e-898cf3fe839d tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.730791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.738538 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3634/7269] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Feb 19 21:16:38 2022] GET /identity/v3/regions/tempest-region-1657364953 => generated 180 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:38.744483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342be322-3028-4616-ac6c-3bb6f8a686f1 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.757553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.758506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.758863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.759197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints/ce869ba73f0945b28cfb5989d38286e3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.774331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=ce869ba73f0945b28cfb5989d38286e3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.776408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.825367 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-904969463. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:16:38.825367 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:16:38.825367 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:16:38.913423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814722-81e5-4657-ad2e-898cf3fe839d tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.920321 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3636/7270] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 21:16:38 2022] PATCH /identity/v3/endpoints/ce869ba73f0945b28cfb5989d38286e3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:38.929792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814722-81e5-4657-ad2e-898cf3fe839d tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:38.956584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3240a1-18fb-4a97-b309-e1faa8b08ca4 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:38.957635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3240a1-18fb-4a97-b309-e1faa8b08ca4 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:38.958040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3240a1-18fb-4a97-b309-e1faa8b08ca4 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:38.958233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3240a1-18fb-4a97-b309-e1faa8b08ca4 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-904969463` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:38.958862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3240a1-18fb-4a97-b309-e1faa8b08ca4 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-904969463)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:38.962824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3240a1-18fb-4a97-b309-e1faa8b08ca4 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:38.975619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:38.977415 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3635/7271] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Feb 19 21:16:38 2022] GET /identity/v3/regions/tempest-region-904969463 => generated 178 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:38.996630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf307-fd81-4130-b22e-f13b88545abd tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:39.012914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:39.014821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:39.015377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:39.015944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints/ce869ba73f0945b28cfb5989d38286e3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:39.031463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ce869ba73f0945b28cfb5989d38286e3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:39.033265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:39.052872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ce869ba73f0945b28cfb5989d38286e3', 'request_id': 'req-a895a659-080a-486c-b19a-c27bab1bbc5b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:39.081558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3240a1-18fb-4a97-b309-e1faa8b08ca4 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:39.082657 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3637/7272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:38 2022] DELETE /identity/v3/endpoints/ce869ba73f0945b28cfb5989d38286e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:39.109522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3240a1-18fb-4a97-b309-e1faa8b08ca4 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:39.174723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253485-3777-40a0-a85d-5f0f67bf3438 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:39.176205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253485-3777-40a0-a85d-5f0f67bf3438 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:39.177818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253485-3777-40a0-a85d-5f0f67bf3438 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:39.178122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253485-3777-40a0-a85d-5f0f67bf3438 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-904969463` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:39.179991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b253485-3777-40a0-a85d-5f0f67bf3438 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-904969463)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:39.186049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b253485-3777-40a0-a85d-5f0f67bf3438 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:39.217783 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-9b253485-3777-40a0-a85d-5f0f67bf3438 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-904969463. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:16:39.217783 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:16:39.217783 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:39.228440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3636/7273] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Feb 19 21:16:39 2022] DELETE /identity/v3/regions/tempest-region-904969463 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:39.231846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:39.263456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08199-95fc-44a6-b0e7-e80876074970 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:39.264376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08199-95fc-44a6-b0e7-e80876074970 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:39.264684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08199-95fc-44a6-b0e7-e80876074970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:39.272856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895a659-080a-486c-b19a-c27bab1bbc5b tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:39.313905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-32f08199-95fc-44a6-b0e7-e80876074970 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:39.315186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-32f08199-95fc-44a6-b0e7-e80876074970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:39.317537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660642f-7d9d-4ac0-84b3-3a868c45fb91 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:39.318398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660642f-7d9d-4ac0-84b3-3a868c45fb91 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:39.318687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660642f-7d9d-4ac0-84b3-3a868c45fb91 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:39.318966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660642f-7d9d-4ac0-84b3-3a868c45fb91 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-1657364953` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:39.319620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660642f-7d9d-4ac0-84b3-3a868c45fb91 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1657364953)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:39.321480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660642f-7d9d-4ac0-84b3-3a868c45fb91 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:39.400229 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3638/7274] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 21:16:39 2022] DELETE /identity/v3/regions/tempest-region-1657364953 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:39.407027 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3637/7275] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3949 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:39.408252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660642f-7d9d-4ac0-84b3-3a868c45fb91 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:39.417127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f08199-95fc-44a6-b0e7-e80876074970 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:39.499429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660642f-7d9d-4ac0-84b3-3a868c45fb91 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:39.515141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f8852-d743-405c-b4d4-30f2eb6d9186 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:39.515824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f08199-95fc-44a6-b0e7-e80876074970 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:39.519310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f8852-d743-405c-b4d4-30f2eb6d9186 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:39.519602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f8852-d743-405c-b4d4-30f2eb6d9186 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:39.523153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f8852-d743-405c-b4d4-30f2eb6d9186 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/services/a4489e721a7245b39c02335a746267c2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:39.527759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f8852-d743-405c-b4d4-30f2eb6d9186 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a4489e721a7245b39c02335a746267c2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:39.531211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f8852-d743-405c-b4d4-30f2eb6d9186 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:39.598747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc31294-841d-44f0-83e3-96b894d52f2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:39.600116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc31294-841d-44f0-83e3-96b894d52f2e service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:39.600454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc31294-841d-44f0-83e3-96b894d52f2e service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:39.601977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc31294-841d-44f0-83e3-96b894d52f2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:39.643639 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3639/7276] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:39 2022] DELETE /identity/v3/services/a4489e721a7245b39c02335a746267c2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:39.646128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f8852-d743-405c-b4d4-30f2eb6d9186 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:39.653689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc31294-841d-44f0-83e3-96b894d52f2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:39.656550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc31294-841d-44f0-83e3-96b894d52f2e service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:39.711677 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3638/7277] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:16:39.741106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f8852-d743-405c-b4d4-30f2eb6d9186 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:39.771049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:39.773821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:39.774618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:39.775328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints/9f02b603711b4004bf1a716736ce8048` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:39.799916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9f02b603711b4004bf1a716736ce8048)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:39.804029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:39.835756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9f02b603711b4004bf1a716736ce8048', 'request_id': 'req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:39.889414 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3640/7278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:39 2022] DELETE /identity/v3/endpoints/9f02b603711b4004bf1a716736ce8048 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:39.890735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc31294-841d-44f0-83e3-96b894d52f2e service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:39.912739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc31294-841d-44f0-83e3-96b894d52f2e service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:39.943761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e23c8-3bf1-4b35-8152-1c749b396f5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:39.945226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e23c8-3bf1-4b35-8152-1c749b396f5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:39.946223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e23c8-3bf1-4b35-8152-1c749b396f5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:39.946511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e23c8-3bf1-4b35-8152-1c749b396f5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-985729895` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:39.948698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e23c8-3bf1-4b35-8152-1c749b396f5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-985729895)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:39.955520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e23c8-3bf1-4b35-8152-1c749b396f5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:40.016980 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3639/7279] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Feb 19 21:16:39 2022] DELETE /identity/v3/regions/tempest-region-985729895 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:40.021801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:40.037189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7af5-ce30-4db7-8ca9-5069ddabb20a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:40.061325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6882c80-a1bb-486d-8718-35bd6745285a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:40.062096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6882c80-a1bb-486d-8718-35bd6745285a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.062440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6882c80-a1bb-486d-8718-35bd6745285a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.062718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6882c80-a1bb-486d-8718-35bd6745285a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/services/307f5ec6b7d04efea89ecb5d1b6155f5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.063983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6882c80-a1bb-486d-8718-35bd6745285a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_service(service_id=307f5ec6b7d04efea89ecb5d1b6155f5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:40.066167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6882c80-a1bb-486d-8718-35bd6745285a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:40.114577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e23c8-3bf1-4b35-8152-1c749b396f5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:40.126469 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3641/7280] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:40 2022] DELETE /identity/v3/services/307f5ec6b7d04efea89ecb5d1b6155f5 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:40.128821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e23c8-3bf1-4b35-8152-1c749b396f5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:40.160068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa2673-0a2e-4474-8246-1f3cd38d9c5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:40.161685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2673-0a2e-4474-8246-1f3cd38d9c5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.162167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2673-0a2e-4474-8246-1f3cd38d9c5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.162652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2673-0a2e-4474-8246-1f3cd38d9c5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/endpoints/4919a19ed2c74187a6454dc351af66f9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.172936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa2673-0a2e-4474-8246-1f3cd38d9c5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4919a19ed2c74187a6454dc351af66f9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:40.175076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa2673-0a2e-4474-8246-1f3cd38d9c5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:40.189374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-08fa2673-0a2e-4474-8246-1f3cd38d9c5c tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4919a19ed2c74187a6454dc351af66f9', 'request_id': 'req-08fa2673-0a2e-4474-8246-1f3cd38d9c5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:40.212817 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3640/7281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:40 2022] DELETE /identity/v3/endpoints/4919a19ed2c74187a6454dc351af66f9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:40.215147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6882c80-a1bb-486d-8718-35bd6745285a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:40.225138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a49f-266d-4793-8e19-c942ddb16ba1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.225411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a49f-266d-4793-8e19-c942ddb16ba1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.225791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a49f-266d-4793-8e19-c942ddb16ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.228202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6882c80-a1bb-486d-8718-35bd6745285a tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:40.245433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:40.245590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f5f2a49f-266d-4793-8e19-c942ddb16ba1 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:40.246584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.246702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f5f2a49f-266d-4793-8e19-c942ddb16ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:40.247112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.247650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/regions/tempest-region-1027509513` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.249155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1027509513)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:40.251286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:40.270736 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3641/7282] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:40.271815 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1027509513. To ensure interoperability, identifiers should be a valid uuid. Feb 19 21:16:40.271815 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Feb 19 21:16:40.271815 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:16:40.280621 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3642/7283] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 21:16:40 2022] DELETE /identity/v3/regions/tempest-region-1027509513 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:40.286694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:40.287033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2a49f-266d-4793-8e19-c942ddb16ba1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:40.305100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2a49f-266d-4793-8e19-c942ddb16ba1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:40.318278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2444-34e1-46ac-a24c-a4816392b857 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:40.329544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6cb5989865146a2bfdf253019d10082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13496872377f472b86ae6901f017bc3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:40.330408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.330628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d264be6-e63e-4300-858d-a25a70b4f5b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:40.330804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.331058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] PATH_INFO: `/v3/services/a6b126b01c0c45db8502f550a7cbcc4c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.331720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a6b126b01c0c45db8502f550a7cbcc4c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:40.333281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d264be6-e63e-4300-858d-a25a70b4f5b8 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.333785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:40.334494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d264be6-e63e-4300-858d-a25a70b4f5b8 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.335191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d264be6-e63e-4300-858d-a25a70b4f5b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.350037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d264be6-e63e-4300-858d-a25a70b4f5b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:40.352822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d264be6-e63e-4300-858d-a25a70b4f5b8 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:40.358655 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3642/7284] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:40 2022] DELETE /identity/v3/services/a6b126b01c0c45db8502f550a7cbcc4c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:40.363017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:40.365433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:40.368816 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3643/7285] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:16:40.612306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4892b-4b80-4727-ab08-cae8d1cb8167 tempest-EndPointsTestJSON-1920172116 tempest-EndPointsTestJSON-1920172116-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:40.631366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:40.635035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.635340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.635628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] PATH_INFO: `/v3/users/bddc87f8705745ed8cf2c687a51a5fc5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.639551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bddc87f8705745ed8cf2c687a51a5fc5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:40.644869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:40.793366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bddc87f8705745ed8cf2c687a51a5fc5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:40.794080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bddc87f8705745ed8cf2c687a51a5fc5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:40.796619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bddc87f8705745ed8cf2c687a51a5fc5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:40.822688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bddc87f8705745ed8cf2c687a51a5fc5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:40.851782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a200df46-0e33-418c-8170-772379819da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bddc87f8705745ed8cf2c687a51a5fc5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:40.883687 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3643/7286] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:40 2022] DELETE /identity/v3/users/bddc87f8705745ed8cf2c687a51a5fc5 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:40.886103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18731-9f1a-4387-80cb-6acccc9a5199 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.886607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18731-9f1a-4387-80cb-6acccc9a5199 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.886716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18731-9f1a-4387-80cb-6acccc9a5199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.919244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64f9e-83e3-4984-9116-0680087c714a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:40.920536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64f9e-83e3-4984-9116-0680087c714a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:40.921214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64f9e-83e3-4984-9116-0680087c714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:40.934207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-80a18731-9f1a-4387-80cb-6acccc9a5199 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:40.937450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-80a18731-9f1a-4387-80cb-6acccc9a5199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:40.949100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3ed64f9e-83e3-4984-9116-0680087c714a None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:40.950543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3ed64f9e-83e3-4984-9116-0680087c714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:41.054409 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3644/7287] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:41.065661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a18731-9f1a-4387-80cb-6acccc9a5199 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:41.068698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-80a18731-9f1a-4387-80cb-6acccc9a5199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:41.103920 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3644/7288] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:41.121511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64f9e-83e3-4984-9116-0680087c714a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:41.124300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3ed64f9e-83e3-4984-9116-0680087c714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:41.235444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a18731-9f1a-4387-80cb-6acccc9a5199 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:41.244008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:41.244809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:41.245098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:41.245382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:41.265928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:41.267681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:41.275096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64f9e-83e3-4984-9116-0680087c714a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:41.282566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8daaa1-09a3-4c30-933f-8764d959fbbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:41.283390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8daaa1-09a3-4c30-933f-8764d959fbbd service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:41.284200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8daaa1-09a3-4c30-933f-8764d959fbbd service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:41.285392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8daaa1-09a3-4c30-933f-8764d959fbbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:41.290328 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3645/7289] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:16:41.303258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8daaa1-09a3-4c30-933f-8764d959fbbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:41.306759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8daaa1-09a3-4c30-933f-8764d959fbbd service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:41.320750 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3645/7290] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:41.933461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:41.934984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:41.963416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2c6b-1488-4719-a102-4074f3d8419a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:41.977287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:41.977923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:41.978209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:41.978671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] PATH_INFO: `/v3/projects/741b4d089111491bb927fa8b49ba36a0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:41.985248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] RBAC: Authorizing `identity:delete_project(project_id=741b4d089111491bb927fa8b49ba36a0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:41.987213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:42.133988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741b4d089111491bb927fa8b49ba36a0', 'request_id': 'req-e60f654f-f95b-444c-a4e0-acb4d4d0104c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.142061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741b4d089111491bb927fa8b49ba36a0', 'request_id': 'req-e60f654f-f95b-444c-a4e0-acb4d4d0104c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.154027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741b4d089111491bb927fa8b49ba36a0', 'request_id': 'req-e60f654f-f95b-444c-a4e0-acb4d4d0104c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.181253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] The token cache is being invalidate because project 741b4d089111491bb927fa8b49ba36a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:42.181556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.182619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e60f654f-f95b-444c-a4e0-acb4d4d0104c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.184692 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3646/7291] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:41 2022] DELETE /identity/v3/projects/741b4d089111491bb927fa8b49ba36a0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:42.189384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8daaa1-09a3-4c30-933f-8764d959fbbd service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:42.203576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8daaa1-09a3-4c30-933f-8764d959fbbd service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:42.358076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:42.359266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:42.359757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:42.360214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] PATH_INFO: `/v3/users/c6cb5989865146a2bfdf253019d10082` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:42.362909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cb5989865146a2bfdf253019d10082)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:42.365062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:42.464672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cb5989865146a2bfdf253019d10082'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.467551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cb5989865146a2bfdf253019d10082'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.468491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cb5989865146a2bfdf253019d10082'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.486404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cb5989865146a2bfdf253019d10082'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.501655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cb5989865146a2bfdf253019d10082'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:42.539392 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3646/7292] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:42 2022] DELETE /identity/v3/users/c6cb5989865146a2bfdf253019d10082 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:42.978548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384414-905c-4598-b860-34d36b4e4755 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:42.979630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384414-905c-4598-b860-34d36b4e4755 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:42.979923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384414-905c-4598-b860-34d36b4e4755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:43.002300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-be384414-905c-4598-b860-34d36b4e4755 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:43.003565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-be384414-905c-4598-b860-34d36b4e4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:43.090368 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3647/7293] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:16:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:43.106468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:43.108064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:43.199124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be384414-905c-4598-b860-34d36b4e4755 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:43.200656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-be384414-905c-4598-b860-34d36b4e4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:43.229413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5b390-a472-45e6-b62a-0497ad602218 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:43.237918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e850cdd-4df3-47b1-a024-b6817c032163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:43.245549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850cdd-4df3-47b1-a024-b6817c032163 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:43.246431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850cdd-4df3-47b1-a024-b6817c032163 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:43.247462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850cdd-4df3-47b1-a024-b6817c032163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:43.262595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e850cdd-4df3-47b1-a024-b6817c032163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:43.265086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e850cdd-4df3-47b1-a024-b6817c032163 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:43.279238 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3647/7294] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:16:43.334435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be384414-905c-4598-b860-34d36b4e4755 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:43.345341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:43.346531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:43.346936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:43.347086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] PATH_INFO: `/v3/projects/13496872377f472b86ae6901f017bc3d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:43.349058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=13496872377f472b86ae6901f017bc3d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:43.353312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:43.573450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13496872377f472b86ae6901f017bc3d', 'request_id': 'req-67974e85-331b-4d4a-a6fc-850edadfe9bb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:43.595174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13496872377f472b86ae6901f017bc3d', 'request_id': 'req-67974e85-331b-4d4a-a6fc-850edadfe9bb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:43.607000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13496872377f472b86ae6901f017bc3d', 'request_id': 'req-67974e85-331b-4d4a-a6fc-850edadfe9bb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:43.614843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b0e3-2872-4f6c-9d07-4b74ce56319f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:43.615805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b0e3-2872-4f6c-9d07-4b74ce56319f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:43.616323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b0e3-2872-4f6c-9d07-4b74ce56319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:43.643580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a440b0e3-2872-4f6c-9d07-4b74ce56319f None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:43.644909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a440b0e3-2872-4f6c-9d07-4b74ce56319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:43.648033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] The token cache is being invalidate because project 13496872377f472b86ae6901f017bc3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:43.648694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:43.649267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67974e85-331b-4d4a-a6fc-850edadfe9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:43.651764 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3648/7295] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:43 2022] DELETE /identity/v3/projects/13496872377f472b86ae6901f017bc3d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:43.658338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df20abd-e237-4756-9f33-03f2499d00ab None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:43.659052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df20abd-e237-4756-9f33-03f2499d00ab None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:43.660931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df20abd-e237-4756-9f33-03f2499d00ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:43.692115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8df20abd-e237-4756-9f33-03f2499d00ab None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:43.694645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8df20abd-e237-4756-9f33-03f2499d00ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:43.803657 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3648/7296] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:43.812531 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3649/7297] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:43.813576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440b0e3-2872-4f6c-9d07-4b74ce56319f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:43.814991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a440b0e3-2872-4f6c-9d07-4b74ce56319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:43.822302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927d0a-00e4-44ad-b19f-2c0215996463 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:43.823292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927d0a-00e4-44ad-b19f-2c0215996463 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:43.823893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927d0a-00e4-44ad-b19f-2c0215996463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:43.867153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-eb927d0a-00e4-44ad-b19f-2c0215996463 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:43.869985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eb927d0a-00e4-44ad-b19f-2c0215996463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:43.920291 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3650/7298] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:43.930249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927d0a-00e4-44ad-b19f-2c0215996463 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:43.954687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440b0e3-2872-4f6c-9d07-4b74ce56319f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:43.965311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef79fb2-c966-4b90-8ee9-ce4397477e2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:43.967649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79fb2-c966-4b90-8ee9-ce4397477e2b service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:43.968168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79fb2-c966-4b90-8ee9-ce4397477e2b service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:43.968566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79fb2-c966-4b90-8ee9-ce4397477e2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:43.981565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927d0a-00e4-44ad-b19f-2c0215996463 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:43.989194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:43.989432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef79fb2-c966-4b90-8ee9-ce4397477e2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:43.990908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef79fb2-c966-4b90-8ee9-ce4397477e2b service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:43.991390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:43.992635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:43.992635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:43.993404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:44.004122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:44.005787 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3649/7299] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:44.017284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:44.051900 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3651/7300] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:44.058060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef79fb2-c966-4b90-8ee9-ce4397477e2b service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:44.082569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef79fb2-c966-4b90-8ee9-ce4397477e2b service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:44.093491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066bdd1-1f8b-46ea-8527-81d3c0f8946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:44.098848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066bdd1-1f8b-46ea-8527-81d3c0f8946a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:44.105000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066bdd1-1f8b-46ea-8527-81d3c0f8946a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:44.106121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066bdd1-1f8b-46ea-8527-81d3c0f8946a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:44.108322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066bdd1-1f8b-46ea-8527-81d3c0f8946a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:44.114828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066bdd1-1f8b-46ea-8527-81d3c0f8946a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:44.177221 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3650/7301] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:44 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:44.182038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:44.215441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e364df2-29e2-4e13-8cd1-edcfd125c1b1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:44.295881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e946f-0b2a-46f8-80ff-e180131e6d88 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:44.296572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e946f-0b2a-46f8-80ff-e180131e6d88 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:44.297289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e946f-0b2a-46f8-80ff-e180131e6d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:44.351879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d45e946f-0b2a-46f8-80ff-e180131e6d88 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:44.354013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d45e946f-0b2a-46f8-80ff-e180131e6d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:44.372125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a926529-1a2a-4162-b0cd-132a12738359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:44.374511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a926529-1a2a-4162-b0cd-132a12738359 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:44.374828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a926529-1a2a-4162-b0cd-132a12738359 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:44.375114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a926529-1a2a-4162-b0cd-132a12738359 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:44.376091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a926529-1a2a-4162-b0cd-132a12738359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:44.381399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a926529-1a2a-4162-b0cd-132a12738359 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:44.434632 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3652/7302] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:44 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:44.437607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a926529-1a2a-4162-b0cd-132a12738359 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:44.454896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a926529-1a2a-4162-b0cd-132a12738359 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:44.466802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bf580-9a56-429c-94b6-27fb324708e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:44.468242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bf580-9a56-429c-94b6-27fb324708e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:44.469485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bf580-9a56-429c-94b6-27fb324708e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:44.470010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bf580-9a56-429c-94b6-27fb324708e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:44.472403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bf580-9a56-429c-94b6-27fb324708e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:44.474338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bf580-9a56-429c-94b6-27fb324708e1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:44.489841 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3651/7303] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:44.493216 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3653/7304] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:16:44.494110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e946f-0b2a-46f8-80ff-e180131e6d88 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:44.504044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bf580-9a56-429c-94b6-27fb324708e1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:44.521604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e946f-0b2a-46f8-80ff-e180131e6d88 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:44.531173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72b283-0c28-4b47-9457-4d93ca66cdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:44.532156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b283-0c28-4b47-9457-4d93ca66cdbd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:44.532745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b283-0c28-4b47-9457-4d93ca66cdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:44.533217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b283-0c28-4b47-9457-4d93ca66cdbd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:44.534164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72b283-0c28-4b47-9457-4d93ca66cdbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:44.535960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72b283-0c28-4b47-9457-4d93ca66cdbd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:44.561898 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3652/7305] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:44.566224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72b283-0c28-4b47-9457-4d93ca66cdbd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:44.586468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72b283-0c28-4b47-9457-4d93ca66cdbd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:44.599885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cda540-7aa7-402e-9272-59d51a2c6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:44.602622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cda540-7aa7-402e-9272-59d51a2c6a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:44.604221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cda540-7aa7-402e-9272-59d51a2c6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:44.604571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cda540-7aa7-402e-9272-59d51a2c6a92 admin admin] PATH_INFO: `/v3/projects/7c0f2ec06be24ce68c9af779d2944823/users/60726c44a0874e5ca5489b4eab75e4df/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:44.644969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cda540-7aa7-402e-9272-59d51a2c6a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0f2ec06be24ce68c9af779d2944823, user_id=60726c44a0874e5ca5489b4eab75e4df, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:44.649379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cda540-7aa7-402e-9272-59d51a2c6a92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:44.691621 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3653/7306] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:44 2022] PUT /identity/v3/projects/7c0f2ec06be24ce68c9af779d2944823/users/60726c44a0874e5ca5489b4eab75e4df/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:44.694086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee15-03a0-463e-9eec-d58e6e5fba48 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:44.694448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee15-03a0-463e-9eec-d58e6e5fba48 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:44.694763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee15-03a0-463e-9eec-d58e6e5fba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:44.718877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bf580-9a56-429c-94b6-27fb324708e1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:44.755638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ce70ee15-03a0-463e-9eec-d58e6e5fba48 None None] MFA Rules not processed for user `60726c44a0874e5ca5489b4eab75e4df`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:44.757098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ce70ee15-03a0-463e-9eec-d58e6e5fba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:44.886993 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3654/7307] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:44.888555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ee15-03a0-463e-9eec-d58e6e5fba48 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:44.985486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009f38-1496-4029-b491-4b54e2d1fcea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:44.988119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009f38-1496-4029-b491-4b54e2d1fcea service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:44.988624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009f38-1496-4029-b491-4b54e2d1fcea service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:44.991051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009f38-1496-4029-b491-4b54e2d1fcea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:45.113319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ee15-03a0-463e-9eec-d58e6e5fba48 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:45.128379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:45.130378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:45.134801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:45.139329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:45.141595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:45.145456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:45.198226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009f38-1496-4029-b491-4b54e2d1fcea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:45.203896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009f38-1496-4029-b491-4b54e2d1fcea service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:45.228450 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3654/7308] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:45.271395 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3655/7309] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:44 2022] POST /identity/v3/projects => generated 369 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:45.276150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009f38-1496-4029-b491-4b54e2d1fcea service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:45.291656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:45.294404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009f38-1496-4029-b491-4b54e2d1fcea service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:45.296545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:45.442610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08f229-db5b-4fbf-91b2-dd100a6aa47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:45.443314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f229-db5b-4fbf-91b2-dd100a6aa47b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:45.443593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f229-db5b-4fbf-91b2-dd100a6aa47b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:45.443875 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f229-db5b-4fbf-91b2-dd100a6aa47b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:45.445180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08f229-db5b-4fbf-91b2-dd100a6aa47b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:45.447160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08f229-db5b-4fbf-91b2-dd100a6aa47b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:45.495557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3655/7310] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:45 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:45.498551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08f229-db5b-4fbf-91b2-dd100a6aa47b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:45.502337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdc206-11c3-4edb-b64b-be168309a242 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:45.518873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:45.519863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:45.520298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:45.520859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:45.524731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:45.552762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08f229-db5b-4fbf-91b2-dd100a6aa47b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:45.574556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f59cb-50e1-4fa9-816e-eb89c8006121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:45.583982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f59cb-50e1-4fa9-816e-eb89c8006121 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:45.585572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f59cb-50e1-4fa9-816e-eb89c8006121 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:45.586634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f59cb-50e1-4fa9-816e-eb89c8006121 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:45.587844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f59cb-50e1-4fa9-816e-eb89c8006121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:45.590956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f59cb-50e1-4fa9-816e-eb89c8006121 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:45.615672 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3656/7311] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:45.621620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fda7f-b8f0-498f-aff1-f8e74a361531 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:45.622489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fda7f-b8f0-498f-aff1-f8e74a361531 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:45.622489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fda7f-b8f0-498f-aff1-f8e74a361531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:45.687844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ea4fda7f-b8f0-498f-aff1-f8e74a361531 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:45.689952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ea4fda7f-b8f0-498f-aff1-f8e74a361531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:45.706350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:45.708966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:45.738905 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3656/7312] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:45.740229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:45.764150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eb860-2fb8-44e5-a858-829353c93e07 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:45.794351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589dcd4-a57e-4b26-9bc6-2f711f418c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:45.796103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589dcd4-a57e-4b26-9bc6-2f711f418c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:45.796408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589dcd4-a57e-4b26-9bc6-2f711f418c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:45.796833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589dcd4-a57e-4b26-9bc6-2f711f418c4f admin admin] PATH_INFO: `/v3/projects/537683a2986e459ca216d05484372839/users/35fc0ead28d4464f81033c96d3fcc550/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:45.841499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589dcd4-a57e-4b26-9bc6-2f711f418c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=537683a2986e459ca216d05484372839, user_id=35fc0ead28d4464f81033c96d3fcc550, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:45.847367 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3657/7313] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:45.847660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589dcd4-a57e-4b26-9bc6-2f711f418c4f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:45.871445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fda7f-b8f0-498f-aff1-f8e74a361531 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:45.877731 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3657/7314] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:45 2022] PUT /identity/v3/projects/537683a2986e459ca216d05484372839/users/35fc0ead28d4464f81033c96d3fcc550/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:45.882067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589dcd4-a57e-4b26-9bc6-2f711f418c4f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:46.070198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589dcd4-a57e-4b26-9bc6-2f711f418c4f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:46.092590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45951006-bf6e-465c-b999-0f9a577d5e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:46.093428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45951006-bf6e-465c-b999-0f9a577d5e84 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:46.093751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45951006-bf6e-465c-b999-0f9a577d5e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:46.093983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45951006-bf6e-465c-b999-0f9a577d5e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:46.097890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45951006-bf6e-465c-b999-0f9a577d5e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:46.103803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45951006-bf6e-465c-b999-0f9a577d5e84 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:46.107978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fda7f-b8f0-498f-aff1-f8e74a361531 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:46.132196 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3658/7315] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:46.138167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45951006-bf6e-465c-b999-0f9a577d5e84 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:46.155351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45951006-bf6e-465c-b999-0f9a577d5e84 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:46.177795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07ecb-e101-4d2f-b328-41c3a63ec3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:46.178749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07ecb-e101-4d2f-b328-41c3a63ec3df admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:46.179033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07ecb-e101-4d2f-b328-41c3a63ec3df admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:46.179311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07ecb-e101-4d2f-b328-41c3a63ec3df admin admin] PATH_INFO: `/v3/projects/537683a2986e459ca216d05484372839/users/35fc0ead28d4464f81033c96d3fcc550/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:46.184663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c07ecb-e101-4d2f-b328-41c3a63ec3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=537683a2986e459ca216d05484372839, user_id=35fc0ead28d4464f81033c96d3fcc550, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:46.190954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c07ecb-e101-4d2f-b328-41c3a63ec3df admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:46.219668 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3659/7316] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:46 2022] PUT /identity/v3/projects/537683a2986e459ca216d05484372839/users/35fc0ead28d4464f81033c96d3fcc550/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:46.312695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276d532-4f9b-49ca-b3db-ad98156aea5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:46.313785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276d532-4f9b-49ca-b3db-ad98156aea5a service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:46.314554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276d532-4f9b-49ca-b3db-ad98156aea5a service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:46.315245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276d532-4f9b-49ca-b3db-ad98156aea5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:46.333657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004a34-a234-4dab-a7d2-65cf406f2efc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:46.334325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004a34-a234-4dab-a7d2-65cf406f2efc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:46.334325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004a34-a234-4dab-a7d2-65cf406f2efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:46.415036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5f004a34-a234-4dab-a7d2-65cf406f2efc None None] MFA Rules not processed for user `35fc0ead28d4464f81033c96d3fcc550`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:46.416742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5f004a34-a234-4dab-a7d2-65cf406f2efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:46.510157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276d532-4f9b-49ca-b3db-ad98156aea5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:46.514945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276d532-4f9b-49ca-b3db-ad98156aea5a service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:46.531642 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3658/7317] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:46.564501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276d532-4f9b-49ca-b3db-ad98156aea5a service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:46.567387 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3660/7318] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:46.679281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276d532-4f9b-49ca-b3db-ad98156aea5a service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:46.693087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e8ae-4384-4000-bdf5-19adbc799c29 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:46.694136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e8ae-4384-4000-bdf5-19adbc799c29 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:46.695734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e8ae-4384-4000-bdf5-19adbc799c29 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:46.696144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e8ae-4384-4000-bdf5-19adbc799c29 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:46.698695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70e8ae-4384-4000-bdf5-19adbc799c29 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:46.702421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70e8ae-4384-4000-bdf5-19adbc799c29 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:46.777379 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3659/7319] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:16:46 2022] POST /identity/v3/projects => generated 328 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:46.781674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004a34-a234-4dab-a7d2-65cf406f2efc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:46.798029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c43dd-6190-4d51-8349-b1bcb1208c06 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:46.798336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c43dd-6190-4d51-8349-b1bcb1208c06 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:46.798620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c43dd-6190-4d51-8349-b1bcb1208c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:46.799050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004a34-a234-4dab-a7d2-65cf406f2efc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:46.825708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-271c43dd-6190-4d51-8349-b1bcb1208c06 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:46.827689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-271c43dd-6190-4d51-8349-b1bcb1208c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:46.872421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ea24-d76d-475f-b082-52e16b5315c6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:46.873733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ea24-d76d-475f-b082-52e16b5315c6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:46.874246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ea24-d76d-475f-b082-52e16b5315c6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:46.874740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ea24-d76d-475f-b082-52e16b5315c6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:46.875675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198ea24-d76d-475f-b082-52e16b5315c6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:46.877883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198ea24-d76d-475f-b082-52e16b5315c6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:46.912724 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3661/7320] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:46 2022] POST /identity/v3/users => generated 416 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:46.918202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ea24-d76d-475f-b082-52e16b5315c6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:46.939080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ea24-d76d-475f-b082-52e16b5315c6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:46.949494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34abcd6-cbb0-413a-8154-235d466c901d tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:46.950495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34abcd6-cbb0-413a-8154-235d466c901d tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:46.951724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34abcd6-cbb0-413a-8154-235d466c901d tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:46.952262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34abcd6-cbb0-413a-8154-235d466c901d tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:46.952866 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3660/7321] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:46.954012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34abcd6-cbb0-413a-8154-235d466c901d tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:46.956213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34abcd6-cbb0-413a-8154-235d466c901d tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:46.972827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c43dd-6190-4d51-8349-b1bcb1208c06 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:47.010940 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3662/7322] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:16:46 2022] POST /identity/v3/roles => generated 244 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:47.011893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34abcd6-cbb0-413a-8154-235d466c901d tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:47.028573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34abcd6-cbb0-413a-8154-235d466c901d tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:47.037179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9faa-f39b-45a8-a77e-9d82ab29ccbc tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:47.038115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9faa-f39b-45a8-a77e-9d82ab29ccbc tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:47.038871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9faa-f39b-45a8-a77e-9d82ab29ccbc tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:47.039314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9faa-f39b-45a8-a77e-9d82ab29ccbc tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:47.040245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9faa-f39b-45a8-a77e-9d82ab29ccbc tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:47.043812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9faa-f39b-45a8-a77e-9d82ab29ccbc tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:47.070757 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3663/7323] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:16:47 2022] POST /identity/v3/roles => generated 246 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:47.080520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9faa-f39b-45a8-a77e-9d82ab29ccbc tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:47.104063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9faa-f39b-45a8-a77e-9d82ab29ccbc tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:47.112959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831caa-a31e-4d96-aeff-33c7b268c661 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:47.114752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831caa-a31e-4d96-aeff-33c7b268c661 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:47.115210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831caa-a31e-4d96-aeff-33c7b268c661 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:47.115663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831caa-a31e-4d96-aeff-33c7b268c661 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/28237b8b7fbf49b7a0a652f18987a218/users/09ac0db7ed2e4407a2c5fb57b87a07db/roles/3788eeb766d64b0fb4a8f4eca5a4434c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:47.135600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e831caa-a31e-4d96-aeff-33c7b268c661 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=28237b8b7fbf49b7a0a652f18987a218, user_id=09ac0db7ed2e4407a2c5fb57b87a07db, role_id=3788eeb766d64b0fb4a8f4eca5a4434c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:47.141040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e831caa-a31e-4d96-aeff-33c7b268c661 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:47.163150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c43dd-6190-4d51-8349-b1bcb1208c06 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:47.177268 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3664/7324] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:47 2022] PUT /identity/v3/projects/28237b8b7fbf49b7a0a652f18987a218/users/09ac0db7ed2e4407a2c5fb57b87a07db/roles/3788eeb766d64b0fb4a8f4eca5a4434c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:47.178417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831caa-a31e-4d96-aeff-33c7b268c661 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:47.270213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48569b7-f542-4a8d-80b3-dd0468089c62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:47.271077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48569b7-f542-4a8d-80b3-dd0468089c62 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:47.271516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48569b7-f542-4a8d-80b3-dd0468089c62 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:47.271825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48569b7-f542-4a8d-80b3-dd0468089c62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:47.383767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831caa-a31e-4d96-aeff-33c7b268c661 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:47.416277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ffc95-0fec-49f1-ba42-f170da0680a4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:47.417517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ffc95-0fec-49f1-ba42-f170da0680a4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:47.417950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ffc95-0fec-49f1-ba42-f170da0680a4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:47.418861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ffc95-0fec-49f1-ba42-f170da0680a4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/28237b8b7fbf49b7a0a652f18987a218/users/09ac0db7ed2e4407a2c5fb57b87a07db/roles/d014b87f7e134065b8dbab7cd506b3fe` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:47.431268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ffc95-0fec-49f1-ba42-f170da0680a4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=28237b8b7fbf49b7a0a652f18987a218, user_id=09ac0db7ed2e4407a2c5fb57b87a07db, role_id=d014b87f7e134065b8dbab7cd506b3fe)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:47.445052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ffc95-0fec-49f1-ba42-f170da0680a4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:47.473169 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3665/7325] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:47 2022] PUT /identity/v3/projects/28237b8b7fbf49b7a0a652f18987a218/users/09ac0db7ed2e4407a2c5fb57b87a07db/roles/d014b87f7e134065b8dbab7cd506b3fe => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:47.479819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ffc95-0fec-49f1-ba42-f170da0680a4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:47.530803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48569b7-f542-4a8d-80b3-dd0468089c62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:47.534474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48569b7-f542-4a8d-80b3-dd0468089c62 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:47.561149 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3661/7326] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:47.659518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ffc95-0fec-49f1-ba42-f170da0680a4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:47.676975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14532db-aa5b-42ae-a8eb-4741bced5014 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:47.680300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14532db-aa5b-42ae-a8eb-4741bced5014 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:47.682732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14532db-aa5b-42ae-a8eb-4741bced5014 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:47.685088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14532db-aa5b-42ae-a8eb-4741bced5014 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:47.688294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14532db-aa5b-42ae-a8eb-4741bced5014 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:47.697204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14532db-aa5b-42ae-a8eb-4741bced5014 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:47.836090 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3666/7327] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:47 2022] GET /identity/v3/users => generated 8041 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:47.842710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeb251-3b9b-4bd9-812f-132a643f937f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:47.843150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeb251-3b9b-4bd9-812f-132a643f937f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:47.843576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeb251-3b9b-4bd9-812f-132a643f937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:47.866573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808795d-3d18-41e0-bf80-1c444e5585af None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:47.867116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808795d-3d18-41e0-bf80-1c444e5585af None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:47.867561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808795d-3d18-41e0-bf80-1c444e5585af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:47.888201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1808795d-3d18-41e0-bf80-1c444e5585af None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:47.890589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1808795d-3d18-41e0-bf80-1c444e5585af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:47.980086 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3667/7328] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:47.981414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808795d-3d18-41e0-bf80-1c444e5585af None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:48.022106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8dbeb251-3b9b-4bd9-812f-132a643f937f None None] MFA Rules not processed for user `09ac0db7ed2e4407a2c5fb57b87a07db`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:48.033052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8dbeb251-3b9b-4bd9-812f-132a643f937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:48.144423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808795d-3d18-41e0-bf80-1c444e5585af None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:48.175536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a207c-2d6c-44c3-8f3d-f01e833dd7b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:48.176228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a207c-2d6c-44c3-8f3d-f01e833dd7b7 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:48.176583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a207c-2d6c-44c3-8f3d-f01e833dd7b7 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:48.176881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a207c-2d6c-44c3-8f3d-f01e833dd7b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:48.179751 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3662/7329] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:48.190309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b81fc1-74be-4bb5-9070-bad49ff628be None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:48.190982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b81fc1-74be-4bb5-9070-bad49ff628be None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:48.191576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b81fc1-74be-4bb5-9070-bad49ff628be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:48.215845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a207c-2d6c-44c3-8f3d-f01e833dd7b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:48.226154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a207c-2d6c-44c3-8f3d-f01e833dd7b7 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:48.239923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-01b81fc1-74be-4bb5-9070-bad49ff628be None None] MFA Rules not processed for user `09ac0db7ed2e4407a2c5fb57b87a07db`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:48.249535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-01b81fc1-74be-4bb5-9070-bad49ff628be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:48.261237 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3668/7330] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:16:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:48.279041 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3663/7331] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:48.279727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a207c-2d6c-44c3-8f3d-f01e833dd7b7 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:48.295561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a207c-2d6c-44c3-8f3d-f01e833dd7b7 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:48.313105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb10329-3a23-459a-b6a9-5da43e7161d7 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09ac0db7ed2e4407a2c5fb57b87a07db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28237b8b7fbf49b7a0a652f18987a218', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-813313405', 'tempest-DelegatedRole-1310299487'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:48.313781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10329-3a23-459a-b6a9-5da43e7161d7 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:48.314070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10329-3a23-459a-b6a9-5da43e7161d7 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:48.314350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10329-3a23-459a-b6a9-5da43e7161d7 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:48.315851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb10329-3a23-459a-b6a9-5da43e7161d7 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] RBAC: Authorizing `identity:create_trust()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:48.316304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb10329-3a23-459a-b6a9-5da43e7161d7 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:48.569807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b81fc1-74be-4bb5-9070-bad49ff628be None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:48.571503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-01b81fc1-74be-4bb5-9070-bad49ff628be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:48.621537 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3669/7332] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 21:16:48 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:48.625784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb10329-3a23-459a-b6a9-5da43e7161d7 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:48.650903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb10329-3a23-459a-b6a9-5da43e7161d7 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:48.666088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:48.667600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:48.668060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:48.668539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:48.669432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:48.670736 ncdv-master-1 devstack@keystone.service[96909]: WARNING py.warnings [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:48.670736 ncdv-master-1 devstack@keystone.service[96909]: warnings.warn(msg) Feb 19 21:16:48.670736 ncdv-master-1 devstack@keystone.service[96909]: Feb 19 21:16:48.672839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:48.692259 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3670/7333] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 21:16:48 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:48.697359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:48.721527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70acb88-ad2c-4c5d-a03c-ad82d76ca4d8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:48.731302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09ac0db7ed2e4407a2c5fb57b87a07db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28237b8b7fbf49b7a0a652f18987a218', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-813313405', 'tempest-DelegatedRole-1310299487'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:48.732802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:48.737926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:48.738367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] PATH_INFO: `/v3/OS-TRUST/trusts/c0d4792394774f13b3fbaa418ab4e7fa` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:48.758754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b81fc1-74be-4bb5-9070-bad49ff628be None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:48.761518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] RBAC: Authorizing `identity:delete_trust(trust_id=c0d4792394774f13b3fbaa418ab4e7fa)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:48.763139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:48.764248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:48.765314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:48.765621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:48.765925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] PATH_INFO: `/v3/users/11ef251159ae4c748ffda898a3704754` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:48.767385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ef251159ae4c748ffda898a3704754)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:48.770254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:48.811756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c0d4792394774f13b3fbaa418ab4e7fa', 'request_id': 'req-9878b941-3eef-438f-b4c7-8b7428795423'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:48.819443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c0d4792394774f13b3fbaa418ab4e7fa', 'request_id': 'req-9878b941-3eef-438f-b4c7-8b7428795423'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:48.820476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c0d4792394774f13b3fbaa418ab4e7fa', 'request_id': 'req-9878b941-3eef-438f-b4c7-8b7428795423'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:48.854768 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3671/7334] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:16:48 2022] DELETE /identity/v3/OS-TRUST/trusts/c0d4792394774f13b3fbaa418ab4e7fa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:48.861449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:48.863617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ef251159ae4c748ffda898a3704754'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:48.868949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:48.887792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ef251159ae4c748ffda898a3704754'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:48.892831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878b941-3eef-438f-b4c7-8b7428795423 tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:48.899634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ef251159ae4c748ffda898a3704754'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:48.900451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ef251159ae4c748ffda898a3704754'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:48.901228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e1bbb165-555c-4b52-934c-80d2d5e0c7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ef251159ae4c748ffda898a3704754'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:48.918956 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3664/7335] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:48 2022] DELETE /identity/v3/users/11ef251159ae4c748ffda898a3704754 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:48.926463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8d697-9a51-4afb-b86e-d325538e29ae tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09ac0db7ed2e4407a2c5fb57b87a07db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28237b8b7fbf49b7a0a652f18987a218', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-813313405', 'tempest-DelegatedRole-1310299487'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:48.926714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c97e-f388-4105-b728-2996ea8d308c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:48.927058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c97e-f388-4105-b728-2996ea8d308c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:48.927522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c97e-f388-4105-b728-2996ea8d308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:48.933818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8d697-9a51-4afb-b86e-d325538e29ae tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:48.933818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8d697-9a51-4afb-b86e-d325538e29ae tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:48.933818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8d697-9a51-4afb-b86e-d325538e29ae tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] PATH_INFO: `/v3/OS-TRUST/trusts/c0d4792394774f13b3fbaa418ab4e7fa` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:48.954898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9144c97e-f388-4105-b728-2996ea8d308c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:48.957031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9144c97e-f388-4105-b728-2996ea8d308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:48.973217 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-95a8d697-9a51-4afb-b86e-d325538e29ae tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Could not find trust: c0d4792394774f13b3fbaa418ab4e7fa.: keystone.exception.TrustNotFound: Could not find trust: c0d4792394774f13b3fbaa418ab4e7fa. Feb 19 21:16:48.981146 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3672/7336] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:16:48 2022] GET /identity/v3/OS-TRUST/trusts/c0d4792394774f13b3fbaa418ab4e7fa => generated 111 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 19 21:16:48.981992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8d697-9a51-4afb-b86e-d325538e29ae tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:48.987357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-95a8d697-9a51-4afb-b86e-d325538e29ae tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:49.019173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8d697-9a51-4afb-b86e-d325538e29ae tempest-TrustsV3TestJSON-499446105 tempest-user-1856844717] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:49.053500 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3665/7337] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:49.073771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c97e-f388-4105-b728-2996ea8d308c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:49.077575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9144c97e-f388-4105-b728-2996ea8d308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:49.164501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c97e-f388-4105-b728-2996ea8d308c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:49.170068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7d4c-b46e-4348-bf50-40ce3ee4a926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:49.171801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7d4c-b46e-4348-bf50-40ce3ee4a926 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:49.172194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7d4c-b46e-4348-bf50-40ce3ee4a926 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:49.172693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7d4c-b46e-4348-bf50-40ce3ee4a926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:49.189547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:49.195255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f7d4c-b46e-4348-bf50-40ce3ee4a926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:49.196576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:49.197082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f7d4c-b46e-4348-bf50-40ce3ee4a926 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:49.197227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:49.197858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/d014b87f7e134065b8dbab7cd506b3fe` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:49.205787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d014b87f7e134065b8dbab7cd506b3fe)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:49.208656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:49.219298 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3666/7338] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:49.313325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role d014b87f7e134065b8dbab7cd506b3fe has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:49.313786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.320491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.320491 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3673/7339] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:48 2022] DELETE /identity/v3/roles/d014b87f7e134065b8dbab7cd506b3fe => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:49.323667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7d4c-b46e-4348-bf50-40ce3ee4a926 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:49.340926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7d4c-b46e-4348-bf50-40ce3ee4a926 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:49.446675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:49.449439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:49.450076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:49.450689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/3788eeb766d64b0fb4a8f4eca5a4434c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:49.453845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3788eeb766d64b0fb4a8f4eca5a4434c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:49.459720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:49.519554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role 3788eeb766d64b0fb4a8f4eca5a4434c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:49.519849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.522366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.532508 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3667/7340] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:49 2022] DELETE /identity/v3/roles/3788eeb766d64b0fb4a8f4eca5a4434c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:49.535400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:49.538576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:49.561296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793feca5-a3e8-4360-b233-9ea97776fd27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:49.738744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:49.739658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:49.740066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:49.740400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users/09ac0db7ed2e4407a2c5fb57b87a07db` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:49.742789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_user(user_id=09ac0db7ed2e4407a2c5fb57b87a07db)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:49.746972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:49.878706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ac0db7ed2e4407a2c5fb57b87a07db'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.879654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ac0db7ed2e4407a2c5fb57b87a07db'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.880805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ac0db7ed2e4407a2c5fb57b87a07db'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.908643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ac0db7ed2e4407a2c5fb57b87a07db'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.920254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ac0db7ed2e4407a2c5fb57b87a07db'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:49.942398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3674/7341] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:49 2022] DELETE /identity/v3/users/09ac0db7ed2e4407a2c5fb57b87a07db => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:49.946407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:49.949248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:49.969945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050028-8407-426b-921d-08eb75070624 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:50.104551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:50.106232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:50.106700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:50.107426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/28237b8b7fbf49b7a0a652f18987a218` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:50.110738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=28237b8b7fbf49b7a0a652f18987a218)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:50.114258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:50.331323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28237b8b7fbf49b7a0a652f18987a218', 'request_id': 'req-910751ce-bf3f-495c-8cb0-11538eabeee1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:50.361401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28237b8b7fbf49b7a0a652f18987a218', 'request_id': 'req-910751ce-bf3f-495c-8cb0-11538eabeee1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:50.399092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28237b8b7fbf49b7a0a652f18987a218', 'request_id': 'req-910751ce-bf3f-495c-8cb0-11538eabeee1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:50.445123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] The token cache is being invalidate because project 28237b8b7fbf49b7a0a652f18987a218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:50.445568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:50.449414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:50.460868 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3668/7342] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:49 2022] DELETE /identity/v3/projects/28237b8b7fbf49b7a0a652f18987a218 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:50.470539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:50.472925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:50.526773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f2bec-cba1-4e57-9487-85686417e5bf tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:50.884347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:50.888179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:50.892484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:50.893861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:50.894160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:50.894491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:50.895207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:50.897265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:50.932378 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3675/7343] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:16:50 2022] POST /identity/v3/projects => generated 328 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:50.937911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:50.941303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:51.053132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103608-2cce-4ce4-bee4-4c878871fa5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:51.061460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ab1ec-a510-4659-84f9-429f456b45e0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:51.062696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab1ec-a510-4659-84f9-429f456b45e0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.063206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab1ec-a510-4659-84f9-429f456b45e0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.063705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab1ec-a510-4659-84f9-429f456b45e0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.065211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ab1ec-a510-4659-84f9-429f456b45e0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:51.068225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ab1ec-a510-4659-84f9-429f456b45e0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:51.103666 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3676/7344] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:50 2022] POST /identity/v3/users => generated 416 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:51.109014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ab1ec-a510-4659-84f9-429f456b45e0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:51.120496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910751ce-bf3f-495c-8cb0-11538eabeee1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:51.125608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ab1ec-a510-4659-84f9-429f456b45e0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:51.132061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e475-21c6-44a6-8df1-0c557c031a0b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:51.132857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e475-21c6-44a6-8df1-0c557c031a0b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.133254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e475-21c6-44a6-8df1-0c557c031a0b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.133780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e475-21c6-44a6-8df1-0c557c031a0b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.134600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80e475-21c6-44a6-8df1-0c557c031a0b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:51.136534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80e475-21c6-44a6-8df1-0c557c031a0b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:51.159304 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3677/7345] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:16:51 2022] POST /identity/v3/roles => generated 243 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:51.162180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e475-21c6-44a6-8df1-0c557c031a0b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:51.186578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e475-21c6-44a6-8df1-0c557c031a0b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:51.209125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e7791-b9af-4a92-be1d-650b426fb6a9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:51.209978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7791-b9af-4a92-be1d-650b426fb6a9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.210836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7791-b9af-4a92-be1d-650b426fb6a9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.210836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7791-b9af-4a92-be1d-650b426fb6a9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.211599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e7791-b9af-4a92-be1d-650b426fb6a9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:51.215041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e7791-b9af-4a92-be1d-650b426fb6a9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:51.255286 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3678/7346] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:16:51 2022] POST /identity/v3/roles => generated 247 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:51.256648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e7791-b9af-4a92-be1d-650b426fb6a9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:51.265305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:51.271817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.272514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.273684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] PATH_INFO: `/v3/projects/50984b380928456a887bd08bbde86c5c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.278994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50984b380928456a887bd08bbde86c5c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:51.282124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e7791-b9af-4a92-be1d-650b426fb6a9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:51.287374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:51.293284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bfecf-bf17-48fd-a48b-88f3af6f7102 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:51.296907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfecf-bf17-48fd-a48b-88f3af6f7102 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.297281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfecf-bf17-48fd-a48b-88f3af6f7102 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.298689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfecf-bf17-48fd-a48b-88f3af6f7102 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/21bb3227b3124dc4a5aa735ef5950d31/users/715add9fc2f741fca8fe22bc7a82e6ad/roles/ad284d7b5557493e920ab6574785da88` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.341079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bfecf-bf17-48fd-a48b-88f3af6f7102 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=21bb3227b3124dc4a5aa735ef5950d31, user_id=715add9fc2f741fca8fe22bc7a82e6ad, role_id=ad284d7b5557493e920ab6574785da88)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:51.344547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bfecf-bf17-48fd-a48b-88f3af6f7102 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:51.390602 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3679/7347] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:51 2022] PUT /identity/v3/projects/21bb3227b3124dc4a5aa735ef5950d31/users/715add9fc2f741fca8fe22bc7a82e6ad/roles/ad284d7b5557493e920ab6574785da88 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:51.396821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bfecf-bf17-48fd-a48b-88f3af6f7102 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:51.451780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50984b380928456a887bd08bbde86c5c', 'request_id': 'req-a463d299-dae5-4378-8bd7-2b9e68539ac8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:51.462246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50984b380928456a887bd08bbde86c5c', 'request_id': 'req-a463d299-dae5-4378-8bd7-2b9e68539ac8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:51.484534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50984b380928456a887bd08bbde86c5c', 'request_id': 'req-a463d299-dae5-4378-8bd7-2b9e68539ac8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:51.504788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] The token cache is being invalidate because project 50984b380928456a887bd08bbde86c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:51.506508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:51.507856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a463d299-dae5-4378-8bd7-2b9e68539ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:51.514933 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3669/7348] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:50 2022] DELETE /identity/v3/projects/50984b380928456a887bd08bbde86c5c => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:51.519541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2495e05-6d23-49ff-aa4d-32cc5bea508e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.520092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2495e05-6d23-49ff-aa4d-32cc5bea508e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.520798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2495e05-6d23-49ff-aa4d-32cc5bea508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.554433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d2495e05-6d23-49ff-aa4d-32cc5bea508e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:51.558101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d2495e05-6d23-49ff-aa4d-32cc5bea508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:51.561443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bfecf-bf17-48fd-a48b-88f3af6f7102 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:51.667056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:51.668238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.668548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.668836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/21bb3227b3124dc4a5aa735ef5950d31/users/715add9fc2f741fca8fe22bc7a82e6ad/roles/5f7776d7a17e45ab8c2e34181b392310` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.677988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=21bb3227b3124dc4a5aa735ef5950d31, user_id=715add9fc2f741fca8fe22bc7a82e6ad, role_id=5f7776d7a17e45ab8c2e34181b392310)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:51.684412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:51.724381 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3680/7349] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:51 2022] PUT /identity/v3/projects/21bb3227b3124dc4a5aa735ef5950d31/users/715add9fc2f741fca8fe22bc7a82e6ad/roles/5f7776d7a17e45ab8c2e34181b392310 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:51.724720 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3670/7350] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:51.731056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:51.731520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2d33-8835-425f-a5aa-5da50365abe5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.731819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2d33-8835-425f-a5aa-5da50365abe5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.732998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2d33-8835-425f-a5aa-5da50365abe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.734529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:51.761718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-096c2d33-8835-425f-a5aa-5da50365abe5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:51.762877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-096c2d33-8835-425f-a5aa-5da50365abe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:51.918603 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3671/7351] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:51.935010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc3779-d6f7-4d6e-a65f-a4ca245dee3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:51.937930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c2d33-8835-425f-a5aa-5da50365abe5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:51.944606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a980e-959d-4226-a121-89c7925e9190 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:51.947371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a980e-959d-4226-a121-89c7925e9190 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.948255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a980e-959d-4226-a121-89c7925e9190 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.948924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a980e-959d-4226-a121-89c7925e9190 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.950392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a980e-959d-4226-a121-89c7925e9190 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:51.956359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a980e-959d-4226-a121-89c7925e9190 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:51.967672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c2d33-8835-425f-a5aa-5da50365abe5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:51.977064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:51.978457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:51.978969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:51.979599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:51.980679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:16:51.982806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:51.984397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:52.016303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3672/7352] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:52.017428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:52.065308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175da1d-9c3d-4b5e-9c94-6064a074f7ba admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:52.091308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86632497-22c8-448a-8f5e-13b2272d0e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:52.094611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632497-22c8-448a-8f5e-13b2272d0e44 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.095966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632497-22c8-448a-8f5e-13b2272d0e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.096485 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3681/7353] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:51 2022] GET /identity/v3/users => generated 7763 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:52.098731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4f289-22d8-4b00-988a-5067fe3c11c5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.099079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632497-22c8-448a-8f5e-13b2272d0e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.099376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4f289-22d8-4b00-988a-5067fe3c11c5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.099797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4f289-22d8-4b00-988a-5067fe3c11c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.100635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86632497-22c8-448a-8f5e-13b2272d0e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:52.106193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86632497-22c8-448a-8f5e-13b2272d0e44 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:52.187421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-92c4f289-22d8-4b00-988a-5067fe3c11c5 None None] MFA Rules not processed for user `715add9fc2f741fca8fe22bc7a82e6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:52.189562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-92c4f289-22d8-4b00-988a-5067fe3c11c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:52.194331 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3673/7354] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:52 2022] POST /identity/v3/projects => generated 407 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:52.201588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86632497-22c8-448a-8f5e-13b2272d0e44 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:52.341168 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3682/7355] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:52.362456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86632497-22c8-448a-8f5e-13b2272d0e44 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:52.362893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532ad9-306c-492c-9d84-ffdb1a05bdb1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.363212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532ad9-306c-492c-9d84-ffdb1a05bdb1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.363501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532ad9-306c-492c-9d84-ffdb1a05bdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.380691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22047b5d-e697-491e-bc2c-6b67278ff957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:52.381739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047b5d-e697-491e-bc2c-6b67278ff957 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.382164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047b5d-e697-491e-bc2c-6b67278ff957 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.382580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047b5d-e697-491e-bc2c-6b67278ff957 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.383717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22047b5d-e697-491e-bc2c-6b67278ff957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:52.397150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22047b5d-e697-491e-bc2c-6b67278ff957 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:52.422268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e5532ad9-306c-492c-9d84-ffdb1a05bdb1 None None] MFA Rules not processed for user `715add9fc2f741fca8fe22bc7a82e6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:52.426123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e5532ad9-306c-492c-9d84-ffdb1a05bdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:52.456302 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3683/7356] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:52.457704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532ad9-306c-492c-9d84-ffdb1a05bdb1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:52.467534 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3674/7357] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:52 2022] POST /identity/v3/users => generated 304 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:52.469489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22047b5d-e697-491e-bc2c-6b67278ff957 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:52.499940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532ad9-306c-492c-9d84-ffdb1a05bdb1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:52.510980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22047b5d-e697-491e-bc2c-6b67278ff957 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:52.530131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fae84-8a0c-49c3-bce3-327c3151b1a1 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715add9fc2f741fca8fe22bc7a82e6ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21bb3227b3124dc4a5aa735ef5950d31', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1678616249', 'tempest-DelegatedRole-138847578'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:52.531028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fae84-8a0c-49c3-bce3-327c3151b1a1 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.531447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fae84-8a0c-49c3-bce3-327c3151b1a1 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.531962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fae84-8a0c-49c3-bce3-327c3151b1a1 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.533064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fae84-8a0c-49c3-bce3-327c3151b1a1 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: Authorizing `identity:create_trust()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:52.534907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fae84-8a0c-49c3-bce3-327c3151b1a1 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:52.547412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11053aa-0fa7-44b2-95b1-3cbcb21c7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:52.548844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11053aa-0fa7-44b2-95b1-3cbcb21c7178 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.549261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11053aa-0fa7-44b2-95b1-3cbcb21c7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.549730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11053aa-0fa7-44b2-95b1-3cbcb21c7178 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.551027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11053aa-0fa7-44b2-95b1-3cbcb21c7178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:52.553701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11053aa-0fa7-44b2-95b1-3cbcb21c7178 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:52.587202 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3675/7358] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:52 2022] GET /identity/v3/roles => generated 1892 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:52.588850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11053aa-0fa7-44b2-95b1-3cbcb21c7178 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:52.610729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11053aa-0fa7-44b2-95b1-3cbcb21c7178 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:52.627252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dbbe8-ed4a-49ea-89e6-52d24b47b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:52.639769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dbbe8-ed4a-49ea-89e6-52d24b47b4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.640062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dbbe8-ed4a-49ea-89e6-52d24b47b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.641137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dbbe8-ed4a-49ea-89e6-52d24b47b4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.641137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dbbe8-ed4a-49ea-89e6-52d24b47b4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:52.648837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dbbe8-ed4a-49ea-89e6-52d24b47b4b3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:52.695282 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3676/7359] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:52 2022] GET /identity/v3/roles => generated 1892 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:52.696230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dbbe8-ed4a-49ea-89e6-52d24b47b4b3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:52.716855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dbbe8-ed4a-49ea-89e6-52d24b47b4b3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:52.733936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb81c5-abe9-4552-9b9c-077c44605db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:52.734865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb81c5-abe9-4552-9b9c-077c44605db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.735155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb81c5-abe9-4552-9b9c-077c44605db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.735440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb81c5-abe9-4552-9b9c-077c44605db2 admin admin] PATH_INFO: `/v3/projects/a0f555126ca64a3b8f54ce6a8470f9f5/users/126237d240b149edb02ffdf3d1f64863/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.768853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb81c5-abe9-4552-9b9c-077c44605db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f555126ca64a3b8f54ce6a8470f9f5, user_id=126237d240b149edb02ffdf3d1f64863, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:52.771569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb81c5-abe9-4552-9b9c-077c44605db2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:52.784053 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3684/7360] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 21:16:52 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:52.789503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fae84-8a0c-49c3-bce3-327c3151b1a1 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:52.797470 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3677/7361] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:52 2022] PUT /identity/v3/projects/a0f555126ca64a3b8f54ce6a8470f9f5/users/126237d240b149edb02ffdf3d1f64863/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:52.804822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fae84-8a0c-49c3-bce3-327c3151b1a1 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:52.815246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f3bb-8bcf-4cbe-ab07-f25e01685e9c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.815562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f3bb-8bcf-4cbe-ab07-f25e01685e9c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.815854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32f3bb-8bcf-4cbe-ab07-f25e01685e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.895546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8b32f3bb-8bcf-4cbe-ab07-f25e01685e9c None None] MFA Rules not processed for user `126237d240b149edb02ffdf3d1f64863`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:52.897482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b32f3bb-8bcf-4cbe-ab07-f25e01685e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:52.928071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df220e-abd6-406d-8ac6-3685def5e908 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715add9fc2f741fca8fe22bc7a82e6ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21bb3227b3124dc4a5aa735ef5950d31', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1678616249', 'tempest-DelegatedRole-138847578'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:52.928939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df220e-abd6-406d-8ac6-3685def5e908 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:52.930520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df220e-abd6-406d-8ac6-3685def5e908 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:52.930837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df220e-abd6-406d-8ac6-3685def5e908 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:52.934105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df220e-abd6-406d-8ac6-3685def5e908 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:52.936680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df220e-abd6-406d-8ac6-3685def5e908 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:52.946968 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3685/7362] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Feb 19 21:16:52 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=715add9fc2f741fca8fe22bc7a82e6ad => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:52.972355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df220e-abd6-406d-8ac6-3685def5e908 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.000139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df220e-abd6-406d-8ac6-3685def5e908 tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.006379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715add9fc2f741fca8fe22bc7a82e6ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21bb3227b3124dc4a5aa735ef5950d31', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1678616249', 'tempest-DelegatedRole-138847578'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.007310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.007516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.007797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] PATH_INFO: `/v3/OS-TRUST/trusts/7434e86fbebc489fb144333f88514a8d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.027289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: Authorizing `identity:delete_trust(trust_id=7434e86fbebc489fb144333f88514a8d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.040582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.070477 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3678/7363] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:53.079689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32f3bb-8bcf-4cbe-ab07-f25e01685e9c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.088906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7434e86fbebc489fb144333f88514a8d', 'request_id': 'req-5d7c0d9d-e85b-4798-879f-6799291d221c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:53.089700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7434e86fbebc489fb144333f88514a8d', 'request_id': 'req-5d7c0d9d-e85b-4798-879f-6799291d221c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:53.090348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7434e86fbebc489fb144333f88514a8d', 'request_id': 'req-5d7c0d9d-e85b-4798-879f-6799291d221c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:53.115007 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3686/7364] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:16:52 2022] DELETE /identity/v3/OS-TRUST/trusts/7434e86fbebc489fb144333f88514a8d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:53.119166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.120658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:53.135067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0d9d-e85b-4798-879f-6799291d221c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.143464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3013e-7ccd-4817-b47e-2882b771ba2c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715add9fc2f741fca8fe22bc7a82e6ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21bb3227b3124dc4a5aa735ef5950d31', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1678616249', 'tempest-DelegatedRole-138847578'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.144320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3013e-7ccd-4817-b47e-2882b771ba2c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.144700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3013e-7ccd-4817-b47e-2882b771ba2c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.144910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3013e-7ccd-4817-b47e-2882b771ba2c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] PATH_INFO: `/v3/OS-TRUST/trusts/7434e86fbebc489fb144333f88514a8d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.163037 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-e9b3013e-7ccd-4817-b47e-2882b771ba2c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Could not find trust: 7434e86fbebc489fb144333f88514a8d.: keystone.exception.TrustNotFound: Could not find trust: 7434e86fbebc489fb144333f88514a8d. Feb 19 21:16:53.164691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3687/7365] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:16:53 2022] GET /identity/v3/OS-TRUST/trusts/7434e86fbebc489fb144333f88514a8d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:16:53.167032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32f3bb-8bcf-4cbe-ab07-f25e01685e9c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.170778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3013e-7ccd-4817-b47e-2882b771ba2c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.172882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e9b3013e-7ccd-4817-b47e-2882b771ba2c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:53.176134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.176814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.177176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.177504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.178452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.180790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.225825 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3679/7366] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:16:53 2022] POST /identity/v3/projects => generated 407 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:53.230979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.233682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:53.309432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3013e-7ccd-4817-b47e-2882b771ba2c tempest-TrustsV3TestJSON-749196355 tempest-user-1093415024] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.334997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f79a8-6814-4bd3-be7e-d34501dd36e1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.342124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5016c0b-1ad1-427e-8239-0116dd9549a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.343243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5016c0b-1ad1-427e-8239-0116dd9549a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.343402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5016c0b-1ad1-427e-8239-0116dd9549a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.343845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5016c0b-1ad1-427e-8239-0116dd9549a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.344646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5016c0b-1ad1-427e-8239-0116dd9549a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.346846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5016c0b-1ad1-427e-8239-0116dd9549a2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.376106 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3680/7367] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:53 2022] POST /identity/v3/users => generated 310 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:53.379651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5016c0b-1ad1-427e-8239-0116dd9549a2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.393749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5016c0b-1ad1-427e-8239-0116dd9549a2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.394755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.395641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.395906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.396341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/5f7776d7a17e45ab8c2e34181b392310` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.399809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d49c24-6ef8-420f-932d-8e8bf6d1fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.400932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d49c24-6ef8-420f-932d-8e8bf6d1fedd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.401182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d49c24-6ef8-420f-932d-8e8bf6d1fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.401482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d49c24-6ef8-420f-932d-8e8bf6d1fedd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.402789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d49c24-6ef8-420f-932d-8e8bf6d1fedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.405094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d49c24-6ef8-420f-932d-8e8bf6d1fedd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.408962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5f7776d7a17e45ab8c2e34181b392310)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.412189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.419490 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3681/7368] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:53 2022] GET /identity/v3/roles => generated 1892 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:53.424368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d49c24-6ef8-420f-932d-8e8bf6d1fedd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.438519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d49c24-6ef8-420f-932d-8e8bf6d1fedd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.443766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.444698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.444984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.445259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] PATH_INFO: `/v3/projects/16ead202d6b84d91a5f9467961fdedab/users/63b039f7781e4e4f8413ee9ef50beaf0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.463864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role 5f7776d7a17e45ab8c2e34181b392310 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:53.464364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:53.465179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:53.468667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ead202d6b84d91a5f9467961fdedab, user_id=63b039f7781e4e4f8413ee9ef50beaf0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.470312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.471810 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3688/7369] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:53 2022] DELETE /identity/v3/roles/5f7776d7a17e45ab8c2e34181b392310 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:53.472869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.474605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:53.494336 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3682/7370] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:53 2022] PUT /identity/v3/projects/16ead202d6b84d91a5f9467961fdedab/users/63b039f7781e4e4f8413ee9ef50beaf0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:53.495499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.497392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:53.556753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf75b2-a626-46f8-8d85-2fe7bbb1eebb tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.598598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8b1e9-6aff-4b07-8ce1-edd4eaa51f5f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.605362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b2d3-9ee3-4a0a-98dd-53b2d07c4a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.606183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b2d3-9ee3-4a0a-98dd-53b2d07c4a23 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.606469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b2d3-9ee3-4a0a-98dd-53b2d07c4a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.606749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b2d3-9ee3-4a0a-98dd-53b2d07c4a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.607737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8b2d3-9ee3-4a0a-98dd-53b2d07c4a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.609846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8b2d3-9ee3-4a0a-98dd-53b2d07c4a23 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.637161 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3683/7371] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:53 2022] GET /identity/v3/roles => generated 1654 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:53.641032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.642167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.642812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b2d3-9ee3-4a0a-98dd-53b2d07c4a23 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.646430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.646430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/ad284d7b5557493e920ab6574785da88` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.650430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad284d7b5557493e920ab6574785da88)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.654228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.678395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b2d3-9ee3-4a0a-98dd-53b2d07c4a23 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:53.702988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:53.713211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.713542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.715906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] PATH_INFO: `/v3/projects/16ead202d6b84d91a5f9467961fdedab/users/63b039f7781e4e4f8413ee9ef50beaf0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.734878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ead202d6b84d91a5f9467961fdedab, user_id=63b039f7781e4e4f8413ee9ef50beaf0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:53.738481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:53.755542 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3684/7372] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:53 2022] PUT /identity/v3/projects/16ead202d6b84d91a5f9467961fdedab/users/63b039f7781e4e4f8413ee9ef50beaf0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:53.832938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role ad284d7b5557493e920ab6574785da88 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:53.833415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:53.836906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-220add0b-d731-4581-8e81-49b102ce510f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:53.843093 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3689/7373] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:53 2022] DELETE /identity/v3/roles/ad284d7b5557493e920ab6574785da88 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:53.844955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:53.853202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:53.856496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476e276-376b-4268-9563-bc0e5054fbd6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:53.856902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476e276-376b-4268-9563-bc0e5054fbd6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:53.857658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476e276-376b-4268-9563-bc0e5054fbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:53.949222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4476e276-376b-4268-9563-bc0e5054fbd6 None None] MFA Rules not processed for user `63b039f7781e4e4f8413ee9ef50beaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:53.955152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4476e276-376b-4268-9563-bc0e5054fbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:54.147083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5907991-0dba-4b5f-884b-caa00bc1e1c5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:54.185688 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3690/7374] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:53 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:54.237508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476e276-376b-4268-9563-bc0e5054fbd6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:54.240037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4476e276-376b-4268-9563-bc0e5054fbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:54.334111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:54.336450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:54.340934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:54.342196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users/715add9fc2f741fca8fe22bc7a82e6ad` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:54.371852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_user(user_id=715add9fc2f741fca8fe22bc7a82e6ad)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:54.408892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:54.538353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476e276-376b-4268-9563-bc0e5054fbd6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:54.547339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce606ae-f1bb-47f1-aa0a-52aefcc6d0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:54.548067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce606ae-f1bb-47f1-aa0a-52aefcc6d0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:54.548461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce606ae-f1bb-47f1-aa0a-52aefcc6d0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:54.550402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce606ae-f1bb-47f1-aa0a-52aefcc6d0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:54.565019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715add9fc2f741fca8fe22bc7a82e6ad'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.575220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce606ae-f1bb-47f1-aa0a-52aefcc6d0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:54.576861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce606ae-f1bb-47f1-aa0a-52aefcc6d0c0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:54.589988 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3691/7375] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:54 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:54.598978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715add9fc2f741fca8fe22bc7a82e6ad'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.609842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715add9fc2f741fca8fe22bc7a82e6ad'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.610512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715add9fc2f741fca8fe22bc7a82e6ad'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.611564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715add9fc2f741fca8fe22bc7a82e6ad'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.634795 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3685/7376] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:53 2022] DELETE /identity/v3/users/715add9fc2f741fca8fe22bc7a82e6ad => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:54.635035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce606ae-f1bb-47f1-aa0a-52aefcc6d0c0 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:54.648595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce606ae-f1bb-47f1-aa0a-52aefcc6d0c0 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:54.792099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:54.793844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:54.794131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:54.795020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/21bb3227b3124dc4a5aa735ef5950d31` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:54.796525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=21bb3227b3124dc4a5aa735ef5950d31)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:54.799982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:54.906355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bb3227b3124dc4a5aa735ef5950d31', 'request_id': 'req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.917547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bb3227b3124dc4a5aa735ef5950d31', 'request_id': 'req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.931316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bb3227b3124dc4a5aa735ef5950d31', 'request_id': 'req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.966206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] The token cache is being invalidate because project 21bb3227b3124dc4a5aa735ef5950d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:54.966206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.970223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:54.974728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3692/7377] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:54 2022] DELETE /identity/v3/projects/21bb3227b3124dc4a5aa735ef5950d31 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:54.983024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:54.986945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:55.013897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ccaa-5ca0-4680-8a00-7947946e2820 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:55.158821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea184134-8a14-4db1-ba3f-9bf9a98ce99b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:55.159727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184134-8a14-4db1-ba3f-9bf9a98ce99b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:55.160009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184134-8a14-4db1-ba3f-9bf9a98ce99b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:55.161216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184134-8a14-4db1-ba3f-9bf9a98ce99b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:55.161971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea184134-8a14-4db1-ba3f-9bf9a98ce99b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:55.164621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea184134-8a14-4db1-ba3f-9bf9a98ce99b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:55.226259 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3686/7378] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:16:54 2022] POST /identity/v3/projects => generated 329 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:55.234545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:55.236996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:55.259287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d76dcd-6fa2-4a7c-90b4-be14bfd31b88 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:55.372223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5011f4a-97fb-421f-81b9-b39d12b71a74 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:55.373152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011f4a-97fb-421f-81b9-b39d12b71a74 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:55.373533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011f4a-97fb-421f-81b9-b39d12b71a74 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:55.374423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011f4a-97fb-421f-81b9-b39d12b71a74 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:55.375596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5011f4a-97fb-421f-81b9-b39d12b71a74 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:55.377974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5011f4a-97fb-421f-81b9-b39d12b71a74 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:55.412675 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3693/7379] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:55 2022] POST /identity/v3/users => generated 416 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:55.413538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea184134-8a14-4db1-ba3f-9bf9a98ce99b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:55.428756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea184134-8a14-4db1-ba3f-9bf9a98ce99b tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:55.434170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346c90d-7d68-47cb-a991-71a3ceebddf3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:55.435118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c90d-7d68-47cb-a991-71a3ceebddf3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:55.435922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c90d-7d68-47cb-a991-71a3ceebddf3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:55.436393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c90d-7d68-47cb-a991-71a3ceebddf3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:55.438718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346c90d-7d68-47cb-a991-71a3ceebddf3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:55.454526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346c90d-7d68-47cb-a991-71a3ceebddf3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:55.488208 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3687/7380] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:16:55 2022] POST /identity/v3/roles => generated 244 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:55.492036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5011f4a-97fb-421f-81b9-b39d12b71a74 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:55.502895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5011f4a-97fb-421f-81b9-b39d12b71a74 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:55.509224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150ae64-5723-4da0-9304-8aed0dbf69f3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:55.509918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150ae64-5723-4da0-9304-8aed0dbf69f3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:55.510803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150ae64-5723-4da0-9304-8aed0dbf69f3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:55.511102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150ae64-5723-4da0-9304-8aed0dbf69f3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:55.511858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150ae64-5723-4da0-9304-8aed0dbf69f3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:55.514076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150ae64-5723-4da0-9304-8aed0dbf69f3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:55.535924 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3694/7381] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:16:55 2022] POST /identity/v3/roles => generated 247 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:55.537409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346c90d-7d68-47cb-a991-71a3ceebddf3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:55.555106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346c90d-7d68-47cb-a991-71a3ceebddf3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:55.564158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f723b0-0df7-4d99-a3a4-22f47c976fa9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:55.565929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f723b0-0df7-4d99-a3a4-22f47c976fa9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:55.566928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f723b0-0df7-4d99-a3a4-22f47c976fa9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:55.567585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f723b0-0df7-4d99-a3a4-22f47c976fa9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/7c3d54e921e444c7b06536a858864493/users/62e8dcbd3d0841df958cd3d632855ea6/roles/4c1e71ce99be47f6964fbe1d975a6eb1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:55.591911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f723b0-0df7-4d99-a3a4-22f47c976fa9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7c3d54e921e444c7b06536a858864493, user_id=62e8dcbd3d0841df958cd3d632855ea6, role_id=4c1e71ce99be47f6964fbe1d975a6eb1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:55.596982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f723b0-0df7-4d99-a3a4-22f47c976fa9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:55.624940 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3688/7382] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:55 2022] PUT /identity/v3/projects/7c3d54e921e444c7b06536a858864493/users/62e8dcbd3d0841df958cd3d632855ea6/roles/4c1e71ce99be47f6964fbe1d975a6eb1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:55.636163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150ae64-5723-4da0-9304-8aed0dbf69f3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:55.656702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150ae64-5723-4da0-9304-8aed0dbf69f3 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:55.794000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bae7d-1769-4d47-a7e0-cf7ed0a41e27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:55.795415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bae7d-1769-4d47-a7e0-cf7ed0a41e27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:55.795800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bae7d-1769-4d47-a7e0-cf7ed0a41e27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:55.796140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bae7d-1769-4d47-a7e0-cf7ed0a41e27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/7c3d54e921e444c7b06536a858864493/users/62e8dcbd3d0841df958cd3d632855ea6/roles/9921815a34234b7a951fc9766192de0b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:55.798727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bae7d-1769-4d47-a7e0-cf7ed0a41e27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7c3d54e921e444c7b06536a858864493, user_id=62e8dcbd3d0841df958cd3d632855ea6, role_id=9921815a34234b7a951fc9766192de0b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:55.801913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bae7d-1769-4d47-a7e0-cf7ed0a41e27 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:55.829458 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3695/7383] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:55 2022] PUT /identity/v3/projects/7c3d54e921e444c7b06536a858864493/users/62e8dcbd3d0841df958cd3d632855ea6/roles/9921815a34234b7a951fc9766192de0b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:55.833015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f723b0-0df7-4d99-a3a4-22f47c976fa9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:55.847625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f723b0-0df7-4d99-a3a4-22f47c976fa9 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:55.984987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd58714-6472-4bba-918f-5f5385358a76 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:55.985792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58714-6472-4bba-918f-5f5385358a76 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:55.986318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58714-6472-4bba-918f-5f5385358a76 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:55.986675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58714-6472-4bba-918f-5f5385358a76 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:55.987524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58714-6472-4bba-918f-5f5385358a76 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:55.990437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58714-6472-4bba-918f-5f5385358a76 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:56.052507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb985-e6e8-46b6-83b1-4f468e10e4ae None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:56.053030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb985-e6e8-46b6-83b1-4f468e10e4ae None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:56.053135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb985-e6e8-46b6-83b1-4f468e10e4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:56.062968 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3689/7384] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:55 2022] GET /identity/v3/users => generated 8359 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:56.115523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c42bb985-e6e8-46b6-83b1-4f468e10e4ae None None] MFA Rules not processed for user `62e8dcbd3d0841df958cd3d632855ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:56.117819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c42bb985-e6e8-46b6-83b1-4f468e10e4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:56.247306 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3696/7385] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:56.257258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332819ae-234b-425a-ac6b-06c52cc2905a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:56.257550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332819ae-234b-425a-ac6b-06c52cc2905a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:56.257832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332819ae-234b-425a-ac6b-06c52cc2905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:56.347254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-332819ae-234b-425a-ac6b-06c52cc2905a None None] MFA Rules not processed for user `62e8dcbd3d0841df958cd3d632855ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:56.350322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-332819ae-234b-425a-ac6b-06c52cc2905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:56.372151 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3690/7386] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:16:56.384120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bb985-e6e8-46b6-83b1-4f468e10e4ae None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:56.402981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bb985-e6e8-46b6-83b1-4f468e10e4ae None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:56.422555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbadec6-8f2f-4c9e-a4ed-b4550aa68923 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:56.422555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadec6-8f2f-4c9e-a4ed-b4550aa68923 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:56.422555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadec6-8f2f-4c9e-a4ed-b4550aa68923 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:56.423152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadec6-8f2f-4c9e-a4ed-b4550aa68923 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:56.423152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbadec6-8f2f-4c9e-a4ed-b4550aa68923 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorizing `identity:create_trust()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:56.423979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbadec6-8f2f-4c9e-a4ed-b4550aa68923 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:56.641018 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3697/7387] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 21:16:56 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:56.643729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332819ae-234b-425a-ac6b-06c52cc2905a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:56.655270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332819ae-234b-425a-ac6b-06c52cc2905a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:56.666333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7372eb-9620-4b06-9075-2256276e5fd1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:56.669480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7372eb-9620-4b06-9075-2256276e5fd1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:56.672874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7372eb-9620-4b06-9075-2256276e5fd1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:56.675045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7372eb-9620-4b06-9075-2256276e5fd1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:56.702913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7372eb-9620-4b06-9075-2256276e5fd1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorizing `identity:get_trust(trust_id=6e3ad3e18991492e9a015633338aa897)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:56.704947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7372eb-9620-4b06-9075-2256276e5fd1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:56.735790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbadec6-8f2f-4c9e-a4ed-b4550aa68923 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:56.736404 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3691/7388] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:16:56 2022] GET /identity/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897 => generated 859 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:56.755768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbadec6-8f2f-4c9e-a4ed-b4550aa68923 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:56.776189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556960b-0b89-43cc-9443-52c850873ef1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:56.779452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556960b-0b89-43cc-9443-52c850873ef1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:56.779452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556960b-0b89-43cc-9443-52c850873ef1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:56.779804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556960b-0b89-43cc-9443-52c850873ef1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:56.796606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556960b-0b89-43cc-9443-52c850873ef1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6e3ad3e18991492e9a015633338aa897)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:56.810143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556960b-0b89-43cc-9443-52c850873ef1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:56.825213 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3698/7389] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:16:56 2022] GET /identity/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles => generated 371 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:56.827864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7372eb-9620-4b06-9075-2256276e5fd1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:56.846937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7372eb-9620-4b06-9075-2256276e5fd1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:56.854415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a35650-c05d-45bb-a5cf-b31150167f0a tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:56.855786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35650-c05d-45bb-a5cf-b31150167f0a tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:56.856403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35650-c05d-45bb-a5cf-b31150167f0a tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:56.857421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35650-c05d-45bb-a5cf-b31150167f0a tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles/4c1e71ce99be47f6964fbe1d975a6eb1` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:56.874022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a35650-c05d-45bb-a5cf-b31150167f0a tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6e3ad3e18991492e9a015633338aa897, role_id=4c1e71ce99be47f6964fbe1d975a6eb1)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:56.875916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a35650-c05d-45bb-a5cf-b31150167f0a tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:56.894440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556960b-0b89-43cc-9443-52c850873ef1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:56.902662 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3692/7390] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Feb 19 21:16:56 2022] GET /identity/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles/4c1e71ce99be47f6964fbe1d975a6eb1 => generated 244 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:56.917444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556960b-0b89-43cc-9443-52c850873ef1 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:56.936307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4a252-93dc-4341-bad0-58d57448c904 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:56.937188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a252-93dc-4341-bad0-58d57448c904 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:56.937474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a252-93dc-4341-bad0-58d57448c904 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:56.937751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a252-93dc-4341-bad0-58d57448c904 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles/4c1e71ce99be47f6964fbe1d975a6eb1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:56.953771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4a252-93dc-4341-bad0-58d57448c904 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6e3ad3e18991492e9a015633338aa897, role_id=4c1e71ce99be47f6964fbe1d975a6eb1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:56.961322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4a252-93dc-4341-bad0-58d57448c904 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:56.991769 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3699/7391] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Feb 19 21:16:56 2022] HEAD /identity/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles/4c1e71ce99be47f6964fbe1d975a6eb1 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:16:56.997332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a35650-c05d-45bb-a5cf-b31150167f0a tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:57.011387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a35650-c05d-45bb-a5cf-b31150167f0a tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:57.025251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:57.026149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:57.026487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:57.026770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles/9921815a34234b7a951fc9766192de0b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:57.034132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6e3ad3e18991492e9a015633338aa897, role_id=9921815a34234b7a951fc9766192de0b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:57.035881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:57.054266 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Could not find role: 9921815a34234b7a951fc9766192de0b.: keystone.exception.RoleNotFound: Could not find role: 9921815a34234b7a951fc9766192de0b. Feb 19 21:16:57.059288 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3693/7392] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Feb 19 21:16:56 2022] GET /identity/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles/9921815a34234b7a951fc9766192de0b => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:16:57.060852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4a252-93dc-4341-bad0-58d57448c904 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:57.077270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4a252-93dc-4341-bad0-58d57448c904 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:57.095981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:57.096829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:57.097111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:57.097387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles/9921815a34234b7a951fc9766192de0b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:57.111169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6e3ad3e18991492e9a015633338aa897, role_id=9921815a34234b7a951fc9766192de0b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:57.113170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:57.142045 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Could not find role: 9921815a34234b7a951fc9766192de0b.: keystone.exception.RoleNotFound: Could not find role: 9921815a34234b7a951fc9766192de0b. Feb 19 21:16:57.142971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3700/7393] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Feb 19 21:16:57 2022] HEAD /identity/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897/roles/9921815a34234b7a951fc9766192de0b => generated 0 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:16:57.147726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:57.162669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade279f2-41d9-4c6d-8363-dc856565f10e tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:57.171150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:57.172080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:57.172423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:57.172963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:57.182982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorizing `identity:delete_trust(trust_id=6e3ad3e18991492e9a015633338aa897)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:57.184651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:57.222441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6e3ad3e18991492e9a015633338aa897', 'request_id': 'req-1d1221d0-2ff7-416e-8efa-7ba0d0314918'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:57.234605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6e3ad3e18991492e9a015633338aa897', 'request_id': 'req-1d1221d0-2ff7-416e-8efa-7ba0d0314918'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:57.235433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6e3ad3e18991492e9a015633338aa897', 'request_id': 'req-1d1221d0-2ff7-416e-8efa-7ba0d0314918'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:57.252545 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3694/7394] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:16:57 2022] DELETE /identity/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:57.253427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:57.255290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:57.276304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f11b-335b-4190-a376-4f7775104740 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:57.290384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fc083-efc0-4dd6-beef-0a357f896233 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e8dcbd3d0841df958cd3d632855ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c3d54e921e444c7b06536a858864493', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1743883851', 'tempest-DelegatedRole-1560741571'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:57.291250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc083-efc0-4dd6-beef-0a357f896233 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:57.291533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc083-efc0-4dd6-beef-0a357f896233 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:57.291816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc083-efc0-4dd6-beef-0a357f896233 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] PATH_INFO: `/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:57.317057 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-7c1fc083-efc0-4dd6-beef-0a357f896233 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Could not find trust: 6e3ad3e18991492e9a015633338aa897.: keystone.exception.TrustNotFound: Could not find trust: 6e3ad3e18991492e9a015633338aa897. Feb 19 21:16:57.320821 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3701/7395] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:16:57 2022] GET /identity/v3/OS-TRUST/trusts/6e3ad3e18991492e9a015633338aa897 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:16:57.323651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:57.325274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:57.365538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1221d0-2ff7-416e-8efa-7ba0d0314918 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:57.379566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:57.380864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:57.381314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:57.381771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/9921815a34234b7a951fc9766192de0b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:57.386425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9921815a34234b7a951fc9766192de0b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:57.389630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:57.481089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role 9921815a34234b7a951fc9766192de0b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:57.482864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:57.485592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:57.487710 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3695/7396] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:57 2022] DELETE /identity/v3/roles/9921815a34234b7a951fc9766192de0b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:57.493863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fc083-efc0-4dd6-beef-0a357f896233 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:57.495869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c1fc083-efc0-4dd6-beef-0a357f896233 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:57.512714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fc083-efc0-4dd6-beef-0a357f896233 tempest-TrustsV3TestJSON-1594304584 tempest-user-1381677244] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:57.625853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:57.626742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:57.627026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:57.627307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/4c1e71ce99be47f6964fbe1d975a6eb1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:57.633935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4c1e71ce99be47f6964fbe1d975a6eb1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:57.637853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:57.728515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role 4c1e71ce99be47f6964fbe1d975a6eb1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:57.729250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:57.730173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:57.733085 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3702/7397] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:57 2022] DELETE /identity/v3/roles/4c1e71ce99be47f6964fbe1d975a6eb1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:57.737073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:57.752885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caadc3-f8db-41c2-857b-f1b1305e0f52 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:57.846129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:57.847248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:57.847594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:57.848071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users/62e8dcbd3d0841df958cd3d632855ea6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:57.849468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_user(user_id=62e8dcbd3d0841df958cd3d632855ea6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:57.851709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:57.952686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e8dcbd3d0841df958cd3d632855ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:57.986454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e8dcbd3d0841df958cd3d632855ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.007298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e8dcbd3d0841df958cd3d632855ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.007896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e8dcbd3d0841df958cd3d632855ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.008753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e8dcbd3d0841df958cd3d632855ea6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.063678 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3696/7398] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:57 2022] DELETE /identity/v3/users/62e8dcbd3d0841df958cd3d632855ea6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:58.068867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:58.071109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:58.115360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4afd-9218-4cf6-b039-25a669c70ee5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:58.301026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:58.309729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:58.311246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:58.312168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/7c3d54e921e444c7b06536a858864493` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:58.315715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c3d54e921e444c7b06536a858864493)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:58.319993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:58.385132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:58.391599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:58.475064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3d54e921e444c7b06536a858864493', 'request_id': 'req-76115cd0-30fe-449e-a834-f8e480e12f26'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.490148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3d54e921e444c7b06536a858864493', 'request_id': 'req-76115cd0-30fe-449e-a834-f8e480e12f26'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.516287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3d54e921e444c7b06536a858864493', 'request_id': 'req-76115cd0-30fe-449e-a834-f8e480e12f26'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.550365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] The token cache is being invalidate because project 7c3d54e921e444c7b06536a858864493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:16:58.550703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.551027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4e5bc-f89f-47cc-aeea-206d5f1243a8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:58.554136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.560838 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3703/7399] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:58 2022] DELETE /identity/v3/projects/7c3d54e921e444c7b06536a858864493 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:58.564785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:58.564893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:58.719144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:58.722267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:58.723552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:58.725432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] PATH_INFO: `/v3/users/126237d240b149edb02ffdf3d1f64863` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:58.730562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76115cd0-30fe-449e-a834-f8e480e12f26 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:58.733644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] RBAC: Authorizing `identity:delete_user(user_id=126237d240b149edb02ffdf3d1f64863)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:58.743683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:58.761376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a82b12-c63d-4dc2-b3a7-c81b30da0174 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:58.762757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82b12-c63d-4dc2-b3a7-c81b30da0174 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:58.764172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82b12-c63d-4dc2-b3a7-c81b30da0174 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:58.764172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82b12-c63d-4dc2-b3a7-c81b30da0174 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:58.767635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a82b12-c63d-4dc2-b3a7-c81b30da0174 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:58.774029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a82b12-c63d-4dc2-b3a7-c81b30da0174 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:58.834142 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3704/7400] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:16:58 2022] POST /identity/v3/projects => generated 328 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:16:58.842207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a82b12-c63d-4dc2-b3a7-c81b30da0174 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:58.880037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126237d240b149edb02ffdf3d1f64863'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.926751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126237d240b149edb02ffdf3d1f64863'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.950385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126237d240b149edb02ffdf3d1f64863'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.951266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126237d240b149edb02ffdf3d1f64863'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.951954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5bdf9a52-0d71-4635-830c-e26c57c3756b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126237d240b149edb02ffdf3d1f64863'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:16:58.991995 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3697/7401] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:16:58 2022] DELETE /identity/v3/users/126237d240b149edb02ffdf3d1f64863 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:16:58.998850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589bfb0-483a-4c50-9e16-ae6678f91cfc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:58.999368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589bfb0-483a-4c50-9e16-ae6678f91cfc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:58.999849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589bfb0-483a-4c50-9e16-ae6678f91cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.004971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a82b12-c63d-4dc2-b3a7-c81b30da0174 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:59.023899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a589bfb0-483a-4c50-9e16-ae6678f91cfc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:59.026291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a589bfb0-483a-4c50-9e16-ae6678f91cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:59.155999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:59.156731 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3698/7402] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:16:59.157193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:59.157474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:59.157746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.158459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:59.160708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:59.167334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589bfb0-483a-4c50-9e16-ae6678f91cfc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:59.169890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a589bfb0-483a-4c50-9e16-ae6678f91cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:59.211692 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3705/7403] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:16:58 2022] POST /identity/v3/users => generated 416 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:59.217682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:59.221629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:59.244675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44225c-24f0-4aa5-b0a1-9db2f586ff19 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:59.253886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c4f7d-ec18-433e-bdbb-6d01bd11dc3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:59.255176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c4f7d-ec18-433e-bdbb-6d01bd11dc3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:59.255176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c4f7d-ec18-433e-bdbb-6d01bd11dc3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:59.255392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c4f7d-ec18-433e-bdbb-6d01bd11dc3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.256713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c4f7d-ec18-433e-bdbb-6d01bd11dc3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:59.259172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c4f7d-ec18-433e-bdbb-6d01bd11dc3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:59.283843 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3706/7404] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:16:59 2022] POST /identity/v3/roles => generated 244 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:59.287808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c4f7d-ec18-433e-bdbb-6d01bd11dc3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:59.301456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c4f7d-ec18-433e-bdbb-6d01bd11dc3a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:59.311718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d04e-a8f7-4a60-8828-8fedee1b0811 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:59.313092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d04e-a8f7-4a60-8828-8fedee1b0811 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:59.313602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d04e-a8f7-4a60-8828-8fedee1b0811 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:59.314098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d04e-a8f7-4a60-8828-8fedee1b0811 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.315617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8d04e-a8f7-4a60-8828-8fedee1b0811 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:59.318363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8d04e-a8f7-4a60-8828-8fedee1b0811 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:59.350217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589bfb0-483a-4c50-9e16-ae6678f91cfc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:59.359246 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3707/7405] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:16:59 2022] POST /identity/v3/roles => generated 247 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:16:59.360626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d04e-a8f7-4a60-8828-8fedee1b0811 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:59.365878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae345ff-7d65-499f-8753-b4ca50e66092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:59.366541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae345ff-7d65-499f-8753-b4ca50e66092 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:59.366870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae345ff-7d65-499f-8753-b4ca50e66092 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:59.367430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae345ff-7d65-499f-8753-b4ca50e66092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.382144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d04e-a8f7-4a60-8828-8fedee1b0811 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:59.385284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae345ff-7d65-499f-8753-b4ca50e66092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:59.387640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae345ff-7d65-499f-8753-b4ca50e66092 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:59.394109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645cd74-acd6-4c14-900a-66f6f2a81288 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:59.395081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645cd74-acd6-4c14-900a-66f6f2a81288 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:59.395366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645cd74-acd6-4c14-900a-66f6f2a81288 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:59.396848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645cd74-acd6-4c14-900a-66f6f2a81288 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/fb8355b9b4b04ae9a94367a12606b031/users/3d18e2224a8b4947b4d2ec5c9be51a64/roles/7710f67768064909b96b6767b7aeadce` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.415185 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3699/7406] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:16:59.428827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645cd74-acd6-4c14-900a-66f6f2a81288 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fb8355b9b4b04ae9a94367a12606b031, user_id=3d18e2224a8b4947b4d2ec5c9be51a64, role_id=7710f67768064909b96b6767b7aeadce)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:59.432143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645cd74-acd6-4c14-900a-66f6f2a81288 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:59.460409 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3708/7407] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:59 2022] PUT /identity/v3/projects/fb8355b9b4b04ae9a94367a12606b031/users/3d18e2224a8b4947b4d2ec5c9be51a64/roles/7710f67768064909b96b6767b7aeadce => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:59.464549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae345ff-7d65-499f-8753-b4ca50e66092 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:59.483741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae345ff-7d65-499f-8753-b4ca50e66092 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:59.591840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65afeae-9937-4935-b588-ceb9601e4afa tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:59.593056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65afeae-9937-4935-b588-ceb9601e4afa tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:59.593500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65afeae-9937-4935-b588-ceb9601e4afa tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:59.593937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65afeae-9937-4935-b588-ceb9601e4afa tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/fb8355b9b4b04ae9a94367a12606b031/users/3d18e2224a8b4947b4d2ec5c9be51a64/roles/de0d32d130de444c9380b127593b00fe` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.597223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65afeae-9937-4935-b588-ceb9601e4afa tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fb8355b9b4b04ae9a94367a12606b031, user_id=3d18e2224a8b4947b4d2ec5c9be51a64, role_id=de0d32d130de444c9380b127593b00fe)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:59.600522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65afeae-9937-4935-b588-ceb9601e4afa tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:59.624404 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3700/7408] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:16:59 2022] PUT /identity/v3/projects/fb8355b9b4b04ae9a94367a12606b031/users/3d18e2224a8b4947b4d2ec5c9be51a64/roles/de0d32d130de444c9380b127593b00fe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:16:59.631400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645cd74-acd6-4c14-900a-66f6f2a81288 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:59.647342 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645cd74-acd6-4c14-900a-66f6f2a81288 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:16:59.802969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:16:59.804500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:59.804790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:59.805072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.806173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:16:59.813160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:16:59.867138 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3709/7409] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:16:59 2022] GET /identity/v3/users => generated 8064 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:16:59.872234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c235dc-66be-49c4-b5f1-24b4a78a21de None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:16:59.874196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c235dc-66be-49c4-b5f1-24b4a78a21de None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:16:59.874736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c235dc-66be-49c4-b5f1-24b4a78a21de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:16:59.938870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:16:59.941100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:16:59.959561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-80c235dc-66be-49c4-b5f1-24b4a78a21de None None] MFA Rules not processed for user `3d18e2224a8b4947b4d2ec5c9be51a64`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:16:59.959561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-80c235dc-66be-49c4-b5f1-24b4a78a21de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:00.100135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84636b92-2b9f-4d1a-9df8-ff4a5bbbfec8 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:00.123162 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3701/7410] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:00.128633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:00.133635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e41b6-023f-4c68-ba81-26deba1bb4dd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:00.133923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e41b6-023f-4c68-ba81-26deba1bb4dd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:00.134257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e41b6-023f-4c68-ba81-26deba1bb4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:00.136581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:00.136860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:00.137135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] PATH_INFO: `/v3/projects/a0f555126ca64a3b8f54ce6a8470f9f5` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:00.139723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f555126ca64a3b8f54ce6a8470f9f5)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:00.143583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:00.171391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-804e41b6-023f-4c68-ba81-26deba1bb4dd None None] MFA Rules not processed for user `3d18e2224a8b4947b4d2ec5c9be51a64`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:00.172786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-804e41b6-023f-4c68-ba81-26deba1bb4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:00.187110 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3702/7411] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:00.192662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e41b6-023f-4c68-ba81-26deba1bb4dd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:00.206556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e41b6-023f-4c68-ba81-26deba1bb4dd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:00.212488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d18e2224a8b4947b4d2ec5c9be51a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb8355b9b4b04ae9a94367a12606b031', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1851887306', 'tempest-DelegatedRole-1341334163'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:00.213207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:00.213367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:00.213630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:00.219777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] RBAC: Authorizing `identity:create_trust()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:00.221256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:00.247175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f555126ca64a3b8f54ce6a8470f9f5', 'request_id': 'req-5e67ee29-3a1f-4950-b44f-0fa8eb792979'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.258286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f555126ca64a3b8f54ce6a8470f9f5', 'request_id': 'req-5e67ee29-3a1f-4950-b44f-0fa8eb792979'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.269828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f555126ca64a3b8f54ce6a8470f9f5', 'request_id': 'req-5e67ee29-3a1f-4950-b44f-0fa8eb792979'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.309488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] The token cache is being invalidate because project a0f555126ca64a3b8f54ce6a8470f9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:00.309783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.311089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.338389 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3710/7412] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:16:59 2022] DELETE /identity/v3/projects/a0f555126ca64a3b8f54ce6a8470f9f5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:00.344466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:00.346560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:00.365265 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Feb 19 21:17:00.366785 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3703/7413] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 21:17:00 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 179 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Feb 19 21:17:00.370947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:00.373348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:00.397996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e601fc-5f55-416f-9d09-2e7d4b3e6f2f tempest-TrustsV3TestJSON-722910353 tempest-user-1834506641] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:00.452716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67ee29-3a1f-4950-b44f-0fa8eb792979 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:00.458283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:00.460860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:00.460860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:00.460860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] PATH_INFO: `/v3/users/63b039f7781e4e4f8413ee9ef50beaf0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:00.461723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b039f7781e4e4f8413ee9ef50beaf0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:00.463786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:00.469246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:00.470547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:00.471240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:00.472563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/de0d32d130de444c9380b127593b00fe` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:00.474460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=de0d32d130de444c9380b127593b00fe)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:00.476627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:00.534902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role de0d32d130de444c9380b127593b00fe has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:00.535350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.536395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.540242 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3704/7414] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:00 2022] DELETE /identity/v3/roles/de0d32d130de444c9380b127593b00fe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:00.552538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:00.555236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:00.579304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b039f7781e4e4f8413ee9ef50beaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.580270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b039f7781e4e4f8413ee9ef50beaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.583197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b039f7781e4e4f8413ee9ef50beaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.599132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b039f7781e4e4f8413ee9ef50beaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.635926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b039f7781e4e4f8413ee9ef50beaf0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.657080 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3711/7415] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:00 2022] DELETE /identity/v3/users/63b039f7781e4e4f8413ee9ef50beaf0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:00.690013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834e712-9c8a-4e57-a5b0-b9ef543fa072 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:00.816522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:00.820604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:00.821531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:00.822019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/7710f67768064909b96b6767b7aeadce` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:00.824466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7710f67768064909b96b6767b7aeadce)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:00.826959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:00.881656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role 7710f67768064909b96b6767b7aeadce has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:00.882609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.882609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:00.884641 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3705/7416] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:00 2022] DELETE /identity/v3/roles/7710f67768064909b96b6767b7aeadce => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:00.889695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:00.892426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:00.910866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54045f-b4b6-4d08-8cc9-adb64fda40cd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:00.974680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:00.975577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:00.975857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:00.976138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users/3d18e2224a8b4947b4d2ec5c9be51a64` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:00.977475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3d18e2224a8b4947b4d2ec5c9be51a64)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:00.979633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:01.053578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d18e2224a8b4947b4d2ec5c9be51a64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.054323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d18e2224a8b4947b4d2ec5c9be51a64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.055192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d18e2224a8b4947b4d2ec5c9be51a64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.071949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d18e2224a8b4947b4d2ec5c9be51a64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.084098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d18e2224a8b4947b4d2ec5c9be51a64'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.118324 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3712/7417] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:00 2022] DELETE /identity/v3/users/3d18e2224a8b4947b4d2ec5c9be51a64 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:01.125358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:01.126602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:01.138557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:01.143967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:01.290361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd527a-d9b6-48b7-b4c1-7d55dacb0218 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:01.298063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363c12-636c-4bd8-8494-9499b87c0952 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:01.311967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:01.312995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:01.313351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:01.313979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/fb8355b9b4b04ae9a94367a12606b031` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:01.316452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fb8355b9b4b04ae9a94367a12606b031)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:01.319362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:01.415697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:01.417154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:01.417154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:01.417361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] PATH_INFO: `/v3/projects/16ead202d6b84d91a5f9467961fdedab` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:01.418576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ead202d6b84d91a5f9467961fdedab)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:01.420749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:01.421799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8355b9b4b04ae9a94367a12606b031', 'request_id': 'req-60178f80-c8fe-45d6-aea7-de3acba81b17'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.430506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8355b9b4b04ae9a94367a12606b031', 'request_id': 'req-60178f80-c8fe-45d6-aea7-de3acba81b17'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.451134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8355b9b4b04ae9a94367a12606b031', 'request_id': 'req-60178f80-c8fe-45d6-aea7-de3acba81b17'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.470635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] The token cache is being invalidate because project fb8355b9b4b04ae9a94367a12606b031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:01.470916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.473743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.477284 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3713/7418] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:01 2022] DELETE /identity/v3/projects/fb8355b9b4b04ae9a94367a12606b031 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:01.485572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:01.488302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:01.503508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ead202d6b84d91a5f9467961fdedab', 'request_id': 'req-ff50b968-cc8d-4494-b761-28f3bb79a795'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.520389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ead202d6b84d91a5f9467961fdedab', 'request_id': 'req-ff50b968-cc8d-4494-b761-28f3bb79a795'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.524706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ead202d6b84d91a5f9467961fdedab', 'request_id': 'req-ff50b968-cc8d-4494-b761-28f3bb79a795'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.549597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] The token cache is being invalidate because project 16ead202d6b84d91a5f9467961fdedab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:01.550972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.551932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ff50b968-cc8d-4494-b761-28f3bb79a795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:01.555970 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3706/7419] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:01 2022] DELETE /identity/v3/projects/16ead202d6b84d91a5f9467961fdedab => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:01.562192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45526-f654-47b9-9e4c-1b4cbdb4eaf0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:01.568456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45526-f654-47b9-9e4c-1b4cbdb4eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:01.569070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45526-f654-47b9-9e4c-1b4cbdb4eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:01.618820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-83f45526-f654-47b9-9e4c-1b4cbdb4eaf0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:01.620779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-83f45526-f654-47b9-9e4c-1b4cbdb4eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:01.649613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60178f80-c8fe-45d6-aea7-de3acba81b17 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:01.777168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:01.778354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:01.778354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:01.778602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:01.779678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:01.782450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:01.809178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3707/7420] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:01.816895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675240-4dae-45e2-9d93-396a48091248 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:01.817929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3714/7421] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:17:01 2022] POST /identity/v3/projects => generated 328 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:01.818162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675240-4dae-45e2-9d93-396a48091248 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:01.819899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675240-4dae-45e2-9d93-396a48091248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:01.825489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:01.831933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:01.884371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8c675240-4dae-45e2-9d93-396a48091248 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:01.886350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c675240-4dae-45e2-9d93-396a48091248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:01.975038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea48e2-3608-47e2-aa6b-7fb41381a2ac tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:01.987114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62ab4-6891-4253-9e30-b37c04828de6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:01.988515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62ab4-6891-4253-9e30-b37c04828de6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:01.989773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62ab4-6891-4253-9e30-b37c04828de6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:01.991071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62ab4-6891-4253-9e30-b37c04828de6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:01.992363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a62ab4-6891-4253-9e30-b37c04828de6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:01.998457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a62ab4-6891-4253-9e30-b37c04828de6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.023762 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3708/7422] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:02.027799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c675240-4dae-45e2-9d93-396a48091248 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.068663 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3715/7423] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:01 2022] POST /identity/v3/users => generated 416 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:02.075224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62ab4-6891-4253-9e30-b37c04828de6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.081976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c675240-4dae-45e2-9d93-396a48091248 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.103686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.105558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.105846 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.106128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.110855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:02.111172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.113704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62ab4-6891-4253-9e30-b37c04828de6 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.119895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.131603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aabceb-06c6-47b5-b578-2e238388a42f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.132235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabceb-06c6-47b5-b578-2e238388a42f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.132559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabceb-06c6-47b5-b578-2e238388a42f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.132823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabceb-06c6-47b5-b578-2e238388a42f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.139795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aabceb-06c6-47b5-b578-2e238388a42f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.142861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aabceb-06c6-47b5-b578-2e238388a42f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.154818 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3709/7424] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:02.157880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.176436 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3716/7425] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:17:02 2022] POST /identity/v3/roles => generated 244 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:02.181190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aabceb-06c6-47b5-b578-2e238388a42f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.184229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7af2e9-12bc-409c-9f65-55d3e90c731e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.194896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1158c-f052-412d-98e0-19c9f3ccf9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.195732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1158c-f052-412d-98e0-19c9f3ccf9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.196024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1158c-f052-412d-98e0-19c9f3ccf9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.198546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1158c-f052-412d-98e0-19c9f3ccf9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.199317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1158c-f052-412d-98e0-19c9f3ccf9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.205187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aabceb-06c6-47b5-b578-2e238388a42f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.205514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1158c-f052-412d-98e0-19c9f3ccf9b2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.215736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c048f-0763-441f-afaa-b306f4b18ee7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.217863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c048f-0763-441f-afaa-b306f4b18ee7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.220637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c048f-0763-441f-afaa-b306f4b18ee7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.220935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c048f-0763-441f-afaa-b306f4b18ee7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.224615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c048f-0763-441f-afaa-b306f4b18ee7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.226143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c048f-0763-441f-afaa-b306f4b18ee7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.270473 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3717/7426] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:17:02 2022] POST /identity/v3/roles => generated 245 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:02.272723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c048f-0763-441f-afaa-b306f4b18ee7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.289662 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3710/7427] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:02 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:02.295260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1158c-f052-412d-98e0-19c9f3ccf9b2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.301446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c048f-0763-441f-afaa-b306f4b18ee7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.427297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1158c-f052-412d-98e0-19c9f3ccf9b2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.447460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0014-c4da-4f77-9e18-0bee9318b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.449131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0014-c4da-4f77-9e18-0bee9318b92c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.449940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0014-c4da-4f77-9e18-0bee9318b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.451515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0014-c4da-4f77-9e18-0bee9318b92c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.453281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c0014-c4da-4f77-9e18-0bee9318b92c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.457173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbceb0-777c-413b-9a38-5c9b1d38d614 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.458398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbceb0-777c-413b-9a38-5c9b1d38d614 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.458899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbceb0-777c-413b-9a38-5c9b1d38d614 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.459262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c0014-c4da-4f77-9e18-0bee9318b92c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.459623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbceb0-777c-413b-9a38-5c9b1d38d614 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/2ecf37b672a64cc4a3882ff102489887/users/e22f49e9f4fa4a22ac265576619023cd/roles/383ade2f1b164fcd9a911c2fac6a709f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.484514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbceb0-777c-413b-9a38-5c9b1d38d614 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2ecf37b672a64cc4a3882ff102489887, user_id=e22f49e9f4fa4a22ac265576619023cd, role_id=383ade2f1b164fcd9a911c2fac6a709f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.487919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbceb0-777c-413b-9a38-5c9b1d38d614 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.510708 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3718/7428] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:02 2022] PUT /identity/v3/projects/2ecf37b672a64cc4a3882ff102489887/users/e22f49e9f4fa4a22ac265576619023cd/roles/383ade2f1b164fcd9a911c2fac6a709f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:02.524201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbceb0-777c-413b-9a38-5c9b1d38d614 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.531263 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3711/7429] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:02 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:02.533320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0014-c4da-4f77-9e18-0bee9318b92c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.560756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0014-c4da-4f77-9e18-0bee9318b92c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.683736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbceb0-777c-413b-9a38-5c9b1d38d614 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.706612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c366-a1ce-4dd8-b21f-a10f502309b0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.709421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c366-a1ce-4dd8-b21f-a10f502309b0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.710811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c366-a1ce-4dd8-b21f-a10f502309b0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.711294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c366-a1ce-4dd8-b21f-a10f502309b0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/2ecf37b672a64cc4a3882ff102489887/users/e22f49e9f4fa4a22ac265576619023cd/roles/de739bab9e814c5eab4b44d418893c19` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.724961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0c366-a1ce-4dd8-b21f-a10f502309b0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2ecf37b672a64cc4a3882ff102489887, user_id=e22f49e9f4fa4a22ac265576619023cd, role_id=de739bab9e814c5eab4b44d418893c19)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.731684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0c366-a1ce-4dd8-b21f-a10f502309b0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.749593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2284b9-1f87-454f-a6de-4fcb3b5577fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.752500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2284b9-1f87-454f-a6de-4fcb3b5577fd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.753914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2284b9-1f87-454f-a6de-4fcb3b5577fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.754296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2284b9-1f87-454f-a6de-4fcb3b5577fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.756232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2284b9-1f87-454f-a6de-4fcb3b5577fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.761232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2284b9-1f87-454f-a6de-4fcb3b5577fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.774686 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3719/7430] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:02 2022] PUT /identity/v3/projects/2ecf37b672a64cc4a3882ff102489887/users/e22f49e9f4fa4a22ac265576619023cd/roles/de739bab9e814c5eab4b44d418893c19 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:02.776777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c366-a1ce-4dd8-b21f-a10f502309b0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.796397 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3712/7431] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:02 2022] GET /identity/v3/roles => generated 1891 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:02.798079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2284b9-1f87-454f-a6de-4fcb3b5577fd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:02.827226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2284b9-1f87-454f-a6de-4fcb3b5577fd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.936749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c366-a1ce-4dd8-b21f-a10f502309b0 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:02.947985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f009e-220c-476c-b4f0-b01ae9aff4d5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.951242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f009e-220c-476c-b4f0-b01ae9aff4d5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.951658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f009e-220c-476c-b4f0-b01ae9aff4d5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.951868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f009e-220c-476c-b4f0-b01ae9aff4d5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.952746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f009e-220c-476c-b4f0-b01ae9aff4d5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.959830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f009e-220c-476c-b4f0-b01ae9aff4d5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:02.977981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797b372-87bf-45fe-a7d2-3fbcf33a1b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:02.978671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b372-87bf-45fe-a7d2-3fbcf33a1b1b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:02.978952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b372-87bf-45fe-a7d2-3fbcf33a1b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:02.979228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b372-87bf-45fe-a7d2-3fbcf33a1b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:02.979949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b372-87bf-45fe-a7d2-3fbcf33a1b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:02.987740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b372-87bf-45fe-a7d2-3fbcf33a1b1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.012143 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3713/7432] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:02 2022] GET /identity/v3/roles => generated 1891 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:17:03.012727 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3720/7433] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:02 2022] GET /identity/v3/users => generated 8038 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:03.014523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797b372-87bf-45fe-a7d2-3fbcf33a1b1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.015864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9adf7c-4b69-4278-ac62-788fe5c8d4ec None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.016206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9adf7c-4b69-4278-ac62-788fe5c8d4ec None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.017065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9adf7c-4b69-4278-ac62-788fe5c8d4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.024961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797b372-87bf-45fe-a7d2-3fbcf33a1b1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:03.031439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c43afa-5b70-462b-928d-e09651dcf592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:03.032372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43afa-5b70-462b-928d-e09651dcf592 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.032657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43afa-5b70-462b-928d-e09651dcf592 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.032935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43afa-5b70-462b-928d-e09651dcf592 admin admin] PATH_INFO: `/v3/projects/3602d6ecd5b146f2a12a8609607cbabe/users/36d2f6bc5a804890b3d364b11ea4d6d8/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.057048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c43afa-5b70-462b-928d-e09651dcf592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3602d6ecd5b146f2a12a8609607cbabe, user_id=36d2f6bc5a804890b3d364b11ea4d6d8, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:03.061045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c43afa-5b70-462b-928d-e09651dcf592 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.087266 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3714/7434] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:03 2022] PUT /identity/v3/projects/3602d6ecd5b146f2a12a8609607cbabe/users/36d2f6bc5a804890b3d364b11ea4d6d8/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:03.097258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69cf5-87ff-4788-b610-a0ef7be472bd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.097886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69cf5-87ff-4788-b610-a0ef7be472bd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.098401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69cf5-87ff-4788-b610-a0ef7be472bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.101154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2f9adf7c-4b69-4278-ac62-788fe5c8d4ec None None] MFA Rules not processed for user `e22f49e9f4fa4a22ac265576619023cd`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:03.102934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2f9adf7c-4b69-4278-ac62-788fe5c8d4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:03.172849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-38c69cf5-87ff-4788-b610-a0ef7be472bd None None] MFA Rules not processed for user `36d2f6bc5a804890b3d364b11ea4d6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:03.186122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-38c69cf5-87ff-4788-b610-a0ef7be472bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:03.214648 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3721/7435] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:03.216920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975513-19e4-471d-a37e-a7b5e773539e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.220546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975513-19e4-471d-a37e-a7b5e773539e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.220842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975513-19e4-471d-a37e-a7b5e773539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.270720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-49975513-19e4-471d-a37e-a7b5e773539e None None] MFA Rules not processed for user `e22f49e9f4fa4a22ac265576619023cd`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:03.272216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-49975513-19e4-471d-a37e-a7b5e773539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:03.296800 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3722/7436] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:03.301208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975513-19e4-471d-a37e-a7b5e773539e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.323149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975513-19e4-471d-a37e-a7b5e773539e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:03.333185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76487c0b-3153-4683-9193-f35cf641a36c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:03.334334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487c0b-3153-4683-9193-f35cf641a36c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.334620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487c0b-3153-4683-9193-f35cf641a36c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.335806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487c0b-3153-4683-9193-f35cf641a36c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.339689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76487c0b-3153-4683-9193-f35cf641a36c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorizing `identity:create_trust()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:03.341018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76487c0b-3153-4683-9193-f35cf641a36c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.360607 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3715/7437] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:03.364961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69cf5-87ff-4788-b610-a0ef7be472bd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.528902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69cf5-87ff-4788-b610-a0ef7be472bd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:03.538592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831669b-11b4-4303-8814-4400cd8329b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:03.539853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831669b-11b4-4303-8814-4400cd8329b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.540386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831669b-11b4-4303-8814-4400cd8329b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.541966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831669b-11b4-4303-8814-4400cd8329b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.542982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831669b-11b4-4303-8814-4400cd8329b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:03.546943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831669b-11b4-4303-8814-4400cd8329b2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.553133 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3723/7438] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 21:17:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:03.554452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76487c0b-3153-4683-9193-f35cf641a36c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.567210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76487c0b-3153-4683-9193-f35cf641a36c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:03.573706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23894cf-e2df-47f3-92bc-d0beac0a5160 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:03.574740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23894cf-e2df-47f3-92bc-d0beac0a5160 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.575120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23894cf-e2df-47f3-92bc-d0beac0a5160 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.575273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23894cf-e2df-47f3-92bc-d0beac0a5160 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.584810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23894cf-e2df-47f3-92bc-d0beac0a5160 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorizing `identity:get_trust(trust_id=1461581f1b4e44688957bcced68ef608)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:03.586431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23894cf-e2df-47f3-92bc-d0beac0a5160 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.597050 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3724/7439] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:17:03 2022] GET /identity/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608 => generated 834 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:03.602689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23894cf-e2df-47f3-92bc-d0beac0a5160 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.615295 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3716/7440] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:03 2022] POST /identity/v3/projects => generated 367 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:03.620131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23894cf-e2df-47f3-92bc-d0beac0a5160 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:03.621229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831669b-11b4-4303-8814-4400cd8329b2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.745093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cfa1b-98f6-4108-9fc4-ffa9819a197a tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:03.746012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cfa1b-98f6-4108-9fc4-ffa9819a197a tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.749112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cfa1b-98f6-4108-9fc4-ffa9819a197a tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.749487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cfa1b-98f6-4108-9fc4-ffa9819a197a tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.765082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cfa1b-98f6-4108-9fc4-ffa9819a197a tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=1461581f1b4e44688957bcced68ef608)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:03.775657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cfa1b-98f6-4108-9fc4-ffa9819a197a tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.784389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831669b-11b4-4303-8814-4400cd8329b2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:03.802422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca79c7-cd69-4203-a9c2-46892fd6987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:03.803484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca79c7-cd69-4203-a9c2-46892fd6987e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.803935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca79c7-cd69-4203-a9c2-46892fd6987e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.804461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca79c7-cd69-4203-a9c2-46892fd6987e admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.805474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca79c7-cd69-4203-a9c2-46892fd6987e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:03.822509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca79c7-cd69-4203-a9c2-46892fd6987e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.866450 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3725/7441] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:17:03 2022] GET /identity/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles => generated 371 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:03.885321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cfa1b-98f6-4108-9fc4-ffa9819a197a tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.893606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3717/7442] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:03 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:03.897891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca79c7-cd69-4203-a9c2-46892fd6987e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.903406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cfa1b-98f6-4108-9fc4-ffa9819a197a tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:03.910259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8968d4-8b13-4dc5-a96c-71cec4437d75 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:03.912250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8968d4-8b13-4dc5-a96c-71cec4437d75 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.912802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8968d4-8b13-4dc5-a96c-71cec4437d75 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.913473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8968d4-8b13-4dc5-a96c-71cec4437d75 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles/383ade2f1b164fcd9a911c2fac6a709f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.930067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca79c7-cd69-4203-a9c2-46892fd6987e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:03.936357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514bf7-ced3-46b8-bc0e-126b14ed5ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:03.937131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514bf7-ced3-46b8-bc0e-126b14ed5ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:03.937414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514bf7-ced3-46b8-bc0e-126b14ed5ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:03.937693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514bf7-ced3-46b8-bc0e-126b14ed5ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:03.938560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74514bf7-ced3-46b8-bc0e-126b14ed5ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:03.940203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74514bf7-ced3-46b8-bc0e-126b14ed5ca1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.957285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8968d4-8b13-4dc5-a96c-71cec4437d75 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1461581f1b4e44688957bcced68ef608, role_id=383ade2f1b164fcd9a911c2fac6a709f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:03.959241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8968d4-8b13-4dc5-a96c-71cec4437d75 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:03.974349 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3726/7443] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Feb 19 21:17:03 2022] GET /identity/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles/383ade2f1b164fcd9a911c2fac6a709f => generated 244 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:03.979507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8968d4-8b13-4dc5-a96c-71cec4437d75 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:03.998401 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3718/7444] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:03 2022] GET /identity/v3/roles => generated 1891 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:17:03.999863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514bf7-ced3-46b8-bc0e-126b14ed5ca1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.000035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8968d4-8b13-4dc5-a96c-71cec4437d75 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.012022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521b03f-59f7-410b-8c68-47cb4f95f5e7 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.012927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521b03f-59f7-410b-8c68-47cb4f95f5e7 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.014068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521b03f-59f7-410b-8c68-47cb4f95f5e7 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.014476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521b03f-59f7-410b-8c68-47cb4f95f5e7 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles/383ade2f1b164fcd9a911c2fac6a709f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.021629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514bf7-ced3-46b8-bc0e-126b14ed5ca1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.029615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521b03f-59f7-410b-8c68-47cb4f95f5e7 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1461581f1b4e44688957bcced68ef608, role_id=383ade2f1b164fcd9a911c2fac6a709f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:04.031378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521b03f-59f7-410b-8c68-47cb4f95f5e7 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:04.059589 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3727/7445] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Feb 19 21:17:03 2022] HEAD /identity/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles/383ade2f1b164fcd9a911c2fac6a709f => generated 0 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Feb 19 21:17:04.061261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521b03f-59f7-410b-8c68-47cb4f95f5e7 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.062464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d34c1-0076-4d98-aa8e-df19b7df6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.063386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d34c1-0076-4d98-aa8e-df19b7df6659 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.063665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d34c1-0076-4d98-aa8e-df19b7df6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.063945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d34c1-0076-4d98-aa8e-df19b7df6659 admin admin] PATH_INFO: `/v3/projects/e06193abd1d34eaab32fdda1693b0ed4/users/153cadd1b1ab4be9981ef151c354f4b0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.100956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521b03f-59f7-410b-8c68-47cb4f95f5e7 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.124744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.126239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d34c1-0076-4d98-aa8e-df19b7df6659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06193abd1d34eaab32fdda1693b0ed4, user_id=153cadd1b1ab4be9981ef151c354f4b0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:04.127996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.128286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.128593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles/de739bab9e814c5eab4b44d418893c19` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.128836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d34c1-0076-4d98-aa8e-df19b7df6659 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:04.176818 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3719/7446] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:03 2022] PUT /identity/v3/projects/e06193abd1d34eaab32fdda1693b0ed4/users/153cadd1b1ab4be9981ef151c354f4b0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:04.177298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1461581f1b4e44688957bcced68ef608, role_id=de739bab9e814c5eab4b44d418893c19)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:04.178744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d34c1-0076-4d98-aa8e-df19b7df6659 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.183352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:04.215411 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Could not find role: de739bab9e814c5eab4b44d418893c19.: keystone.exception.RoleNotFound: Could not find role: de739bab9e814c5eab4b44d418893c19. Feb 19 21:17:04.220151 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3728/7447] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Feb 19 21:17:04 2022] GET /identity/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles/de739bab9e814c5eab4b44d418893c19 => generated 110 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:17:04.224545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.275329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d216a-bce4-407c-aae5-e31b8809dbde tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.298531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d34c1-0076-4d98-aa8e-df19b7df6659 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.309276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3afb4-b512-42cc-81b0-f587a0aa1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.311906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3afb4-b512-42cc-81b0-f587a0aa1cad admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.312302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3afb4-b512-42cc-81b0-f587a0aa1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.315081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3afb4-b512-42cc-81b0-f587a0aa1cad admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.315959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3afb4-b512-42cc-81b0-f587a0aa1cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:04.320675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3afb4-b512-42cc-81b0-f587a0aa1cad admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:04.350722 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3720/7448] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:04 2022] GET /identity/v3/roles => generated 1891 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:17:04.353247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3afb4-b512-42cc-81b0-f587a0aa1cad admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.380946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3afb4-b512-42cc-81b0-f587a0aa1cad admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.399558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892b6d1-e8ed-4536-aac7-dd8b83bbd36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.401242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b6d1-e8ed-4536-aac7-dd8b83bbd36b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.401705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b6d1-e8ed-4536-aac7-dd8b83bbd36b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.403006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b6d1-e8ed-4536-aac7-dd8b83bbd36b admin admin] PATH_INFO: `/v3/projects/e06193abd1d34eaab32fdda1693b0ed4/users/153cadd1b1ab4be9981ef151c354f4b0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.405954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892b6d1-e8ed-4536-aac7-dd8b83bbd36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06193abd1d34eaab32fdda1693b0ed4, user_id=153cadd1b1ab4be9981ef151c354f4b0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:04.409859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892b6d1-e8ed-4536-aac7-dd8b83bbd36b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:04.430816 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3721/7449] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:04 2022] PUT /identity/v3/projects/e06193abd1d34eaab32fdda1693b0ed4/users/153cadd1b1ab4be9981ef151c354f4b0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:04.442195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5a08-870d-4698-89eb-56beebae84a7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.442693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5a08-870d-4698-89eb-56beebae84a7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.442829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.443617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5a08-870d-4698-89eb-56beebae84a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.445707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.446090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.446351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles/de739bab9e814c5eab4b44d418893c19` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.461864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1461581f1b4e44688957bcced68ef608, role_id=de739bab9e814c5eab4b44d418893c19)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:04.464633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:04.498506 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Could not find role: de739bab9e814c5eab4b44d418893c19.: keystone.exception.RoleNotFound: Could not find role: de739bab9e814c5eab4b44d418893c19. Feb 19 21:17:04.504793 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3729/7450] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Feb 19 21:17:04 2022] HEAD /identity/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608/roles/de739bab9e814c5eab4b44d418893c19 => generated 0 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Feb 19 21:17:04.508882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.517575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3a0d5a08-870d-4698-89eb-56beebae84a7 None None] MFA Rules not processed for user `153cadd1b1ab4be9981ef151c354f4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:04.519830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3a0d5a08-870d-4698-89eb-56beebae84a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:04.528404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa362533-e956-4677-a803-1e94214eb15c tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.636904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.637755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.638580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.638864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.649432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorizing `identity:delete_trust(trust_id=1461581f1b4e44688957bcced68ef608)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:04.651728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:04.693607 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3722/7451] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:04.706699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1461581f1b4e44688957bcced68ef608', 'request_id': 'req-adcc3413-811d-4f71-840c-411b1358b5f3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:04.708518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1461581f1b4e44688957bcced68ef608', 'request_id': 'req-adcc3413-811d-4f71-840c-411b1358b5f3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:04.709700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1461581f1b4e44688957bcced68ef608', 'request_id': 'req-adcc3413-811d-4f71-840c-411b1358b5f3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:04.747129 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3730/7452] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:17:04 2022] DELETE /identity/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:04.751673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5a08-870d-4698-89eb-56beebae84a7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.770595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5a08-870d-4698-89eb-56beebae84a7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.776064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86118-ecad-4bf8-a377-373f007bdffe tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22f49e9f4fa4a22ac265576619023cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ecf37b672a64cc4a3882ff102489887', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-11380471', 'tempest-DelegatedRole-1109993588'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.778382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86118-ecad-4bf8-a377-373f007bdffe tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.779741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86118-ecad-4bf8-a377-373f007bdffe tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.780244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86118-ecad-4bf8-a377-373f007bdffe tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] PATH_INFO: `/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.788645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.790553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:04.811954 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-4ce86118-ecad-4bf8-a377-373f007bdffe tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Could not find trust: 1461581f1b4e44688957bcced68ef608.: keystone.exception.TrustNotFound: Could not find trust: 1461581f1b4e44688957bcced68ef608. Feb 19 21:17:04.814319 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3723/7453] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:17:04 2022] GET /identity/v3/OS-TRUST/trusts/1461581f1b4e44688957bcced68ef608 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:17:04.818409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86118-ecad-4bf8-a377-373f007bdffe tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:04.829482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4ce86118-ecad-4bf8-a377-373f007bdffe tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:04.956909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc3413-811d-4f71-840c-411b1358b5f3 tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:04.964175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:04.965291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:04.965745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:04.966225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:04.970331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:05.016880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86118-ecad-4bf8-a377-373f007bdffe tempest-TrustsV3TestJSON-913835107 tempest-user-1391559618] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:05.019877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:05.030747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:05.031863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:05.032936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:05.033987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:05.034386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/de739bab9e814c5eab4b44d418893c19` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:05.037191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=de739bab9e814c5eab4b44d418893c19)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:05.040087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:05.061323 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3731/7454] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:17:05.140200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role de739bab9e814c5eab4b44d418893c19 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:05.140724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.141505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.143673 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3724/7455] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:04 2022] DELETE /identity/v3/roles/de739bab9e814c5eab4b44d418893c19 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:05.147705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:05.180814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5df4db-07d1-431d-a24c-3ae04cd6f287 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:05.298419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:05.299547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:05.300796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:05.301557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/383ade2f1b164fcd9a911c2fac6a709f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:05.303647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=383ade2f1b164fcd9a911c2fac6a709f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:05.305823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:05.401075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role 383ade2f1b164fcd9a911c2fac6a709f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:05.402396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.403562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.408346 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3732/7456] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:05 2022] DELETE /identity/v3/roles/383ade2f1b164fcd9a911c2fac6a709f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:05.413083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:05.416250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:05.455370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4786b-792d-4828-a5c0-ca700c1db1da tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:05.549940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:05.550880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:05.551490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:05.551944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users/e22f49e9f4fa4a22ac265576619023cd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:05.557004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e22f49e9f4fa4a22ac265576619023cd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:05.559591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:05.661285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22f49e9f4fa4a22ac265576619023cd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.685719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22f49e9f4fa4a22ac265576619023cd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.717429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22f49e9f4fa4a22ac265576619023cd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.720045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22f49e9f4fa4a22ac265576619023cd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.721144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22f49e9f4fa4a22ac265576619023cd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:05.762624 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3725/7457] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:05 2022] DELETE /identity/v3/users/e22f49e9f4fa4a22ac265576619023cd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:05.767226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:05.783329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:05.799849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcf8e5-1c50-47a8-9375-e62776b778b4 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:05.906406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:05.907453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:05.907610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:05.907951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/2ecf37b672a64cc4a3882ff102489887` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:05.909623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2ecf37b672a64cc4a3882ff102489887)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:05.913147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:06.025992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecf37b672a64cc4a3882ff102489887', 'request_id': 'req-ec21e027-59f1-4c66-9fbb-0110b16bc779'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:06.045002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecf37b672a64cc4a3882ff102489887', 'request_id': 'req-ec21e027-59f1-4c66-9fbb-0110b16bc779'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:06.089116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecf37b672a64cc4a3882ff102489887', 'request_id': 'req-ec21e027-59f1-4c66-9fbb-0110b16bc779'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:06.138759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] The token cache is being invalidate because project 2ecf37b672a64cc4a3882ff102489887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:06.138759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:06.153630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:06.168836 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3733/7458] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:05 2022] DELETE /identity/v3/projects/2ecf37b672a64cc4a3882ff102489887 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:06.170576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:06.172069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:06.198657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78d20-7a0d-4818-bf67-8d5bc2bd346f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:06.379737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729299-3a1a-4549-a13b-df22e4661dc1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:06.380941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729299-3a1a-4549-a13b-df22e4661dc1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:06.382122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729299-3a1a-4549-a13b-df22e4661dc1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:06.382670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729299-3a1a-4549-a13b-df22e4661dc1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:06.384178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6729299-3a1a-4549-a13b-df22e4661dc1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:06.389178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6729299-3a1a-4549-a13b-df22e4661dc1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:06.465928 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3726/7459] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Feb 19 21:17:06 2022] POST /identity/v3/projects => generated 329 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:06.468642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:06.471209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:06.493274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21e027-59f1-4c66-9fbb-0110b16bc779 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:06.648482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f605f-8a58-4d6b-901b-7d86da49d8ff tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:06.649384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f605f-8a58-4d6b-901b-7d86da49d8ff tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:06.649773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f605f-8a58-4d6b-901b-7d86da49d8ff tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:06.650767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f605f-8a58-4d6b-901b-7d86da49d8ff tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:06.652037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f605f-8a58-4d6b-901b-7d86da49d8ff tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:06.658083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f605f-8a58-4d6b-901b-7d86da49d8ff tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:06.720701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729299-3a1a-4549-a13b-df22e4661dc1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:06.731607 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3734/7460] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:06 2022] POST /identity/v3/users => generated 416 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:06.738555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729299-3a1a-4549-a13b-df22e4661dc1 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:06.754041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b2b06-959e-4469-a98e-5eed080210e7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:06.755166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b2b06-959e-4469-a98e-5eed080210e7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:06.755726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b2b06-959e-4469-a98e-5eed080210e7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:06.756244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b2b06-959e-4469-a98e-5eed080210e7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:06.757423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b2b06-959e-4469-a98e-5eed080210e7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:06.759325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b2b06-959e-4469-a98e-5eed080210e7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:06.790437 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3727/7461] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:17:06 2022] POST /identity/v3/roles => generated 243 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:06.795602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f605f-8a58-4d6b-901b-7d86da49d8ff tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:06.813486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f605f-8a58-4d6b-901b-7d86da49d8ff tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:06.820550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b935a-bd69-4560-854f-ddf8d6a2ae45 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:06.821054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b935a-bd69-4560-854f-ddf8d6a2ae45 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:06.821445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b935a-bd69-4560-854f-ddf8d6a2ae45 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:06.821879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b935a-bd69-4560-854f-ddf8d6a2ae45 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:06.823008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b935a-bd69-4560-854f-ddf8d6a2ae45 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:06.825355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b935a-bd69-4560-854f-ddf8d6a2ae45 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:06.849224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b2b06-959e-4469-a98e-5eed080210e7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:06.863209 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3735/7462] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:17:06 2022] POST /identity/v3/roles => generated 247 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:06.866277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b2b06-959e-4469-a98e-5eed080210e7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:06.875471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3bb8-0fb3-4292-9b2f-436941ad8e0f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:06.877618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3bb8-0fb3-4292-9b2f-436941ad8e0f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:06.878152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3bb8-0fb3-4292-9b2f-436941ad8e0f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:06.880179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3bb8-0fb3-4292-9b2f-436941ad8e0f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/658d49722d6f49b28206c58c6c365ae7/users/5a6ba33c5b164d0caa72893fdb3171b6/roles/b4b54e3de7f34f9786d0cd46bb41f5e2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:06.915877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b3bb8-0fb3-4292-9b2f-436941ad8e0f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=658d49722d6f49b28206c58c6c365ae7, user_id=5a6ba33c5b164d0caa72893fdb3171b6, role_id=b4b54e3de7f34f9786d0cd46bb41f5e2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:06.918870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b3bb8-0fb3-4292-9b2f-436941ad8e0f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:06.948919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b935a-bd69-4560-854f-ddf8d6a2ae45 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:06.959481 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3728/7463] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:06 2022] PUT /identity/v3/projects/658d49722d6f49b28206c58c6c365ae7/users/5a6ba33c5b164d0caa72893fdb3171b6/roles/b4b54e3de7f34f9786d0cd46bb41f5e2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:06.965082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b935a-bd69-4560-854f-ddf8d6a2ae45 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:07.066030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee03b7-7a64-4368-a298-7893e39c05a7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:07.067393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee03b7-7a64-4368-a298-7893e39c05a7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:07.068587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee03b7-7a64-4368-a298-7893e39c05a7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:07.069117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee03b7-7a64-4368-a298-7893e39c05a7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/658d49722d6f49b28206c58c6c365ae7/users/5a6ba33c5b164d0caa72893fdb3171b6/roles/8354ce0dfecd4c3b8e3e5b949c3c8d7b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:07.072357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee03b7-7a64-4368-a298-7893e39c05a7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:create_grant(project_id=658d49722d6f49b28206c58c6c365ae7, user_id=5a6ba33c5b164d0caa72893fdb3171b6, role_id=8354ce0dfecd4c3b8e3e5b949c3c8d7b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:07.076232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee03b7-7a64-4368-a298-7893e39c05a7 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:07.103755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3bb8-0fb3-4292-9b2f-436941ad8e0f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:07.104349 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3736/7464] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:06 2022] PUT /identity/v3/projects/658d49722d6f49b28206c58c6c365ae7/users/5a6ba33c5b164d0caa72893fdb3171b6/roles/8354ce0dfecd4c3b8e3e5b949c3c8d7b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:07.117064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3bb8-0fb3-4292-9b2f-436941ad8e0f tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:07.253215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cae94-a775-4c07-95e5-f333b5d60cc5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:07.254589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cae94-a775-4c07-95e5-f333b5d60cc5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:07.256723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cae94-a775-4c07-95e5-f333b5d60cc5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:07.258200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cae94-a775-4c07-95e5-f333b5d60cc5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:07.259210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cae94-a775-4c07-95e5-f333b5d60cc5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:07.263113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cae94-a775-4c07-95e5-f333b5d60cc5 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:07.323930 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3729/7465] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:07 2022] GET /identity/v3/users => generated 8319 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:07.327505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32f56-8092-4089-bd95-0c0cec1c894c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:07.328048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32f56-8092-4089-bd95-0c0cec1c894c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:07.328486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32f56-8092-4089-bd95-0c0cec1c894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:07.423218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-91e32f56-8092-4089-bd95-0c0cec1c894c None None] MFA Rules not processed for user `5a6ba33c5b164d0caa72893fdb3171b6`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:07.425027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-91e32f56-8092-4089-bd95-0c0cec1c894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:07.573341 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3737/7466] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:07.584885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fa934-38ab-449f-bc0b-77545f4a49eb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:07.585186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fa934-38ab-449f-bc0b-77545f4a49eb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:07.585529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fa934-38ab-449f-bc0b-77545f4a49eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:07.632104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ec3fa934-38ab-449f-bc0b-77545f4a49eb None None] MFA Rules not processed for user `5a6ba33c5b164d0caa72893fdb3171b6`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:07.633721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec3fa934-38ab-449f-bc0b-77545f4a49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:07.645660 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3730/7467] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:07.651626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e32f56-8092-4089-bd95-0c0cec1c894c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:07.672951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e32f56-8092-4089-bd95-0c0cec1c894c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:07.681382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab6bd-1ac9-443e-96ea-badb26f5072b tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:07.682571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab6bd-1ac9-443e-96ea-badb26f5072b tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:07.683084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab6bd-1ac9-443e-96ea-badb26f5072b tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:07.683590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab6bd-1ac9-443e-96ea-badb26f5072b tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:07.685751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ab6bd-1ac9-443e-96ea-badb26f5072b tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorizing `identity:create_trust()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:07.688728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ab6bd-1ac9-443e-96ea-badb26f5072b tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:07.839925 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3738/7468] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 21:17:07 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:07.844753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fa934-38ab-449f-bc0b-77545f4a49eb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:07.855652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fa934-38ab-449f-bc0b-77545f4a49eb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:07.862970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c26b4-6efc-446b-9bca-b1877beac15d tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:07.864000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c26b4-6efc-446b-9bca-b1877beac15d tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:07.864298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c26b4-6efc-446b-9bca-b1877beac15d tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:07.864608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c26b4-6efc-446b-9bca-b1877beac15d tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:07.874103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c26b4-6efc-446b-9bca-b1877beac15d tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorizing `identity:get_trust(trust_id=ef875bc6b8094efe934dfbdbc0a564e8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:07.875795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c26b4-6efc-446b-9bca-b1877beac15d tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:07.885380 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3731/7469] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:17:07 2022] GET /identity/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8 => generated 834 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:07.889963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab6bd-1ac9-443e-96ea-badb26f5072b tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:07.901552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab6bd-1ac9-443e-96ea-badb26f5072b tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:07.909533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630f72c-a3af-41ad-badd-e587df26aba4 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:07.910696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630f72c-a3af-41ad-badd-e587df26aba4 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:07.910696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630f72c-a3af-41ad-badd-e587df26aba4 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:07.910696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630f72c-a3af-41ad-badd-e587df26aba4 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:07.935660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630f72c-a3af-41ad-badd-e587df26aba4 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=ef875bc6b8094efe934dfbdbc0a564e8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:07.937343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630f72c-a3af-41ad-badd-e587df26aba4 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:07.949692 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3739/7470] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:17:07 2022] GET /identity/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:07.950112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c26b4-6efc-446b-9bca-b1877beac15d tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:07.962016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c26b4-6efc-446b-9bca-b1877beac15d tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:07.966525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47282307-2d60-401a-a793-418f0d20b891 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:07.967438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47282307-2d60-401a-a793-418f0d20b891 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:07.967835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47282307-2d60-401a-a793-418f0d20b891 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:07.968239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47282307-2d60-401a-a793-418f0d20b891 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles/b4b54e3de7f34f9786d0cd46bb41f5e2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:07.975771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47282307-2d60-401a-a793-418f0d20b891 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ef875bc6b8094efe934dfbdbc0a564e8, role_id=b4b54e3de7f34f9786d0cd46bb41f5e2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:07.977022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47282307-2d60-401a-a793-418f0d20b891 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:07.993955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630f72c-a3af-41ad-badd-e587df26aba4 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.004571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3732/7471] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Feb 19 21:17:07 2022] GET /identity/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles/b4b54e3de7f34f9786d0cd46bb41f5e2 => generated 243 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:08.005868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630f72c-a3af-41ad-badd-e587df26aba4 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.010433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a754493-afc1-42f6-afce-77a66447f66f tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.011522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a754493-afc1-42f6-afce-77a66447f66f tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.011775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a754493-afc1-42f6-afce-77a66447f66f tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.012119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a754493-afc1-42f6-afce-77a66447f66f tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles/b4b54e3de7f34f9786d0cd46bb41f5e2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:08.020167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a754493-afc1-42f6-afce-77a66447f66f tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ef875bc6b8094efe934dfbdbc0a564e8, role_id=b4b54e3de7f34f9786d0cd46bb41f5e2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:08.022047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a754493-afc1-42f6-afce-77a66447f66f tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:08.031317 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3740/7472] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Feb 19 21:17:07 2022] HEAD /identity/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles/b4b54e3de7f34f9786d0cd46bb41f5e2 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Feb 19 21:17:08.036169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47282307-2d60-401a-a793-418f0d20b891 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.047252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47282307-2d60-401a-a793-418f0d20b891 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.052902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.053814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.054215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.054555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles/8354ce0dfecd4c3b8e3e5b949c3c8d7b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:08.062844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ef875bc6b8094efe934dfbdbc0a564e8, role_id=8354ce0dfecd4c3b8e3e5b949c3c8d7b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:08.064415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:08.086086 ncdv-master-1 devstack@keystone.service[96910]: WARNING keystone.server.flask.application [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Could not find role: 8354ce0dfecd4c3b8e3e5b949c3c8d7b.: keystone.exception.RoleNotFound: Could not find role: 8354ce0dfecd4c3b8e3e5b949c3c8d7b. Feb 19 21:17:08.091248 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3733/7473] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Feb 19 21:17:08 2022] GET /identity/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles/8354ce0dfecd4c3b8e3e5b949c3c8d7b => generated 110 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:17:08.091796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a754493-afc1-42f6-afce-77a66447f66f tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.106036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a754493-afc1-42f6-afce-77a66447f66f tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.111429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.112751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `HEAD` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.113224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.113656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles/8354ce0dfecd4c3b8e3e5b949c3c8d7b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:08.121427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ef875bc6b8094efe934dfbdbc0a564e8, role_id=8354ce0dfecd4c3b8e3e5b949c3c8d7b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:08.124793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:08.143068 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Could not find role: 8354ce0dfecd4c3b8e3e5b949c3c8d7b.: keystone.exception.RoleNotFound: Could not find role: 8354ce0dfecd4c3b8e3e5b949c3c8d7b. Feb 19 21:17:08.144386 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3741/7474] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Feb 19 21:17:08 2022] HEAD /identity/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8/roles/8354ce0dfecd4c3b8e3e5b949c3c8d7b => generated 0 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:17:08.150571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.163275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51d24-95f7-4217-852c-a3ef8d96079e tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.171644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.173159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.173713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.175090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:08.184256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorizing `identity:delete_trust(trust_id=ef875bc6b8094efe934dfbdbc0a564e8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:08.186959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:08.224456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ef875bc6b8094efe934dfbdbc0a564e8', 'request_id': 'req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.238779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ef875bc6b8094efe934dfbdbc0a564e8', 'request_id': 'req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.240018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ef875bc6b8094efe934dfbdbc0a564e8', 'request_id': 'req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.253698 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3734/7475] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:17:08 2022] DELETE /identity/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:08.257806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.265357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:08.286047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86142d9b-ad7a-40ac-9a2c-c713755c4bca tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.293003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddd82f-dfea-4ea5-af82-8556c1b1a31a tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ba33c5b164d0caa72893fdb3171b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '658d49722d6f49b28206c58c6c365ae7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1355573386', 'tempest-DelegatedRole-506800119'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.294081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd82f-dfea-4ea5-af82-8556c1b1a31a tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.294979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd82f-dfea-4ea5-af82-8556c1b1a31a tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.295348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd82f-dfea-4ea5-af82-8556c1b1a31a tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] PATH_INFO: `/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:08.312592 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-21ddd82f-dfea-4ea5-af82-8556c1b1a31a tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Could not find trust: ef875bc6b8094efe934dfbdbc0a564e8.: keystone.exception.TrustNotFound: Could not find trust: ef875bc6b8094efe934dfbdbc0a564e8. Feb 19 21:17:08.315717 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3742/7476] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:17:08 2022] GET /identity/v3/OS-TRUST/trusts/ef875bc6b8094efe934dfbdbc0a564e8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:17:08.319841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.322048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:08.344475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae887c-be34-4f98-8cbb-2f77ee5fa4e1 tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.352466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.353591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.354143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.354416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/8354ce0dfecd4c3b8e3e5b949c3c8d7b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:08.356252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8354ce0dfecd4c3b8e3e5b949c3c8d7b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:08.358587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:08.432498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role 8354ce0dfecd4c3b8e3e5b949c3c8d7b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:08.432839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.436111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.454279 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3735/7477] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:08 2022] DELETE /identity/v3/roles/8354ce0dfecd4c3b8e3e5b949c3c8d7b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:08.458136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddd82f-dfea-4ea5-af82-8556c1b1a31a tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.460090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-21ddd82f-dfea-4ea5-af82-8556c1b1a31a tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:08.485023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddd82f-dfea-4ea5-af82-8556c1b1a31a tempest-TrustsV3TestJSON-1404981774 tempest-user-1630601198] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.590871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.592081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.592901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.593189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/roles/b4b54e3de7f34f9786d0cd46bb41f5e2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:08.597548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b4b54e3de7f34f9786d0cd46bb41f5e2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:08.600973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:08.664193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invalidating the token cache because role b4b54e3de7f34f9786d0cd46bb41f5e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:08.664555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.665247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.668811 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3743/7478] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:08 2022] DELETE /identity/v3/roles/b4b54e3de7f34f9786d0cd46bb41f5e2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:08.673620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.686434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc9c2-2015-44dc-bb78-28572b49c745 tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.765154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.766344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.766812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.767267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/users/5a6ba33c5b164d0caa72893fdb3171b6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:08.769393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5a6ba33c5b164d0caa72893fdb3171b6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:08.771901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:08.835191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6ba33c5b164d0caa72893fdb3171b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.851701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6ba33c5b164d0caa72893fdb3171b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.862925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6ba33c5b164d0caa72893fdb3171b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.863849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6ba33c5b164d0caa72893fdb3171b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.865142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6ba33c5b164d0caa72893fdb3171b6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:08.887733 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3736/7479] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:08 2022] DELETE /identity/v3/users/5a6ba33c5b164d0caa72893fdb3171b6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:08.892600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:08.895306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:08.913431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6b2e-ceae-437b-a0dd-78e450af836e tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:08.998561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fc0ead28d4464f81033c96d3fcc550', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537683a2986e459ca216d05484372839', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:08.999432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:08.999713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:08.999992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] PATH_INFO: `/v3/projects/658d49722d6f49b28206c58c6c365ae7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:09.001877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=658d49722d6f49b28206c58c6c365ae7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:09.004110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:09.071943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658d49722d6f49b28206c58c6c365ae7', 'request_id': 'req-2222a9cc-8c58-44cc-8996-d48bb80f67ec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.080750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658d49722d6f49b28206c58c6c365ae7', 'request_id': 'req-2222a9cc-8c58-44cc-8996-d48bb80f67ec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.091212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658d49722d6f49b28206c58c6c365ae7', 'request_id': 'req-2222a9cc-8c58-44cc-8996-d48bb80f67ec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.108052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] The token cache is being invalidate because project 658d49722d6f49b28206c58c6c365ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:09.108359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.109126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2222a9cc-8c58-44cc-8996-d48bb80f67ec tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.111069 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3744/7480] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:08 2022] DELETE /identity/v3/projects/658d49722d6f49b28206c58c6c365ae7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:09.118615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:09.122186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:09.262110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64bda9-d160-4e41-88eb-4fbd1148ab5a tempest-TrustsV3TestJSON-1846281188 tempest-TrustsV3TestJSON-1846281188-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:09.368119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:09.368119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:09.368119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:09.368119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] PATH_INFO: `/v3/users/60726c44a0874e5ca5489b4eab75e4df` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:09.368631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60726c44a0874e5ca5489b4eab75e4df)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:09.369393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:09.428468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60726c44a0874e5ca5489b4eab75e4df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.451290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60726c44a0874e5ca5489b4eab75e4df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.459568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60726c44a0874e5ca5489b4eab75e4df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.460624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60726c44a0874e5ca5489b4eab75e4df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.461505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60726c44a0874e5ca5489b4eab75e4df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.478133 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3737/7481] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:09 2022] DELETE /identity/v3/users/60726c44a0874e5ca5489b4eab75e4df => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:09.482925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee80a6-9f12-4fbd-95ac-4a5fd6eb2513 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:09.483482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee80a6-9f12-4fbd-95ac-4a5fd6eb2513 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:09.484567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee80a6-9f12-4fbd-95ac-4a5fd6eb2513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:09.505599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8cee80a6-9f12-4fbd-95ac-4a5fd6eb2513 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:09.507173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8cee80a6-9f12-4fbd-95ac-4a5fd6eb2513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:09.564558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:09.566018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:09.638928 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3745/7482] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:09.662963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee80a6-9f12-4fbd-95ac-4a5fd6eb2513 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:09.664543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8cee80a6-9f12-4fbd-95ac-4a5fd6eb2513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:09.706857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cb48f-0566-4aac-8d6b-dd17c06853d1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:09.721014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:09.726685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:09.727192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:09.727598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] PATH_INFO: `/v3/users/73abd5e75b5e4f549e59660ee17226c4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:09.729654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73abd5e75b5e4f549e59660ee17226c4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:09.739381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:09.778393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee80a6-9f12-4fbd-95ac-4a5fd6eb2513 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:09.782612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8522e0-6ddb-48c5-b186-a20caf542cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:09.783765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8522e0-6ddb-48c5-b186-a20caf542cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:09.784101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8522e0-6ddb-48c5-b186-a20caf542cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:09.784463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8522e0-6ddb-48c5-b186-a20caf542cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:09.799194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8522e0-6ddb-48c5-b186-a20caf542cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:09.802561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8522e0-6ddb-48c5-b186-a20caf542cc2 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:09.824725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3746/7483] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:17:09.832420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73abd5e75b5e4f549e59660ee17226c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.847595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73abd5e75b5e4f549e59660ee17226c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.860155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73abd5e75b5e4f549e59660ee17226c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.862602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73abd5e75b5e4f549e59660ee17226c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.863534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73abd5e75b5e4f549e59660ee17226c4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:09.881609 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3738/7484] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:09 2022] DELETE /identity/v3/users/73abd5e75b5e4f549e59660ee17226c4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:09.888868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18568ac-720c-4f41-90ec-b19c7b2c58c1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:09.889209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18568ac-720c-4f41-90ec-b19c7b2c58c1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:09.891082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18568ac-720c-4f41-90ec-b19c7b2c58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:09.917127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b18568ac-720c-4f41-90ec-b19c7b2c58c1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:09.919046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b18568ac-720c-4f41-90ec-b19c7b2c58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:10.019532 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3747/7485] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:10.092343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:10.093843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:10.261698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915a3c5-7da9-4359-9006-b08f30eb00f6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:10.275450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca655183-0b0d-4374-9e76-2c2d80045df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:10.276125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca655183-0b0d-4374-9e76-2c2d80045df8 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:10.276458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca655183-0b0d-4374-9e76-2c2d80045df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:10.276744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca655183-0b0d-4374-9e76-2c2d80045df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:10.302291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca655183-0b0d-4374-9e76-2c2d80045df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:10.303763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca655183-0b0d-4374-9e76-2c2d80045df8 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:10.347173 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3739/7486] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:11.790501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18568ac-720c-4f41-90ec-b19c7b2c58c1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:11.792664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b18568ac-720c-4f41-90ec-b19c7b2c58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:11.807285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18568ac-720c-4f41-90ec-b19c7b2c58c1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:11.814435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:11.815365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:11.815834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:11.816300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] PATH_INFO: `/v3/projects/7c0f2ec06be24ce68c9af779d2944823` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:11.818011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0f2ec06be24ce68c9af779d2944823)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:11.820154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:11.897176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0f2ec06be24ce68c9af779d2944823', 'request_id': 'req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:11.905223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0f2ec06be24ce68c9af779d2944823', 'request_id': 'req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:11.915141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0f2ec06be24ce68c9af779d2944823', 'request_id': 'req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:11.927630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] The token cache is being invalidate because project 7c0f2ec06be24ce68c9af779d2944823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:11.928075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:11.928793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:11.930583 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3748/7487] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:11 2022] DELETE /identity/v3/projects/7c0f2ec06be24ce68c9af779d2944823 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:11.934519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca655183-0b0d-4374-9e76-2c2d80045df8 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:11.950433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca655183-0b0d-4374-9e76-2c2d80045df8 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:12.058308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:12.059265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:12.059550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:12.060446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] PATH_INFO: `/v3/users/35fc0ead28d4464f81033c96d3fcc550` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:12.066797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fc0ead28d4464f81033c96d3fcc550)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:12.071783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:12.185448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fc0ead28d4464f81033c96d3fcc550'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.199753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fc0ead28d4464f81033c96d3fcc550'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.216313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fc0ead28d4464f81033c96d3fcc550'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.216998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fc0ead28d4464f81033c96d3fcc550'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.217995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fc0ead28d4464f81033c96d3fcc550'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.237708 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3740/7488] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:11 2022] DELETE /identity/v3/users/35fc0ead28d4464f81033c96d3fcc550 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:12.366980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:12.369343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:12.393570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2c31-4b3c-4d22-b44f-3fbaeff11f88 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:12.486724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:12.487729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:12.488112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:12.488518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] PATH_INFO: `/v3/projects/485f24939ca34525a63e45e52f4d8cfa` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:12.489937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=485f24939ca34525a63e45e52f4d8cfa)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:12.491956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:12.554485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485f24939ca34525a63e45e52f4d8cfa', 'request_id': 'req-5084fbd3-0835-4315-8e14-fe9fa28a7eed'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.561093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485f24939ca34525a63e45e52f4d8cfa', 'request_id': 'req-5084fbd3-0835-4315-8e14-fe9fa28a7eed'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.570997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485f24939ca34525a63e45e52f4d8cfa', 'request_id': 'req-5084fbd3-0835-4315-8e14-fe9fa28a7eed'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.585330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] The token cache is being invalidate because project 485f24939ca34525a63e45e52f4d8cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:12.585665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.586808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.588380 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3749/7489] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:12 2022] DELETE /identity/v3/projects/485f24939ca34525a63e45e52f4d8cfa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:12.593222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:12.596504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:12.613995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed24638-024d-4a37-9069-ab2115f1c428 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:12.709936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:12.711400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:12.711689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:12.712250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] PATH_INFO: `/v3/users/7e871c1804964c999047d3ddfda8d54d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:12.713563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e871c1804964c999047d3ddfda8d54d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:12.715475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:12.798287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e871c1804964c999047d3ddfda8d54d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.818962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e871c1804964c999047d3ddfda8d54d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.829664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e871c1804964c999047d3ddfda8d54d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.830419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e871c1804964c999047d3ddfda8d54d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.831085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a33f8c84-ded9-417c-a7e0-142f442f1aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e871c1804964c999047d3ddfda8d54d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:12.859015 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3741/7490] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:12 2022] DELETE /identity/v3/users/7e871c1804964c999047d3ddfda8d54d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:12.970683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:12.973281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:12.997073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084fbd3-0835-4315-8e14-fe9fa28a7eed admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:13.080666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:13.082179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.082887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.083335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] PATH_INFO: `/v3/projects/537683a2986e459ca216d05484372839` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.086105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=537683a2986e459ca216d05484372839)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:13.089513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:13.159632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537683a2986e459ca216d05484372839', 'request_id': 'req-95932d2c-c1b4-425c-b0a1-b6be083199bb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:13.166635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537683a2986e459ca216d05484372839', 'request_id': 'req-95932d2c-c1b4-425c-b0a1-b6be083199bb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:13.177105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537683a2986e459ca216d05484372839', 'request_id': 'req-95932d2c-c1b4-425c-b0a1-b6be083199bb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:13.199411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] The token cache is being invalidate because project 537683a2986e459ca216d05484372839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:13.208683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:13.209672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-95932d2c-c1b4-425c-b0a1-b6be083199bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:13.216152 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3750/7491] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:12 2022] DELETE /identity/v3/projects/537683a2986e459ca216d05484372839 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:13.218837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28862f83-57b8-4732-a9cc-246f34ec3f2a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.219342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28862f83-57b8-4732-a9cc-246f34ec3f2a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.219582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28862f83-57b8-4732-a9cc-246f34ec3f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.245943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-28862f83-57b8-4732-a9cc-246f34ec3f2a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:13.248717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-28862f83-57b8-4732-a9cc-246f34ec3f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:13.337958 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3742/7492] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:13.348307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e6701-df4e-4f0d-9bb6-7dc0c8a24a98 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.350222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e6701-df4e-4f0d-9bb6-7dc0c8a24a98 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.350519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e6701-df4e-4f0d-9bb6-7dc0c8a24a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.400778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f71e6701-df4e-4f0d-9bb6-7dc0c8a24a98 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:13.402066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f71e6701-df4e-4f0d-9bb6-7dc0c8a24a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:13.414821 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3751/7493] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:13.418899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28862f83-57b8-4732-a9cc-246f34ec3f2a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:13.437194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28862f83-57b8-4732-a9cc-246f34ec3f2a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:13.444883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:13.445748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.446097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.446489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.447300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:13.447672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:13.449710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:13.467653 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3743/7494] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:13.472003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e6701-df4e-4f0d-9bb6-7dc0c8a24a98 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:13.481532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e6701-df4e-4f0d-9bb6-7dc0c8a24a98 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:13.500422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989d64-e9c3-4294-a5f0-f2dc386cc342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:13.501234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989d64-e9c3-4294-a5f0-f2dc386cc342 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.501862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989d64-e9c3-4294-a5f0-f2dc386cc342 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.502264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989d64-e9c3-4294-a5f0-f2dc386cc342 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.507161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b989d64-e9c3-4294-a5f0-f2dc386cc342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:13.509209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b989d64-e9c3-4294-a5f0-f2dc386cc342 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:13.555083 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3752/7495] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:13 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:13.562774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:13.574644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fe57-b765-4a90-b9fd-43fb12d09a2f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:13.639713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5ae19-50f3-4b7a-877b-0ac9a2edf7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:13.640704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ae19-50f3-4b7a-877b-0ac9a2edf7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.640805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ae19-50f3-4b7a-877b-0ac9a2edf7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.641156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ae19-50f3-4b7a-877b-0ac9a2edf7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.641993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5ae19-50f3-4b7a-877b-0ac9a2edf7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:13.644195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5ae19-50f3-4b7a-877b-0ac9a2edf7c8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:13.666876 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3744/7496] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:13 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:13.671051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989d64-e9c3-4294-a5f0-f2dc386cc342 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:13.682805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989d64-e9c3-4294-a5f0-f2dc386cc342 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:13.692257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d89cf-d96f-411c-bfc6-733c2abfb615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:13.693141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d89cf-d96f-411c-bfc6-733c2abfb615 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.693545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d89cf-d96f-411c-bfc6-733c2abfb615 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.693989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d89cf-d96f-411c-bfc6-733c2abfb615 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.694816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d89cf-d96f-411c-bfc6-733c2abfb615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:13.700593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d89cf-d96f-411c-bfc6-733c2abfb615 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:13.708794 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3753/7497] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:13.713098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5ae19-50f3-4b7a-877b-0ac9a2edf7c8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:13.724296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5ae19-50f3-4b7a-877b-0ac9a2edf7c8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:13.737562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:13.738571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.738897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.739136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.740009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:13.741688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:13.756375 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3745/7498] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:13.758738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d89cf-d96f-411c-bfc6-733c2abfb615 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:13.782580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d89cf-d96f-411c-bfc6-733c2abfb615 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:13.790497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db73fc-0ae0-4834-b544-1dc71d0a09be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:13.792108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db73fc-0ae0-4834-b544-1dc71d0a09be admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.792612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db73fc-0ae0-4834-b544-1dc71d0a09be admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.793065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db73fc-0ae0-4834-b544-1dc71d0a09be admin admin] PATH_INFO: `/v3/projects/b1dbc224855a4accb2d6518920d212c9/users/444778f66c5a4977997e86a51f75eef2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.815820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:13.823165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db73fc-0ae0-4834-b544-1dc71d0a09be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1dbc224855a4accb2d6518920d212c9, user_id=444778f66c5a4977997e86a51f75eef2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:13.823165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db73fc-0ae0-4834-b544-1dc71d0a09be admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:13.826180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:13.858763 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3754/7499] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:13 2022] PUT /identity/v3/projects/b1dbc224855a4accb2d6518920d212c9/users/444778f66c5a4977997e86a51f75eef2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:13.869494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e57dc-9394-46c9-985d-479c2faddeac None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.872714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e57dc-9394-46c9-985d-479c2faddeac None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.873700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e57dc-9394-46c9-985d-479c2faddeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.885025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c16b8-e098-4bf3-8545-3dfe80b190f2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:13.915669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-066e57dc-9394-46c9-985d-479c2faddeac None None] MFA Rules not processed for user `444778f66c5a4977997e86a51f75eef2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:13.917390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-066e57dc-9394-46c9-985d-479c2faddeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:13.970288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:13.971760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:13.972240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:13.972777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] PATH_INFO: `/v3/projects/d6cf3472e5d648f799b6eda84d47e969` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:13.974199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cf3472e5d648f799b6eda84d47e969)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:13.976524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.012495 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3755/7500] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:14.016025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e57dc-9394-46c9-985d-479c2faddeac None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.033321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e57dc-9394-46c9-985d-479c2faddeac None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.074834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cf3472e5d648f799b6eda84d47e969', 'request_id': 'req-410c970e-9ea4-46cc-87e6-53e898e3bf7d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:14.086398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cf3472e5d648f799b6eda84d47e969', 'request_id': 'req-410c970e-9ea4-46cc-87e6-53e898e3bf7d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:14.098888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cf3472e5d648f799b6eda84d47e969', 'request_id': 'req-410c970e-9ea4-46cc-87e6-53e898e3bf7d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:14.115511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] The token cache is being invalidate because project d6cf3472e5d648f799b6eda84d47e969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:14.116175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:14.117170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-410c970e-9ea4-46cc-87e6-53e898e3bf7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:14.123023 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3746/7501] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:13 2022] DELETE /identity/v3/projects/d6cf3472e5d648f799b6eda84d47e969 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:14.125330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfca0d-15b3-4a1e-80d3-a46629e5af9e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.125806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfca0d-15b3-4a1e-80d3-a46629e5af9e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.126434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfca0d-15b3-4a1e-80d3-a46629e5af9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.143065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.143961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.146373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.146798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.147700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.150160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.199908 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3756/7502] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:14 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:14.204411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.206751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:14.213699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6cbfca0d-15b3-4a1e-80d3-a46629e5af9e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:14.215435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6cbfca0d-15b3-4a1e-80d3-a46629e5af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:14.297848 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3747/7503] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:14.300235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89cec7-e6a4-4a9b-b42e-9e0e680b1203 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.300622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89cec7-e6a4-4a9b-b42e-9e0e680b1203 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.300915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89cec7-e6a4-4a9b-b42e-9e0e680b1203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.322696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5d66d-c22b-44c5-b78f-1c65cad6e87d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.328149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5d89cec7-e6a4-4a9b-b42e-9e0e680b1203 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:14.329517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5d89cec7-e6a4-4a9b-b42e-9e0e680b1203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:14.334620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c938373-a945-45a9-9578-537b82ad035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.335322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c938373-a945-45a9-9578-537b82ad035e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.335605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c938373-a945-45a9-9578-537b82ad035e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.335890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c938373-a945-45a9-9578-537b82ad035e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.336626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c938373-a945-45a9-9578-537b82ad035e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.338816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c938373-a945-45a9-9578-537b82ad035e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.348915 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3748/7504] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:14.352093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89cec7-e6a4-4a9b-b42e-9e0e680b1203 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.363024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89cec7-e6a4-4a9b-b42e-9e0e680b1203 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.368294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.369173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.369490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.369771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.370505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:14.370814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.371827 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3757/7505] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:14 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:14.373270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.375446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c938373-a945-45a9-9578-537b82ad035e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.386436 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3749/7506] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:14.390768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c938373-a945-45a9-9578-537b82ad035e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.391259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.405683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8857e4-2137-46bc-8fe9-9abc676bc68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.406647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8857e4-2137-46bc-8fe9-9abc676bc68b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.407161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8857e4-2137-46bc-8fe9-9abc676bc68b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.407374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8857e4-2137-46bc-8fe9-9abc676bc68b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.408105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8857e4-2137-46bc-8fe9-9abc676bc68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.411263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311c9cb-0739-452f-a292-ff31e7e5b5b1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.413183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8857e4-2137-46bc-8fe9-9abc676bc68b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.425535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973f15-994e-466f-ad79-be9fb7cb9897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.426222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973f15-994e-466f-ad79-be9fb7cb9897 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.426506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973f15-994e-466f-ad79-be9fb7cb9897 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.426822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973f15-994e-466f-ad79-be9fb7cb9897 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.427706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e973f15-994e-466f-ad79-be9fb7cb9897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.432023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e973f15-994e-466f-ad79-be9fb7cb9897 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.434007 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3758/7507] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:14.438618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8857e4-2137-46bc-8fe9-9abc676bc68b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.465667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8857e4-2137-46bc-8fe9-9abc676bc68b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.479532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40d00b-960c-41f0-9366-de6ae56ce1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.481024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40d00b-960c-41f0-9366-de6ae56ce1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.481565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40d00b-960c-41f0-9366-de6ae56ce1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.482029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40d00b-960c-41f0-9366-de6ae56ce1a4 admin admin] PATH_INFO: `/v3/projects/fb3da46500c9440bb0d6a561008c6476/users/a7d72242cca2442f81f8d5acd79ae317/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.504428 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3750/7508] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:14 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:14.508280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973f15-994e-466f-ad79-be9fb7cb9897 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.531012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40d00b-960c-41f0-9366-de6ae56ce1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3da46500c9440bb0d6a561008c6476, user_id=a7d72242cca2442f81f8d5acd79ae317, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.541224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40d00b-960c-41f0-9366-de6ae56ce1a4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.586654 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3759/7509] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:14 2022] PUT /identity/v3/projects/fb3da46500c9440bb0d6a561008c6476/users/a7d72242cca2442f81f8d5acd79ae317/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:14.590715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40d00b-960c-41f0-9366-de6ae56ce1a4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.695906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973f15-994e-466f-ad79-be9fb7cb9897 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.701356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40d00b-960c-41f0-9366-de6ae56ce1a4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.707780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfcfaf-3046-4cc7-90a4-6b4f3188a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.708579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfcfaf-3046-4cc7-90a4-6b4f3188a358 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.708934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfcfaf-3046-4cc7-90a4-6b4f3188a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.709431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfcfaf-3046-4cc7-90a4-6b4f3188a358 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.710260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfcfaf-3046-4cc7-90a4-6b4f3188a358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.710539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7949f6-a3b9-4455-956e-178c09cf1760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.711612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7949f6-a3b9-4455-956e-178c09cf1760 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.712292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfcfaf-3046-4cc7-90a4-6b4f3188a358 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.712774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7949f6-a3b9-4455-956e-178c09cf1760 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.720385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7949f6-a3b9-4455-956e-178c09cf1760 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.721622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7949f6-a3b9-4455-956e-178c09cf1760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.724014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7949f6-a3b9-4455-956e-178c09cf1760 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.726832 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3760/7510] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:14.737386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfcfaf-3046-4cc7-90a4-6b4f3188a358 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.750738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfcfaf-3046-4cc7-90a4-6b4f3188a358 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.759306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6731d7-218d-499a-a63c-a43c0ec5dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.760893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6731d7-218d-499a-a63c-a43c0ec5dcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.761253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6731d7-218d-499a-a63c-a43c0ec5dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.761697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6731d7-218d-499a-a63c-a43c0ec5dcb8 admin admin] PATH_INFO: `/v3/projects/fb3da46500c9440bb0d6a561008c6476/users/a7d72242cca2442f81f8d5acd79ae317/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.765447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6731d7-218d-499a-a63c-a43c0ec5dcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3da46500c9440bb0d6a561008c6476, user_id=a7d72242cca2442f81f8d5acd79ae317, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.769456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6731d7-218d-499a-a63c-a43c0ec5dcb8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.770799 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3751/7511] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:14 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:14.777408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7949f6-a3b9-4455-956e-178c09cf1760 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.782296 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3761/7512] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:14 2022] PUT /identity/v3/projects/fb3da46500c9440bb0d6a561008c6476/users/a7d72242cca2442f81f8d5acd79ae317/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:14.794027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a68c7-cea4-4817-8f28-c7cf55c5f489 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.795303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a68c7-cea4-4817-8f28-c7cf55c5f489 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.796007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a68c7-cea4-4817-8f28-c7cf55c5f489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.796809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7949f6-a3b9-4455-956e-178c09cf1760 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.851759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-453a68c7-cea4-4817-8f28-c7cf55c5f489 None None] MFA Rules not processed for user `a7d72242cca2442f81f8d5acd79ae317`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:14.853321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-453a68c7-cea4-4817-8f28-c7cf55c5f489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:14.942505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433c81-a9fc-4689-b1c0-56bf8ae51e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.944193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433c81-a9fc-4689-b1c0-56bf8ae51e17 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.944708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433c81-a9fc-4689-b1c0-56bf8ae51e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.945170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433c81-a9fc-4689-b1c0-56bf8ae51e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:14.948422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3433c81-a9fc-4689-b1c0-56bf8ae51e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:14.951401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3433c81-a9fc-4689-b1c0-56bf8ae51e17 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:14.969009 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3752/7513] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:14.970418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433c81-a9fc-4689-b1c0-56bf8ae51e17 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.983218 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3762/7514] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:14.986831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a68c7-cea4-4817-8f28-c7cf55c5f489 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:14.990279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433c81-a9fc-4689-b1c0-56bf8ae51e17 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:14.996750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66024357-edae-4e40-8472-a2357f09587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:14.997798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024357-edae-4e40-8472-a2357f09587e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:14.998476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024357-edae-4e40-8472-a2357f09587e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:14.999029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66024357-edae-4e40-8472-a2357f09587e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.000151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66024357-edae-4e40-8472-a2357f09587e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:15.002500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66024357-edae-4e40-8472-a2357f09587e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:15.023970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a68c7-cea4-4817-8f28-c7cf55c5f489 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:15.040865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaad9cf-7734-456b-8f02-b7b18c07a455 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:15.041893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad9cf-7734-456b-8f02-b7b18c07a455 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:15.042288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad9cf-7734-456b-8f02-b7b18c07a455 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:15.042575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad9cf-7734-456b-8f02-b7b18c07a455 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.043337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaad9cf-7734-456b-8f02-b7b18c07a455 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:15.054940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaad9cf-7734-456b-8f02-b7b18c07a455 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:15.055784 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3753/7515] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:15.057646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66024357-edae-4e40-8472-a2357f09587e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:15.074308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66024357-edae-4e40-8472-a2357f09587e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:15.084509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcd322-c7ad-4833-9118-e44c62f201d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:15.086487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd322-c7ad-4833-9118-e44c62f201d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:15.087909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd322-c7ad-4833-9118-e44c62f201d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:15.088423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd322-c7ad-4833-9118-e44c62f201d4 admin admin] PATH_INFO: `/v3/projects/d59c8f560331408690f5fb8c65a38f24/users/d95089868d42439a980f61ae2845bec2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.126925 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3763/7516] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:14 2022] POST /identity/v3/projects => generated 358 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:15.130104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaad9cf-7734-456b-8f02-b7b18c07a455 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:15.130904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcd322-c7ad-4833-9118-e44c62f201d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59c8f560331408690f5fb8c65a38f24, user_id=d95089868d42439a980f61ae2845bec2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:15.134158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcd322-c7ad-4833-9118-e44c62f201d4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:15.160021 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3754/7517] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:15 2022] PUT /identity/v3/projects/d59c8f560331408690f5fb8c65a38f24/users/d95089868d42439a980f61ae2845bec2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:15.171138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ffb91-ed1d-4121-a1c5-a13e99ca807d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:15.171406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ffb91-ed1d-4121-a1c5-a13e99ca807d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:15.171667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ffb91-ed1d-4121-a1c5-a13e99ca807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.217504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e45ffb91-ed1d-4121-a1c5-a13e99ca807d None None] MFA Rules not processed for user `d95089868d42439a980f61ae2845bec2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:15.218518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e45ffb91-ed1d-4121-a1c5-a13e99ca807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:15.267343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaad9cf-7734-456b-8f02-b7b18c07a455 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:15.343253 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3755/7518] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:15.354717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ffb91-ed1d-4121-a1c5-a13e99ca807d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:15.358703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e45ffb91-ed1d-4121-a1c5-a13e99ca807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:15.395671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6e29-1038-4f56-bcce-55da252840ad tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:15.395671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6e29-1038-4f56-bcce-55da252840ad tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:15.395671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6e29-1038-4f56-bcce-55da252840ad tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:15.396167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6e29-1038-4f56-bcce-55da252840ad tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.396688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c6e29-1038-4f56-bcce-55da252840ad tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:15.405054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c6e29-1038-4f56-bcce-55da252840ad tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:15.468664 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3764/7519] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:15 2022] POST /identity/v3/users => generated 371 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:15.472263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6e29-1038-4f56-bcce-55da252840ad tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:15.490336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6e29-1038-4f56-bcce-55da252840ad tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:15.502263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7e6ec-8692-4431-b7c7-bac988d3279d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:15.503773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7e6ec-8692-4431-b7c7-bac988d3279d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:15.504268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7e6ec-8692-4431-b7c7-bac988d3279d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:15.504839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7e6ec-8692-4431-b7c7-bac988d3279d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/2abe5c67cc6848d796d7acb6a0b82182` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.520894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ffb91-ed1d-4121-a1c5-a13e99ca807d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:15.525947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199779b3-4546-4cd0-83e7-110144155bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:15.527478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199779b3-4546-4cd0-83e7-110144155bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:15.527911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199779b3-4546-4cd0-83e7-110144155bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:15.528269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199779b3-4546-4cd0-83e7-110144155bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.540735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199779b3-4546-4cd0-83e7-110144155bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:15.541704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7e6ec-8692-4431-b7c7-bac988d3279d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:get_user(user_id=2abe5c67cc6848d796d7acb6a0b82182)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:15.542736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199779b3-4546-4cd0-83e7-110144155bc1 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:15.549212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7e6ec-8692-4431-b7c7-bac988d3279d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:15.552428 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3765/7520] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:17:15 2022] GET /identity/v3/users/2abe5c67cc6848d796d7acb6a0b82182 => generated 371 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:15.557310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7e6ec-8692-4431-b7c7-bac988d3279d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:15.564893 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3756/7521] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:15.592743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199779b3-4546-4cd0-83e7-110144155bc1 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:15.593703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7e6ec-8692-4431-b7c7-bac988d3279d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:15.607245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:15.608501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:15.608955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:15.609414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/2abe5c67cc6848d796d7acb6a0b82182` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.612473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2abe5c67cc6848d796d7acb6a0b82182)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:15.617245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:15.743713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abe5c67cc6848d796d7acb6a0b82182'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.744911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abe5c67cc6848d796d7acb6a0b82182'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.747911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abe5c67cc6848d796d7acb6a0b82182'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.759387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199779b3-4546-4cd0-83e7-110144155bc1 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:15.770603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:15.771516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:15.771803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:15.772082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] PATH_INFO: `/v3/users/d95089868d42439a980f61ae2845bec2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:15.773788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95089868d42439a980f61ae2845bec2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:15.779063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abe5c67cc6848d796d7acb6a0b82182'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.783772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:15.808198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abe5c67cc6848d796d7acb6a0b82182'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.828057 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3766/7522] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:15 2022] DELETE /identity/v3/users/2abe5c67cc6848d796d7acb6a0b82182 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:15.833913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:15.837711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:15.910579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95089868d42439a980f61ae2845bec2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.964885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95089868d42439a980f61ae2845bec2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.984140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111a11d-baaf-4873-92a0-b598cf0fd63e tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:15.990694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95089868d42439a980f61ae2845bec2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.992243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95089868d42439a980f61ae2845bec2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:15.993890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-554d81c3-9abb-4e87-b76b-7c3a5b566c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95089868d42439a980f61ae2845bec2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:16.000849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:16.007199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.007580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.007942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/a8354023ebb14228878e5d90adda1ee9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.009875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8354023ebb14228878e5d90adda1ee9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:16.018463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:16.031243 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3757/7523] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:15 2022] DELETE /identity/v3/users/d95089868d42439a980f61ae2845bec2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:16.035556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f068-fadf-4b48-be85-5ef62168f5f5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.037840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f068-fadf-4b48-be85-5ef62168f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.038284 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f068-fadf-4b48-be85-5ef62168f5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.100685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1e42f068-fadf-4b48-be85-5ef62168f5f5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:16.102158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e42f068-fadf-4b48-be85-5ef62168f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:16.178715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8354023ebb14228878e5d90adda1ee9', 'request_id': 'req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:16.189775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8354023ebb14228878e5d90adda1ee9', 'request_id': 'req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:16.212144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8354023ebb14228878e5d90adda1ee9', 'request_id': 'req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:16.226730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] The token cache is being invalidate because project a8354023ebb14228878e5d90adda1ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:16.227022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:16.227840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:16.235034 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3767/7524] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:15 2022] DELETE /identity/v3/projects/a8354023ebb14228878e5d90adda1ee9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:16.236514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:16.259909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:16.375704 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3758/7525] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:16.388085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f068-fadf-4b48-be85-5ef62168f5f5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:16.389778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e42f068-fadf-4b48-be85-5ef62168f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:16.397255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257a1c7-7980-42a2-bee6-7d2ea250c1b0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:16.407195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76c7b-23f5-4f41-812a-1465f8e2376c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:16.408587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76c7b-23f5-4f41-812a-1465f8e2376c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.410096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76c7b-23f5-4f41-812a-1465f8e2376c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.410391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76c7b-23f5-4f41-812a-1465f8e2376c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.411110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f76c7b-23f5-4f41-812a-1465f8e2376c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:16.415357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f76c7b-23f5-4f41-812a-1465f8e2376c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:16.487266 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3768/7526] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:16 2022] POST /identity/v3/projects => generated 360 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:16.492523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76c7b-23f5-4f41-812a-1465f8e2376c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:16.595091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f068-fadf-4b48-be85-5ef62168f5f5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:16.669323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76c7b-23f5-4f41-812a-1465f8e2376c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:16.677989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670d6a-e81c-47f9-a0a4-23d7bdc8a3fa tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:16.678861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670d6a-e81c-47f9-a0a4-23d7bdc8a3fa tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.679146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670d6a-e81c-47f9-a0a4-23d7bdc8a3fa tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.679428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670d6a-e81c-47f9-a0a4-23d7bdc8a3fa tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.680162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c670d6a-e81c-47f9-a0a4-23d7bdc8a3fa tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:16.682573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c670d6a-e81c-47f9-a0a4-23d7bdc8a3fa tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:16.689925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9e3a7-7eb2-466e-81a5-eea71da46167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:16.691235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9e3a7-7eb2-466e-81a5-eea71da46167 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.691746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9e3a7-7eb2-466e-81a5-eea71da46167 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.693593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9e3a7-7eb2-466e-81a5-eea71da46167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.739371 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3769/7527] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:16 2022] POST /identity/v3/users => generated 414 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:16.741343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670d6a-e81c-47f9-a0a4-23d7bdc8a3fa tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:16.778545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670d6a-e81c-47f9-a0a4-23d7bdc8a3fa tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:16.794868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e3c73-5b21-4126-bcff-467453d9d612 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:16.802019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e3c73-5b21-4126-bcff-467453d9d612 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.802633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e3c73-5b21-4126-bcff-467453d9d612 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.807340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e3c73-5b21-4126-bcff-467453d9d612 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.808433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e3c73-5b21-4126-bcff-467453d9d612 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:16.813351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e3c73-5b21-4126-bcff-467453d9d612 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:16.852624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3770/7528] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:17:16 2022] POST /identity/v3/roles => generated 239 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:16.857533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e3c73-5b21-4126-bcff-467453d9d612 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:16.871216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e3c73-5b21-4126-bcff-467453d9d612 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:16.886190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc567f66-fc4b-4612-8313-e908fa666e1c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:16.886932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc567f66-fc4b-4612-8313-e908fa666e1c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.887948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc567f66-fc4b-4612-8313-e908fa666e1c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.888888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc567f66-fc4b-4612-8313-e908fa666e1c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/b0612b30d7ad4b1b8e9b925d60eb4698` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.890365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9e3a7-7eb2-466e-81a5-eea71da46167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:16.891859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9e3a7-7eb2-466e-81a5-eea71da46167 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:16.911817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc567f66-fc4b-4612-8313-e908fa666e1c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:get_user(user_id=b0612b30d7ad4b1b8e9b925d60eb4698)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:16.912371 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3759/7529] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:17:16.916192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc567f66-fc4b-4612-8313-e908fa666e1c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:16.919499 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3771/7530] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:17:16 2022] GET /identity/v3/users/b0612b30d7ad4b1b8e9b925d60eb4698 => generated 414 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:16.925600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9e3a7-7eb2-466e-81a5-eea71da46167 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:16.938431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9e3a7-7eb2-466e-81a5-eea71da46167 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:16.943923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f7a3f-7c04-4bcc-8524-61c054505e5d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:16.947217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7a3f-7c04-4bcc-8524-61c054505e5d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.947844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7a3f-7c04-4bcc-8524-61c054505e5d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.948771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7a3f-7c04-4bcc-8524-61c054505e5d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/roles/c5c3faef84b14ff59c0c8e77d9c1c0f7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.952591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f7a3f-7c04-4bcc-8524-61c054505e5d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:get_role(role_id=c5c3faef84b14ff59c0c8e77d9c1c0f7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:16.955393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f7a3f-7c04-4bcc-8524-61c054505e5d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:16.959304 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3760/7531] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:17:16 2022] GET /identity/v3/roles/c5c3faef84b14ff59c0c8e77d9c1c0f7 => generated 239 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:16.963456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc567f66-fc4b-4612-8313-e908fa666e1c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:16.982149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc567f66-fc4b-4612-8313-e908fa666e1c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:16.987875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ba82f-9659-43ab-aade-0bc1c75481f6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:16.989135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba82f-9659-43ab-aade-0bc1c75481f6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:16.989429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba82f-9659-43ab-aade-0bc1c75481f6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:16.989822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba82f-9659-43ab-aade-0bc1c75481f6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:16.990521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ba82f-9659-43ab-aade-0bc1c75481f6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:16.992575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ba82f-9659-43ab-aade-0bc1c75481f6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:17.068903 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3772/7532] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:16 2022] POST /identity/v3/projects => generated 360 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:17.072873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f7a3f-7c04-4bcc-8524-61c054505e5d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:17.085738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f7a3f-7c04-4bcc-8524-61c054505e5d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:17.219613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e15973-733d-4edb-8f62-ddada7393340 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:17.225641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15973-733d-4edb-8f62-ddada7393340 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:17.238412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15973-733d-4edb-8f62-ddada7393340 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:17.238412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15973-733d-4edb-8f62-ddada7393340 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/f6f41abcfae142698425e7d67adaa12c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:17.247469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e15973-733d-4edb-8f62-ddada7393340 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:get_project(project_id=f6f41abcfae142698425e7d67adaa12c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:17.255133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e15973-733d-4edb-8f62-ddada7393340 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:17.255544 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3761/7533] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:17:17 2022] GET /identity/v3/projects/f6f41abcfae142698425e7d67adaa12c => generated 360 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:17.257054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ba82f-9659-43ab-aade-0bc1c75481f6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:17.277939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ba82f-9659-43ab-aade-0bc1c75481f6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:17.294002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6e6e7-6267-47f8-9f7d-f0f298276170 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:17.295123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6e6e7-6267-47f8-9f7d-f0f298276170 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:17.295599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6e6e7-6267-47f8-9f7d-f0f298276170 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:17.295981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6e6e7-6267-47f8-9f7d-f0f298276170 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/f6f41abcfae142698425e7d67adaa12c/users/b0612b30d7ad4b1b8e9b925d60eb4698/roles/c5c3faef84b14ff59c0c8e77d9c1c0f7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:17.298608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6e6e7-6267-47f8-9f7d-f0f298276170 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f6f41abcfae142698425e7d67adaa12c, user_id=b0612b30d7ad4b1b8e9b925d60eb4698, role_id=c5c3faef84b14ff59c0c8e77d9c1c0f7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:17.301820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6e6e7-6267-47f8-9f7d-f0f298276170 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:17.322533 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3773/7534] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:17 2022] PUT /identity/v3/projects/f6f41abcfae142698425e7d67adaa12c/users/b0612b30d7ad4b1b8e9b925d60eb4698/roles/c5c3faef84b14ff59c0c8e77d9c1c0f7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:17.327970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e15973-733d-4edb-8f62-ddada7393340 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:17.341053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e15973-733d-4edb-8f62-ddada7393340 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:17.426859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4af7-9b53-49d0-95b0-7f2a050356a2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:17.428297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4af7-9b53-49d0-95b0-7f2a050356a2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:17.428776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4af7-9b53-49d0-95b0-7f2a050356a2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:17.429249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4af7-9b53-49d0-95b0-7f2a050356a2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:17.431765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e4af7-9b53-49d0-95b0-7f2a050356a2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:17.434391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e4af7-9b53-49d0-95b0-7f2a050356a2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:17.499431 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3762/7535] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:17 2022] POST /identity/v3/projects => generated 359 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:17.503707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6e6e7-6267-47f8-9f7d-f0f298276170 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:17.517452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6e6e7-6267-47f8-9f7d-f0f298276170 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:17.627677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd239cf-aa1c-4eff-b83e-7070a31b206b tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:17.629309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd239cf-aa1c-4eff-b83e-7070a31b206b tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:17.629704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd239cf-aa1c-4eff-b83e-7070a31b206b tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:17.630086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd239cf-aa1c-4eff-b83e-7070a31b206b tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/bd52fbd20aee4400a0651f39f9d99c0c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:17.631458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd239cf-aa1c-4eff-b83e-7070a31b206b tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd52fbd20aee4400a0651f39f9d99c0c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:17.633827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd239cf-aa1c-4eff-b83e-7070a31b206b tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:17.637556 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3774/7536] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:17:17 2022] GET /identity/v3/projects/bd52fbd20aee4400a0651f39f9d99c0c => generated 359 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:17.641613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4af7-9b53-49d0-95b0-7f2a050356a2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:17.668740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4af7-9b53-49d0-95b0-7f2a050356a2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:17.677376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1328e0-8819-4cd9-b6d5-07c9c0a3f9e6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:17.680148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1328e0-8819-4cd9-b6d5-07c9c0a3f9e6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:17.680941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1328e0-8819-4cd9-b6d5-07c9c0a3f9e6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:17.680941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1328e0-8819-4cd9-b6d5-07c9c0a3f9e6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/bd52fbd20aee4400a0651f39f9d99c0c/users/b0612b30d7ad4b1b8e9b925d60eb4698/roles/c5c3faef84b14ff59c0c8e77d9c1c0f7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:17.686394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1328e0-8819-4cd9-b6d5-07c9c0a3f9e6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd52fbd20aee4400a0651f39f9d99c0c, user_id=b0612b30d7ad4b1b8e9b925d60eb4698, role_id=c5c3faef84b14ff59c0c8e77d9c1c0f7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:17.687963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1328e0-8819-4cd9-b6d5-07c9c0a3f9e6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:17.725008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3763/7537] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:17 2022] PUT /identity/v3/projects/bd52fbd20aee4400a0651f39f9d99c0c/users/b0612b30d7ad4b1b8e9b925d60eb4698/roles/c5c3faef84b14ff59c0c8e77d9c1c0f7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:17.733846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd239cf-aa1c-4eff-b83e-7070a31b206b tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:17.747879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd239cf-aa1c-4eff-b83e-7070a31b206b tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:17.949453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:17.951682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:17.951972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:17.952257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/b0612b30d7ad4b1b8e9b925d60eb4698/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:17.955186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=b0612b30d7ad4b1b8e9b925d60eb4698)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:17.958474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:18.058753 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3775/7538] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:17:17 2022] GET /identity/v3/users/b0612b30d7ad4b1b8e9b925d60eb4698/projects => generated 843 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:18.061991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1328e0-8819-4cd9-b6d5-07c9c0a3f9e6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:18.075935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1328e0-8819-4cd9-b6d5-07c9c0a3f9e6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:18.081739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:18.083057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:18.083280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:18.084520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/bd52fbd20aee4400a0651f39f9d99c0c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:18.086839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd52fbd20aee4400a0651f39f9d99c0c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:18.089743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:18.229281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:18.232174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:18.256808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd52fbd20aee4400a0651f39f9d99c0c', 'request_id': 'req-69bf3399-4664-47b2-b617-3654e60367f2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.265739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd52fbd20aee4400a0651f39f9d99c0c', 'request_id': 'req-69bf3399-4664-47b2-b617-3654e60367f2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.281508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd52fbd20aee4400a0651f39f9d99c0c', 'request_id': 'req-69bf3399-4664-47b2-b617-3654e60367f2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.503471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c01c7-9ea5-4d78-a36a-ca272ca3f8d6 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:18.632511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:18.633384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:18.633668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:18.633936 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] PATH_INFO: `/v3/projects/d59c8f560331408690f5fb8c65a38f24` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:18.636817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59c8f560331408690f5fb8c65a38f24)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:18.639680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:18.684150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] The token cache is being invalidate because project bd52fbd20aee4400a0651f39f9d99c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:18.685424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.693553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.699138 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3764/7539] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:18 2022] DELETE /identity/v3/projects/bd52fbd20aee4400a0651f39f9d99c0c => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:18.704568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:18.707433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:18.758901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59c8f560331408690f5fb8c65a38f24', 'request_id': 'req-0eab826c-65bb-446d-b538-b3200950341b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.779914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59c8f560331408690f5fb8c65a38f24', 'request_id': 'req-0eab826c-65bb-446d-b538-b3200950341b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.796775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59c8f560331408690f5fb8c65a38f24', 'request_id': 'req-0eab826c-65bb-446d-b538-b3200950341b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.816865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] The token cache is being invalidate because project d59c8f560331408690f5fb8c65a38f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:18.817161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.820870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0eab826c-65bb-446d-b538-b3200950341b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:18.830609 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3776/7540] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:18 2022] DELETE /identity/v3/projects/d59c8f560331408690f5fb8c65a38f24 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:18.832312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d7996-d071-4bb7-a807-193095ad3aaa None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:18.832540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d7996-d071-4bb7-a807-193095ad3aaa None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:18.835659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d7996-d071-4bb7-a807-193095ad3aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:18.887034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3399-4664-47b2-b617-3654e60367f2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:18.892742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-be4d7996-d071-4bb7-a807-193095ad3aaa None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:18.894139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-be4d7996-d071-4bb7-a807-193095ad3aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:18.973134 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3777/7541] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:18.983005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5b3d5-72c3-462a-ab2a-433f0342cc68 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:18.983270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5b3d5-72c3-462a-ab2a-433f0342cc68 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:18.983553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5b3d5-72c3-462a-ab2a-433f0342cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.005267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-77c5b3d5-72c3-462a-ab2a-433f0342cc68 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:19.006549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-77c5b3d5-72c3-462a-ab2a-433f0342cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:19.016612 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3778/7542] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:19.022952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5b3d5-72c3-462a-ab2a-433f0342cc68 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.027652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.028893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.030127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.031937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/f6f41abcfae142698425e7d67adaa12c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.033590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5b3d5-72c3-462a-ab2a-433f0342cc68 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.034776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f6f41abcfae142698425e7d67adaa12c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.039201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.040018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.040393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.040688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.040922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.041439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:19.041732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.044245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.096473 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3779/7543] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:19.103501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.116630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a188ff-5b2d-41d3-af25-9acd1594c96a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.123630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b63b-74af-47eb-903e-0f3464acaf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.124455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b63b-74af-47eb-903e-0f3464acaf51 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.124611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b63b-74af-47eb-903e-0f3464acaf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.124943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b63b-74af-47eb-903e-0f3464acaf51 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.125686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9b63b-74af-47eb-903e-0f3464acaf51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.128245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9b63b-74af-47eb-903e-0f3464acaf51 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.167060 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3780/7544] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:19 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:19.168371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f41abcfae142698425e7d67adaa12c', 'request_id': 'req-582c4655-1528-4adc-959d-3755eac3209a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.172143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b63b-74af-47eb-903e-0f3464acaf51 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.182357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f41abcfae142698425e7d67adaa12c', 'request_id': 'req-582c4655-1528-4adc-959d-3755eac3209a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.205576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f41abcfae142698425e7d67adaa12c', 'request_id': 'req-582c4655-1528-4adc-959d-3755eac3209a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.225991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] The token cache is being invalidate because project f6f41abcfae142698425e7d67adaa12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:19.226282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.228485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.237673 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3765/7545] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:18 2022] DELETE /identity/v3/projects/f6f41abcfae142698425e7d67adaa12c => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:19.238683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.240247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:19.289580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b63b-74af-47eb-903e-0f3464acaf51 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.296300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.297036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.297317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.297595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.298580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.300634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.336400 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3781/7546] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:19 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:19.339612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.343595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:19.371132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c4655-1528-4adc-959d-3755eac3209a tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.464739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153cadd1b1ab4be9981ef151c354f4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06193abd1d34eaab32fdda1693b0ed4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.465490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.465781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.466126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.468713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:19.468713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.472028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.486669 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3766/7547] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:19.488049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.488557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dffdcd-02d0-4f7e-a1bf-452db90ce0d6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.490083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:19.504285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.507903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.508197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.508538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/roles/c5c3faef84b14ff59c0c8e77d9c1c0f7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.514203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c5c3faef84b14ff59c0c8e77d9c1c0f7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.514923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857943f0-aaec-4baf-8631-22efb8c2c14a tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.518253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.522849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414207c-a9ff-4c90-950e-6772177905d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.523380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414207c-a9ff-4c90-950e-6772177905d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.523670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414207c-a9ff-4c90-950e-6772177905d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.523948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414207c-a9ff-4c90-950e-6772177905d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.525220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414207c-a9ff-4c90-950e-6772177905d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.526910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414207c-a9ff-4c90-950e-6772177905d9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.540270 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3767/7548] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:19 2022] GET /identity/v3/roles => generated 1650 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:19.541378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414207c-a9ff-4c90-950e-6772177905d9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.558428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414207c-a9ff-4c90-950e-6772177905d9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.566685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153cadd1b1ab4be9981ef151c354f4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06193abd1d34eaab32fdda1693b0ed4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.567561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.568007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.568164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.569309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.572737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.599119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invalidating the token cache because role c5c3faef84b14ff59c0c8e77d9c1c0f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:19.600368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.601223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.603921 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3782/7549] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:19 2022] DELETE /identity/v3/roles/c5c3faef84b14ff59c0c8e77d9c1c0f7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:19.605143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.611784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:19.626005 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3768/7550] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:19 2022] POST /identity/v3/projects => generated 349 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:19.627501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.631446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:19.721578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce1354-06fd-4974-857f-5f50b4d7b90d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.787596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416a91f-420e-4b58-9040-5cfd528edd0b tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:19.798363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.799364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.799654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.799934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/b0612b30d7ad4b1b8e9b925d60eb4698` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.803986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b0612b30d7ad4b1b8e9b925d60eb4698)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.805978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.844233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:19.844927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:19.845213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:19.845493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:19.847937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:19.849911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:19.866791 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3783/7551] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:19.868232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.872049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:19.912369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0612b30d7ad4b1b8e9b925d60eb4698'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.934202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0612b30d7ad4b1b8e9b925d60eb4698'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.952762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0612b30d7ad4b1b8e9b925d60eb4698'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.954016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0612b30d7ad4b1b8e9b925d60eb4698'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.954891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0612b30d7ad4b1b8e9b925d60eb4698'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:19.985111 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3769/7552] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:19 2022] DELETE /identity/v3/users/b0612b30d7ad4b1b8e9b925d60eb4698 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:19.986150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:19.990327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:20.023051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da32ae-866d-4d01-b38a-a390300f1389 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:20.113194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735765-3ac0-43ae-8d6b-ea85d6bfb869 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:20.134766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9cfb-ec9d-4d6b-988f-43339da1b2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:20.136045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9cfb-ec9d-4d6b-988f-43339da1b2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:20.137306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9cfb-ec9d-4d6b-988f-43339da1b2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:20.138406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9cfb-ec9d-4d6b-988f-43339da1b2e3 admin admin] PATH_INFO: `/v3/projects/b33e2b5cc01d46e0aaf008fe66c51942/users/97f800f04d0b4857accfe52c51edf4bb/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:20.156647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153cadd1b1ab4be9981ef151c354f4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06193abd1d34eaab32fdda1693b0ed4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:20.158538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:20.158921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:20.160381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:20.161624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:20.164588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:20.165975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d9cfb-ec9d-4d6b-988f-43339da1b2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33e2b5cc01d46e0aaf008fe66c51942, user_id=97f800f04d0b4857accfe52c51edf4bb, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:20.168125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:20.170812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d9cfb-ec9d-4d6b-988f-43339da1b2e3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:20.191998 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3784/7553] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:20.193857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:20.196227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:20.224440 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3770/7554] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:19 2022] PUT /identity/v3/projects/b33e2b5cc01d46e0aaf008fe66c51942/users/97f800f04d0b4857accfe52c51edf4bb/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:20.236581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b46a4-63be-487d-a5e4-a0247d2f7cf3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:20.237066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b46a4-63be-487d-a5e4-a0247d2f7cf3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:20.237630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b46a4-63be-487d-a5e4-a0247d2f7cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:20.311770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c911e3-0938-4706-90cc-a54011f7a741 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:20.314202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fa2b46a4-63be-487d-a5e4-a0247d2f7cf3 None None] MFA Rules not processed for user `97f800f04d0b4857accfe52c51edf4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:20.318945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fa2b46a4-63be-487d-a5e4-a0247d2f7cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:20.395167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:20.396212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:20.396617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:20.397045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/1e9fa5c7af5740ef9e4a3384b3a4607c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:20.399001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e9fa5c7af5740ef9e4a3384b3a4607c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:20.404923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:20.437847 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3771/7555] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:20.446910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b46a4-63be-487d-a5e4-a0247d2f7cf3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:20.449360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fa2b46a4-63be-487d-a5e4-a0247d2f7cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:20.498520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9fa5c7af5740ef9e4a3384b3a4607c', 'request_id': 'req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:20.518305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9fa5c7af5740ef9e4a3384b3a4607c', 'request_id': 'req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:20.534030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9fa5c7af5740ef9e4a3384b3a4607c', 'request_id': 'req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:20.561932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] The token cache is being invalidate because project 1e9fa5c7af5740ef9e4a3384b3a4607c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:20.562691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:20.564071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:20.572602 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3785/7556] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:20 2022] DELETE /identity/v3/projects/1e9fa5c7af5740ef9e4a3384b3a4607c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:20.574329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:20.576259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:20.577105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b46a4-63be-487d-a5e4-a0247d2f7cf3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:20.690813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d05e-5a36-43b3-a595-b6fde4ae84a4 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:20.714410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:20.717851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:20.718262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:20.718647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:20.723900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:20.725986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:20.727430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:20.727721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:20.728004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/444778f66c5a4977997e86a51f75eef2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:20.730189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:update_user(user_id=444778f66c5a4977997e86a51f75eef2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:20.737826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:20.803544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:20.822282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invalidating the token cache because user 444778f66c5a4977997e86a51f75eef2 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:20.822670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:20.823790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-036c9165-7c9d-45c9-811c-41bf82d65ce2 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:20.830477 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3786/7557] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Feb 19 21:17:20 2022] PATCH /identity/v3/users/444778f66c5a4977997e86a51f75eef2 => generated 296 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:20.834341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46003-5262-4b04-b70a-f391abe25ac9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:20.834742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46003-5262-4b04-b70a-f391abe25ac9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:20.835027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46003-5262-4b04-b70a-f391abe25ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:20.872021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:20.882065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:20.904292 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3772/7558] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:20.922597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2dc46003-5262-4b04-b70a-f391abe25ac9 None None] MFA Rules not processed for user `444778f66c5a4977997e86a51f75eef2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:20.924072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2dc46003-5262-4b04-b70a-f391abe25ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:20.934431 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3787/7559] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:20 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:17:20.938747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:20.961482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e0dc-db7d-4fdf-8e4d-caf62ab655a1 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:20.984204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:20.985166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:20.985464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:20.985752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/444778f66c5a4977997e86a51f75eef2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:20.987248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:update_user(user_id=444778f66c5a4977997e86a51f75eef2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:20.988307 ncdv-master-1 devstack@keystone.service[96910]: WARNING py.warnings [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:17:20.988307 ncdv-master-1 devstack@keystone.service[96910]: warnings.warn(msg) Feb 19 21:17:20.988307 ncdv-master-1 devstack@keystone.service[96910]: Feb 19 21:17:20.989573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:21.072845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.089692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invalidating the token cache because user 444778f66c5a4977997e86a51f75eef2 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:21.090084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.090751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.094085 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3773/7560] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Feb 19 21:17:20 2022] PATCH /identity/v3/users/444778f66c5a4977997e86a51f75eef2 => generated 296 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:21.099531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46003-5262-4b04-b70a-f391abe25ac9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:21.101787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2dc46003-5262-4b04-b70a-f391abe25ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:21.146310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46003-5262-4b04-b70a-f391abe25ac9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:21.168299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:21.173365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:21.173365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:21.173365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/444778f66c5a4977997e86a51f75eef2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:21.216279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:update_user(user_id=444778f66c5a4977997e86a51f75eef2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:21.219627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:21.292518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:21.294117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:21.304298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.332075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invalidating the token cache because user 444778f66c5a4977997e86a51f75eef2 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:21.332463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.333113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-38d7f51e-899a-46f6-bd9e-e407fccced7c tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.340597 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3788/7561] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Feb 19 21:17:21 2022] PATCH /identity/v3/users/444778f66c5a4977997e86a51f75eef2 => generated 296 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:21.342433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f362-0e7c-4ac4-8996-b889378c8cf5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:21.342754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f362-0e7c-4ac4-8996-b889378c8cf5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:21.343030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f362-0e7c-4ac4-8996-b889378c8cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:21.417145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2757f362-0e7c-4ac4-8996-b889378c8cf5 None None] MFA Rules not processed for user `444778f66c5a4977997e86a51f75eef2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:21.418506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2757f362-0e7c-4ac4-8996-b889378c8cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:21.452102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b7af4-09cf-49f1-b145-e456359e43d5 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:21.452748 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3789/7562] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:21 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:17:21.453954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757f362-0e7c-4ac4-8996-b889378c8cf5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:21.461215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2757f362-0e7c-4ac4-8996-b889378c8cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:21.470463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153cadd1b1ab4be9981ef151c354f4b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06193abd1d34eaab32fdda1693b0ed4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:21.471354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:21.471644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:21.473015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] PATH_INFO: `/v3/projects/c850e4ed7ac440e2aa8904003679e6e5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:21.474929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c850e4ed7ac440e2aa8904003679e6e5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:21.485026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757f362-0e7c-4ac4-8996-b889378c8cf5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:21.487265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:21.491206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:21.492605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:21.493077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:21.493524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/444778f66c5a4977997e86a51f75eef2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:21.497480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:update_user(user_id=444778f66c5a4977997e86a51f75eef2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:21.499886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:21.546786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.558410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invalidating the token cache because user 444778f66c5a4977997e86a51f75eef2 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:21.559006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.565561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.579554 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3790/7563] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Feb 19 21:17:21 2022] PATCH /identity/v3/users/444778f66c5a4977997e86a51f75eef2 => generated 296 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:21.582432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:21.583947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:21.601687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb30e0-9b7d-4f85-8d88-e445622309f0 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:21.608319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaa1b0-5671-4f3b-913a-82921fa15eed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:21.609281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaa1b0-5671-4f3b-913a-82921fa15eed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:21.609453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaa1b0-5671-4f3b-913a-82921fa15eed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:21.609785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaa1b0-5671-4f3b-913a-82921fa15eed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:21.610527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaa1b0-5671-4f3b-913a-82921fa15eed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:21.612521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaa1b0-5671-4f3b-913a-82921fa15eed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:21.637186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c850e4ed7ac440e2aa8904003679e6e5', 'request_id': 'req-25d6eb03-be5e-4788-b22a-efc0229c26b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.651639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c850e4ed7ac440e2aa8904003679e6e5', 'request_id': 'req-25d6eb03-be5e-4788-b22a-efc0229c26b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.676396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c850e4ed7ac440e2aa8904003679e6e5', 'request_id': 'req-25d6eb03-be5e-4788-b22a-efc0229c26b9'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.692584 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3791/7564] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Feb 19 21:17:21 2022] POST /identity/v3/users => generated 265 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:21.694586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaa1b0-5671-4f3b-913a-82921fa15eed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:21.695069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] The token cache is being invalidate because project c850e4ed7ac440e2aa8904003679e6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:21.695638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.696482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.700663 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3774/7565] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:21 2022] DELETE /identity/v3/projects/c850e4ed7ac440e2aa8904003679e6e5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:21.713358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaa1b0-5671-4f3b-913a-82921fa15eed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:21.769298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:21.772040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:21.818194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92408d4-59b0-4d90-8ea4-44105c51b476 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:21.820524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92408d4-59b0-4d90-8ea4-44105c51b476 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:21.821682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92408d4-59b0-4d90-8ea4-44105c51b476 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:21.821682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92408d4-59b0-4d90-8ea4-44105c51b476 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/83e49bfd472d477fb47c3643a8df765c/password` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:21.869332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6eb03-be5e-4788-b22a-efc0229c26b9 tempest-RoutersAdminTest-948467046 tempest-RoutersAdminTest-948467046-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:21.877556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:21.878629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:21.879025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:21.879433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:21.882554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:21.965335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a92408d4-59b0-4d90-8ea4-44105c51b476 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83e49bfd472d477fb47c3643a8df765c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:21.974401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:21.976633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:21.993717 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3792/7566] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Feb 19 21:17:21 2022] POST /identity/v3/users/83e49bfd472d477fb47c3643a8df765c/password => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:21.995427 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3775/7567] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:22.999247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ac089-bc92-4bb6-8e42-48a5057b4a53 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:23.000422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ac089-bc92-4bb6-8e42-48a5057b4a53 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:23.000938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ac089-bc92-4bb6-8e42-48a5057b4a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:23.029919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-561ac089-bc92-4bb6-8e42-48a5057b4a53 None None] MFA Rules not processed for user `83e49bfd472d477fb47c3643a8df765c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:23.037938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-561ac089-bc92-4bb6-8e42-48a5057b4a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:23.049610 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3793/7568] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:22 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 19 21:17:23.053791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:23.055707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:23.088937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84791472-88c6-4d0e-94d3-d3cfa87d2520 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:23.103515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d25da-dcbc-4f56-adae-37f521869f09 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:23.104400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d25da-dcbc-4f56-adae-37f521869f09 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:23.105495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d25da-dcbc-4f56-adae-37f521869f09 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:23.105897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d25da-dcbc-4f56-adae-37f521869f09 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:23.130502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d25da-dcbc-4f56-adae-37f521869f09 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:23.139067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d25da-dcbc-4f56-adae-37f521869f09 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:23.160262 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3776/7569] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Feb 19 21:17:23 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 19 21:17:23.164587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ac089-bc92-4bb6-8e42-48a5057b4a53 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:23.189966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ac089-bc92-4bb6-8e42-48a5057b4a53 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:23.202643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:23.205282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:23.205282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:23.208462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/83e49bfd472d477fb47c3643a8df765c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:23.208462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_user(user_id=83e49bfd472d477fb47c3643a8df765c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:23.211016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:23.321497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e49bfd472d477fb47c3643a8df765c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:23.323406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e49bfd472d477fb47c3643a8df765c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:23.324149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e49bfd472d477fb47c3643a8df765c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:23.337440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e49bfd472d477fb47c3643a8df765c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:23.346214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e49bfd472d477fb47c3643a8df765c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:23.362754 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3794/7570] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:23 2022] DELETE /identity/v3/users/83e49bfd472d477fb47c3643a8df765c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:23.368436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d25da-dcbc-4f56-adae-37f521869f09 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:23.380483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d25da-dcbc-4f56-adae-37f521869f09 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:23.459673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3f961-7a35-4cdb-a8e4-67fbccf6cb44 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:23.460397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f961-7a35-4cdb-a8e4-67fbccf6cb44 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:23.460691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f961-7a35-4cdb-a8e4-67fbccf6cb44 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:23.460972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f961-7a35-4cdb-a8e4-67fbccf6cb44 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:23.462371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3f961-7a35-4cdb-a8e4-67fbccf6cb44 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:23.463788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3f961-7a35-4cdb-a8e4-67fbccf6cb44 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:23.536417 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3777/7571] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:23 2022] POST /identity/v3/users => generated 364 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:23.538117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:23.540044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:23.573641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7192b9-d4fe-4625-b300-8fa8f43582ed tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:23.582801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9cc6-f462-4f29-ad6c-75469b71cd3d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:23.584730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9cc6-f462-4f29-ad6c-75469b71cd3d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:23.585137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9cc6-f462-4f29-ad6c-75469b71cd3d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:23.585426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9cc6-f462-4f29-ad6c-75469b71cd3d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:23.586239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d9cc6-f462-4f29-ad6c-75469b71cd3d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:23.589296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d9cc6-f462-4f29-ad6c-75469b71cd3d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:23.637204 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3795/7572] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:23 2022] POST /identity/v3/projects => generated 359 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:23.642123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3f961-7a35-4cdb-a8e4-67fbccf6cb44 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:23.660254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3f961-7a35-4cdb-a8e4-67fbccf6cb44 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:23.795350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707be69-d7bc-4355-bea9-a40fe2d306ae tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:23.796445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707be69-d7bc-4355-bea9-a40fe2d306ae tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:23.796960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707be69-d7bc-4355-bea9-a40fe2d306ae tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:23.797236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707be69-d7bc-4355-bea9-a40fe2d306ae tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/d055316b0b9f45aa8e9704148fcfb0e6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:23.815426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707be69-d7bc-4355-bea9-a40fe2d306ae tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:update_user(user_id=d055316b0b9f45aa8e9704148fcfb0e6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:23.818358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707be69-d7bc-4355-bea9-a40fe2d306ae tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:23.863985 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3778/7573] 10.222.0.30 () {60 vars in 1243 bytes} [Sat Feb 19 21:17:23 2022] PATCH /identity/v3/users/d055316b0b9f45aa8e9704148fcfb0e6 => generated 524 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:23.868645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9cc6-f462-4f29-ad6c-75469b71cd3d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:23.882781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9cc6-f462-4f29-ad6c-75469b71cd3d tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:23.887622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:23.888858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:23.888995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:23.889253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/d055316b0b9f45aa8e9704148fcfb0e6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:23.904946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:get_user(user_id=d055316b0b9f45aa8e9704148fcfb0e6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:23.907518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:23.909867 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3796/7574] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:17:23 2022] GET /identity/v3/users/d055316b0b9f45aa8e9704148fcfb0e6 => generated 390 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:23.915631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707be69-d7bc-4355-bea9-a40fe2d306ae tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:23.929597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707be69-d7bc-4355-bea9-a40fe2d306ae tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:23.935599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:23.936775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:23.937255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:23.937728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/projects/1c0b7d50c2974ce4be70fa50908f40d6` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:23.939267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1c0b7d50c2974ce4be70fa50908f40d6)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:23.941916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:24.024398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0b7d50c2974ce4be70fa50908f40d6', 'request_id': 'req-bd2a6a05-d9b5-472d-b736-cb637d758df1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.032476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0b7d50c2974ce4be70fa50908f40d6', 'request_id': 'req-bd2a6a05-d9b5-472d-b736-cb637d758df1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.046173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0b7d50c2974ce4be70fa50908f40d6', 'request_id': 'req-bd2a6a05-d9b5-472d-b736-cb637d758df1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.058439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] The token cache is being invalidate because project 1c0b7d50c2974ce4be70fa50908f40d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:24.059222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.060519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.067275 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3779/7575] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:23 2022] DELETE /identity/v3/projects/1c0b7d50c2974ce4be70fa50908f40d6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:24.069093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:24.071298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:24.117275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ed2b2-77a2-4d34-801f-22027d96c6b7 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:24.311565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d72242cca2442f81f8d5acd79ae317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3da46500c9440bb0d6a561008c6476', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:24.312543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:24.313747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:24.314763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] PATH_INFO: `/v3/users/d055316b0b9f45aa8e9704148fcfb0e6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:24.316999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d055316b0b9f45aa8e9704148fcfb0e6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:24.320477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:24.484323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd055316b0b9f45aa8e9704148fcfb0e6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.489800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd055316b0b9f45aa8e9704148fcfb0e6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.492138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd055316b0b9f45aa8e9704148fcfb0e6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.515331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd055316b0b9f45aa8e9704148fcfb0e6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.544867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd055316b0b9f45aa8e9704148fcfb0e6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:24.582405 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3797/7576] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:24 2022] DELETE /identity/v3/users/d055316b0b9f45aa8e9704148fcfb0e6 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:24.587474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:24.594015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:24.742179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a6a05-d9b5-472d-b736-cb637d758df1 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:24.779111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:24.781421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:24.911947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:24.913470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:24.913926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:24.914370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] PATH_INFO: `/v3/users/444778f66c5a4977997e86a51f75eef2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:24.921478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2488765-6577-4709-bfde-5d78edcbe996 tempest-UsersV3TestJSON-1143190364 tempest-UsersV3TestJSON-1143190364-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:24.931717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a6a0a-1709-4c4d-ab58-5b88d7400f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:24.932836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a6a0a-1709-4c4d-ab58-5b88d7400f32 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:24.933318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a6a0a-1709-4c4d-ab58-5b88d7400f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:24.933758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a6a0a-1709-4c4d-ab58-5b88d7400f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:24.938607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-939a6a0a-1709-4c4d-ab58-5b88d7400f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:24.950532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=444778f66c5a4977997e86a51f75eef2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:24.954164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:24.969946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a6a0a-1709-4c4d-ab58-5b88d7400f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:24.972035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a6a0a-1709-4c4d-ab58-5b88d7400f32 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:24.997846 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3798/7577] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:25.061477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:25.089895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:25.105576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:25.106259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:25.106994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444778f66c5a4977997e86a51f75eef2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:25.127625 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3780/7578] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:24 2022] DELETE /identity/v3/users/444778f66c5a4977997e86a51f75eef2 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:25.130036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b5cc3-41d7-48ff-9224-7e7c9171d017 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:25.130600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b5cc3-41d7-48ff-9224-7e7c9171d017 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:25.130978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b5cc3-41d7-48ff-9224-7e7c9171d017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:25.156597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-553b5cc3-41d7-48ff-9224-7e7c9171d017 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:25.158527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-553b5cc3-41d7-48ff-9224-7e7c9171d017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:25.280976 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3799/7579] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:25.305151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:25.307482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:25.409376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68007b18-91a0-424f-9cf9-7250cb17a7c3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:25.415340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac7f01-8b68-43ac-8366-086af2e71460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:25.416253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7f01-8b68-43ac-8366-086af2e71460 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:25.416690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7f01-8b68-43ac-8366-086af2e71460 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:25.417064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7f01-8b68-43ac-8366-086af2e71460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:25.433048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac7f01-8b68-43ac-8366-086af2e71460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:25.437014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac7f01-8b68-43ac-8366-086af2e71460 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:25.449574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3781/7580] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:26.432861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b5cc3-41d7-48ff-9224-7e7c9171d017 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:26.434293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-553b5cc3-41d7-48ff-9224-7e7c9171d017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:26.453245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b5cc3-41d7-48ff-9224-7e7c9171d017 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:26.461556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:26.466924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:26.468790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:26.469312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] PATH_INFO: `/v3/projects/b1dbc224855a4accb2d6518920d212c9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:26.471540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1dbc224855a4accb2d6518920d212c9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:26.475107 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:26.577455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1dbc224855a4accb2d6518920d212c9', 'request_id': 'req-581edff2-0fb0-4bbb-9197-aefc9008b9be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.584944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1dbc224855a4accb2d6518920d212c9', 'request_id': 'req-581edff2-0fb0-4bbb-9197-aefc9008b9be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.599184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1dbc224855a4accb2d6518920d212c9', 'request_id': 'req-581edff2-0fb0-4bbb-9197-aefc9008b9be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.618464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] The token cache is being invalidate because project b1dbc224855a4accb2d6518920d212c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:26.619446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.620613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.623902 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3800/7581] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:26 2022] DELETE /identity/v3/projects/b1dbc224855a4accb2d6518920d212c9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:26.629529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac7f01-8b68-43ac-8366-086af2e71460 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:26.652647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac7f01-8b68-43ac-8366-086af2e71460 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:26.782400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:26.783660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:26.784110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:26.784936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] PATH_INFO: `/v3/users/a7d72242cca2442f81f8d5acd79ae317` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:26.788003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d72242cca2442f81f8d5acd79ae317)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:26.794702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:26.902630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d72242cca2442f81f8d5acd79ae317'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.945238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d72242cca2442f81f8d5acd79ae317'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.961289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d72242cca2442f81f8d5acd79ae317'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.962207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d72242cca2442f81f8d5acd79ae317'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.963109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-81c9f289-68cf-463c-8101-ca87b517e1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d72242cca2442f81f8d5acd79ae317'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:26.988790 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3782/7582] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:26 2022] DELETE /identity/v3/users/a7d72242cca2442f81f8d5acd79ae317 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:27.775811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:27.777976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:27.816654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581edff2-0fb0-4bbb-9197-aefc9008b9be admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:27.996162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:27.998756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:27.999363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:27.999826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] PATH_INFO: `/v3/projects/fb3da46500c9440bb0d6a561008c6476` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.002484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3da46500c9440bb0d6a561008c6476)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:28.006279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:28.140919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3da46500c9440bb0d6a561008c6476', 'request_id': 'req-168a7a34-b442-49f6-8b34-686ac8521b1c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:28.160382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3da46500c9440bb0d6a561008c6476', 'request_id': 'req-168a7a34-b442-49f6-8b34-686ac8521b1c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:28.182445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3da46500c9440bb0d6a561008c6476', 'request_id': 'req-168a7a34-b442-49f6-8b34-686ac8521b1c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:28.197805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] The token cache is being invalidate because project fb3da46500c9440bb0d6a561008c6476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:28.198348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:28.200044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168a7a34-b442-49f6-8b34-686ac8521b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:28.204124 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3801/7583] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:27 2022] DELETE /identity/v3/projects/fb3da46500c9440bb0d6a561008c6476 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:28.209550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b677af-380c-4fff-ac04-833c41becdc1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.210072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b677af-380c-4fff-ac04-833c41becdc1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:28.210072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b677af-380c-4fff-ac04-833c41becdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.238224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-07b677af-380c-4fff-ac04-833c41becdc1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:28.239509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-07b677af-380c-4fff-ac04-833c41becdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:28.347450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba805-dcf5-4a61-ab5f-e713398eb1e6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.347994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba805-dcf5-4a61-ab5f-e713398eb1e6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:28.348417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba805-dcf5-4a61-ab5f-e713398eb1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.351250 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3783/7584] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:28.372915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1dbba805-dcf5-4a61-ab5f-e713398eb1e6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:28.374603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1dbba805-dcf5-4a61-ab5f-e713398eb1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:28.390960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b677af-380c-4fff-ac04-833c41becdc1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:28.396512 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3802/7585] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:28.404253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b677af-380c-4fff-ac04-833c41becdc1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:28.410973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:28.411974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.412542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:28.413045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.414111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:28.414642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:28.416935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:28.441965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3784/7586] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:28.447458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbba805-dcf5-4a61-ab5f-e713398eb1e6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:28.459959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbba805-dcf5-4a61-ab5f-e713398eb1e6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:28.467268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c4d60-7f54-452d-805d-4bc0ceb6ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:28.468201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4d60-7f54-452d-805d-4bc0ceb6ce88 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.468678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4d60-7f54-452d-805d-4bc0ceb6ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:28.469111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4d60-7f54-452d-805d-4bc0ceb6ce88 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.470061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c4d60-7f54-452d-805d-4bc0ceb6ce88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:28.472490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c4d60-7f54-452d-805d-4bc0ceb6ce88 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:28.514884 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3803/7587] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:28 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:28.520681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:28.533424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb0f6c-7b6b-4ef6-bf9a-446ff06ce54f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:28.632023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fdc6a-2893-48d3-8c44-2bde4d01b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:28.633036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fdc6a-2893-48d3-8c44-2bde4d01b660 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.633406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fdc6a-2893-48d3-8c44-2bde4d01b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:28.633760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fdc6a-2893-48d3-8c44-2bde4d01b660 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.634699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fdc6a-2893-48d3-8c44-2bde4d01b660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:28.637078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fdc6a-2893-48d3-8c44-2bde4d01b660 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:28.675635 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3785/7588] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:28 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:28.682519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c4d60-7f54-452d-805d-4bc0ceb6ce88 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:28.724447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c4d60-7f54-452d-805d-4bc0ceb6ce88 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:28.741917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec1054-408f-485a-b261-8a2f1ca83def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:28.742788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec1054-408f-485a-b261-8a2f1ca83def admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.743170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec1054-408f-485a-b261-8a2f1ca83def admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:28.743407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec1054-408f-485a-b261-8a2f1ca83def admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.748671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec1054-408f-485a-b261-8a2f1ca83def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:28.750380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec1054-408f-485a-b261-8a2f1ca83def admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:28.771045 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3804/7589] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:28.772910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fdc6a-2893-48d3-8c44-2bde4d01b660 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:28.800212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fdc6a-2893-48d3-8c44-2bde4d01b660 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:28.818638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63690812-e3c5-44ea-a493-514e6ea8843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:28.820152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690812-e3c5-44ea-a493-514e6ea8843d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.820837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690812-e3c5-44ea-a493-514e6ea8843d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:28.821484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690812-e3c5-44ea-a493-514e6ea8843d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.823559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690812-e3c5-44ea-a493-514e6ea8843d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:28.827240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690812-e3c5-44ea-a493-514e6ea8843d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:28.850478 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3786/7590] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:28.855357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec1054-408f-485a-b261-8a2f1ca83def admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:28.876081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec1054-408f-485a-b261-8a2f1ca83def admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:28.887081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b6aa-0269-43a8-a688-2ac2d081447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:28.888860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b6aa-0269-43a8-a688-2ac2d081447b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.889220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b6aa-0269-43a8-a688-2ac2d081447b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:28.889507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b6aa-0269-43a8-a688-2ac2d081447b admin admin] PATH_INFO: `/v3/projects/4f1e7b911d8649ab86f901ff0b82b09d/users/64c384cd700041a381eb9bbbc695f527/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:28.927343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b6aa-0269-43a8-a688-2ac2d081447b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1e7b911d8649ab86f901ff0b82b09d, user_id=64c384cd700041a381eb9bbbc695f527, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:28.943072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b6aa-0269-43a8-a688-2ac2d081447b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:28.983739 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3805/7591] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:28 2022] PUT /identity/v3/projects/4f1e7b911d8649ab86f901ff0b82b09d/users/64c384cd700041a381eb9bbbc695f527/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:28.999335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e21f8-a400-42b6-bc63-ae6fa1b2433d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:28.999928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e21f8-a400-42b6-bc63-ae6fa1b2433d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:29.001786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e21f8-a400-42b6-bc63-ae6fa1b2433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:29.054184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-666e21f8-a400-42b6-bc63-ae6fa1b2433d None None] MFA Rules not processed for user `64c384cd700041a381eb9bbbc695f527`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:29.055821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-666e21f8-a400-42b6-bc63-ae6fa1b2433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:29.215672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b6aa-0269-43a8-a688-2ac2d081447b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:29.222329 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3787/7592] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:29.229153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b6aa-0269-43a8-a688-2ac2d081447b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:29.234897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69200798-435d-4ab7-ba43-e200c9598fc4 tempest-DefaultDomainTestJSON-1516983925 tempest-DefaultDomainTestJSON-1516983925-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c384cd700041a381eb9bbbc695f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f1e7b911d8649ab86f901ff0b82b09d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:29.235764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69200798-435d-4ab7-ba43-e200c9598fc4 tempest-DefaultDomainTestJSON-1516983925 tempest-DefaultDomainTestJSON-1516983925-project] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:29.236053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69200798-435d-4ab7-ba43-e200c9598fc4 tempest-DefaultDomainTestJSON-1516983925 tempest-DefaultDomainTestJSON-1516983925-project] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:29.236382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69200798-435d-4ab7-ba43-e200c9598fc4 tempest-DefaultDomainTestJSON-1516983925 tempest-DefaultDomainTestJSON-1516983925-project] PATH_INFO: `/v3/domains/default` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:29.238136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69200798-435d-4ab7-ba43-e200c9598fc4 tempest-DefaultDomainTestJSON-1516983925 tempest-DefaultDomainTestJSON-1516983925-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:29.240019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69200798-435d-4ab7-ba43-e200c9598fc4 tempest-DefaultDomainTestJSON-1516983925 tempest-DefaultDomainTestJSON-1516983925-project] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:29.242217 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3806/7593] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:17:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:29.248058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e21f8-a400-42b6-bc63-ae6fa1b2433d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:29.346909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e21f8-a400-42b6-bc63-ae6fa1b2433d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:29.355555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:29.358294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:29.358931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:29.359930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] PATH_INFO: `/v3/users/64c384cd700041a381eb9bbbc695f527` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:29.363249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c384cd700041a381eb9bbbc695f527)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:29.367415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:29.457429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c384cd700041a381eb9bbbc695f527'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:29.488480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c384cd700041a381eb9bbbc695f527'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:29.501118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c384cd700041a381eb9bbbc695f527'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:29.501964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c384cd700041a381eb9bbbc695f527'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:29.503170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c384cd700041a381eb9bbbc695f527'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:29.539780 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3788/7594] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:29 2022] DELETE /identity/v3/users/64c384cd700041a381eb9bbbc695f527 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:29.544935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220c0d-ce18-4afa-ac98-f2f61706ab01 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:29.545224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220c0d-ce18-4afa-ac98-f2f61706ab01 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:29.545503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220c0d-ce18-4afa-ac98-f2f61706ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:29.575880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-32220c0d-ce18-4afa-ac98-f2f61706ab01 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:29.577158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-32220c0d-ce18-4afa-ac98-f2f61706ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:29.716900 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3807/7595] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:29.729083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:29.730519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:29.903505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2990d9-3e86-4869-879b-c6a8fd29be41 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:29.914895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee8513-44bd-4415-b46c-0c037ed24ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:29.915604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8513-44bd-4415-b46c-0c037ed24ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:29.915889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8513-44bd-4415-b46c-0c037ed24ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:29.916212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8513-44bd-4415-b46c-0c037ed24ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:29.929665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee8513-44bd-4415-b46c-0c037ed24ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:29.931262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee8513-44bd-4415-b46c-0c037ed24ca5 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:29.950933 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3789/7596] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:30.314596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32220c0d-ce18-4afa-ac98-f2f61706ab01 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:30.316972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-32220c0d-ce18-4afa-ac98-f2f61706ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:30.338129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32220c0d-ce18-4afa-ac98-f2f61706ab01 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:30.344345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:30.345605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:30.345900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:30.346183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] PATH_INFO: `/v3/users/97f800f04d0b4857accfe52c51edf4bb` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:30.348348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f800f04d0b4857accfe52c51edf4bb)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:30.350441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:30.447467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f800f04d0b4857accfe52c51edf4bb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:30.449241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f800f04d0b4857accfe52c51edf4bb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:30.449978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f800f04d0b4857accfe52c51edf4bb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:30.472786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f800f04d0b4857accfe52c51edf4bb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:30.485132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f800f04d0b4857accfe52c51edf4bb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:30.525217 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3808/7597] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:30 2022] DELETE /identity/v3/users/97f800f04d0b4857accfe52c51edf4bb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:30.526151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da96f7-c7b7-4b2b-8a79-4a20189f2311 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:30.526653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da96f7-c7b7-4b2b-8a79-4a20189f2311 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:30.526779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da96f7-c7b7-4b2b-8a79-4a20189f2311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:30.564922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d6da96f7-c7b7-4b2b-8a79-4a20189f2311 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:30.566417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d6da96f7-c7b7-4b2b-8a79-4a20189f2311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:30.681843 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3790/7598] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:30.750547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:30.753279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:30.849296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6401f-f9e2-47c4-bf7d-788e827d5256 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:30.874878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131091b-f448-4d41-acdd-82a9ba3957fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:30.876291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131091b-f448-4d41-acdd-82a9ba3957fd service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:30.876634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131091b-f448-4d41-acdd-82a9ba3957fd service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:30.876923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131091b-f448-4d41-acdd-82a9ba3957fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:30.891253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131091b-f448-4d41-acdd-82a9ba3957fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:30.893091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131091b-f448-4d41-acdd-82a9ba3957fd service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:30.908663 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3809/7599] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:31.259109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da96f7-c7b7-4b2b-8a79-4a20189f2311 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:31.260616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d6da96f7-c7b7-4b2b-8a79-4a20189f2311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:31.280706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da96f7-c7b7-4b2b-8a79-4a20189f2311 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:31.287888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:31.289579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:31.290113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:31.290610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] PATH_INFO: `/v3/projects/4f1e7b911d8649ab86f901ff0b82b09d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:31.292179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1e7b911d8649ab86f901ff0b82b09d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:31.297273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:31.409149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1e7b911d8649ab86f901ff0b82b09d', 'request_id': 'req-85ac190b-1993-407f-9d0f-d8fc7d095e54'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.438661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1e7b911d8649ab86f901ff0b82b09d', 'request_id': 'req-85ac190b-1993-407f-9d0f-d8fc7d095e54'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.452808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1e7b911d8649ab86f901ff0b82b09d', 'request_id': 'req-85ac190b-1993-407f-9d0f-d8fc7d095e54'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.474396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] The token cache is being invalidate because project 4f1e7b911d8649ab86f901ff0b82b09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:31.475813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.477240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-85ac190b-1993-407f-9d0f-d8fc7d095e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.479827 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3791/7600] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:31 2022] DELETE /identity/v3/projects/4f1e7b911d8649ab86f901ff0b82b09d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:31.484550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542609b0-4fdd-467e-9da3-bd9b8e43c1a0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:31.485495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542609b0-4fdd-467e-9da3-bd9b8e43c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:31.485999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542609b0-4fdd-467e-9da3-bd9b8e43c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:31.510449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-542609b0-4fdd-467e-9da3-bd9b8e43c1a0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:31.513336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-542609b0-4fdd-467e-9da3-bd9b8e43c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:31.662393 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3810/7601] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:31.662887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7c5f-fabf-4fb9-9243-92089f22f0ab None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:31.663360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7c5f-fabf-4fb9-9243-92089f22f0ab None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:31.663470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7c5f-fabf-4fb9-9243-92089f22f0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:31.693695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ca1a7c5f-fabf-4fb9-9243-92089f22f0ab None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:31.695474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ca1a7c5f-fabf-4fb9-9243-92089f22f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:31.717833 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3792/7602] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:31.723109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542609b0-4fdd-467e-9da3-bd9b8e43c1a0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:31.739140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7c5f-fabf-4fb9-9243-92089f22f0ab None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:31.745364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542609b0-4fdd-467e-9da3-bd9b8e43c1a0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:31.749922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ca1a7c5f-fabf-4fb9-9243-92089f22f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:31.766830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:31.771222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:31.773155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:31.773823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:31.777224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:31.777767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:31.782370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:31.788553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7c5f-fabf-4fb9-9243-92089f22f0ab None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:31.805979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:31.807044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:31.807455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:31.807836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] PATH_INFO: `/v3/projects/b33e2b5cc01d46e0aaf008fe66c51942` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:31.809772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33e2b5cc01d46e0aaf008fe66c51942)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:31.815993 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3811/7603] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:31.817088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:31.817672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:31.849444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30adaa8-44a5-46fe-8bab-718f753f6244 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:31.866012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac457d78-a7af-4ecc-9678-6ca0eaabde10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:31.867179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457d78-a7af-4ecc-9678-6ca0eaabde10 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:31.867559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457d78-a7af-4ecc-9678-6ca0eaabde10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:31.867934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457d78-a7af-4ecc-9678-6ca0eaabde10 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:31.868768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac457d78-a7af-4ecc-9678-6ca0eaabde10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:31.871602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac457d78-a7af-4ecc-9678-6ca0eaabde10 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:31.925083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33e2b5cc01d46e0aaf008fe66c51942', 'request_id': 'req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.935512 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3812/7604] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:31 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:31.937670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac457d78-a7af-4ecc-9678-6ca0eaabde10 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:31.940842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33e2b5cc01d46e0aaf008fe66c51942', 'request_id': 'req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.958406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33e2b5cc01d46e0aaf008fe66c51942', 'request_id': 'req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.986983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] The token cache is being invalidate because project b33e2b5cc01d46e0aaf008fe66c51942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:31.990635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.991735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c4b9ccb-bd7e-4b22-ad6e-08dd582f532c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:31.995764 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3793/7605] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:31 2022] DELETE /identity/v3/projects/b33e2b5cc01d46e0aaf008fe66c51942 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:32.001837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a13a3-bb1b-411c-a4ee-72f4781d3549 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.002403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a13a3-bb1b-411c-a4ee-72f4781d3549 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.002876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a13a3-bb1b-411c-a4ee-72f4781d3549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.042953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cd7a13a3-bb1b-411c-a4ee-72f4781d3549 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:32.045514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cd7a13a3-bb1b-411c-a4ee-72f4781d3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:32.050046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac457d78-a7af-4ecc-9678-6ca0eaabde10 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.055155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.056116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.056435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.056720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.057464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.057617 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3794/7606] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:32.059561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.068742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9377-4dc3-446f-ab56-d60ef61b8886 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.069272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9377-4dc3-446f-ab56-d60ef61b8886 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.069808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9377-4dc3-446f-ab56-d60ef61b8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.101979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1c3b9377-4dc3-446f-ab56-d60ef61b8886 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:32.103188 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3813/7607] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:31 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:32.105919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1c3b9377-4dc3-446f-ab56-d60ef61b8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:32.108059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.109828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:32.136362 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3795/7608] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:32.136362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b9377-4dc3-446f-ab56-d60ef61b8886 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.140866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a3415-7fe5-4f39-bd56-a3c542fcf190 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.157690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b9377-4dc3-446f-ab56-d60ef61b8886 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.159045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75664-5ddd-454d-a9b9-64bef3a0deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.159879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75664-5ddd-454d-a9b9-64bef3a0deef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.160168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75664-5ddd-454d-a9b9-64bef3a0deef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.162661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75664-5ddd-454d-a9b9-64bef3a0deef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.165295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.165548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e75664-5ddd-454d-a9b9-64bef3a0deef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.166317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.166707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.167215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e75664-5ddd-454d-a9b9-64bef3a0deef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.167333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.168374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:32.169331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.171035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.193269 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3814/7609] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:32.195007 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3796/7610] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:32.197279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75664-5ddd-454d-a9b9-64bef3a0deef admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.201662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.212918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75664-5ddd-454d-a9b9-64bef3a0deef admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.220945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f35fd-412f-4f38-a449-019961b77658 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.227512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84433-ad40-444a-b32e-35a47f887c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.228233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84433-ad40-444a-b32e-35a47f887c80 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.228547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84433-ad40-444a-b32e-35a47f887c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.228829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84433-ad40-444a-b32e-35a47f887c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.229573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84433-ad40-444a-b32e-35a47f887c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.233817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81594a0b-4841-4262-bd98-2d12f6e63df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.234501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594a0b-4841-4262-bd98-2d12f6e63df2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.234983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594a0b-4841-4262-bd98-2d12f6e63df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.235272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594a0b-4841-4262-bd98-2d12f6e63df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.235986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81594a0b-4841-4262-bd98-2d12f6e63df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.237779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84433-ad40-444a-b32e-35a47f887c80 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.241858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81594a0b-4841-4262-bd98-2d12f6e63df2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.263500 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3815/7611] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:32.268943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84433-ad40-444a-b32e-35a47f887c80 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.288588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84433-ad40-444a-b32e-35a47f887c80 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.295548 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3c6a4-0733-49d6-9abe-6516428ae192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.296594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c6a4-0733-49d6-9abe-6516428ae192 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.296883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c6a4-0733-49d6-9abe-6516428ae192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.297426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c6a4-0733-49d6-9abe-6516428ae192 admin admin] PATH_INFO: `/v3/projects/5d20975451fd46888b7e194bed337315/users/0f6226c4ac13479480e7a135e9a9e05e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.314545 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3797/7612] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:32 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:32.319449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81594a0b-4841-4262-bd98-2d12f6e63df2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.348835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3c6a4-0733-49d6-9abe-6516428ae192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d20975451fd46888b7e194bed337315, user_id=0f6226c4ac13479480e7a135e9a9e05e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.351777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3c6a4-0733-49d6-9abe-6516428ae192 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.397276 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3816/7613] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:32 2022] PUT /identity/v3/projects/5d20975451fd46888b7e194bed337315/users/0f6226c4ac13479480e7a135e9a9e05e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:32.408546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a60cf-ab3d-4bf3-b4de-8d5b81681e85 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.408875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a60cf-ab3d-4bf3-b4de-8d5b81681e85 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.409117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a60cf-ab3d-4bf3-b4de-8d5b81681e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.481464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-747a60cf-ab3d-4bf3-b4de-8d5b81681e85 None None] MFA Rules not processed for user `0f6226c4ac13479480e7a135e9a9e05e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:32.482803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-747a60cf-ab3d-4bf3-b4de-8d5b81681e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:32.492285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81594a0b-4841-4262-bd98-2d12f6e63df2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.632455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8a8b-8d54-4d0b-921f-58206ba2fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.633151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8a8b-8d54-4d0b-921f-58206ba2fafc admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.633432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8a8b-8d54-4d0b-921f-58206ba2fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.633712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8a8b-8d54-4d0b-921f-58206ba2fafc admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.639020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da8a8b-8d54-4d0b-921f-58206ba2fafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.642631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da8a8b-8d54-4d0b-921f-58206ba2fafc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.654162 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3817/7614] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:32.670238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a60cf-ab3d-4bf3-b4de-8d5b81681e85 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.672097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-747a60cf-ab3d-4bf3-b4de-8d5b81681e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:32.704361 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3798/7615] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:32 2022] POST /identity/v3/users => generated 285 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:32.710204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8a8b-8d54-4d0b-921f-58206ba2fafc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.735154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8a8b-8d54-4d0b-921f-58206ba2fafc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.759977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d279b7-e856-4203-ada0-8b878951fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.760803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d279b7-e856-4203-ada0-8b878951fe56 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.761091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d279b7-e856-4203-ada0-8b878951fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.761367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d279b7-e856-4203-ada0-8b878951fe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.762098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d279b7-e856-4203-ada0-8b878951fe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.766110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d279b7-e856-4203-ada0-8b878951fe56 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.786307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a60cf-ab3d-4bf3-b4de-8d5b81681e85 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.793346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5948f-6d16-4685-a5b4-e4a1dab31114 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.794596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5948f-6d16-4685-a5b4-e4a1dab31114 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.794876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5948f-6d16-4685-a5b4-e4a1dab31114 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.795155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5948f-6d16-4685-a5b4-e4a1dab31114 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.798210 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3799/7616] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:32.802652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d279b7-e856-4203-ada0-8b878951fe56 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.816076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d279b7-e856-4203-ada0-8b878951fe56 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.820767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5948f-6d16-4685-a5b4-e4a1dab31114 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.822061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60a985-7dfd-4142-8c25-bc45d97b2b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.822527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5948f-6d16-4685-a5b4-e4a1dab31114 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.823074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60a985-7dfd-4142-8c25-bc45d97b2b8b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.823753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60a985-7dfd-4142-8c25-bc45d97b2b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.824082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60a985-7dfd-4142-8c25-bc45d97b2b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.824876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60a985-7dfd-4142-8c25-bc45d97b2b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.826607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60a985-7dfd-4142-8c25-bc45d97b2b8b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.844377 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3800/7617] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:17:32.845445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60a985-7dfd-4142-8c25-bc45d97b2b8b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:32.859748 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3818/7618] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:17:32.859952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60a985-7dfd-4142-8c25-bc45d97b2b8b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:32.863454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb104fa-fa15-4ce2-8e8c-1c6249c9e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:32.864899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb104fa-fa15-4ce2-8e8c-1c6249c9e479 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.865301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb104fa-fa15-4ce2-8e8c-1c6249c9e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.865822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb104fa-fa15-4ce2-8e8c-1c6249c9e479 admin admin] PATH_INFO: `/v3/projects/1e95d3ca072e4ac99e011676d8376673/users/84aa8d234d4f476093aaa1367703886d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.887122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb104fa-fa15-4ce2-8e8c-1c6249c9e479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e95d3ca072e4ac99e011676d8376673, user_id=84aa8d234d4f476093aaa1367703886d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:32.891064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb104fa-fa15-4ce2-8e8c-1c6249c9e479 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:32.929069 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3801/7619] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:32 2022] PUT /identity/v3/projects/1e95d3ca072e4ac99e011676d8376673/users/84aa8d234d4f476093aaa1367703886d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:32.931037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b150cfa-b1ff-4d25-8953-5d56a5e2f77c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:32.931265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b150cfa-b1ff-4d25-8953-5d56a5e2f77c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:32.931551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b150cfa-b1ff-4d25-8953-5d56a5e2f77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:32.982518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5b150cfa-b1ff-4d25-8953-5d56a5e2f77c None None] MFA Rules not processed for user `84aa8d234d4f476093aaa1367703886d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:32.983963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5b150cfa-b1ff-4d25-8953-5d56a5e2f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:33.050357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88689-beff-493e-b158-4a1810668926 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:33.050788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88689-beff-493e-b158-4a1810668926 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:33.051535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88689-beff-493e-b158-4a1810668926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:33.082711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0cd88689-beff-493e-b158-4a1810668926 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:33.085565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0cd88689-beff-493e-b158-4a1810668926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:33.086452 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3819/7620] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:33.100789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b150cfa-b1ff-4d25-8953-5d56a5e2f77c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:33.226062 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3802/7621] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:33.235945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b150cfa-b1ff-4d25-8953-5d56a5e2f77c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:33.256451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd88689-beff-493e-b158-4a1810668926 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:33.258277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0cd88689-beff-493e-b158-4a1810668926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:33.258744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b2813-3c8d-43c2-b45f-02e4df6b4cf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:33.259820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2813-3c8d-43c2-b45f-02e4df6b4cf9 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:33.260321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2813-3c8d-43c2-b45f-02e4df6b4cf9 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:33.261145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2813-3c8d-43c2-b45f-02e4df6b4cf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:33.273494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b2813-3c8d-43c2-b45f-02e4df6b4cf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:33.275843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b2813-3c8d-43c2-b45f-02e4df6b4cf9 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:33.307110 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3820/7622] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:33.376937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd88689-beff-493e-b158-4a1810668926 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:33.388406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e725a6-a01c-46b7-8206-d11e05ba19c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:33.389136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e725a6-a01c-46b7-8206-d11e05ba19c8 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:33.389405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e725a6-a01c-46b7-8206-d11e05ba19c8 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:33.389969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e725a6-a01c-46b7-8206-d11e05ba19c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:33.405049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e725a6-a01c-46b7-8206-d11e05ba19c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:33.406667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e725a6-a01c-46b7-8206-d11e05ba19c8 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:33.417901 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3803/7623] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:17:34.197981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace6d1-e630-41e0-959d-ce57fd7db8a7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:34.198800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace6d1-e630-41e0-959d-ce57fd7db8a7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:34.198800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace6d1-e630-41e0-959d-ce57fd7db8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:34.248200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-06ace6d1-e630-41e0-959d-ce57fd7db8a7 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:34.261194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-06ace6d1-e630-41e0-959d-ce57fd7db8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:34.286965 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3821/7624] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:34.305233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e725a6-a01c-46b7-8206-d11e05ba19c8 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:34.337491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e725a6-a01c-46b7-8206-d11e05ba19c8 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:34.348151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5af2e7-3d60-4bab-a419-96ff5464efaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:34.351147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af2e7-3d60-4bab-a419-96ff5464efaf service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:34.351883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af2e7-3d60-4bab-a419-96ff5464efaf service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:34.352260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af2e7-3d60-4bab-a419-96ff5464efaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:34.402105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5af2e7-3d60-4bab-a419-96ff5464efaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:34.414851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5af2e7-3d60-4bab-a419-96ff5464efaf service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:34.443833 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3804/7625] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:17:35.219657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7deb93-f8a1-4f71-bec3-f304d5c4cc8f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:35.220266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7deb93-f8a1-4f71-bec3-f304d5c4cc8f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:35.220266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7deb93-f8a1-4f71-bec3-f304d5c4cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:35.285784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fc7deb93-f8a1-4f71-bec3-f304d5c4cc8f None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:35.287117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fc7deb93-f8a1-4f71-bec3-f304d5c4cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:35.319201 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3822/7626] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:35.348818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5af2e7-3d60-4bab-a419-96ff5464efaf service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:35.369624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5af2e7-3d60-4bab-a419-96ff5464efaf service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:35.380936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4d9e-5278-4feb-9abe-85bf51f4bd8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:35.381990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4d9e-5278-4feb-9abe-85bf51f4bd8f service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:35.383399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4d9e-5278-4feb-9abe-85bf51f4bd8f service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:35.384286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4d9e-5278-4feb-9abe-85bf51f4bd8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:35.408905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4d9e-5278-4feb-9abe-85bf51f4bd8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:35.411965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4d9e-5278-4feb-9abe-85bf51f4bd8f service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:35.440151 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3805/7627] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:17:35.834252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339278-5246-447f-b67a-8b327ff245fe None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:35.834658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339278-5246-447f-b67a-8b327ff245fe None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:35.835029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339278-5246-447f-b67a-8b327ff245fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:35.874718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-da339278-5246-447f-b67a-8b327ff245fe None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:35.877663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-da339278-5246-447f-b67a-8b327ff245fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:35.925642 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3823/7628] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:35.953594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4d9e-5278-4feb-9abe-85bf51f4bd8f service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:35.975367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4d9e-5278-4feb-9abe-85bf51f4bd8f service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:35.989399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be31a6-8959-44a5-81d7-b2486f2cbc5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:35.992500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be31a6-8959-44a5-81d7-b2486f2cbc5e service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:35.993053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be31a6-8959-44a5-81d7-b2486f2cbc5e service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:35.994015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be31a6-8959-44a5-81d7-b2486f2cbc5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:36.020225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be31a6-8959-44a5-81d7-b2486f2cbc5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:36.022384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be31a6-8959-44a5-81d7-b2486f2cbc5e service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:36.033673 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3806/7629] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:17:36.780225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e579e-617b-4eb5-8e60-b5557c852551 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:36.780800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e579e-617b-4eb5-8e60-b5557c852551 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:36.780889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e579e-617b-4eb5-8e60-b5557c852551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:36.822513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-524e579e-617b-4eb5-8e60-b5557c852551 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:36.825775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-524e579e-617b-4eb5-8e60-b5557c852551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:36.849626 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3824/7630] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:36.865273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be31a6-8959-44a5-81d7-b2486f2cbc5e service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:36.891043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be31a6-8959-44a5-81d7-b2486f2cbc5e service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:36.912257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5ba9c-47ff-4381-a9be-f6413296d11f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:36.912965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5ba9c-47ff-4381-a9be-f6413296d11f service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:36.913245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5ba9c-47ff-4381-a9be-f6413296d11f service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:36.913524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5ba9c-47ff-4381-a9be-f6413296d11f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:36.938091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5ba9c-47ff-4381-a9be-f6413296d11f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:36.939761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5ba9c-47ff-4381-a9be-f6413296d11f service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:36.990428 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3807/7631] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:17:37.372754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68fd7-195c-4d79-8fe9-07b9f0ab4174 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:37.373299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68fd7-195c-4d79-8fe9-07b9f0ab4174 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:37.373753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68fd7-195c-4d79-8fe9-07b9f0ab4174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:37.398586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-66c68fd7-195c-4d79-8fe9-07b9f0ab4174 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:37.400248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-66c68fd7-195c-4d79-8fe9-07b9f0ab4174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:37.439451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5ba9c-47ff-4381-a9be-f6413296d11f service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:37.440449 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3825/7632] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:37.480458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5ba9c-47ff-4381-a9be-f6413296d11f service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:37.500497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe301856-526b-4e7b-be23-cd3a7b4cf387 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:37.501194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301856-526b-4e7b-be23-cd3a7b4cf387 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:37.501490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301856-526b-4e7b-be23-cd3a7b4cf387 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:37.501761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301856-526b-4e7b-be23-cd3a7b4cf387 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:37.518885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe301856-526b-4e7b-be23-cd3a7b4cf387 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:37.520743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe301856-526b-4e7b-be23-cd3a7b4cf387 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:37.553547 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3808/7633] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:17:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:17:37.779465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c68fd7-195c-4d79-8fe9-07b9f0ab4174 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:37.907677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c68fd7-195c-4d79-8fe9-07b9f0ab4174 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:37.923737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:37.927991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:37.929021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:37.929540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] PATH_INFO: `/v3/users/0f6226c4ac13479480e7a135e9a9e05e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:37.932457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6226c4ac13479480e7a135e9a9e05e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:37.938420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:38.059227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6226c4ac13479480e7a135e9a9e05e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:38.060695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6226c4ac13479480e7a135e9a9e05e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:38.061622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6226c4ac13479480e7a135e9a9e05e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:38.111138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6226c4ac13479480e7a135e9a9e05e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:38.127052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6226c4ac13479480e7a135e9a9e05e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:38.157635 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3826/7634] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:37 2022] DELETE /identity/v3/users/0f6226c4ac13479480e7a135e9a9e05e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:38.162929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c2b91-66a8-4a22-b11e-719290a8adac None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:38.164016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c2b91-66a8-4a22-b11e-719290a8adac None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:38.164849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c2b91-66a8-4a22-b11e-719290a8adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:38.204817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-465c2b91-66a8-4a22-b11e-719290a8adac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:38.207463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-465c2b91-66a8-4a22-b11e-719290a8adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:38.436851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3809/7635] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:38.494737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:38.496540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:38.692114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ecdb-5303-4347-8529-935583641f2f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:38.710369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfab3d7-eaa9-4b7e-8723-cfe0ead67b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:38.711215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfab3d7-eaa9-4b7e-8723-cfe0ead67b9c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:38.711331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfab3d7-eaa9-4b7e-8723-cfe0ead67b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:38.711583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfab3d7-eaa9-4b7e-8723-cfe0ead67b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:38.741845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfab3d7-eaa9-4b7e-8723-cfe0ead67b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:38.745021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfab3d7-eaa9-4b7e-8723-cfe0ead67b9c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:38.759363 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3827/7636] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:39.516539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c2b91-66a8-4a22-b11e-719290a8adac None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:39.518716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-465c2b91-66a8-4a22-b11e-719290a8adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:39.539976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c2b91-66a8-4a22-b11e-719290a8adac None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:39.545982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:39.547222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:39.547751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:39.548263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] PATH_INFO: `/v3/projects/5d20975451fd46888b7e194bed337315` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:39.550192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d20975451fd46888b7e194bed337315)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:39.552400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:39.621147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d20975451fd46888b7e194bed337315', 'request_id': 'req-ee74cc48-5f63-40e2-a1b5-abb9510297e8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:39.628099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d20975451fd46888b7e194bed337315', 'request_id': 'req-ee74cc48-5f63-40e2-a1b5-abb9510297e8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:39.639085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d20975451fd46888b7e194bed337315', 'request_id': 'req-ee74cc48-5f63-40e2-a1b5-abb9510297e8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:39.653775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] The token cache is being invalidate because project 5d20975451fd46888b7e194bed337315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:39.654159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:39.655520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee74cc48-5f63-40e2-a1b5-abb9510297e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:39.662275 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3810/7637] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:39 2022] DELETE /identity/v3/projects/5d20975451fd46888b7e194bed337315 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:39.664158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f606-e1ba-4eae-b494-4b1086517637 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:39.664700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f606-e1ba-4eae-b494-4b1086517637 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:39.664805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f606-e1ba-4eae-b494-4b1086517637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:39.692770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-44f5f606-e1ba-4eae-b494-4b1086517637 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:39.694444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-44f5f606-e1ba-4eae-b494-4b1086517637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:39.793084 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3828/7638] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:39.802818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fd74b-f3fe-47e0-b76c-71f5a9f6e8c7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:39.803564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fd74b-f3fe-47e0-b76c-71f5a9f6e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:39.803961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fd74b-f3fe-47e0-b76c-71f5a9f6e8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:39.833799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a06fd74b-f3fe-47e0-b76c-71f5a9f6e8c7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:39.835324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a06fd74b-f3fe-47e0-b76c-71f5a9f6e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:39.850021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f606-e1ba-4eae-b494-4b1086517637 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:39.863426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f606-e1ba-4eae-b494-4b1086517637 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:39.876415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3811/7639] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:39.889304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:39.893228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:39.894163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:39.895236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:39.896384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:39.896958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:39.899447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:39.952790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fd74b-f3fe-47e0-b76c-71f5a9f6e8c7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:39.972744 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3829/7640] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:39.983637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fd74b-f3fe-47e0-b76c-71f5a9f6e8c7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:40.001266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88381d1-1a10-4f18-a388-f4d7d611d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:40.002394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88381d1-1a10-4f18-a388-f4d7d611d07e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:40.003852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88381d1-1a10-4f18-a388-f4d7d611d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:40.005045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88381d1-1a10-4f18-a388-f4d7d611d07e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:40.008672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88381d1-1a10-4f18-a388-f4d7d611d07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:40.011682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88381d1-1a10-4f18-a388-f4d7d611d07e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:40.094808 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3812/7641] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:39 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:40.100527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:40.127249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7df0-c222-4dd3-88c1-129b0bca01b8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:40.208067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84f8d3-6bdb-4fca-a09d-c1088634245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:40.209044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84f8d3-6bdb-4fca-a09d-c1088634245c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:40.209602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84f8d3-6bdb-4fca-a09d-c1088634245c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:40.211327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84f8d3-6bdb-4fca-a09d-c1088634245c admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:40.211327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84f8d3-6bdb-4fca-a09d-c1088634245c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:40.214147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84f8d3-6bdb-4fca-a09d-c1088634245c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:40.252369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3830/7642] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:40 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:40.254818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88381d1-1a10-4f18-a388-f4d7d611d07e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:40.294337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88381d1-1a10-4f18-a388-f4d7d611d07e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:40.304996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82e691-1053-413e-9072-1cac4c8b574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:40.306456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82e691-1053-413e-9072-1cac4c8b574b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:40.306970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82e691-1053-413e-9072-1cac4c8b574b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:40.307977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82e691-1053-413e-9072-1cac4c8b574b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:40.310095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82e691-1053-413e-9072-1cac4c8b574b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:40.313774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82e691-1053-413e-9072-1cac4c8b574b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:40.339006 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3813/7643] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:40.344584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84f8d3-6bdb-4fca-a09d-c1088634245c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:40.360266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84f8d3-6bdb-4fca-a09d-c1088634245c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:40.367784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434d37-206b-4763-9d5c-c5537307b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:40.368777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434d37-206b-4763-9d5c-c5537307b690 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:40.369227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434d37-206b-4763-9d5c-c5537307b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:40.369669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434d37-206b-4763-9d5c-c5537307b690 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:40.371325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434d37-206b-4763-9d5c-c5537307b690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:40.373353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434d37-206b-4763-9d5c-c5537307b690 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:40.396496 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3831/7644] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:40.397108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82e691-1053-413e-9072-1cac4c8b574b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:40.413772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82e691-1053-413e-9072-1cac4c8b574b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:40.421858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:40.423133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:40.423922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:40.424518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] PATH_INFO: `/v3/projects/e2ceaa5559614c5191aa106f6f7e8f36/users/1e7b73d3ddea4b03807dc34019720b7a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:40.448955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ceaa5559614c5191aa106f6f7e8f36, user_id=1e7b73d3ddea4b03807dc34019720b7a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:40.453617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:40.485170 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3814/7645] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:40 2022] PUT /identity/v3/projects/e2ceaa5559614c5191aa106f6f7e8f36/users/1e7b73d3ddea4b03807dc34019720b7a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:40.486572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57ee3-0bcc-46cf-83c6-86f08e1b952c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:40.486859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57ee3-0bcc-46cf-83c6-86f08e1b952c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:40.487303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd57ee3-0bcc-46cf-83c6-86f08e1b952c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:40.521199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ddd57ee3-0bcc-46cf-83c6-86f08e1b952c None None] MFA Rules not processed for user `1e7b73d3ddea4b03807dc34019720b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:40.523523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ddd57ee3-0bcc-46cf-83c6-86f08e1b952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:40.614238 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3832/7646] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:40.626852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:40.641108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:40.794640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded78b4-a82b-45e5-a491-f49f5fffa545 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:40.805389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:40.807899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:40.810886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:40.814404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:40.837159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:40.841127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:40.864992 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3815/7647] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:41.029292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd57ee3-0bcc-46cf-83c6-86f08e1b952c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:41.115998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd57ee3-0bcc-46cf-83c6-86f08e1b952c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:41.125359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:41.126633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:41.127138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:41.127583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] PATH_INFO: `/v3/users/1e7b73d3ddea4b03807dc34019720b7a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:41.129174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7b73d3ddea4b03807dc34019720b7a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:41.133147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:41.227222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:41.228826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:41.230653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7b73d3ddea4b03807dc34019720b7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.232012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7b73d3ddea4b03807dc34019720b7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.234074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7b73d3ddea4b03807dc34019720b7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.259421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7b73d3ddea4b03807dc34019720b7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.263886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4e26-1c67-474b-95cf-c9259ec67963 service glance] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:41.273550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a42b3611-be46-423a-a084-6257d23c959e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7b73d3ddea4b03807dc34019720b7a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.281454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:41.282840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:41.283356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:41.283856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] PATH_INFO: `/v3/users/0ad2e1d07d8449eca1700217ee91df37` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:41.286059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad2e1d07d8449eca1700217ee91df37)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:41.291316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:41.295847 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3833/7648] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:41 2022] DELETE /identity/v3/users/1e7b73d3ddea4b03807dc34019720b7a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:41.302646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a44d-e0c2-4f71-9470-2f0476a44f5f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:41.303182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a44d-e0c2-4f71-9470-2f0476a44f5f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:41.303565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a44d-e0c2-4f71-9470-2f0476a44f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:41.335710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c2e4a44d-e0c2-4f71-9470-2f0476a44f5f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:41.337707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c2e4a44d-e0c2-4f71-9470-2f0476a44f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:41.413716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad2e1d07d8449eca1700217ee91df37'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.438601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad2e1d07d8449eca1700217ee91df37'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.460648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad2e1d07d8449eca1700217ee91df37'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.461632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad2e1d07d8449eca1700217ee91df37'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.462949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad2e1d07d8449eca1700217ee91df37'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:41.470001 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3834/7649] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:17:41.480639 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3816/7650] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:41 2022] DELETE /identity/v3/users/0ad2e1d07d8449eca1700217ee91df37 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:41.485907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929ab2-403a-422b-8c1f-3eb9064a26ba None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:41.485907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929ab2-403a-422b-8c1f-3eb9064a26ba None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:41.486450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929ab2-403a-422b-8c1f-3eb9064a26ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:41.493771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:41.496680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:41.523369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7c929ab2-403a-422b-8c1f-3eb9064a26ba None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:41.526436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c929ab2-403a-422b-8c1f-3eb9064a26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:41.647139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52da47b-1e55-4527-8406-29426eaf62c7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:41.662432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:41.664004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:41.664840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:41.665659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:41.671063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:41.676663 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3835/7651] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:41.720515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:41.722731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:41.725012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c929ab2-403a-422b-8c1f-3eb9064a26ba None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:41.726539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c929ab2-403a-422b-8c1f-3eb9064a26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:41.749174 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3817/7652] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:17:41.753741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c929ab2-403a-422b-8c1f-3eb9064a26ba None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:41.766133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd03ea-04a9-42e1-9b1a-5bf15d5e56e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:41.766801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd03ea-04a9-42e1-9b1a-5bf15d5e56e1 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:41.767095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd03ea-04a9-42e1-9b1a-5bf15d5e56e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:41.767357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd03ea-04a9-42e1-9b1a-5bf15d5e56e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:41.780390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd03ea-04a9-42e1-9b1a-5bf15d5e56e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:41.782451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd03ea-04a9-42e1-9b1a-5bf15d5e56e1 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:41.796664 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3836/7653] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:17:42.159792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:42.161530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:42.177326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675d98e-0988-426a-9e7c-ad9a414050b3 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:42.205412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:42.206402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:42.209022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:42.209441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] PATH_INFO: `/v3/projects/e896604882924927a86fea7b4fdfb56b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:42.212708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e896604882924927a86fea7b4fdfb56b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:42.216918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:42.321488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e896604882924927a86fea7b4fdfb56b', 'request_id': 'req-ab864530-ab76-47a6-8ac1-c435a0a11b81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:42.338513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e896604882924927a86fea7b4fdfb56b', 'request_id': 'req-ab864530-ab76-47a6-8ac1-c435a0a11b81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:42.360026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e896604882924927a86fea7b4fdfb56b', 'request_id': 'req-ab864530-ab76-47a6-8ac1-c435a0a11b81'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:42.379562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] The token cache is being invalidate because project e896604882924927a86fea7b4fdfb56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:42.379854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:42.388876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ab864530-ab76-47a6-8ac1-c435a0a11b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:42.391362 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3818/7654] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:42 2022] DELETE /identity/v3/projects/e896604882924927a86fea7b4fdfb56b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:42.397208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f88d2c-0a22-4fbe-9706-6f388e904e88 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:42.398588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f88d2c-0a22-4fbe-9706-6f388e904e88 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:42.398782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f88d2c-0a22-4fbe-9706-6f388e904e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:42.430757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-00f88d2c-0a22-4fbe-9706-6f388e904e88 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:42.432360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-00f88d2c-0a22-4fbe-9706-6f388e904e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:42.660880 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3837/7655] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:42.761782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283db59-94d5-48ba-8581-066b569249a1 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:42.762274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283db59-94d5-48ba-8581-066b569249a1 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:42.762440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283db59-94d5-48ba-8581-066b569249a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:42.808999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4283db59-94d5-48ba-8581-066b569249a1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:42.811083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4283db59-94d5-48ba-8581-066b569249a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:42.834851 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3819/7656] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:42.835510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f88d2c-0a22-4fbe-9706-6f388e904e88 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:42.847707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f88d2c-0a22-4fbe-9706-6f388e904e88 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:42.853863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:42.854655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:42.856065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:42.856065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:42.857855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:42.857855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:42.862351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:42.879183 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3838/7657] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:17:42.883394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283db59-94d5-48ba-8581-066b569249a1 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:42.893933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283db59-94d5-48ba-8581-066b569249a1 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:42.900461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0816a-3968-40d8-9283-27e08f4d9a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:42.901618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0816a-3968-40d8-9283-27e08f4d9a3f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:42.901907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0816a-3968-40d8-9283-27e08f4d9a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:42.905966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0816a-3968-40d8-9283-27e08f4d9a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:42.907363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0816a-3968-40d8-9283-27e08f4d9a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:42.911282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0816a-3968-40d8-9283-27e08f4d9a3f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:42.950555 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3820/7658] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:42 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:17:42.955374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:42.969980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51be44-ee7d-4c30-91e8-7c61e34df461 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.050521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3406d8-4913-47be-a8f5-a7ed2863c36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.051152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3406d8-4913-47be-a8f5-a7ed2863c36b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.051431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3406d8-4913-47be-a8f5-a7ed2863c36b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.051883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3406d8-4913-47be-a8f5-a7ed2863c36b admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.052781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3406d8-4913-47be-a8f5-a7ed2863c36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.054895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3406d8-4913-47be-a8f5-a7ed2863c36b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.083346 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3839/7659] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:42 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:43.088011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0816a-3968-40d8-9283-27e08f4d9a3f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.101721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0816a-3968-40d8-9283-27e08f4d9a3f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.108451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.109547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.113475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.114037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.115051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.118257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.148491 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3821/7660] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:43.161364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3406d8-4913-47be-a8f5-a7ed2863c36b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.183026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3406d8-4913-47be-a8f5-a7ed2863c36b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.190146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06c07-1d4d-48c5-9023-a05da64e091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.190992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06c07-1d4d-48c5-9023-a05da64e091d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.192121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06c07-1d4d-48c5-9023-a05da64e091d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.192510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06c07-1d4d-48c5-9023-a05da64e091d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.193672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c06c07-1d4d-48c5-9023-a05da64e091d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.194432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.195493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c06c07-1d4d-48c5-9023-a05da64e091d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.197085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:43.218911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c153d5d-738e-4508-9ef7-220efcb7e413 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.229836 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3840/7661] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:43.232733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06c07-1d4d-48c5-9023-a05da64e091d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.236465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.238559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.245200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.255889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06c07-1d4d-48c5-9023-a05da64e091d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.261476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] PATH_INFO: `/v3/projects/e2ceaa5559614c5191aa106f6f7e8f36` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.264776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ceaa5559614c5191aa106f6f7e8f36)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.268489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.271246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98298dd-cf13-4b3f-bba0-aafd77b8b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.272168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98298dd-cf13-4b3f-bba0-aafd77b8b372 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.272536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98298dd-cf13-4b3f-bba0-aafd77b8b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.272766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98298dd-cf13-4b3f-bba0-aafd77b8b372 admin admin] PATH_INFO: `/v3/projects/ad93e6eca7bb4554bef6fd82494917db/users/e7d24e6210c848d3820fa969cb77d9c1/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.310436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98298dd-cf13-4b3f-bba0-aafd77b8b372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad93e6eca7bb4554bef6fd82494917db, user_id=e7d24e6210c848d3820fa969cb77d9c1, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.315255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98298dd-cf13-4b3f-bba0-aafd77b8b372 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.341479 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3841/7662] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:43 2022] PUT /identity/v3/projects/ad93e6eca7bb4554bef6fd82494917db/users/e7d24e6210c848d3820fa969cb77d9c1/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:43.349422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b61c6-9c89-41fd-aa34-ffff72727e5e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.349815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b61c6-9c89-41fd-aa34-ffff72727e5e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.350254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b61c6-9c89-41fd-aa34-ffff72727e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.352834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ceaa5559614c5191aa106f6f7e8f36', 'request_id': 'req-4f81c405-489b-4e80-881b-eef19ffb69c6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:43.359420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ceaa5559614c5191aa106f6f7e8f36', 'request_id': 'req-4f81c405-489b-4e80-881b-eef19ffb69c6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:43.372943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ceaa5559614c5191aa106f6f7e8f36', 'request_id': 'req-4f81c405-489b-4e80-881b-eef19ffb69c6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:43.389762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] The token cache is being invalidate because project e2ceaa5559614c5191aa106f6f7e8f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:43.390150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:43.390941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4f81c405-489b-4e80-881b-eef19ffb69c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:43.393450 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3822/7663] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:43 2022] DELETE /identity/v3/projects/e2ceaa5559614c5191aa106f6f7e8f36 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:43.397885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ac02e-b3f9-4231-a216-4ae163c7128b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.398308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ac02e-b3f9-4231-a216-4ae163c7128b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.398816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ac02e-b3f9-4231-a216-4ae163c7128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.405929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3c3b61c6-9c89-41fd-aa34-ffff72727e5e None None] MFA Rules not processed for user `e7d24e6210c848d3820fa969cb77d9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:43.407807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3c3b61c6-9c89-41fd-aa34-ffff72727e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:43.429143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9b5ac02e-b3f9-4231-a216-4ae163c7128b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:43.431097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9b5ac02e-b3f9-4231-a216-4ae163c7128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:43.518284 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3842/7664] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:43.527557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3823/7665] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:43.536199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2444d-1eed-4932-89be-db80cd1cad46 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.536627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2444d-1eed-4932-89be-db80cd1cad46 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.536773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2444d-1eed-4932-89be-db80cd1cad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.539059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ac02e-b3f9-4231-a216-4ae163c7128b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.540580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9b5ac02e-b3f9-4231-a216-4ae163c7128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:43.560967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-61b2444d-1eed-4932-89be-db80cd1cad46 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:43.562198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-61b2444d-1eed-4932-89be-db80cd1cad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:43.576869 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3843/7666] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:43.580857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2444d-1eed-4932-89be-db80cd1cad46 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.591735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2444d-1eed-4932-89be-db80cd1cad46 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.607014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.607697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.607979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.608252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.609020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:43.609547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.629329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.643064 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3844/7667] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:43.645503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ac02e-b3f9-4231-a216-4ae163c7128b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.647362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.656358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5c17-d162-48ae-b844-7d4ed780933d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.657797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c17-d162-48ae-b844-7d4ed780933d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.658082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c17-d162-48ae-b844-7d4ed780933d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.658362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c17-d162-48ae-b844-7d4ed780933d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.659261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672fda8-fdb2-4eb0-8eca-ccbd6d6c8a28 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.678309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5c17-d162-48ae-b844-7d4ed780933d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.681084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5c17-d162-48ae-b844-7d4ed780933d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.695130 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3824/7668] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:43.696435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db910ff-8465-4657-beca-f10833abb4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.697655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db910ff-8465-4657-beca-f10833abb4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.698101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db910ff-8465-4657-beca-f10833abb4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.699272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db910ff-8465-4657-beca-f10833abb4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.701499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db910ff-8465-4657-beca-f10833abb4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.706307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db910ff-8465-4657-beca-f10833abb4f3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.750163 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3845/7669] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:43 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:43.753961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5c17-d162-48ae-b844-7d4ed780933d service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.768203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5c17-d162-48ae-b844-7d4ed780933d service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.883587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ecd62-8681-4587-94a6-4e875a2dbcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.884409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ecd62-8681-4587-94a6-4e875a2dbcaa admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.884919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ecd62-8681-4587-94a6-4e875a2dbcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.885683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ecd62-8681-4587-94a6-4e875a2dbcaa admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.886595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ecd62-8681-4587-94a6-4e875a2dbcaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.888915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ecd62-8681-4587-94a6-4e875a2dbcaa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.923825 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3825/7670] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:43 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:43.927876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db910ff-8465-4657-beca-f10833abb4f3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.947539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db910ff-8465-4657-beca-f10833abb4f3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:43.955620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4798b3-2ab7-4d9b-9934-51f57bf3a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:43.956408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4798b3-2ab7-4d9b-9934-51f57bf3a750 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:43.956733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4798b3-2ab7-4d9b-9934-51f57bf3a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:43.957046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4798b3-2ab7-4d9b-9934-51f57bf3a750 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:43.957905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4798b3-2ab7-4d9b-9934-51f57bf3a750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:43.960195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4798b3-2ab7-4d9b-9934-51f57bf3a750 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:43.978013 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3846/7671] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:43.982904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ecd62-8681-4587-94a6-4e875a2dbcaa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:43.994242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ecd62-8681-4587-94a6-4e875a2dbcaa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:44.000359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aa5b9-d82f-4ea1-8815-6b53bb09f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:44.001046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa5b9-d82f-4ea1-8815-6b53bb09f0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:44.001332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa5b9-d82f-4ea1-8815-6b53bb09f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:44.001929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa5b9-d82f-4ea1-8815-6b53bb09f0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:44.003149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa5b9-d82f-4ea1-8815-6b53bb09f0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:44.005138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa5b9-d82f-4ea1-8815-6b53bb09f0a1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:44.019460 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3826/7672] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:44.023433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4798b3-2ab7-4d9b-9934-51f57bf3a750 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:44.040935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4798b3-2ab7-4d9b-9934-51f57bf3a750 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:44.046786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17cbe-c067-41fc-9746-19506b081096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:44.047850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17cbe-c067-41fc-9746-19506b081096 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:44.048205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17cbe-c067-41fc-9746-19506b081096 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:44.048638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17cbe-c067-41fc-9746-19506b081096 admin admin] PATH_INFO: `/v3/projects/c0d980341c53486097ff7c90cefbc5ea/users/fadeb8f9b8f0463cbbad92b345362546/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:44.074543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b17cbe-c067-41fc-9746-19506b081096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d980341c53486097ff7c90cefbc5ea, user_id=fadeb8f9b8f0463cbbad92b345362546, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:44.080799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b17cbe-c067-41fc-9746-19506b081096 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:44.114919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0a83-6cb9-46e0-bc19-bd408c43cd10 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:44.115252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0a83-6cb9-46e0-bc19-bd408c43cd10 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:44.115617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c0a83-6cb9-46e0-bc19-bd408c43cd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:44.119040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3847/7673] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:44 2022] PUT /identity/v3/projects/c0d980341c53486097ff7c90cefbc5ea/users/fadeb8f9b8f0463cbbad92b345362546/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:44.162033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b14c0a83-6cb9-46e0-bc19-bd408c43cd10 None None] MFA Rules not processed for user `fadeb8f9b8f0463cbbad92b345362546`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:44.163340 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b14c0a83-6cb9-46e0-bc19-bd408c43cd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:44.274677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3827/7674] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:44.279626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17cbe-c067-41fc-9746-19506b081096 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:44.416774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17cbe-c067-41fc-9746-19506b081096 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:44.434864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e8a70-6fc0-4918-97f0-92d61a84c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:44.435863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e8a70-6fc0-4918-97f0-92d61a84c640 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:44.438205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e8a70-6fc0-4918-97f0-92d61a84c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:44.438690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e8a70-6fc0-4918-97f0-92d61a84c640 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:44.439453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e8a70-6fc0-4918-97f0-92d61a84c640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:44.443440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e8a70-6fc0-4918-97f0-92d61a84c640 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:44.513900 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3848/7675] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:44 2022] POST /identity/v3/projects => generated 397 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:44.518074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c0a83-6cb9-46e0-bc19-bd408c43cd10 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:44.540635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c0a83-6cb9-46e0-bc19-bd408c43cd10 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:44.662322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc428c-218b-40ef-9684-10f60743de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:44.663041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc428c-218b-40ef-9684-10f60743de1b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:44.663371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc428c-218b-40ef-9684-10f60743de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:44.663653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc428c-218b-40ef-9684-10f60743de1b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:44.666194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc428c-218b-40ef-9684-10f60743de1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:44.670409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc428c-218b-40ef-9684-10f60743de1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:44.706006 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3828/7676] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:44 2022] POST /identity/v3/users => generated 305 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:44.706885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e8a70-6fc0-4918-97f0-92d61a84c640 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:44.730613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e8a70-6fc0-4918-97f0-92d61a84c640 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:44.738569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d642872-7ba0-4f9a-b916-5dd89a18e27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:44.739905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642872-7ba0-4f9a-b916-5dd89a18e27e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:44.740178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642872-7ba0-4f9a-b916-5dd89a18e27e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:44.740958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642872-7ba0-4f9a-b916-5dd89a18e27e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:44.741975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d642872-7ba0-4f9a-b916-5dd89a18e27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:44.746690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d642872-7ba0-4f9a-b916-5dd89a18e27e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:44.768711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3849/7677] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:44.770480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc428c-218b-40ef-9684-10f60743de1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:44.786281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc428c-218b-40ef-9684-10f60743de1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:44.792010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8284b50-df48-47b4-8ce0-0c4944e0eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:44.793082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8284b50-df48-47b4-8ce0-0c4944e0eb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:44.793363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8284b50-df48-47b4-8ce0-0c4944e0eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:44.793672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8284b50-df48-47b4-8ce0-0c4944e0eb78 admin admin] PATH_INFO: `/v3/projects/2bf97ca8c144485fb096b7030caf8f60/users/25cc5e39b83a4790a17bb825f9115496/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:44.815513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8284b50-df48-47b4-8ce0-0c4944e0eb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf97ca8c144485fb096b7030caf8f60, user_id=25cc5e39b83a4790a17bb825f9115496, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:44.818265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8284b50-df48-47b4-8ce0-0c4944e0eb78 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:44.841724 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3829/7678] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:44 2022] PUT /identity/v3/projects/2bf97ca8c144485fb096b7030caf8f60/users/25cc5e39b83a4790a17bb825f9115496/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:44.845271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d642872-7ba0-4f9a-b916-5dd89a18e27e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:44.873139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d642872-7ba0-4f9a-b916-5dd89a18e27e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:45.032535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac7d57-c402-4817-beb7-fd01a43afdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:45.038065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7d57-c402-4817-beb7-fd01a43afdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:45.038065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7d57-c402-4817-beb7-fd01a43afdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:45.038535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7d57-c402-4817-beb7-fd01a43afdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:45.039280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac7d57-c402-4817-beb7-fd01a43afdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:45.040937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac7d57-c402-4817-beb7-fd01a43afdc9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:45.074194 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3850/7679] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:17:45.077394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8284b50-df48-47b4-8ce0-0c4944e0eb78 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:45.093883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8284b50-df48-47b4-8ce0-0c4944e0eb78 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:45.105774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd48a5-d118-41e0-9c01-5a9930657f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:45.107147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd48a5-d118-41e0-9c01-5a9930657f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:45.107617 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd48a5-d118-41e0-9c01-5a9930657f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:45.112010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd48a5-d118-41e0-9c01-5a9930657f39 admin admin] PATH_INFO: `/v3/projects/2bf97ca8c144485fb096b7030caf8f60/users/25cc5e39b83a4790a17bb825f9115496/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:45.114741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd48a5-d118-41e0-9c01-5a9930657f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf97ca8c144485fb096b7030caf8f60, user_id=25cc5e39b83a4790a17bb825f9115496, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:45.119559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd48a5-d118-41e0-9c01-5a9930657f39 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:45.165966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b34ba-69c2-4808-b4cf-711c8a058a51 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:45.166457 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3830/7680] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:45 2022] PUT /identity/v3/projects/2bf97ca8c144485fb096b7030caf8f60/users/25cc5e39b83a4790a17bb825f9115496/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:45.166603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b34ba-69c2-4808-b4cf-711c8a058a51 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:45.167559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b34ba-69c2-4808-b4cf-711c8a058a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:45.224690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-184b34ba-69c2-4808-b4cf-711c8a058a51 None None] MFA Rules not processed for user `25cc5e39b83a4790a17bb825f9115496`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:45.227086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-184b34ba-69c2-4808-b4cf-711c8a058a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:45.378891 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3851/7681] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:45.416926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd48a5-d118-41e0-9c01-5a9930657f39 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:45.574941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd48a5-d118-41e0-9c01-5a9930657f39 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:45.591652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:45.592705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:45.593373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:45.593966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:45.714282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:45.717058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:45.740568 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3831/7682] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:47.148103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b34ba-69c2-4808-b4cf-711c8a058a51 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:47.149957 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-184b34ba-69c2-4808-b4cf-711c8a058a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:47.300114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b34ba-69c2-4808-b4cf-711c8a058a51 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:47.307494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5afcb-7f1b-433b-900b-2fa5c8557d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:47.308255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5afcb-7f1b-433b-900b-2fa5c8557d60 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:47.308650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5afcb-7f1b-433b-900b-2fa5c8557d60 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:47.309000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5afcb-7f1b-433b-900b-2fa5c8557d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:47.322032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5afcb-7f1b-433b-900b-2fa5c8557d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:47.324164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5afcb-7f1b-433b-900b-2fa5c8557d60 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:47.339605 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3852/7683] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:48.422479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:48.424047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:48.570393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964665e-ac43-475e-81f5-a78fe8409484 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:48.587568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:48.588496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:48.588781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:48.589061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] PATH_INFO: `/v3/users/84aa8d234d4f476093aaa1367703886d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:48.601394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=84aa8d234d4f476093aaa1367703886d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:48.603359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:48.729071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84aa8d234d4f476093aaa1367703886d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:48.776765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84aa8d234d4f476093aaa1367703886d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:48.805112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84aa8d234d4f476093aaa1367703886d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:48.819561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84aa8d234d4f476093aaa1367703886d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:48.829690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84aa8d234d4f476093aaa1367703886d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:48.890116 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3832/7684] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:17:48 2022] DELETE /identity/v3/users/84aa8d234d4f476093aaa1367703886d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:48.892000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7dfb-7297-48c2-a304-21a4ee317956 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:48.892599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7dfb-7297-48c2-a304-21a4ee317956 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:48.892599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7dfb-7297-48c2-a304-21a4ee317956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:48.922397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4d2a7dfb-7297-48c2-a304-21a4ee317956 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:48.923651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4d2a7dfb-7297-48c2-a304-21a4ee317956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:49.077498 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3853/7685] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:49.095744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:49.097503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:49.244627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89616be-8b46-4a61-8a3d-727b4380dbdd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:49.263986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecf379-5d9d-4097-8f8a-9c8d0e9b57c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:49.272207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf379-5d9d-4097-8f8a-9c8d0e9b57c2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:49.272714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf379-5d9d-4097-8f8a-9c8d0e9b57c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:49.276408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf379-5d9d-4097-8f8a-9c8d0e9b57c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:49.293236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf379-5d9d-4097-8f8a-9c8d0e9b57c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:49.295288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf379-5d9d-4097-8f8a-9c8d0e9b57c2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:49.314055 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3833/7686] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:17:50.406310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7dfb-7297-48c2-a304-21a4ee317956 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:50.408189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4d2a7dfb-7297-48c2-a304-21a4ee317956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:50.455671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7dfb-7297-48c2-a304-21a4ee317956 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:50.468133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:50.469215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:50.469572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:50.470114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] PATH_INFO: `/v3/projects/1e95d3ca072e4ac99e011676d8376673` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:50.474240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e95d3ca072e4ac99e011676d8376673)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:50.478127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:50.632550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e95d3ca072e4ac99e011676d8376673', 'request_id': 'req-88e32bac-bb9c-4848-831c-f7144bc13c1e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:50.661111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e95d3ca072e4ac99e011676d8376673', 'request_id': 'req-88e32bac-bb9c-4848-831c-f7144bc13c1e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:50.676440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e95d3ca072e4ac99e011676d8376673', 'request_id': 'req-88e32bac-bb9c-4848-831c-f7144bc13c1e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:50.701148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] The token cache is being invalidate because project 1e95d3ca072e4ac99e011676d8376673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:17:50.701443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:50.703212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-88e32bac-bb9c-4848-831c-f7144bc13c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:17:50.705972 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3854/7687] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:17:50 2022] DELETE /identity/v3/projects/1e95d3ca072e4ac99e011676d8376673 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:50.711198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468472-1262-44e7-9763-b1b43fd37df0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:50.712099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468472-1262-44e7-9763-b1b43fd37df0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:50.712438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468472-1262-44e7-9763-b1b43fd37df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:50.751006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0d468472-1262-44e7-9763-b1b43fd37df0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:50.752512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0d468472-1262-44e7-9763-b1b43fd37df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:50.825753 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3834/7688] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:50.834193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed43727-012d-46b1-a2cd-0303683ac3c9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:50.834755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed43727-012d-46b1-a2cd-0303683ac3c9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:50.835197 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed43727-012d-46b1-a2cd-0303683ac3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:50.873952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bed43727-012d-46b1-a2cd-0303683ac3c9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:50.875407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bed43727-012d-46b1-a2cd-0303683ac3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:50.886351 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3855/7689] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:50.891837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d468472-1262-44e7-9763-b1b43fd37df0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:50.905769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d468472-1262-44e7-9763-b1b43fd37df0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:50.917396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:50.919041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:50.919491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:50.919934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:50.921349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:17:50.922034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:50.924036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:50.940009 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3835/7690] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:17:50.944209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed43727-012d-46b1-a2cd-0303683ac3c9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:50.954428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed43727-012d-46b1-a2cd-0303683ac3c9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:50.960946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9abe-e8cf-49f9-9271-0a8bf2a91c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:50.961960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9abe-e8cf-49f9-9271-0a8bf2a91c81 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:50.962443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9abe-e8cf-49f9-9271-0a8bf2a91c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:50.962915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9abe-e8cf-49f9-9271-0a8bf2a91c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:50.964430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe9abe-e8cf-49f9-9271-0a8bf2a91c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:50.966643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe9abe-e8cf-49f9-9271-0a8bf2a91c81 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:51.008651 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3856/7691] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:50 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:51.012189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:51.036744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c16df5-0bd8-4ddc-92dc-5e0aa3d60079 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:51.137138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f1f1-7cd0-40e2-91c1-167ae0e3f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:51.138743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f1f1-7cd0-40e2-91c1-167ae0e3f4ee admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:51.139106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f1f1-7cd0-40e2-91c1-167ae0e3f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:51.139431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f1f1-7cd0-40e2-91c1-167ae0e3f4ee admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:51.140459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7f1f1-7cd0-40e2-91c1-167ae0e3f4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:51.143175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7f1f1-7cd0-40e2-91c1-167ae0e3f4ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:51.209517 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3836/7692] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:51 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:51.214458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9abe-e8cf-49f9-9271-0a8bf2a91c81 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:51.280881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9abe-e8cf-49f9-9271-0a8bf2a91c81 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:51.304955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499eda-23e2-4f6b-b9c6-77a1bb73b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:51.313729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499eda-23e2-4f6b-b9c6-77a1bb73b1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:51.314545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499eda-23e2-4f6b-b9c6-77a1bb73b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:51.315929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499eda-23e2-4f6b-b9c6-77a1bb73b1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:51.320644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499eda-23e2-4f6b-b9c6-77a1bb73b1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:51.322748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499eda-23e2-4f6b-b9c6-77a1bb73b1a1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:51.345474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f1f1-7cd0-40e2-91c1-167ae0e3f4ee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:51.347214 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3857/7693] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:51.360889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f1f1-7cd0-40e2-91c1-167ae0e3f4ee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:51.379411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799bcd4-01c7-4c87-ba8f-f16b2baa14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:51.380118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799bcd4-01c7-4c87-ba8f-f16b2baa14ef admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:51.380435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799bcd4-01c7-4c87-ba8f-f16b2baa14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:51.380717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799bcd4-01c7-4c87-ba8f-f16b2baa14ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:51.381464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799bcd4-01c7-4c87-ba8f-f16b2baa14ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:51.384223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799bcd4-01c7-4c87-ba8f-f16b2baa14ef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:51.409932 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3837/7694] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:51.411338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499eda-23e2-4f6b-b9c6-77a1bb73b1a1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:51.435410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499eda-23e2-4f6b-b9c6-77a1bb73b1a1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:51.449297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3e11d-9d58-4e88-9998-91e9f139598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:51.450635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3e11d-9d58-4e88-9998-91e9f139598e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:51.451188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3e11d-9d58-4e88-9998-91e9f139598e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:51.451628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3e11d-9d58-4e88-9998-91e9f139598e admin admin] PATH_INFO: `/v3/projects/e2dcdf87966c4cc5899afcfb6f2b6b1f/users/e1fde410660b47939139960a9420179a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:51.482594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3e11d-9d58-4e88-9998-91e9f139598e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dcdf87966c4cc5899afcfb6f2b6b1f, user_id=e1fde410660b47939139960a9420179a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:51.487359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3e11d-9d58-4e88-9998-91e9f139598e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:51.520104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bead0-0a86-4717-a8c4-3205ea6f8207 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:51.520769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bead0-0a86-4717-a8c4-3205ea6f8207 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:51.521235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bead0-0a86-4717-a8c4-3205ea6f8207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:51.522785 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3858/7695] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:51 2022] PUT /identity/v3/projects/e2dcdf87966c4cc5899afcfb6f2b6b1f/users/e1fde410660b47939139960a9420179a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:51.561128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-911bead0-0a86-4717-a8c4-3205ea6f8207 None None] MFA Rules not processed for user `e1fde410660b47939139960a9420179a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:51.563039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-911bead0-0a86-4717-a8c4-3205ea6f8207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:51.681242 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3838/7696] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:51.686470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3e11d-9d58-4e88-9998-91e9f139598e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:51.771175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3e11d-9d58-4e88-9998-91e9f139598e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:51.780119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d7600-103e-4483-ae8d-97202c0f8ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:51.781289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d7600-103e-4483-ae8d-97202c0f8ecf admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:51.781910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d7600-103e-4483-ae8d-97202c0f8ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:51.782504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d7600-103e-4483-ae8d-97202c0f8ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:51.783491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d7600-103e-4483-ae8d-97202c0f8ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:51.786719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d7600-103e-4483-ae8d-97202c0f8ecf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:51.830939 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3859/7697] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:17:51 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:51.835105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bead0-0a86-4717-a8c4-3205ea6f8207 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:51.852250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bead0-0a86-4717-a8c4-3205ea6f8207 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:51.933376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247252b-39e4-4518-b56a-54eb54330744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:51.934909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247252b-39e4-4518-b56a-54eb54330744 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:51.935584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247252b-39e4-4518-b56a-54eb54330744 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:51.937673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247252b-39e4-4518-b56a-54eb54330744 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:51.939033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247252b-39e4-4518-b56a-54eb54330744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:51.941086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247252b-39e4-4518-b56a-54eb54330744 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:51.974364 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3839/7698] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:17:51 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:17:51.978122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d7600-103e-4483-ae8d-97202c0f8ecf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:51.992878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d7600-103e-4483-ae8d-97202c0f8ecf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:52.015053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c2ee1-b603-4595-b1bf-4c6f81bb55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:52.016552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2ee1-b603-4595-b1bf-4c6f81bb55d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:52.017419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2ee1-b603-4595-b1bf-4c6f81bb55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:52.017974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2ee1-b603-4595-b1bf-4c6f81bb55d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:52.019494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c2ee1-b603-4595-b1bf-4c6f81bb55d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:52.021899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c2ee1-b603-4595-b1bf-4c6f81bb55d5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:52.043957 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3860/7699] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:52.048391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247252b-39e4-4518-b56a-54eb54330744 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:52.067492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247252b-39e4-4518-b56a-54eb54330744 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:52.076686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd539b4-ca57-43a0-8810-b225c9e4c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:52.078130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd539b4-ca57-43a0-8810-b225c9e4c52c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:52.078579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd539b4-ca57-43a0-8810-b225c9e4c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:52.079056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd539b4-ca57-43a0-8810-b225c9e4c52c admin admin] PATH_INFO: `/v3/projects/5f7e3cbf221a45dd95bfe721e4bb18f0/users/b69db7bd77d0429ca25495aec2882cac/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:52.101613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd539b4-ca57-43a0-8810-b225c9e4c52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7e3cbf221a45dd95bfe721e4bb18f0, user_id=b69db7bd77d0429ca25495aec2882cac, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:52.104719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd539b4-ca57-43a0-8810-b225c9e4c52c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:52.124440 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3840/7700] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:52 2022] PUT /identity/v3/projects/5f7e3cbf221a45dd95bfe721e4bb18f0/users/b69db7bd77d0429ca25495aec2882cac/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:17:52.128278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c2ee1-b603-4595-b1bf-4c6f81bb55d5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:52.145156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c2ee1-b603-4595-b1bf-4c6f81bb55d5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:52.267741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c4853-43d7-4b56-bd06-7f5fbcd77eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:52.268740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c4853-43d7-4b56-bd06-7f5fbcd77eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:52.270260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c4853-43d7-4b56-bd06-7f5fbcd77eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:52.270735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c4853-43d7-4b56-bd06-7f5fbcd77eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:52.271553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c4853-43d7-4b56-bd06-7f5fbcd77eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:52.277256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c4853-43d7-4b56-bd06-7f5fbcd77eb9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:52.296775 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3861/7701] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:17:52.297751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd539b4-ca57-43a0-8810-b225c9e4c52c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:52.322194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd539b4-ca57-43a0-8810-b225c9e4c52c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:52.341109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:52.342215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:52.342698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:52.343151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] PATH_INFO: `/v3/projects/5f7e3cbf221a45dd95bfe721e4bb18f0/users/b69db7bd77d0429ca25495aec2882cac/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:52.348165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7e3cbf221a45dd95bfe721e4bb18f0, user_id=b69db7bd77d0429ca25495aec2882cac, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:52.350909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:52.388420 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3841/7702] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:17:52 2022] PUT /identity/v3/projects/5f7e3cbf221a45dd95bfe721e4bb18f0/users/b69db7bd77d0429ca25495aec2882cac/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:17:52.397093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bead7-e437-42ae-a08f-b27c4180f616 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:52.399088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bead7-e437-42ae-a08f-b27c4180f616 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:52.400062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bead7-e437-42ae-a08f-b27c4180f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:52.455154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-707bead7-e437-42ae-a08f-b27c4180f616 None None] MFA Rules not processed for user `b69db7bd77d0429ca25495aec2882cac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:17:52.456427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-707bead7-e437-42ae-a08f-b27c4180f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:52.624058 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3862/7703] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:17:52.665488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:17:52.667555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:17:52.802927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f18ee-c5c3-4deb-952b-46a374733f25 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:17:52.817955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:17:52.819691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:17:52.820225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:17:52.820748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:17:52.909100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:17:52.919442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:17:52.932605 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3842/7704] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:17:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:00.192631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bead7-e437-42ae-a08f-b27c4180f616 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:00.195704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-707bead7-e437-42ae-a08f-b27c4180f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:00.225380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bead7-e437-42ae-a08f-b27c4180f616 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:00.241602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99bab-8692-4abd-854f-a854e891b0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:00.243806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99bab-8692-4abd-854f-a854e891b0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:00.245303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99bab-8692-4abd-854f-a854e891b0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:00.246331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99bab-8692-4abd-854f-a854e891b0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:00.262017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd99bab-8692-4abd-854f-a854e891b0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:00.265286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd99bab-8692-4abd-854f-a854e891b0e3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:00.281975 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3863/7705] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:05.186103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:05.187707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:05.350242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b12c-0ce0-41fb-9e74-5d8eb93f345e service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:05.378010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:05.379910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:05.382129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:05.383490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] PATH_INFO: `/v3/users/fadeb8f9b8f0463cbbad92b345362546` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:05.392818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadeb8f9b8f0463cbbad92b345362546)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:05.394820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:05.564766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadeb8f9b8f0463cbbad92b345362546'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:05.620098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadeb8f9b8f0463cbbad92b345362546'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:05.636758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadeb8f9b8f0463cbbad92b345362546'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:05.638119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadeb8f9b8f0463cbbad92b345362546'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:05.638951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadeb8f9b8f0463cbbad92b345362546'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:05.663125 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3843/7706] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:05 2022] DELETE /identity/v3/users/fadeb8f9b8f0463cbbad92b345362546 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:18:05.670408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920af9-6712-48a3-a7e5-182cad5fbc28 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:05.671398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920af9-6712-48a3-a7e5-182cad5fbc28 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:05.671727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920af9-6712-48a3-a7e5-182cad5fbc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:05.707474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-76920af9-6712-48a3-a7e5-182cad5fbc28 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:05.714371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76920af9-6712-48a3-a7e5-182cad5fbc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:05.891461 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3864/7707] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:18:05.905400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:05.907531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:06.009436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcde4fb-94bd-4372-90d4-af4d527dd68a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:06.015305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:06.016253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:06.016830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:06.020814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:06.042092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:06.044544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:06.065943 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3844/7708] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:06.088404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920af9-6712-48a3-a7e5-182cad5fbc28 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:06.092014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-76920af9-6712-48a3-a7e5-182cad5fbc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:06.215602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920af9-6712-48a3-a7e5-182cad5fbc28 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:06.226430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:06.227502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:06.231128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:06.231851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:06.234823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:06.343167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:06.346077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:06.382447 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3865/7709] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:18:06.809972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:06.822302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:06.858683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6d99-8ad2-4a16-a65e-548f6d3a884a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:06.868193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:06.869702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:06.870141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:06.870597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] PATH_INFO: `/v3/projects/c0d980341c53486097ff7c90cefbc5ea` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:06.873203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d980341c53486097ff7c90cefbc5ea)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:06.877151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:07.004148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d980341c53486097ff7c90cefbc5ea', 'request_id': 'req-7973e7e5-5237-4167-be48-112410ad54b1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.014964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d980341c53486097ff7c90cefbc5ea', 'request_id': 'req-7973e7e5-5237-4167-be48-112410ad54b1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.026801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d980341c53486097ff7c90cefbc5ea', 'request_id': 'req-7973e7e5-5237-4167-be48-112410ad54b1'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.041999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] The token cache is being invalidate because project c0d980341c53486097ff7c90cefbc5ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:07.042837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.044251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.055617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:07.057065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3845/7710] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:06 2022] DELETE /identity/v3/projects/c0d980341c53486097ff7c90cefbc5ea => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:07.074612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dae96-d44f-4b8c-99ea-14600cb67a47 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:07.181634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:07.182226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:07.182951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:07.183665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] PATH_INFO: `/v3/users/25cc5e39b83a4790a17bb825f9115496` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:07.188520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cc5e39b83a4790a17bb825f9115496)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:07.193994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:07.294013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cc5e39b83a4790a17bb825f9115496'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.296822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cc5e39b83a4790a17bb825f9115496'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.297984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cc5e39b83a4790a17bb825f9115496'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.337645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cc5e39b83a4790a17bb825f9115496'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.365185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8f9086ab-bd95-4bbf-82ab-851101ba5b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cc5e39b83a4790a17bb825f9115496'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:07.390986 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3866/7711] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:07 2022] DELETE /identity/v3/users/25cc5e39b83a4790a17bb825f9115496 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:07.932134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:07.934450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:07.964176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973e7e5-5237-4167-be48-112410ad54b1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:08.041959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:08.042852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.044091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.044508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] PATH_INFO: `/v3/projects/2bf97ca8c144485fb096b7030caf8f60` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.045580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf97ca8c144485fb096b7030caf8f60)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:08.047683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:08.116166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf97ca8c144485fb096b7030caf8f60', 'request_id': 'req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:08.123959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf97ca8c144485fb096b7030caf8f60', 'request_id': 'req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:08.136755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf97ca8c144485fb096b7030caf8f60', 'request_id': 'req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:08.155648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] The token cache is being invalidate because project 2bf97ca8c144485fb096b7030caf8f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:08.156236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:08.157303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-67ad8b5c-bdaf-4814-86e7-c3eaf08388f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:08.159756 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3846/7712] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:07 2022] DELETE /identity/v3/projects/2bf97ca8c144485fb096b7030caf8f60 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:08.165479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957f4d-9d78-452f-bd00-f72daf8e604f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.166028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957f4d-9d78-452f-bd00-f72daf8e604f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.167117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957f4d-9d78-452f-bd00-f72daf8e604f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.187997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4a957f4d-9d78-452f-bd00-f72daf8e604f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:08.189291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4a957f4d-9d78-452f-bd00-f72daf8e604f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:08.256106 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3867/7713] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:08.267407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fbecb-d8e8-4a67-b303-e5dee5d827eb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.268484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fbecb-d8e8-4a67-b303-e5dee5d827eb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.269042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fbecb-d8e8-4a67-b303-e5dee5d827eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.296932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-df4fbecb-d8e8-4a67-b303-e5dee5d827eb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:08.298605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-df4fbecb-d8e8-4a67-b303-e5dee5d827eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:08.311623 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3847/7714] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:08.317427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957f4d-9d78-452f-bd00-f72daf8e604f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:08.329667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957f4d-9d78-452f-bd00-f72daf8e604f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:08.337591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:08.338307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.338595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.338881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.339686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:08.340001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:08.342289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:08.354855 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3868/7715] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:08.360166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fbecb-d8e8-4a67-b303-e5dee5d827eb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:08.376526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fbecb-d8e8-4a67-b303-e5dee5d827eb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:08.382235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e87cf9-dbbb-4d56-9e05-0624a8111b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:08.383042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e87cf9-dbbb-4d56-9e05-0624a8111b0d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.383421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e87cf9-dbbb-4d56-9e05-0624a8111b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.383626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e87cf9-dbbb-4d56-9e05-0624a8111b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.384664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e87cf9-dbbb-4d56-9e05-0624a8111b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:08.388530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e87cf9-dbbb-4d56-9e05-0624a8111b0d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:08.432393 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3848/7716] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:08 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:08.437709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:08.450966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8189732-6589-4f1b-969a-c806c7dc3665 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:08.553126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3917f-0e6a-4461-94a0-74fc398854bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:08.556555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3917f-0e6a-4461-94a0-74fc398854bb admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.556875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3917f-0e6a-4461-94a0-74fc398854bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.557147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3917f-0e6a-4461-94a0-74fc398854bb admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.557906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3917f-0e6a-4461-94a0-74fc398854bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:08.560292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3917f-0e6a-4461-94a0-74fc398854bb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:08.586782 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3869/7717] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:08 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:08.591125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e87cf9-dbbb-4d56-9e05-0624a8111b0d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:08.603571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e87cf9-dbbb-4d56-9e05-0624a8111b0d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:08.609881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1f3d0-0966-4b1b-a346-12c91e85ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:08.610575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1f3d0-0966-4b1b-a346-12c91e85ed14 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.611447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1f3d0-0966-4b1b-a346-12c91e85ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.611447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1f3d0-0966-4b1b-a346-12c91e85ed14 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.611852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1f3d0-0966-4b1b-a346-12c91e85ed14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:08.613530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1f3d0-0966-4b1b-a346-12c91e85ed14 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:08.625167 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3849/7718] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:08.630539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3917f-0e6a-4461-94a0-74fc398854bb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:08.643256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3917f-0e6a-4461-94a0-74fc398854bb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:08.649116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76627ca8-8772-46cf-9eaf-9fb722c578d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:08.649890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76627ca8-8772-46cf-9eaf-9fb722c578d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.650254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76627ca8-8772-46cf-9eaf-9fb722c578d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.650598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76627ca8-8772-46cf-9eaf-9fb722c578d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.651556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76627ca8-8772-46cf-9eaf-9fb722c578d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:08.653865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76627ca8-8772-46cf-9eaf-9fb722c578d0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:08.670425 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3870/7719] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:08.672616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1f3d0-0966-4b1b-a346-12c91e85ed14 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:08.684378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1f3d0-0966-4b1b-a346-12c91e85ed14 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:08.699352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73831dd-3200-4243-926c-c9947df0cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:08.699352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73831dd-3200-4243-926c-c9947df0cb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.699352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73831dd-3200-4243-926c-c9947df0cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.699352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73831dd-3200-4243-926c-c9947df0cb8b admin admin] PATH_INFO: `/v3/projects/a3cce9ffe5d04486b69bbf73b537bb3e/users/10a8443c166e46448ec99e9d11ef926e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.717421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73831dd-3200-4243-926c-c9947df0cb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cce9ffe5d04486b69bbf73b537bb3e, user_id=10a8443c166e46448ec99e9d11ef926e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:08.720317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73831dd-3200-4243-926c-c9947df0cb8b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:08.748427 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3850/7720] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:08 2022] PUT /identity/v3/projects/a3cce9ffe5d04486b69bbf73b537bb3e/users/10a8443c166e46448ec99e9d11ef926e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:08.760619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361b94c-6a73-4aa2-8b8b-466fd02a3e1d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.761119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361b94c-6a73-4aa2-8b8b-466fd02a3e1d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.761569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361b94c-6a73-4aa2-8b8b-466fd02a3e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.794203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3361b94c-6a73-4aa2-8b8b-466fd02a3e1d None None] MFA Rules not processed for user `10a8443c166e46448ec99e9d11ef926e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:08.795672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3361b94c-6a73-4aa2-8b8b-466fd02a3e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:08.902624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3871/7721] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:08.907697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73831dd-3200-4243-926c-c9947df0cb8b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:08.989480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73831dd-3200-4243-926c-c9947df0cb8b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:08.995042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339c03c-68bd-4a62-89d1-3d79ec792d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:08.995894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c03c-68bd-4a62-89d1-3d79ec792d07 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:08.996194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c03c-68bd-4a62-89d1-3d79ec792d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:08.996575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c03c-68bd-4a62-89d1-3d79ec792d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:08.997791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339c03c-68bd-4a62-89d1-3d79ec792d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:08.999744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339c03c-68bd-4a62-89d1-3d79ec792d07 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:09.053675 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3851/7722] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:08 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:09.057636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361b94c-6a73-4aa2-8b8b-466fd02a3e1d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:09.070944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361b94c-6a73-4aa2-8b8b-466fd02a3e1d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:09.147890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51e0ee-03e5-450a-a2c8-3206916a3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:09.148372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e0ee-03e5-450a-a2c8-3206916a3408 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:09.148703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e0ee-03e5-450a-a2c8-3206916a3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:09.149262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e0ee-03e5-450a-a2c8-3206916a3408 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:09.150048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51e0ee-03e5-450a-a2c8-3206916a3408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:09.152178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51e0ee-03e5-450a-a2c8-3206916a3408 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:09.180221 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3872/7723] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:09 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:09.184439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339c03c-68bd-4a62-89d1-3d79ec792d07 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:09.198193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339c03c-68bd-4a62-89d1-3d79ec792d07 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:09.207282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3969c3-f568-45fb-b151-1bac386a50bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:09.208460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3969c3-f568-45fb-b151-1bac386a50bf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:09.208804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3969c3-f568-45fb-b151-1bac386a50bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:09.209184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3969c3-f568-45fb-b151-1bac386a50bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:09.210046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3969c3-f568-45fb-b151-1bac386a50bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:09.212713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3969c3-f568-45fb-b151-1bac386a50bf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:09.237401 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3852/7724] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:09.241803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51e0ee-03e5-450a-a2c8-3206916a3408 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:09.252960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51e0ee-03e5-450a-a2c8-3206916a3408 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:09.258729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f79ba-30d8-4b79-9935-405682633d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:09.260127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f79ba-30d8-4b79-9935-405682633d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:09.260731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f79ba-30d8-4b79-9935-405682633d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:09.261069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f79ba-30d8-4b79-9935-405682633d1c admin admin] PATH_INFO: `/v3/projects/1faeda2bd070497183a8ec7172696aca/users/3d3a9946d0aa445dbca7d12f0c0f1e0b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:09.291831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f79ba-30d8-4b79-9935-405682633d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1faeda2bd070497183a8ec7172696aca, user_id=3d3a9946d0aa445dbca7d12f0c0f1e0b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:09.295500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f79ba-30d8-4b79-9935-405682633d1c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:09.312388 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3873/7725] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:09 2022] PUT /identity/v3/projects/1faeda2bd070497183a8ec7172696aca/users/3d3a9946d0aa445dbca7d12f0c0f1e0b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:09.316231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3969c3-f568-45fb-b151-1bac386a50bf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:09.330115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3969c3-f568-45fb-b151-1bac386a50bf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:09.413085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb1e63-4f1a-47f1-95af-cd8de998ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:09.413929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1e63-4f1a-47f1-95af-cd8de998ddf1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:09.414051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1e63-4f1a-47f1-95af-cd8de998ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:09.414327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1e63-4f1a-47f1-95af-cd8de998ddf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:09.415677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb1e63-4f1a-47f1-95af-cd8de998ddf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:09.417542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb1e63-4f1a-47f1-95af-cd8de998ddf1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:09.429961 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3853/7726] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:09.434119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f79ba-30d8-4b79-9935-405682633d1c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:09.447538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f79ba-30d8-4b79-9935-405682633d1c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:09.453618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:09.454589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:09.455125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:09.455589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] PATH_INFO: `/v3/projects/1faeda2bd070497183a8ec7172696aca/users/3d3a9946d0aa445dbca7d12f0c0f1e0b/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:09.461419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1faeda2bd070497183a8ec7172696aca, user_id=3d3a9946d0aa445dbca7d12f0c0f1e0b, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:09.464430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:09.484799 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3874/7727] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:09 2022] PUT /identity/v3/projects/1faeda2bd070497183a8ec7172696aca/users/3d3a9946d0aa445dbca7d12f0c0f1e0b/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:09.495093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081ca1-1379-488b-aa77-f80bb81a8364 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:09.495381 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081ca1-1379-488b-aa77-f80bb81a8364 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:09.495861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081ca1-1379-488b-aa77-f80bb81a8364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:09.535840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d4081ca1-1379-488b-aa77-f80bb81a8364 None None] MFA Rules not processed for user `3d3a9946d0aa445dbca7d12f0c0f1e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:09.538046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4081ca1-1379-488b-aa77-f80bb81a8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:09.626705 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3854/7728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:09.633424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:09.635326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:09.726176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfde4d-d05f-4746-a4c8-077d3f7b37f4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:09.730959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394ae00-5937-448c-a3ee-1fce3cf37c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:09.731950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ae00-5937-448c-a3ee-1fce3cf37c60 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:09.732865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ae00-5937-448c-a3ee-1fce3cf37c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:09.732865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ae00-5937-448c-a3ee-1fce3cf37c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:09.744287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394ae00-5937-448c-a3ee-1fce3cf37c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:09.745933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394ae00-5937-448c-a3ee-1fce3cf37c60 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:09.756783 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3875/7729] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:16.385494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4081ca1-1379-488b-aa77-f80bb81a8364 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:16.390614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d4081ca1-1379-488b-aa77-f80bb81a8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:16.447481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4081ca1-1379-488b-aa77-f80bb81a8364 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:16.461623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:16.462573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:16.463051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:16.463510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:16.468676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:16.638925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:16.641066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:16.658738 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3855/7730] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:19.160707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394ae00-5937-448c-a3ee-1fce3cf37c60 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:19.175785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394ae00-5937-448c-a3ee-1fce3cf37c60 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:19.191669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3a9946d0aa445dbca7d12f0c0f1e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1faeda2bd070497183a8ec7172696aca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:19.192821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:19.193285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:19.193742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:19.200621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:19.201433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:19.203419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:19.272441 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3876/7731] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:19.273639 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:19.295918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a321ad-4e89-446c-b08d-d69c9371b2c0 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:19.304577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1032ac6-8c9f-4b9d-b362-48419570f860 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3a9946d0aa445dbca7d12f0c0f1e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1faeda2bd070497183a8ec7172696aca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:19.305819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1032ac6-8c9f-4b9d-b362-48419570f860 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:19.306470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1032ac6-8c9f-4b9d-b362-48419570f860 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:19.306936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1032ac6-8c9f-4b9d-b362-48419570f860 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:19.308006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1032ac6-8c9f-4b9d-b362-48419570f860 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:19.332615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1032ac6-8c9f-4b9d-b362-48419570f860 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:19.401620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3856/7732] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:19 2022] POST /identity/v3/projects => generated 348 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:19.406574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:19.420454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0911-1ede-48d6-bf84-58f690ba19e0 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:19.550978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3a9946d0aa445dbca7d12f0c0f1e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1faeda2bd070497183a8ec7172696aca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:19.552116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:19.552433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:19.553771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:19.556832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:19.557455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:19.563115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:19.595801 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3877/7733] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:21.303584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1032ac6-8c9f-4b9d-b362-48419570f860 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:21.348526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1032ac6-8c9f-4b9d-b362-48419570f860 tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:21.366730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3a9946d0aa445dbca7d12f0c0f1e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1faeda2bd070497183a8ec7172696aca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:21.369981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:21.370517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:21.370973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] PATH_INFO: `/v3/projects/d538e9851c7742e68d3eee80db45729b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:21.373484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d538e9851c7742e68d3eee80db45729b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:21.376059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:21.483203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd538e9851c7742e68d3eee80db45729b', 'request_id': 'req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:21.499973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd538e9851c7742e68d3eee80db45729b', 'request_id': 'req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:21.523594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd538e9851c7742e68d3eee80db45729b', 'request_id': 'req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:21.542567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] The token cache is being invalidate because project d538e9851c7742e68d3eee80db45729b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:21.543103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:21.544034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8e2a06cf-ca90-4169-9e36-f304a7dccdaa tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:21.546410 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3857/7734] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:21 2022] DELETE /identity/v3/projects/d538e9851c7742e68d3eee80db45729b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:21.582078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:21.584436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:21.719093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68231-bca3-4fe5-b08a-6696b6241cae tempest-RoutersIpV6AdminTest-2119379993 tempest-RoutersIpV6AdminTest-2119379993-project-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:21.790737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:21.791763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:21.792286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:21.792885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:21.796668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:21.907038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:21.909846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:21.945320 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3878/7735] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:22.787444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0c28-65b3-4c1d-b0f5-5d7e0f5265c6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:22.788892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0c28-65b3-4c1d-b0f5-5d7e0f5265c6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:22.789703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0c28-65b3-4c1d-b0f5-5d7e0f5265c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:22.814225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b50a0c28-65b3-4c1d-b0f5-5d7e0f5265c6 None None] MFA Rules not processed for user `e1fde410660b47939139960a9420179a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:22.816851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b50a0c28-65b3-4c1d-b0f5-5d7e0f5265c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:22.945602 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3858/7736] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:23.681379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:23.683171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:23.751109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a0c28-65b3-4c1d-b0f5-5d7e0f5265c6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:23.753116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b50a0c28-65b3-4c1d-b0f5-5d7e0f5265c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:23.779569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a0c28-65b3-4c1d-b0f5-5d7e0f5265c6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:23.795878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969c80d-0f9f-4d7d-8c77-f2cc143ceefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:23.798974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c80d-0f9f-4d7d-8c77-f2cc143ceefc service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:23.802926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c80d-0f9f-4d7d-8c77-f2cc143ceefc service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:23.803789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c80d-0f9f-4d7d-8c77-f2cc143ceefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:23.812952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0969c80d-0f9f-4d7d-8c77-f2cc143ceefc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:23.851380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969c80d-0f9f-4d7d-8c77-f2cc143ceefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:23.853278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969c80d-0f9f-4d7d-8c77-f2cc143ceefc service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:23.867746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4bc2b-652b-4126-92c4-43d569bf95c7 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:23.879012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:23.880363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:23.880887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:23.881393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] PATH_INFO: `/v3/users/e7d24e6210c848d3820fa969cb77d9c1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:23.883254 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3859/7737] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:23.884219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d24e6210c848d3820fa969cb77d9c1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:23.886322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:23.945889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d24e6210c848d3820fa969cb77d9c1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:23.947426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d24e6210c848d3820fa969cb77d9c1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:23.947426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d24e6210c848d3820fa969cb77d9c1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:23.963037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d24e6210c848d3820fa969cb77d9c1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:23.978814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d24e6210c848d3820fa969cb77d9c1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:24.004058 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3879/7738] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:23 2022] DELETE /identity/v3/users/e7d24e6210c848d3820fa969cb77d9c1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:24.008589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac03e6-e9f0-4017-8bcd-08ec27151674 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:24.008880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac03e6-e9f0-4017-8bcd-08ec27151674 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:24.009160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac03e6-e9f0-4017-8bcd-08ec27151674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:24.036779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-69ac03e6-e9f0-4017-8bcd-08ec27151674 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:24.038427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69ac03e6-e9f0-4017-8bcd-08ec27151674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:24.124949 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3860/7739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:24.140180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:24.143741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:24.248145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa428c92-5118-43b0-a353-b84c10f0baae admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:24.252425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:24.253250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:24.253648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:24.254058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:24.267448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:24.271074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:24.290724 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3880/7740] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:25.120697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac03e6-e9f0-4017-8bcd-08ec27151674 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:25.122915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-69ac03e6-e9f0-4017-8bcd-08ec27151674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:25.143902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac03e6-e9f0-4017-8bcd-08ec27151674 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:25.153803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:25.155030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:25.155315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:25.155934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] PATH_INFO: `/v3/projects/ad93e6eca7bb4554bef6fd82494917db` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:25.157963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad93e6eca7bb4554bef6fd82494917db)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:25.160432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:25.317882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad93e6eca7bb4554bef6fd82494917db', 'request_id': 'req-042fc501-7130-4d91-824c-f5bde9d52d10'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:25.334946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad93e6eca7bb4554bef6fd82494917db', 'request_id': 'req-042fc501-7130-4d91-824c-f5bde9d52d10'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:25.336702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:25.338330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:25.363310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad93e6eca7bb4554bef6fd82494917db', 'request_id': 'req-042fc501-7130-4d91-824c-f5bde9d52d10'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:25.407071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] The token cache is being invalidate because project ad93e6eca7bb4554bef6fd82494917db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:25.407374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:25.409606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-042fc501-7130-4d91-824c-f5bde9d52d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:25.412322 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3861/7741] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:25 2022] DELETE /identity/v3/projects/ad93e6eca7bb4554bef6fd82494917db => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:25.418729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd52d-1519-4f23-b1b2-2091b2dba2c8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:25.419367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd52d-1519-4f23-b1b2-2091b2dba2c8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:25.419596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd52d-1519-4f23-b1b2-2091b2dba2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:25.474424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-62dfd52d-1519-4f23-b1b2-2091b2dba2c8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:25.476123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-62dfd52d-1519-4f23-b1b2-2091b2dba2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:25.599437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b8c9-b9c7-483f-8b8f-ab83c37faee1 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:25.615780 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3862/7742] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:25.624883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573597dd-c252-4806-8554-5aa001d67684 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:25.626534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573597dd-c252-4806-8554-5aa001d67684 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:25.627015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573597dd-c252-4806-8554-5aa001d67684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:25.651404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-573597dd-c252-4806-8554-5aa001d67684 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:25.654733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-573597dd-c252-4806-8554-5aa001d67684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:25.667017 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3863/7743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:25.671053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573597dd-c252-4806-8554-5aa001d67684 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:25.690788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573597dd-c252-4806-8554-5aa001d67684 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:25.704955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:25.705536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:25.705821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:25.706092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:25.709771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:25.710103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:25.716180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:25.758127 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3864/7744] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:25.760131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:25.761663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:25.762947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:25.763238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:25.763523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:25.773051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1a66-a031-4551-a9e4-b9cca45a5d06 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:25.777252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:25.790114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca736cf1-814d-448b-9164-73beaa173ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:25.790997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca736cf1-814d-448b-9164-73beaa173ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:25.791481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca736cf1-814d-448b-9164-73beaa173ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:25.791916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca736cf1-814d-448b-9164-73beaa173ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:25.792815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca736cf1-814d-448b-9164-73beaa173ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:25.795503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca736cf1-814d-448b-9164-73beaa173ae2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:25.826131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:25.834371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:25.846099 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3865/7745] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:25 2022] POST /identity/v3/projects => generated 359 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:25.847507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca736cf1-814d-448b-9164-73beaa173ae2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:25.865658 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3881/7746] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:18:26.046048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca736cf1-814d-448b-9164-73beaa173ae2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:26.057364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673839-f669-4267-a414-5a42d98acf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:26.060401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673839-f669-4267-a414-5a42d98acf60 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:26.060401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673839-f669-4267-a414-5a42d98acf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:26.060401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673839-f669-4267-a414-5a42d98acf60 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:26.060965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34673839-f669-4267-a414-5a42d98acf60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:26.063246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34673839-f669-4267-a414-5a42d98acf60 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:26.094571 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3866/7747] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:25 2022] POST /identity/v3/users => generated 280 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:26.095825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:26.113951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18f8d-e049-4e42-920c-addd266ea78f service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:26.133934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d21583-1e48-4af8-862c-9e4f2496d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:26.134987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21583-1e48-4af8-862c-9e4f2496d0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:26.135482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21583-1e48-4af8-862c-9e4f2496d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:26.135994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21583-1e48-4af8-862c-9e4f2496d0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:26.140954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d21583-1e48-4af8-862c-9e4f2496d0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:26.143148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d21583-1e48-4af8-862c-9e4f2496d0e7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:26.179870 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3882/7748] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:26.184710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673839-f669-4267-a414-5a42d98acf60 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:26.219532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673839-f669-4267-a414-5a42d98acf60 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:26.240299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b458bc-9bba-427d-8b65-e5d849aa82fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:26.241462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b458bc-9bba-427d-8b65-e5d849aa82fb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:26.241918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b458bc-9bba-427d-8b65-e5d849aa82fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:26.242379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b458bc-9bba-427d-8b65-e5d849aa82fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:26.243283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b458bc-9bba-427d-8b65-e5d849aa82fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:26.247258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b458bc-9bba-427d-8b65-e5d849aa82fb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:26.272814 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3867/7749] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:26.276849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d21583-1e48-4af8-862c-9e4f2496d0e7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:26.287824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d21583-1e48-4af8-862c-9e4f2496d0e7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:26.300848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:26.302352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:26.303049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:26.303661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] PATH_INFO: `/v3/projects/17dcedea5c824fb1af2727789604388d/users/9e5efb50ea6e41809bc46423cef86ce7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:26.359525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17dcedea5c824fb1af2727789604388d, user_id=9e5efb50ea6e41809bc46423cef86ce7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:26.365465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:26.391737 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3883/7750] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:26 2022] PUT /identity/v3/projects/17dcedea5c824fb1af2727789604388d/users/9e5efb50ea6e41809bc46423cef86ce7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:18:26.408832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7f551-606e-415e-8653-3d75b538614a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:26.409236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7f551-606e-415e-8653-3d75b538614a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:26.409656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7f551-606e-415e-8653-3d75b538614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:26.459070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0fc7f551-606e-415e-8653-3d75b538614a None None] MFA Rules not processed for user `9e5efb50ea6e41809bc46423cef86ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:26.460396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0fc7f551-606e-415e-8653-3d75b538614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:26.574409 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3868/7751] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:26.767551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:26.769426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:26.915451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131908c3-63a5-4d7a-a8be-eb95ddf0766b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:26.924597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:26.925314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:26.925601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:26.925886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:26.939699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:26.945120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:26.958148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3884/7752] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:26 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:29.906664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7f551-606e-415e-8653-3d75b538614a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:29.922580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7f551-606e-415e-8653-3d75b538614a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:29.929366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:29.932026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:29.932574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:29.933291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:29.937558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:29.956371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:29.958126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:29.976468 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3869/7753] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:34.957311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:34.958869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:35.058082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b399d-0920-47e2-8d9a-e27e3ae9aee6 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:35.064855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:35.065637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:35.065987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:35.066364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:35.068361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:35.084122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:35.086104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:35.102797 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3885/7754] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:36.249463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:36.251840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:36.370803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155739f3-9a54-4a8e-9f36-d3812602b632 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:36.381249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:36.383876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:36.384585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:36.385367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] PATH_INFO: `/v3/users/9f1e1cafad4f475dad7bc93b50312279` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:36.388555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1e1cafad4f475dad7bc93b50312279)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:36.391970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:36.468276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1e1cafad4f475dad7bc93b50312279'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.483951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1e1cafad4f475dad7bc93b50312279'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.496367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1e1cafad4f475dad7bc93b50312279'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.498547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1e1cafad4f475dad7bc93b50312279'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.499469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91d475a9-eb14-4c22-90e4-e8cda4c0600f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1e1cafad4f475dad7bc93b50312279'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.516276 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3870/7755] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:36 2022] DELETE /identity/v3/users/9f1e1cafad4f475dad7bc93b50312279 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:36.595890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:36.601365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:36.625658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1859c5-2354-4150-bbba-7118dcda081f service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:36.748712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:36.749714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:36.750268 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:36.750828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] PATH_INFO: `/v3/users/38327ff993634f09ba329d92e58c9576` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:36.752733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=38327ff993634f09ba329d92e58c9576)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:36.755328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:36.827097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38327ff993634f09ba329d92e58c9576'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.827512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38327ff993634f09ba329d92e58c9576'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.828412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38327ff993634f09ba329d92e58c9576'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.844128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38327ff993634f09ba329d92e58c9576'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.853314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38327ff993634f09ba329d92e58c9576'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:36.870356 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3886/7756] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:36 2022] DELETE /identity/v3/users/38327ff993634f09ba329d92e58c9576 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:36.875479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224a96d-bed8-4a84-9ce3-2a341a3417ee None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:36.875765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224a96d-bed8-4a84-9ce3-2a341a3417ee None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:36.876039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224a96d-bed8-4a84-9ce3-2a341a3417ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:36.893180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9224a96d-bed8-4a84-9ce3-2a341a3417ee None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:36.894428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9224a96d-bed8-4a84-9ce3-2a341a3417ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:36.971297 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3871/7757] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:36.985523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:36.986997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:36.998099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224a96d-bed8-4a84-9ce3-2a341a3417ee None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:36.999955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9224a96d-bed8-4a84-9ce3-2a341a3417ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:37.044686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224a96d-bed8-4a84-9ce3-2a341a3417ee None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:37.053812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:37.055192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:37.055645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:37.056102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] PATH_INFO: `/v3/projects/da6216f26c814fceaa94fc64e78c8efc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:37.058133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6216f26c814fceaa94fc64e78c8efc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:37.060441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:37.120916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b3901-1cb4-4d85-b641-9960c599cbbb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:37.135595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6216f26c814fceaa94fc64e78c8efc', 'request_id': 'req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.147804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6216f26c814fceaa94fc64e78c8efc', 'request_id': 'req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.161390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6216f26c814fceaa94fc64e78c8efc', 'request_id': 'req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.190582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] The token cache is being invalidate because project da6216f26c814fceaa94fc64e78c8efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:37.191054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.192046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.195361 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3872/7758] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:36 2022] DELETE /identity/v3/projects/da6216f26c814fceaa94fc64e78c8efc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:18:37.203024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:37.205834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:37.234347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:37.235333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:37.236008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:37.236669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:37.239183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:37.321306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4cc8f-32a3-46db-be60-5b3c13f1e877 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:37.334452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:37.337756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:37.340466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:37.341416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] PATH_INFO: `/v3/users/e261613761bb44609c8aa5b7bc3d7d90` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:37.348169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e261613761bb44609c8aa5b7bc3d7d90)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:37.355059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:37.460357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:37.461853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:37.479680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e261613761bb44609c8aa5b7bc3d7d90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.485901 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3887/7759] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:18:37.496568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e261613761bb44609c8aa5b7bc3d7d90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.512882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e261613761bb44609c8aa5b7bc3d7d90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.513844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e261613761bb44609c8aa5b7bc3d7d90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.514661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79a5b7b1-2996-41e7-b22c-f29bad5a96f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e261613761bb44609c8aa5b7bc3d7d90'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:37.536226 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3873/7760] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:37 2022] DELETE /identity/v3/users/e261613761bb44609c8aa5b7bc3d7d90 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:38.232156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:38.233832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:38.248467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e115ac-67d5-489d-8f4c-4399f04683d8 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:38.315074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:38.316381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:38.316789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:38.318620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] PATH_INFO: `/v3/projects/ee1f38ceb0d34c39af97d64199951236` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:38.320441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1f38ceb0d34c39af97d64199951236)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:38.322714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:38.402941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1f38ceb0d34c39af97d64199951236', 'request_id': 'req-d22d1c2b-9a56-4f68-a398-3adc15b33529'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:38.412414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1f38ceb0d34c39af97d64199951236', 'request_id': 'req-d22d1c2b-9a56-4f68-a398-3adc15b33529'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:38.425834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1f38ceb0d34c39af97d64199951236', 'request_id': 'req-d22d1c2b-9a56-4f68-a398-3adc15b33529'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:38.459524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] The token cache is being invalidate because project ee1f38ceb0d34c39af97d64199951236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:38.460177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:38.461470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-d22d1c2b-9a56-4f68-a398-3adc15b33529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:38.465983 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3888/7761] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:38 2022] DELETE /identity/v3/projects/ee1f38ceb0d34c39af97d64199951236 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:38.472910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fa614-7e4f-47e8-a75c-32d5e616096e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:38.473830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fa614-7e4f-47e8-a75c-32d5e616096e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:38.474850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fa614-7e4f-47e8-a75c-32d5e616096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:38.505445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e69fa614-7e4f-47e8-a75c-32d5e616096e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:38.507357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e69fa614-7e4f-47e8-a75c-32d5e616096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:38.592716 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3874/7762] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:38.596207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac79ff-cc37-4b21-bb2a-38d3afb61041 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:38.596853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac79ff-cc37-4b21-bb2a-38d3afb61041 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:38.597393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac79ff-cc37-4b21-bb2a-38d3afb61041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:38.618732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-12ac79ff-cc37-4b21-bb2a-38d3afb61041 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:38.620571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-12ac79ff-cc37-4b21-bb2a-38d3afb61041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:38.660873 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3889/7763] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:38.663469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fa614-7e4f-47e8-a75c-32d5e616096e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:38.687307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fa614-7e4f-47e8-a75c-32d5e616096e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:38.690860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac79ff-cc37-4b21-bb2a-38d3afb61041 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:38.692605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-12ac79ff-cc37-4b21-bb2a-38d3afb61041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:38.712112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:38.713136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:38.715290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:38.715946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:38.720387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:38.723144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:38.725094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac79ff-cc37-4b21-bb2a-38d3afb61041 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:38.726240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:38.760237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:38.763929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:38.764848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:38.766212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] PATH_INFO: `/v3/projects/aeb441a7b0094cc59af51b60a7f101a9` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:38.775266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb441a7b0094cc59af51b60a7f101a9)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:38.786173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:38.830300 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3875/7764] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:18:38.836472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:38.862339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b157cf-dce6-4427-bc36-0bfc0454260e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:38.878869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3418-0b2d-44d3-a291-415fb871cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:38.879981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3418-0b2d-44d3-a291-415fb871cb4d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:38.880673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3418-0b2d-44d3-a291-415fb871cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:38.880988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3418-0b2d-44d3-a291-415fb871cb4d admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:38.882241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f3418-0b2d-44d3-a291-415fb871cb4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:38.890194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f3418-0b2d-44d3-a291-415fb871cb4d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:38.945186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb441a7b0094cc59af51b60a7f101a9', 'request_id': 'req-cfaadddf-13b1-4af0-be44-479f90457831'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:38.958029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb441a7b0094cc59af51b60a7f101a9', 'request_id': 'req-cfaadddf-13b1-4af0-be44-479f90457831'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:38.976785 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3876/7765] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:38 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:38.980419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3418-0b2d-44d3-a291-415fb871cb4d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:38.984222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb441a7b0094cc59af51b60a7f101a9', 'request_id': 'req-cfaadddf-13b1-4af0-be44-479f90457831'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:39.007236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] The token cache is being invalidate because project aeb441a7b0094cc59af51b60a7f101a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:39.007587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:39.008529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cfaadddf-13b1-4af0-be44-479f90457831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:39.015768 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3890/7766] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:38 2022] DELETE /identity/v3/projects/aeb441a7b0094cc59af51b60a7f101a9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:18:39.019452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5f10-a0da-4c81-a994-32fd907839b8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.020535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5f10-a0da-4c81-a994-32fd907839b8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.020535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5f10-a0da-4c81-a994-32fd907839b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.073417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c40c5f10-a0da-4c81-a994-32fd907839b8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:39.084695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c40c5f10-a0da-4c81-a994-32fd907839b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:39.115211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3418-0b2d-44d3-a291-415fb871cb4d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.118028 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3891/7767] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:39.125839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391f5d-c71b-49a2-85a9-b2f817d4b020 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.126695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391f5d-c71b-49a2-85a9-b2f817d4b020 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.127709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391f5d-c71b-49a2-85a9-b2f817d4b020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.129162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.129873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.130189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.130441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.131141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.133149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.165556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0b391f5d-c71b-49a2-85a9-b2f817d4b020 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:39.170023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0b391f5d-c71b-49a2-85a9-b2f817d4b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:39.178384 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3877/7768] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:38 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:18:39.182168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.185593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:39.197014 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3892/7769] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:39.202181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b391f5d-c71b-49a2-85a9-b2f817d4b020 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.213412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807197bb-5993-47be-8efb-2ad27a8a98db admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.226966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829758da-1312-4145-98ac-37c91ea33fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.228866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829758da-1312-4145-98ac-37c91ea33fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.229635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b391f5d-c71b-49a2-85a9-b2f817d4b020 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.229794 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829758da-1312-4145-98ac-37c91ea33fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.232014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829758da-1312-4145-98ac-37c91ea33fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.234025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829758da-1312-4145-98ac-37c91ea33fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.235859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829758da-1312-4145-98ac-37c91ea33fc5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.261588 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3878/7770] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:18:39.269585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829758da-1312-4145-98ac-37c91ea33fc5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.270233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.271643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.272642 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.274096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.276212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:39.277894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.281794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.283304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829758da-1312-4145-98ac-37c91ea33fc5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.297876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683a33a-6b9d-4dd9-b241-21c20d697824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.298559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a33a-6b9d-4dd9-b241-21c20d697824 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.298845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a33a-6b9d-4dd9-b241-21c20d697824 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.299125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683a33a-6b9d-4dd9-b241-21c20d697824 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.299850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683a33a-6b9d-4dd9-b241-21c20d697824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.303147 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3893/7771] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:39.309962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683a33a-6b9d-4dd9-b241-21c20d697824 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.311210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.329270 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3879/7772] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:18:39.333413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683a33a-6b9d-4dd9-b241-21c20d697824 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.349733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683a33a-6b9d-4dd9-b241-21c20d697824 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.359812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5c51-b7e6-4c89-b24a-383acb488c8e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.367141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f1a02-37d2-4ac5-91fc-2347b89882ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.368731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1a02-37d2-4ac5-91fc-2347b89882ca admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.368731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1a02-37d2-4ac5-91fc-2347b89882ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.368731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1a02-37d2-4ac5-91fc-2347b89882ca admin admin] PATH_INFO: `/v3/projects/46127394ad1b420f9156fce51407b8b5/users/7c40b7a363be4f689707ebcced283723/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.397181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35f418-1ed2-4c90-bdb2-84549bc6e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.398390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f418-1ed2-4c90-bdb2-84549bc6e970 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.398390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f418-1ed2-4c90-bdb2-84549bc6e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.398390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f418-1ed2-4c90-bdb2-84549bc6e970 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.399829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35f418-1ed2-4c90-bdb2-84549bc6e970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.401870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35f418-1ed2-4c90-bdb2-84549bc6e970 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.404976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f1a02-37d2-4ac5-91fc-2347b89882ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=46127394ad1b420f9156fce51407b8b5, user_id=7c40b7a363be4f689707ebcced283723, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.407766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f1a02-37d2-4ac5-91fc-2347b89882ca admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.433053 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3880/7773] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:39 2022] PUT /identity/v3/projects/46127394ad1b420f9156fce51407b8b5/users/7c40b7a363be4f689707ebcced283723/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:39.443411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5a68-3c5b-4256-9114-c6e67f328b91 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.443689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5a68-3c5b-4256-9114-c6e67f328b91 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.444001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5a68-3c5b-4256-9114-c6e67f328b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.477255 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3894/7774] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:39 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:39.478180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35f418-1ed2-4c90-bdb2-84549bc6e970 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.500096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-970d5a68-3c5b-4256-9114-c6e67f328b91 None None] MFA Rules not processed for user `7c40b7a363be4f689707ebcced283723`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:39.501385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-970d5a68-3c5b-4256-9114-c6e67f328b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:39.581589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35f418-1ed2-4c90-bdb2-84549bc6e970 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.588461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d809-b06f-48b2-b9ef-06e6b867b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.589463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d809-b06f-48b2-b9ef-06e6b867b021 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.589463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d809-b06f-48b2-b9ef-06e6b867b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.590400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d809-b06f-48b2-b9ef-06e6b867b021 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.591121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d809-b06f-48b2-b9ef-06e6b867b021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.593524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d809-b06f-48b2-b9ef-06e6b867b021 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.645819 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3895/7775] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:39 2022] POST /identity/v3/users => generated 282 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:39.647968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d809-b06f-48b2-b9ef-06e6b867b021 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.680011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d809-b06f-48b2-b9ef-06e6b867b021 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.696737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.703903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.704355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.704640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.705423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.709366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.728239 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3881/7776] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:18:39.732991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d5a68-3c5b-4256-9114-c6e67f328b91 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.735469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3896/7777] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:39.755688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d5a68-3c5b-4256-9114-c6e67f328b91 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.765134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.770264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:39.782500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb14c8-fd5d-4650-b2af-158393e48915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.784187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb14c8-fd5d-4650-b2af-158393e48915 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.785993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb14c8-fd5d-4650-b2af-158393e48915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.786315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb14c8-fd5d-4650-b2af-158393e48915 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.787541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb14c8-fd5d-4650-b2af-158393e48915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.791532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb14c8-fd5d-4650-b2af-158393e48915 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.820587 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3882/7778] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:18:39.825152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb14c8-fd5d-4650-b2af-158393e48915 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:39.843560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb14c8-fd5d-4650-b2af-158393e48915 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.851444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587d238-fa83-4cf1-be95-d0f8268f770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:39.852638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d238-fa83-4cf1-be95-d0f8268f770e admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.852961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d238-fa83-4cf1-be95-d0f8268f770e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.854267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d238-fa83-4cf1-be95-d0f8268f770e admin admin] PATH_INFO: `/v3/projects/03b2d1224b644f36aa3f9a7636a9cef5/users/2ae717495d724ffd8e3c138fd0a939d8/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.874780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587d238-fa83-4cf1-be95-d0f8268f770e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b2d1224b644f36aa3f9a7636a9cef5, user_id=2ae717495d724ffd8e3c138fd0a939d8, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:39.878720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587d238-fa83-4cf1-be95-d0f8268f770e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:39.896502 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3883/7779] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:39 2022] PUT /identity/v3/projects/03b2d1224b644f36aa3f9a7636a9cef5/users/2ae717495d724ffd8e3c138fd0a939d8/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:39.905299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c66d-20a5-46c3-b71e-db071d2d1579 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:39.905625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c66d-20a5-46c3-b71e-db071d2d1579 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:39.905927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c66d-20a5-46c3-b71e-db071d2d1579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:39.929700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3410813-e6b9-4a07-841b-805a561d395d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:39.930568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1cd1c66d-20a5-46c3-b71e-db071d2d1579 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:39.931823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1cd1c66d-20a5-46c3-b71e-db071d2d1579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:40.000523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:40.001284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:40.001637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:40.001982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:40.011179 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3884/7780] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:40.066446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c66d-20a5-46c3-b71e-db071d2d1579 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:40.083758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c66d-20a5-46c3-b71e-db071d2d1579 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:40.092323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:40.093023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267f9f7-88a8-4a0d-953e-75cab7f31eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:40.093765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267f9f7-88a8-4a0d-953e-75cab7f31eae service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:40.093990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267f9f7-88a8-4a0d-953e-75cab7f31eae service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:40.094274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267f9f7-88a8-4a0d-953e-75cab7f31eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:40.094427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:40.108029 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3897/7781] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:40.116485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267f9f7-88a8-4a0d-953e-75cab7f31eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:40.117961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267f9f7-88a8-4a0d-953e-75cab7f31eae service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:40.131581 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3885/7782] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:40.401702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:40.403814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:40.578813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b1996-763d-40fb-bf7b-d9ba8f6d7904 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:40.596780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7512c-d3bb-4898-96c9-fb328475a2c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:40.597462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7512c-d3bb-4898-96c9-fb328475a2c6 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:40.600120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7512c-d3bb-4898-96c9-fb328475a2c6 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:40.600120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7512c-d3bb-4898-96c9-fb328475a2c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:40.601326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e8d7512c-d3bb-4898-96c9-fb328475a2c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:40.636292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7512c-d3bb-4898-96c9-fb328475a2c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:40.638486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7512c-d3bb-4898-96c9-fb328475a2c6 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:40.670011 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3898/7783] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:40.850504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267f9f7-88a8-4a0d-953e-75cab7f31eae service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:40.864475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267f9f7-88a8-4a0d-953e-75cab7f31eae service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:40.874185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:40.875085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:40.875370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:40.875650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] PATH_INFO: `/v3/users/7c40b7a363be4f689707ebcced283723` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:40.876949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c40b7a363be4f689707ebcced283723)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:40.878901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:40.951390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c40b7a363be4f689707ebcced283723'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:40.971638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c40b7a363be4f689707ebcced283723'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:40.982610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c40b7a363be4f689707ebcced283723'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:40.983368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c40b7a363be4f689707ebcced283723'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:40.983986 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c40b7a363be4f689707ebcced283723'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:41.007004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7394f-094c-4d69-a247-f0fcdd5e1d21 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:41.007290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7394f-094c-4d69-a247-f0fcdd5e1d21 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:41.007571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7394f-094c-4d69-a247-f0fcdd5e1d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:41.012453 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3886/7784] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:40 2022] DELETE /identity/v3/users/7c40b7a363be4f689707ebcced283723 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:41.045825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e5f7394f-094c-4d69-a247-f0fcdd5e1d21 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:41.058016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e5f7394f-094c-4d69-a247-f0fcdd5e1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:41.173586 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3899/7785] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:41.244001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:41.245679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:41.341743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430f802-cf75-4721-be58-a555eff6c598 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:41.359789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:41.362482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:41.363600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:41.364174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:41.395530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:41.397503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:41.451031 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3887/7786] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:18:42.767654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7394f-094c-4d69-a247-f0fcdd5e1d21 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:42.769917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e5f7394f-094c-4d69-a247-f0fcdd5e1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:42.787929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7394f-094c-4d69-a247-f0fcdd5e1d21 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:42.795203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:42.796283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:42.796785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:42.797458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] PATH_INFO: `/v3/users/36d2f6bc5a804890b3d364b11ea4d6d8` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:42.798677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d2f6bc5a804890b3d364b11ea4d6d8)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:42.800850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:42.887151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d2f6bc5a804890b3d364b11ea4d6d8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:42.888359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d2f6bc5a804890b3d364b11ea4d6d8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:42.889593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d2f6bc5a804890b3d364b11ea4d6d8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:42.914436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d2f6bc5a804890b3d364b11ea4d6d8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:42.923110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a3dedc51-725f-488f-85b0-323deac79cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d2f6bc5a804890b3d364b11ea4d6d8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:42.932301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:42.934441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:42.942889 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3900/7787] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:42 2022] DELETE /identity/v3/users/36d2f6bc5a804890b3d364b11ea4d6d8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:42.945655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b4b2-9381-437b-8de7-a7234be57d31 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:42.946168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b4b2-9381-437b-8de7-a7234be57d31 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:42.946699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b4b2-9381-437b-8de7-a7234be57d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:42.948835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1b22-b0da-458b-b184-80de36521835 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:42.981621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f684b4b2-9381-437b-8de7-a7234be57d31 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:42.988127 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f684b4b2-9381-437b-8de7-a7234be57d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:43.056736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:43.057883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.058290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.059369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] PATH_INFO: `/v3/projects/46127394ad1b420f9156fce51407b8b5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.060797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] RBAC: Authorizing `identity:delete_project(project_id=46127394ad1b420f9156fce51407b8b5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:43.063916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:43.106238 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3901/7788] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:43.117567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b4b2-9381-437b-8de7-a7234be57d31 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:43.122126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f684b4b2-9381-437b-8de7-a7234be57d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:43.189755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46127394ad1b420f9156fce51407b8b5', 'request_id': 'req-d5e71d0f-e5e4-435b-be53-48e435cedeba'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:43.208826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b4b2-9381-437b-8de7-a7234be57d31 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:43.215979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46127394ad1b420f9156fce51407b8b5', 'request_id': 'req-d5e71d0f-e5e4-435b-be53-48e435cedeba'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:43.240397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46127394ad1b420f9156fce51407b8b5', 'request_id': 'req-d5e71d0f-e5e4-435b-be53-48e435cedeba'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:43.265654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] The token cache is being invalidate because project 46127394ad1b420f9156fce51407b8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:43.269366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a645-07aa-49fb-bfdd-072c0cb06bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:43.270307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a645-07aa-49fb-bfdd-072c0cb06bea service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.270742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a645-07aa-49fb-bfdd-072c0cb06bea service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.271164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a645-07aa-49fb-bfdd-072c0cb06bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.271331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:43.273146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5e71d0f-e5e4-435b-be53-48e435cedeba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:43.274932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8ac0a645-07aa-49fb-bfdd-072c0cb06bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:43.275894 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3888/7789] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:42 2022] DELETE /identity/v3/projects/46127394ad1b420f9156fce51407b8b5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:18:43.283961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2a5b-4e10-426a-a9cb-3f1fd3a24bce None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.284247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2a5b-4e10-426a-a9cb-3f1fd3a24bce None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.291234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2a5b-4e10-426a-a9cb-3f1fd3a24bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.360213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-82cd2a5b-4e10-426a-a9cb-3f1fd3a24bce None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:43.361559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-82cd2a5b-4e10-426a-a9cb-3f1fd3a24bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:43.373765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0a645-07aa-49fb-bfdd-072c0cb06bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:43.375494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0a645-07aa-49fb-bfdd-072c0cb06bea service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:43.388927 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3902/7790] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:43.397696 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3889/7791] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:43.408442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c911e3-d18c-47b6-82e3-3e4506b3cc8e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.409012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c911e3-d18c-47b6-82e3-3e4506b3cc8e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.409479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c911e3-d18c-47b6-82e3-3e4506b3cc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.448849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-50c911e3-d18c-47b6-82e3-3e4506b3cc8e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:43.451112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-50c911e3-d18c-47b6-82e3-3e4506b3cc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:43.484591 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3903/7792] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:43.487818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd2a5b-4e10-426a-a9cb-3f1fd3a24bce None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:43.502395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd2a5b-4e10-426a-a9cb-3f1fd3a24bce None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:43.514703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:43.515395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.515689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.515971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.516968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:43.517360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:43.522399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:43.559954 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3890/7793] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:43.561165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c911e3-d18c-47b6-82e3-3e4506b3cc8e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:43.577396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c911e3-d18c-47b6-82e3-3e4506b3cc8e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:43.588937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cf263-e2d8-4b78-99be-a5c3a0134efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:43.590959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf263-e2d8-4b78-99be-a5c3a0134efa admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.592064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf263-e2d8-4b78-99be-a5c3a0134efa admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.592365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf263-e2d8-4b78-99be-a5c3a0134efa admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.593667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cf263-e2d8-4b78-99be-a5c3a0134efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:43.597158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cf263-e2d8-4b78-99be-a5c3a0134efa admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:43.668795 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3904/7794] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:43 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:43.673060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:43.700739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45360846-8350-4eab-9d7c-01d27e51426b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:43.809775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2667b-3f87-4ab0-993f-b4afaf565e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:43.810171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2667b-3f87-4ab0-993f-b4afaf565e9f admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.810456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2667b-3f87-4ab0-993f-b4afaf565e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.810734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2667b-3f87-4ab0-993f-b4afaf565e9f admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.811436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2667b-3f87-4ab0-993f-b4afaf565e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:43.813542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2667b-3f87-4ab0-993f-b4afaf565e9f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:43.843481 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3891/7795] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:43 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:43.844708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cf263-e2d8-4b78-99be-a5c3a0134efa admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:43.861047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cf263-e2d8-4b78-99be-a5c3a0134efa admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:43.867809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0db984-3bac-4a0f-8d33-ed1f1aa7adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:43.868779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0db984-3bac-4a0f-8d33-ed1f1aa7adbb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.869237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0db984-3bac-4a0f-8d33-ed1f1aa7adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.869674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0db984-3bac-4a0f-8d33-ed1f1aa7adbb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.870574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0db984-3bac-4a0f-8d33-ed1f1aa7adbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:43.872943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0db984-3bac-4a0f-8d33-ed1f1aa7adbb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:43.892381 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3905/7796] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:43.897015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2667b-3f87-4ab0-993f-b4afaf565e9f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:43.912765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2667b-3f87-4ab0-993f-b4afaf565e9f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:43.925734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8730162-7603-4b27-b94d-516c638a8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:43.927007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8730162-7603-4b27-b94d-516c638a8fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.927570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8730162-7603-4b27-b94d-516c638a8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.928282 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8730162-7603-4b27-b94d-516c638a8fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:43.929483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8730162-7603-4b27-b94d-516c638a8fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:43.932169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8730162-7603-4b27-b94d-516c638a8fa5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:43.947547 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3892/7797] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:18:43.952553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0db984-3bac-4a0f-8d33-ed1f1aa7adbb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:43.974698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0db984-3bac-4a0f-8d33-ed1f1aa7adbb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:43.982614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:43.983908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:43.984393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:43.984828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] PATH_INFO: `/v3/projects/b3f6a891ff9645d58636fb53ce2f23e2/users/86c7b9e07793465a8b87d250ee0d61d1/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:44.055883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f6a891ff9645d58636fb53ce2f23e2, user_id=86c7b9e07793465a8b87d250ee0d61d1, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:44.063362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:44.096659 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3906/7798] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:43 2022] PUT /identity/v3/projects/b3f6a891ff9645d58636fb53ce2f23e2/users/86c7b9e07793465a8b87d250ee0d61d1/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:44.108712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeda52-ca62-4b7d-90f4-05913e1c2f46 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:44.109000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeda52-ca62-4b7d-90f4-05913e1c2f46 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:44.110029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeda52-ca62-4b7d-90f4-05913e1c2f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:44.168989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-eabeda52-ca62-4b7d-90f4-05913e1c2f46 None None] MFA Rules not processed for user `86c7b9e07793465a8b87d250ee0d61d1`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:44.170401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eabeda52-ca62-4b7d-90f4-05913e1c2f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:44.288395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:44.290288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:44.295621 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3893/7799] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:44.330960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeda52-ca62-4b7d-90f4-05913e1c2f46 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:44.332585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eabeda52-ca62-4b7d-90f4-05913e1c2f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:44.471085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751f68b-e728-4f9e-a889-ccc38075022a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:44.502250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeda52-ca62-4b7d-90f4-05913e1c2f46 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:44.507280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:44.508133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:44.508445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:44.508726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] PATH_INFO: `/v3/projects/3602d6ecd5b146f2a12a8609607cbabe` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:44.510079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3602d6ecd5b146f2a12a8609607cbabe)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:44.510783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b59b8-728f-4920-9f7e-784f96604edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:44.511815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b59b8-728f-4920-9f7e-784f96604edd service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:44.512094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:44.512508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b59b8-728f-4920-9f7e-784f96604edd service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:44.512945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b59b8-728f-4920-9f7e-784f96604edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:44.525668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b59b8-728f-4920-9f7e-784f96604edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:44.544661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b59b8-728f-4920-9f7e-784f96604edd service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:44.570702 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3894/7800] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:18:44.655778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3602d6ecd5b146f2a12a8609607cbabe', 'request_id': 'req-e86f75e7-6927-48a7-baaf-7312b285b0d1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:44.663321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3602d6ecd5b146f2a12a8609607cbabe', 'request_id': 'req-e86f75e7-6927-48a7-baaf-7312b285b0d1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:44.681218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3602d6ecd5b146f2a12a8609607cbabe', 'request_id': 'req-e86f75e7-6927-48a7-baaf-7312b285b0d1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:44.702953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] The token cache is being invalidate because project 3602d6ecd5b146f2a12a8609607cbabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:44.703516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:44.704506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:44.719526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b59b8-728f-4920-9f7e-784f96604edd service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:44.722563 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3907/7801] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:44 2022] DELETE /identity/v3/projects/3602d6ecd5b146f2a12a8609607cbabe => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:44.745204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b59b8-728f-4920-9f7e-784f96604edd service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:44.925913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:44.928576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:44.929422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:44.929995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] PATH_INFO: `/v3/users/153cadd1b1ab4be9981ef151c354f4b0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:44.932222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=153cadd1b1ab4be9981ef151c354f4b0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:44.935841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:45.082888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153cadd1b1ab4be9981ef151c354f4b0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.104722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153cadd1b1ab4be9981ef151c354f4b0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.118240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153cadd1b1ab4be9981ef151c354f4b0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.119274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153cadd1b1ab4be9981ef151c354f4b0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.120512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153cadd1b1ab4be9981ef151c354f4b0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.142844 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3895/7802] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:44 2022] DELETE /identity/v3/users/153cadd1b1ab4be9981ef151c354f4b0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:45.538660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:45.541184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:45.565538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f75e7-6927-48a7-baaf-7312b285b0d1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:45.581958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:45.584122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:45.699023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:45.700652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:45.701430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:45.701934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] PATH_INFO: `/v3/users/86c7b9e07793465a8b87d250ee0d61d1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:45.704135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c7b9e07793465a8b87d250ee0d61d1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:45.707425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:45.762189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2289e-80af-4b98-ae9f-142ded3eb28b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:45.779165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:45.780557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:45.781033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:45.781651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] PATH_INFO: `/v3/projects/e06193abd1d34eaab32fdda1693b0ed4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:45.783859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06193abd1d34eaab32fdda1693b0ed4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:45.787895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:45.824907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c7b9e07793465a8b87d250ee0d61d1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.826154 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c7b9e07793465a8b87d250ee0d61d1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.826817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c7b9e07793465a8b87d250ee0d61d1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.858570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c7b9e07793465a8b87d250ee0d61d1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.872978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06193abd1d34eaab32fdda1693b0ed4', 'request_id': 'req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.879845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e8f57aa1-3741-4303-970d-7444a26b38b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c7b9e07793465a8b87d250ee0d61d1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.880785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06193abd1d34eaab32fdda1693b0ed4', 'request_id': 'req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.893853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06193abd1d34eaab32fdda1693b0ed4', 'request_id': 'req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.908443 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3908/7803] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:45 2022] DELETE /identity/v3/users/86c7b9e07793465a8b87d250ee0d61d1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:45.913087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa1d4-3dd2-4fad-bb1e-507c6cf53959 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:45.913601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa1d4-3dd2-4fad-bb1e-507c6cf53959 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:45.913958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa1d4-3dd2-4fad-bb1e-507c6cf53959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:45.934004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] The token cache is being invalidate because project e06193abd1d34eaab32fdda1693b0ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:45.934307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.935008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9ea4b5fb-c6fe-44fc-adac-753ad478aa0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:45.937076 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3896/7804] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:45 2022] DELETE /identity/v3/projects/e06193abd1d34eaab32fdda1693b0ed4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:45.941908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9ee0-ad48-4d8f-9c9b-e1112667b1d9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:45.942595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9ee0-ad48-4d8f-9c9b-e1112667b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:45.943055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9ee0-ad48-4d8f-9c9b-e1112667b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:45.961095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3dbfa1d4-3dd2-4fad-bb1e-507c6cf53959 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:45.964232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3dbfa1d4-3dd2-4fad-bb1e-507c6cf53959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:45.982731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0f6e9ee0-ad48-4d8f-9c9b-e1112667b1d9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:45.986273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0f6e9ee0-ad48-4d8f-9c9b-e1112667b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:46.072894 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3909/7805] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:46.092925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfa1d4-3dd2-4fad-bb1e-507c6cf53959 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:46.095838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3dbfa1d4-3dd2-4fad-bb1e-507c6cf53959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:46.139960 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3897/7806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:18:46.148164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725621a0-aba9-46b6-a278-ffe18a2539fc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.148652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725621a0-aba9-46b6-a278-ffe18a2539fc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.149075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725621a0-aba9-46b6-a278-ffe18a2539fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.198934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-725621a0-aba9-46b6-a278-ffe18a2539fc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:46.204050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-725621a0-aba9-46b6-a278-ffe18a2539fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:46.227012 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3898/7807] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:18:46.229435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725621a0-aba9-46b6-a278-ffe18a2539fc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:46.254377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725621a0-aba9-46b6-a278-ffe18a2539fc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:46.262871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:46.266476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.267770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.268491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.271220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:46.271813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:46.274392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:46.276434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfa1d4-3dd2-4fad-bb1e-507c6cf53959 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:46.284708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a5e57-114e-4629-a8a4-e6f0b54f1d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:46.285672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a5e57-114e-4629-a8a4-e6f0b54f1d1b service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.286063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a5e57-114e-4629-a8a4-e6f0b54f1d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.286451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a5e57-114e-4629-a8a4-e6f0b54f1d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.305598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a5e57-114e-4629-a8a4-e6f0b54f1d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:46.307176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a5e57-114e-4629-a8a4-e6f0b54f1d1b service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:46.319367 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3899/7808] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:46.320974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:46.323353 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3910/7809] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:46.348478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc5c60-7e3c-4716-aeba-d3a347e45df4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:46.355066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eb8fa-6a47-47dc-90d6-8ff4fc811cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:46.356569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eb8fa-6a47-47dc-90d6-8ff4fc811cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.357826 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eb8fa-6a47-47dc-90d6-8ff4fc811cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.358487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eb8fa-6a47-47dc-90d6-8ff4fc811cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.359377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5eb8fa-6a47-47dc-90d6-8ff4fc811cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:46.361730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5eb8fa-6a47-47dc-90d6-8ff4fc811cc4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:46.423108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a5e57-114e-4629-a8a4-e6f0b54f1d1b service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:46.424749 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3900/7810] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:46 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:46.440133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a5e57-114e-4629-a8a4-e6f0b54f1d1b service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:46.564029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6272a-944a-4f9e-8e5f-bdfdf562d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:46.564865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6272a-944a-4f9e-8e5f-bdfdf562d4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.565353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6272a-944a-4f9e-8e5f-bdfdf562d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.565825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6272a-944a-4f9e-8e5f-bdfdf562d4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.567674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6272a-944a-4f9e-8e5f-bdfdf562d4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:46.570944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6272a-944a-4f9e-8e5f-bdfdf562d4c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:46.609893 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3911/7811] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:46 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:18:46.614065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eb8fa-6a47-47dc-90d6-8ff4fc811cc4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:46.641162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eb8fa-6a47-47dc-90d6-8ff4fc811cc4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:46.647908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2932a-555f-44b1-b057-7312b5d8678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:46.649021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2932a-555f-44b1-b057-7312b5d8678f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.649536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2932a-555f-44b1-b057-7312b5d8678f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.649880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2932a-555f-44b1-b057-7312b5d8678f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.650869 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2932a-555f-44b1-b057-7312b5d8678f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:46.654516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2932a-555f-44b1-b057-7312b5d8678f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:46.687117 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3901/7812] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:46.691112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6272a-944a-4f9e-8e5f-bdfdf562d4c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:46.710318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6272a-944a-4f9e-8e5f-bdfdf562d4c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:46.723248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6db3-4e5a-4721-914a-894cebeccde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:46.724476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6db3-4e5a-4721-914a-894cebeccde0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.736211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6db3-4e5a-4721-914a-894cebeccde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.736542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6db3-4e5a-4721-914a-894cebeccde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.737544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f6db3-4e5a-4721-914a-894cebeccde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:46.739252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f6db3-4e5a-4721-914a-894cebeccde0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:46.753463 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3912/7813] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:46.757894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2932a-555f-44b1-b057-7312b5d8678f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:46.771362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2932a-555f-44b1-b057-7312b5d8678f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:46.779133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76cdb9-65ae-4626-8ded-0d511a24c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:46.780397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76cdb9-65ae-4626-8ded-0d511a24c53c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.780891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76cdb9-65ae-4626-8ded-0d511a24c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.781561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76cdb9-65ae-4626-8ded-0d511a24c53c admin admin] PATH_INFO: `/v3/projects/ee95f61e46b548ebb3d07818562cb7c7/users/db4490bff7fd4b16b669a896ed9bf6e7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.803169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76cdb9-65ae-4626-8ded-0d511a24c53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee95f61e46b548ebb3d07818562cb7c7, user_id=db4490bff7fd4b16b669a896ed9bf6e7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:46.810241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76cdb9-65ae-4626-8ded-0d511a24c53c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:46.830767 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3902/7814] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:46 2022] PUT /identity/v3/projects/ee95f61e46b548ebb3d07818562cb7c7/users/db4490bff7fd4b16b669a896ed9bf6e7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:46.841829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6f35-c670-4130-b8c7-6827393ee26b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:46.842128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6f35-c670-4130-b8c7-6827393ee26b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:46.842464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6f35-c670-4130-b8c7-6827393ee26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:46.873954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d72d6f35-c670-4130-b8c7-6827393ee26b None None] MFA Rules not processed for user `db4490bff7fd4b16b669a896ed9bf6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:46.875510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d72d6f35-c670-4130-b8c7-6827393ee26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:47.006805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3913/7815] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:47.026116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76cdb9-65ae-4626-8ded-0d511a24c53c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:47.097694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76cdb9-65ae-4626-8ded-0d511a24c53c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:47.101486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00466c-0831-45f2-a371-c36d6ca4d03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:47.102276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00466c-0831-45f2-a371-c36d6ca4d03f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:47.102950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00466c-0831-45f2-a371-c36d6ca4d03f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:47.103324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00466c-0831-45f2-a371-c36d6ca4d03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:47.113233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00466c-0831-45f2-a371-c36d6ca4d03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:47.115356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00466c-0831-45f2-a371-c36d6ca4d03f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:47.132815 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3903/7816] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:47.317336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6f35-c670-4130-b8c7-6827393ee26b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:47.319535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d72d6f35-c670-4130-b8c7-6827393ee26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:47.432777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6f35-c670-4130-b8c7-6827393ee26b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:47.439229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:47.440166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:47.440490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:47.440908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] PATH_INFO: `/v3/projects/b3f6a891ff9645d58636fb53ce2f23e2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:47.442482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f6a891ff9645d58636fb53ce2f23e2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:47.444614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:47.517244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f6a891ff9645d58636fb53ce2f23e2', 'request_id': 'req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:47.525559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f6a891ff9645d58636fb53ce2f23e2', 'request_id': 'req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:47.537671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f6a891ff9645d58636fb53ce2f23e2', 'request_id': 'req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:47.557193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] The token cache is being invalidate because project b3f6a891ff9645d58636fb53ce2f23e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:47.557622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:47.558865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0a7e6c46-c635-4d05-9a2e-d8a6e88ed6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:47.562043 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3914/7817] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:47 2022] DELETE /identity/v3/projects/b3f6a891ff9645d58636fb53ce2f23e2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:47.567334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39808666-cf1b-4677-a65c-7cedefd1decf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:47.568494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39808666-cf1b-4677-a65c-7cedefd1decf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:47.569005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39808666-cf1b-4677-a65c-7cedefd1decf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:47.595777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-39808666-cf1b-4677-a65c-7cedefd1decf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:47.597863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-39808666-cf1b-4677-a65c-7cedefd1decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:47.678035 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3904/7818] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:47.686681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e965-0318-4f87-88f1-f96789d312e8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:47.687281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e965-0318-4f87-88f1-f96789d312e8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:47.687281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e965-0318-4f87-88f1-f96789d312e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:47.728497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-adb7e965-0318-4f87-88f1-f96789d312e8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:47.732074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-adb7e965-0318-4f87-88f1-f96789d312e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:47.745797 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3915/7819] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:47.749740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39808666-cf1b-4677-a65c-7cedefd1decf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:47.760700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39808666-cf1b-4677-a65c-7cedefd1decf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:47.766972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:47.767691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:47.767989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:47.768259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:47.769032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:47.769342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:47.770956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:47.787942 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3905/7820] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:18:47.789144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e965-0318-4f87-88f1-f96789d312e8 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:47.800075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e965-0318-4f87-88f1-f96789d312e8 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:47.806870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c0e90-5d7a-4f07-98bf-81389bfceef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:47.807929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0e90-5d7a-4f07-98bf-81389bfceef2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:47.808876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0e90-5d7a-4f07-98bf-81389bfceef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:47.810139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0e90-5d7a-4f07-98bf-81389bfceef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:47.811101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c0e90-5d7a-4f07-98bf-81389bfceef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:47.820092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c0e90-5d7a-4f07-98bf-81389bfceef2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:47.863143 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3916/7821] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:47 2022] POST /identity/v3/projects => generated 405 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:47.864844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:47.881141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a7b9-f424-40eb-9b32-ab56afe09d40 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:47.973811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69898e-a429-4f5e-8198-bd87f5009f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:47.974570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69898e-a429-4f5e-8198-bd87f5009f6e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:47.975485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69898e-a429-4f5e-8198-bd87f5009f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:47.976026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69898e-a429-4f5e-8198-bd87f5009f6e admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:47.976848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69898e-a429-4f5e-8198-bd87f5009f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:47.979638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69898e-a429-4f5e-8198-bd87f5009f6e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:48.012832 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3906/7822] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:47 2022] POST /identity/v3/users => generated 303 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:48.014119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c0e90-5d7a-4f07-98bf-81389bfceef2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:48.028438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c0e90-5d7a-4f07-98bf-81389bfceef2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:48.034094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb9c86-0f6e-4e3b-8e82-50cf86280d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:48.035052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9c86-0f6e-4e3b-8e82-50cf86280d47 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:48.035411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9c86-0f6e-4e3b-8e82-50cf86280d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:48.035873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9c86-0f6e-4e3b-8e82-50cf86280d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:48.036878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb9c86-0f6e-4e3b-8e82-50cf86280d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:48.038831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb9c86-0f6e-4e3b-8e82-50cf86280d47 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:48.055208 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3917/7823] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:18:48.056586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69898e-a429-4f5e-8198-bd87f5009f6e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:48.068568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69898e-a429-4f5e-8198-bd87f5009f6e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:48.074931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dd782-c187-4866-a47a-807fbc24f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:48.075811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dd782-c187-4866-a47a-807fbc24f8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:48.076190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dd782-c187-4866-a47a-807fbc24f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:48.076584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dd782-c187-4866-a47a-807fbc24f8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:48.077442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dd782-c187-4866-a47a-807fbc24f8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:48.079239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dd782-c187-4866-a47a-807fbc24f8a0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:48.093373 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3907/7824] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:48.097171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb9c86-0f6e-4e3b-8e82-50cf86280d47 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:48.108605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb9c86-0f6e-4e3b-8e82-50cf86280d47 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:48.115992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:48.116981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:48.117254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:48.117533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] PATH_INFO: `/v3/projects/84ae0d8feb2c43e59091ce4925eb8bb2/users/d371dd124a54495987e2cf7e2e75d81c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:48.137240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ae0d8feb2c43e59091ce4925eb8bb2, user_id=d371dd124a54495987e2cf7e2e75d81c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:48.140276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:48.158924 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3918/7825] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:48 2022] PUT /identity/v3/projects/84ae0d8feb2c43e59091ce4925eb8bb2/users/d371dd124a54495987e2cf7e2e75d81c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:48.163978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7445-a42f-427a-b6a1-febf15a6fb92 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:48.164433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7445-a42f-427a-b6a1-febf15a6fb92 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:48.164924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7445-a42f-427a-b6a1-febf15a6fb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:48.188238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cb7b7445-a42f-427a-b6a1-febf15a6fb92 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:48.189845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cb7b7445-a42f-427a-b6a1-febf15a6fb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:48.269902 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3908/7826] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:48.287028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:48.288901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:48.359080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d5f66-da61-45b6-9a1b-23cffe8a6a20 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:48.363224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce046d-68a5-448e-bee3-142e82653985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:48.364092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce046d-68a5-448e-bee3-142e82653985 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:48.364526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce046d-68a5-448e-bee3-142e82653985 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:48.364907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce046d-68a5-448e-bee3-142e82653985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:48.376870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce046d-68a5-448e-bee3-142e82653985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:48.378529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce046d-68a5-448e-bee3-142e82653985 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:48.390834 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3919/7827] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:50.326042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8003-9775-4c51-b576-176ed06acbe6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:50.326591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8003-9775-4c51-b576-176ed06acbe6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:50.326591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8003-9775-4c51-b576-176ed06acbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:50.380257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a11f8003-9775-4c51-b576-176ed06acbe6 None None] MFA Rules not processed for user `d371dd124a54495987e2cf7e2e75d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:50.381834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a11f8003-9775-4c51-b576-176ed06acbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:50.467291 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3909/7828] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:50.471529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce046d-68a5-448e-bee3-142e82653985 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:50.483853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce046d-68a5-448e-bee3-142e82653985 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:50.519500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2acd2-aca7-4645-9190-44b76838c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:50.521025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2acd2-aca7-4645-9190-44b76838c67a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:50.521855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2acd2-aca7-4645-9190-44b76838c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:50.523145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2acd2-aca7-4645-9190-44b76838c67a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:50.524129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2acd2-aca7-4645-9190-44b76838c67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:50.526793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2acd2-aca7-4645-9190-44b76838c67a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:50.608988 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3920/7829] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:50 2022] POST /identity/v3/projects => generated 401 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:50.612994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8003-9775-4c51-b576-176ed06acbe6 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:50.629386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8003-9775-4c51-b576-176ed06acbe6 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:50.762941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77a07-104d-466d-878f-b7a70ff30d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:50.763658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77a07-104d-466d-878f-b7a70ff30d90 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:50.763992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77a07-104d-466d-878f-b7a70ff30d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:50.764271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77a07-104d-466d-878f-b7a70ff30d90 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:50.765009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77a07-104d-466d-878f-b7a70ff30d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:50.768235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77a07-104d-466d-878f-b7a70ff30d90 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:50.804470 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3910/7830] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:50 2022] POST /identity/v3/users => generated 307 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:50.805930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2acd2-aca7-4645-9190-44b76838c67a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:50.820856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2acd2-aca7-4645-9190-44b76838c67a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:50.827731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e794bb-01e1-4a26-b93a-48e26f857cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:50.829053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e794bb-01e1-4a26-b93a-48e26f857cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:50.829600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e794bb-01e1-4a26-b93a-48e26f857cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:50.830366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e794bb-01e1-4a26-b93a-48e26f857cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:50.831287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e794bb-01e1-4a26-b93a-48e26f857cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:50.833470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e794bb-01e1-4a26-b93a-48e26f857cf1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:50.848383 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3921/7831] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:50.852619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77a07-104d-466d-878f-b7a70ff30d90 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:50.873807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77a07-104d-466d-878f-b7a70ff30d90 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:50.886719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dceb0c-8e81-4908-a206-45623271855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:50.888449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dceb0c-8e81-4908-a206-45623271855c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:50.888999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dceb0c-8e81-4908-a206-45623271855c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:50.889498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dceb0c-8e81-4908-a206-45623271855c admin admin] PATH_INFO: `/v3/projects/dc2ee5f3a2fa487c8649a6da497530e9/users/33af21b30f7b4ae3bc355feafa813465/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:50.959928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dceb0c-8e81-4908-a206-45623271855c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2ee5f3a2fa487c8649a6da497530e9, user_id=33af21b30f7b4ae3bc355feafa813465, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:50.965487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dceb0c-8e81-4908-a206-45623271855c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:50.987888 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3911/7832] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:50 2022] PUT /identity/v3/projects/dc2ee5f3a2fa487c8649a6da497530e9/users/33af21b30f7b4ae3bc355feafa813465/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:50.991508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e794bb-01e1-4a26-b93a-48e26f857cf1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:51.004854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e794bb-01e1-4a26-b93a-48e26f857cf1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:51.087867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7920f1c-4912-4bcf-9056-4e4439e50821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:51.089113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920f1c-4912-4bcf-9056-4e4439e50821 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:51.090284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920f1c-4912-4bcf-9056-4e4439e50821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:51.090880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920f1c-4912-4bcf-9056-4e4439e50821 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:51.091924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7920f1c-4912-4bcf-9056-4e4439e50821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:51.093851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7920f1c-4912-4bcf-9056-4e4439e50821 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:51.110475 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3922/7833] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:51.115059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dceb0c-8e81-4908-a206-45623271855c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:51.128909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dceb0c-8e81-4908-a206-45623271855c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:51.137337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:51.138879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:51.139432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:51.140187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] PATH_INFO: `/v3/projects/dc2ee5f3a2fa487c8649a6da497530e9/users/33af21b30f7b4ae3bc355feafa813465/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:51.142954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2ee5f3a2fa487c8649a6da497530e9, user_id=33af21b30f7b4ae3bc355feafa813465, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:51.146220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:51.164419 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3912/7834] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:51 2022] PUT /identity/v3/projects/dc2ee5f3a2fa487c8649a6da497530e9/users/33af21b30f7b4ae3bc355feafa813465/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:51.260735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd0e27-9a41-4fee-8f1a-48b177a7ce42 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:51.261185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd0e27-9a41-4fee-8f1a-48b177a7ce42 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:51.262049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd0e27-9a41-4fee-8f1a-48b177a7ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:51.302718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e1fd0e27-9a41-4fee-8f1a-48b177a7ce42 None None] MFA Rules not processed for user `2ae717495d724ffd8e3c138fd0a939d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:51.304396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e1fd0e27-9a41-4fee-8f1a-48b177a7ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:51.497780 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3923/7835] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:51.499710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:51.505270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:51.652734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cfb0a-1f43-478b-a1fb-42ca4f9af452 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:51.660736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cda7b-0084-4577-89fb-5eac15653774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:51.665590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cda7b-0084-4577-89fb-5eac15653774 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:51.666141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cda7b-0084-4577-89fb-5eac15653774 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:51.666583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cda7b-0084-4577-89fb-5eac15653774 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:51.667461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cda7b-0084-4577-89fb-5eac15653774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:51.672936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cda7b-0084-4577-89fb-5eac15653774 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:51.707025 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3913/7836] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:51 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:18:51.708037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd0e27-9a41-4fee-8f1a-48b177a7ce42 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:51.733011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd0e27-9a41-4fee-8f1a-48b177a7ce42 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:51.738205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30918e2f-60ba-4a52-9826-e9759d4256f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:51.739101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30918e2f-60ba-4a52-9826-e9759d4256f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:51.739959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30918e2f-60ba-4a52-9826-e9759d4256f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:51.740448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30918e2f-60ba-4a52-9826-e9759d4256f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:51.741665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30918e2f-60ba-4a52-9826-e9759d4256f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:51.748832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30918e2f-60ba-4a52-9826-e9759d4256f4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:51.777187 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3924/7837] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:18:51.777417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cda7b-0084-4577-89fb-5eac15653774 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:51.790664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cda7b-0084-4577-89fb-5eac15653774 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:51.802810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4782d9-f46a-4b87-927c-983d14e6eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:51.804103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4782d9-f46a-4b87-927c-983d14e6eddf admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:51.806730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4782d9-f46a-4b87-927c-983d14e6eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:51.809505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4782d9-f46a-4b87-927c-983d14e6eddf admin admin] PATH_INFO: `/v3/system/users/5d20b914e0304e5fb0c80ce0a01d8098/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:51.831546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4782d9-f46a-4b87-927c-983d14e6eddf admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5d20b914e0304e5fb0c80ce0a01d8098, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:51.833225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4782d9-f46a-4b87-927c-983d14e6eddf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:51.844767 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3914/7838] 10.222.0.30 () {60 vars in 1377 bytes} [Sat Feb 19 21:18:51 2022] PUT /identity/v3/system/users/5d20b914e0304e5fb0c80ce0a01d8098/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:18:51.854109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06fe6-ba9c-4b9e-8cd7-532176206968 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:51.854475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06fe6-ba9c-4b9e-8cd7-532176206968 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:51.855015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06fe6-ba9c-4b9e-8cd7-532176206968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:51.899793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d2f06fe6-ba9c-4b9e-8cd7-532176206968 None None] MFA Rules not processed for user `5d20b914e0304e5fb0c80ce0a01d8098`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:51.901859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d2f06fe6-ba9c-4b9e-8cd7-532176206968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:52.064885 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3925/7839] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:51 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 19 21:18:52.065120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4782d9-f46a-4b87-927c-983d14e6eddf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:52.336027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4782d9-f46a-4b87-927c-983d14e6eddf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:52.419467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7ae5f-a486-4ada-9def-2f8b146d329b None tempest-ImageQuotaTest-301235512-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d20b914e0304e5fb0c80ce0a01d8098', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:52.420316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ae5f-a486-4ada-9def-2f8b146d329b None tempest-ImageQuotaTest-301235512-system-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:52.420748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ae5f-a486-4ada-9def-2f8b146d329b None tempest-ImageQuotaTest-301235512-system-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:52.421167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ae5f-a486-4ada-9def-2f8b146d329b None tempest-ImageQuotaTest-301235512-system-admin] PATH_INFO: `/v3/services` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:52.421959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7ae5f-a486-4ada-9def-2f8b146d329b None tempest-ImageQuotaTest-301235512-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:52.423594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7ae5f-a486-4ada-9def-2f8b146d329b None tempest-ImageQuotaTest-301235512-system-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:52.432317 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3915/7840] 10.222.0.30 () {58 vars in 1109 bytes} [Sat Feb 19 21:18:52 2022] GET /identity/v3/services => generated 2191 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:52.437567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f06fe6-ba9c-4b9e-8cd7-532176206968 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:52.671426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f06fe6-ba9c-4b9e-8cd7-532176206968 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:52.760581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d20b914e0304e5fb0c80ce0a01d8098', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:52.761973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:52.762568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:52.763775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] PATH_INFO: `/v3/limits` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:52.765657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:52.774314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:52.888055 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Feb 19 21:18:52.906574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7ae5f-a486-4ada-9def-2f8b146d329b None tempest-ImageQuotaTest-301235512-system-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:52.910450 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3926/7841] 10.222.0.30 () {60 vars in 1125 bytes} [Sat Feb 19 21:18:52 2022] POST /identity/v3/limits => generated 124 bytes in 473 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Feb 19 21:18:53.214111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7ae5f-a486-4ada-9def-2f8b146d329b None tempest-ImageQuotaTest-301235512-system-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:53.306367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb74f3-2542-436b-a9fd-770e74e95f30 None tempest-ImageQuotaTest-301235512-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d20b914e0304e5fb0c80ce0a01d8098', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:53.307223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb74f3-2542-436b-a9fd-770e74e95f30 None tempest-ImageQuotaTest-301235512-system-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:53.307514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb74f3-2542-436b-a9fd-770e74e95f30 None tempest-ImageQuotaTest-301235512-system-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:53.310127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb74f3-2542-436b-a9fd-770e74e95f30 None tempest-ImageQuotaTest-301235512-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:53.311011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb74f3-2542-436b-a9fd-770e74e95f30 None tempest-ImageQuotaTest-301235512-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:53.315712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb74f3-2542-436b-a9fd-770e74e95f30 None tempest-ImageQuotaTest-301235512-system-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:53.343425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:53.348387 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3916/7842] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 21:18:52 2022] GET /identity/v3/registered_limits => generated 129 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:53.609562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6f25-c56c-43a1-9e6d-ae13c9ee7c5f None tempest-ImageQuotaTest-301235512-system-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:53.709977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d20b914e0304e5fb0c80ce0a01d8098', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:53.711290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:53.712603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:53.713078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:53.716279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:53.718276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:53.726158 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3927/7843] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 21:18:53 2022] GET /identity/v3/registered_limits => generated 129 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:54.824667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e03a-ffcd-4f84-8ad5-ee2d3550b6fa None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:54.826133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e03a-ffcd-4f84-8ad5-ee2d3550b6fa None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:54.826762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e03a-ffcd-4f84-8ad5-ee2d3550b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:54.890553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b990e03a-ffcd-4f84-8ad5-ee2d3550b6fa None None] MFA Rules not processed for user `33af21b30f7b4ae3bc355feafa813465`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:54.891810 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b990e03a-ffcd-4f84-8ad5-ee2d3550b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:55.064234 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3917/7844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:56.657565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:56.660962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:56.721095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086835-f53a-40bf-9940-2b4ac2ab75c2 None tempest-ImageQuotaTest-301235512-system-admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:56.731298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:56.733428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:56.734198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:56.734597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] PATH_INFO: `/v3/users/9e5efb50ea6e41809bc46423cef86ce7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:56.736543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5efb50ea6e41809bc46423cef86ce7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:56.740884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:56.863355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5efb50ea6e41809bc46423cef86ce7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:56.864387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5efb50ea6e41809bc46423cef86ce7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:56.865487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5efb50ea6e41809bc46423cef86ce7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:56.895491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5efb50ea6e41809bc46423cef86ce7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:56.914290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5efb50ea6e41809bc46423cef86ce7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:56.934682 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3928/7845] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:56 2022] DELETE /identity/v3/users/9e5efb50ea6e41809bc46423cef86ce7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:56.940141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd462a-a934-4c91-b8db-64b09145ff95 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:56.940681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd462a-a934-4c91-b8db-64b09145ff95 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:56.940773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd462a-a934-4c91-b8db-64b09145ff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:56.970876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e4dd462a-a934-4c91-b8db-64b09145ff95 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:56.972128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e4dd462a-a934-4c91-b8db-64b09145ff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:57.085898 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3918/7846] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:57.107861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:57.109367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:57.239935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c5346-2566-4d48-a8d2-9421a60a6f72 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:57.251522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75102b-3594-4028-9861-41f56f6a08a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:57.252583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75102b-3594-4028-9861-41f56f6a08a4 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:57.253036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75102b-3594-4028-9861-41f56f6a08a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:57.253472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75102b-3594-4028-9861-41f56f6a08a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:57.274543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75102b-3594-4028-9861-41f56f6a08a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:57.276136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75102b-3594-4028-9861-41f56f6a08a4 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:57.302718 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3929/7847] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:18:58.256894 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd462a-a934-4c91-b8db-64b09145ff95 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:58.259001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e4dd462a-a934-4c91-b8db-64b09145ff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:58.272642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd462a-a934-4c91-b8db-64b09145ff95 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:58.279585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:58.281532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:58.281991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:58.282651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] PATH_INFO: `/v3/projects/17dcedea5c824fb1af2727789604388d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:58.285059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17dcedea5c824fb1af2727789604388d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:58.287812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:58.374602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17dcedea5c824fb1af2727789604388d', 'request_id': 'req-5a8c5387-823b-4004-9aa2-5105ac57c863'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.381016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17dcedea5c824fb1af2727789604388d', 'request_id': 'req-5a8c5387-823b-4004-9aa2-5105ac57c863'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.391752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17dcedea5c824fb1af2727789604388d', 'request_id': 'req-5a8c5387-823b-4004-9aa2-5105ac57c863'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.408657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] The token cache is being invalidate because project 17dcedea5c824fb1af2727789604388d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:58.409416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.410301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.412471 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3919/7848] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:58 2022] DELETE /identity/v3/projects/17dcedea5c824fb1af2727789604388d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:58.419858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c84dfb-7164-45ff-b90f-cafb869dbb7c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:58.420889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c84dfb-7164-45ff-b90f-cafb869dbb7c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:58.421580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c84dfb-7164-45ff-b90f-cafb869dbb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:58.443213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-57c84dfb-7164-45ff-b90f-cafb869dbb7c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:58.444858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-57c84dfb-7164-45ff-b90f-cafb869dbb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:58.497916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:58.499586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:58.537499 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3930/7849] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:58.546099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a395c1-e1f1-43d1-b119-5cc102a2048f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:58.546743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a395c1-e1f1-43d1-b119-5cc102a2048f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:58.547245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a395c1-e1f1-43d1-b119-5cc102a2048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:58.579502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-21a395c1-e1f1-43d1-b119-5cc102a2048f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:58.581282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-21a395c1-e1f1-43d1-b119-5cc102a2048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:58.586433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5387-823b-4004-9aa2-5105ac57c863 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:58.592493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:58.593384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:58.593667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:58.593941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] PATH_INFO: `/v3/users/d371dd124a54495987e2cf7e2e75d81c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:58.595166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d371dd124a54495987e2cf7e2e75d81c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:58.596496 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3931/7850] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:58.600245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a395c1-e1f1-43d1-b119-5cc102a2048f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:58.600472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:58.613244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a395c1-e1f1-43d1-b119-5cc102a2048f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:58.621369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:58.622787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:58.623301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:58.623822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:58.624822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:18:58.625464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:58.627783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:58.658115 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3932/7851] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:18:58.659831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:58.664109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd371dd124a54495987e2cf7e2e75d81c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.673507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ec421-9c35-4856-91c8-9751210b7205 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:58.679223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd371dd124a54495987e2cf7e2e75d81c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.680590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7c2e-2f63-4176-b70e-c911ad65a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:58.681592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7c2e-2f63-4176-b70e-c911ad65a303 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:58.682358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7c2e-2f63-4176-b70e-c911ad65a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:58.682890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7c2e-2f63-4176-b70e-c911ad65a303 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:58.685063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7c2e-2f63-4176-b70e-c911ad65a303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:58.688628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7c2e-2f63-4176-b70e-c911ad65a303 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:58.688808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd371dd124a54495987e2cf7e2e75d81c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.689525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd371dd124a54495987e2cf7e2e75d81c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.690212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd371dd124a54495987e2cf7e2e75d81c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:58.710927 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3920/7852] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:58 2022] DELETE /identity/v3/users/d371dd124a54495987e2cf7e2e75d81c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:18:58.731199 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3933/7853] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:58 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:58.736261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:58.737745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:58.828555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b4c70-b971-44ac-9518-b390c6eb4b68 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:58.895559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6441ba-e437-4644-82b3-d293ffa82c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:58.896494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6441ba-e437-4644-82b3-d293ffa82c08 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:58.896795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6441ba-e437-4644-82b3-d293ffa82c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:58.897163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6441ba-e437-4644-82b3-d293ffa82c08 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:58.898341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6441ba-e437-4644-82b3-d293ffa82c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:58.901203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6441ba-e437-4644-82b3-d293ffa82c08 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:58.942352 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3921/7854] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:58 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:58.943734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7c2e-2f63-4176-b70e-c911ad65a303 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:58.956670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7c2e-2f63-4176-b70e-c911ad65a303 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:58.963386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a76a1-48aa-4e39-9be4-04a33b887a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:58.964922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a76a1-48aa-4e39-9be4-04a33b887a34 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:58.965416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a76a1-48aa-4e39-9be4-04a33b887a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:58.965913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a76a1-48aa-4e39-9be4-04a33b887a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:58.966872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a76a1-48aa-4e39-9be4-04a33b887a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:58.970212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a76a1-48aa-4e39-9be4-04a33b887a34 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:58.995193 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3934/7855] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:58.997320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6441ba-e437-4644-82b3-d293ffa82c08 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.008742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6441ba-e437-4644-82b3-d293ffa82c08 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:59.015868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e012c-5d37-42b8-979e-41c2e37413dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:59.017125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e012c-5d37-42b8-979e-41c2e37413dc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.017669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e012c-5d37-42b8-979e-41c2e37413dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.018188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e012c-5d37-42b8-979e-41c2e37413dc admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.019149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e012c-5d37-42b8-979e-41c2e37413dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:59.021416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e012c-5d37-42b8-979e-41c2e37413dc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:59.039486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a76a1-48aa-4e39-9be4-04a33b887a34 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.041755 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3922/7856] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:18:59.053006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a76a1-48aa-4e39-9be4-04a33b887a34 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:59.060946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:59.062340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.062680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.063033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] PATH_INFO: `/v3/projects/aa41be43da9d4980856afd410a9daa9d/users/1343d994837d4804b6ae4331dd3153ee/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.089021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa41be43da9d4980856afd410a9daa9d, user_id=1343d994837d4804b6ae4331dd3153ee, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:59.093129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:59.146682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e732a0-5900-489f-867b-b4828e5e24f0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.147108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e732a0-5900-489f-867b-b4828e5e24f0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.147479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e732a0-5900-489f-867b-b4828e5e24f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.149597 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3935/7857] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:59 2022] PUT /identity/v3/projects/aa41be43da9d4980856afd410a9daa9d/users/1343d994837d4804b6ae4331dd3153ee/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:18:59.193525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-00e732a0-5900-489f-867b-b4828e5e24f0 None None] MFA Rules not processed for user `1343d994837d4804b6ae4331dd3153ee`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:18:59.195656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00e732a0-5900-489f-867b-b4828e5e24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:59.257845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.260963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:59.330221 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3923/7858] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:18:59.332155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e732a0-5900-489f-867b-b4828e5e24f0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.431103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c177e-6e6d-4c2e-a064-226d5d9e5e80 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:59.438039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:59.439274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.439764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.440310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] PATH_INFO: `/v3/projects/84ae0d8feb2c43e59091ce4925eb8bb2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.442180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ae0d8feb2c43e59091ce4925eb8bb2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:59.444285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:59.477770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e732a0-5900-489f-867b-b4828e5e24f0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:59.489408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bce7f-58fa-4863-8ef4-afc543e171cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:59.492735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bce7f-58fa-4863-8ef4-afc543e171cb admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.493123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bce7f-58fa-4863-8ef4-afc543e171cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.493480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bce7f-58fa-4863-8ef4-afc543e171cb admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.494278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bce7f-58fa-4863-8ef4-afc543e171cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:59.497594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bce7f-58fa-4863-8ef4-afc543e171cb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:59.521633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ae0d8feb2c43e59091ce4925eb8bb2', 'request_id': 'req-0d043f56-0ccd-4190-904f-e2d54c3364b8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.538469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ae0d8feb2c43e59091ce4925eb8bb2', 'request_id': 'req-0d043f56-0ccd-4190-904f-e2d54c3364b8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.553174 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3924/7859] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:18:59 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:59.554205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bce7f-58fa-4863-8ef4-afc543e171cb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.563188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ae0d8feb2c43e59091ce4925eb8bb2', 'request_id': 'req-0d043f56-0ccd-4190-904f-e2d54c3364b8'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.581828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] The token cache is being invalidate because project 84ae0d8feb2c43e59091ce4925eb8bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:18:59.584092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.586612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.593174 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3936/7860] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:18:59 2022] DELETE /identity/v3/projects/84ae0d8feb2c43e59091ce4925eb8bb2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:59.597985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.599652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:59.697377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bce7f-58fa-4863-8ef4-afc543e171cb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:59.708879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:59.710331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.710898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.712588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.714804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:59.718142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:59.740369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043f56-0ccd-4190-904f-e2d54c3364b8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:59.756133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:59.756846 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3925/7861] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:18:59 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:18:59.757076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.757356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.757636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] PATH_INFO: `/v3/users/33af21b30f7b4ae3bc355feafa813465` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.758464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.760751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=33af21b30f7b4ae3bc355feafa813465)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:59.762198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:59.763201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:59.776978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239469f6-79d8-4166-8de9-752d3c5a90b0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:59.783910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6d40-77a4-45d3-9379-6f54aa81332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:59.785162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6d40-77a4-45d3-9379-6f54aa81332b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.785554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6d40-77a4-45d3-9379-6f54aa81332b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.785939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6d40-77a4-45d3-9379-6f54aa81332b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.787080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6d40-77a4-45d3-9379-6f54aa81332b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:59.789156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6d40-77a4-45d3-9379-6f54aa81332b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:59.806502 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3926/7862] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:18:59.807546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6d40-77a4-45d3-9379-6f54aa81332b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.820820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6d40-77a4-45d3-9379-6f54aa81332b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:18:59.828512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:18:59.829595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:18:59.830033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:18:59.830556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] PATH_INFO: `/v3/projects/d71bfb76699941158ce3ebc36623c51d/users/edbbccd7f68b49c1ad0386919f2903bf/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:18:59.870641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71bfb76699941158ce3ebc36623c51d, user_id=edbbccd7f68b49c1ad0386919f2903bf, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:18:59.877454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:18:59.883000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33af21b30f7b4ae3bc355feafa813465'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.883706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33af21b30f7b4ae3bc355feafa813465'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.884378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33af21b30f7b4ae3bc355feafa813465'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.911880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33af21b30f7b4ae3bc355feafa813465'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.913437 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3927/7863] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:18:59 2022] PUT /identity/v3/projects/d71bfb76699941158ce3ebc36623c51d/users/edbbccd7f68b49c1ad0386919f2903bf/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:18:59.919038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:18:59.922065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:18:59.924474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33af21b30f7b4ae3bc355feafa813465'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:18:59.982255 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3937/7864] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:18:59 2022] DELETE /identity/v3/users/33af21b30f7b4ae3bc355feafa813465 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:00.040405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d138c4-2a02-4436-a21d-b758651cdd18 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:00.120056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775153d-f8a5-4a5e-b5db-20fc1f1941bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:00.122326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775153d-f8a5-4a5e-b5db-20fc1f1941bf admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:00.122803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775153d-f8a5-4a5e-b5db-20fc1f1941bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:00.123245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775153d-f8a5-4a5e-b5db-20fc1f1941bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:00.124202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775153d-f8a5-4a5e-b5db-20fc1f1941bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:00.126018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775153d-f8a5-4a5e-b5db-20fc1f1941bf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:00.139153 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3928/7865] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:19:00.143172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:00.154813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d875d90-9413-44ae-82f0-3904728f9acc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:00.160040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:00.161047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:00.161393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:00.161735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] PATH_INFO: `/v3/projects/d71bfb76699941158ce3ebc36623c51d/users/edbbccd7f68b49c1ad0386919f2903bf/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:00.164246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71bfb76699941158ce3ebc36623c51d, user_id=edbbccd7f68b49c1ad0386919f2903bf, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:00.168617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:00.187367 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3938/7866] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:00 2022] PUT /identity/v3/projects/d71bfb76699941158ce3ebc36623c51d/users/edbbccd7f68b49c1ad0386919f2903bf/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:00.200359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dceb1-56f0-4d14-984c-fbf31bdf7460 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:00.200787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dceb1-56f0-4d14-984c-fbf31bdf7460 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:00.201166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dceb1-56f0-4d14-984c-fbf31bdf7460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:00.235285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0a3dceb1-56f0-4d14-984c-fbf31bdf7460 None None] MFA Rules not processed for user `edbbccd7f68b49c1ad0386919f2903bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:00.236922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0a3dceb1-56f0-4d14-984c-fbf31bdf7460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:00.340362 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3929/7867] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:00.352296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:00.354442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:00.453027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a740-36a4-47ce-8274-c9f51d62cdcb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:00.458789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed31b2-8701-409f-8855-20948cdb8cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:00.459809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed31b2-8701-409f-8855-20948cdb8cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:00.460360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed31b2-8701-409f-8855-20948cdb8cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:00.461655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed31b2-8701-409f-8855-20948cdb8cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:00.474377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed31b2-8701-409f-8855-20948cdb8cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:00.477304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed31b2-8701-409f-8855-20948cdb8cd0 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:00.489585 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3939/7868] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:00 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:00.605919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dceb1-56f0-4d14-984c-fbf31bdf7460 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:00.607579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0a3dceb1-56f0-4d14-984c-fbf31bdf7460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:00.727333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dceb1-56f0-4d14-984c-fbf31bdf7460 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:00.732629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed31b2-8701-409f-8855-20948cdb8cd0 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:00.743945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:00.745024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:00.745312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:00.746150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] PATH_INFO: `/v3/projects/dc2ee5f3a2fa487c8649a6da497530e9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:00.746382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed31b2-8701-409f-8855-20948cdb8cd0 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:00.748005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2ee5f3a2fa487c8649a6da497530e9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:00.749992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:00.751877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:00.752774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:00.753049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:00.753326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] PATH_INFO: `/v3/users/1343d994837d4804b6ae4331dd3153ee` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:00.754786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1343d994837d4804b6ae4331dd3153ee)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:00.757083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:00.815937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2ee5f3a2fa487c8649a6da497530e9', 'request_id': 'req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.822670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2ee5f3a2fa487c8649a6da497530e9', 'request_id': 'req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.855224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2ee5f3a2fa487c8649a6da497530e9', 'request_id': 'req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.874539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1343d994837d4804b6ae4331dd3153ee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.875288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] The token cache is being invalidate because project dc2ee5f3a2fa487c8649a6da497530e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:00.875581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.876301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1343d994837d4804b6ae4331dd3153ee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.876886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a3950dc9-5302-48ac-ba7b-f6b8e01fdade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.877452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1343d994837d4804b6ae4331dd3153ee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.882589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3930/7869] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:00 2022] DELETE /identity/v3/projects/dc2ee5f3a2fa487c8649a6da497530e9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:00.887962 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d12e-0542-4e4a-824b-f62cf6def0b3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:00.888210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d12e-0542-4e4a-824b-f62cf6def0b3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:00.889048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d12e-0542-4e4a-824b-f62cf6def0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:00.912189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1343d994837d4804b6ae4331dd3153ee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.929051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5328cc3b-fdd3-4abe-8a17-094bfb392b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1343d994837d4804b6ae4331dd3153ee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:00.939425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8e52d12e-0542-4e4a-824b-f62cf6def0b3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:00.943150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8e52d12e-0542-4e4a-824b-f62cf6def0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:00.959964 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3940/7870] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:00 2022] DELETE /identity/v3/users/1343d994837d4804b6ae4331dd3153ee => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:00.965423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43806b1-41d5-4042-b30c-19f05a2139a5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:00.965941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43806b1-41d5-4042-b30c-19f05a2139a5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:00.966215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43806b1-41d5-4042-b30c-19f05a2139a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.008551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c43806b1-41d5-4042-b30c-19f05a2139a5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:01.013730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c43806b1-41d5-4042-b30c-19f05a2139a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:01.048197 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3931/7871] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:01.067838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538243e4-4d7f-4ce9-9b93-0df784d8d762 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.075498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538243e4-4d7f-4ce9-9b93-0df784d8d762 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.076636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538243e4-4d7f-4ce9-9b93-0df784d8d762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.132401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-538243e4-4d7f-4ce9-9b93-0df784d8d762 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:01.138210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-538243e4-4d7f-4ce9-9b93-0df784d8d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:01.165293 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3941/7872] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:01.185975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43806b1-41d5-4042-b30c-19f05a2139a5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.187739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c43806b1-41d5-4042-b30c-19f05a2139a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:01.278522 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3932/7873] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:01.282876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538243e4-4d7f-4ce9-9b93-0df784d8d762 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.299871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43806b1-41d5-4042-b30c-19f05a2139a5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:01.302660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538243e4-4d7f-4ce9-9b93-0df784d8d762 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:01.310346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d6a57-57db-48ee-893e-dcae756adbbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:01.311189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d6a57-57db-48ee-893e-dcae756adbbd service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.311473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d6a57-57db-48ee-893e-dcae756adbbd service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.311757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d6a57-57db-48ee-893e-dcae756adbbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.315410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:01.316111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.316418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.316698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.317458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:01.317767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:01.322851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:01.345184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d6a57-57db-48ee-893e-dcae756adbbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:01.346730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d6a57-57db-48ee-893e-dcae756adbbd service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:01.363072 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3933/7874] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:01.368677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.372176 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3942/7875] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:01.383385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a4a01-1112-4a14-ad8e-e83b00856187 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:01.389743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46424f38-692f-41b6-8269-59d69bb1e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:01.391976 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424f38-692f-41b6-8269-59d69bb1e774 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.392551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424f38-692f-41b6-8269-59d69bb1e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.392997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424f38-692f-41b6-8269-59d69bb1e774 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.393902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46424f38-692f-41b6-8269-59d69bb1e774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:01.396219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46424f38-692f-41b6-8269-59d69bb1e774 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:01.455925 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3934/7876] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:01 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:01.460656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d6a57-57db-48ee-893e-dcae756adbbd service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.476580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d6a57-57db-48ee-893e-dcae756adbbd service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:01.559888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b12d7-7333-4cb4-b86a-836a2c691005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:01.560673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b12d7-7333-4cb4-b86a-836a2c691005 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.560963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b12d7-7333-4cb4-b86a-836a2c691005 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.561301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b12d7-7333-4cb4-b86a-836a2c691005 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.562005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b12d7-7333-4cb4-b86a-836a2c691005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:01.564595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b12d7-7333-4cb4-b86a-836a2c691005 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:01.600713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3943/7877] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:01 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:01.605173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46424f38-692f-41b6-8269-59d69bb1e774 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.619525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46424f38-692f-41b6-8269-59d69bb1e774 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:01.629910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788c3d4-6174-4307-ac23-19064f7892ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:01.629910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c3d4-6174-4307-ac23-19064f7892ec admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.629910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c3d4-6174-4307-ac23-19064f7892ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.629910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c3d4-6174-4307-ac23-19064f7892ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.630378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788c3d4-6174-4307-ac23-19064f7892ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:01.632202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788c3d4-6174-4307-ac23-19064f7892ec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:01.653823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b12d7-7333-4cb4-b86a-836a2c691005 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.661809 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3935/7878] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:01.666351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b12d7-7333-4cb4-b86a-836a2c691005 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:01.675757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef91dad-5fbd-4f8a-8e29-d8480d95688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:01.676490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91dad-5fbd-4f8a-8e29-d8480d95688b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.676785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91dad-5fbd-4f8a-8e29-d8480d95688b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.677057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91dad-5fbd-4f8a-8e29-d8480d95688b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.678195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef91dad-5fbd-4f8a-8e29-d8480d95688b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:01.680251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef91dad-5fbd-4f8a-8e29-d8480d95688b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:01.735912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788c3d4-6174-4307-ac23-19064f7892ec admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.740516 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3944/7879] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:01.747166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788c3d4-6174-4307-ac23-19064f7892ec admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:01.752733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:01.753802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.754162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.754520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] PATH_INFO: `/v3/projects/7e8d8b358e3c44ffa1b22a4cc1214467/users/77fc4361ba2645d3b4d1ef3977fe9e31/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.772512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8d8b358e3c44ffa1b22a4cc1214467, user_id=77fc4361ba2645d3b4d1ef3977fe9e31, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:01.776127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:01.793465 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3936/7880] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:01 2022] PUT /identity/v3/projects/7e8d8b358e3c44ffa1b22a4cc1214467/users/77fc4361ba2645d3b4d1ef3977fe9e31/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:01.807529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aadb8b-6193-47a4-8bc7-4c5f32dcd995 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.807894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aadb8b-6193-47a4-8bc7-4c5f32dcd995 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.808848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aadb8b-6193-47a4-8bc7-4c5f32dcd995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.823458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.828569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:01.856165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f1aadb8b-6193-47a4-8bc7-4c5f32dcd995 None None] MFA Rules not processed for user `77fc4361ba2645d3b4d1ef3977fe9e31`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:01.857943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f1aadb8b-6193-47a4-8bc7-4c5f32dcd995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:01.925788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70d2b-6324-41f4-a7e0-8d3cb907e390 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:01.933799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:01.935104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:01.935664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:01.935954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] PATH_INFO: `/v3/users/2ae717495d724ffd8e3c138fd0a939d8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:01.938121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae717495d724ffd8e3c138fd0a939d8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:01.940679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:01.967760 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3945/7881] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:01.973183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aadb8b-6193-47a4-8bc7-4c5f32dcd995 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:01.992613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aadb8b-6193-47a4-8bc7-4c5f32dcd995 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.000286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.001007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.001285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.001558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.002463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.004445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.018002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae717495d724ffd8e3c138fd0a939d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.032490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae717495d724ffd8e3c138fd0a939d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.041069 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3946/7882] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:01 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:02.041918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae717495d724ffd8e3c138fd0a939d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.044090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae717495d724ffd8e3c138fd0a939d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.045548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae717495d724ffd8e3c138fd0a939d8'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.046468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.048308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:02.060104 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3937/7883] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:01 2022] DELETE /identity/v3/users/2ae717495d724ffd8e3c138fd0a939d8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:02.123354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea01329-b9ce-4a0f-a592-478a4974f11a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.187229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3ca9-ec03-461d-a33f-dd2a97231aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.188466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3ca9-ec03-461d-a33f-dd2a97231aee admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.188466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3ca9-ec03-461d-a33f-dd2a97231aee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.188466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3ca9-ec03-461d-a33f-dd2a97231aee admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.189542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3ca9-ec03-461d-a33f-dd2a97231aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.191627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3ca9-ec03-461d-a33f-dd2a97231aee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.222046 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3947/7884] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:02 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:02.223037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.238076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173cb8a-a5d8-4a0b-8053-80dce8c55b1f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.243694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.244841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.245206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.245601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.246428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.248421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.261746 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3938/7885] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:19:02.268227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3ca9-ec03-461d-a33f-dd2a97231aee admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.279925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.281877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:02.282336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3ca9-ec03-461d-a33f-dd2a97231aee admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.287601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b882248-45e6-4f84-bdf0-aee7cd2f3093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.288883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b882248-45e6-4f84-bdf0-aee7cd2f3093 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.289166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b882248-45e6-4f84-bdf0-aee7cd2f3093 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.289439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b882248-45e6-4f84-bdf0-aee7cd2f3093 admin admin] PATH_INFO: `/v3/projects/cea3f3454bac4f4f9c2586f67cb2eb64/users/b3b40dc937ca49b68f588cb148d9259a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.308137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b882248-45e6-4f84-bdf0-aee7cd2f3093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea3f3454bac4f4f9c2586f67cb2eb64, user_id=b3b40dc937ca49b68f588cb148d9259a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.312047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b882248-45e6-4f84-bdf0-aee7cd2f3093 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.323322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e1182-943b-4296-89d2-870bb6e64f69 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.336416 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3948/7886] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:02 2022] PUT /identity/v3/projects/cea3f3454bac4f4f9c2586f67cb2eb64/users/b3b40dc937ca49b68f588cb148d9259a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:02.338736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b882248-45e6-4f84-bdf0-aee7cd2f3093 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.397253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.398187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.398471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.398752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] PATH_INFO: `/v3/projects/03b2d1224b644f36aa3f9a7636a9cef5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.399984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b2d1224b644f36aa3f9a7636a9cef5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.402561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.409731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b882248-45e6-4f84-bdf0-aee7cd2f3093 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.430118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb806-5de2-417d-9a81-5fc40416080d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.431360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb806-5de2-417d-9a81-5fc40416080d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.431360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb806-5de2-417d-9a81-5fc40416080d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.431708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb806-5de2-417d-9a81-5fc40416080d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.433869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfb806-5de2-417d-9a81-5fc40416080d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.435646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfb806-5de2-417d-9a81-5fc40416080d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.472802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b2d1224b644f36aa3f9a7636a9cef5', 'request_id': 'req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.473706 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3949/7887] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:02.476433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb806-5de2-417d-9a81-5fc40416080d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.479873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b2d1224b644f36aa3f9a7636a9cef5', 'request_id': 'req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.490265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b2d1224b644f36aa3f9a7636a9cef5', 'request_id': 'req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.502812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb806-5de2-417d-9a81-5fc40416080d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.504627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] The token cache is being invalidate because project 03b2d1224b644f36aa3f9a7636a9cef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:02.504996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.505735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.507836 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3939/7888] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:02 2022] DELETE /identity/v3/projects/03b2d1224b644f36aa3f9a7636a9cef5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:02.512950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.520255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:02.609561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.610617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.611011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.611371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] PATH_INFO: `/v3/projects/cea3f3454bac4f4f9c2586f67cb2eb64/users/b3b40dc937ca49b68f588cb148d9259a/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.614312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea3f3454bac4f4f9c2586f67cb2eb64, user_id=b3b40dc937ca49b68f588cb148d9259a, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.618020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.625256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa5e9c-e514-43a8-9a31-2b18269b12ce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.631440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3950/7889] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:02 2022] PUT /identity/v3/projects/cea3f3454bac4f4f9c2586f67cb2eb64/users/b3b40dc937ca49b68f588cb148d9259a/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:02.633291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.635174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:02.711348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.712237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.712724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.713000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] PATH_INFO: `/v3/users/5d20b914e0304e5fb0c80ce0a01d8098` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.715161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d20b914e0304e5fb0c80ce0a01d8098)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.717150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.723954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1d0fe-4681-4185-977a-e0df7915c40c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.739806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.741915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.741915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.741915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] PATH_INFO: `/v3/projects/aa41be43da9d4980856afd410a9daa9d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.743659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa41be43da9d4980856afd410a9daa9d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:02.745492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:02.791067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d20b914e0304e5fb0c80ce0a01d8098'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.800546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa41be43da9d4980856afd410a9daa9d', 'request_id': 'req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.813041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d20b914e0304e5fb0c80ce0a01d8098'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.813426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa41be43da9d4980856afd410a9daa9d', 'request_id': 'req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.822063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa41be43da9d4980856afd410a9daa9d', 'request_id': 'req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.827154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d20b914e0304e5fb0c80ce0a01d8098'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.827930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d20b914e0304e5fb0c80ce0a01d8098'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.828859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d20b914e0304e5fb0c80ce0a01d8098'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.835866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] The token cache is being invalidate because project aa41be43da9d4980856afd410a9daa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:02.836158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.837165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2b6b27a5-873a-4baf-9b3b-0fafa1d40cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:02.838821 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3951/7890] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:02 2022] DELETE /identity/v3/projects/aa41be43da9d4980856afd410a9daa9d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:02.840943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3890-217b-4fc5-a2aa-79fcd717b37c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:02.841080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3890-217b-4fc5-a2aa-79fcd717b37c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:02.841289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3890-217b-4fc5-a2aa-79fcd717b37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:02.845831 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3940/7891] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:02 2022] DELETE /identity/v3/users/5d20b914e0304e5fb0c80ce0a01d8098 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:02.846837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:02.849528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:02.875990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-77ae3890-217b-4fc5-a2aa-79fcd717b37c None None] MFA Rules not processed for user `b3b40dc937ca49b68f588cb148d9259a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:02.878707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-77ae3890-217b-4fc5-a2aa-79fcd717b37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:02.983101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05111ddd-2579-498d-8fa5-76c61d81295d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:02.993517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:02.999031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:03.000939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:03.001503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] PATH_INFO: `/v3/users/edbbccd7f68b49c1ad0386919f2903bf` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:03.002046 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3952/7892] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:03.005555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbbccd7f68b49c1ad0386919f2903bf)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:03.010920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:03.013683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae3890-217b-4fc5-a2aa-79fcd717b37c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:03.015554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-77ae3890-217b-4fc5-a2aa-79fcd717b37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:03.117707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbbccd7f68b49c1ad0386919f2903bf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:03.140863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbbccd7f68b49c1ad0386919f2903bf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:03.151181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbbccd7f68b49c1ad0386919f2903bf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:03.152140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbbccd7f68b49c1ad0386919f2903bf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:03.153354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbbccd7f68b49c1ad0386919f2903bf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:03.165018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae3890-217b-4fc5-a2aa-79fcd717b37c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:03.169130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:03.169802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:03.170181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:03.170537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:03.172688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:03.177610 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3941/7893] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:02 2022] DELETE /identity/v3/users/edbbccd7f68b49c1ad0386919f2903bf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:03.194701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:03.196770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:03.214711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3953/7894] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:03.264507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:03.265937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:03.358470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d06bca-00d5-4ac9-bfe3-7914741cc85a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:03.364054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:03.366644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:03.367064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:03.367313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:03.371763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:03.478338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:03.486948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:03.499243 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3942/7895] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:03.810657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:03.812094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:03.836710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e200743-1f6d-4dc3-b045-83f651e3229d service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:03.915450 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:03.918567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:03.931788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9ae62-5fd3-4305-97fc-f368e3970936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:03.933399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ae62-5fd3-4305-97fc-f368e3970936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:03.934897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ae62-5fd3-4305-97fc-f368e3970936 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:03.935493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ae62-5fd3-4305-97fc-f368e3970936 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:03.950262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9ae62-5fd3-4305-97fc-f368e3970936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:03.952473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9ae62-5fd3-4305-97fc-f368e3970936 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:03.974741 ncdv-master-1 devstack@keystone.service[96909]: WARNING keystone.server.flask.application [None req-dfc9ae62-5fd3-4305-97fc-f368e3970936 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Feb 19 21:19:03.982265 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3954/7896] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 21:19:03 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 19 21:19:03.984243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ef463-9d10-47b3-91ed-c5735b6522b3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:03.984829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ef463-9d10-47b3-91ed-c5735b6522b3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:03.985207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ef463-9d10-47b3-91ed-c5735b6522b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.013616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0c0ef463-9d10-47b3-91ed-c5735b6522b3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:04.015589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0c0ef463-9d10-47b3-91ed-c5735b6522b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.037103 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3955/7897] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:04.040956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995c20d-0a60-429a-b2a7-6597b07e6ecf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.041243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995c20d-0a60-429a-b2a7-6597b07e6ecf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.043371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995c20d-0a60-429a-b2a7-6597b07e6ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.066770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6995c20d-0a60-429a-b2a7-6597b07e6ecf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:04.067533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50c3dd-d059-41b7-9fa4-c548f67f4570 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.068698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6995c20d-0a60-429a-b2a7-6597b07e6ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.076893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.078237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.080032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.080441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] PATH_INFO: `/v3/users/db4490bff7fd4b16b669a896ed9bf6e7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.082033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4490bff7fd4b16b669a896ed9bf6e7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.084159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.089449 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3956/7898] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:04.093673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995c20d-0a60-429a-b2a7-6597b07e6ecf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.109948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995c20d-0a60-429a-b2a7-6597b07e6ecf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.115029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.115777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.116145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.116540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.117361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:04.117771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.121453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.142373 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3957/7899] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:19:04.142373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.142373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.160465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8db24-1dc9-42be-a123-78fe577657a9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.163510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4490bff7fd4b16b669a896ed9bf6e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.165903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.166994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.167498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.167781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] PATH_INFO: `/v3/projects/d71bfb76699941158ce3ebc36623c51d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.169223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71bfb76699941158ce3ebc36623c51d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.171413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.182212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4490bff7fd4b16b669a896ed9bf6e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.192778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4490bff7fd4b16b669a896ed9bf6e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.193393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4490bff7fd4b16b669a896ed9bf6e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.194192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4490bff7fd4b16b669a896ed9bf6e7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.210441 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3943/7900] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:03 2022] DELETE /identity/v3/users/db4490bff7fd4b16b669a896ed9bf6e7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:04.211055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.212441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.229512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71bfb76699941158ce3ebc36623c51d', 'request_id': 'req-0698c0c7-e54c-471b-96c5-ce5200e10329'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.235463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71bfb76699941158ce3ebc36623c51d', 'request_id': 'req-0698c0c7-e54c-471b-96c5-ce5200e10329'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.248665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71bfb76699941158ce3ebc36623c51d', 'request_id': 'req-0698c0c7-e54c-471b-96c5-ce5200e10329'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.260908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] The token cache is being invalidate because project d71bfb76699941158ce3ebc36623c51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:04.261797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.262697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0698c0c7-e54c-471b-96c5-ce5200e10329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:04.266006 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3958/7901] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:04 2022] DELETE /identity/v3/projects/d71bfb76699941158ce3ebc36623c51d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:04.267031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75470bb-671e-4aa0-ae53-c6c18e360062 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.267316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75470bb-671e-4aa0-ae53-c6c18e360062 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.267593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75470bb-671e-4aa0-ae53-c6c18e360062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.286698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e75470bb-671e-4aa0-ae53-c6c18e360062 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:04.288869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e75470bb-671e-4aa0-ae53-c6c18e360062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.292281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccbea8-1815-49fa-b429-4b4903f46d44 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.365080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bb81a-572e-454c-9631-156a997e7099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.366151 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb81a-572e-454c-9631-156a997e7099 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.366543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb81a-572e-454c-9631-156a997e7099 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.366942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb81a-572e-454c-9631-156a997e7099 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.367908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bb81a-572e-454c-9631-156a997e7099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.371984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bb81a-572e-454c-9631-156a997e7099 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.376085 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3959/7902] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:04.377658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357105-4f14-48ee-9c29-d3c87d72e4ca None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.377949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357105-4f14-48ee-9c29-d3c87d72e4ca None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.378226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357105-4f14-48ee-9c29-d3c87d72e4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.409272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7f357105-4f14-48ee-9c29-d3c87d72e4ca None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:04.410911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7f357105-4f14-48ee-9c29-d3c87d72e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.431398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3960/7903] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:04.431398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357105-4f14-48ee-9c29-d3c87d72e4ca None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.431398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7f357105-4f14-48ee-9c29-d3c87d72e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.452349 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3944/7904] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:04.454999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9905-37b1-4c4d-90b8-f739ef15e134 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.455530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9905-37b1-4c4d-90b8-f739ef15e134 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.456044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9905-37b1-4c4d-90b8-f739ef15e134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.494299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9a1d9905-37b1-4c4d-90b8-f739ef15e134 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:04.497197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9a1d9905-37b1-4c4d-90b8-f739ef15e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.503781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357105-4f14-48ee-9c29-d3c87d72e4ca None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.567049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f76d6-c71d-41f6-b653-8d06fae211ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.567874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f76d6-c71d-41f6-b653-8d06fae211ba service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.568857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f76d6-c71d-41f6-b653-8d06fae211ba service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.569434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f76d6-c71d-41f6-b653-8d06fae211ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.618437 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3945/7905] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:04.620102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d9905-37b1-4c4d-90b8-f739ef15e134 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.622974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9a1d9905-37b1-4c4d-90b8-f739ef15e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.638137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d9905-37b1-4c4d-90b8-f739ef15e134 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.644591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480eb84-b20f-4c61-a025-eb278834bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.645273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480eb84-b20f-4c61-a025-eb278834bf7d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.645558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480eb84-b20f-4c61-a025-eb278834bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.645838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480eb84-b20f-4c61-a025-eb278834bf7d admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.646534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480eb84-b20f-4c61-a025-eb278834bf7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.648487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480eb84-b20f-4c61-a025-eb278834bf7d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.651275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f76d6-c71d-41f6-b653-8d06fae211ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.653603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f76d6-c71d-41f6-b653-8d06fae211ba service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.668663 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3961/7906] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:04.670904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f76d6-c71d-41f6-b653-8d06fae211ba service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.676542 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3946/7907] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/users => generated 290 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:04.682432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480eb84-b20f-4c61-a025-eb278834bf7d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.696557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f76d6-c71d-41f6-b653-8d06fae211ba service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.704351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480eb84-b20f-4c61-a025-eb278834bf7d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.706464 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.707666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.708310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.708917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.711987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf3a7-8e05-44bd-b12d-a78314bcd6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.711987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf3a7-8e05-44bd-b12d-a78314bcd6cb admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.711987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf3a7-8e05-44bd-b12d-a78314bcd6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.711987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf3a7-8e05-44bd-b12d-a78314bcd6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.712662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8adf3a7-8e05-44bd-b12d-a78314bcd6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.713525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8adf3a7-8e05-44bd-b12d-a78314bcd6cb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.715209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:04.715730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.717705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.734718 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3962/7908] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:04.735695 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3947/7909] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:19:04.739517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.740177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf3a7-8e05-44bd-b12d-a78314bcd6cb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.751228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf3a7-8e05-44bd-b12d-a78314bcd6cb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.752477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965788c5-ead4-4103-9180-a896a6abb8a1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.757300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde779f-af50-4805-a69f-31d1e3e445a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.758339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde779f-af50-4805-a69f-31d1e3e445a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.758815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde779f-af50-4805-a69f-31d1e3e445a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.759251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde779f-af50-4805-a69f-31d1e3e445a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.759407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc64c0-bf8a-42a8-9e56-8901245d4c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.760076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc64c0-bf8a-42a8-9e56-8901245d4c02 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.760386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc64c0-bf8a-42a8-9e56-8901245d4c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.760670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc64c0-bf8a-42a8-9e56-8901245d4c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.760851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde779f-af50-4805-a69f-31d1e3e445a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.761612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc64c0-bf8a-42a8-9e56-8901245d4c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.763553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde779f-af50-4805-a69f-31d1e3e445a3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.764702 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc64c0-bf8a-42a8-9e56-8901245d4c02 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.778037 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3948/7910] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:04.782592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde779f-af50-4805-a69f-31d1e3e445a3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.796765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde779f-af50-4805-a69f-31d1e3e445a3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.801780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643ec36-1b08-4463-8ae4-748f9f2aca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:04.802687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ec36-1b08-4463-8ae4-748f9f2aca8e admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.803031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ec36-1b08-4463-8ae4-748f9f2aca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.803303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ec36-1b08-4463-8ae4-748f9f2aca8e admin admin] PATH_INFO: `/v3/projects/c88a055c429b4b9e8e86a370c8571785/users/2af13ad54ab048d495e5ff0c0453abb2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.806623 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3963/7911] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:04.807659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc64c0-bf8a-42a8-9e56-8901245d4c02 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.826362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643ec36-1b08-4463-8ae4-748f9f2aca8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88a055c429b4b9e8e86a370c8571785, user_id=2af13ad54ab048d495e5ff0c0453abb2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:04.829113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643ec36-1b08-4463-8ae4-748f9f2aca8e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:04.852428 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3949/7912] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:04 2022] PUT /identity/v3/projects/c88a055c429b4b9e8e86a370c8571785/users/2af13ad54ab048d495e5ff0c0453abb2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:04.858479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc584843-4049-49a2-8bd8-801d3842d147 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:04.858934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc584843-4049-49a2-8bd8-801d3842d147 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:04.860656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc584843-4049-49a2-8bd8-801d3842d147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:04.888445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cc584843-4049-49a2-8bd8-801d3842d147 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:04.890035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc584843-4049-49a2-8bd8-801d3842d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:04.903457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc64c0-bf8a-42a8-9e56-8901245d4c02 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:04.981109 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3950/7913] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:04.982072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc584843-4049-49a2-8bd8-801d3842d147 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:04.983911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cc584843-4049-49a2-8bd8-801d3842d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:05.005006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc584843-4049-49a2-8bd8-801d3842d147 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.010319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.011991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.012364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.012730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] PATH_INFO: `/v3/projects/ee95f61e46b548ebb3d07818562cb7c7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.014057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee95f61e46b548ebb3d07818562cb7c7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.016051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.017009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27469ad7-e4ae-4b1d-8a8e-17831e5863d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.018114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27469ad7-e4ae-4b1d-8a8e-17831e5863d2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.019099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27469ad7-e4ae-4b1d-8a8e-17831e5863d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.019775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27469ad7-e4ae-4b1d-8a8e-17831e5863d2 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.020769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27469ad7-e4ae-4b1d-8a8e-17831e5863d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.025471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27469ad7-e4ae-4b1d-8a8e-17831e5863d2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.054213 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3964/7914] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:04 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:05.058249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27469ad7-e4ae-4b1d-8a8e-17831e5863d2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.083932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee95f61e46b548ebb3d07818562cb7c7', 'request_id': 'req-286443c3-6eec-43ad-9c8d-bee9833d83f2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:05.093600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee95f61e46b548ebb3d07818562cb7c7', 'request_id': 'req-286443c3-6eec-43ad-9c8d-bee9833d83f2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:05.107270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee95f61e46b548ebb3d07818562cb7c7', 'request_id': 'req-286443c3-6eec-43ad-9c8d-bee9833d83f2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:05.124088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] The token cache is being invalidate because project ee95f61e46b548ebb3d07818562cb7c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:05.124494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:05.125201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:05.127591 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3951/7915] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:04 2022] DELETE /identity/v3/projects/ee95f61e46b548ebb3d07818562cb7c7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:05.127886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.134028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:05.134153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27469ad7-e4ae-4b1d-8a8e-17831e5863d2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.219418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286443c3-6eec-43ad-9c8d-bee9833d83f2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.230653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45bf24-1d9f-467a-8ea7-c70b9467e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.231913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45bf24-1d9f-467a-8ea7-c70b9467e20a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.232971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45bf24-1d9f-467a-8ea7-c70b9467e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.233540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45bf24-1d9f-467a-8ea7-c70b9467e20a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.234598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45bf24-1d9f-467a-8ea7-c70b9467e20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.238592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45bf24-1d9f-467a-8ea7-c70b9467e20a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.239059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.239745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.240012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.240292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.242232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:05.260940 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3952/7916] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:05.260940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e19e4-d7b2-4ba4-aa3b-9a00aac6a992 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.260940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e19e4-d7b2-4ba4-aa3b-9a00aac6a992 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.260940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e19e4-d7b2-4ba4-aa3b-9a00aac6a992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.267443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.269947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.284367 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3965/7917] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:05.284545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a58e19e4-d7b2-4ba4-aa3b-9a00aac6a992 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:05.285681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.286131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a58e19e4-d7b2-4ba4-aa3b-9a00aac6a992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:05.298677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deb331-f305-4436-9207-7d0d13009676 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.300133 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3953/7918] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:05.306396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3342487-5aa1-48e8-ba2e-c5611261ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.307241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342487-5aa1-48e8-ba2e-c5611261ca13 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.307527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342487-5aa1-48e8-ba2e-c5611261ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.307801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342487-5aa1-48e8-ba2e-c5611261ca13 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.308707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3342487-5aa1-48e8-ba2e-c5611261ca13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.312403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098536-7811-4555-b8a3-97cca95188bc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.312620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3342487-5aa1-48e8-ba2e-c5611261ca13 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.312733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098536-7811-4555-b8a3-97cca95188bc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.312733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098536-7811-4555-b8a3-97cca95188bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.327345 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3966/7919] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:05.331516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3342487-5aa1-48e8-ba2e-c5611261ca13 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.343239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3342487-5aa1-48e8-ba2e-c5611261ca13 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.345726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-51098536-7811-4555-b8a3-97cca95188bc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:05.347935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-51098536-7811-4555-b8a3-97cca95188bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:05.348969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a26943-b386-4f87-b28c-189ec6c2e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.350081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26943-b386-4f87-b28c-189ec6c2e7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.350602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26943-b386-4f87-b28c-189ec6c2e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.350976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26943-b386-4f87-b28c-189ec6c2e7bb admin admin] PATH_INFO: `/v3/projects/9c59681854604e18a3a7bc8af86302d9/users/6cb0bb088cbe4793839104b22b40efee/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.360600 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3954/7920] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:05.364825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098536-7811-4555-b8a3-97cca95188bc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.371760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a26943-b386-4f87-b28c-189ec6c2e7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c59681854604e18a3a7bc8af86302d9, user_id=6cb0bb088cbe4793839104b22b40efee, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.374748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a26943-b386-4f87-b28c-189ec6c2e7bb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.377322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098536-7811-4555-b8a3-97cca95188bc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.384171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.385063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.385446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.385835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.386645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:05.387006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.389129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.407137 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3955/7922] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:19:05.408452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.414391 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3967/7922] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:05 2022] PUT /identity/v3/projects/9c59681854604e18a3a7bc8af86302d9/users/6cb0bb088cbe4793839104b22b40efee/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:05.415979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d8ee-787a-4ae6-a0b7-7ab0b0998919 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.416255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d8ee-787a-4ae6-a0b7-7ab0b0998919 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.416559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d8ee-787a-4ae6-a0b7-7ab0b0998919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.423626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ae22c-0570-4c7f-94c1-474613210e99 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.492184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8375d8ee-787a-4ae6-a0b7-7ab0b0998919 None None] MFA Rules not processed for user `6cb0bb088cbe4793839104b22b40efee`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:05.496010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8375d8ee-787a-4ae6-a0b7-7ab0b0998919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:05.505907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de0114-9d58-4357-992e-be9df5ee7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.506533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de0114-9d58-4357-992e-be9df5ee7002 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.506929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de0114-9d58-4357-992e-be9df5ee7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.507412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de0114-9d58-4357-992e-be9df5ee7002 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.508591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de0114-9d58-4357-992e-be9df5ee7002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.511911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de0114-9d58-4357-992e-be9df5ee7002 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.568433 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3956/7923] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:05 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:05.570325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de0114-9d58-4357-992e-be9df5ee7002 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.672231 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3968/7924] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:05.676224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de0114-9d58-4357-992e-be9df5ee7002 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.677587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d8ee-787a-4ae6-a0b7-7ab0b0998919 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.681564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a43eb-5673-47b9-95dc-5e92b76327d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.682401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a43eb-5673-47b9-95dc-5e92b76327d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.682766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a43eb-5673-47b9-95dc-5e92b76327d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.683141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a43eb-5673-47b9-95dc-5e92b76327d5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.683901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a43eb-5673-47b9-95dc-5e92b76327d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.685982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a43eb-5673-47b9-95dc-5e92b76327d5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.692964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d8ee-787a-4ae6-a0b7-7ab0b0998919 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.705115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ee150-5f8d-49b2-855b-2f970123f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.705571 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee150-5f8d-49b2-855b-2f970123f4ba admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.705952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee150-5f8d-49b2-855b-2f970123f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.706419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee150-5f8d-49b2-855b-2f970123f4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.707347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ee150-5f8d-49b2-855b-2f970123f4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.710162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ee150-5f8d-49b2-855b-2f970123f4ba admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.722255 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3957/7925] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:05 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:05.723096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a43eb-5673-47b9-95dc-5e92b76327d5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.741967 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3969/7926] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:05 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:05.746306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a43eb-5673-47b9-95dc-5e92b76327d5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.746823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ee150-5f8d-49b2-855b-2f970123f4ba admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.840515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be653dc1-00f3-4516-91f3-0eb90e4ce162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.841264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653dc1-00f3-4516-91f3-0eb90e4ce162 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.841554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653dc1-00f3-4516-91f3-0eb90e4ce162 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.841893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653dc1-00f3-4516-91f3-0eb90e4ce162 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.842771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be653dc1-00f3-4516-91f3-0eb90e4ce162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.844666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be653dc1-00f3-4516-91f3-0eb90e4ce162 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.850773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ee150-5f8d-49b2-855b-2f970123f4ba admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.858971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee698a95-26b6-4714-b99b-66aa85b2fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.859910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee698a95-26b6-4714-b99b-66aa85b2fcca admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.860665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee698a95-26b6-4714-b99b-66aa85b2fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.861139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee698a95-26b6-4714-b99b-66aa85b2fcca admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.862060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee698a95-26b6-4714-b99b-66aa85b2fcca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.863826 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3958/7927] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:05.864720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee698a95-26b6-4714-b99b-66aa85b2fcca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.864960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be653dc1-00f3-4516-91f3-0eb90e4ce162 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.879569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be653dc1-00f3-4516-91f3-0eb90e4ce162 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.893477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef5e6-641e-4d92-94b7-fa5248f7b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.894285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef5e6-641e-4d92-94b7-fa5248f7b348 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.894712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef5e6-641e-4d92-94b7-fa5248f7b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.895107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef5e6-641e-4d92-94b7-fa5248f7b348 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.895977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ef5e6-641e-4d92-94b7-fa5248f7b348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.897253 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3970/7928] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:05 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:05.898101 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ef5e6-641e-4d92-94b7-fa5248f7b348 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.900822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee698a95-26b6-4714-b99b-66aa85b2fcca admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.910793 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3959/7929] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:05.913465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee698a95-26b6-4714-b99b-66aa85b2fcca admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.915135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef5e6-641e-4d92-94b7-fa5248f7b348 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.922723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065d222-bac7-459c-bd9f-d97672406e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.923413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d222-bac7-459c-bd9f-d97672406e74 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.923692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d222-bac7-459c-bd9f-d97672406e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.924051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d222-bac7-459c-bd9f-d97672406e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.924947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065d222-bac7-459c-bd9f-d97672406e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.928518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065d222-bac7-459c-bd9f-d97672406e74 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.930935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef5e6-641e-4d92-94b7-fa5248f7b348 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.936196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483755f-d95c-44e2-9f93-4337d9d7ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.937235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483755f-d95c-44e2-9f93-4337d9d7ce25 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.937596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483755f-d95c-44e2-9f93-4337d9d7ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.937955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483755f-d95c-44e2-9f93-4337d9d7ce25 admin admin] PATH_INFO: `/v3/projects/637118d588ee46e5ab20e412e96a9c40/users/db4a5b6cdc794245accceea56f14567b/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.940171 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3971/7930] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:19:05.946176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065d222-bac7-459c-bd9f-d97672406e74 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:05.957694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483755f-d95c-44e2-9f93-4337d9d7ce25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637118d588ee46e5ab20e412e96a9c40, user_id=db4a5b6cdc794245accceea56f14567b, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:05.960665 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483755f-d95c-44e2-9f93-4337d9d7ce25 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:05.962905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065d222-bac7-459c-bd9f-d97672406e74 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:05.969661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d59a-3c51-4a23-8afd-dfbad561151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:05.971076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d59a-3c51-4a23-8afd-dfbad561151b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.972611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d59a-3c51-4a23-8afd-dfbad561151b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.973159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d59a-3c51-4a23-8afd-dfbad561151b admin admin] PATH_INFO: `/v3/projects/9744d59b46fd470c9106a1c26f5231b2/users/98ea3a3d2d364035a4cb6d0d636d7544/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:05.979429 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3960/7931] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:05 2022] PUT /identity/v3/projects/637118d588ee46e5ab20e412e96a9c40/users/db4a5b6cdc794245accceea56f14567b/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:05.990563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4940fd-df9c-4a12-9c43-aa4d7ad84dab None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:05.990857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4940fd-df9c-4a12-9c43-aa4d7ad84dab None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:05.991139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4940fd-df9c-4a12-9c43-aa4d7ad84dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.008400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23d59a-3c51-4a23-8afd-dfbad561151b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9744d59b46fd470c9106a1c26f5231b2, user_id=98ea3a3d2d364035a4cb6d0d636d7544, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.013770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23d59a-3c51-4a23-8afd-dfbad561151b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.024481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1f4940fd-df9c-4a12-9c43-aa4d7ad84dab None None] MFA Rules not processed for user `db4a5b6cdc794245accceea56f14567b`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:06.025723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1f4940fd-df9c-4a12-9c43-aa4d7ad84dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:06.038425 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3972/7932] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:05 2022] PUT /identity/v3/projects/9744d59b46fd470c9106a1c26f5231b2/users/98ea3a3d2d364035a4cb6d0d636d7544/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:06.040380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d59a-3c51-4a23-8afd-dfbad561151b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.107715 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3961/7933] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:06.112225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4940fd-df9c-4a12-9c43-aa4d7ad84dab None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.135826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d59a-3c51-4a23-8afd-dfbad561151b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.147209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fae7c-3862-4fe9-a7b7-4fe9bbd6512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.147916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fae7c-3862-4fe9-a7b7-4fe9bbd6512e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.148186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fae7c-3862-4fe9-a7b7-4fe9bbd6512e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.148621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fae7c-3862-4fe9-a7b7-4fe9bbd6512e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.149404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fae7c-3862-4fe9-a7b7-4fe9bbd6512e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.151098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fae7c-3862-4fe9-a7b7-4fe9bbd6512e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.172713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3973/7934] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:06.174534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fae7c-3862-4fe9-a7b7-4fe9bbd6512e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.205566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fae7c-3862-4fe9-a7b7-4fe9bbd6512e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.211402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2551b-9267-4ebc-bcc3-52a236da9175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.212657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2551b-9267-4ebc-bcc3-52a236da9175 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.212952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2551b-9267-4ebc-bcc3-52a236da9175 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.213235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2551b-9267-4ebc-bcc3-52a236da9175 admin admin] PATH_INFO: `/v3/projects/9744d59b46fd470c9106a1c26f5231b2/users/98ea3a3d2d364035a4cb6d0d636d7544/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.215522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2551b-9267-4ebc-bcc3-52a236da9175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9744d59b46fd470c9106a1c26f5231b2, user_id=98ea3a3d2d364035a4cb6d0d636d7544, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.219507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2551b-9267-4ebc-bcc3-52a236da9175 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.233904 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3974/7935] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:06 2022] PUT /identity/v3/projects/9744d59b46fd470c9106a1c26f5231b2/users/98ea3a3d2d364035a4cb6d0d636d7544/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:06.243803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c98c1-b2a0-4275-905f-c67919dcfc2d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.244122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c98c1-b2a0-4275-905f-c67919dcfc2d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.244402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c98c1-b2a0-4275-905f-c67919dcfc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.267069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4940fd-df9c-4a12-9c43-aa4d7ad84dab None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.289397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7a9c98c1-b2a0-4275-905f-c67919dcfc2d None None] MFA Rules not processed for user `98ea3a3d2d364035a4cb6d0d636d7544`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:06.290759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a9c98c1-b2a0-4275-905f-c67919dcfc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:06.372774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b343a56-b2f6-456e-aa76-56a9f3bf6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.373923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b343a56-b2f6-456e-aa76-56a9f3bf6184 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.374217 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b343a56-b2f6-456e-aa76-56a9f3bf6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.374674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b343a56-b2f6-456e-aa76-56a9f3bf6184 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.375410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b343a56-b2f6-456e-aa76-56a9f3bf6184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.377538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b343a56-b2f6-456e-aa76-56a9f3bf6184 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.396302 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3975/7936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:06.408713 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3962/7937] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:06 2022] POST /identity/v3/projects => generated 381 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:06.411290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c98c1-b2a0-4275-905f-c67919dcfc2d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.412862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7a9c98c1-b2a0-4275-905f-c67919dcfc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:06.413531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b343a56-b2f6-456e-aa76-56a9f3bf6184 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.478476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c98c1-b2a0-4275-905f-c67919dcfc2d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.484004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b343a56-b2f6-456e-aa76-56a9f3bf6184 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.491718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef2f88-e4ba-4e37-887b-62b5999627ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.492440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef2f88-e4ba-4e37-887b-62b5999627ea admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.492728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef2f88-e4ba-4e37-887b-62b5999627ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.493010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef2f88-e4ba-4e37-887b-62b5999627ea admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.493921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef2f88-e4ba-4e37-887b-62b5999627ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.496703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef2f88-e4ba-4e37-887b-62b5999627ea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.519667 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3963/7938] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:06 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:06.524028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef2f88-e4ba-4e37-887b-62b5999627ea admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.535183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef2f88-e4ba-4e37-887b-62b5999627ea admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.540283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.540659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de920d-71fa-4528-a2ff-81fadfa2e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.540985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.541324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.541440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de920d-71fa-4528-a2ff-81fadfa2e58e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.541630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.541791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de920d-71fa-4528-a2ff-81fadfa2e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.541961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de920d-71fa-4528-a2ff-81fadfa2e58e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.543200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de920d-71fa-4528-a2ff-81fadfa2e58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.545298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de920d-71fa-4528-a2ff-81fadfa2e58e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.560391 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3964/7939] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:06.561694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de920d-71fa-4528-a2ff-81fadfa2e58e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.573536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de920d-71fa-4528-a2ff-81fadfa2e58e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.579599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1773ac9-87f7-4ede-b79d-2bca04ffc97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.580526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773ac9-87f7-4ede-b79d-2bca04ffc97e admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.580816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773ac9-87f7-4ede-b79d-2bca04ffc97e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.581099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773ac9-87f7-4ede-b79d-2bca04ffc97e admin admin] PATH_INFO: `/v3/projects/52c73964c8564c5aac8fa2003ef2f623/users/509de2cdfaa9432494f80fcbc5419012/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.600950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1773ac9-87f7-4ede-b79d-2bca04ffc97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c73964c8564c5aac8fa2003ef2f623, user_id=509de2cdfaa9432494f80fcbc5419012, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.604560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1773ac9-87f7-4ede-b79d-2bca04ffc97e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.631178 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3965/7940] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:06 2022] PUT /identity/v3/projects/52c73964c8564c5aac8fa2003ef2f623/users/509de2cdfaa9432494f80fcbc5419012/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:06.636612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1773ac9-87f7-4ede-b79d-2bca04ffc97e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.640877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.642623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.654623 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3976/7941] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:06.752441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1773ac9-87f7-4ede-b79d-2bca04ffc97e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.757860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf6153-6874-4ba1-bf92-d1dd2ad534e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.758828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf6153-6874-4ba1-bf92-d1dd2ad534e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.759230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf6153-6874-4ba1-bf92-d1dd2ad534e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.759704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf6153-6874-4ba1-bf92-d1dd2ad534e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.766413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf6153-6874-4ba1-bf92-d1dd2ad534e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.769064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf6153-6874-4ba1-bf92-d1dd2ad534e6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.775149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.777574 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:06.782114 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3966/7942] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:06.786231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf6153-6874-4ba1-bf92-d1dd2ad534e6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:06.805978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf6153-6874-4ba1-bf92-d1dd2ad534e6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.820560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812215b1-35b4-4493-88a1-9eb389adf191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.820963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2237b8-dfab-46fc-b8c9-37add866e08a service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:06.821652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812215b1-35b4-4493-88a1-9eb389adf191 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.822013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812215b1-35b4-4493-88a1-9eb389adf191 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.822373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812215b1-35b4-4493-88a1-9eb389adf191 admin admin] PATH_INFO: `/v3/projects/52c73964c8564c5aac8fa2003ef2f623/users/509de2cdfaa9432494f80fcbc5419012/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.825066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812215b1-35b4-4493-88a1-9eb389adf191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c73964c8564c5aac8fa2003ef2f623, user_id=509de2cdfaa9432494f80fcbc5419012, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:06.828231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812215b1-35b4-4493-88a1-9eb389adf191 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:06.840846 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3967/7943] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:06 2022] PUT /identity/v3/projects/52c73964c8564c5aac8fa2003ef2f623/users/509de2cdfaa9432494f80fcbc5419012/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:06.855780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667a3f-1e64-46d0-8eab-56c150dfc7bc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.856972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667a3f-1e64-46d0-8eab-56c150dfc7bc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.857507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667a3f-1e64-46d0-8eab-56c150dfc7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:06.933649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-06667a3f-1e64-46d0-8eab-56c150dfc7bc None None] MFA Rules not processed for user `509de2cdfaa9432494f80fcbc5419012`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:06.937745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-06667a3f-1e64-46d0-8eab-56c150dfc7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:06.964703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466a97e-c8aa-4beb-8d18-5b654c25b6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:06.965788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466a97e-c8aa-4beb-8d18-5b654c25b6db service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:06.968120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466a97e-c8aa-4beb-8d18-5b654c25b6db service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:06.968555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466a97e-c8aa-4beb-8d18-5b654c25b6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:07.104796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466a97e-c8aa-4beb-8d18-5b654c25b6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:07.107754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466a97e-c8aa-4beb-8d18-5b654c25b6db service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:07.115155 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3968/7944] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:07.122731 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3977/7945] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:07.170637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06667a3f-1e64-46d0-8eab-56c150dfc7bc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:07.346406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06667a3f-1e64-46d0-8eab-56c150dfc7bc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:07.364213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:07.365375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:07.366922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:07.367436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:07.395113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:07.398298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:07.425262 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3969/7946] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:07.521027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466a97e-c8aa-4beb-8d18-5b654c25b6db service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:07.541501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466a97e-c8aa-4beb-8d18-5b654c25b6db service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:07.549032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c8912-e4d1-4e6f-aed3-8211da634f6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:07.550100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8912-e4d1-4e6f-aed3-8211da634f6f service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:07.550646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8912-e4d1-4e6f-aed3-8211da634f6f service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:07.551110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8912-e4d1-4e6f-aed3-8211da634f6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:07.671738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c8912-e4d1-4e6f-aed3-8211da634f6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:07.674018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c8912-e4d1-4e6f-aed3-8211da634f6f service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:07.706789 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3978/7947] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:07.821137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:07.823322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:07.963362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4442df-3dcb-41c5-86b0-e744b1ff5d83 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:07.968673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:07.969562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:07.969844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:07.970124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] PATH_INFO: `/v3/users/77fc4361ba2645d3b4d1ef3977fe9e31` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:07.971878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fc4361ba2645d3b4d1ef3977fe9e31)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:07.975038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:08.039449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fc4361ba2645d3b4d1ef3977fe9e31'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:08.054269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fc4361ba2645d3b4d1ef3977fe9e31'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:08.083635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fc4361ba2645d3b4d1ef3977fe9e31'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:08.084594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fc4361ba2645d3b4d1ef3977fe9e31'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:08.093859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fc4361ba2645d3b4d1ef3977fe9e31'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:08.114501 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3970/7948] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:07 2022] DELETE /identity/v3/users/77fc4361ba2645d3b4d1ef3977fe9e31 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:08.118751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aadb6-8e1d-4b8c-a25c-e8def042f659 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:08.119305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aadb6-8e1d-4b8c-a25c-e8def042f659 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:08.119305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aadb6-8e1d-4b8c-a25c-e8def042f659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:08.139242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c60aadb6-8e1d-4b8c-a25c-e8def042f659 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:08.140872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c60aadb6-8e1d-4b8c-a25c-e8def042f659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:08.218618 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3979/7949] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:08.233395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:08.237153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:08.374997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc342f-13db-4357-b801-eecf21b5cbe7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:08.380185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251d91f-9894-43dd-8357-89ff1990eeef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:08.381026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251d91f-9894-43dd-8357-89ff1990eeef service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:08.381662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251d91f-9894-43dd-8357-89ff1990eeef service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:08.382022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251d91f-9894-43dd-8357-89ff1990eeef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:08.404058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251d91f-9894-43dd-8357-89ff1990eeef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:08.405835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251d91f-9894-43dd-8357-89ff1990eeef service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:08.418430 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3971/7950] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:09.235479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aadb6-8e1d-4b8c-a25c-e8def042f659 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:09.237316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c60aadb6-8e1d-4b8c-a25c-e8def042f659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:09.259356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aadb6-8e1d-4b8c-a25c-e8def042f659 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:09.267090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:09.268794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:09.269259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:09.269727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] PATH_INFO: `/v3/projects/7e8d8b358e3c44ffa1b22a4cc1214467` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:09.271581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8d8b358e3c44ffa1b22a4cc1214467)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:09.274223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:09.389840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8d8b358e3c44ffa1b22a4cc1214467', 'request_id': 'req-168c0406-9cd0-48e3-8410-04b2221560be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.410830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8d8b358e3c44ffa1b22a4cc1214467', 'request_id': 'req-168c0406-9cd0-48e3-8410-04b2221560be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.428651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8d8b358e3c44ffa1b22a4cc1214467', 'request_id': 'req-168c0406-9cd0-48e3-8410-04b2221560be'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.461053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] The token cache is being invalidate because project 7e8d8b358e3c44ffa1b22a4cc1214467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:09.461397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.463894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.469129 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3980/7951] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:09 2022] DELETE /identity/v3/projects/7e8d8b358e3c44ffa1b22a4cc1214467 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:09.473474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251d91f-9894-43dd-8357-89ff1990eeef service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:09.493046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251d91f-9894-43dd-8357-89ff1990eeef service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:09.661947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:09.662859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:09.663148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:09.663434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] PATH_INFO: `/v3/users/b3b40dc937ca49b68f588cb148d9259a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:09.666783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b40dc937ca49b68f588cb148d9259a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:09.672717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:09.790119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b40dc937ca49b68f588cb148d9259a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.818464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b40dc937ca49b68f588cb148d9259a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.827898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b40dc937ca49b68f588cb148d9259a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.829242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b40dc937ca49b68f588cb148d9259a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.829491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ad861ad-4d0e-4e51-bbe5-382798b70bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b40dc937ca49b68f588cb148d9259a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:09.846736 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3972/7952] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:09 2022] DELETE /identity/v3/users/b3b40dc937ca49b68f588cb148d9259a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:10.241287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:10.243330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:10.261980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c0406-9cd0-48e3-8410-04b2221560be admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:10.355319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:10.356899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:10.357576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:10.358087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] PATH_INFO: `/v3/users/6cb0bb088cbe4793839104b22b40efee` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:10.359699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb0bb088cbe4793839104b22b40efee)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:10.362225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:10.448251 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb0bb088cbe4793839104b22b40efee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.449047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb0bb088cbe4793839104b22b40efee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.450350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb0bb088cbe4793839104b22b40efee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.465324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb0bb088cbe4793839104b22b40efee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.477259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb0bb088cbe4793839104b22b40efee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.499427 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3981/7953] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:10 2022] DELETE /identity/v3/users/6cb0bb088cbe4793839104b22b40efee => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:10.504244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12289c23-5704-4a1e-932a-3a66d41c2d86 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:10.505425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12289c23-5704-4a1e-932a-3a66d41c2d86 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:10.506197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12289c23-5704-4a1e-932a-3a66d41c2d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:10.530464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-12289c23-5704-4a1e-932a-3a66d41c2d86 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:10.532136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-12289c23-5704-4a1e-932a-3a66d41c2d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:10.547690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:10.550757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:10.618489 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3973/7954] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:10.641186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12289c23-5704-4a1e-932a-3a66d41c2d86 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:10.642845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-12289c23-5704-4a1e-932a-3a66d41c2d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:10.679726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79e0c-6949-4e18-8fb0-e61d44b32279 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:10.686043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:10.687604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:10.688291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:10.689153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] PATH_INFO: `/v3/projects/cea3f3454bac4f4f9c2586f67cb2eb64` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:10.691077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea3f3454bac4f4f9c2586f67cb2eb64)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:10.693495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:10.778175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12289c23-5704-4a1e-932a-3a66d41c2d86 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:10.789363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861f6d7-297f-437b-ae89-458eac3571f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:10.790033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861f6d7-297f-437b-ae89-458eac3571f6 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:10.790313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861f6d7-297f-437b-ae89-458eac3571f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:10.790586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861f6d7-297f-437b-ae89-458eac3571f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:10.815016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861f6d7-297f-437b-ae89-458eac3571f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:10.816667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861f6d7-297f-437b-ae89-458eac3571f6 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:10.823994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea3f3454bac4f4f9c2586f67cb2eb64', 'request_id': 'req-77466bfa-08b8-4836-a3dc-edbd3b567603'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.840140 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3974/7955] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:10.841269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea3f3454bac4f4f9c2586f67cb2eb64', 'request_id': 'req-77466bfa-08b8-4836-a3dc-edbd3b567603'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.861553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea3f3454bac4f4f9c2586f67cb2eb64', 'request_id': 'req-77466bfa-08b8-4836-a3dc-edbd3b567603'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.907262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] The token cache is being invalidate because project cea3f3454bac4f4f9c2586f67cb2eb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:10.907872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.911607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-77466bfa-08b8-4836-a3dc-edbd3b567603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:10.916834 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3982/7956] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:10 2022] DELETE /identity/v3/projects/cea3f3454bac4f4f9c2586f67cb2eb64 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:10.921503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4975-8674-4653-846f-dd3745631427 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:10.921816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4975-8674-4653-846f-dd3745631427 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:10.922114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4975-8674-4653-846f-dd3745631427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:10.966258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-994d4975-8674-4653-846f-dd3745631427 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:10.967667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-994d4975-8674-4653-846f-dd3745631427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:11.072870 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3975/7957] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:11.082039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b87c2-1ebe-44e7-9287-3f01b86a1a35 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.082726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b87c2-1ebe-44e7-9287-3f01b86a1a35 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.083199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b87c2-1ebe-44e7-9287-3f01b86a1a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.129179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-af4b87c2-1ebe-44e7-9287-3f01b86a1a35 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:11.138789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-af4b87c2-1ebe-44e7-9287-3f01b86a1a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:11.157848 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3983/7958] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:11.162721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d4975-8674-4653-846f-dd3745631427 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:11.177208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d4975-8674-4653-846f-dd3745631427 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:11.192715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:11.192715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.192715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.192715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.193347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:11.193347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:11.224863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:11.285801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3976/7959] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:11.290182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b87c2-1ebe-44e7-9287-3f01b86a1a35 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:11.303226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b87c2-1ebe-44e7-9287-3f01b86a1a35 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:11.320041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9019d-8719-406f-8cd7-1a5713e6c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:11.321252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9019d-8719-406f-8cd7-1a5713e6c543 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.321791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9019d-8719-406f-8cd7-1a5713e6c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.322852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9019d-8719-406f-8cd7-1a5713e6c543 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.324432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9019d-8719-406f-8cd7-1a5713e6c543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:11.334373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9019d-8719-406f-8cd7-1a5713e6c543 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:11.399221 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3984/7960] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:11 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:11.405616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:11.423800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84e1af-f354-4dfa-8541-0529ff290593 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:11.550074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d58a-0eb9-43b1-809f-1ebe5cdb2cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:11.551399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d58a-0eb9-43b1-809f-1ebe5cdb2cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.552304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d58a-0eb9-43b1-809f-1ebe5cdb2cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.552734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d58a-0eb9-43b1-809f-1ebe5cdb2cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.554583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d58a-0eb9-43b1-809f-1ebe5cdb2cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:11.557555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d58a-0eb9-43b1-809f-1ebe5cdb2cf5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:11.590124 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3977/7961] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:11 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:11.594509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9019d-8719-406f-8cd7-1a5713e6c543 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:11.610188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9019d-8719-406f-8cd7-1a5713e6c543 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:11.618009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f0bf-9d08-4796-9777-d574c176ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:11.618163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f0bf-9d08-4796-9777-d574c176ed58 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.618454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f0bf-9d08-4796-9777-d574c176ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.618791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f0bf-9d08-4796-9777-d574c176ed58 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.620098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f0bf-9d08-4796-9777-d574c176ed58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:11.624758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f0bf-9d08-4796-9777-d574c176ed58 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:11.641838 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3985/7962] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:11.643295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d58a-0eb9-43b1-809f-1ebe5cdb2cf5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:11.659002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d58a-0eb9-43b1-809f-1ebe5cdb2cf5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:11.664758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:11.665753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.666043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.666370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.668321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:11.670448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:11.682702 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3978/7963] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:11.688166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f0bf-9d08-4796-9777-d574c176ed58 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:11.712988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f0bf-9d08-4796-9777-d574c176ed58 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:11.723879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a73ba-3563-4640-903e-ce8de9f6a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:11.729387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a73ba-3563-4640-903e-ce8de9f6a812 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.729750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a73ba-3563-4640-903e-ce8de9f6a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.731269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a73ba-3563-4640-903e-ce8de9f6a812 admin admin] PATH_INFO: `/v3/projects/cb3ac6e5295f46929a6ec974f83f62e2/users/7e4927177d744a38bbaa6194d806dffb/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.749673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a73ba-3563-4640-903e-ce8de9f6a812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3ac6e5295f46929a6ec974f83f62e2, user_id=7e4927177d744a38bbaa6194d806dffb, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:11.753744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a73ba-3563-4640-903e-ce8de9f6a812 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:11.775508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:11.777713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:11.787540 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3986/7964] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:11 2022] PUT /identity/v3/projects/cb3ac6e5295f46929a6ec974f83f62e2/users/7e4927177d744a38bbaa6194d806dffb/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:11.804701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add848de-3b0b-4441-a34e-d0fe5db5bb61 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.805655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add848de-3b0b-4441-a34e-d0fe5db5bb61 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.806153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add848de-3b0b-4441-a34e-d0fe5db5bb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.806786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74339b8b-e2ff-49b6-9e39-1e580a0d37e2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:11.872549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-add848de-3b0b-4441-a34e-d0fe5db5bb61 None None] MFA Rules not processed for user `7e4927177d744a38bbaa6194d806dffb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:11.873791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-add848de-3b0b-4441-a34e-d0fe5db5bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:11.922133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:11.923403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:11.924741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:11.925253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] PATH_INFO: `/v3/projects/9c59681854604e18a3a7bc8af86302d9` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:11.926955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c59681854604e18a3a7bc8af86302d9)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:11.930725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:12.010081 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3987/7965] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:12.015573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add848de-3b0b-4441-a34e-d0fe5db5bb61 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:12.038549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add848de-3b0b-4441-a34e-d0fe5db5bb61 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:12.039319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c59681854604e18a3a7bc8af86302d9', 'request_id': 'req-cf74e71a-dd07-4a76-80e7-638023914121'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.051710 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c59681854604e18a3a7bc8af86302d9', 'request_id': 'req-cf74e71a-dd07-4a76-80e7-638023914121'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.073029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c59681854604e18a3a7bc8af86302d9', 'request_id': 'req-cf74e71a-dd07-4a76-80e7-638023914121'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.094551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] The token cache is being invalidate because project 9c59681854604e18a3a7bc8af86302d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:12.094867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.097524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.100149 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3979/7966] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:11 2022] DELETE /identity/v3/projects/9c59681854604e18a3a7bc8af86302d9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:12.104110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:12.107145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:12.153763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:12.154835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:12.155335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:12.155822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:12.157114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:12.161766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:12.226263 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3988/7967] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:12 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:12.230510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:12.232563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:12.307370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74e71a-dd07-4a76-80e7-638023914121 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:12.338983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7557-2364-4e14-b1d6-a38964c71acf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:12.348085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e6bd-0e86-4d69-bc67-4ff188024538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:12.348899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e6bd-0e86-4d69-bc67-4ff188024538 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:12.349181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e6bd-0e86-4d69-bc67-4ff188024538 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:12.349528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e6bd-0e86-4d69-bc67-4ff188024538 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:12.351120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e6bd-0e86-4d69-bc67-4ff188024538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:12.353752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e6bd-0e86-4d69-bc67-4ff188024538 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:12.395581 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3989/7968] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:12 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:12.399194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e6bd-0e86-4d69-bc67-4ff188024538 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:12.427236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e6bd-0e86-4d69-bc67-4ff188024538 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:12.428441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:12.429609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:12.430090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:12.430499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] PATH_INFO: `/v3/users/98ea3a3d2d364035a4cb6d0d636d7544` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:12.432377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ea3a3d2d364035a4cb6d0d636d7544)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:12.434730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:12.435843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3823992-f084-4e67-bd19-8687c5b9db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:12.436827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823992-f084-4e67-bd19-8687c5b9db9d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:12.437331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823992-f084-4e67-bd19-8687c5b9db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:12.437784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823992-f084-4e67-bd19-8687c5b9db9d admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:12.438777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3823992-f084-4e67-bd19-8687c5b9db9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:12.440801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3823992-f084-4e67-bd19-8687c5b9db9d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:12.456492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3990/7969] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:12.460613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3823992-f084-4e67-bd19-8687c5b9db9d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:12.478528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3823992-f084-4e67-bd19-8687c5b9db9d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:12.484789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9fee1-b053-4784-8601-f7b5978c4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:12.485824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9fee1-b053-4784-8601-f7b5978c4dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:12.486560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9fee1-b053-4784-8601-f7b5978c4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:12.487035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9fee1-b053-4784-8601-f7b5978c4dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:12.487942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9fee1-b053-4784-8601-f7b5978c4dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:12.491024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9fee1-b053-4784-8601-f7b5978c4dd6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:12.508543 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3991/7970] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:19:12.515728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9fee1-b053-4784-8601-f7b5978c4dd6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:12.541469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9fee1-b053-4784-8601-f7b5978c4dd6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:12.543056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ea3a3d2d364035a4cb6d0d636d7544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.550917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:12.552169 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:12.552686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:12.553930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] PATH_INFO: `/v3/projects/f743b48bc04c4adcbf1556ca30e1e1b7/users/04e98d2ae24f446c9cd476f49442695a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:12.562795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ea3a3d2d364035a4cb6d0d636d7544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.587052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ea3a3d2d364035a4cb6d0d636d7544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.587978 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ea3a3d2d364035a4cb6d0d636d7544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.590017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3f65cda7-a661-4c08-bb66-7fdae7884780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ea3a3d2d364035a4cb6d0d636d7544'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:12.591156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f743b48bc04c4adcbf1556ca30e1e1b7, user_id=04e98d2ae24f446c9cd476f49442695a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:12.596061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:12.619810 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3980/7971] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:12 2022] DELETE /identity/v3/users/98ea3a3d2d364035a4cb6d0d636d7544 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:12.639072 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3992/7972] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:12 2022] PUT /identity/v3/projects/f743b48bc04c4adcbf1556ca30e1e1b7/users/04e98d2ae24f446c9cd476f49442695a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:12.649442 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8960f-0dfa-4707-a576-3fe69da54412 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:12.649740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8960f-0dfa-4707-a576-3fe69da54412 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:12.650235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8960f-0dfa-4707-a576-3fe69da54412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:12.687124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4cc8960f-0dfa-4707-a576-3fe69da54412 None None] MFA Rules not processed for user `04e98d2ae24f446c9cd476f49442695a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:12.688605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4cc8960f-0dfa-4707-a576-3fe69da54412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:12.791323 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3981/7973] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:12.796514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:12.798923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:12.920658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4573ea-a4d8-42e7-af0a-5504a68ebc0c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:12.926988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904e7dc-81fb-43cd-b720-b9243b6bb0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:12.928038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904e7dc-81fb-43cd-b720-b9243b6bb0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:12.928593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904e7dc-81fb-43cd-b720-b9243b6bb0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:12.929115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904e7dc-81fb-43cd-b720-b9243b6bb0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:12.930267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904e7dc-81fb-43cd-b720-b9243b6bb0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:12.932829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904e7dc-81fb-43cd-b720-b9243b6bb0b8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:12.989131 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3993/7974] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:12 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:12.991080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8960f-0dfa-4707-a576-3fe69da54412 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.008700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8960f-0dfa-4707-a576-3fe69da54412 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:13.123645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d4aeb-4fc0-4558-bda4-4c51b9acd805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:13.124374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4aeb-4fc0-4558-bda4-4c51b9acd805 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.124797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4aeb-4fc0-4558-bda4-4c51b9acd805 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.125076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4aeb-4fc0-4558-bda4-4c51b9acd805 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.126407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d4aeb-4fc0-4558-bda4-4c51b9acd805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:13.131258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d4aeb-4fc0-4558-bda4-4c51b9acd805 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:13.176256 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3982/7975] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:12 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:13.180927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904e7dc-81fb-43cd-b720-b9243b6bb0b8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.218461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67931f-11ce-4130-a069-87447655a798 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.218835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904e7dc-81fb-43cd-b720-b9243b6bb0b8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:13.218971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67931f-11ce-4130-a069-87447655a798 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.219225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67931f-11ce-4130-a069-87447655a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.225076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:13.225895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.226181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.226469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.227641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:13.243110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:13.273797 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3994/7976] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:13.276461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.283598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-da67931f-11ce-4130-a069-87447655a798 None None] MFA Rules not processed for user `2af13ad54ab048d495e5ff0c0453abb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:13.285055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:13.286864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-da67931f-11ce-4130-a069-87447655a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:13.318749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e42dd-7752-443d-969c-fd4e87bd8492 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:13.343640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:13.344559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.344975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.345256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] PATH_INFO: `/v3/projects/9744d59b46fd470c9106a1c26f5231b2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.346566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9744d59b46fd470c9106a1c26f5231b2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:13.348567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:13.427898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9744d59b46fd470c9106a1c26f5231b2', 'request_id': 'req-4137e682-8299-4756-9b37-851582e1bdee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:13.434628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9744d59b46fd470c9106a1c26f5231b2', 'request_id': 'req-4137e682-8299-4756-9b37-851582e1bdee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:13.448311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9744d59b46fd470c9106a1c26f5231b2', 'request_id': 'req-4137e682-8299-4756-9b37-851582e1bdee'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:13.465305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] The token cache is being invalidate because project 9744d59b46fd470c9106a1c26f5231b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:13.465305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:13.465305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:13.466177 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3995/7977] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:13 2022] DELETE /identity/v3/projects/9744d59b46fd470c9106a1c26f5231b2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:13.467089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.468153 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3983/7978] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:13.468434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:13.469718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67931f-11ce-4130-a069-87447655a798 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.472900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-da67931f-11ce-4130-a069-87447655a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:13.487409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67931f-11ce-4130-a069-87447655a798 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:13.541547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e682-8299-4756-9b37-851582e1bdee admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:13.561188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc9466-6640-47e8-8f6b-fbd497f11c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:13.564110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9466-6640-47e8-8f6b-fbd497f11c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.564505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9466-6640-47e8-8f6b-fbd497f11c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.564984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9466-6640-47e8-8f6b-fbd497f11c7a admin admin] PATH_INFO: `/v3/projects/65d46a02d8e94d2c85ffd23db5a54343/users/7a05b7fc8855434991bb054d5bde4091/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.597918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc9466-6640-47e8-8f6b-fbd497f11c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d46a02d8e94d2c85ffd23db5a54343, user_id=7a05b7fc8855434991bb054d5bde4091, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:13.597918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc9466-6640-47e8-8f6b-fbd497f11c7a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:13.605391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9871dd-a4dc-4b0f-8bf2-edcd0604a3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:13.606936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9871dd-a4dc-4b0f-8bf2-edcd0604a3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.607435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9871dd-a4dc-4b0f-8bf2-edcd0604a3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.607884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9871dd-a4dc-4b0f-8bf2-edcd0604a3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.608816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9871dd-a4dc-4b0f-8bf2-edcd0604a3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:13.612292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9871dd-a4dc-4b0f-8bf2-edcd0604a3b3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:13.615578 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3996/7979] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:13 2022] PUT /identity/v3/projects/65d46a02d8e94d2c85ffd23db5a54343/users/7a05b7fc8855434991bb054d5bde4091/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:13.617083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12440e2-e012-4aee-9599-925cca25f758 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.617475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12440e2-e012-4aee-9599-925cca25f758 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.617896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12440e2-e012-4aee-9599-925cca25f758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.642215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d12440e2-e012-4aee-9599-925cca25f758 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:13.642634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d12440e2-e012-4aee-9599-925cca25f758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:13.659142 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3984/7980] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:13 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:13.659870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9871dd-a4dc-4b0f-8bf2-edcd0604a3b3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.726173 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3997/7981] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:13.727655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12440e2-e012-4aee-9599-925cca25f758 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.730704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d12440e2-e012-4aee-9599-925cca25f758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:13.744765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12440e2-e012-4aee-9599-925cca25f758 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:13.794346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9871dd-a4dc-4b0f-8bf2-edcd0604a3b3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:13.799870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb832d2-dd22-432f-97b8-5942bcd67d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:13.800490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb832d2-dd22-432f-97b8-5942bcd67d76 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.800772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb832d2-dd22-432f-97b8-5942bcd67d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.801045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb832d2-dd22-432f-97b8-5942bcd67d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.802032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb832d2-dd22-432f-97b8-5942bcd67d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:13.803479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb832d2-dd22-432f-97b8-5942bcd67d76 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:13.814620 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3985/7982] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:13.816037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637036c-7b7a-4cb8-992c-c60b707e8baf None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.816294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637036c-7b7a-4cb8-992c-c60b707e8baf None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.816645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637036c-7b7a-4cb8-992c-c60b707e8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.840479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25507363-5ed8-4af4-a22b-1ee256b23364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:13.841600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507363-5ed8-4af4-a22b-1ee256b23364 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.842032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507363-5ed8-4af4-a22b-1ee256b23364 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.842319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507363-5ed8-4af4-a22b-1ee256b23364 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.843088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25507363-5ed8-4af4-a22b-1ee256b23364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:13.846596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8637036c-7b7a-4cb8-992c-c60b707e8baf None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:13.851089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8637036c-7b7a-4cb8-992c-c60b707e8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:13.856984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25507363-5ed8-4af4-a22b-1ee256b23364 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:13.863412 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3986/7983] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:13.863412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637036c-7b7a-4cb8-992c-c60b707e8baf None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.874496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637036c-7b7a-4cb8-992c-c60b707e8baf None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:13.895260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270580-e1ed-4c41-8d54-e7dea7a804b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:13.896440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270580-e1ed-4c41-8d54-e7dea7a804b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:13.896778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270580-e1ed-4c41-8d54-e7dea7a804b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:13.898337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270580-e1ed-4c41-8d54-e7dea7a804b1 admin admin] PATH_INFO: `/v3/projects/65d46a02d8e94d2c85ffd23db5a54343/users/7a05b7fc8855434991bb054d5bde4091/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:13.907037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6270580-e1ed-4c41-8d54-e7dea7a804b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d46a02d8e94d2c85ffd23db5a54343, user_id=7a05b7fc8855434991bb054d5bde4091, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:13.909768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6270580-e1ed-4c41-8d54-e7dea7a804b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:13.915264 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3998/7984] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:13 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:13.918402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25507363-5ed8-4af4-a22b-1ee256b23364 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.932399 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3987/7985] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:13 2022] PUT /identity/v3/projects/65d46a02d8e94d2c85ffd23db5a54343/users/7a05b7fc8855434991bb054d5bde4091/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:13.934934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270580-e1ed-4c41-8d54-e7dea7a804b1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:13.953430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25507363-5ed8-4af4-a22b-1ee256b23364 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.047011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dae31a-01fd-471d-b05d-0df5ea0fcdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.048230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae31a-01fd-471d-b05d-0df5ea0fcdbc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.049676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae31a-01fd-471d-b05d-0df5ea0fcdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.050769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae31a-01fd-471d-b05d-0df5ea0fcdbc admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.052656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dae31a-01fd-471d-b05d-0df5ea0fcdbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:14.053067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dae31a-01fd-471d-b05d-0df5ea0fcdbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.054289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270580-e1ed-4c41-8d54-e7dea7a804b1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.054784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dae31a-01fd-471d-b05d-0df5ea0fcdbc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.062328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4215-17dc-421d-a3a2-118b1842b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.063193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4215-17dc-421d-a3a2-118b1842b91f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.063736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4215-17dc-421d-a3a2-118b1842b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.064453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4215-17dc-421d-a3a2-118b1842b91f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.065434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b4215-17dc-421d-a3a2-118b1842b91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.067061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b4215-17dc-421d-a3a2-118b1842b91f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.080031 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 3999/7986] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:14.081857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c988-59dd-44c4-b830-211cdbc69d6f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.082005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c988-59dd-44c4-b830-211cdbc69d6f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.082240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c988-59dd-44c4-b830-211cdbc69d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.087183 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3988/7987] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:14.087183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4215-17dc-421d-a3a2-118b1842b91f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.099087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4215-17dc-421d-a3a2-118b1842b91f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.105393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbd2dc-4bd1-4418-a645-9e9bc8fa67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.106140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd2dc-4bd1-4418-a645-9e9bc8fa67df admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.106413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd2dc-4bd1-4418-a645-9e9bc8fa67df admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.107132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd2dc-4bd1-4418-a645-9e9bc8fa67df admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.107522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbd2dc-4bd1-4418-a645-9e9bc8fa67df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.110174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbd2dc-4bd1-4418-a645-9e9bc8fa67df admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.112260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6672c988-59dd-44c4-b830-211cdbc69d6f None None] MFA Rules not processed for user `7a05b7fc8855434991bb054d5bde4091`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:14.113611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6672c988-59dd-44c4-b830-211cdbc69d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:14.145787 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3989/7988] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:14 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:14.145997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbd2dc-4bd1-4418-a645-9e9bc8fa67df admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.205591 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4000/7989] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:14.207063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672c988-59dd-44c4-b830-211cdbc69d6f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.223513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672c988-59dd-44c4-b830-211cdbc69d6f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.243342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbd2dc-4bd1-4418-a645-9e9bc8fa67df admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.249014 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.250008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.250365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.250713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] PATH_INFO: `/v3/projects/23d1e8bdb8cc4a4d98556d0d7995b580/users/3cebe98eca534f919bde143936e10f4c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.272164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d1e8bdb8cc4a4d98556d0d7995b580, user_id=3cebe98eca534f919bde143936e10f4c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.275000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.293767 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3990/7990] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:14 2022] PUT /identity/v3/projects/23d1e8bdb8cc4a4d98556d0d7995b580/users/3cebe98eca534f919bde143936e10f4c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:14.294765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.296858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:14.309754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0ddea-36e2-41b3-abb7-30bb8355dd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.310345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ddea-36e2-41b3-abb7-30bb8355dd90 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.311080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ddea-36e2-41b3-abb7-30bb8355dd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.311362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ddea-36e2-41b3-abb7-30bb8355dd90 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.312182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0ddea-36e2-41b3-abb7-30bb8355dd90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.314738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0ddea-36e2-41b3-abb7-30bb8355dd90 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.344863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4001/7991] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:14 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:14.345797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0ddea-36e2-41b3-abb7-30bb8355dd90 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.357772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0ddea-36e2-41b3-abb7-30bb8355dd90 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.380259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fb6ef-0c84-45b2-a029-8e01c69930c2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.386876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036df30-1811-44f5-b0bc-89ead02406a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.388287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036df30-1811-44f5-b0bc-89ead02406a3 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.388852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036df30-1811-44f5-b0bc-89ead02406a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.389995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036df30-1811-44f5-b0bc-89ead02406a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.440221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcd8d0-f246-4f9b-ad36-d24b30cc673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.451332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd8d0-f246-4f9b-ad36-d24b30cc673e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.451332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd8d0-f246-4f9b-ad36-d24b30cc673e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.451567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd8d0-f246-4f9b-ad36-d24b30cc673e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.452285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcd8d0-f246-4f9b-ad36-d24b30cc673e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.455040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcd8d0-f246-4f9b-ad36-d24b30cc673e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.471725 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4002/7992] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:14.472625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcd8d0-f246-4f9b-ad36-d24b30cc673e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.484667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcd8d0-f246-4f9b-ad36-d24b30cc673e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.490730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14666225-335c-4ead-8d33-83223983247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.491527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14666225-335c-4ead-8d33-83223983247a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.491947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14666225-335c-4ead-8d33-83223983247a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.492383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14666225-335c-4ead-8d33-83223983247a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.493051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14666225-335c-4ead-8d33-83223983247a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.494833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14666225-335c-4ead-8d33-83223983247a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.513693 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4003/7993] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:14.519868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14666225-335c-4ead-8d33-83223983247a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.540786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14666225-335c-4ead-8d33-83223983247a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.541359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036df30-1811-44f5-b0bc-89ead02406a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.544137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036df30-1811-44f5-b0bc-89ead02406a3 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.551024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998c86a-144f-4c21-b6cf-cbe9678a6406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.553769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998c86a-144f-4c21-b6cf-cbe9678a6406 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.554052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998c86a-144f-4c21-b6cf-cbe9678a6406 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.554327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998c86a-144f-4c21-b6cf-cbe9678a6406 admin admin] PATH_INFO: `/v3/projects/23d1e8bdb8cc4a4d98556d0d7995b580/users/3cebe98eca534f919bde143936e10f4c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.566872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998c86a-144f-4c21-b6cf-cbe9678a6406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d1e8bdb8cc4a4d98556d0d7995b580, user_id=3cebe98eca534f919bde143936e10f4c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.569738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998c86a-144f-4c21-b6cf-cbe9678a6406 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.580412 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3991/7994] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:14.581678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036df30-1811-44f5-b0bc-89ead02406a3 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.591566 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4004/7995] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:14 2022] PUT /identity/v3/projects/23d1e8bdb8cc4a4d98556d0d7995b580/users/3cebe98eca534f919bde143936e10f4c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:14.642136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036df30-1811-44f5-b0bc-89ead02406a3 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.818678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8efb-14b7-4d8a-b50e-c766815a9fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.819724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8efb-14b7-4d8a-b50e-c766815a9fee admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.820021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8efb-14b7-4d8a-b50e-c766815a9fee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.820605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8efb-14b7-4d8a-b50e-c766815a9fee admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.821912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c8efb-14b7-4d8a-b50e-c766815a9fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.825821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c8efb-14b7-4d8a-b50e-c766815a9fee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.846906 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3992/7996] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:14.850636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998c86a-144f-4c21-b6cf-cbe9678a6406 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:14.868081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998c86a-144f-4c21-b6cf-cbe9678a6406 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:14.883992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059b2c-b82b-429d-bd62-2733f25e4b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:14.885785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059b2c-b82b-429d-bd62-2733f25e4b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.886097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059b2c-b82b-429d-bd62-2733f25e4b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.886436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059b2c-b82b-429d-bd62-2733f25e4b7a admin admin] PATH_INFO: `/v3/projects/210223ff58554db884e168484787b048/users/ebd939b425554b0e8d592f325c325da2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:14.910795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059b2c-b82b-429d-bd62-2733f25e4b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=210223ff58554db884e168484787b048, user_id=ebd939b425554b0e8d592f325c325da2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:14.914294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059b2c-b82b-429d-bd62-2733f25e4b7a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:14.959728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4005/7997] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:14 2022] PUT /identity/v3/projects/210223ff58554db884e168484787b048/users/ebd939b425554b0e8d592f325c325da2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:14.970628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97c3a-1d0f-423c-91af-f6a8872055c8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:14.971245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97c3a-1d0f-423c-91af-f6a8872055c8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:14.971713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97c3a-1d0f-423c-91af-f6a8872055c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:15.012302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6ba97c3a-1d0f-423c-91af-f6a8872055c8 None None] MFA Rules not processed for user `ebd939b425554b0e8d592f325c325da2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:15.014272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6ba97c3a-1d0f-423c-91af-f6a8872055c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:15.147588 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3993/7998] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:15.153620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059b2c-b82b-429d-bd62-2733f25e4b7a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:15.279035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059b2c-b82b-429d-bd62-2733f25e4b7a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:15.284228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:15.285775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:15.286619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:15.286619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:15.287459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:15.289909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:15.342391 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4006/7999] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:15 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:15.344191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba97c3a-1d0f-423c-91af-f6a8872055c8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:15.358984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba97c3a-1d0f-423c-91af-f6a8872055c8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:15.544102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:15.546489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:15.557946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872528f4-c91b-4505-8137-e7ce74cab719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:15.564176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872528f4-c91b-4505-8137-e7ce74cab719 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:15.567389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872528f4-c91b-4505-8137-e7ce74cab719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:15.568132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872528f4-c91b-4505-8137-e7ce74cab719 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:15.569093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872528f4-c91b-4505-8137-e7ce74cab719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:15.582753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872528f4-c91b-4505-8137-e7ce74cab719 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:15.630671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d41da-7ec4-40e3-a914-c435f95fb928 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:15.635068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:15.635737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:15.636051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:15.636355 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:15.642224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:15.650558 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3994/8000] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:15 2022] POST /identity/v3/users => generated 291 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:15.651937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872528f4-c91b-4505-8137-e7ce74cab719 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:15.714461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872528f4-c91b-4505-8137-e7ce74cab719 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:15.736402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5daf8e-775b-4d57-af93-cfcd0c34e3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:15.738517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5daf8e-775b-4d57-af93-cfcd0c34e3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:15.738977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5daf8e-775b-4d57-af93-cfcd0c34e3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:15.739431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5daf8e-775b-4d57-af93-cfcd0c34e3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:15.740668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5daf8e-775b-4d57-af93-cfcd0c34e3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:15.743700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5daf8e-775b-4d57-af93-cfcd0c34e3f6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:15.836139 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3995/8001] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:15.842843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5daf8e-775b-4d57-af93-cfcd0c34e3f6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:15.862319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:15.868219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:15.885685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5daf8e-775b-4d57-af93-cfcd0c34e3f6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:15.904095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd102a-3e31-4168-b83c-baa26a8c30fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:15.907636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd102a-3e31-4168-b83c-baa26a8c30fa admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:15.907636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd102a-3e31-4168-b83c-baa26a8c30fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:15.914643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd102a-3e31-4168-b83c-baa26a8c30fa admin admin] PATH_INFO: `/v3/projects/80f883b5de6b457f8982de7bf9490f2c/users/0e827fd9bed1426daf7795d576ace712/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:15.927057 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4007/8002] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:15.975142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd102a-3e31-4168-b83c-baa26a8c30fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f883b5de6b457f8982de7bf9490f2c, user_id=0e827fd9bed1426daf7795d576ace712, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:15.980709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd102a-3e31-4168-b83c-baa26a8c30fa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:16.024761 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3996/8003] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:15 2022] PUT /identity/v3/projects/80f883b5de6b457f8982de7bf9490f2c/users/0e827fd9bed1426daf7795d576ace712/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:16.031910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:16.073917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e017a-db94-4246-bd5e-73e96463b42b service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:16.301455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71697fe2-6e2b-4b26-8ba6-d8f1a0895d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:16.315141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697fe2-6e2b-4b26-8ba6-d8f1a0895d9b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:16.315496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697fe2-6e2b-4b26-8ba6-d8f1a0895d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:16.315789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697fe2-6e2b-4b26-8ba6-d8f1a0895d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:16.316847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71697fe2-6e2b-4b26-8ba6-d8f1a0895d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:16.321825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71697fe2-6e2b-4b26-8ba6-d8f1a0895d9b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:16.352597 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4008/8004] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:19:16.358543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd102a-3e31-4168-b83c-baa26a8c30fa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:16.379027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd102a-3e31-4168-b83c-baa26a8c30fa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:16.384235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ce2b6-7ebe-474b-8c40-f60dee01aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:16.385218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ce2b6-7ebe-474b-8c40-f60dee01aea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:16.385696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ce2b6-7ebe-474b-8c40-f60dee01aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:16.386660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ce2b6-7ebe-474b-8c40-f60dee01aea1 admin admin] PATH_INFO: `/v3/projects/80f883b5de6b457f8982de7bf9490f2c/users/0e827fd9bed1426daf7795d576ace712/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:16.390567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ce2b6-7ebe-474b-8c40-f60dee01aea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f883b5de6b457f8982de7bf9490f2c, user_id=0e827fd9bed1426daf7795d576ace712, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:16.395348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ce2b6-7ebe-474b-8c40-f60dee01aea1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:16.416134 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3997/8005] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:16 2022] PUT /identity/v3/projects/80f883b5de6b457f8982de7bf9490f2c/users/0e827fd9bed1426daf7795d576ace712/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:16.435447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827e07-0e66-4d63-80c0-366bf2b15483 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:16.436042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827e07-0e66-4d63-80c0-366bf2b15483 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:16.436528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827e07-0e66-4d63-80c0-366bf2b15483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:16.525089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-78827e07-0e66-4d63-80c0-366bf2b15483 None None] MFA Rules not processed for user `0e827fd9bed1426daf7795d576ace712`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:16.526366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-78827e07-0e66-4d63-80c0-366bf2b15483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:16.840691 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4009/8006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:16.850957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ce2b6-7ebe-474b-8c40-f60dee01aea1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:16.972035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ce2b6-7ebe-474b-8c40-f60dee01aea1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:16.976142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c4528-92a2-4bc1-b8e5-f1929f9ccb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:16.976922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c4528-92a2-4bc1-b8e5-f1929f9ccb3b service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:16.977211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c4528-92a2-4bc1-b8e5-f1929f9ccb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:16.977491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c4528-92a2-4bc1-b8e5-f1929f9ccb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:17.007241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c4528-92a2-4bc1-b8e5-f1929f9ccb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:17.009834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c4528-92a2-4bc1-b8e5-f1929f9ccb3b service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:17.028165 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3998/8007] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:18.355057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827e07-0e66-4d63-80c0-366bf2b15483 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:18.356729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-78827e07-0e66-4d63-80c0-366bf2b15483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:18.538525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827e07-0e66-4d63-80c0-366bf2b15483 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:18.557348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:18.558485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:18.558875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:18.559260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] PATH_INFO: `/v3/users/db4a5b6cdc794245accceea56f14567b` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:18.562218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4a5b6cdc794245accceea56f14567b)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:18.565173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:18.654545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4a5b6cdc794245accceea56f14567b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:18.655649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4a5b6cdc794245accceea56f14567b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:18.657110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4a5b6cdc794245accceea56f14567b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:18.673584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4a5b6cdc794245accceea56f14567b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:18.686184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4a5b6cdc794245accceea56f14567b'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:18.709174 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4010/8008] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:18 2022] DELETE /identity/v3/users/db4a5b6cdc794245accceea56f14567b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:18.713698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13b57-d8bf-4d71-ab89-14db54c3e9d9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:18.714254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13b57-d8bf-4d71-ab89-14db54c3e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:18.714352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13b57-d8bf-4d71-ab89-14db54c3e9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:18.740229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c8a13b57-d8bf-4d71-ab89-14db54c3e9d9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:18.747353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c8a13b57-d8bf-4d71-ab89-14db54c3e9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:18.897583 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 3999/8009] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:18.914558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:18.916083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:19.043377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472fc82-1a0e-4611-9cff-29bf578fbaa1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:19.056675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b41c9d-62e9-4c36-8b16-dc4757a6e9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:19.057572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b41c9d-62e9-4c36-8b16-dc4757a6e9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:19.058573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b41c9d-62e9-4c36-8b16-dc4757a6e9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:19.059021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b41c9d-62e9-4c36-8b16-dc4757a6e9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:19.085287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b41c9d-62e9-4c36-8b16-dc4757a6e9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:19.086811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b41c9d-62e9-4c36-8b16-dc4757a6e9f3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:19.113867 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4011/8010] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:19.520389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a13b57-d8bf-4d71-ab89-14db54c3e9d9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:19.522336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c8a13b57-d8bf-4d71-ab89-14db54c3e9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:19.542836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a13b57-d8bf-4d71-ab89-14db54c3e9d9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:19.550512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:19.551890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:19.552425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:19.552961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] PATH_INFO: `/v3/users/ebd939b425554b0e8d592f325c325da2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:19.555023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd939b425554b0e8d592f325c325da2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:19.557302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:19.663137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd939b425554b0e8d592f325c325da2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:19.719195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd939b425554b0e8d592f325c325da2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:19.753109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd939b425554b0e8d592f325c325da2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:19.754160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd939b425554b0e8d592f325c325da2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:19.755059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd939b425554b0e8d592f325c325da2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:19.788718 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4000/8011] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:19 2022] DELETE /identity/v3/users/ebd939b425554b0e8d592f325c325da2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:19.791681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4a98-c236-412b-9196-c9b2d0b5e2d4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:19.792778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4a98-c236-412b-9196-c9b2d0b5e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:19.793221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4a98-c236-412b-9196-c9b2d0b5e2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:19.821173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2cdc4a98-c236-412b-9196-c9b2d0b5e2d4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:19.838271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:19.841761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:19.844418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2cdc4a98-c236-412b-9196-c9b2d0b5e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:20.002197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3454a6-de67-4325-9b5b-e8005694e79a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:20.017089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:20.021728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:20.022326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:20.022788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] PATH_INFO: `/v3/projects/637118d588ee46e5ab20e412e96a9c40` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:20.026840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=637118d588ee46e5ab20e412e96a9c40)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:20.029892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:20.045507 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4012/8012] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:20.091482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc4a98-c236-412b-9196-c9b2d0b5e2d4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:20.094200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2cdc4a98-c236-412b-9196-c9b2d0b5e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:20.098251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637118d588ee46e5ab20e412e96a9c40', 'request_id': 'req-e5e30131-4d19-4c17-87a7-e23920130bde'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.109293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637118d588ee46e5ab20e412e96a9c40', 'request_id': 'req-e5e30131-4d19-4c17-87a7-e23920130bde'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.150061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637118d588ee46e5ab20e412e96a9c40', 'request_id': 'req-e5e30131-4d19-4c17-87a7-e23920130bde'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.168615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] The token cache is being invalidate because project 637118d588ee46e5ab20e412e96a9c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:20.168905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.170108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.172429 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4001/8013] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:19 2022] DELETE /identity/v3/projects/637118d588ee46e5ab20e412e96a9c40 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:20.176259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:20.189022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:20.297508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc4a98-c236-412b-9196-c9b2d0b5e2d4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:20.369407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e30131-4d19-4c17-87a7-e23920130bde admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:20.389507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:20.390705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:20.391201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:20.391658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] PATH_INFO: `/v3/users/509de2cdfaa9432494f80fcbc5419012` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:20.394494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=509de2cdfaa9432494f80fcbc5419012)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:20.396319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:20.399005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:20.400181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:20.403088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:20.403461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:20.409685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:20.437729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:20.441022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:20.466870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509de2cdfaa9432494f80fcbc5419012'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.478078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4013/8014] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:20.487295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509de2cdfaa9432494f80fcbc5419012'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.504093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509de2cdfaa9432494f80fcbc5419012'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.505327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509de2cdfaa9432494f80fcbc5419012'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.506463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509de2cdfaa9432494f80fcbc5419012'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.536342 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4002/8015] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:20 2022] DELETE /identity/v3/users/509de2cdfaa9432494f80fcbc5419012 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:20.841468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:20.843484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:20.862836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c901ee7-1726-4779-ad01-9cf5fa28f8bd service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:20.936419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:20.937279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:20.937593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:20.937901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] PATH_INFO: `/v3/projects/210223ff58554db884e168484787b048` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:20.939305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210223ff58554db884e168484787b048)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:20.941453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:20.989419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210223ff58554db884e168484787b048', 'request_id': 'req-ec05867f-0646-4868-9eca-d12d3b6a9f37'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:20.994960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210223ff58554db884e168484787b048', 'request_id': 'req-ec05867f-0646-4868-9eca-d12d3b6a9f37'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.004740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210223ff58554db884e168484787b048', 'request_id': 'req-ec05867f-0646-4868-9eca-d12d3b6a9f37'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.018304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] The token cache is being invalidate because project 210223ff58554db884e168484787b048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:21.018595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.019627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.021301 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4014/8016] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:20 2022] DELETE /identity/v3/projects/210223ff58554db884e168484787b048 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:21.025243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:21.027304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:21.041439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da502c-7d26-43b3-ab65-52f234ecac7a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:21.128292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:21.129573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:21.130076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:21.130539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] PATH_INFO: `/v3/users/0e827fd9bed1426daf7795d576ace712` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:21.136053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e827fd9bed1426daf7795d576ace712)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:21.139678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:21.227239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e827fd9bed1426daf7795d576ace712'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.245722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e827fd9bed1426daf7795d576ace712'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.262488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e827fd9bed1426daf7795d576ace712'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.264199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e827fd9bed1426daf7795d576ace712'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.265747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e827fd9bed1426daf7795d576ace712'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.294482 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4003/8017] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:21 2022] DELETE /identity/v3/users/0e827fd9bed1426daf7795d576ace712 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:21.388348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:21.390477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:21.538112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05867f-0646-4868-9eca-d12d3b6a9f37 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:21.600551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:21.602591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:21.740235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:21.741130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:21.741502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:21.741862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:21.744299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:21.788832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed9e31-5601-4b76-b267-506fc1aea17f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:21.794671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:21.795485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:21.795901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:21.796065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] PATH_INFO: `/v3/projects/52c73964c8564c5aac8fa2003ef2f623` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:21.797581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c73964c8564c5aac8fa2003ef2f623)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:21.799632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:21.845536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:21.849006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:21.866751 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4015/8018] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:21.868180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:21.870822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:21.876527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c73964c8564c5aac8fa2003ef2f623', 'request_id': 'req-e515bb72-5327-4711-9be1-aa1023fd9405'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.888139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c73964c8564c5aac8fa2003ef2f623', 'request_id': 'req-e515bb72-5327-4711-9be1-aa1023fd9405'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.893239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ac2b0-ff13-4fc1-8979-52df59e75c22 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:21.904873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c73964c8564c5aac8fa2003ef2f623', 'request_id': 'req-e515bb72-5327-4711-9be1-aa1023fd9405'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.934239 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] The token cache is being invalidate because project 52c73964c8564c5aac8fa2003ef2f623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:21.936154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.938158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e515bb72-5327-4711-9be1-aa1023fd9405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:21.953594 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4004/8019] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:21 2022] DELETE /identity/v3/projects/52c73964c8564c5aac8fa2003ef2f623 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:21.955838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fed4-b2c0-4e52-9792-7b19ed9ef792 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:21.955838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fed4-b2c0-4e52-9792-7b19ed9ef792 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:21.955838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fed4-b2c0-4e52-9792-7b19ed9ef792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:21.976032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:21.977084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:21.977659 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:21.978002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] PATH_INFO: `/v3/projects/80f883b5de6b457f8982de7bf9490f2c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:21.982136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f883b5de6b457f8982de7bf9490f2c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:21.984282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:21.993781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fbc4fed4-b2c0-4e52-9792-7b19ed9ef792 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:21.995035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fbc4fed4-b2c0-4e52-9792-7b19ed9ef792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:22.012048 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4005/8020] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:22.020191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64760a-9936-46c9-b65a-de239bc773ad None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.020425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64760a-9936-46c9-b65a-de239bc773ad None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.020696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64760a-9936-46c9-b65a-de239bc773ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.054453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1d64760a-9936-46c9-b65a-de239bc773ad None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:22.055673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1d64760a-9936-46c9-b65a-de239bc773ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:22.058923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f883b5de6b457f8982de7bf9490f2c', 'request_id': 'req-69ca92d3-6716-44eb-8deb-7d6372518532'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:22.065432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f883b5de6b457f8982de7bf9490f2c', 'request_id': 'req-69ca92d3-6716-44eb-8deb-7d6372518532'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:22.079030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f883b5de6b457f8982de7bf9490f2c', 'request_id': 'req-69ca92d3-6716-44eb-8deb-7d6372518532'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:22.103329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] The token cache is being invalidate because project 80f883b5de6b457f8982de7bf9490f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:22.103976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:22.106128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69ca92d3-6716-44eb-8deb-7d6372518532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:22.108545 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4016/8021] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:21 2022] DELETE /identity/v3/projects/80f883b5de6b457f8982de7bf9490f2c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:22.114924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d2c26-cd84-4867-80e1-168ba95c1b39 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.115701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d2c26-cd84-4867-80e1-168ba95c1b39 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.116192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d2c26-cd84-4867-80e1-168ba95c1b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.140983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-054d2c26-cd84-4867-80e1-168ba95c1b39 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:22.143422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-054d2c26-cd84-4867-80e1-168ba95c1b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:22.159585 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4006/8022] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:22.164237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64760a-9936-46c9-b65a-de239bc773ad None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.183739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64760a-9936-46c9-b65a-de239bc773ad None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.216148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.217373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.217890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.218401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.219813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:22.226060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.229500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:22.255880 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4017/8023] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:22.264783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4811-043b-441c-9503-4c9cb0a70268 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.265163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4811-043b-441c-9503-4c9cb0a70268 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.265368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4811-043b-441c-9503-4c9cb0a70268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.277560 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4007/8024] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:19:22.288897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.307233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf19258-903c-44d9-90b1-3a651d7fd59c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.315617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bdff4811-043b-441c-9503-4c9cb0a70268 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:22.317176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e1e5-8266-4d29-a303-0cf3771174cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.317739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bdff4811-043b-441c-9503-4c9cb0a70268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:22.318016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e1e5-8266-4d29-a303-0cf3771174cd admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.318508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e1e5-8266-4d29-a303-0cf3771174cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.319734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e1e5-8266-4d29-a303-0cf3771174cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.320746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2e1e5-8266-4d29-a303-0cf3771174cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.323288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2e1e5-8266-4d29-a303-0cf3771174cd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:22.344495 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4018/8025] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:22.347841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4811-043b-441c-9503-4c9cb0a70268 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.365133 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4008/8026] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:22.370266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e1e5-8266-4d29-a303-0cf3771174cd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.374922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4811-043b-441c-9503-4c9cb0a70268 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.459740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e1e5-8266-4d29-a303-0cf3771174cd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.470720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4d83-3163-4f5c-a090-05f99b46961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.471834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4d83-3163-4f5c-a090-05f99b46961a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.472289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4d83-3163-4f5c-a090-05f99b46961a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.473056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4d83-3163-4f5c-a090-05f99b46961a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.474106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c4d83-3163-4f5c-a090-05f99b46961a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.478350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c4d83-3163-4f5c-a090-05f99b46961a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:22.523962 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4009/8027] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:22.530018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4d83-3163-4f5c-a090-05f99b46961a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.531568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da70568-379d-4765-aada-ce081520674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.531733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70568-379d-4765-aada-ce081520674d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.532006 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70568-379d-4765-aada-ce081520674d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.532289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70568-379d-4765-aada-ce081520674d admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.533166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da70568-379d-4765-aada-ce081520674d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:22.533477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da70568-379d-4765-aada-ce081520674d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.535119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da70568-379d-4765-aada-ce081520674d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:22.548194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4d83-3163-4f5c-a090-05f99b46961a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.555382 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4019/8028] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:22.556479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7edaf0-4e12-43af-814f-8b081610273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.557165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7edaf0-4e12-43af-814f-8b081610273b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.557452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7edaf0-4e12-43af-814f-8b081610273b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.557778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7edaf0-4e12-43af-814f-8b081610273b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.559533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da70568-379d-4765-aada-ce081520674d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.559849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7edaf0-4e12-43af-814f-8b081610273b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.562106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7edaf0-4e12-43af-814f-8b081610273b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:22.575007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da70568-379d-4765-aada-ce081520674d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.586042 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4010/8029] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:22.587206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7edaf0-4e12-43af-814f-8b081610273b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.588795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037cad-3802-4c38-bda6-643deeb025e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.593082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037cad-3802-4c38-bda6-643deeb025e7 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.594624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037cad-3802-4c38-bda6-643deeb025e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.595899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037cad-3802-4c38-bda6-643deeb025e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.599887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c037cad-3802-4c38-bda6-643deeb025e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.600273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7edaf0-4e12-43af-814f-8b081610273b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.605825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c037cad-3802-4c38-bda6-643deeb025e7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:22.607671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff62347-7279-432a-ab39-2c00bd7efc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.608535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62347-7279-432a-ab39-2c00bd7efc18 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.608907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62347-7279-432a-ab39-2c00bd7efc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.609255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62347-7279-432a-ab39-2c00bd7efc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.610109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff62347-7279-432a-ab39-2c00bd7efc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.612620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff62347-7279-432a-ab39-2c00bd7efc18 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:22.633699 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4011/8030] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:22.635007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff62347-7279-432a-ab39-2c00bd7efc18 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.655693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff62347-7279-432a-ab39-2c00bd7efc18 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.665155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7450f1-ada2-4643-96c2-d0c08fe8be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.666750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7450f1-ada2-4643-96c2-d0c08fe8be62 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.667247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7450f1-ada2-4643-96c2-d0c08fe8be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.667802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7450f1-ada2-4643-96c2-d0c08fe8be62 admin admin] PATH_INFO: `/v3/projects/36b519bb226646c799b0c36222f3e486/users/1675d72ee3614ac5b511f5262a7b659a/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.695458 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4020/8031] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:22.701396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037cad-3802-4c38-bda6-643deeb025e7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:22.710275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7450f1-ada2-4643-96c2-d0c08fe8be62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b519bb226646c799b0c36222f3e486, user_id=1675d72ee3614ac5b511f5262a7b659a, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.715333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7450f1-ada2-4643-96c2-d0c08fe8be62 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:22.764065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4012/8032] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:22 2022] PUT /identity/v3/projects/36b519bb226646c799b0c36222f3e486/users/1675d72ee3614ac5b511f5262a7b659a/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:22.776999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305160b-c884-4906-a0a0-a34e703a54a0 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.777600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305160b-c884-4906-a0a0-a34e703a54a0 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.778117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305160b-c884-4906-a0a0-a34e703a54a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.865599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5305160b-c884-4906-a0a0-a34e703a54a0 None None] MFA Rules not processed for user `1675d72ee3614ac5b511f5262a7b659a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:22.868000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5305160b-c884-4906-a0a0-a34e703a54a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:22.912241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037cad-3802-4c38-bda6-643deeb025e7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:22.989821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b5781-71a6-4f3b-8289-cf0293c7ca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:22.990990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5781-71a6-4f3b-8289-cf0293c7ca37 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:22.991595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5781-71a6-4f3b-8289-cf0293c7ca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:22.991885 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4013/8033] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:22.992292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5781-71a6-4f3b-8289-cf0293c7ca37 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:22.993243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b5781-71a6-4f3b-8289-cf0293c7ca37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:22.996495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305160b-c884-4906-a0a0-a34e703a54a0 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.001003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b5781-71a6-4f3b-8289-cf0293c7ca37 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.013441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305160b-c884-4906-a0a0-a34e703a54a0 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.021295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5fc3c-e43f-4e71-900c-14340c1a2186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.023221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5fc3c-e43f-4e71-900c-14340c1a2186 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.023688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5fc3c-e43f-4e71-900c-14340c1a2186 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.024522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5fc3c-e43f-4e71-900c-14340c1a2186 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.029198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5fc3c-e43f-4e71-900c-14340c1a2186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.033386 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5fc3c-e43f-4e71-900c-14340c1a2186 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.053946 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4021/8034] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/users => generated 288 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:23.059451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b5781-71a6-4f3b-8289-cf0293c7ca37 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.075574 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4014/8035] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:22 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:23.076707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5fc3c-e43f-4e71-900c-14340c1a2186 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.083374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b5781-71a6-4f3b-8289-cf0293c7ca37 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.157932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5fc3c-e43f-4e71-900c-14340c1a2186 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.164071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c26f1-0781-48cd-b45d-425028d26064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.164956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c26f1-0781-48cd-b45d-425028d26064 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.165367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c26f1-0781-48cd-b45d-425028d26064 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.165800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c26f1-0781-48cd-b45d-425028d26064 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.166614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c26f1-0781-48cd-b45d-425028d26064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.169749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c26f1-0781-48cd-b45d-425028d26064 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.197902 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4015/8036] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:23 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:23.202872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c26f1-0781-48cd-b45d-425028d26064 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.213502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26204359-d924-448d-b7f1-c739fc7deee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.215031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204359-d924-448d-b7f1-c739fc7deee0 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.215463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204359-d924-448d-b7f1-c739fc7deee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.215816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204359-d924-448d-b7f1-c739fc7deee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.216719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26204359-d924-448d-b7f1-c739fc7deee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.222243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26204359-d924-448d-b7f1-c739fc7deee0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.229612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c26f1-0781-48cd-b45d-425028d26064 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.240364 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4022/8037] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:23.247704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26204359-d924-448d-b7f1-c739fc7deee0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.248783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8efe-8e2e-4739-8004-568322ffd213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.249552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8efe-8e2e-4739-8004-568322ffd213 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.250008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8efe-8e2e-4739-8004-568322ffd213 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.250325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8efe-8e2e-4739-8004-568322ffd213 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.251082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d8efe-8e2e-4739-8004-568322ffd213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.253051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d8efe-8e2e-4739-8004-568322ffd213 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.272122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26204359-d924-448d-b7f1-c739fc7deee0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.292378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c474-daa0-4b68-94ed-9096a77d90ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.293497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c474-daa0-4b68-94ed-9096a77d90ed admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.293956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c474-daa0-4b68-94ed-9096a77d90ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.294402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c474-daa0-4b68-94ed-9096a77d90ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.295402 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4016/8038] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:23.296258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87c474-daa0-4b68-94ed-9096a77d90ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.296457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8efe-8e2e-4739-8004-568322ffd213 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.297917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87c474-daa0-4b68-94ed-9096a77d90ed admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.311093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8efe-8e2e-4739-8004-568322ffd213 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.318899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5a567-8933-4fb8-b928-d6724ba99d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.319916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a567-8933-4fb8-b928-d6724ba99d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.320307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a567-8933-4fb8-b928-d6724ba99d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.321484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a567-8933-4fb8-b928-d6724ba99d87 admin admin] PATH_INFO: `/v3/projects/1a1569dbd8d74f21bfb9d7b0357305b3/users/d1f7ce4137de416c8854747ada4ba38d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.324848 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4023/8039] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:23.329185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c474-daa0-4b68-94ed-9096a77d90ed admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.348353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5a567-8933-4fb8-b928-d6724ba99d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1569dbd8d74f21bfb9d7b0357305b3, user_id=d1f7ce4137de416c8854747ada4ba38d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.353037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5a567-8933-4fb8-b928-d6724ba99d87 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.354252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c474-daa0-4b68-94ed-9096a77d90ed admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.367973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28070c32-eb7d-4e15-8ab5-005d3dec7679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.370041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070c32-eb7d-4e15-8ab5-005d3dec7679 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.372263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070c32-eb7d-4e15-8ab5-005d3dec7679 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.373438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070c32-eb7d-4e15-8ab5-005d3dec7679 admin admin] PATH_INFO: `/v3/projects/f3044d6158694119ae81b86a83b29a3e/users/3fbbce5546a04545924043a3bb1c31df/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.392414 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4017/8040] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:23 2022] PUT /identity/v3/projects/1a1569dbd8d74f21bfb9d7b0357305b3/users/d1f7ce4137de416c8854747ada4ba38d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:23.397075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5a567-8933-4fb8-b928-d6724ba99d87 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.422099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28070c32-eb7d-4e15-8ab5-005d3dec7679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3044d6158694119ae81b86a83b29a3e, user_id=3fbbce5546a04545924043a3bb1c31df, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.426264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28070c32-eb7d-4e15-8ab5-005d3dec7679 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.448377 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4024/8041] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:23 2022] PUT /identity/v3/projects/f3044d6158694119ae81b86a83b29a3e/users/3fbbce5546a04545924043a3bb1c31df/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:23.460879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41082212-3970-40df-a4ff-dae856844bdb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.462055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41082212-3970-40df-a4ff-dae856844bdb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.463192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41082212-3970-40df-a4ff-dae856844bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.547323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-41082212-3970-40df-a4ff-dae856844bdb None None] MFA Rules not processed for user `3fbbce5546a04545924043a3bb1c31df`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:23.549665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41082212-3970-40df-a4ff-dae856844bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:23.593503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5a567-8933-4fb8-b928-d6724ba99d87 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.663109 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4025/8042] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:23.670621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41082212-3970-40df-a4ff-dae856844bdb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.711365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d20b7-8184-444c-83bd-19e5baf61e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.713663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d20b7-8184-444c-83bd-19e5baf61e8a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.714885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d20b7-8184-444c-83bd-19e5baf61e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.715694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d20b7-8184-444c-83bd-19e5baf61e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.716100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d20b7-8184-444c-83bd-19e5baf61e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.718901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d20b7-8184-444c-83bd-19e5baf61e8a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.757864 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4018/8043] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:23.763056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d20b7-8184-444c-83bd-19e5baf61e8a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.784162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d20b7-8184-444c-83bd-19e5baf61e8a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.803695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cb208-6bb5-4a6a-8d81-ac4c1b11045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.804729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb208-6bb5-4a6a-8d81-ac4c1b11045b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.805436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb208-6bb5-4a6a-8d81-ac4c1b11045b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.805436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb208-6bb5-4a6a-8d81-ac4c1b11045b admin admin] PATH_INFO: `/v3/projects/1a1569dbd8d74f21bfb9d7b0357305b3/users/d1f7ce4137de416c8854747ada4ba38d/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.809329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cb208-6bb5-4a6a-8d81-ac4c1b11045b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1569dbd8d74f21bfb9d7b0357305b3, user_id=d1f7ce4137de416c8854747ada4ba38d, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.817929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cb208-6bb5-4a6a-8d81-ac4c1b11045b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.824863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41082212-3970-40df-a4ff-dae856844bdb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:23.834900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cd04a-5611-40ad-8509-786b45aae7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:23.837266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd04a-5611-40ad-8509-786b45aae7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.837446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd04a-5611-40ad-8509-786b45aae7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.838985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd04a-5611-40ad-8509-786b45aae7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.840976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cd04a-5611-40ad-8509-786b45aae7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:23.846412 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4019/8044] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:23 2022] PUT /identity/v3/projects/1a1569dbd8d74f21bfb9d7b0357305b3/users/d1f7ce4137de416c8854747ada4ba38d/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:23.858484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cd04a-5611-40ad-8509-786b45aae7e9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:23.859586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14513802-d760-4faf-9a3b-fa246451ff2e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:23.862144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14513802-d760-4faf-9a3b-fa246451ff2e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:23.863274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14513802-d760-4faf-9a3b-fa246451ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:23.906818 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4026/8045] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:23 2022] POST /identity/v3/projects => generated 375 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:23.908121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cd04a-5611-40ad-8509-786b45aae7e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:23.920366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-14513802-d760-4faf-9a3b-fa246451ff2e None None] MFA Rules not processed for user `d1f7ce4137de416c8854747ada4ba38d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:23.921619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-14513802-d760-4faf-9a3b-fa246451ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:24.001718 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4020/8046] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:24.013531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14513802-d760-4faf-9a3b-fa246451ff2e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:24.015406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-14513802-d760-4faf-9a3b-fa246451ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:24.091507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cd04a-5611-40ad-8509-786b45aae7e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:24.106906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e219-bcda-4e7d-b2a5-29899315113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:24.109793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e219-bcda-4e7d-b2a5-29899315113f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.110109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e219-bcda-4e7d-b2a5-29899315113f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.110389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e219-bcda-4e7d-b2a5-29899315113f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:24.112483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399e219-bcda-4e7d-b2a5-29899315113f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:24.119731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399e219-bcda-4e7d-b2a5-29899315113f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:24.153198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14513802-d760-4faf-9a3b-fa246451ff2e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:24.158074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a78ff6-8644-4b25-b07e-6a21d7b71390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:24.160473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78ff6-8644-4b25-b07e-6a21d7b71390 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.160473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78ff6-8644-4b25-b07e-6a21d7b71390 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.160473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78ff6-8644-4b25-b07e-6a21d7b71390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:24.175722 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4027/8047] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:23 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:24.181970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e219-bcda-4e7d-b2a5-29899315113f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:24.193329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a78ff6-8644-4b25-b07e-6a21d7b71390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:24.195481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a78ff6-8644-4b25-b07e-6a21d7b71390 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:24.206439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e219-bcda-4e7d-b2a5-29899315113f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:24.216798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7025-efbe-4a25-bf26-0eac0c3e60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:24.219365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7025-efbe-4a25-bf26-0eac0c3e60ef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.219651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7025-efbe-4a25-bf26-0eac0c3e60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.220066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7025-efbe-4a25-bf26-0eac0c3e60ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:24.222697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d7025-efbe-4a25-bf26-0eac0c3e60ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:24.225564 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4021/8048] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:24.225718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d7025-efbe-4a25-bf26-0eac0c3e60ef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:24.237929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4028/8049] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:24.244296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a78ff6-8644-4b25-b07e-6a21d7b71390 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:24.259196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a78ff6-8644-4b25-b07e-6a21d7b71390 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:24.289457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a0542-d11b-4676-ac26-05e3e91b4a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:24.290459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0542-d11b-4676-ac26-05e3e91b4a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.290743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0542-d11b-4676-ac26-05e3e91b4a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.291015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0542-d11b-4676-ac26-05e3e91b4a6b admin admin] PATH_INFO: `/v3/projects/d9cd4788a6cc470c9fd6ca77c8e47c14/users/42bc5e4dd59f40ef9977329908cfe6cf/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:24.330580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a0542-d11b-4676-ac26-05e3e91b4a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cd4788a6cc470c9fd6ca77c8e47c14, user_id=42bc5e4dd59f40ef9977329908cfe6cf, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:24.341160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a0542-d11b-4676-ac26-05e3e91b4a6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:24.381095 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4022/8050] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:24 2022] PUT /identity/v3/projects/d9cd4788a6cc470c9fd6ca77c8e47c14/users/42bc5e4dd59f40ef9977329908cfe6cf/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:24.391502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7025-efbe-4a25-bf26-0eac0c3e60ef admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:24.406205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7025-efbe-4a25-bf26-0eac0c3e60ef admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:24.503173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a0542-d11b-4676-ac26-05e3e91b4a6b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:24.578846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb187c-eeb6-43bf-a4f3-6f36fcaf95dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:24.579553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb187c-eeb6-43bf-a4f3-6f36fcaf95dd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.582828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb187c-eeb6-43bf-a4f3-6f36fcaf95dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.583725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb187c-eeb6-43bf-a4f3-6f36fcaf95dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:24.584094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb187c-eeb6-43bf-a4f3-6f36fcaf95dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:24.591458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb187c-eeb6-43bf-a4f3-6f36fcaf95dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:24.631377 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4029/8051] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:24.631895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb187c-eeb6-43bf-a4f3-6f36fcaf95dd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:24.638609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a0542-d11b-4676-ac26-05e3e91b4a6b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:24.644669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:24.645821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.646272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.647095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] PATH_INFO: `/v3/users/1675d72ee3614ac5b511f5262a7b659a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:24.652159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1675d72ee3614ac5b511f5262a7b659a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:24.658752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb187c-eeb6-43bf-a4f3-6f36fcaf95dd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:24.658965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:24.671909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c103a34-9126-4b3f-a20d-d1871336edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:24.672872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103a34-9126-4b3f-a20d-d1871336edcb admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.673214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103a34-9126-4b3f-a20d-d1871336edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.673503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103a34-9126-4b3f-a20d-d1871336edcb admin admin] PATH_INFO: `/v3/projects/d9cd4788a6cc470c9fd6ca77c8e47c14/users/42bc5e4dd59f40ef9977329908cfe6cf/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:24.675615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c103a34-9126-4b3f-a20d-d1871336edcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cd4788a6cc470c9fd6ca77c8e47c14, user_id=42bc5e4dd59f40ef9977329908cfe6cf, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:24.680607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c103a34-9126-4b3f-a20d-d1871336edcb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:24.718788 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4030/8052] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:24 2022] PUT /identity/v3/projects/d9cd4788a6cc470c9fd6ca77c8e47c14/users/42bc5e4dd59f40ef9977329908cfe6cf/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:24.732897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb4c28-e041-49c9-853a-f46902adc8e4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.733724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb4c28-e041-49c9-853a-f46902adc8e4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.734255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb4c28-e041-49c9-853a-f46902adc8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:24.778958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1675d72ee3614ac5b511f5262a7b659a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:24.786237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-22eb4c28-e041-49c9-853a-f46902adc8e4 None None] MFA Rules not processed for user `42bc5e4dd59f40ef9977329908cfe6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:24.787951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-22eb4c28-e041-49c9-853a-f46902adc8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:24.836658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1675d72ee3614ac5b511f5262a7b659a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:24.893283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1675d72ee3614ac5b511f5262a7b659a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:24.894904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1675d72ee3614ac5b511f5262a7b659a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:24.909626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5a120500-4376-44eb-a17b-89d4e6e31605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1675d72ee3614ac5b511f5262a7b659a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:24.935650 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4031/8053] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:24.942153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb4c28-e041-49c9-853a-f46902adc8e4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:24.944692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-22eb4c28-e041-49c9-853a-f46902adc8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:24.964026 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4023/8054] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:24 2022] DELETE /identity/v3/users/1675d72ee3614ac5b511f5262a7b659a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:24.966283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7db9a-0889-4481-91d2-e0cec20ff409 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:24.966737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7db9a-0889-4481-91d2-e0cec20ff409 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:24.966975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7db9a-0889-4481-91d2-e0cec20ff409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:25.023900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dcd7db9a-0889-4481-91d2-e0cec20ff409 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:25.026679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dcd7db9a-0889-4481-91d2-e0cec20ff409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:25.086812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb4c28-e041-49c9-853a-f46902adc8e4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:25.148478 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4024/8055] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:25.149555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7db9a-0889-4481-91d2-e0cec20ff409 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:25.150990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dcd7db9a-0889-4481-91d2-e0cec20ff409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:25.170788 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7db9a-0889-4481-91d2-e0cec20ff409 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:25.177263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:25.178310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:25.178871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:25.179153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] PATH_INFO: `/v3/users/7e4927177d744a38bbaa6194d806dffb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:25.180469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4927177d744a38bbaa6194d806dffb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:25.182416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:25.190354 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:25.191031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:25.191314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:25.191589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:25.198099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:25.280072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4927177d744a38bbaa6194d806dffb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:25.302526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:25.304913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:25.329157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4032/8056] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:25.330023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:25.335436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4927177d744a38bbaa6194d806dffb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:25.340625 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:25.363833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4927177d744a38bbaa6194d806dffb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:25.364745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4927177d744a38bbaa6194d806dffb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:25.365428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-76c75a8d-5d79-4226-8c2f-9f315fb1472f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4927177d744a38bbaa6194d806dffb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:25.400316 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4025/8057] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:25 2022] DELETE /identity/v3/users/7e4927177d744a38bbaa6194d806dffb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:25.401979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342158-004b-452a-8da8-46122a98a570 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:25.402232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342158-004b-452a-8da8-46122a98a570 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:25.402511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342158-004b-452a-8da8-46122a98a570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:25.458643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-aa342158-004b-452a-8da8-46122a98a570 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:25.460050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aa342158-004b-452a-8da8-46122a98a570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:25.483179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff1cb9-dd73-4390-b61c-60d91cc91273 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:25.592591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:25.593277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:25.593672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:25.594214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:25.598272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:25.609229 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4026/8058] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:25.632602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:25.634513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:25.641656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa342158-004b-452a-8da8-46122a98a570 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:25.643222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-aa342158-004b-452a-8da8-46122a98a570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:25.653004 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4033/8059] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:25.671063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa342158-004b-452a-8da8-46122a98a570 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:25.682463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9bb1-ed9e-46aa-bf99-8969a06349f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:25.683550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9bb1-ed9e-46aa-bf99-8969a06349f1 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:25.683960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9bb1-ed9e-46aa-bf99-8969a06349f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:25.684235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9bb1-ed9e-46aa-bf99-8969a06349f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:25.710311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe9bb1-ed9e-46aa-bf99-8969a06349f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:25.712188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe9bb1-ed9e-46aa-bf99-8969a06349f1 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:25.748436 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4027/8060] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:27.405140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:27.407160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:27.428293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53889b11-4020-46a2-9dd6-776f0047a354 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:27.444821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:27.445691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:27.446748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:27.446748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] PATH_INFO: `/v3/projects/cb3ac6e5295f46929a6ec974f83f62e2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:27.447829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3ac6e5295f46929a6ec974f83f62e2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:27.450500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:27.595609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3ac6e5295f46929a6ec974f83f62e2', 'request_id': 'req-ec6dace9-7035-4446-b081-1d84e462ac89'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.608490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3ac6e5295f46929a6ec974f83f62e2', 'request_id': 'req-ec6dace9-7035-4446-b081-1d84e462ac89'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.629083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3ac6e5295f46929a6ec974f83f62e2', 'request_id': 'req-ec6dace9-7035-4446-b081-1d84e462ac89'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.648592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] The token cache is being invalidate because project cb3ac6e5295f46929a6ec974f83f62e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:27.649226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.650163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ec6dace9-7035-4446-b081-1d84e462ac89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.653278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4034/8061] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:27 2022] DELETE /identity/v3/projects/cb3ac6e5295f46929a6ec974f83f62e2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:27.659446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9bb1-ed9e-46aa-bf99-8969a06349f1 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:27.674838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9bb1-ed9e-46aa-bf99-8969a06349f1 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:27.703891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5cae-aebe-496d-b7bf-1aec5f2c01fd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:27.704280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5cae-aebe-496d-b7bf-1aec5f2c01fd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:27.704721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5cae-aebe-496d-b7bf-1aec5f2c01fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:27.757753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-96de5cae-aebe-496d-b7bf-1aec5f2c01fd None None] MFA Rules not processed for user `3cebe98eca534f919bde143936e10f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:27.760551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-96de5cae-aebe-496d-b7bf-1aec5f2c01fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:27.785549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:27.787133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:27.787493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:27.787970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] PATH_INFO: `/v3/users/04e98d2ae24f446c9cd476f49442695a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:27.795479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e98d2ae24f446c9cd476f49442695a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:27.797645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:27.878611 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4035/8062] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:27.888940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e98d2ae24f446c9cd476f49442695a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.919275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5cae-aebe-496d-b7bf-1aec5f2c01fd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:27.923958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-96de5cae-aebe-496d-b7bf-1aec5f2c01fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:27.928180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e98d2ae24f446c9cd476f49442695a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.952979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e98d2ae24f446c9cd476f49442695a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.954825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e98d2ae24f446c9cd476f49442695a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.956142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e98d2ae24f446c9cd476f49442695a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:27.991147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4028/8063] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:27 2022] DELETE /identity/v3/users/04e98d2ae24f446c9cd476f49442695a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:28.045701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5cae-aebe-496d-b7bf-1aec5f2c01fd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:28.162760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:28.163795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:28.174245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:28.177928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:28.178222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:28.178506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:28.187228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:28.381206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91406546-f10f-414c-a0dc-9c760dd860fd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:28.392757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:28.393359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:28.393649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:28.393932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] PATH_INFO: `/v3/projects/36b519bb226646c799b0c36222f3e486` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:28.395337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:28.397650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:28.399534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b519bb226646c799b0c36222f3e486)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:28.406260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:28.421297 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4036/8064] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:28.424134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:28.426370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:28.451726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e419-0b1a-4535-b81d-e3f8e560b986 service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:28.458797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:28.473572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:28.473943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:28.474377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] PATH_INFO: `/v3/users/10a8443c166e46448ec99e9d11ef926e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:28.479875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a8443c166e46448ec99e9d11ef926e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:28.485388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:28.516654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b519bb226646c799b0c36222f3e486', 'request_id': 'req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.547786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b519bb226646c799b0c36222f3e486', 'request_id': 'req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.559213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b519bb226646c799b0c36222f3e486', 'request_id': 'req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.599477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a8443c166e46448ec99e9d11ef926e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.600633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a8443c166e46448ec99e9d11ef926e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.604999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a8443c166e46448ec99e9d11ef926e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.624283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] The token cache is being invalidate because project 36b519bb226646c799b0c36222f3e486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:28.624627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.625711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.627276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a8443c166e46448ec99e9d11ef926e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.634131 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4029/8065] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:28 2022] DELETE /identity/v3/projects/36b519bb226646c799b0c36222f3e486 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:28.634131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:28.638459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:28.642735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a8443c166e46448ec99e9d11ef926e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.667582 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4037/8066] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:28 2022] DELETE /identity/v3/users/10a8443c166e46448ec99e9d11ef926e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:28.668620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:28.670159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:28.818356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0302b-60ea-4f0f-bdf6-11af49ad4525 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:28.830069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:28.830518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e139-7316-44a0-a768-7d7c3733096b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:28.837593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:28.837934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:28.838227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] PATH_INFO: `/v3/users/3fbbce5546a04545924043a3bb1c31df` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:28.840865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:28.841806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:28.842039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:28.842320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] PATH_INFO: `/v3/users/d1f7ce4137de416c8854747ada4ba38d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:28.846925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbbce5546a04545924043a3bb1c31df)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:28.853537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f7ce4137de416c8854747ada4ba38d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:28.858767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:28.864361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:28.944838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbbce5546a04545924043a3bb1c31df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.963434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f7ce4137de416c8854747ada4ba38d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.964984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f7ce4137de416c8854747ada4ba38d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.966984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f7ce4137de416c8854747ada4ba38d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.977882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbbce5546a04545924043a3bb1c31df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.997697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbbce5546a04545924043a3bb1c31df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:28.998590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbbce5546a04545924043a3bb1c31df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.004224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-54cdd895-0179-4367-96c8-6c9ba0357d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbbce5546a04545924043a3bb1c31df'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.013283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f7ce4137de416c8854747ada4ba38d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.030515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f7ce4137de416c8854747ada4ba38d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.038364 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4030/8067] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:28 2022] DELETE /identity/v3/users/3fbbce5546a04545924043a3bb1c31df => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:29.038364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee0c8-0e6f-4326-9a22-b7cfd326be44 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:29.038364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee0c8-0e6f-4326-9a22-b7cfd326be44 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:29.038364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee0c8-0e6f-4326-9a22-b7cfd326be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:29.060401 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4038/8068] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:28 2022] DELETE /identity/v3/users/d1f7ce4137de416c8854747ada4ba38d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:29.062086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:29.066849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:29.076859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-478ee0c8-0e6f-4326-9a22-b7cfd326be44 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:29.080241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-478ee0c8-0e6f-4326-9a22-b7cfd326be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:29.207312 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4031/8069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:29.208737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226284b2-5d31-4dcc-99f4-e2b7f90ddaf7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:29.209034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226284b2-5d31-4dcc-99f4-e2b7f90ddaf7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:29.209320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226284b2-5d31-4dcc-99f4-e2b7f90ddaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:29.257831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-226284b2-5d31-4dcc-99f4-e2b7f90ddaf7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:29.259347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-226284b2-5d31-4dcc-99f4-e2b7f90ddaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:29.270241 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4032/8070] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:29.271362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226284b2-5d31-4dcc-99f4-e2b7f90ddaf7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:29.273116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-226284b2-5d31-4dcc-99f4-e2b7f90ddaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:29.337578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964c959-3da1-4030-9224-f339d511aeb4 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:29.362491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:29.363389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:29.368927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:29.372386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] PATH_INFO: `/v3/projects/f743b48bc04c4adcbf1556ca30e1e1b7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:29.378175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f743b48bc04c4adcbf1556ca30e1e1b7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:29.390292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226284b2-5d31-4dcc-99f4-e2b7f90ddaf7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:29.395631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa1244-fb89-4524-97cb-cb7f61748ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:29.396443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa1244-fb89-4524-97cb-cb7f61748ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:29.396939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa1244-fb89-4524-97cb-cb7f61748ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:29.397211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa1244-fb89-4524-97cb-cb7f61748ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:29.401181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:29.412016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa1244-fb89-4524-97cb-cb7f61748ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:29.413874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa1244-fb89-4524-97cb-cb7f61748ae0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:29.428787 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4033/8071] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:29.430507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa1244-fb89-4524-97cb-cb7f61748ae0 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:29.458633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa1244-fb89-4524-97cb-cb7f61748ae0 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:29.470789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:29.473096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:29.473409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:29.473873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:29.515063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:29.516687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:29.561737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f743b48bc04c4adcbf1556ca30e1e1b7', 'request_id': 'req-b10d1a29-d08c-4678-b069-31dd81376899'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.566075 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4034/8072] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:29.583007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f743b48bc04c4adcbf1556ca30e1e1b7', 'request_id': 'req-b10d1a29-d08c-4678-b069-31dd81376899'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.614422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f743b48bc04c4adcbf1556ca30e1e1b7', 'request_id': 'req-b10d1a29-d08c-4678-b069-31dd81376899'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.634115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] The token cache is being invalidate because project f743b48bc04c4adcbf1556ca30e1e1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:29.634533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.655396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-b10d1a29-d08c-4678-b069-31dd81376899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:29.661727 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4039/8073] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:29 2022] DELETE /identity/v3/projects/f743b48bc04c4adcbf1556ca30e1e1b7 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:29.662959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:29.665505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:29.707701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0240b-d5df-4368-8421-8e75edcf32c5 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:29.897552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:29.898455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:29.898838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:29.899175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] PATH_INFO: `/v3/users/7a05b7fc8855434991bb054d5bde4091` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:29.901050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a05b7fc8855434991bb054d5bde4091)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:29.918077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:30.031806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a05b7fc8855434991bb054d5bde4091'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.070089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a05b7fc8855434991bb054d5bde4091'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.099391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a05b7fc8855434991bb054d5bde4091'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.100169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a05b7fc8855434991bb054d5bde4091'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.102224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a05b7fc8855434991bb054d5bde4091'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.128654 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4035/8074] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:29 2022] DELETE /identity/v3/users/7a05b7fc8855434991bb054d5bde4091 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:30.181753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1299c5-267c-44bc-bf7f-257b0f13401e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:30.182253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1299c5-267c-44bc-bf7f-257b0f13401e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:30.183255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1299c5-267c-44bc-bf7f-257b0f13401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:30.190523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:30.192264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:30.241583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2a1299c5-267c-44bc-bf7f-257b0f13401e None None] MFA Rules not processed for user `e1fde410660b47939139960a9420179a`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:30.256876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a1299c5-267c-44bc-bf7f-257b0f13401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:30.405398 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4040/8075] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:30.455134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b66761-4b32-43c5-b9ef-9c5204baa3d9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:30.464593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:30.465681 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:30.465975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:30.466256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] PATH_INFO: `/v3/projects/1a1569dbd8d74f21bfb9d7b0357305b3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:30.467880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1569dbd8d74f21bfb9d7b0357305b3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:30.470996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:30.565649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1569dbd8d74f21bfb9d7b0357305b3', 'request_id': 'req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.573730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1569dbd8d74f21bfb9d7b0357305b3', 'request_id': 'req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.580772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1299c5-267c-44bc-bf7f-257b0f13401e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:30.582463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2a1299c5-267c-44bc-bf7f-257b0f13401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:30.588267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1569dbd8d74f21bfb9d7b0357305b3', 'request_id': 'req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.605236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1299c5-267c-44bc-bf7f-257b0f13401e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:30.610015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] The token cache is being invalidate because project 1a1569dbd8d74f21bfb9d7b0357305b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:30.610326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.611011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-73ea90b9-7dac-4e83-b85a-a8aae4f047ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.613942 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4036/8076] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:30 2022] DELETE /identity/v3/projects/1a1569dbd8d74f21bfb9d7b0357305b3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:30.619182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a485-2b9e-4136-855e-1a5f3026a063 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:30.619530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a485-2b9e-4136-855e-1a5f3026a063 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:30.619876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a485-2b9e-4136-855e-1a5f3026a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:30.645358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5482a485-2b9e-4136-855e-1a5f3026a063 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:30.646896 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5482a485-2b9e-4136-855e-1a5f3026a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:30.773827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:30.775016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:30.775478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:30.775926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] PATH_INFO: `/v3/projects/f3044d6158694119ae81b86a83b29a3e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:30.777537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3044d6158694119ae81b86a83b29a3e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:30.779751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:30.783615 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4037/8077] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:30.794354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c8db-7300-4860-bbb1-bf42502a17ca None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:30.794661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c8db-7300-4860-bbb1-bf42502a17ca None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:30.795003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c8db-7300-4860-bbb1-bf42502a17ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:30.849444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-58e2c8db-7300-4860-bbb1-bf42502a17ca None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:30.850904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-58e2c8db-7300-4860-bbb1-bf42502a17ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:30.872577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3044d6158694119ae81b86a83b29a3e', 'request_id': 'req-3059edfc-0673-4653-990e-7c4d7aa13ded'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.879984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3044d6158694119ae81b86a83b29a3e', 'request_id': 'req-3059edfc-0673-4653-990e-7c4d7aa13ded'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.890345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3044d6158694119ae81b86a83b29a3e', 'request_id': 'req-3059edfc-0673-4653-990e-7c4d7aa13ded'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.921818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] The token cache is being invalidate because project f3044d6158694119ae81b86a83b29a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:30.922683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.924042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:30.934076 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4041/8078] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:30 2022] DELETE /identity/v3/projects/f3044d6158694119ae81b86a83b29a3e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:30.935054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:30.936793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:30.959208 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4038/8079] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:30.959208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c8db-7300-4860-bbb1-bf42502a17ca None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:30.963294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-58e2c8db-7300-4860-bbb1-bf42502a17ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:30.982120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c8db-7300-4860-bbb1-bf42502a17ca None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:30.993984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:30.995116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:30.995315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:30.996969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] PATH_INFO: `/v3/users/42bc5e4dd59f40ef9977329908cfe6cf` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:30.998966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42bc5e4dd59f40ef9977329908cfe6cf)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:31.003410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:31.084222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059edfc-0673-4653-990e-7c4d7aa13ded admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:31.099955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42bc5e4dd59f40ef9977329908cfe6cf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.101808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:31.103984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:31.104278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:31.104734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] PATH_INFO: `/v3/projects/a3cce9ffe5d04486b69bbf73b537bb3e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:31.107229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cce9ffe5d04486b69bbf73b537bb3e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:31.109483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:31.120558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42bc5e4dd59f40ef9977329908cfe6cf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.144141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42bc5e4dd59f40ef9977329908cfe6cf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.145660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42bc5e4dd59f40ef9977329908cfe6cf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.147376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42bc5e4dd59f40ef9977329908cfe6cf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.179209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4039/8080] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:30 2022] DELETE /identity/v3/users/42bc5e4dd59f40ef9977329908cfe6cf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:31.180199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:31.200459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:31.207638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cce9ffe5d04486b69bbf73b537bb3e', 'request_id': 'req-72198975-6cfc-4a2b-a99d-27fd17dfac93'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.223781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cce9ffe5d04486b69bbf73b537bb3e', 'request_id': 'req-72198975-6cfc-4a2b-a99d-27fd17dfac93'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.242186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cce9ffe5d04486b69bbf73b537bb3e', 'request_id': 'req-72198975-6cfc-4a2b-a99d-27fd17dfac93'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.274034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] The token cache is being invalidate because project a3cce9ffe5d04486b69bbf73b537bb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:31.274339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.275134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.286349 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4042/8081] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:30 2022] DELETE /identity/v3/projects/a3cce9ffe5d04486b69bbf73b537bb3e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:31.286349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:31.288105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:31.374132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d97ae-8c81-4fca-940b-05fe4d52ffc1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:31.379903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:31.380624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:31.380973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:31.381319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:31.384543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:31.384870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:31.388031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:31.412850 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4040/8082] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:31.414077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:31.416485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:31.436457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0684fbc-d82b-4c09-b277-cfbdb457c0b7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:31.451600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:31.456283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:31.456916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:31.457355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] PATH_INFO: `/v3/users/3d3a9946d0aa445dbca7d12f0c0f1e0b` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:31.460154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3a9946d0aa445dbca7d12f0c0f1e0b)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:31.463390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:31.494960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198975-6cfc-4a2b-a99d-27fd17dfac93 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:31.502949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:31.506658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:31.510085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:31.511153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] PATH_INFO: `/v3/projects/65d46a02d8e94d2c85ffd23db5a54343` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:31.516391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d46a02d8e94d2c85ffd23db5a54343)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:31.518903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:31.554088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3a9946d0aa445dbca7d12f0c0f1e0b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.585299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3a9946d0aa445dbca7d12f0c0f1e0b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.602213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3a9946d0aa445dbca7d12f0c0f1e0b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.603066 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3a9946d0aa445dbca7d12f0c0f1e0b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.603689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3a9946d0aa445dbca7d12f0c0f1e0b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.624556 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4041/8083] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:31 2022] DELETE /identity/v3/users/3d3a9946d0aa445dbca7d12f0c0f1e0b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:31.625982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:31.627708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:31.666018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d46a02d8e94d2c85ffd23db5a54343', 'request_id': 'req-ba5ee438-7d57-49e2-8131-1791410ec7d5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.680205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d46a02d8e94d2c85ffd23db5a54343', 'request_id': 'req-ba5ee438-7d57-49e2-8131-1791410ec7d5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.708079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d46a02d8e94d2c85ffd23db5a54343', 'request_id': 'req-ba5ee438-7d57-49e2-8131-1791410ec7d5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.724221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] The token cache is being invalidate because project 65d46a02d8e94d2c85ffd23db5a54343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:31.725084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.725747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e59d9-4117-41fb-97b4-6efbfdc4fce6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:31.730528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b5f5e-5c96-4ccd-83fb-062daf6cf309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:31.731267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5f5e-5c96-4ccd-83fb-062daf6cf309 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:31.731566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5f5e-5c96-4ccd-83fb-062daf6cf309 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:31.731863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5f5e-5c96-4ccd-83fb-062daf6cf309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:31.733396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:31.736453 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4043/8084] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:31 2022] DELETE /identity/v3/projects/65d46a02d8e94d2c85ffd23db5a54343 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:31.737345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:31.742739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:31.744734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ba7b5f5e-5c96-4ccd-83fb-062daf6cf309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:31.775743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b5f5e-5c96-4ccd-83fb-062daf6cf309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:31.780023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b5f5e-5c96-4ccd-83fb-062daf6cf309 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:31.822892 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4042/8085] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:31.828988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20b96-64bb-469d-82be-2b887c4c9fba None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:31.832011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20b96-64bb-469d-82be-2b887c4c9fba None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:31.832720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20b96-64bb-469d-82be-2b887c4c9fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:31.859573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ee438-7d57-49e2-8131-1791410ec7d5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:31.896649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f3a20b96-64bb-469d-82be-2b887c4c9fba None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:31.900299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f3a20b96-64bb-469d-82be-2b887c4c9fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:31.941227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:31.941911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:31.942198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:31.942478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:31.943408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:31.945948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:31.997733 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4044/8086] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:31 2022] POST /identity/v3/projects => generated 383 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:31.999191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.005213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.066362 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4043/8087] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:32.067374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20b96-64bb-469d-82be-2b887c4c9fba None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.085422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20b96-64bb-469d-82be-2b887c4c9fba None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.156751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27049704-0cd2-457c-9e6c-0316293b13a2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.163142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.164807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.165105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.165384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] PATH_INFO: `/v3/projects/1faeda2bd070497183a8ec7172696aca` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.168956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1faeda2bd070497183a8ec7172696aca)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.173538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.215528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.216482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.216777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.217229 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.217939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.220122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.245471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1faeda2bd070497183a8ec7172696aca', 'request_id': 'req-4a183d90-e919-4cce-a9b3-0d19a0d9294a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.251883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1faeda2bd070497183a8ec7172696aca', 'request_id': 'req-4a183d90-e919-4cce-a9b3-0d19a0d9294a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.258668 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4044/8088] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:32.260262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.264473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.274519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1faeda2bd070497183a8ec7172696aca', 'request_id': 'req-4a183d90-e919-4cce-a9b3-0d19a0d9294a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.290217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] The token cache is being invalidate because project 1faeda2bd070497183a8ec7172696aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:32.290596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.291229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a183d90-e919-4cce-a9b3-0d19a0d9294a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.293417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1aa8-1231-4f18-9b9c-177150bdaca1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.297290 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4045/8089] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:31 2022] DELETE /identity/v3/projects/1faeda2bd070497183a8ec7172696aca => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:32.297290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63f00-97fe-471d-9b83-be76024cf140 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.297290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63f00-97fe-471d-9b83-be76024cf140 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.297290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf63f00-97fe-471d-9b83-be76024cf140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.319158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1bf63f00-97fe-471d-9b83-be76024cf140 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:32.320507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1bf63f00-97fe-471d-9b83-be76024cf140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.374778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.376225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.376538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.376816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] PATH_INFO: `/v3/projects/d9cd4788a6cc470c9fd6ca77c8e47c14` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.380648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cd4788a6cc470c9fd6ca77c8e47c14)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.384796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.403657 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4046/8090] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:32.404486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf63f00-97fe-471d-9b83-be76024cf140 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.407050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1bf63f00-97fe-471d-9b83-be76024cf140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.422563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf63f00-97fe-471d-9b83-be76024cf140 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.435701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74882bd3-d545-4a6d-961a-89628fd1ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.436655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882bd3-d545-4a6d-961a-89628fd1ccee admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.437195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882bd3-d545-4a6d-961a-89628fd1ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.437587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882bd3-d545-4a6d-961a-89628fd1ccee admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.438689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74882bd3-d545-4a6d-961a-89628fd1ccee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.440978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74882bd3-d545-4a6d-961a-89628fd1ccee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.459342 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4047/8091] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:32.464662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368dee-8607-4078-982b-6b109da8aeb1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.465114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368dee-8607-4078-982b-6b109da8aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.465505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368dee-8607-4078-982b-6b109da8aeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.474812 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cd4788a6cc470c9fd6ca77c8e47c14', 'request_id': 'req-2ba70239-6184-49ed-b2f2-3f2ee634364e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.485667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cd4788a6cc470c9fd6ca77c8e47c14', 'request_id': 'req-2ba70239-6184-49ed-b2f2-3f2ee634364e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.498185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cd4788a6cc470c9fd6ca77c8e47c14', 'request_id': 'req-2ba70239-6184-49ed-b2f2-3f2ee634364e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.499912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a0368dee-8607-4078-982b-6b109da8aeb1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:32.502145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a0368dee-8607-4078-982b-6b109da8aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.519116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] The token cache is being invalidate because project d9cd4788a6cc470c9fd6ca77c8e47c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:32.519408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.520757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:32.525640 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4045/8092] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:32 2022] DELETE /identity/v3/projects/d9cd4788a6cc470c9fd6ca77c8e47c14 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:32.525640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.527652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.592155 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4048/8093] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:32.593586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0368dee-8607-4078-982b-6b109da8aeb1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.597692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a0368dee-8607-4078-982b-6b109da8aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.613455 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0368dee-8607-4078-982b-6b109da8aeb1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.629647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c431b-1f24-448c-87fc-d08771de63ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.630249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c431b-1f24-448c-87fc-d08771de63ef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.630531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c431b-1f24-448c-87fc-d08771de63ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.630811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c431b-1f24-448c-87fc-d08771de63ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.631691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c431b-1f24-448c-87fc-d08771de63ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.633331 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba70239-6184-49ed-b2f2-3f2ee634364e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.633517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c431b-1f24-448c-87fc-d08771de63ef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.639954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f0a73-f19a-49e2-b186-cb96d46bdd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.640870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0a73-f19a-49e2-b186-cb96d46bdd17 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.641237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0a73-f19a-49e2-b186-cb96d46bdd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.641619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0a73-f19a-49e2-b186-cb96d46bdd17 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.642709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f0a73-f19a-49e2-b186-cb96d46bdd17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:32.643256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f0a73-f19a-49e2-b186-cb96d46bdd17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.645155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f0a73-f19a-49e2-b186-cb96d46bdd17 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.647736 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4049/8094] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:32.649260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acef86-a243-4787-a150-4fa5025df265 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.649610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acef86-a243-4787-a150-4fa5025df265 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.650142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acef86-a243-4787-a150-4fa5025df265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.669627 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4046/8095] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:32.669627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439eaba-60ff-417f-b760-9671a3b5b97f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.669627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439eaba-60ff-417f-b760-9671a3b5b97f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.669627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439eaba-60ff-417f-b760-9671a3b5b97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.673601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f9acef86-a243-4787-a150-4fa5025df265 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:32.675016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f9acef86-a243-4787-a150-4fa5025df265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.686160 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4050/8096] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:32.693679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acef86-a243-4787-a150-4fa5025df265 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.694369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b439eaba-60ff-417f-b760-9671a3b5b97f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:32.696915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b439eaba-60ff-417f-b760-9671a3b5b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.709256 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4047/8097] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:32.709467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439eaba-60ff-417f-b760-9671a3b5b97f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.711644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acef86-a243-4787-a150-4fa5025df265 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.717838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91ab04-e36b-43a7-a1a1-baac66c2e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.718800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ab04-e36b-43a7-a1a1-baac66c2e717 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.719148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ab04-e36b-43a7-a1a1-baac66c2e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.719490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91ab04-e36b-43a7-a1a1-baac66c2e717 admin admin] PATH_INFO: `/v3/projects/8883030dc1c5430d91d508b6e433dd8d/users/00eba8020d984dc4917093efd42a4b1c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.721515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439eaba-60ff-417f-b760-9671a3b5b97f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.727673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47c98-c0ba-42ce-8a89-9e832f9d6316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.728376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47c98-c0ba-42ce-8a89-9e832f9d6316 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.728669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47c98-c0ba-42ce-8a89-9e832f9d6316 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.728950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47c98-c0ba-42ce-8a89-9e832f9d6316 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.730222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47c98-c0ba-42ce-8a89-9e832f9d6316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.732270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47c98-c0ba-42ce-8a89-9e832f9d6316 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.739010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91ab04-e36b-43a7-a1a1-baac66c2e717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8883030dc1c5430d91d508b6e433dd8d, user_id=00eba8020d984dc4917093efd42a4b1c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.741903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91ab04-e36b-43a7-a1a1-baac66c2e717 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.759863 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4051/8098] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:32 2022] PUT /identity/v3/projects/8883030dc1c5430d91d508b6e433dd8d/users/00eba8020d984dc4917093efd42a4b1c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:32.762146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ad6f3-c3c5-4ac8-8675-1311b7a1e268 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.762559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ad6f3-c3c5-4ac8-8675-1311b7a1e268 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.762931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ad6f3-c3c5-4ac8-8675-1311b7a1e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.780530 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4048/8099] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:32.784872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47c98-c0ba-42ce-8a89-9e832f9d6316 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.786609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-455ad6f3-c3c5-4ac8-8675-1311b7a1e268 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:32.788480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-455ad6f3-c3c5-4ac8-8675-1311b7a1e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.863090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47c98-c0ba-42ce-8a89-9e832f9d6316 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.869079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.870762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.871570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.872033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.875894 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4052/8100] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:32.875894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fd50-5050-4b0e-ae18-88f4a2bcb85a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.875894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fd50-5050-4b0e-ae18-88f4a2bcb85a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.875894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fd50-5050-4b0e-ae18-88f4a2bcb85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.876867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:32.877384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.879385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.893965 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4049/8101] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:32.895307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.919389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d0e9fd50-5050-4b0e-ae18-88f4a2bcb85a None None] MFA Rules not processed for user `00eba8020d984dc4917093efd42a4b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:32.920886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d0e9fd50-5050-4b0e-ae18-88f4a2bcb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:32.926684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcae613-af22-4fe1-8b8b-c3236560f27c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.933269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c673c-aa36-43c3-8b9b-b252835f4c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.934236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c673c-aa36-43c3-8b9b-b252835f4c79 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.934517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c673c-aa36-43c3-8b9b-b252835f4c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.934856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c673c-aa36-43c3-8b9b-b252835f4c79 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.935762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c673c-aa36-43c3-8b9b-b252835f4c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.937994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c673c-aa36-43c3-8b9b-b252835f4c79 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:32.969742 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4050/8102] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/users => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:32.970541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c673c-aa36-43c3-8b9b-b252835f4c79 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:32.981867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c673c-aa36-43c3-8b9b-b252835f4c79 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:32.987700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:32.988559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:32.989421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:32.989421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:32.990341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:32.990751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:32.992474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.007256 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4051/8103] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:33.009333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.021542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9c7f-627a-49cc-87eb-fa84638e60cc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.027257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554164d-cc5a-4c63-869e-847716210309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.027996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554164d-cc5a-4c63-869e-847716210309 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.028378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554164d-cc5a-4c63-869e-847716210309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.028721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554164d-cc5a-4c63-869e-847716210309 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.029579 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554164d-cc5a-4c63-869e-847716210309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.031651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554164d-cc5a-4c63-869e-847716210309 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.040282 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4053/8104] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:33.040282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fd50-5050-4b0e-ae18-88f4a2bcb85a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.054884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fd50-5050-4b0e-ae18-88f4a2bcb85a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.061411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.063000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.063483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.063859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.065179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.067052 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4052/8105] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:33.067593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.071173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554164d-cc5a-4c63-869e-847716210309 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.084799 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4054/8106] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:33.085808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.089687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:33.156182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554164d-cc5a-4c63-869e-847716210309 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.162027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f2170-0424-4851-9850-a6de32db8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.162402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f2170-0424-4851-9850-a6de32db8862 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.162680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f2170-0424-4851-9850-a6de32db8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.162951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f2170-0424-4851-9850-a6de32db8862 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.163650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f2170-0424-4851-9850-a6de32db8862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.165783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f2170-0424-4851-9850-a6de32db8862 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.182335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d697e53-433e-44a7-bbf4-6e38db6791b1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.211172 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4053/8107] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:33.212884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f2170-0424-4851-9850-a6de32db8862 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.264302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0ea7f-c24b-42b9-9f97-ad20bb048313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.265028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0ea7f-c24b-42b9-9f97-ad20bb048313 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.265314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0ea7f-c24b-42b9-9f97-ad20bb048313 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.265594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0ea7f-c24b-42b9-9f97-ad20bb048313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.291329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f2170-0424-4851-9850-a6de32db8862 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.297257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fcf8a-60a7-4307-b8e5-fe4ac93ff228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.297879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcf8a-60a7-4307-b8e5-fe4ac93ff228 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.298207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcf8a-60a7-4307-b8e5-fe4ac93ff228 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.298447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcf8a-60a7-4307-b8e5-fe4ac93ff228 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.299175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fcf8a-60a7-4307-b8e5-fe4ac93ff228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.305671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fcf8a-60a7-4307-b8e5-fe4ac93ff228 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.335307 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4054/8108] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:33.335307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fcf8a-60a7-4307-b8e5-fe4ac93ff228 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.338032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0ea7f-c24b-42b9-9f97-ad20bb048313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.340050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0ea7f-c24b-42b9-9f97-ad20bb048313 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.345604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fcf8a-60a7-4307-b8e5-fe4ac93ff228 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.349268 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4055/8109] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:33.350035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0ea7f-c24b-42b9-9f97-ad20bb048313 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.350790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f0e3a-1f61-4235-9d67-5c988976b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.351562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0e3a-1f61-4235-9d67-5c988976b540 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.351954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0e3a-1f61-4235-9d67-5c988976b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.352359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0e3a-1f61-4235-9d67-5c988976b540 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.353200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f0e3a-1f61-4235-9d67-5c988976b540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.355847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f0e3a-1f61-4235-9d67-5c988976b540 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.360965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0ea7f-c24b-42b9-9f97-ad20bb048313 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.365956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd89a8d-13c4-4db1-a159-902f0fe6ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.366986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd89a8d-13c4-4db1-a159-902f0fe6ad95 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.367131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd89a8d-13c4-4db1-a159-902f0fe6ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.367320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd89a8d-13c4-4db1-a159-902f0fe6ad95 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.368019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd89a8d-13c4-4db1-a159-902f0fe6ad95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.369594 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4055/8110] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:33.370241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd89a8d-13c4-4db1-a159-902f0fe6ad95 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.370958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f0e3a-1f61-4235-9d67-5c988976b540 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.383994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f0e3a-1f61-4235-9d67-5c988976b540 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.388975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8112f57-8fb9-4e0c-a316-21d2a1380f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.389647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8112f57-8fb9-4e0c-a316-21d2a1380f6d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.389932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8112f57-8fb9-4e0c-a316-21d2a1380f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.390213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8112f57-8fb9-4e0c-a316-21d2a1380f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.392455 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4056/8111] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:33.392620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8112f57-8fb9-4e0c-a316-21d2a1380f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.392731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd89a8d-13c4-4db1-a159-902f0fe6ad95 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.392824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8112f57-8fb9-4e0c-a316-21d2a1380f6d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.402774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd89a8d-13c4-4db1-a159-902f0fe6ad95 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.404109 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4056/8112] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:33.404930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8112f57-8fb9-4e0c-a316-21d2a1380f6d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.408471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96470c-1cfa-42de-bd03-53b89066519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.409378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96470c-1cfa-42de-bd03-53b89066519e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.409662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96470c-1cfa-42de-bd03-53b89066519e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.409939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96470c-1cfa-42de-bd03-53b89066519e admin admin] PATH_INFO: `/v3/projects/e90cde1934f643fbac57cdafb6b448fc/users/53f18e5cf7744e6e8e9509ad27525e99/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.415021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8112f57-8fb9-4e0c-a316-21d2a1380f6d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.420305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.421187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.421500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.421748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] PATH_INFO: `/v3/users/00eba8020d984dc4917093efd42a4b1c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.422957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=00eba8020d984dc4917093efd42a4b1c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.424907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.426064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96470c-1cfa-42de-bd03-53b89066519e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90cde1934f643fbac57cdafb6b448fc, user_id=53f18e5cf7744e6e8e9509ad27525e99, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.428956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96470c-1cfa-42de-bd03-53b89066519e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.443855 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4057/8113] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:33 2022] PUT /identity/v3/projects/e90cde1934f643fbac57cdafb6b448fc/users/53f18e5cf7744e6e8e9509ad27525e99/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:33.444906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96470c-1cfa-42de-bd03-53b89066519e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.494996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00eba8020d984dc4917093efd42a4b1c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:33.510190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00eba8020d984dc4917093efd42a4b1c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:33.515564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96470c-1cfa-42de-bd03-53b89066519e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.520903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00eba8020d984dc4917093efd42a4b1c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:33.521817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00eba8020d984dc4917093efd42a4b1c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:33.523276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3376186-cc1d-4644-945b-ddaa4c2da41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.523842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00eba8020d984dc4917093efd42a4b1c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:33.523976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376186-cc1d-4644-945b-ddaa4c2da41e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.524191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376186-cc1d-4644-945b-ddaa4c2da41e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.524509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376186-cc1d-4644-945b-ddaa4c2da41e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.529504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3376186-cc1d-4644-945b-ddaa4c2da41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.531811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3376186-cc1d-4644-945b-ddaa4c2da41e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.541172 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4057/8114] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:33 2022] DELETE /identity/v3/users/00eba8020d984dc4917093efd42a4b1c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:33.542367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.545246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:33.554175 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4058/8115] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:33.556241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29832e5-664d-441d-8e7a-2d35fd7ae831 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.557322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29832e5-664d-441d-8e7a-2d35fd7ae831 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.557885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29832e5-664d-441d-8e7a-2d35fd7ae831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.616349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b29832e5-664d-441d-8e7a-2d35fd7ae831 None None] MFA Rules not processed for user `53f18e5cf7744e6e8e9509ad27525e99`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:33.617853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b29832e5-664d-441d-8e7a-2d35fd7ae831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:33.659485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc870a3-5713-4f5e-97a7-aa1cd84ff5fd admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.670135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0436a71-37a1-451f-863e-0bd2cf9842dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.671444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0436a71-37a1-451f-863e-0bd2cf9842dd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.672078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0436a71-37a1-451f-863e-0bd2cf9842dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.673158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0436a71-37a1-451f-863e-0bd2cf9842dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.674203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0436a71-37a1-451f-863e-0bd2cf9842dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.676533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0436a71-37a1-451f-863e-0bd2cf9842dd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.689663 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4058/8116] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:33.691056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652668-3ff7-4d3b-bfba-691759ee015c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.691352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652668-3ff7-4d3b-bfba-691759ee015c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.691694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652668-3ff7-4d3b-bfba-691759ee015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.712989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e2652668-3ff7-4d3b-bfba-691759ee015c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:33.715417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2652668-3ff7-4d3b-bfba-691759ee015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:33.728759 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4059/8117] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:33.728759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652668-3ff7-4d3b-bfba-691759ee015c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.728759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2652668-3ff7-4d3b-bfba-691759ee015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:33.739993 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4059/8118] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:33.741507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29832e5-664d-441d-8e7a-2d35fd7ae831 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.744525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652668-3ff7-4d3b-bfba-691759ee015c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.750803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.751476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.751780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.752040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.752808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.754411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.757680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29832e5-664d-441d-8e7a-2d35fd7ae831 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.763322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.764258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.764638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.764989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] PATH_INFO: `/v3/projects/5188e9b532c344be898e2c5b490708c1/users/4989eb5e08d94439b413dae6bfa870e7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.766143 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4060/8119] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:33.767884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.770366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:33.789540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5188e9b532c344be898e2c5b490708c1, user_id=4989eb5e08d94439b413dae6bfa870e7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.792465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.810311 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4060/8120] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:33 2022] PUT /identity/v3/projects/5188e9b532c344be898e2c5b490708c1/users/4989eb5e08d94439b413dae6bfa870e7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:33.810893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.812752 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:33.833746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d6da-d13b-489d-afcc-af17fe85aaae admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.887416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cdb6f-edd8-40c8-8c9a-261d8b785a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.888012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cdb6f-edd8-40c8-8c9a-261d8b785a90 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.888297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cdb6f-edd8-40c8-8c9a-261d8b785a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.888608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cdb6f-edd8-40c8-8c9a-261d8b785a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.898471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cdb6f-edd8-40c8-8c9a-261d8b785a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.899026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e593-38fd-4b1b-9afd-4d838f4693de admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.899908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cdb6f-edd8-40c8-8c9a-261d8b785a90 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.905241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2127a4-939f-432a-be39-39bb2054f412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.905910 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2127a4-939f-432a-be39-39bb2054f412 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.906193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2127a4-939f-432a-be39-39bb2054f412 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.906470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2127a4-939f-432a-be39-39bb2054f412 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.907159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2127a4-939f-432a-be39-39bb2054f412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.909113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2127a4-939f-432a-be39-39bb2054f412 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.911603 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4061/8121] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:33.912892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cdb6f-edd8-40c8-8c9a-261d8b785a90 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:33.922825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cdb6f-edd8-40c8-8c9a-261d8b785a90 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:33.929031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b3fcb-c918-4df7-9199-e8e5e55e9e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:33.930188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3fcb-c918-4df7-9199-e8e5e55e9e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.930508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3fcb-c918-4df7-9199-e8e5e55e9e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.930793 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3fcb-c918-4df7-9199-e8e5e55e9e02 admin admin] PATH_INFO: `/v3/projects/0dc0da4addd54a9db8117f8c935e95ca/users/16cf9ce248b245179934e11c9b45fab6/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.941505 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4061/8122] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:33.942997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ee3d-1783-4553-9557-773f6d868d57 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:33.943388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ee3d-1783-4553-9557-773f6d868d57 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:33.944054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ee3d-1783-4553-9557-773f6d868d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:33.956637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b3fcb-c918-4df7-9199-e8e5e55e9e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc0da4addd54a9db8117f8c935e95ca, user_id=16cf9ce248b245179934e11c9b45fab6, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:33.960899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b3fcb-c918-4df7-9199-e8e5e55e9e02 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:33.990688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7328ee3d-1783-4553-9557-773f6d868d57 None None] MFA Rules not processed for user `4989eb5e08d94439b413dae6bfa870e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:34.001122 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4062/8123] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:33 2022] PUT /identity/v3/projects/0dc0da4addd54a9db8117f8c935e95ca/users/16cf9ce248b245179934e11c9b45fab6/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:34.001122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b3fcb-c918-4df7-9199-e8e5e55e9e02 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.001852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7328ee3d-1783-4553-9557-773f6d868d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:34.113248 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4062/8124] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:34.116698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd848-96fd-43a7-ad79-a2c8e3ad3087 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.117932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd848-96fd-43a7-ad79-a2c8e3ad3087 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.117932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd848-96fd-43a7-ad79-a2c8e3ad3087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.121492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b3fcb-c918-4df7-9199-e8e5e55e9e02 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.128742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1440158-1b72-4ac1-849c-8f8023b6f8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.129547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1440158-1b72-4ac1-849c-8f8023b6f8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.129841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1440158-1b72-4ac1-849c-8f8023b6f8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.130124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1440158-1b72-4ac1-849c-8f8023b6f8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.130824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1440158-1b72-4ac1-849c-8f8023b6f8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.132890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1440158-1b72-4ac1-849c-8f8023b6f8b7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.151618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-859fd848-96fd-43a7-ad79-a2c8e3ad3087 None None] MFA Rules not processed for user `16cf9ce248b245179934e11c9b45fab6`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:34.153020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-859fd848-96fd-43a7-ad79-a2c8e3ad3087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:34.155049 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4063/8125] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:33 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:34.156399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbd724-ffa2-4273-bb14-1e8d522c3bb9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.156694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbd724-ffa2-4273-bb14-1e8d522c3bb9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.157113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbd724-ffa2-4273-bb14-1e8d522c3bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.177061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a4bbd724-ffa2-4273-bb14-1e8d522c3bb9 None None] MFA Rules not processed for user `2af13ad54ab048d495e5ff0c0453abb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:34.178742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4bbd724-ffa2-4273-bb14-1e8d522c3bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:34.246575 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4063/8126] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:34.247461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fd848-96fd-43a7-ad79-a2c8e3ad3087 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.249549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-859fd848-96fd-43a7-ad79-a2c8e3ad3087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:34.263487 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4064/8127] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:34.264144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbd724-ffa2-4273-bb14-1e8d522c3bb9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.298046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbd724-ffa2-4273-bb14-1e8d522c3bb9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.303402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1742e6-0120-410c-9a13-7f62bdd0d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.304164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1742e6-0120-410c-9a13-7f62bdd0d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.304642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1742e6-0120-410c-9a13-7f62bdd0d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.304979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1742e6-0120-410c-9a13-7f62bdd0d3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.305965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1742e6-0120-410c-9a13-7f62bdd0d3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.308321 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1742e6-0120-410c-9a13-7f62bdd0d3ea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.320682 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4065/8128] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:34.321715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1742e6-0120-410c-9a13-7f62bdd0d3ea admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.340083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1742e6-0120-410c-9a13-7f62bdd0d3ea admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.346421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed530c-bd67-4771-8819-06bcd9e88024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.347216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed530c-bd67-4771-8819-06bcd9e88024 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.347598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed530c-bd67-4771-8819-06bcd9e88024 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.348142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed530c-bd67-4771-8819-06bcd9e88024 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.349504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed530c-bd67-4771-8819-06bcd9e88024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.352211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed530c-bd67-4771-8819-06bcd9e88024 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.390714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fd848-96fd-43a7-ad79-a2c8e3ad3087 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.397050 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dd36-18b3-493b-9846-083e2cadf657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.398458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dd36-18b3-493b-9846-083e2cadf657 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.399088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dd36-18b3-493b-9846-083e2cadf657 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.399477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dd36-18b3-493b-9846-083e2cadf657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.404324 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4066/8129] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:34 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:34.405559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed530c-bd67-4771-8819-06bcd9e88024 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.426711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77dd36-18b3-493b-9846-083e2cadf657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.428552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77dd36-18b3-493b-9846-083e2cadf657 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.439181 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4064/8130] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:34.440311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dd36-18b3-493b-9846-083e2cadf657 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.460089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dd36-18b3-493b-9846-083e2cadf657 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.516469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed530c-bd67-4771-8819-06bcd9e88024 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.524318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.526165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.529682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.529682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] PATH_INFO: `/v3/projects/01281172352340b3aef84251965eb5e8/users/66ba7d04bc544334ab3623c19191c534/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.546296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01281172352340b3aef84251965eb5e8, user_id=66ba7d04bc544334ab3623c19191c534, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.548413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a17e-4f85-483b-aa5e-dab509300697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.551588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.551742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a17e-4f85-483b-aa5e-dab509300697 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.551742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a17e-4f85-483b-aa5e-dab509300697 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.551742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a17e-4f85-483b-aa5e-dab509300697 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.551742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73a17e-4f85-483b-aa5e-dab509300697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.552881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73a17e-4f85-483b-aa5e-dab509300697 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.567037 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4067/8131] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:34 2022] PUT /identity/v3/projects/01281172352340b3aef84251965eb5e8/users/66ba7d04bc544334ab3623c19191c534/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:34.567037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.570624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:34.585998 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4065/8132] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:34 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:34.585998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a17e-4f85-483b-aa5e-dab509300697 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.594742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a17e-4f85-483b-aa5e-dab509300697 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.668861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff021b38-3a2a-4fbb-9e48-902e717d37f4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.673833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded167d-ec69-46a1-b373-157b95d05823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.674996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded167d-ec69-46a1-b373-157b95d05823 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.675482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded167d-ec69-46a1-b373-157b95d05823 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.676118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded167d-ec69-46a1-b373-157b95d05823 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.680412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded167d-ec69-46a1-b373-157b95d05823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.683703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded167d-ec69-46a1-b373-157b95d05823 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.687233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.688310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.688778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.689219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] PATH_INFO: `/v3/projects/8883030dc1c5430d91d508b6e433dd8d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.691326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8883030dc1c5430d91d508b6e433dd8d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.694478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.710626 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4066/8133] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:34.710626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded167d-ec69-46a1-b373-157b95d05823 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.732974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded167d-ec69-46a1-b373-157b95d05823 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.749015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc2b9d-4469-4172-976d-1933805a06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.750431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc2b9d-4469-4172-976d-1933805a06fe admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.751072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc2b9d-4469-4172-976d-1933805a06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.751828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc2b9d-4469-4172-976d-1933805a06fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.752849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc2b9d-4469-4172-976d-1933805a06fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.755195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc2b9d-4469-4172-976d-1933805a06fe admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.774214 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4067/8134] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:34.775902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc2b9d-4469-4172-976d-1933805a06fe admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.797001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc2b9d-4469-4172-976d-1933805a06fe admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:34.806915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e002-ad33-482d-966a-4b67125aab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:34.809561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e002-ad33-482d-966a-4b67125aab78 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.812840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e002-ad33-482d-966a-4b67125aab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.813159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e002-ad33-482d-966a-4b67125aab78 admin admin] PATH_INFO: `/v3/projects/01281172352340b3aef84251965eb5e8/users/66ba7d04bc544334ab3623c19191c534/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.820429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8883030dc1c5430d91d508b6e433dd8d', 'request_id': 'req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:34.821373 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78e002-ad33-482d-966a-4b67125aab78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01281172352340b3aef84251965eb5e8, user_id=66ba7d04bc544334ab3623c19191c534, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:34.828568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78e002-ad33-482d-966a-4b67125aab78 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:34.836385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8883030dc1c5430d91d508b6e433dd8d', 'request_id': 'req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:34.857664 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4068/8135] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:34 2022] PUT /identity/v3/projects/01281172352340b3aef84251965eb5e8/users/66ba7d04bc544334ab3623c19191c534/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:34.858976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e002-ad33-482d-966a-4b67125aab78 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:34.859235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8883030dc1c5430d91d508b6e433dd8d', 'request_id': 'req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:34.877755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] The token cache is being invalidate because project 8883030dc1c5430d91d508b6e433dd8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:34.878050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:34.879354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1fc4786a-7f24-48a8-8f7d-7d073f9917e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:34.889676 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4068/8136] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:34 2022] DELETE /identity/v3/projects/8883030dc1c5430d91d508b6e433dd8d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:34.889676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98161e9-7134-4be5-9e64-53165e38d8d8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:34.889676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98161e9-7134-4be5-9e64-53165e38d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:34.890235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98161e9-7134-4be5-9e64-53165e38d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:34.930092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d98161e9-7134-4be5-9e64-53165e38d8d8 None None] MFA Rules not processed for user `66ba7d04bc544334ab3623c19191c534`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:34.931063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d98161e9-7134-4be5-9e64-53165e38d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.009500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e002-ad33-482d-966a-4b67125aab78 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.020476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.022190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.023164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.024093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.025653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.029975 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4069/8137] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:35.031137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245efea-32ab-4254-869b-c7b4fa66b7c9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.031540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245efea-32ab-4254-869b-c7b4fa66b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.031916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245efea-32ab-4254-869b-c7b4fa66b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.032965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.054068 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4069/8138] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:35.055129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:35.060943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0245efea-32ab-4254-869b-c7b4fa66b7c9 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:35.061963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0245efea-32ab-4254-869b-c7b4fa66b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.062624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.072492 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4070/8139] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:35.073966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245efea-32ab-4254-869b-c7b4fa66b7c9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:35.076444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0245efea-32ab-4254-869b-c7b4fa66b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.098937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245efea-32ab-4254-869b-c7b4fa66b7c9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.105303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28048f-1af5-4a29-8918-524a416b8283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.108911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28048f-1af5-4a29-8918-524a416b8283 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.108911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28048f-1af5-4a29-8918-524a416b8283 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.108911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28048f-1af5-4a29-8918-524a416b8283 admin admin] PATH_INFO: `/v3/projects/1197f1831a924689b4513ca1e059d5a5/users/317cc181fda14ab28220349bcd32ad06/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.139947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28048f-1af5-4a29-8918-524a416b8283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1197f1831a924689b4513ca1e059d5a5, user_id=317cc181fda14ab28220349bcd32ad06, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.146047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28048f-1af5-4a29-8918-524a416b8283 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.170065 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4071/8140] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:35 2022] PUT /identity/v3/projects/1197f1831a924689b4513ca1e059d5a5/users/317cc181fda14ab28220349bcd32ad06/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:35.171553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69aa0-a312-4226-94dc-49e1d079c64d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.172023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69aa0-a312-4226-94dc-49e1d079c64d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.172420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69aa0-a312-4226-94dc-49e1d079c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.197061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec52ef5-f09a-477c-96bd-b887d15bfeed admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.208542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-22a69aa0-a312-4226-94dc-49e1d079c64d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:35.211368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-22a69aa0-a312-4226-94dc-49e1d079c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.288005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626aca5-6eca-45ed-96a0-779dc394f46a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.294508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626aca5-6eca-45ed-96a0-779dc394f46a service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.295137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626aca5-6eca-45ed-96a0-779dc394f46a service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.295582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626aca5-6eca-45ed-96a0-779dc394f46a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.334113 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4072/8141] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:35.336481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b64dd-b372-44d5-b607-a5739fc461d9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.337067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b64dd-b372-44d5-b607-a5739fc461d9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.337377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b64dd-b372-44d5-b607-a5739fc461d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.376178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-502b64dd-b372-44d5-b607-a5739fc461d9 None None] MFA Rules not processed for user `317cc181fda14ab28220349bcd32ad06`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:35.377808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-502b64dd-b372-44d5-b607-a5739fc461d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.380099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626aca5-6eca-45ed-96a0-779dc394f46a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.381629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626aca5-6eca-45ed-96a0-779dc394f46a service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.393246 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4070/8142] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:35.393687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626aca5-6eca-45ed-96a0-779dc394f46a service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:35.404649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626aca5-6eca-45ed-96a0-779dc394f46a service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.410509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.411241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.411528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.411812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.412639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:35.412979 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.415155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.451264 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4071/8143] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:35.452903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:35.461698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.472085 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4073/8144] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:35.478983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b64dd-b372-44d5-b607-a5739fc461d9 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:35.485859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162234d-7f06-4d71-a013-7b6cdf8ae649 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.497563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.497563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.497563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.497563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] PATH_INFO: `/v3/users/4989eb5e08d94439b413dae6bfa870e7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.498110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b64dd-b372-44d5-b607-a5739fc461d9 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.499111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4989eb5e08d94439b413dae6bfa870e7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.504028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.504922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf749-ac4c-4363-9134-439f2ae4c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.505841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf749-ac4c-4363-9134-439f2ae4c7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.506119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf749-ac4c-4363-9134-439f2ae4c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.506459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf749-ac4c-4363-9134-439f2ae4c7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.507628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccf749-ac4c-4363-9134-439f2ae4c7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.509908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccf749-ac4c-4363-9134-439f2ae4c7a1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.552908 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4074/8145] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:35 2022] POST /identity/v3/projects => generated 361 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:35.554365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf749-ac4c-4363-9134-439f2ae4c7a1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:35.591813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4989eb5e08d94439b413dae6bfa870e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:35.592556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4989eb5e08d94439b413dae6bfa870e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:35.593565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4989eb5e08d94439b413dae6bfa870e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:35.610758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4989eb5e08d94439b413dae6bfa870e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:35.625559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4989eb5e08d94439b413dae6bfa870e7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:35.641207 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4072/8146] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:35 2022] DELETE /identity/v3/users/4989eb5e08d94439b413dae6bfa870e7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:35.642562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:35.644704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.647900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf749-ac4c-4363-9134-439f2ae4c7a1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.741314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59258a-966f-4014-b41b-5f2b77de5aab admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.747311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645f2b-fa1e-4850-ac8f-f16624f23742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.748507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645f2b-fa1e-4850-ac8f-f16624f23742 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.749052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645f2b-fa1e-4850-ac8f-f16624f23742 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.750524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645f2b-fa1e-4850-ac8f-f16624f23742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.753492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-01645f2b-fa1e-4850-ac8f-f16624f23742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.755942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.756805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.757158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.757498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.758280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.760402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.812022 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4075/8147] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:35 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:35.812422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:35.818748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:35.894650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01645f2b-fa1e-4850-ac8f-f16624f23742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.900701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01645f2b-fa1e-4850-ac8f-f16624f23742 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.919357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b22418-6991-46ad-812b-419ec53dff9e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:35.926742 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4073/8148] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:35.933212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaac209-9653-4e11-a035-2b06dd75f4cb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.934308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaac209-9653-4e11-a035-2b06dd75f4cb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.937413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:35.938004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaac209-9653-4e11-a035-2b06dd75f4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.948504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:35.949114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:35.954070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:35.955494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:35.969722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:35.980676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-aaaac209-9653-4e11-a035-2b06dd75f4cb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:35.988415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aaaac209-9653-4e11-a035-2b06dd75f4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:36.010003 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4074/8149] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:36.011552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaac209-9653-4e11-a035-2b06dd75f4cb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.023938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-aaaac209-9653-4e11-a035-2b06dd75f4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:36.039025 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4076/8150] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:35 2022] POST /identity/v3/users => generated 281 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:36.040360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.043924 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:36.045056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaac209-9653-4e11-a035-2b06dd75f4cb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.052623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124ae7-fb16-4383-b4a0-2228959b36f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.053247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124ae7-fb16-4383-b4a0-2228959b36f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.053532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124ae7-fb16-4383-b4a0-2228959b36f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.053817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124ae7-fb16-4383-b4a0-2228959b36f3 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.054520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86124ae7-fb16-4383-b4a0-2228959b36f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.056528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86124ae7-fb16-4383-b4a0-2228959b36f3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.100605 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4075/8151] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:36 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:36.106349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124ae7-fb16-4383-b4a0-2228959b36f3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.128079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124ae7-fb16-4383-b4a0-2228959b36f3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.138629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65654f79-fb8e-4441-a98b-d40aaae3bbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.139513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65654f79-fb8e-4441-a98b-d40aaae3bbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.140062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65654f79-fb8e-4441-a98b-d40aaae3bbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.140945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65654f79-fb8e-4441-a98b-d40aaae3bbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.142235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65654f79-fb8e-4441-a98b-d40aaae3bbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.144536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65654f79-fb8e-4441-a98b-d40aaae3bbe6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.166546 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4076/8152] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:36.167639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65654f79-fb8e-4441-a98b-d40aaae3bbe6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.172436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78ca3c-2e17-4dbc-af7d-974f026dbcae admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.179198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d7d8a-1db0-4cda-a30e-bc56a4bb3a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.180289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d7d8a-1db0-4cda-a30e-bc56a4bb3a7a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.180651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d7d8a-1db0-4cda-a30e-bc56a4bb3a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.181030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d7d8a-1db0-4cda-a30e-bc56a4bb3a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.185709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65654f79-fb8e-4441-a98b-d40aaae3bbe6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.191041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce8f96-8687-4d2b-9af4-9c3f2ce939dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.192475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce8f96-8687-4d2b-9af4-9c3f2ce939dd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.192765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce8f96-8687-4d2b-9af4-9c3f2ce939dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.193112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce8f96-8687-4d2b-9af4-9c3f2ce939dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.194018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce8f96-8687-4d2b-9af4-9c3f2ce939dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.195005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d7d8a-1db0-4cda-a30e-bc56a4bb3a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.195651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce8f96-8687-4d2b-9af4-9c3f2ce939dd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.197652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d7d8a-1db0-4cda-a30e-bc56a4bb3a7a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.211448 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4077/8153] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:36.212369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce8f96-8687-4d2b-9af4-9c3f2ce939dd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.214691 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4077/8154] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:36.215911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d7d8a-1db0-4cda-a30e-bc56a4bb3a7a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.229811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce8f96-8687-4d2b-9af4-9c3f2ce939dd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.230477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d7d8a-1db0-4cda-a30e-bc56a4bb3a7a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.236315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6ccc7-2503-4c6b-a1ea-5339e4908638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.236635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275f1b4-aa1d-4ea1-9d6a-7ddaea0b9248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.237489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275f1b4-aa1d-4ea1-9d6a-7ddaea0b9248 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.237944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275f1b4-aa1d-4ea1-9d6a-7ddaea0b9248 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.238521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275f1b4-aa1d-4ea1-9d6a-7ddaea0b9248 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.239426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275f1b4-aa1d-4ea1-9d6a-7ddaea0b9248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.242139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275f1b4-aa1d-4ea1-9d6a-7ddaea0b9248 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.247929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6ccc7-2503-4c6b-a1ea-5339e4908638 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.247929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6ccc7-2503-4c6b-a1ea-5339e4908638 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.247929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6ccc7-2503-4c6b-a1ea-5339e4908638 admin admin] PATH_INFO: `/v3/projects/bf070a82152b4cf6b48efb2d2aa994d5/users/94acceb35d9044da932540f5efc40e5c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.256211 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4078/8155] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:36.262472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275f1b4-aa1d-4ea1-9d6a-7ddaea0b9248 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.279953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6ccc7-2503-4c6b-a1ea-5339e4908638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf070a82152b4cf6b48efb2d2aa994d5, user_id=94acceb35d9044da932540f5efc40e5c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.285587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6ccc7-2503-4c6b-a1ea-5339e4908638 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.314238 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4078/8156] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:36 2022] PUT /identity/v3/projects/bf070a82152b4cf6b48efb2d2aa994d5/users/94acceb35d9044da932540f5efc40e5c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:36.317394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275f1b4-aa1d-4ea1-9d6a-7ddaea0b9248 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.318828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6ccc7-2503-4c6b-a1ea-5339e4908638 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.487389 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6ccc7-2503-4c6b-a1ea-5339e4908638 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.512762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27ef7-34bb-427d-bbca-549773680899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.512762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27ef7-34bb-427d-bbca-549773680899 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.512762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27ef7-34bb-427d-bbca-549773680899 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.512762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27ef7-34bb-427d-bbca-549773680899 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.513714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27ef7-34bb-427d-bbca-549773680899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.515432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27ef7-34bb-427d-bbca-549773680899 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.549123 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4079/8157] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:19:36.553028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27ef7-34bb-427d-bbca-549773680899 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.559428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a0f34-feb6-444a-88b1-f94c43022462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.561839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0f34-feb6-444a-88b1-f94c43022462 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.562148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0f34-feb6-444a-88b1-f94c43022462 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.562431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0f34-feb6-444a-88b1-f94c43022462 admin admin] PATH_INFO: `/v3/projects/71462d79fd0c4a13a7e0d3ad2914439c/users/37b452c1ccfc4c72b2e3425a3e85e95e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.577696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27ef7-34bb-427d-bbca-549773680899 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.596579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a0f34-feb6-444a-88b1-f94c43022462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71462d79fd0c4a13a7e0d3ad2914439c, user_id=37b452c1ccfc4c72b2e3425a3e85e95e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.598629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcee89-40a9-4d5d-a900-9b58e549133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.599552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcee89-40a9-4d5d-a900-9b58e549133f admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.599837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcee89-40a9-4d5d-a900-9b58e549133f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.600104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcee89-40a9-4d5d-a900-9b58e549133f admin admin] PATH_INFO: `/v3/projects/bf070a82152b4cf6b48efb2d2aa994d5/users/94acceb35d9044da932540f5efc40e5c/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.601330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a0f34-feb6-444a-88b1-f94c43022462 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.610006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcee89-40a9-4d5d-a900-9b58e549133f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf070a82152b4cf6b48efb2d2aa994d5, user_id=94acceb35d9044da932540f5efc40e5c, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:36.617534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcee89-40a9-4d5d-a900-9b58e549133f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:36.634093 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4079/8158] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:36 2022] PUT /identity/v3/projects/71462d79fd0c4a13a7e0d3ad2914439c/users/37b452c1ccfc4c72b2e3425a3e85e95e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:36.646005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc31c5-d37e-4304-befc-f54654f08842 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.646712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc31c5-d37e-4304-befc-f54654f08842 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.647243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc31c5-d37e-4304-befc-f54654f08842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.648915 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4080/8159] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:36 2022] PUT /identity/v3/projects/bf070a82152b4cf6b48efb2d2aa994d5/users/94acceb35d9044da932540f5efc40e5c/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:36.659703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582e66f-91d1-478f-9b4b-37089292b608 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.660045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582e66f-91d1-478f-9b4b-37089292b608 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.660264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582e66f-91d1-478f-9b4b-37089292b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:36.693472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ddbc31c5-d37e-4304-befc-f54654f08842 None None] MFA Rules not processed for user `37b452c1ccfc4c72b2e3425a3e85e95e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:36.695113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ddbc31c5-d37e-4304-befc-f54654f08842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:36.765532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e582e66f-91d1-478f-9b4b-37089292b608 None None] MFA Rules not processed for user `94acceb35d9044da932540f5efc40e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:36.769322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e582e66f-91d1-478f-9b4b-37089292b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:36.804982 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4080/8160] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:36.835913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc31c5-d37e-4304-befc-f54654f08842 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.837837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ddbc31c5-d37e-4304-befc-f54654f08842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:36.913177 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4081/8161] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:36.926482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582e66f-91d1-478f-9b4b-37089292b608 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:36.966700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc31c5-d37e-4304-befc-f54654f08842 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:36.974921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:36.986294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:36.988988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:36.989480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.010027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:37.018339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:37.039380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582e66f-91d1-478f-9b4b-37089292b608 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:37.045490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:37.046778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.047286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.047775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.053406 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4081/8162] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:37.054356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:37.055037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:37.056276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:37.158866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:37.160563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:37.170313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff506e5-e591-4b4a-8c28-5c139effe608 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:37.171959 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4082/8163] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:37.173052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:37.176184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:37.177104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.177543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.177723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] PATH_INFO: `/v3/projects/5188e9b532c344be898e2c5b490708c1` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.179174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5188e9b532c344be898e2c5b490708c1)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:37.181321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:37.191197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64fc5-8b26-4215-9ec1-68baaba7128e service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:37.197360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:37.199236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.199524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.200216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] PATH_INFO: `/v3/users/37b452c1ccfc4c72b2e3425a3e85e95e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.201531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b452c1ccfc4c72b2e3425a3e85e95e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:37.203451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:37.259216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b452c1ccfc4c72b2e3425a3e85e95e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.270552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5188e9b532c344be898e2c5b490708c1', 'request_id': 'req-96f4948d-164b-49f9-9854-f91c62576e45'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.275180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5188e9b532c344be898e2c5b490708c1', 'request_id': 'req-96f4948d-164b-49f9-9854-f91c62576e45'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.281871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b452c1ccfc4c72b2e3425a3e85e95e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.290215 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5188e9b532c344be898e2c5b490708c1', 'request_id': 'req-96f4948d-164b-49f9-9854-f91c62576e45'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.297460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b452c1ccfc4c72b2e3425a3e85e95e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.298511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b452c1ccfc4c72b2e3425a3e85e95e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.300021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-41cc0190-0d8e-464a-a19f-f61e39231210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b452c1ccfc4c72b2e3425a3e85e95e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.310234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] The token cache is being invalidate because project 5188e9b532c344be898e2c5b490708c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:37.310672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.311572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-96f4948d-164b-49f9-9854-f91c62576e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:37.316374 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4082/8164] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:37 2022] DELETE /identity/v3/projects/5188e9b532c344be898e2c5b490708c1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:37.321260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02978f-9598-4bbb-955e-142cc91db64c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.321553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02978f-9598-4bbb-955e-142cc91db64c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.321839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02978f-9598-4bbb-955e-142cc91db64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.347249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1e02978f-9598-4bbb-955e-142cc91db64c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:37.348636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1e02978f-9598-4bbb-955e-142cc91db64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:37.349319 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4083/8165] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:37 2022] DELETE /identity/v3/users/37b452c1ccfc4c72b2e3425a3e85e95e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:37.362464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de511-912e-406e-8cdc-2ac5b2b2107e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.363730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de511-912e-406e-8cdc-2ac5b2b2107e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.364295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de511-912e-406e-8cdc-2ac5b2b2107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.421040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-df3de511-912e-406e-8cdc-2ac5b2b2107e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:37.426302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-df3de511-912e-406e-8cdc-2ac5b2b2107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:37.439895 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4083/8166] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:37.442068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35607cc7-c550-45ad-a52f-4d40945a4db2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.444016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35607cc7-c550-45ad-a52f-4d40945a4db2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.444323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35607cc7-c550-45ad-a52f-4d40945a4db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.457236 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4084/8167] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:37.465564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3de511-912e-406e-8cdc-2ac5b2b2107e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:37.467293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-df3de511-912e-406e-8cdc-2ac5b2b2107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:37.480102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-35607cc7-c550-45ad-a52f-4d40945a4db2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:37.482085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-35607cc7-c550-45ad-a52f-4d40945a4db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:37.494206 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4084/8168] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:37.499715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35607cc7-c550-45ad-a52f-4d40945a4db2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:37.512693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35607cc7-c550-45ad-a52f-4d40945a4db2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:37.537090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:37.538587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.539213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.540930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.542747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:37.543673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:37.547032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:37.575959 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4085/8169] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:37.579544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:37.598782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1747cc-b087-4925-9050-c163410c3efc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:37.607181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3de511-912e-406e-8cdc-2ac5b2b2107e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:37.614008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4958-c408-4fbb-b9c7-8149388aa189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:37.615441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4958-c408-4fbb-b9c7-8149388aa189 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.616202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4958-c408-4fbb-b9c7-8149388aa189 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.617459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4958-c408-4fbb-b9c7-8149388aa189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.619020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ed558-cd71-42d7-a036-30679d7ce532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:37.619880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed558-cd71-42d7-a036-30679d7ce532 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.620697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed558-cd71-42d7-a036-30679d7ce532 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.622432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed558-cd71-42d7-a036-30679d7ce532 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.623246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ed558-cd71-42d7-a036-30679d7ce532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:37.628587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ed558-cd71-42d7-a036-30679d7ce532 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:37.642475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc4958-c408-4fbb-b9c7-8149388aa189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:37.644013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc4958-c408-4fbb-b9c7-8149388aa189 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:37.666380 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4085/8170] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:37.689909 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4086/8171] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:37 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:37.703291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4958-c408-4fbb-b9c7-8149388aa189 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:37.717838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4958-c408-4fbb-b9c7-8149388aa189 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:37.890360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afcb4e-9c53-453d-a0fb-0600d64279b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:37.891078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcb4e-9c53-453d-a0fb-0600d64279b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:37.891374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcb4e-9c53-453d-a0fb-0600d64279b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:37.891660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcb4e-9c53-453d-a0fb-0600d64279b0 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:37.892407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afcb4e-9c53-453d-a0fb-0600d64279b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:37.899383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afcb4e-9c53-453d-a0fb-0600d64279b0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:37.972199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4086/8172] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:37 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:37.976551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ed558-cd71-42d7-a036-30679d7ce532 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:37.994654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ed558-cd71-42d7-a036-30679d7ce532 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:38.007852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c97c7-447b-42c2-9b96-9b5744f7a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:38.008697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c97c7-447b-42c2-9b96-9b5744f7a144 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.011935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c97c7-447b-42c2-9b96-9b5744f7a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.013038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c97c7-447b-42c2-9b96-9b5744f7a144 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.014504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c97c7-447b-42c2-9b96-9b5744f7a144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:38.018573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c97c7-447b-42c2-9b96-9b5744f7a144 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:38.090006 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4087/8173] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:38.092057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afcb4e-9c53-453d-a0fb-0600d64279b0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:38.110357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afcb4e-9c53-453d-a0fb-0600d64279b0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:38.125366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:38.126104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.126387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.127248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.127399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:38.131954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:38.176847 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4087/8174] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:38.181318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c97c7-447b-42c2-9b96-9b5744f7a144 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:38.201357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c97c7-447b-42c2-9b96-9b5744f7a144 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:38.217894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3ca0d-10cf-4613-9958-f1afad577239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:38.219163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ca0d-10cf-4613-9958-f1afad577239 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.219163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ca0d-10cf-4613-9958-f1afad577239 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.219434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ca0d-10cf-4613-9958-f1afad577239 admin admin] PATH_INFO: `/v3/projects/0536dcef551e4e76a62fb8fd56a36335/users/2c6817b44b9841de843d33297449df5d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.253126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3ca0d-10cf-4613-9958-f1afad577239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0536dcef551e4e76a62fb8fd56a36335, user_id=2c6817b44b9841de843d33297449df5d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:38.257481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3ca0d-10cf-4613-9958-f1afad577239 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:38.279481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:38.281345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:38.292029 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4088/8175] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:38 2022] PUT /identity/v3/projects/0536dcef551e4e76a62fb8fd56a36335/users/2c6817b44b9841de843d33297449df5d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:38.294093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf1642-bc47-4c76-885b-3507ebe1867e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.294383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf1642-bc47-4c76-885b-3507ebe1867e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.294703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf1642-bc47-4c76-885b-3507ebe1867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.311294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d966a72-c771-46ca-8384-3d07887cda62 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:38.366309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-25bf1642-bc47-4c76-885b-3507ebe1867e None None] MFA Rules not processed for user `2c6817b44b9841de843d33297449df5d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:38.372176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25bf1642-bc47-4c76-885b-3507ebe1867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:38.465075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:38.467468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.467468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.467859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] PATH_INFO: `/v3/projects/71462d79fd0c4a13a7e0d3ad2914439c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.472787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71462d79fd0c4a13a7e0d3ad2914439c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:38.481021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:38.494349 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4089/8176] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:38.518990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf1642-bc47-4c76-885b-3507ebe1867e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:38.579548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71462d79fd0c4a13a7e0d3ad2914439c', 'request_id': 'req-db0c9e7e-e058-4d0f-ad96-063effc1df9a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:38.591575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71462d79fd0c4a13a7e0d3ad2914439c', 'request_id': 'req-db0c9e7e-e058-4d0f-ad96-063effc1df9a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:38.607530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71462d79fd0c4a13a7e0d3ad2914439c', 'request_id': 'req-db0c9e7e-e058-4d0f-ad96-063effc1df9a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:38.625708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] The token cache is being invalidate because project 71462d79fd0c4a13a7e0d3ad2914439c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:38.626064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:38.627179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-db0c9e7e-e058-4d0f-ad96-063effc1df9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:38.632442 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4088/8177] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:38 2022] DELETE /identity/v3/projects/71462d79fd0c4a13a7e0d3ad2914439c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:38.634099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422dc75-03a0-4ef4-bc68-f29eb9127492 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.634392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422dc75-03a0-4ef4-bc68-f29eb9127492 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.634678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422dc75-03a0-4ef4-bc68-f29eb9127492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.637983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf1642-bc47-4c76-885b-3507ebe1867e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:38.655436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7422dc75-03a0-4ef4-bc68-f29eb9127492 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:38.656711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7422dc75-03a0-4ef4-bc68-f29eb9127492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:38.716386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:38.716971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.717388 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.717797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.749083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:38.752034 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4089/8178] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:38.759261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e527f3-ce5d-4e7c-adcf-1569b9b3e642 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.759899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e527f3-ce5d-4e7c-adcf-1569b9b3e642 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.760585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e527f3-ce5d-4e7c-adcf-1569b9b3e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.788392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e1e527f3-ce5d-4e7c-adcf-1569b9b3e642 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:38.790447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e1e527f3-ce5d-4e7c-adcf-1569b9b3e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:38.804231 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4090/8179] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:38.819395 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e527f3-ce5d-4e7c-adcf-1569b9b3e642 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:38.844072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e527f3-ce5d-4e7c-adcf-1569b9b3e642 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:38.861254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:38.863077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:38.863219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:38.864145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.864472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.865149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.866664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:38.867002 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:38.870625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:38.877911 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4090/8180] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:38.888519 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4091/8181] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:38.891633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:38.940462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097ede-e09f-4823-bfee-51a380a9c069 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:38.955278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:38.956245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:38.956568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:38.956848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:38.957712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:38.963091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:39.025509 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4091/8182] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:38 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:39.030008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:39.055516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d4a44-1fe7-4fba-a772-3e54f228cce4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:39.090685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:39.093582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:39.250147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdbba-0ce4-48d9-8b2e-054ce1f7f207 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:39.254973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:39.259425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:39.259425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:39.259694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:39.259801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:39.259900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:39.260003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:39.260100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:39.260100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:39.262622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:39.263144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:39.305503 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4092/8183] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:39 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:39.306557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:39.309045 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:39.330543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ba22-e456-4f45-89e9-639d3e49c3af admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:39.353809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:39.355478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:39.357180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:39.357621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] PATH_INFO: `/v3/users/53f18e5cf7744e6e8e9509ad27525e99` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:39.359139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f18e5cf7744e6e8e9509ad27525e99)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:39.363370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:39.385083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:39.390387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:39.417943 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4092/8184] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:39.418918 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:39.448808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d98e9-6e0b-4e7c-a2e4-cdbe1dd9e850 service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:39.461747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe2ce-85de-4e76-9c27-a9914637eb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:39.462641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe2ce-85de-4e76-9c27-a9914637eb6e admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:39.463111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe2ce-85de-4e76-9c27-a9914637eb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:39.463563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe2ce-85de-4e76-9c27-a9914637eb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:39.465325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fe2ce-85de-4e76-9c27-a9914637eb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:39.467157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fe2ce-85de-4e76-9c27-a9914637eb6e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:39.492266 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4093/8185] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:39.496218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe2ce-85de-4e76-9c27-a9914637eb6e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:39.517928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f18e5cf7744e6e8e9509ad27525e99'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:39.522192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe2ce-85de-4e76-9c27-a9914637eb6e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:39.538972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6a93-0820-4bc0-8ffa-78c76cfea255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:39.539612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6a93-0820-4bc0-8ffa-78c76cfea255 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:39.539881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6a93-0820-4bc0-8ffa-78c76cfea255 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:39.540129 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6a93-0820-4bc0-8ffa-78c76cfea255 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:39.542019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb6a93-0820-4bc0-8ffa-78c76cfea255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:39.544553 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb6a93-0820-4bc0-8ffa-78c76cfea255 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:39.561122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f18e5cf7744e6e8e9509ad27525e99'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:39.570640 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4094/8186] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:19:39.572069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6a93-0820-4bc0-8ffa-78c76cfea255 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:39.584478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6a93-0820-4bc0-8ffa-78c76cfea255 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:39.589741 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f18e5cf7744e6e8e9509ad27525e99'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:39.590754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f18e5cf7744e6e8e9509ad27525e99'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:39.591540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a4ea37da-47a4-4ecf-81c7-abed533248b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f18e5cf7744e6e8e9509ad27525e99'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:39.604572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c010fc1-c09b-4b19-9479-76db4457c196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:39.606248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010fc1-c09b-4b19-9479-76db4457c196 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:39.606817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010fc1-c09b-4b19-9479-76db4457c196 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:39.608476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010fc1-c09b-4b19-9479-76db4457c196 admin admin] PATH_INFO: `/v3/projects/3b206f017e904c07af8dc6c35551790c/users/f9fb3af08ada44e185561b0e96f5fa22/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:39.612071 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4093/8187] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:39 2022] DELETE /identity/v3/users/53f18e5cf7744e6e8e9509ad27525e99 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:39.617056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1381-ff5f-42b4-a3ff-291ffe77b465 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:39.617476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1381-ff5f-42b4-a3ff-291ffe77b465 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:39.621525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1381-ff5f-42b4-a3ff-291ffe77b465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:39.650067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c010fc1-c09b-4b19-9479-76db4457c196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b206f017e904c07af8dc6c35551790c, user_id=f9fb3af08ada44e185561b0e96f5fa22, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:39.656367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c010fc1-c09b-4b19-9479-76db4457c196 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:39.664876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e97e1381-ff5f-42b4-a3ff-291ffe77b465 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:39.668834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e97e1381-ff5f-42b4-a3ff-291ffe77b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:39.709880 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4095/8188] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:39 2022] PUT /identity/v3/projects/3b206f017e904c07af8dc6c35551790c/users/f9fb3af08ada44e185561b0e96f5fa22/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:39.722937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692edc-0b46-4aac-9fb5-a817312d9e0c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:39.723330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692edc-0b46-4aac-9fb5-a817312d9e0c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:39.723707 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692edc-0b46-4aac-9fb5-a817312d9e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:39.779443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b0692edc-0b46-4aac-9fb5-a817312d9e0c None None] MFA Rules not processed for user `f9fb3af08ada44e185561b0e96f5fa22`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:39.780886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0692edc-0b46-4aac-9fb5-a817312d9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:39.860442 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4094/8189] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:39.889070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e1381-ff5f-42b4-a3ff-291ffe77b465 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:39.890545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e97e1381-ff5f-42b4-a3ff-291ffe77b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:39.958434 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4096/8190] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:39.970250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692edc-0b46-4aac-9fb5-a817312d9e0c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:39.975397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0692edc-0b46-4aac-9fb5-a817312d9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:40.000226 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e1381-ff5f-42b4-a3ff-291ffe77b465 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:40.099397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:40.101613 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:40.103012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:40.104184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:40.120407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692edc-0b46-4aac-9fb5-a817312d9e0c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:40.124865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:40.125585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:40.125874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:40.126172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:40.137067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:40.138821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:40.165308 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4097/8191] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:40.288142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:40.294247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:40.328187 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4095/8192] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:40.584274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:40.588487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:40.611688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6c882-bced-408d-a9d9-aa7a3decc9ac service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:40.618135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:40.618943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:40.621236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:40.622772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:40.625278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:40.722263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:40.724580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:40.744204 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4098/8193] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:40.861527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:40.863107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:40.889502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b8eb-03a7-4a97-8fee-6b038d3c119b service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:40.903583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:40.906183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:40.906572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:40.906780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] PATH_INFO: `/v3/projects/e90cde1934f643fbac57cdafb6b448fc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:40.908601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90cde1934f643fbac57cdafb6b448fc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:40.910928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:40.996149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90cde1934f643fbac57cdafb6b448fc', 'request_id': 'req-1339c9ea-b1e6-4763-8653-72aaaed68ecb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.004519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90cde1934f643fbac57cdafb6b448fc', 'request_id': 'req-1339c9ea-b1e6-4763-8653-72aaaed68ecb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.018137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90cde1934f643fbac57cdafb6b448fc', 'request_id': 'req-1339c9ea-b1e6-4763-8653-72aaaed68ecb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.037319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] The token cache is being invalidate because project e90cde1934f643fbac57cdafb6b448fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:41.037721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.038830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.041521 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4096/8194] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:40 2022] DELETE /identity/v3/projects/e90cde1934f643fbac57cdafb6b448fc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:41.046039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:41.062809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281fdf5-cc68-4403-8971-97a0038d223a service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:41.208449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:41.209697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:41.212855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:41.213711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] PATH_INFO: `/v3/users/66ba7d04bc544334ab3623c19191c534` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:41.219559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ba7d04bc544334ab3623c19191c534)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:41.226550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:41.378501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ba7d04bc544334ab3623c19191c534'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.380377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ba7d04bc544334ab3623c19191c534'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.387022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ba7d04bc544334ab3623c19191c534'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.414562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ba7d04bc544334ab3623c19191c534'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.425722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-764d7bea-b378-4321-bbed-196307f0bc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ba7d04bc544334ab3623c19191c534'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:41.451317 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4099/8195] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:41 2022] DELETE /identity/v3/users/66ba7d04bc544334ab3623c19191c534 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:42.050228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:42.054354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:42.088062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c9ea-b1e6-4763-8653-72aaaed68ecb admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:42.279092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:42.280795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:42.281332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:42.281818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] PATH_INFO: `/v3/projects/01281172352340b3aef84251965eb5e8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:42.283172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01281172352340b3aef84251965eb5e8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:42.285680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:42.389550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01281172352340b3aef84251965eb5e8', 'request_id': 'req-573958bd-315f-48a2-8072-fc1d5a79db3a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:42.397516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01281172352340b3aef84251965eb5e8', 'request_id': 'req-573958bd-315f-48a2-8072-fc1d5a79db3a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:42.408776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01281172352340b3aef84251965eb5e8', 'request_id': 'req-573958bd-315f-48a2-8072-fc1d5a79db3a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:42.441902 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] The token cache is being invalidate because project 01281172352340b3aef84251965eb5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:42.442342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:42.444619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-573958bd-315f-48a2-8072-fc1d5a79db3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:42.450303 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4097/8196] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:42 2022] DELETE /identity/v3/projects/01281172352340b3aef84251965eb5e8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:42.451858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed66f9-cffb-4194-92c5-1e48a70dd26f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:42.452396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed66f9-cffb-4194-92c5-1e48a70dd26f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:42.452508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed66f9-cffb-4194-92c5-1e48a70dd26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:42.476880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a2ed66f9-cffb-4194-92c5-1e48a70dd26f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:42.478803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a2ed66f9-cffb-4194-92c5-1e48a70dd26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:42.593351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16905-3d1e-4f3d-858b-1bd5f682fca7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:42.594803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16905-3d1e-4f3d-858b-1bd5f682fca7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:42.595446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16905-3d1e-4f3d-858b-1bd5f682fca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:42.598303 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4100/8197] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:42.645071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-b1a16905-3d1e-4f3d-858b-1bd5f682fca7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:42.650260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b1a16905-3d1e-4f3d-858b-1bd5f682fca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:42.670711 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4098/8198] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:42.674993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed66f9-cffb-4194-92c5-1e48a70dd26f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:42.687862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed66f9-cffb-4194-92c5-1e48a70dd26f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:42.704830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:42.705966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:42.706491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:42.707040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:42.711067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:42.711616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:42.713509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:42.731087 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4101/8199] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:19:42.735311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16905-3d1e-4f3d-858b-1bd5f682fca7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:42.749412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16905-3d1e-4f3d-858b-1bd5f682fca7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:42.754774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29bdeb-71dd-4e84-9d6c-6b9913e2bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:42.756069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29bdeb-71dd-4e84-9d6c-6b9913e2bb6b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:42.756506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29bdeb-71dd-4e84-9d6c-6b9913e2bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:42.756798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29bdeb-71dd-4e84-9d6c-6b9913e2bb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:42.757499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29bdeb-71dd-4e84-9d6c-6b9913e2bb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:42.760011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29bdeb-71dd-4e84-9d6c-6b9913e2bb6b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:42.812745 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4099/8200] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:42 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:42.813358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:42.834195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a200df9-be86-4287-8e13-339c87988baf admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:42.996087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821a20-3d07-4f4e-9c35-a74d50f5ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:42.997473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821a20-3d07-4f4e-9c35-a74d50f5ce7e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:42.998678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821a20-3d07-4f4e-9c35-a74d50f5ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:42.999705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821a20-3d07-4f4e-9c35-a74d50f5ce7e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:43.012115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf821a20-3d07-4f4e-9c35-a74d50f5ce7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:43.018993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf821a20-3d07-4f4e-9c35-a74d50f5ce7e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:43.072385 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4102/8201] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:42 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:43.077126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29bdeb-71dd-4e84-9d6c-6b9913e2bb6b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:43.089648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29bdeb-71dd-4e84-9d6c-6b9913e2bb6b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:43.097687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de83b63-92a1-4dea-bfac-2ce64d5de8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:43.098779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83b63-92a1-4dea-bfac-2ce64d5de8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:43.100582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83b63-92a1-4dea-bfac-2ce64d5de8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:43.101060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83b63-92a1-4dea-bfac-2ce64d5de8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:43.102475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de83b63-92a1-4dea-bfac-2ce64d5de8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:43.105555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de83b63-92a1-4dea-bfac-2ce64d5de8b9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:43.122869 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4100/8202] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:43.126913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821a20-3d07-4f4e-9c35-a74d50f5ce7e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:43.142016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821a20-3d07-4f4e-9c35-a74d50f5ce7e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:43.151648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38406d81-7822-4baf-b69c-9283ac2e1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:43.152610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406d81-7822-4baf-b69c-9283ac2e1d80 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:43.152990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406d81-7822-4baf-b69c-9283ac2e1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:43.153267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406d81-7822-4baf-b69c-9283ac2e1d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:43.160966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38406d81-7822-4baf-b69c-9283ac2e1d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:43.163600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38406d81-7822-4baf-b69c-9283ac2e1d80 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:43.211723 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4103/8203] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:43.212954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de83b63-92a1-4dea-bfac-2ce64d5de8b9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:43.228286 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de83b63-92a1-4dea-bfac-2ce64d5de8b9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:43.242701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:43.243604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:43.243890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:43.244164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] PATH_INFO: `/v3/projects/dd3b741e55b1457db0e9ddd5745c629e/users/4f16858532b34d45a505cb1ce5f9dfaa/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:43.267473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3b741e55b1457db0e9ddd5745c629e, user_id=4f16858532b34d45a505cb1ce5f9dfaa, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:43.271751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:43.309674 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4101/8204] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:43 2022] PUT /identity/v3/projects/dd3b741e55b1457db0e9ddd5745c629e/users/4f16858532b34d45a505cb1ce5f9dfaa/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:43.327968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6bcb0-c975-4f03-991a-6ec12c0ef1f5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:43.329382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6bcb0-c975-4f03-991a-6ec12c0ef1f5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:43.330377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6bcb0-c975-4f03-991a-6ec12c0ef1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:43.383393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d8e6bcb0-c975-4f03-991a-6ec12c0ef1f5 None None] MFA Rules not processed for user `4f16858532b34d45a505cb1ce5f9dfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:43.384863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d8e6bcb0-c975-4f03-991a-6ec12c0ef1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:43.483875 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4104/8205] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:43.494037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:43.496474 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:43.617364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92a542-48ee-4431-8785-3be7df708de6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:43.627105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc1fd5-48aa-4135-8c7b-86070d5ceb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:43.628114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1fd5-48aa-4135-8c7b-86070d5ceb4d service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:43.628773 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1fd5-48aa-4135-8c7b-86070d5ceb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:43.629506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc1fd5-48aa-4135-8c7b-86070d5ceb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:43.649493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc1fd5-48aa-4135-8c7b-86070d5ceb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:43.652787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc1fd5-48aa-4135-8c7b-86070d5ceb4d service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:43.677209 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4102/8206] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:45.386295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6bcb0-c975-4f03-991a-6ec12c0ef1f5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:45.391634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d8e6bcb0-c975-4f03-991a-6ec12c0ef1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:45.561229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6bcb0-c975-4f03-991a-6ec12c0ef1f5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:45.566789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:45.567785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:45.568141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:45.568537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] PATH_INFO: `/v3/users/16cf9ce248b245179934e11c9b45fab6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:45.569897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=16cf9ce248b245179934e11c9b45fab6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:45.572470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:45.655125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16cf9ce248b245179934e11c9b45fab6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:45.656020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16cf9ce248b245179934e11c9b45fab6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:45.656895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16cf9ce248b245179934e11c9b45fab6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:45.678109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16cf9ce248b245179934e11c9b45fab6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:45.689329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16cf9ce248b245179934e11c9b45fab6'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:45.706995 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4105/8207] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:45 2022] DELETE /identity/v3/users/16cf9ce248b245179934e11c9b45fab6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:45.713460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9f61-c88e-4d35-a6d4-738cd2cda49d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:45.714968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9f61-c88e-4d35-a6d4-738cd2cda49d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:45.715786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9f61-c88e-4d35-a6d4-738cd2cda49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:45.743128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-faab9f61-c88e-4d35-a6d4-738cd2cda49d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:45.744650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-faab9f61-c88e-4d35-a6d4-738cd2cda49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:45.821008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4103/8208] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:45.831982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:45.833767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:45.906733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc798d-6727-4a36-95fd-c125cfb9a75b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:45.913316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01d8f-082d-4960-a4f7-8b6b85d3e683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:45.914396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01d8f-082d-4960-a4f7-8b6b85d3e683 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:45.914850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01d8f-082d-4960-a4f7-8b6b85d3e683 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:45.915301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01d8f-082d-4960-a4f7-8b6b85d3e683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:45.929813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f01d8f-082d-4960-a4f7-8b6b85d3e683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:45.932623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f01d8f-082d-4960-a4f7-8b6b85d3e683 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:45.945492 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4106/8209] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:19:46.366957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab9f61-c88e-4d35-a6d4-738cd2cda49d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:46.368708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-faab9f61-c88e-4d35-a6d4-738cd2cda49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:46.399159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab9f61-c88e-4d35-a6d4-738cd2cda49d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:46.412096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:46.413502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:46.414910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:46.415726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] PATH_INFO: `/v3/projects/0dc0da4addd54a9db8117f8c935e95ca` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:46.419097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc0da4addd54a9db8117f8c935e95ca)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:46.423730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:46.523478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc0da4addd54a9db8117f8c935e95ca', 'request_id': 'req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.541278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc0da4addd54a9db8117f8c935e95ca', 'request_id': 'req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.555464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc0da4addd54a9db8117f8c935e95ca', 'request_id': 'req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.580457 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] The token cache is being invalidate because project 0dc0da4addd54a9db8117f8c935e95ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:46.580972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.582043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.593740 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4104/8210] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:46 2022] DELETE /identity/v3/projects/0dc0da4addd54a9db8117f8c935e95ca => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:46.595162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01d8f-082d-4960-a4f7-8b6b85d3e683 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:46.609093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01d8f-082d-4960-a4f7-8b6b85d3e683 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:46.689437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:46.690148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:46.690508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:46.690667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] PATH_INFO: `/v3/users/317cc181fda14ab28220349bcd32ad06` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:46.691895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317cc181fda14ab28220349bcd32ad06)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:46.694212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:46.763105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317cc181fda14ab28220349bcd32ad06'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.763922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317cc181fda14ab28220349bcd32ad06'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.764628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317cc181fda14ab28220349bcd32ad06'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.787769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317cc181fda14ab28220349bcd32ad06'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.802817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317cc181fda14ab28220349bcd32ad06'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:46.829733 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4107/8211] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:46 2022] DELETE /identity/v3/users/317cc181fda14ab28220349bcd32ad06 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:47.243329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:47.245147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:47.272548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d69dbf-2c1e-43c4-9e03-34a4c9e4019a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:47.379852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:47.381203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:47.381688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:47.382200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] PATH_INFO: `/v3/projects/1197f1831a924689b4513ca1e059d5a5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:47.383951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1197f1831a924689b4513ca1e059d5a5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:47.387879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:47.475143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1197f1831a924689b4513ca1e059d5a5', 'request_id': 'req-79f90349-56e0-4a71-a137-f7c565c1c925'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.482046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1197f1831a924689b4513ca1e059d5a5', 'request_id': 'req-79f90349-56e0-4a71-a137-f7c565c1c925'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.492322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1197f1831a924689b4513ca1e059d5a5', 'request_id': 'req-79f90349-56e0-4a71-a137-f7c565c1c925'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.539991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] The token cache is being invalidate because project 1197f1831a924689b4513ca1e059d5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:47.540297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.542317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.547247 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4105/8212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:47 2022] DELETE /identity/v3/projects/1197f1831a924689b4513ca1e059d5a5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:47.550974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:47.552997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:47.582480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209840f-5108-4cfc-957f-83c52d5f0945 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:47.680806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:47.681735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:47.682321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:47.682773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] PATH_INFO: `/v3/users/94acceb35d9044da932540f5efc40e5c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:47.684183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94acceb35d9044da932540f5efc40e5c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:47.686202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:47.782861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94acceb35d9044da932540f5efc40e5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.783919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94acceb35d9044da932540f5efc40e5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.785104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94acceb35d9044da932540f5efc40e5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.812818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94acceb35d9044da932540f5efc40e5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.829465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-ba85c742-27f6-4ae0-adbe-c8c4b25e9d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94acceb35d9044da932540f5efc40e5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:47.851405 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4108/8213] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:47 2022] DELETE /identity/v3/users/94acceb35d9044da932540f5efc40e5c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:48.308648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:48.310210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:48.335804 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f90349-56e0-4a71-a137-f7c565c1c925 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:48.413685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:48.414607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:48.414898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:48.415265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] PATH_INFO: `/v3/projects/bf070a82152b4cf6b48efb2d2aa994d5` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:48.418060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf070a82152b4cf6b48efb2d2aa994d5)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:48.420655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:48.493424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf070a82152b4cf6b48efb2d2aa994d5', 'request_id': 'req-dc706510-b730-43c1-b512-3b7079cb2eec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:48.501408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf070a82152b4cf6b48efb2d2aa994d5', 'request_id': 'req-dc706510-b730-43c1-b512-3b7079cb2eec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:48.515000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf070a82152b4cf6b48efb2d2aa994d5', 'request_id': 'req-dc706510-b730-43c1-b512-3b7079cb2eec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:48.539544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] The token cache is being invalidate because project bf070a82152b4cf6b48efb2d2aa994d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:48.540122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:48.541149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-dc706510-b730-43c1-b512-3b7079cb2eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:48.543551 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4106/8214] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:48 2022] DELETE /identity/v3/projects/bf070a82152b4cf6b48efb2d2aa994d5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:19:48.552506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044b6bc-36a0-4f69-a2b0-eb9a4995d5fb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:48.552998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044b6bc-36a0-4f69-a2b0-eb9a4995d5fb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:48.553312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044b6bc-36a0-4f69-a2b0-eb9a4995d5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:48.595078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1044b6bc-36a0-4f69-a2b0-eb9a4995d5fb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:48.597772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1044b6bc-36a0-4f69-a2b0-eb9a4995d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:48.682482 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4109/8215] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:48.691201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67c520-85ad-47fd-a84f-43d5321bab06 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:48.691519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67c520-85ad-47fd-a84f-43d5321bab06 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:48.691770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67c520-85ad-47fd-a84f-43d5321bab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:48.758252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4a67c520-85ad-47fd-a84f-43d5321bab06 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:48.759506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4a67c520-85ad-47fd-a84f-43d5321bab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:48.782442 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4107/8216] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:48.787465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044b6bc-36a0-4f69-a2b0-eb9a4995d5fb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:48.799675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044b6bc-36a0-4f69-a2b0-eb9a4995d5fb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:48.806116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:48.806793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:48.807074 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:48.807406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:48.808145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:48.808618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:48.810116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:48.826582 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4110/8217] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:48.831756 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67c520-85ad-47fd-a84f-43d5321bab06 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:48.860358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67c520-85ad-47fd-a84f-43d5321bab06 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:48.875114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70ee55-0997-4197-ae5d-e36cd50dbdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:48.876409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ee55-0997-4197-ae5d-e36cd50dbdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:48.879327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ee55-0997-4197-ae5d-e36cd50dbdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:48.879748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ee55-0997-4197-ae5d-e36cd50dbdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:48.880618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70ee55-0997-4197-ae5d-e36cd50dbdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:48.884161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70ee55-0997-4197-ae5d-e36cd50dbdc9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:48.932189 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4108/8218] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:48 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:48.936941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:48.950943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13603eef-ccd9-4d54-87ba-c56576a4c13d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:49.074397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbde06-da21-45df-b236-82ebea7dfc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:49.075772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbde06-da21-45df-b236-82ebea7dfc1b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:49.076224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbde06-da21-45df-b236-82ebea7dfc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:49.076741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbde06-da21-45df-b236-82ebea7dfc1b admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:49.077750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbde06-da21-45df-b236-82ebea7dfc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:49.079874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbde06-da21-45df-b236-82ebea7dfc1b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:49.111869 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4111/8219] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:48 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:49.117892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70ee55-0997-4197-ae5d-e36cd50dbdc9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:49.133876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70ee55-0997-4197-ae5d-e36cd50dbdc9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:49.140253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54379ae-2127-4e99-8f47-a47df2edb16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:49.141205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54379ae-2127-4e99-8f47-a47df2edb16e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:49.141670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54379ae-2127-4e99-8f47-a47df2edb16e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:49.142046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54379ae-2127-4e99-8f47-a47df2edb16e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:49.142964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54379ae-2127-4e99-8f47-a47df2edb16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:49.146981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54379ae-2127-4e99-8f47-a47df2edb16e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:49.168632 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4109/8220] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:49.168834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbde06-da21-45df-b236-82ebea7dfc1b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:49.181431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbde06-da21-45df-b236-82ebea7dfc1b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:49.187116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb96c6d-7da6-4f97-979d-97a5926a3e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:49.187575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96c6d-7da6-4f97-979d-97a5926a3e91 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:49.187855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96c6d-7da6-4f97-979d-97a5926a3e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:49.188282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb96c6d-7da6-4f97-979d-97a5926a3e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:49.192496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb96c6d-7da6-4f97-979d-97a5926a3e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:49.192838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb96c6d-7da6-4f97-979d-97a5926a3e91 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:49.207174 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4112/8221] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:49.214042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54379ae-2127-4e99-8f47-a47df2edb16e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:49.229060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54379ae-2127-4e99-8f47-a47df2edb16e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:49.236556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:49.238289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:49.238743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:49.239195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] PATH_INFO: `/v3/projects/4735cc20b18f46a1b0468386b0b7a632/users/27dbcebd833d49dbbeca6c661518336f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:49.264044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4735cc20b18f46a1b0468386b0b7a632, user_id=27dbcebd833d49dbbeca6c661518336f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:49.266856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:49.283602 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4110/8222] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:49 2022] PUT /identity/v3/projects/4735cc20b18f46a1b0468386b0b7a632/users/27dbcebd833d49dbbeca6c661518336f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:49.295310 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc0bb-f277-48fe-8493-c381ed235ebe None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:49.295925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc0bb-f277-48fe-8493-c381ed235ebe None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:49.296492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc0bb-f277-48fe-8493-c381ed235ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:49.340551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-8c3dc0bb-f277-48fe-8493-c381ed235ebe None None] MFA Rules not processed for user `27dbcebd833d49dbbeca6c661518336f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:49.341820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8c3dc0bb-f277-48fe-8493-c381ed235ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:49.423194 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4113/8223] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:49.434899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:49.436727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:49.513731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630c5e4-e1a3-4b2a-ade0-552ce3ec5a6e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:49.520044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29cac4-e6ba-4bb1-aab0-9e492e2448ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:49.521095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29cac4-e6ba-4bb1-aab0-9e492e2448ef service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:49.521458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29cac4-e6ba-4bb1-aab0-9e492e2448ef service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:49.521769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29cac4-e6ba-4bb1-aab0-9e492e2448ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:49.532019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29cac4-e6ba-4bb1-aab0-9e492e2448ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:49.533576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29cac4-e6ba-4bb1-aab0-9e492e2448ef service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:49.544703 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4111/8224] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:51.881148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dc0bb-f277-48fe-8493-c381ed235ebe None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:51.883285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8c3dc0bb-f277-48fe-8493-c381ed235ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:52.027587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dc0bb-f277-48fe-8493-c381ed235ebe None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:52.034254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:52.035372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:52.035874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:52.036632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] PATH_INFO: `/v3/users/4f16858532b34d45a505cb1ce5f9dfaa` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:52.038818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f16858532b34d45a505cb1ce5f9dfaa)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:52.041311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:52.107662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f16858532b34d45a505cb1ce5f9dfaa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:52.111025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f16858532b34d45a505cb1ce5f9dfaa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:52.112078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f16858532b34d45a505cb1ce5f9dfaa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:52.162959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f16858532b34d45a505cb1ce5f9dfaa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:52.185708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f16858532b34d45a505cb1ce5f9dfaa'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:52.225611 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4114/8225] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:19:51 2022] DELETE /identity/v3/users/4f16858532b34d45a505cb1ce5f9dfaa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:52.231341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49d44d-ab27-4627-9218-a48a46480277 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:52.232172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49d44d-ab27-4627-9218-a48a46480277 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:52.232576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49d44d-ab27-4627-9218-a48a46480277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:52.262930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ce49d44d-ab27-4627-9218-a48a46480277 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:52.325891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce49d44d-ab27-4627-9218-a48a46480277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:52.442581 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4112/8226] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:19:52.475563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:52.477177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:52.566794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0335a8-7407-45c1-9b5f-47306a43907e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:52.572324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea4436-8385-4711-8e2e-bb7f22ef97b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:52.574144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4436-8385-4711-8e2e-bb7f22ef97b0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:52.574443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4436-8385-4711-8e2e-bb7f22ef97b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:52.574785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4436-8385-4711-8e2e-bb7f22ef97b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:52.590014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea4436-8385-4711-8e2e-bb7f22ef97b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:52.591676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea4436-8385-4711-8e2e-bb7f22ef97b0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:52.605479 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4115/8227] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:19:53.402374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49d44d-ab27-4627-9218-a48a46480277 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:53.404646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce49d44d-ab27-4627-9218-a48a46480277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:53.444080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49d44d-ab27-4627-9218-a48a46480277 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:53.456735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:53.457849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:53.458052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:53.458484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] PATH_INFO: `/v3/projects/dd3b741e55b1457db0e9ddd5745c629e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:53.462921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3b741e55b1457db0e9ddd5745c629e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:53.470010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:53.621855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3b741e55b1457db0e9ddd5745c629e', 'request_id': 'req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:53.637789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3b741e55b1457db0e9ddd5745c629e', 'request_id': 'req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:53.654079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3b741e55b1457db0e9ddd5745c629e', 'request_id': 'req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:53.670988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] The token cache is being invalidate because project dd3b741e55b1457db0e9ddd5745c629e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:19:53.671577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:53.672813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f6e5e2e6-a164-4f51-a26b-1a6c736f9efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:19:53.674977 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4113/8228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:19:53 2022] DELETE /identity/v3/projects/dd3b741e55b1457db0e9ddd5745c629e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:53.681973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e6047-7378-4937-8f9c-8bc118e091e2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:53.683192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e6047-7378-4937-8f9c-8bc118e091e2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:53.683711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e6047-7378-4937-8f9c-8bc118e091e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:53.741082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-043e6047-7378-4937-8f9c-8bc118e091e2 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:53.742661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-043e6047-7378-4937-8f9c-8bc118e091e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:53.861929 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4116/8229] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:53.863842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd80e-3da4-487e-abe5-79f16d8a3c36 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:53.864184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd80e-3da4-487e-abe5-79f16d8a3c36 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:53.865289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd80e-3da4-487e-abe5-79f16d8a3c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:53.890221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bf1bd80e-3da4-487e-abe5-79f16d8a3c36 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:53.891497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bf1bd80e-3da4-487e-abe5-79f16d8a3c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:53.904019 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4114/8230] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:53.905350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e6047-7378-4937-8f9c-8bc118e091e2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:53.922002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e6047-7378-4937-8f9c-8bc118e091e2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:53.931287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:53.933735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:53.935416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:53.936830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:53.937950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:19:53.938578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:53.940806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:53.972407 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4117/8231] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:19:53.975736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bd80e-3da4-487e-abe5-79f16d8a3c36 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:54.024734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bd80e-3da4-487e-abe5-79f16d8a3c36 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:54.063766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2755-92f8-4c99-92b3-7a7fd5bffe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:54.064530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2755-92f8-4c99-92b3-7a7fd5bffe8a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:54.064957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2755-92f8-4c99-92b3-7a7fd5bffe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:54.065247 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2755-92f8-4c99-92b3-7a7fd5bffe8a admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:54.065961 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2755-92f8-4c99-92b3-7a7fd5bffe8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:54.076732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2755-92f8-4c99-92b3-7a7fd5bffe8a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:54.135938 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4115/8232] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:19:53 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:19:54.140624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:54.158095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e58c9-729c-4616-893e-9f9f7df5f5a3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:54.306589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c040-1a66-45d5-b3ff-256bb2857fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:54.308222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c040-1a66-45d5-b3ff-256bb2857fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:54.308538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c040-1a66-45d5-b3ff-256bb2857fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:54.308819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c040-1a66-45d5-b3ff-256bb2857fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:54.309520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959c040-1a66-45d5-b3ff-256bb2857fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:54.312743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959c040-1a66-45d5-b3ff-256bb2857fb2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:54.363890 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4118/8233] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:19:54 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:19:54.365354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2755-92f8-4c99-92b3-7a7fd5bffe8a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:54.382668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2755-92f8-4c99-92b3-7a7fd5bffe8a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:54.410824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baf326-43c9-4d81-b420-2fb83431afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:54.411937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baf326-43c9-4d81-b420-2fb83431afb1 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:54.412100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baf326-43c9-4d81-b420-2fb83431afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:54.412572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baf326-43c9-4d81-b420-2fb83431afb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:54.415161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baf326-43c9-4d81-b420-2fb83431afb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:54.419946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baf326-43c9-4d81-b420-2fb83431afb1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:54.451131 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4116/8234] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:54.453007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c040-1a66-45d5-b3ff-256bb2857fb2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:54.469949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c040-1a66-45d5-b3ff-256bb2857fb2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:54.478560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b1958-c6c0-4acf-ba09-bac85bd5cb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:54.479429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1958-c6c0-4acf-ba09-bac85bd5cb50 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:54.479717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1958-c6c0-4acf-ba09-bac85bd5cb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:54.479998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1958-c6c0-4acf-ba09-bac85bd5cb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:54.480809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b1958-c6c0-4acf-ba09-bac85bd5cb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:54.484092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b1958-c6c0-4acf-ba09-bac85bd5cb50 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:54.504377 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4119/8235] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:19:54.511105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baf326-43c9-4d81-b420-2fb83431afb1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:54.526780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baf326-43c9-4d81-b420-2fb83431afb1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:54.537354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:54.538717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:54.539297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:54.539747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] PATH_INFO: `/v3/projects/4460bc7458364067affd49ffa2f6aad3/users/6eb8aded09954e1088ec589d6d0fdd9f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:54.563769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4460bc7458364067affd49ffa2f6aad3, user_id=6eb8aded09954e1088ec589d6d0fdd9f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:54.569347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:54.596564 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4117/8236] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:19:54 2022] PUT /identity/v3/projects/4460bc7458364067affd49ffa2f6aad3/users/6eb8aded09954e1088ec589d6d0fdd9f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:19:54.609245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8fbff-0769-4d2c-844f-46f2dd747f5e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:54.609245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8fbff-0769-4d2c-844f-46f2dd747f5e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:54.609245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8fbff-0769-4d2c-844f-46f2dd747f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:54.681266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-87b8fbff-0769-4d2c-844f-46f2dd747f5e None None] MFA Rules not processed for user `6eb8aded09954e1088ec589d6d0fdd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:19:54.682993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-87b8fbff-0769-4d2c-844f-46f2dd747f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:54.798258 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4120/8237] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:19:54.813561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:19:54.816671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:19:54.978199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bcb71-4af4-4748-a7f3-1dd874c11882 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:19:54.988195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348c986-5969-4620-96b1-cba2f0786bf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:19:54.993607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c986-5969-4620-96b1-cba2f0786bf9 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:19:54.994277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c986-5969-4620-96b1-cba2f0786bf9 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:19:54.996778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c986-5969-4620-96b1-cba2f0786bf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:19:55.018933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348c986-5969-4620-96b1-cba2f0786bf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:19:55.018933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348c986-5969-4620-96b1-cba2f0786bf9 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:19:55.053319 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4118/8238] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:19:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:02.808770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8fbff-0769-4d2c-844f-46f2dd747f5e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:02.810203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-87b8fbff-0769-4d2c-844f-46f2dd747f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:02.884271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8fbff-0769-4d2c-844f-46f2dd747f5e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:02.890025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:02.890949 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:02.891230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:02.891498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] PATH_INFO: `/v3/users/27dbcebd833d49dbbeca6c661518336f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:02.892801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dbcebd833d49dbbeca6c661518336f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:02.900925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:02.967280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dbcebd833d49dbbeca6c661518336f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:02.968053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dbcebd833d49dbbeca6c661518336f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:02.969245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dbcebd833d49dbbeca6c661518336f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:02.986551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dbcebd833d49dbbeca6c661518336f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:02.996193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dbcebd833d49dbbeca6c661518336f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:03.012386 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4121/8239] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:20:02 2022] DELETE /identity/v3/users/27dbcebd833d49dbbeca6c661518336f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:03.017708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0dbe7-efb0-4a91-830d-0bc6b60b863f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:03.018456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0dbe7-efb0-4a91-830d-0bc6b60b863f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:03.018456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0dbe7-efb0-4a91-830d-0bc6b60b863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:03.039433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-93b0dbe7-efb0-4a91-830d-0bc6b60b863f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:03.041115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-93b0dbe7-efb0-4a91-830d-0bc6b60b863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:03.139957 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4119/8240] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:03.149256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:03.150504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:03.255886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d432a4-9933-45ef-8d0c-cc685a0b5e29 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:03.261698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fbf88-c958-4416-b308-aee6d0c5d099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:03.262522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fbf88-c958-4416-b308-aee6d0c5d099 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:03.262807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fbf88-c958-4416-b308-aee6d0c5d099 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:03.263078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fbf88-c958-4416-b308-aee6d0c5d099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:03.288696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fbf88-c958-4416-b308-aee6d0c5d099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:03.288696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fbf88-c958-4416-b308-aee6d0c5d099 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:03.290549 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4122/8241] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:20:03.986175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0dbe7-efb0-4a91-830d-0bc6b60b863f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:03.989781 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-93b0dbe7-efb0-4a91-830d-0bc6b60b863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:04.029427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0dbe7-efb0-4a91-830d-0bc6b60b863f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:04.039160 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:04.040829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.043264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.043749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] PATH_INFO: `/v3/projects/4735cc20b18f46a1b0468386b0b7a632` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.045825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4735cc20b18f46a1b0468386b0b7a632)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:04.051118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:04.146670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4735cc20b18f46a1b0468386b0b7a632', 'request_id': 'req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:04.158216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4735cc20b18f46a1b0468386b0b7a632', 'request_id': 'req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:04.171630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4735cc20b18f46a1b0468386b0b7a632', 'request_id': 'req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:04.191857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] The token cache is being invalidate because project 4735cc20b18f46a1b0468386b0b7a632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:20:04.192558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:04.196283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-8c18b8fc-74ad-4c98-bb45-fb043cb4bb14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:04.202749 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4120/8242] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:20:03 2022] DELETE /identity/v3/projects/4735cc20b18f46a1b0468386b0b7a632 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:04.212114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22c78-a514-4971-b7da-5c0068d2cc95 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.212617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22c78-a514-4971-b7da-5c0068d2cc95 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.212775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22c78-a514-4971-b7da-5c0068d2cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.236077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0de22c78-a514-4971-b7da-5c0068d2cc95 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:04.237551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0de22c78-a514-4971-b7da-5c0068d2cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:04.320469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4123/8243] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:04.333087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5976-c715-472e-9724-19895fe5af4a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.333769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5976-c715-472e-9724-19895fe5af4a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.334261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5976-c715-472e-9724-19895fe5af4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.361288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4cbd5976-c715-472e-9724-19895fe5af4a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:04.362763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4cbd5976-c715-472e-9724-19895fe5af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:04.383211 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4121/8244] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:04.387937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22c78-a514-4971-b7da-5c0068d2cc95 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:04.400626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22c78-a514-4971-b7da-5c0068d2cc95 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:04.409544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:04.410311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.410637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.410958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.411777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:20:04.412088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:04.413857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:04.428655 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4124/8245] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:20:04.433089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5976-c715-472e-9724-19895fe5af4a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:04.444035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5976-c715-472e-9724-19895fe5af4a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:04.450072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6a3f5-875a-4840-ae02-655229533abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:04.451376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a3f5-875a-4840-ae02-655229533abe admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.451834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a3f5-875a-4840-ae02-655229533abe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.452256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a3f5-875a-4840-ae02-655229533abe admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.453315 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6a3f5-875a-4840-ae02-655229533abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:04.455439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6a3f5-875a-4840-ae02-655229533abe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:04.502872 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4122/8246] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:20:04 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:04.507232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:04.521599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3a573-b24f-4ce5-98cf-0589ff767633 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:04.611496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda03a-6424-41ff-be28-9df4fac42cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:04.615273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda03a-6424-41ff-be28-9df4fac42cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.615710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda03a-6424-41ff-be28-9df4fac42cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.616087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda03a-6424-41ff-be28-9df4fac42cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.616829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda03a-6424-41ff-be28-9df4fac42cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:04.619791 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda03a-6424-41ff-be28-9df4fac42cf6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:04.650610 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4125/8247] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:20:04 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:04.655908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6a3f5-875a-4840-ae02-655229533abe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:04.669856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6a3f5-875a-4840-ae02-655229533abe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:04.691813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375d60-8cf1-47fa-8246-04000c6d2045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:04.692718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375d60-8cf1-47fa-8246-04000c6d2045 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.693077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375d60-8cf1-47fa-8246-04000c6d2045 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.693429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375d60-8cf1-47fa-8246-04000c6d2045 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.694292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d375d60-8cf1-47fa-8246-04000c6d2045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:04.704534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d375d60-8cf1-47fa-8246-04000c6d2045 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:04.720635 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4123/8248] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:20:04.728484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda03a-6424-41ff-be28-9df4fac42cf6 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:04.739483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda03a-6424-41ff-be28-9df4fac42cf6 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:04.748797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9990b-db19-4aa0-9d90-b53e879d0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:04.749973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9990b-db19-4aa0-9d90-b53e879d0c16 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.750749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9990b-db19-4aa0-9d90-b53e879d0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.751309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9990b-db19-4aa0-9d90-b53e879d0c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.753112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9990b-db19-4aa0-9d90-b53e879d0c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:04.756765 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9990b-db19-4aa0-9d90-b53e879d0c16 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:04.775636 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4126/8249] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:04.777799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375d60-8cf1-47fa-8246-04000c6d2045 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:04.795121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375d60-8cf1-47fa-8246-04000c6d2045 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:04.801453 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:04.802549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.802893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.803347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] PATH_INFO: `/v3/projects/f101b14d492c4f419d522cfbd3a863e4/users/12833678dba14769b444cbff3ccdb9a0/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.825808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f101b14d492c4f419d522cfbd3a863e4, user_id=12833678dba14769b444cbff3ccdb9a0, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:04.828824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:04.845103 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4124/8250] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:20:04 2022] PUT /identity/v3/projects/f101b14d492c4f419d522cfbd3a863e4/users/12833678dba14769b444cbff3ccdb9a0/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:04.858333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b012a-902e-4461-901a-9865a5d10351 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:04.858629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b012a-902e-4461-901a-9865a5d10351 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:04.858917 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b012a-902e-4461-901a-9865a5d10351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:04.912410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-780b012a-902e-4461-901a-9865a5d10351 None None] MFA Rules not processed for user `12833678dba14769b444cbff3ccdb9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:04.913738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-780b012a-902e-4461-901a-9865a5d10351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:04.987075 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4127/8251] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:04.997532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:04.999539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:05.070462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624f6ed-a8f8-4a0f-bc0e-e7ff22de1644 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:05.074822 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:05.076050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:05.076409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:05.076702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:05.087276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:05.088832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:05.099407 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4125/8252] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:07.659677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abada4-2b69-4b3e-98c7-cf5793cf6c9a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:07.660556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abada4-2b69-4b3e-98c7-cf5793cf6c9a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:07.660556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abada4-2b69-4b3e-98c7-cf5793cf6c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:07.679121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e1abada4-2b69-4b3e-98c7-cf5793cf6c9a None None] MFA Rules not processed for user `12833678dba14769b444cbff3ccdb9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:07.680372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e1abada4-2b69-4b3e-98c7-cf5793cf6c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:07.688991 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4128/8253] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:09.060360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:09.060360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:09.152451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bfbdc-9568-4f08-9992-404a96d7559d service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:09.155253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:09.156370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:09.156891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:09.157863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] PATH_INFO: `/v3/users/f9fb3af08ada44e185561b0e96f5fa22` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:09.160305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9fb3af08ada44e185561b0e96f5fa22)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:09.163382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:09.231307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9fb3af08ada44e185561b0e96f5fa22'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:09.248911 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9fb3af08ada44e185561b0e96f5fa22'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:09.262140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9fb3af08ada44e185561b0e96f5fa22'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:09.264264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9fb3af08ada44e185561b0e96f5fa22'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:09.265554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9fb3af08ada44e185561b0e96f5fa22'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:09.288440 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4126/8254] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:20:09 2022] DELETE /identity/v3/users/f9fb3af08ada44e185561b0e96f5fa22 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:09.294041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b160e-854c-4e05-b1c5-dd040ac02444 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:09.294871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b160e-854c-4e05-b1c5-dd040ac02444 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:09.295484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b160e-854c-4e05-b1c5-dd040ac02444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:09.336321 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-eb2b160e-854c-4e05-b1c5-dd040ac02444 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:09.338708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb2b160e-854c-4e05-b1c5-dd040ac02444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:09.467588 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4129/8255] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:09.477845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:09.480233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:09.553359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe99a-af63-429f-bebd-53e3331f12f7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:09.557526 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cf9f2-228d-4cbb-b35c-6f4d74a3ac5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:09.558201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf9f2-228d-4cbb-b35c-6f4d74a3ac5b service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:09.558742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf9f2-228d-4cbb-b35c-6f4d74a3ac5b service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:09.559170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf9f2-228d-4cbb-b35c-6f4d74a3ac5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:09.582842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cf9f2-228d-4cbb-b35c-6f4d74a3ac5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:09.584666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cf9f2-228d-4cbb-b35c-6f4d74a3ac5b service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:09.599056 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4127/8256] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:10.283726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b160e-854c-4e05-b1c5-dd040ac02444 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:10.287838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb2b160e-854c-4e05-b1c5-dd040ac02444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:10.349539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b160e-854c-4e05-b1c5-dd040ac02444 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:10.358376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69297f72-2824-458c-b750-018587940be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:10.359538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69297f72-2824-458c-b750-018587940be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:10.360060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69297f72-2824-458c-b750-018587940be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:10.360585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69297f72-2824-458c-b750-018587940be0 admin admin] PATH_INFO: `/v3/projects/3b206f017e904c07af8dc6c35551790c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:10.362631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69297f72-2824-458c-b750-018587940be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b206f017e904c07af8dc6c35551790c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:10.365954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69297f72-2824-458c-b750-018587940be0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:10.443000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69297f72-2824-458c-b750-018587940be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b206f017e904c07af8dc6c35551790c', 'request_id': 'req-69297f72-2824-458c-b750-018587940be0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:10.455931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69297f72-2824-458c-b750-018587940be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b206f017e904c07af8dc6c35551790c', 'request_id': 'req-69297f72-2824-458c-b750-018587940be0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:10.472108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69297f72-2824-458c-b750-018587940be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b206f017e904c07af8dc6c35551790c', 'request_id': 'req-69297f72-2824-458c-b750-018587940be0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:10.488058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69297f72-2824-458c-b750-018587940be0 admin admin] The token cache is being invalidate because project 3b206f017e904c07af8dc6c35551790c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:20:10.488653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69297f72-2824-458c-b750-018587940be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:10.490637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-69297f72-2824-458c-b750-018587940be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:10.492513 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4130/8257] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:20:10 2022] DELETE /identity/v3/projects/3b206f017e904c07af8dc6c35551790c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:12.134292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c9c65-327c-4b98-b53e-9267c82519d7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:12.138795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c9c65-327c-4b98-b53e-9267c82519d7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:12.138795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c9c65-327c-4b98-b53e-9267c82519d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:12.170844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0a0c9c65-327c-4b98-b53e-9267c82519d7 None None] MFA Rules not processed for user `2af13ad54ab048d495e5ff0c0453abb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:12.172493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0a0c9c65-327c-4b98-b53e-9267c82519d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:12.266801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4128/8258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:16.177450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69297f72-2824-458c-b750-018587940be0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:16.179290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-69297f72-2824-458c-b750-018587940be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:16.314068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69297f72-2824-458c-b750-018587940be0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:16.323511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:16.324671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:16.324958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:16.325237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] PATH_INFO: `/v3/users/6eb8aded09954e1088ec589d6d0fdd9f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:16.326796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb8aded09954e1088ec589d6d0fdd9f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:16.329068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:16.406681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb8aded09954e1088ec589d6d0fdd9f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:16.407934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb8aded09954e1088ec589d6d0fdd9f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:16.409425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb8aded09954e1088ec589d6d0fdd9f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:16.431811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb8aded09954e1088ec589d6d0fdd9f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:16.451489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb8aded09954e1088ec589d6d0fdd9f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:16.477440 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4131/8259] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:20:16 2022] DELETE /identity/v3/users/6eb8aded09954e1088ec589d6d0fdd9f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:20:16.486912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5916ea-eada-4a18-9214-5eb987642c49 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:16.488466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5916ea-eada-4a18-9214-5eb987642c49 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:16.489169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5916ea-eada-4a18-9214-5eb987642c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:16.545564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4b5916ea-eada-4a18-9214-5eb987642c49 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:16.548048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4b5916ea-eada-4a18-9214-5eb987642c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:16.666171 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4129/8260] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:16.679895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:16.687831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:16.785645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616faf73-7673-4603-9f44-4d4407143a9d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:16.790513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbe074-f8de-4583-8c25-0792039f0716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:16.791235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbe074-f8de-4583-8c25-0792039f0716 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:16.792048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbe074-f8de-4583-8c25-0792039f0716 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:16.792471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbe074-f8de-4583-8c25-0792039f0716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:16.810841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbe074-f8de-4583-8c25-0792039f0716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:16.811875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbe074-f8de-4583-8c25-0792039f0716 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:16.822884 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4132/8261] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:17.212939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5916ea-eada-4a18-9214-5eb987642c49 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:17.217749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4b5916ea-eada-4a18-9214-5eb987642c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:17.237814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5916ea-eada-4a18-9214-5eb987642c49 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:17.243476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:17.244666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.245029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.245608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] PATH_INFO: `/v3/projects/4460bc7458364067affd49ffa2f6aad3` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.247532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4460bc7458364067affd49ffa2f6aad3)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:17.249963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:17.323168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4460bc7458364067affd49ffa2f6aad3', 'request_id': 'req-1789520c-a188-43f1-9a85-06a4bdd291a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:17.332821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4460bc7458364067affd49ffa2f6aad3', 'request_id': 'req-1789520c-a188-43f1-9a85-06a4bdd291a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:17.348017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4460bc7458364067affd49ffa2f6aad3', 'request_id': 'req-1789520c-a188-43f1-9a85-06a4bdd291a3'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:17.364192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] The token cache is being invalidate because project 4460bc7458364067affd49ffa2f6aad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:20:17.364192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:17.364940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1789520c-a188-43f1-9a85-06a4bdd291a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:17.367180 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4130/8262] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:20:17 2022] DELETE /identity/v3/projects/4460bc7458364067affd49ffa2f6aad3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:17.372179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42164b57-e877-4bdb-a119-25776ae16454 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.372915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42164b57-e877-4bdb-a119-25776ae16454 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.373188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42164b57-e877-4bdb-a119-25776ae16454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.401637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-42164b57-e877-4bdb-a119-25776ae16454 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:17.402916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-42164b57-e877-4bdb-a119-25776ae16454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:17.465886 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4133/8263] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:17.477176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2c68-8fea-4edc-b215-aba564b62daa None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.477486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2c68-8fea-4edc-b215-aba564b62daa None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.478023 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2c68-8fea-4edc-b215-aba564b62daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.503324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f1ae2c68-8fea-4edc-b215-aba564b62daa None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:17.504730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f1ae2c68-8fea-4edc-b215-aba564b62daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:17.514367 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4131/8264] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:17.518688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42164b57-e877-4bdb-a119-25776ae16454 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:17.529712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42164b57-e877-4bdb-a119-25776ae16454 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:17.534790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:17.535623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.535834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.536043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.536938 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:20:17.537656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:17.538888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:17.555589 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4134/8265] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:20:17.556774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae2c68-8fea-4edc-b215-aba564b62daa None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:17.566542 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae2c68-8fea-4edc-b215-aba564b62daa None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:17.572047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8308165-00f6-4992-b6a3-19c50600a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:17.572817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308165-00f6-4992-b6a3-19c50600a565 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.573076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308165-00f6-4992-b6a3-19c50600a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.573354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308165-00f6-4992-b6a3-19c50600a565 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.574061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8308165-00f6-4992-b6a3-19c50600a565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:17.576288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8308165-00f6-4992-b6a3-19c50600a565 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:17.613222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4132/8266] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:20:17 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:20:17.614645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:17.626261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a80fc-20f9-469e-b3c6-9268f48eeb97 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:17.699123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c8b95-9bb4-49d9-9773-ef535f9b05e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:17.700255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c8b95-9bb4-49d9-9773-ef535f9b05e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.701032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c8b95-9bb4-49d9-9773-ef535f9b05e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.701589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c8b95-9bb4-49d9-9773-ef535f9b05e0 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.702814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c8b95-9bb4-49d9-9773-ef535f9b05e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:17.706757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c8b95-9bb4-49d9-9773-ef535f9b05e0 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:17.738093 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4135/8267] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:20:17 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:17.742313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8308165-00f6-4992-b6a3-19c50600a565 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:17.753711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8308165-00f6-4992-b6a3-19c50600a565 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:17.759093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33488-2d24-4340-a9d8-a3ac02162d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:17.759775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33488-2d24-4340-a9d8-a3ac02162d41 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.760636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33488-2d24-4340-a9d8-a3ac02162d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.760918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33488-2d24-4340-a9d8-a3ac02162d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.761656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb33488-2d24-4340-a9d8-a3ac02162d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:17.763275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb33488-2d24-4340-a9d8-a3ac02162d41 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:17.777478 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4133/8268] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:20:17.783045 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c8b95-9bb4-49d9-9773-ef535f9b05e0 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:17.798485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c8b95-9bb4-49d9-9773-ef535f9b05e0 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:17.812273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112ed8c-500c-42ce-93d1-8b6d643be6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:17.812913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ed8c-500c-42ce-93d1-8b6d643be6cd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.813208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ed8c-500c-42ce-93d1-8b6d643be6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.813498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ed8c-500c-42ce-93d1-8b6d643be6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.814253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112ed8c-500c-42ce-93d1-8b6d643be6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:17.815921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112ed8c-500c-42ce-93d1-8b6d643be6cd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:17.831042 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4136/8269] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:17.832556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33488-2d24-4340-a9d8-a3ac02162d41 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:17.845634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33488-2d24-4340-a9d8-a3ac02162d41 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:17.850597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:17.851593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.851973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.852349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] PATH_INFO: `/v3/projects/fbd5f6c5ad7a43ebb775aa4a8f3cfa5a/users/d518555ca5f449eaa82cf50963757769/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.871662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd5f6c5ad7a43ebb775aa4a8f3cfa5a, user_id=d518555ca5f449eaa82cf50963757769, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:17.875181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:17.891206 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4134/8270] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:20:17 2022] PUT /identity/v3/projects/fbd5f6c5ad7a43ebb775aa4a8f3cfa5a/users/d518555ca5f449eaa82cf50963757769/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:17.903114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10636ef4-ebc4-4f0a-b315-92a85788d11c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:17.903529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10636ef4-ebc4-4f0a-b315-92a85788d11c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:17.903902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10636ef4-ebc4-4f0a-b315-92a85788d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:17.964945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-10636ef4-ebc4-4f0a-b315-92a85788d11c None None] MFA Rules not processed for user `d518555ca5f449eaa82cf50963757769`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:17.966237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-10636ef4-ebc4-4f0a-b315-92a85788d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:18.042818 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4137/8271] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:18.054593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:18.057966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:18.156281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212d967-c1ed-474a-a318-6a6b26e7283e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:18.161643 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a1c4-e150-4a72-9dc7-c258d5dbb1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:18.162358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a1c4-e150-4a72-9dc7-c258d5dbb1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:18.162618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a1c4-e150-4a72-9dc7-c258d5dbb1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:18.162903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a1c4-e150-4a72-9dc7-c258d5dbb1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:18.174456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0a1c4-e150-4a72-9dc7-c258d5dbb1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:18.175897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0a1c4-e150-4a72-9dc7-c258d5dbb1c6 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:18.189951 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4135/8272] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:20.836560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10636ef4-ebc4-4f0a-b315-92a85788d11c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:20.911686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10636ef4-ebc4-4f0a-b315-92a85788d11c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:20.917258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:20.918163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:20.918423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:20.918698 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] PATH_INFO: `/v3/users/d518555ca5f449eaa82cf50963757769` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:20.920086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d518555ca5f449eaa82cf50963757769)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:20.922090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:20.975101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd518555ca5f449eaa82cf50963757769'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:20.980709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd518555ca5f449eaa82cf50963757769'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:20.980709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd518555ca5f449eaa82cf50963757769'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:20.991781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd518555ca5f449eaa82cf50963757769'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:21.001176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd518555ca5f449eaa82cf50963757769'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:21.015733 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4138/8273] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:20:20 2022] DELETE /identity/v3/users/d518555ca5f449eaa82cf50963757769 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:21.020968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e125-383e-4425-b795-f817639aabef None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:21.021535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e125-383e-4425-b795-f817639aabef None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:21.021759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e125-383e-4425-b795-f817639aabef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:21.041832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0549e125-383e-4425-b795-f817639aabef None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:21.043366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0549e125-383e-4425-b795-f817639aabef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:21.117017 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4136/8274] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:21.129041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:21.130734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:21.207799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe94b-8dd4-4e41-9b4c-6d8eb2038935 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:21.211924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62076d-0055-4a43-aa55-9bc6139ccc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:21.216598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62076d-0055-4a43-aa55-9bc6139ccc94 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:21.217090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62076d-0055-4a43-aa55-9bc6139ccc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:21.218056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62076d-0055-4a43-aa55-9bc6139ccc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:21.230217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62076d-0055-4a43-aa55-9bc6139ccc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:21.231815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62076d-0055-4a43-aa55-9bc6139ccc94 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:21.245709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4139/8275] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:21.669921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e125-383e-4425-b795-f817639aabef None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:21.671420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0549e125-383e-4425-b795-f817639aabef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:21.703204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e125-383e-4425-b795-f817639aabef None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:21.713280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:21.714541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:21.714915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:21.715298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] PATH_INFO: `/v3/projects/fbd5f6c5ad7a43ebb775aa4a8f3cfa5a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:21.718519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd5f6c5ad7a43ebb775aa4a8f3cfa5a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:21.720592 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:21.810574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd5f6c5ad7a43ebb775aa4a8f3cfa5a', 'request_id': 'req-251b8727-26a3-42fa-a296-e42e16c6290e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:21.830144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd5f6c5ad7a43ebb775aa4a8f3cfa5a', 'request_id': 'req-251b8727-26a3-42fa-a296-e42e16c6290e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:21.840900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd5f6c5ad7a43ebb775aa4a8f3cfa5a', 'request_id': 'req-251b8727-26a3-42fa-a296-e42e16c6290e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:21.857525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] The token cache is being invalidate because project fbd5f6c5ad7a43ebb775aa4a8f3cfa5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:20:21.857891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:21.858736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-251b8727-26a3-42fa-a296-e42e16c6290e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:21.861276 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4137/8276] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:20:21 2022] DELETE /identity/v3/projects/fbd5f6c5ad7a43ebb775aa4a8f3cfa5a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:21.867306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bfc6c-f2e5-4b6f-8e1a-5cd00c2bdc55 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:21.867869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bfc6c-f2e5-4b6f-8e1a-5cd00c2bdc55 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:21.867959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bfc6c-f2e5-4b6f-8e1a-5cd00c2bdc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:21.894245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-655bfc6c-f2e5-4b6f-8e1a-5cd00c2bdc55 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:21.895715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-655bfc6c-f2e5-4b6f-8e1a-5cd00c2bdc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:22.029051 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4140/8277] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:22.036744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7c12-10cd-4fc4-b5b2-cc1d57b57d1e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.037278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7c12-10cd-4fc4-b5b2-cc1d57b57d1e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.037370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7c12-10cd-4fc4-b5b2-cc1d57b57d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.070349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-653c7c12-10cd-4fc4-b5b2-cc1d57b57d1e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:22.072105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-653c7c12-10cd-4fc4-b5b2-cc1d57b57d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:22.085113 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4138/8278] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:22.090724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bfc6c-f2e5-4b6f-8e1a-5cd00c2bdc55 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:22.101974 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bfc6c-f2e5-4b6f-8e1a-5cd00c2bdc55 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:22.109770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:22.110458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.110732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.111179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.111923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:20:22.112235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:22.113932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:22.135861 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4141/8279] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:20:22.138601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c7c12-10cd-4fc4-b5b2-cc1d57b57d1e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:22.152232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c7c12-10cd-4fc4-b5b2-cc1d57b57d1e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:22.159483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc377-67f8-4fdb-adeb-1eb9588fe485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:22.160378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc377-67f8-4fdb-adeb-1eb9588fe485 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.160669 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc377-67f8-4fdb-adeb-1eb9588fe485 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.160955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc377-67f8-4fdb-adeb-1eb9588fe485 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.161723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc377-67f8-4fdb-adeb-1eb9588fe485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:22.163698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc377-67f8-4fdb-adeb-1eb9588fe485 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:22.216063 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4139/8280] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:20:22 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:22.220591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:22.232927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5314a-ee6c-4dcd-85a4-83be8323a90a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:22.340812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad804e3e-ae1a-445f-b615-09e82c4fe24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:22.341956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804e3e-ae1a-445f-b615-09e82c4fe24d admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.342516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804e3e-ae1a-445f-b615-09e82c4fe24d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.343718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804e3e-ae1a-445f-b615-09e82c4fe24d admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.344663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad804e3e-ae1a-445f-b615-09e82c4fe24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:22.347580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad804e3e-ae1a-445f-b615-09e82c4fe24d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:22.376782 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4142/8281] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:20:22 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:20:22.381339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc377-67f8-4fdb-adeb-1eb9588fe485 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:22.397203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc377-67f8-4fdb-adeb-1eb9588fe485 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:22.403951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9d438-f172-460f-b432-9afc6ed641b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:22.405026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9d438-f172-460f-b432-9afc6ed641b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.405556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9d438-f172-460f-b432-9afc6ed641b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.405985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9d438-f172-460f-b432-9afc6ed641b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.407148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9d438-f172-460f-b432-9afc6ed641b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:22.409064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9d438-f172-460f-b432-9afc6ed641b4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:22.423308 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4140/8282] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:20:22.427905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad804e3e-ae1a-445f-b615-09e82c4fe24d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:22.452585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad804e3e-ae1a-445f-b615-09e82c4fe24d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:22.457907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bd681-c5ba-4480-a259-bdc1098902d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:22.458727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd681-c5ba-4480-a259-bdc1098902d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.459020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd681-c5ba-4480-a259-bdc1098902d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.459364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd681-c5ba-4480-a259-bdc1098902d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.460172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bd681-c5ba-4480-a259-bdc1098902d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:22.461969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bd681-c5ba-4480-a259-bdc1098902d1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:22.486524 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4143/8283] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:22.487751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9d438-f172-460f-b432-9afc6ed641b4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:22.500656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9d438-f172-460f-b432-9afc6ed641b4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:22.507879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:22.508823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.509107 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.509380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] PATH_INFO: `/v3/projects/7674fc9fd1364fc19f4d3a3f29fff526/users/40b5203563744c88bd24defd8f677904/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.529531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7674fc9fd1364fc19f4d3a3f29fff526, user_id=40b5203563744c88bd24defd8f677904, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:22.532573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:22.576276 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4141/8284] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:20:22 2022] PUT /identity/v3/projects/7674fc9fd1364fc19f4d3a3f29fff526/users/40b5203563744c88bd24defd8f677904/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:22.582056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852e70-6826-4670-a05d-46d213970d6a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.582568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852e70-6826-4670-a05d-46d213970d6a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.582960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852e70-6826-4670-a05d-46d213970d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.637657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-21852e70-6826-4670-a05d-46d213970d6a None None] MFA Rules not processed for user `40b5203563744c88bd24defd8f677904`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:22.638975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-21852e70-6826-4670-a05d-46d213970d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:22.733951 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4144/8285] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:22.743843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:22.748557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:22.829904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d416a-2682-4811-807f-63cc34992bce admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:22.835520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:22.836215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:22.836599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:22.836888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:22.846836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:22.848290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:22.859719 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4142/8286] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:26.438460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdcdbd-a7c5-4894-99a1-4f17b3107220 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:26.439041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdcdbd-a7c5-4894-99a1-4f17b3107220 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:26.439802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdcdbd-a7c5-4894-99a1-4f17b3107220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:26.495195 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-67bdcdbd-a7c5-4894-99a1-4f17b3107220 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:26.496958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67bdcdbd-a7c5-4894-99a1-4f17b3107220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:26.625372 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4145/8287] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:26.724439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:26.727557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:26.928192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831cd0-1366-487b-b19a-299c9ca4668c service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:26.940664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dbee4-b8f2-4558-b1ad-4e494b701e3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:26.941346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dbee4-b8f2-4558-b1ad-4e494b701e3e service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:26.941823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dbee4-b8f2-4558-b1ad-4e494b701e3e service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:26.942112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dbee4-b8f2-4558-b1ad-4e494b701e3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:26.953221 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dbee4-b8f2-4558-b1ad-4e494b701e3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:26.954751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dbee4-b8f2-4558-b1ad-4e494b701e3e service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:26.969968 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4143/8288] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:20:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:27.373610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdcdbd-a7c5-4894-99a1-4f17b3107220 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:27.375941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67bdcdbd-a7c5-4894-99a1-4f17b3107220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:27.567262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdcdbd-a7c5-4894-99a1-4f17b3107220 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:27.590110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:27.592803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:27.596718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:27.597276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:27.603279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:27.800246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:27.803279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:27.834180 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4146/8289] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:20:27.856310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5be2-b6d9-4bd7-b3e0-5427a6c4c059 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:27.856927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5be2-b6d9-4bd7-b3e0-5427a6c4c059 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:27.856927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5be2-b6d9-4bd7-b3e0-5427a6c4c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:27.877684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9cee5be2-b6d9-4bd7-b3e0-5427a6c4c059 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:27.879241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9cee5be2-b6d9-4bd7-b3e0-5427a6c4c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:27.890241 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4144/8290] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:27.908404 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:27.927867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b38f9-b9e5-437d-a17c-36cb35c047bc service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:27.933897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4692b-788d-42cc-805a-0428c9922a2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:27.934726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4692b-788d-42cc-805a-0428c9922a2c service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:27.935011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4692b-788d-42cc-805a-0428c9922a2c service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:27.935285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4692b-788d-42cc-805a-0428c9922a2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:27.947001 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4692b-788d-42cc-805a-0428c9922a2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:27.948701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4692b-788d-42cc-805a-0428c9922a2c service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:27.974412 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4147/8291] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:20:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:28.208942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67327-9ff8-4ca3-acd2-3c9562ad8929 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:28.209303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67327-9ff8-4ca3-acd2-3c9562ad8929 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:28.209505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67327-9ff8-4ca3-acd2-3c9562ad8929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:28.228179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7ab67327-9ff8-4ca3-acd2-3c9562ad8929 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:28.229379 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7ab67327-9ff8-4ca3-acd2-3c9562ad8929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:28.236844 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4145/8292] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:28.253319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4692b-788d-42cc-805a-0428c9922a2c service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:28.270168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4692b-788d-42cc-805a-0428c9922a2c service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:28.278475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b1c6c-cb9c-4419-b67d-f83ef3a98d96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:28.279298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1c6c-cb9c-4419-b67d-f83ef3a98d96 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:28.279639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1c6c-cb9c-4419-b67d-f83ef3a98d96 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:28.279972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1c6c-cb9c-4419-b67d-f83ef3a98d96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:28.290745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b1c6c-cb9c-4419-b67d-f83ef3a98d96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:28.293155 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b1c6c-cb9c-4419-b67d-f83ef3a98d96 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:28.303109 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4148/8293] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:20:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:28.685732 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab67327-9ff8-4ca3-acd2-3c9562ad8929 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:28.700318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab67327-9ff8-4ca3-acd2-3c9562ad8929 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:28.705311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:28.706337 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:28.707610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:28.707897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:28.710633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:28.737823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:28.739618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:28.765471 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4146/8294] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:28.803825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a536-68b3-455b-ba41-f1707df98929 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:28.804308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a536-68b3-455b-ba41-f1707df98929 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:28.804422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a536-68b3-455b-ba41-f1707df98929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:28.823032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-71c5a536-68b3-455b-ba41-f1707df98929 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:28.824505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-71c5a536-68b3-455b-ba41-f1707df98929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:28.838732 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4149/8295] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:28.855785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:28.874018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cb15a-5709-4074-8f42-c259c2130055 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:28.906642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7a9f6-f15c-4120-aec9-9d1e5420f91a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:28.907428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7a9f6-f15c-4120-aec9-9d1e5420f91a service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:28.907713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7a9f6-f15c-4120-aec9-9d1e5420f91a service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:28.908029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7a9f6-f15c-4120-aec9-9d1e5420f91a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:28.920595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7a9f6-f15c-4120-aec9-9d1e5420f91a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:28.922204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7a9f6-f15c-4120-aec9-9d1e5420f91a service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:28.936567 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4147/8296] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:20:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:31.112142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcfac4-5933-4f22-b3f5-1dea260a1993 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:31.113144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcfac4-5933-4f22-b3f5-1dea260a1993 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:31.113468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcfac4-5933-4f22-b3f5-1dea260a1993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:31.162452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c4dcfac4-5933-4f22-b3f5-1dea260a1993 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:31.163550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c4dcfac4-5933-4f22-b3f5-1dea260a1993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:31.186875 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4150/8297] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:31.202645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7a9f6-f15c-4120-aec9-9d1e5420f91a service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:31.221505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7a9f6-f15c-4120-aec9-9d1e5420f91a service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:31.235879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73369f-e1eb-4865-9236-12060ec968f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:31.236573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73369f-e1eb-4865-9236-12060ec968f7 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:31.236904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73369f-e1eb-4865-9236-12060ec968f7 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:31.237134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73369f-e1eb-4865-9236-12060ec968f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:31.250508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73369f-e1eb-4865-9236-12060ec968f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:31.252466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73369f-e1eb-4865-9236-12060ec968f7 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:31.276530 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4148/8298] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:32.003483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcfac4-5933-4f22-b3f5-1dea260a1993 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:32.005314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c4dcfac4-5933-4f22-b3f5-1dea260a1993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:32.149454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcfac4-5933-4f22-b3f5-1dea260a1993 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:32.170504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:32.172069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:32.172235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:32.172661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] PATH_INFO: `/v3/users/12833678dba14769b444cbff3ccdb9a0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:32.174596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] RBAC: Authorizing `identity:delete_user(user_id=12833678dba14769b444cbff3ccdb9a0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:32.177970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:32.250697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12833678dba14769b444cbff3ccdb9a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:32.252365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12833678dba14769b444cbff3ccdb9a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:32.253490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12833678dba14769b444cbff3ccdb9a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:32.273397 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12833678dba14769b444cbff3ccdb9a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:32.284182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12833678dba14769b444cbff3ccdb9a0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:32.303771 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4151/8299] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:20:32 2022] DELETE /identity/v3/users/12833678dba14769b444cbff3ccdb9a0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:32.308484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9179f-c22a-4491-84dc-5cc4484d9782 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:32.308974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9179f-c22a-4491-84dc-5cc4484d9782 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:32.309049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9179f-c22a-4491-84dc-5cc4484d9782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:32.335898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-78f9179f-c22a-4491-84dc-5cc4484d9782 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:32.337077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-78f9179f-c22a-4491-84dc-5cc4484d9782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:32.422497 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4149/8300] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:32.436851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:32.438629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:32.553200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0f8c-7593-40c4-b25a-755bbda6360d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:32.563682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:32.564654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:32.565616 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:32.566040 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:32.582841 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:32.584492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:32.597079 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4152/8301] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:32.705203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f7c3-8637-41b1-8143-b847c8cae5cb None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:32.706237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f7c3-8637-41b1-8143-b847c8cae5cb None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:32.707235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3f7c3-8637-41b1-8143-b847c8cae5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:32.738304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e9f3f7c3-8637-41b1-8143-b847c8cae5cb None None] MFA Rules not processed for user `2af13ad54ab048d495e5ff0c0453abb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:32.741532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e9f3f7c3-8637-41b1-8143-b847c8cae5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:32.839222 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4150/8302] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:33.086798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:33.088828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:33.149383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255e103-e5c9-442f-8fb9-4e3c2cb6fa08 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:33.158301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:33.159232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:33.160067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:33.160546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] PATH_INFO: `/v3/projects/f101b14d492c4f419d522cfbd3a863e4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:33.162369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f101b14d492c4f419d522cfbd3a863e4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:33.164775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:33.337965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f101b14d492c4f419d522cfbd3a863e4', 'request_id': 'req-476af1c9-731a-4682-9844-028eb720a0ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:33.348293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f101b14d492c4f419d522cfbd3a863e4', 'request_id': 'req-476af1c9-731a-4682-9844-028eb720a0ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:33.365870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f101b14d492c4f419d522cfbd3a863e4', 'request_id': 'req-476af1c9-731a-4682-9844-028eb720a0ef'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:33.382876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] The token cache is being invalidate because project f101b14d492c4f419d522cfbd3a863e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:20:33.383220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:33.383916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-476af1c9-731a-4682-9844-028eb720a0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:33.388907 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4153/8303] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:20:33 2022] DELETE /identity/v3/projects/f101b14d492c4f419d522cfbd3a863e4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:20:36.471702 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3f7c3-8637-41b1-8143-b847c8cae5cb None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:36.474188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e9f3f7c3-8637-41b1-8143-b847c8cae5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:36.516017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3f7c3-8637-41b1-8143-b847c8cae5cb None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:36.615728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:36.616674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:36.617721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:36.618010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] PATH_INFO: `/v3/users/40b5203563744c88bd24defd8f677904` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:36.619528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b5203563744c88bd24defd8f677904)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:36.622666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:36.716104 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b5203563744c88bd24defd8f677904'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:36.731670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b5203563744c88bd24defd8f677904'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:36.745454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b5203563744c88bd24defd8f677904'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:36.746653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b5203563744c88bd24defd8f677904'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:36.747295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b5203563744c88bd24defd8f677904'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:36.771729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0a1d4-77b8-4f48-a9d9-cda8eb0e1036 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:36.772851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0a1d4-77b8-4f48-a9d9-cda8eb0e1036 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:36.773142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0a1d4-77b8-4f48-a9d9-cda8eb0e1036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:36.775119 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4151/8304] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:20:36 2022] DELETE /identity/v3/users/40b5203563744c88bd24defd8f677904 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:36.815744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6cd0a1d4-77b8-4f48-a9d9-cda8eb0e1036 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:36.817477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6cd0a1d4-77b8-4f48-a9d9-cda8eb0e1036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:36.955763 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4154/8305] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:36.973159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:36.975861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:37.069972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310161e-d26d-4092-a634-d4035951a15a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:37.088991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c436ce-c17d-4821-8c3e-08fa9793f4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:37.089942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c436ce-c17d-4821-8c3e-08fa9793f4dd service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:37.090520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c436ce-c17d-4821-8c3e-08fa9793f4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:37.090952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c436ce-c17d-4821-8c3e-08fa9793f4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:37.107929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c436ce-c17d-4821-8c3e-08fa9793f4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:37.109684 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c436ce-c17d-4821-8c3e-08fa9793f4dd service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:37.157413 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4152/8306] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:38.739267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0a1d4-77b8-4f48-a9d9-cda8eb0e1036 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:38.741592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6cd0a1d4-77b8-4f48-a9d9-cda8eb0e1036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:38.757690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0a1d4-77b8-4f48-a9d9-cda8eb0e1036 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:38.763861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:38.765327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:38.765969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:38.766473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] PATH_INFO: `/v3/projects/7674fc9fd1364fc19f4d3a3f29fff526` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:38.770241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7674fc9fd1364fc19f4d3a3f29fff526)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:38.780022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:38.892445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7674fc9fd1364fc19f4d3a3f29fff526', 'request_id': 'req-485d9091-dc63-4ddb-83f9-3add63c7057a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:38.906126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7674fc9fd1364fc19f4d3a3f29fff526', 'request_id': 'req-485d9091-dc63-4ddb-83f9-3add63c7057a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:38.919418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7674fc9fd1364fc19f4d3a3f29fff526', 'request_id': 'req-485d9091-dc63-4ddb-83f9-3add63c7057a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:38.939929 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] The token cache is being invalidate because project 7674fc9fd1364fc19f4d3a3f29fff526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:20:38.940416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:38.942177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:38.947796 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4155/8307] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:20:38 2022] DELETE /identity/v3/projects/7674fc9fd1364fc19f4d3a3f29fff526 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:38.954998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65478c-f053-473c-b770-590ce4a7278c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:38.955489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65478c-f053-473c-b770-590ce4a7278c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:38.955565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65478c-f053-473c-b770-590ce4a7278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:38.990647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:38.995728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:39.031211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-da65478c-f053-473c-b770-590ce4a7278c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:39.032497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-da65478c-f053-473c-b770-590ce4a7278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:39.153896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d9091-dc63-4ddb-83f9-3add63c7057a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:39.154733 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4153/8308] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:39.162931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01826-ef0a-49c9-a720-e1ff456ea91f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.163586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01826-ef0a-49c9-a720-e1ff456ea91f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.164447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01826-ef0a-49c9-a720-e1ff456ea91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:39.193746 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7ad01826-ef0a-49c9-a720-e1ff456ea91f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:39.197989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7ad01826-ef0a-49c9-a720-e1ff456ea91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:39.212163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:39.213557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4154/8309] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:39.218390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.218674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.221196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:39.225870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:39.230074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad01826-ef0a-49c9-a720-e1ff456ea91f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:39.252533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:39.254534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:39.269720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad01826-ef0a-49c9-a720-e1ff456ea91f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:39.283097 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4156/8310] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:39.295320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:39.296050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.296982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.297262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:39.300473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:20:39.301181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:39.302993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:39.354143 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4155/8311] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:20:39.359171 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:39.379593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223a44-2b82-4e37-a9f7-f37cc8544172 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:39.394438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2c361-ac0b-4ab8-9933-f8e7b96b5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:39.395283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2c361-ac0b-4ab8-9933-f8e7b96b5c48 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.395605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2c361-ac0b-4ab8-9933-f8e7b96b5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.395896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2c361-ac0b-4ab8-9933-f8e7b96b5c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:39.396674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2c361-ac0b-4ab8-9933-f8e7b96b5c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:39.399410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2c361-ac0b-4ab8-9933-f8e7b96b5c48 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:39.490956 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4157/8312] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:20:39 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:39.495372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:39.524064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a25175-86fb-409b-aed9-5364ee8e925b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:39.698172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57c2d2-62c7-43d3-8361-255cb596ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:39.698827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57c2d2-62c7-43d3-8361-255cb596ae20 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.699119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57c2d2-62c7-43d3-8361-255cb596ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.699399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57c2d2-62c7-43d3-8361-255cb596ae20 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:39.701124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57c2d2-62c7-43d3-8361-255cb596ae20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:39.703352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57c2d2-62c7-43d3-8361-255cb596ae20 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:39.751537 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4156/8313] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:20:39 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:39.760108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2c361-ac0b-4ab8-9933-f8e7b96b5c48 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:39.780855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2c361-ac0b-4ab8-9933-f8e7b96b5c48 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:39.809278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71963169-cf13-4507-9815-92d7754e071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:39.809984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71963169-cf13-4507-9815-92d7754e071a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.810271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71963169-cf13-4507-9815-92d7754e071a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.813885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71963169-cf13-4507-9815-92d7754e071a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:39.817651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71963169-cf13-4507-9815-92d7754e071a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:39.819324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71963169-cf13-4507-9815-92d7754e071a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:39.833065 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4158/8314] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:39.837129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57c2d2-62c7-43d3-8361-255cb596ae20 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:39.851169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57c2d2-62c7-43d3-8361-255cb596ae20 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:39.858545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2ec09-2401-43da-8b77-c5a6a37265cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:39.860889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2ec09-2401-43da-8b77-c5a6a37265cd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.861601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2ec09-2401-43da-8b77-c5a6a37265cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.862447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2ec09-2401-43da-8b77-c5a6a37265cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:39.863532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2ec09-2401-43da-8b77-c5a6a37265cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:39.865624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2ec09-2401-43da-8b77-c5a6a37265cd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:39.879475 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4157/8315] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:39.885591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71963169-cf13-4507-9815-92d7754e071a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:39.901727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71963169-cf13-4507-9815-92d7754e071a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:39.910106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:39.912614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.913474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.914587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] PATH_INFO: `/v3/projects/f355422bbc4a402597f285f02ca85a3a/users/75acfc9921fc44bb8b307616ae5da163/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:39.943353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f355422bbc4a402597f285f02ca85a3a, user_id=75acfc9921fc44bb8b307616ae5da163, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:39.947515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:39.971956 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4159/8316] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:20:39 2022] PUT /identity/v3/projects/f355422bbc4a402597f285f02ca85a3a/users/75acfc9921fc44bb8b307616ae5da163/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:39.978243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0bfe-786f-42df-b5ce-35053646a0dc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:39.980370 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0bfe-786f-42df-b5ce-35053646a0dc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:39.981136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0bfe-786f-42df-b5ce-35053646a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:40.008296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6c7a0bfe-786f-42df-b5ce-35053646a0dc None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:40.010939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6c7a0bfe-786f-42df-b5ce-35053646a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:40.103795 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4158/8317] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:40.119901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:40.123587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:40.243156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8e0d7-2947-4736-8d8e-437d0cadc5ad admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:40.253096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b761aae-aec2-4293-bf86-4db01f8d259c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:40.254206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b761aae-aec2-4293-bf86-4db01f8d259c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:40.254500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b761aae-aec2-4293-bf86-4db01f8d259c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:40.254781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b761aae-aec2-4293-bf86-4db01f8d259c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:40.283108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b761aae-aec2-4293-bf86-4db01f8d259c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:40.284737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b761aae-aec2-4293-bf86-4db01f8d259c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:40.302771 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4160/8318] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:41.468384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618273f-2181-468a-8dce-9926c272444e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:41.469278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618273f-2181-468a-8dce-9926c272444e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:41.469597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618273f-2181-468a-8dce-9926c272444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:41.507460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e618273f-2181-468a-8dce-9926c272444e None None] MFA Rules not processed for user `75acfc9921fc44bb8b307616ae5da163`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:41.509013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e618273f-2181-468a-8dce-9926c272444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:41.607409 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4159/8319] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:41.611822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b761aae-aec2-4293-bf86-4db01f8d259c service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:41.625658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b761aae-aec2-4293-bf86-4db01f8d259c service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:41.643243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2995d-eb4c-4996-b317-913f66fa6a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:41.644242 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2995d-eb4c-4996-b317-913f66fa6a90 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:41.644632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2995d-eb4c-4996-b317-913f66fa6a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:41.644992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2995d-eb4c-4996-b317-913f66fa6a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:41.646105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2995d-eb4c-4996-b317-913f66fa6a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:41.648942 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2995d-eb4c-4996-b317-913f66fa6a90 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:41.686528 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4161/8320] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:20:41 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:41.690307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618273f-2181-468a-8dce-9926c272444e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:41.713503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618273f-2181-468a-8dce-9926c272444e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:41.781428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943620c-adad-4abf-ae3e-daa559ffcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:41.782242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943620c-adad-4abf-ae3e-daa559ffcac8 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:41.782595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943620c-adad-4abf-ae3e-daa559ffcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:41.782941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943620c-adad-4abf-ae3e-daa559ffcac8 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:41.783712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943620c-adad-4abf-ae3e-daa559ffcac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:41.785748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943620c-adad-4abf-ae3e-daa559ffcac8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:41.831688 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4160/8321] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:20:41 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:41.832863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2995d-eb4c-4996-b317-913f66fa6a90 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:41.844182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2995d-eb4c-4996-b317-913f66fa6a90 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:41.849643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78200-68c7-4b1b-88e6-791d6b1f6da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:41.850328 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78200-68c7-4b1b-88e6-791d6b1f6da7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:41.850824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78200-68c7-4b1b-88e6-791d6b1f6da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:41.851099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78200-68c7-4b1b-88e6-791d6b1f6da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:41.851868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b78200-68c7-4b1b-88e6-791d6b1f6da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:41.854200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b78200-68c7-4b1b-88e6-791d6b1f6da7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:41.866916 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4162/8322] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:41.872106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943620c-adad-4abf-ae3e-daa559ffcac8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:41.884303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943620c-adad-4abf-ae3e-daa559ffcac8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:41.890530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed0a57-00c4-4ab6-b5d1-3fdb9039d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:41.893067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed0a57-00c4-4ab6-b5d1-3fdb9039d072 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:41.893849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed0a57-00c4-4ab6-b5d1-3fdb9039d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:41.894473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed0a57-00c4-4ab6-b5d1-3fdb9039d072 admin admin] PATH_INFO: `/v3/projects/f9ee52aba69e494e86667326d2d1b5e4/users/2e873eae00f544f19c64f3ec6817530e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:41.922310 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed0a57-00c4-4ab6-b5d1-3fdb9039d072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ee52aba69e494e86667326d2d1b5e4, user_id=2e873eae00f544f19c64f3ec6817530e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:41.925158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed0a57-00c4-4ab6-b5d1-3fdb9039d072 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:41.943330 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4161/8323] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:20:41 2022] PUT /identity/v3/projects/f9ee52aba69e494e86667326d2d1b5e4/users/2e873eae00f544f19c64f3ec6817530e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:41.947788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78200-68c7-4b1b-88e6-791d6b1f6da7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:41.961743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78200-68c7-4b1b-88e6-791d6b1f6da7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:42.059518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661be62e-f9f5-44e4-88c0-20e9b5c2e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:42.060811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be62e-f9f5-44e4-88c0-20e9b5c2e216 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:42.061187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be62e-f9f5-44e4-88c0-20e9b5c2e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:42.061655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be62e-f9f5-44e4-88c0-20e9b5c2e216 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:42.062522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661be62e-f9f5-44e4-88c0-20e9b5c2e216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:42.064508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661be62e-f9f5-44e4-88c0-20e9b5c2e216 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:42.080383 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4163/8324] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:42.084139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed0a57-00c4-4ab6-b5d1-3fdb9039d072 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:42.096142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed0a57-00c4-4ab6-b5d1-3fdb9039d072 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:42.109406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ba5ec-ed55-4a8c-ae08-dae54ffb408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:42.110360 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ba5ec-ed55-4a8c-ae08-dae54ffb408a admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:42.110870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ba5ec-ed55-4a8c-ae08-dae54ffb408a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:42.110870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ba5ec-ed55-4a8c-ae08-dae54ffb408a admin admin] PATH_INFO: `/v3/projects/f9ee52aba69e494e86667326d2d1b5e4/users/2e873eae00f544f19c64f3ec6817530e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:42.114289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ba5ec-ed55-4a8c-ae08-dae54ffb408a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ee52aba69e494e86667326d2d1b5e4, user_id=2e873eae00f544f19c64f3ec6817530e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:42.118179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ba5ec-ed55-4a8c-ae08-dae54ffb408a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:42.138833 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4162/8325] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:20:42 2022] PUT /identity/v3/projects/f9ee52aba69e494e86667326d2d1b5e4/users/2e873eae00f544f19c64f3ec6817530e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:44.036212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d9d81-53ce-4fe7-bbb9-ccce05cc0300 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:44.037130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d9d81-53ce-4fe7-bbb9-ccce05cc0300 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:44.037554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d9d81-53ce-4fe7-bbb9-ccce05cc0300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:44.071570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9c2d9d81-53ce-4fe7-bbb9-ccce05cc0300 None None] MFA Rules not processed for user `2e873eae00f544f19c64f3ec6817530e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:44.073178 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9c2d9d81-53ce-4fe7-bbb9-ccce05cc0300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:44.176393 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4164/8326] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:44.185548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785aeaa-eaac-4c91-a457-4675ee1a6aec None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:44.186433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785aeaa-eaac-4c91-a457-4675ee1a6aec None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:44.186895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785aeaa-eaac-4c91-a457-4675ee1a6aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:44.206420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e785aeaa-eaac-4c91-a457-4675ee1a6aec None None] MFA Rules not processed for user `75acfc9921fc44bb8b307616ae5da163`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:44.207929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e785aeaa-eaac-4c91-a457-4675ee1a6aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:44.275812 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4163/8327] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:44.283903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d9d81-53ce-4fe7-bbb9-ccce05cc0300 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:44.410469 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d9d81-53ce-4fe7-bbb9-ccce05cc0300 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:44.420148 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0a4f9-0b4e-48ab-b6da-af8636a30b0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:44.420856 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a4f9-0b4e-48ab-b6da-af8636a30b0f service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:44.421144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a4f9-0b4e-48ab-b6da-af8636a30b0f service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:44.421578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a4f9-0b4e-48ab-b6da-af8636a30b0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:44.434221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0a4f9-0b4e-48ab-b6da-af8636a30b0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:44.435888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0a4f9-0b4e-48ab-b6da-af8636a30b0f service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:44.459333 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4165/8328] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:50.429612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785aeaa-eaac-4c91-a457-4675ee1a6aec None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:50.430930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e785aeaa-eaac-4c91-a457-4675ee1a6aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:50.559201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785aeaa-eaac-4c91-a457-4675ee1a6aec None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:50.573022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:50.574145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:50.574660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:50.575128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] PATH_INFO: `/v3/users/2c6817b44b9841de843d33297449df5d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:50.579277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6817b44b9841de843d33297449df5d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:50.584233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:50.698073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6817b44b9841de843d33297449df5d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:50.716057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6817b44b9841de843d33297449df5d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:50.734262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6817b44b9841de843d33297449df5d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:50.735294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6817b44b9841de843d33297449df5d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:50.736797 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6817b44b9841de843d33297449df5d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:50.754882 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4164/8329] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:20:50 2022] DELETE /identity/v3/users/2c6817b44b9841de843d33297449df5d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:50.761720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef12b2-f94d-42d0-8a37-3803145efeee None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:50.762260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef12b2-f94d-42d0-8a37-3803145efeee None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:50.762338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef12b2-f94d-42d0-8a37-3803145efeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:50.789612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3aef12b2-f94d-42d0-8a37-3803145efeee None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:50.792691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3aef12b2-f94d-42d0-8a37-3803145efeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:50.956955 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4166/8330] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:50.978021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:50.980400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:51.084219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a485-32ca-4d29-920e-1089ff432e60 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:51.097130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaf38c-2c88-4090-b1a1-24d584ffe783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:51.098249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf38c-2c88-4090-b1a1-24d584ffe783 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:51.100417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf38c-2c88-4090-b1a1-24d584ffe783 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:51.100946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf38c-2c88-4090-b1a1-24d584ffe783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:51.119106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaf38c-2c88-4090-b1a1-24d584ffe783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:51.121633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaf38c-2c88-4090-b1a1-24d584ffe783 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:51.133247 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4165/8331] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:20:51.656720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef12b2-f94d-42d0-8a37-3803145efeee None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:51.658263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3aef12b2-f94d-42d0-8a37-3803145efeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:51.671168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef12b2-f94d-42d0-8a37-3803145efeee None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:51.683418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:51.684559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:51.684989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:51.685378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] PATH_INFO: `/v3/projects/0536dcef551e4e76a62fb8fd56a36335` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:51.687267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0536dcef551e4e76a62fb8fd56a36335)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:51.689847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:51.771528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0536dcef551e4e76a62fb8fd56a36335', 'request_id': 'req-98142a71-1bc2-491b-8f09-c10d1353ad63'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:51.787838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0536dcef551e4e76a62fb8fd56a36335', 'request_id': 'req-98142a71-1bc2-491b-8f09-c10d1353ad63'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:51.807869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0536dcef551e4e76a62fb8fd56a36335', 'request_id': 'req-98142a71-1bc2-491b-8f09-c10d1353ad63'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:51.833808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] The token cache is being invalidate because project 0536dcef551e4e76a62fb8fd56a36335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:20:51.834432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:51.835876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-98142a71-1bc2-491b-8f09-c10d1353ad63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:20:51.838887 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4167/8332] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:20:51 2022] DELETE /identity/v3/projects/0536dcef551e4e76a62fb8fd56a36335 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:20:51.844622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbbbde-ea34-4f9e-a663-c2d548d3d028 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:51.845492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbbbde-ea34-4f9e-a663-c2d548d3d028 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:51.845948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbbbde-ea34-4f9e-a663-c2d548d3d028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:51.886594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e5dbbbde-ea34-4f9e-a663-c2d548d3d028 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:51.888138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e5dbbbde-ea34-4f9e-a663-c2d548d3d028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:51.985640 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4166/8333] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:20:51.986953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b59b-9f20-4754-956a-a6f88e45fa51 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:51.987247 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b59b-9f20-4754-956a-a6f88e45fa51 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:51.987529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830b59b-9f20-4754-956a-a6f88e45fa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:52.011448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3830b59b-9f20-4754-956a-a6f88e45fa51 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:52.013364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3830b59b-9f20-4754-956a-a6f88e45fa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:52.032984 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4168/8334] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:52.035439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbbbde-ea34-4f9e-a663-c2d548d3d028 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:52.049993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbbbde-ea34-4f9e-a663-c2d548d3d028 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:52.071775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:52.074384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:52.076055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:52.077058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:52.078893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:20:52.079607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:52.083764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:52.123969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b59b-9f20-4754-956a-a6f88e45fa51 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:52.124505 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4167/8335] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:20:52.153960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830b59b-9f20-4754-956a-a6f88e45fa51 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:52.167071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04798721-3d56-45e9-8694-867b00b35ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:52.167941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798721-3d56-45e9-8694-867b00b35ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:52.169012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798721-3d56-45e9-8694-867b00b35ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:52.169540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798721-3d56-45e9-8694-867b00b35ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:52.171359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04798721-3d56-45e9-8694-867b00b35ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:52.174219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04798721-3d56-45e9-8694-867b00b35ce9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:52.224368 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4169/8336] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:20:52 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:20:52.228398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:52.249127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806dee-095d-4913-8528-88e1654251ef admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:52.415698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395e57-05f3-42e2-b245-8151332dd460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:52.416987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395e57-05f3-42e2-b245-8151332dd460 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:52.417468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395e57-05f3-42e2-b245-8151332dd460 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:52.417966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395e57-05f3-42e2-b245-8151332dd460 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:52.419285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd395e57-05f3-42e2-b245-8151332dd460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:52.423268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd395e57-05f3-42e2-b245-8151332dd460 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:52.469904 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4168/8337] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:20:52 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:20:52.471992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04798721-3d56-45e9-8694-867b00b35ce9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:52.488463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04798721-3d56-45e9-8694-867b00b35ce9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:52.504912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cfc3a-1447-4cd0-a9da-5351f28c05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:52.506039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfc3a-1447-4cd0-a9da-5351f28c05cd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:52.506670 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfc3a-1447-4cd0-a9da-5351f28c05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:52.507206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfc3a-1447-4cd0-a9da-5351f28c05cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:52.508437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cfc3a-1447-4cd0-a9da-5351f28c05cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:52.511487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cfc3a-1447-4cd0-a9da-5351f28c05cd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:52.529693 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4170/8338] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:52.541088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395e57-05f3-42e2-b245-8151332dd460 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:52.596439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395e57-05f3-42e2-b245-8151332dd460 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:52.627215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b22bea-0d68-4892-8278-821cc092f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:52.629133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b22bea-0d68-4892-8278-821cc092f7bd admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:52.631430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b22bea-0d68-4892-8278-821cc092f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:52.631999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b22bea-0d68-4892-8278-821cc092f7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:52.635026 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b22bea-0d68-4892-8278-821cc092f7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:52.642127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b22bea-0d68-4892-8278-821cc092f7bd admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:52.690435 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4169/8339] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:20:52.692046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cfc3a-1447-4cd0-a9da-5351f28c05cd admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:52.719561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cfc3a-1447-4cd0-a9da-5351f28c05cd admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:52.733615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:52.736796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:52.737214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:52.738360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] PATH_INFO: `/v3/projects/ff6923d11cfd4943aec6ed8493a824b8/users/a560b7be420a4924800ffb79e0b9995d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:52.766582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6923d11cfd4943aec6ed8493a824b8, user_id=a560b7be420a4924800ffb79e0b9995d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:52.770032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:52.805702 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4171/8340] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:20:52 2022] PUT /identity/v3/projects/ff6923d11cfd4943aec6ed8493a824b8/users/a560b7be420a4924800ffb79e0b9995d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:20:52.817407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c8b7-0fea-40c0-a4ad-26a5ee15e1a9 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:52.817886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c8b7-0fea-40c0-a4ad-26a5ee15e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:52.818344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c8b7-0fea-40c0-a4ad-26a5ee15e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:52.867725 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0c16c8b7-0fea-40c0-a4ad-26a5ee15e1a9 None None] MFA Rules not processed for user `a560b7be420a4924800ffb79e0b9995d`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:20:52.869328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0c16c8b7-0fea-40c0-a4ad-26a5ee15e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:53.021613 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4170/8341] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:20:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:20:53.034377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:20:53.036415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:20:53.149879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162c62-1a08-478d-9813-cf5fbf8b17dc admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:20:53.156651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:20:53.158528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:20:53.158997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:20:53.159620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:20:53.174424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:20:53.176622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:20:53.201745 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4172/8342] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:20:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:00.313839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72602610-ff6e-4c85-add6-aae78342e17b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:00.314706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72602610-ff6e-4c85-add6-aae78342e17b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:00.314706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72602610-ff6e-4c85-add6-aae78342e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:00.351168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-72602610-ff6e-4c85-add6-aae78342e17b None None] MFA Rules not processed for user `e1fde410660b47939139960a9420179a`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:00.353849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-72602610-ff6e-4c85-add6-aae78342e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:00.461014 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4171/8343] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:01.543685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:01.545683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:01.673217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722d6d4-fdeb-44c6-9254-9d8461cd299a service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:01.680505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:01.682218 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:01.682964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:01.683370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:01.698463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:01.719287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:01.721360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:01.737288 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4173/8344] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:05.498039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72602610-ff6e-4c85-add6-aae78342e17b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:05.501792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-72602610-ff6e-4c85-add6-aae78342e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:05.735455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72602610-ff6e-4c85-add6-aae78342e17b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:05.772724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89829e5-dc5c-49fa-9703-b8c98e56d28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:05.773933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89829e5-dc5c-49fa-9703-b8c98e56d28c service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:05.774440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89829e5-dc5c-49fa-9703-b8c98e56d28c service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:05.775798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89829e5-dc5c-49fa-9703-b8c98e56d28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:05.781364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f89829e5-dc5c-49fa-9703-b8c98e56d28c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:05.806036 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89829e5-dc5c-49fa-9703-b8c98e56d28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:05.808965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89829e5-dc5c-49fa-9703-b8c98e56d28c service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:05.868129 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4172/8345] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:06.726304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:06.813102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbcd35-4d8c-4117-8fdb-aed2022cb76c service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:06.819631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:06.820710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:06.821214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:06.821507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] PATH_INFO: `/v3/users/a560b7be420a4924800ffb79e0b9995d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:06.822947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a560b7be420a4924800ffb79e0b9995d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:06.824940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:06.892510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a560b7be420a4924800ffb79e0b9995d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:06.893466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a560b7be420a4924800ffb79e0b9995d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:06.894258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a560b7be420a4924800ffb79e0b9995d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:06.914604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a560b7be420a4924800ffb79e0b9995d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:06.924715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a560b7be420a4924800ffb79e0b9995d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:06.940943 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4174/8346] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:06 2022] DELETE /identity/v3/users/a560b7be420a4924800ffb79e0b9995d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:06.948739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc01aa5-3f74-4f46-8c7f-096b784df752 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:06.949428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc01aa5-3f74-4f46-8c7f-096b784df752 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:06.949428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc01aa5-3f74-4f46-8c7f-096b784df752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:06.973348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8dc01aa5-3f74-4f46-8c7f-096b784df752 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:06.974720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8dc01aa5-3f74-4f46-8c7f-096b784df752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:07.056741 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4173/8347] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:21:07.069503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:07.070980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:07.147576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32ea45-52cf-4d57-b4b7-1e0697295ef5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:07.152496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafd101-edf6-4173-a685-dcb4df4c2957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:07.153136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd101-edf6-4173-a685-dcb4df4c2957 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:07.153427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd101-edf6-4173-a685-dcb4df4c2957 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:07.153703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd101-edf6-4173-a685-dcb4df4c2957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:07.169403 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd101-edf6-4173-a685-dcb4df4c2957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:07.170964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd101-edf6-4173-a685-dcb4df4c2957 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:07.182805 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4175/8348] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:07.407186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc01aa5-3f74-4f46-8c7f-096b784df752 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:07.409770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8dc01aa5-3f74-4f46-8c7f-096b784df752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:07.424980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc01aa5-3f74-4f46-8c7f-096b784df752 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:07.431518 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:07.432874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:07.433293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:07.433511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] PATH_INFO: `/v3/projects/ff6923d11cfd4943aec6ed8493a824b8` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:07.435099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6923d11cfd4943aec6ed8493a824b8)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:07.437277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:07.505914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6923d11cfd4943aec6ed8493a824b8', 'request_id': 'req-21f7aaa8-2298-4496-8182-c11655020353'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:07.512997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6923d11cfd4943aec6ed8493a824b8', 'request_id': 'req-21f7aaa8-2298-4496-8182-c11655020353'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:07.522957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6923d11cfd4943aec6ed8493a824b8', 'request_id': 'req-21f7aaa8-2298-4496-8182-c11655020353'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:07.539072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] The token cache is being invalidate because project ff6923d11cfd4943aec6ed8493a824b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:07.539403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:07.540656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-21f7aaa8-2298-4496-8182-c11655020353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:07.544385 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4174/8349] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:07 2022] DELETE /identity/v3/projects/ff6923d11cfd4943aec6ed8493a824b8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:07.554145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d351a68-3ded-46f7-813a-1d1679d6d39b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:07.554429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d351a68-3ded-46f7-813a-1d1679d6d39b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:07.554710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d351a68-3ded-46f7-813a-1d1679d6d39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:07.579631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7d351a68-3ded-46f7-813a-1d1679d6d39b None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:07.581266 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7d351a68-3ded-46f7-813a-1d1679d6d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:07.655544 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4176/8350] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:07.664296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc098e5-e01c-46a6-b061-c854442072d8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:07.664651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc098e5-e01c-46a6-b061-c854442072d8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:07.664953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc098e5-e01c-46a6-b061-c854442072d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:07.686994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3cc098e5-e01c-46a6-b061-c854442072d8 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:07.695750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3cc098e5-e01c-46a6-b061-c854442072d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:07.697435 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4175/8351] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:07.702110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d351a68-3ded-46f7-813a-1d1679d6d39b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:07.713318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d351a68-3ded-46f7-813a-1d1679d6d39b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:07.719913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:07.721137 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:07.721597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:07.721930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:07.722780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:21:07.723167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:07.725769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:07.742260 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4177/8352] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:21:07.749516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc098e5-e01c-46a6-b061-c854442072d8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:07.761835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc098e5-e01c-46a6-b061-c854442072d8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:07.766945 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cab3d-ae8c-4712-aa1a-d91685be4cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:07.767413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cab3d-ae8c-4712-aa1a-d91685be4cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:07.767707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cab3d-ae8c-4712-aa1a-d91685be4cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:07.767983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cab3d-ae8c-4712-aa1a-d91685be4cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:07.768745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cab3d-ae8c-4712-aa1a-d91685be4cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:07.770679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cab3d-ae8c-4712-aa1a-d91685be4cd1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:07.802239 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4176/8353] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:21:07 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:07.807279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:07.819079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e57a9-8fb0-459f-87ba-4df23c6c9ac8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:07.889482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f775537-4bde-419b-ac2a-f6c366416bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:07.890271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f775537-4bde-419b-ac2a-f6c366416bac admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:07.890655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f775537-4bde-419b-ac2a-f6c366416bac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:07.890973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f775537-4bde-419b-ac2a-f6c366416bac admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:07.891675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f775537-4bde-419b-ac2a-f6c366416bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:07.894235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f775537-4bde-419b-ac2a-f6c366416bac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:07.916625 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4178/8354] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:21:07 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:21:07.922332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cab3d-ae8c-4712-aa1a-d91685be4cd1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:07.934605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cab3d-ae8c-4712-aa1a-d91685be4cd1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:07.940257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c42efc-7cd0-4c50-8807-358ef6f95060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:07.941252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42efc-7cd0-4c50-8807-358ef6f95060 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:07.941540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42efc-7cd0-4c50-8807-358ef6f95060 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:07.941886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42efc-7cd0-4c50-8807-358ef6f95060 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:07.942800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c42efc-7cd0-4c50-8807-358ef6f95060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:07.946796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c42efc-7cd0-4c50-8807-358ef6f95060 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:07.973062 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4177/8355] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:07.979722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f775537-4bde-419b-ac2a-f6c366416bac admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:08.001555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f775537-4bde-419b-ac2a-f6c366416bac admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:08.016864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab687ffc-027b-4a91-aa06-0f49e91d461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:08.017577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab687ffc-027b-4a91-aa06-0f49e91d461a admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.017950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab687ffc-027b-4a91-aa06-0f49e91d461a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.018319 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab687ffc-027b-4a91-aa06-0f49e91d461a admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.019299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab687ffc-027b-4a91-aa06-0f49e91d461a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:08.023325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab687ffc-027b-4a91-aa06-0f49e91d461a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:08.037278 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4179/8356] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:08.043539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c42efc-7cd0-4c50-8807-358ef6f95060 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:08.054532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c42efc-7cd0-4c50-8807-358ef6f95060 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:08.061950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02109c8-2212-4a82-9a6c-a87f1759f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:08.063185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02109c8-2212-4a82-9a6c-a87f1759f38c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.063462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02109c8-2212-4a82-9a6c-a87f1759f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.063736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02109c8-2212-4a82-9a6c-a87f1759f38c admin admin] PATH_INFO: `/v3/projects/05c16f84eefc46bc9bdfc6d0f3723ac6/users/0efea3be86504ec2acde2bea6bc96864/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.081523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02109c8-2212-4a82-9a6c-a87f1759f38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c16f84eefc46bc9bdfc6d0f3723ac6, user_id=0efea3be86504ec2acde2bea6bc96864, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:08.084242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02109c8-2212-4a82-9a6c-a87f1759f38c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:08.103845 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4178/8357] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:08 2022] PUT /identity/v3/projects/05c16f84eefc46bc9bdfc6d0f3723ac6/users/0efea3be86504ec2acde2bea6bc96864/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:21:08.115561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80790-9fa9-46ba-a984-7f0cb97ca6a3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.115758 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80790-9fa9-46ba-a984-7f0cb97ca6a3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.115968 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80790-9fa9-46ba-a984-7f0cb97ca6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.149916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e5e80790-9fa9-46ba-a984-7f0cb97ca6a3 None None] MFA Rules not processed for user `0efea3be86504ec2acde2bea6bc96864`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:08.151237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e5e80790-9fa9-46ba-a984-7f0cb97ca6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:08.235655 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4180/8358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:08.240594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02109c8-2212-4a82-9a6c-a87f1759f38c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:08.326462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02109c8-2212-4a82-9a6c-a87f1759f38c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:08.332718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efcf69-8527-4d44-9103-407f2fef6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:08.333385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efcf69-8527-4d44-9103-407f2fef6200 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.333859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efcf69-8527-4d44-9103-407f2fef6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.334264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efcf69-8527-4d44-9103-407f2fef6200 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.334883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efcf69-8527-4d44-9103-407f2fef6200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:08.337123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efcf69-8527-4d44-9103-407f2fef6200 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:08.380740 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4179/8359] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:21:08 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:21:08.383892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80790-9fa9-46ba-a984-7f0cb97ca6a3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:08.397517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80790-9fa9-46ba-a984-7f0cb97ca6a3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:08.480538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d7bd-979c-46a6-8b97-08dd638d06b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:08.481378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d7bd-979c-46a6-8b97-08dd638d06b9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.481667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d7bd-979c-46a6-8b97-08dd638d06b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.481993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d7bd-979c-46a6-8b97-08dd638d06b9 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.482836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892d7bd-979c-46a6-8b97-08dd638d06b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:08.485509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892d7bd-979c-46a6-8b97-08dd638d06b9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:08.509966 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4181/8360] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:21:08 2022] POST /identity/v3/users => generated 309 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:08.515365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efcf69-8527-4d44-9103-407f2fef6200 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:08.535415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efcf69-8527-4d44-9103-407f2fef6200 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:08.549901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b285e-8238-4575-9c83-22843451d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:08.551277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b285e-8238-4575-9c83-22843451d0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.551843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b285e-8238-4575-9c83-22843451d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.552507 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b285e-8238-4575-9c83-22843451d0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.553407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b285e-8238-4575-9c83-22843451d0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:08.555258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b285e-8238-4575-9c83-22843451d0d7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:08.568385 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4180/8361] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:08.581015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d7bd-979c-46a6-8b97-08dd638d06b9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:08.597615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d7bd-979c-46a6-8b97-08dd638d06b9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:08.606438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab17e-0a99-4581-b6ec-c8c7acf85c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:08.607117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab17e-0a99-4581-b6ec-c8c7acf85c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.607396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab17e-0a99-4581-b6ec-c8c7acf85c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.607697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab17e-0a99-4581-b6ec-c8c7acf85c2a admin admin] PATH_INFO: `/v3/projects/d486fd40def9400fb92343e59f52eb62/users/2d8c2c9fc46e4b37b8ec2e5183f038fd/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.627650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ab17e-0a99-4581-b6ec-c8c7acf85c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d486fd40def9400fb92343e59f52eb62, user_id=2d8c2c9fc46e4b37b8ec2e5183f038fd, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:08.630487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ab17e-0a99-4581-b6ec-c8c7acf85c2a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:08.652038 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4182/8362] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:08 2022] PUT /identity/v3/projects/d486fd40def9400fb92343e59f52eb62/users/2d8c2c9fc46e4b37b8ec2e5183f038fd/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:21:08.654333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b285e-8238-4575-9c83-22843451d0d7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:08.666191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b285e-8238-4575-9c83-22843451d0d7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:08.758257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099588ea-0836-4810-917d-15842d5b128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:08.758977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099588ea-0836-4810-917d-15842d5b128b admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.760092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099588ea-0836-4810-917d-15842d5b128b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.760444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099588ea-0836-4810-917d-15842d5b128b admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.761261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099588ea-0836-4810-917d-15842d5b128b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:08.762884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099588ea-0836-4810-917d-15842d5b128b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:08.775949 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4181/8363] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:21:08.780939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab17e-0a99-4581-b6ec-c8c7acf85c2a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:08.795244 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab17e-0a99-4581-b6ec-c8c7acf85c2a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:08.802908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:08.804311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.804696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.805151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] PATH_INFO: `/v3/projects/d486fd40def9400fb92343e59f52eb62/users/2d8c2c9fc46e4b37b8ec2e5183f038fd/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.807617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d486fd40def9400fb92343e59f52eb62, user_id=2d8c2c9fc46e4b37b8ec2e5183f038fd, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:08.813803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:08.831585 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4183/8364] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:08 2022] PUT /identity/v3/projects/d486fd40def9400fb92343e59f52eb62/users/2d8c2c9fc46e4b37b8ec2e5183f038fd/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:08.929403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc78a-7ba5-4aa6-a9df-c832b44c3556 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:08.929403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc78a-7ba5-4aa6-a9df-c832b44c3556 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:08.930079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc78a-7ba5-4aa6-a9df-c832b44c3556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:08.971937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c7cbc78a-7ba5-4aa6-a9df-c832b44c3556 None None] MFA Rules not processed for user `2d8c2c9fc46e4b37b8ec2e5183f038fd`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:08.973891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c7cbc78a-7ba5-4aa6-a9df-c832b44c3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:09.065811 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4182/8365] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:09.077011 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:09.079693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:09.157813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3cc75-455d-4fad-a6d2-7401f335ce2b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:09.163604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2693a2c-86c3-45d9-adda-44b75ec97aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:09.164748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2693a2c-86c3-45d9-adda-44b75ec97aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:09.165201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2693a2c-86c3-45d9-adda-44b75ec97aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:09.166378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2693a2c-86c3-45d9-adda-44b75ec97aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:09.185631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2693a2c-86c3-45d9-adda-44b75ec97aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:09.187874 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2693a2c-86c3-45d9-adda-44b75ec97aa2 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:09.202949 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4184/8366] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:09.362942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbc78a-7ba5-4aa6-a9df-c832b44c3556 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:09.445985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbc78a-7ba5-4aa6-a9df-c832b44c3556 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:09.453879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:09.454898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:09.455176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:09.455485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] PATH_INFO: `/v3/users/0efea3be86504ec2acde2bea6bc96864` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:09.457108 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efea3be86504ec2acde2bea6bc96864)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:09.459994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:09.519792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efea3be86504ec2acde2bea6bc96864'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:09.542008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efea3be86504ec2acde2bea6bc96864'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:09.550145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efea3be86504ec2acde2bea6bc96864'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:09.551091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efea3be86504ec2acde2bea6bc96864'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:09.551888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efea3be86504ec2acde2bea6bc96864'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:09.568677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4183/8367] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:09 2022] DELETE /identity/v3/users/0efea3be86504ec2acde2bea6bc96864 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:21:09.574298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072b14-3fa1-4a6f-8ca4-26070b74a353 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:09.574623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072b14-3fa1-4a6f-8ca4-26070b74a353 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:09.574927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072b14-3fa1-4a6f-8ca4-26070b74a353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:09.595158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d6072b14-3fa1-4a6f-8ca4-26070b74a353 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:09.596359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6072b14-3fa1-4a6f-8ca4-26070b74a353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:09.660582 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4185/8368] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:09.671243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:09.672816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:09.750497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc29dc-1006-421d-ad31-4c474250149e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:09.755730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed102e0-e00d-475c-b5df-3e8f0f33d85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:09.756635 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed102e0-e00d-475c-b5df-3e8f0f33d85e service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:09.756909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed102e0-e00d-475c-b5df-3e8f0f33d85e service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:09.757335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed102e0-e00d-475c-b5df-3e8f0f33d85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:09.769180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed102e0-e00d-475c-b5df-3e8f0f33d85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:09.771501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed102e0-e00d-475c-b5df-3e8f0f33d85e service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:09.784799 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4184/8369] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:21:10.126274 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6072b14-3fa1-4a6f-8ca4-26070b74a353 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:10.127941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6072b14-3fa1-4a6f-8ca4-26070b74a353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:10.151640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6072b14-3fa1-4a6f-8ca4-26070b74a353 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:10.167418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:10.168362 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:10.168651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:10.168925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] PATH_INFO: `/v3/projects/05c16f84eefc46bc9bdfc6d0f3723ac6` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:10.170297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c16f84eefc46bc9bdfc6d0f3723ac6)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:10.172384 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:10.247291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c16f84eefc46bc9bdfc6d0f3723ac6', 'request_id': 'req-1910fef7-a74f-43ae-87a1-6a38bab1076c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.254418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c16f84eefc46bc9bdfc6d0f3723ac6', 'request_id': 'req-1910fef7-a74f-43ae-87a1-6a38bab1076c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.277017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c16f84eefc46bc9bdfc6d0f3723ac6', 'request_id': 'req-1910fef7-a74f-43ae-87a1-6a38bab1076c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.298157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] The token cache is being invalidate because project 05c16f84eefc46bc9bdfc6d0f3723ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:10.298458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.299248 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.301199 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4186/8370] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:10 2022] DELETE /identity/v3/projects/05c16f84eefc46bc9bdfc6d0f3723ac6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:10.306852 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed102e0-e00d-475c-b5df-3e8f0f33d85e service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:10.322522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed102e0-e00d-475c-b5df-3e8f0f33d85e service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:10.419281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:10.420201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:10.420759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:10.421143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] PATH_INFO: `/v3/users/2d8c2c9fc46e4b37b8ec2e5183f038fd` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:10.422511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8c2c9fc46e4b37b8ec2e5183f038fd)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:10.425158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:10.510262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8c2c9fc46e4b37b8ec2e5183f038fd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.537143 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8c2c9fc46e4b37b8ec2e5183f038fd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.552051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8c2c9fc46e4b37b8ec2e5183f038fd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.553436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8c2c9fc46e4b37b8ec2e5183f038fd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.554294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-83fb7fdb-3cae-49c3-8b07-c367b5073ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8c2c9fc46e4b37b8ec2e5183f038fd'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:10.579342 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4185/8371] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:10 2022] DELETE /identity/v3/users/2d8c2c9fc46e4b37b8ec2e5183f038fd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:11.023682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:11.027143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:11.049332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910fef7-a74f-43ae-87a1-6a38bab1076c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:11.120424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:11.121312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.121583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.121853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] PATH_INFO: `/v3/projects/d486fd40def9400fb92343e59f52eb62` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.123318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d486fd40def9400fb92343e59f52eb62)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:11.125297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:11.186304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd486fd40def9400fb92343e59f52eb62', 'request_id': 'req-7ee18969-c2bd-4173-a6db-dc64fa3091f1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:11.193947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd486fd40def9400fb92343e59f52eb62', 'request_id': 'req-7ee18969-c2bd-4173-a6db-dc64fa3091f1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:11.217159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd486fd40def9400fb92343e59f52eb62', 'request_id': 'req-7ee18969-c2bd-4173-a6db-dc64fa3091f1'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:11.238368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] The token cache is being invalidate because project d486fd40def9400fb92343e59f52eb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:11.238960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:11.240049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7ee18969-c2bd-4173-a6db-dc64fa3091f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:11.250293 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4187/8372] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:11 2022] DELETE /identity/v3/projects/d486fd40def9400fb92343e59f52eb62 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:11.252208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41cbeb-5048-4465-a833-12577fe5c228 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.252611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41cbeb-5048-4465-a833-12577fe5c228 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.252886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41cbeb-5048-4465-a833-12577fe5c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.275436 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2a41cbeb-5048-4465-a833-12577fe5c228 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:11.277632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2a41cbeb-5048-4465-a833-12577fe5c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:11.369151 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4186/8373] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:11.377283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094163-2837-421e-a4e7-06abb7eef410 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.377691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094163-2837-421e-a4e7-06abb7eef410 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.378023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094163-2837-421e-a4e7-06abb7eef410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.400898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6a094163-2837-421e-a4e7-06abb7eef410 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:11.402530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6a094163-2837-421e-a4e7-06abb7eef410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:11.412078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4188/8374] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:11.417692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41cbeb-5048-4465-a833-12577fe5c228 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:11.431816 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41cbeb-5048-4465-a833-12577fe5c228 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:11.438234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:11.439325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.439791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.440262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.441601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:21:11.442176 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:11.444260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:11.459721 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4187/8375] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:21:11.465267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a094163-2837-421e-a4e7-06abb7eef410 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:11.475175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a094163-2837-421e-a4e7-06abb7eef410 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:11.481869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1217d-4897-41a7-949c-2d426e5d17ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:11.482687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1217d-4897-41a7-949c-2d426e5d17ff admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.483005 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1217d-4897-41a7-949c-2d426e5d17ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.483421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1217d-4897-41a7-949c-2d426e5d17ff admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.484132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1217d-4897-41a7-949c-2d426e5d17ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:11.486389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1217d-4897-41a7-949c-2d426e5d17ff admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:11.517476 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4189/8376] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:21:11 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:11.521712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:11.533872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e188f-40ef-46ab-bf0e-516596400c6f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:11.622831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c2fa5-006c-4a13-a8db-adb128540993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:11.623594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c2fa5-006c-4a13-a8db-adb128540993 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.623937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c2fa5-006c-4a13-a8db-adb128540993 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.624479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c2fa5-006c-4a13-a8db-adb128540993 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.625511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c2fa5-006c-4a13-a8db-adb128540993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:11.627703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c2fa5-006c-4a13-a8db-adb128540993 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:11.652237 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4188/8377] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:21:11 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:11.656565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1217d-4897-41a7-949c-2d426e5d17ff admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:11.674363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1217d-4897-41a7-949c-2d426e5d17ff admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:11.681095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff5e51-d698-43c6-a57e-e4232c5fffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:11.681849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff5e51-d698-43c6-a57e-e4232c5fffef admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.682128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff5e51-d698-43c6-a57e-e4232c5fffef admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.682419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff5e51-d698-43c6-a57e-e4232c5fffef admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.683203 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff5e51-d698-43c6-a57e-e4232c5fffef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:11.688223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff5e51-d698-43c6-a57e-e4232c5fffef admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:11.701938 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4190/8378] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:11.711759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c2fa5-006c-4a13-a8db-adb128540993 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:11.740417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c2fa5-006c-4a13-a8db-adb128540993 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:11.744915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafeacf-88a8-4a00-ad45-4dcab8560cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:11.745615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafeacf-88a8-4a00-ad45-4dcab8560cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.745900 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafeacf-88a8-4a00-ad45-4dcab8560cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.746179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafeacf-88a8-4a00-ad45-4dcab8560cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.747786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafeacf-88a8-4a00-ad45-4dcab8560cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:11.748646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafeacf-88a8-4a00-ad45-4dcab8560cc4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:11.764529 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4189/8379] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:11.767471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff5e51-d698-43c6-a57e-e4232c5fffef admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:11.780212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff5e51-d698-43c6-a57e-e4232c5fffef admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:11.788125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:11.789793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.790095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.790445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] PATH_INFO: `/v3/projects/11e2a227c87942d7ad7e2c9d8329fd65/users/240cbe1ec99f40be9520de32902a357c/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.819565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e2a227c87942d7ad7e2c9d8329fd65, user_id=240cbe1ec99f40be9520de32902a357c, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:11.825446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:11.863635 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4191/8380] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:11 2022] PUT /identity/v3/projects/11e2a227c87942d7ad7e2c9d8329fd65/users/240cbe1ec99f40be9520de32902a357c/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:11.879180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9fc1d-8439-4f42-a72e-5ef4ab524e75 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:11.879916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9fc1d-8439-4f42-a72e-5ef4ab524e75 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:11.880538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9fc1d-8439-4f42-a72e-5ef4ab524e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:11.919601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f8f9fc1d-8439-4f42-a72e-5ef4ab524e75 None None] MFA Rules not processed for user `240cbe1ec99f40be9520de32902a357c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:11.920867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8f9fc1d-8439-4f42-a72e-5ef4ab524e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:12.015684 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4190/8381] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:12.031329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:12.033954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:12.114424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb84a09-2450-4c88-91ff-7787c00cb826 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:12.119518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d28732-6dd4-4e54-8a55-8eb3ffc297b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:12.120255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d28732-6dd4-4e54-8a55-8eb3ffc297b4 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:12.120634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d28732-6dd4-4e54-8a55-8eb3ffc297b4 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:12.120914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d28732-6dd4-4e54-8a55-8eb3ffc297b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:12.131279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d28732-6dd4-4e54-8a55-8eb3ffc297b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:12.132919 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d28732-6dd4-4e54-8a55-8eb3ffc297b4 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:12.143993 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4192/8382] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:21:17.300535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9fc1d-8439-4f42-a72e-5ef4ab524e75 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:17.425003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9fc1d-8439-4f42-a72e-5ef4ab524e75 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:17.431434 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:17.432674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:17.433011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:17.433861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] PATH_INFO: `/v3/users/240cbe1ec99f40be9520de32902a357c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:17.435349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=240cbe1ec99f40be9520de32902a357c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:17.438796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:17.531462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240cbe1ec99f40be9520de32902a357c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:17.568034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240cbe1ec99f40be9520de32902a357c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:17.589364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240cbe1ec99f40be9520de32902a357c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:17.591679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240cbe1ec99f40be9520de32902a357c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:17.592771 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240cbe1ec99f40be9520de32902a357c'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:17.616862 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4191/8383] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:17 2022] DELETE /identity/v3/users/240cbe1ec99f40be9520de32902a357c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:17.621858 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3ae30-fdaf-4ee2-b91e-a834ec87b6a5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:17.622413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3ae30-fdaf-4ee2-b91e-a834ec87b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:17.622413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3ae30-fdaf-4ee2-b91e-a834ec87b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:17.647200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-91e3ae30-fdaf-4ee2-b91e-a834ec87b6a5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:17.648243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-91e3ae30-fdaf-4ee2-b91e-a834ec87b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:17.776410 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4193/8384] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:17.785636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:17.787124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:17.924629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ecf59-8ba0-4b1d-9937-8902028bb83c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:17.931538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaad7d-f49e-4992-93ca-430b1f35c0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:17.932646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaad7d-f49e-4992-93ca-430b1f35c0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:17.933049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaad7d-f49e-4992-93ca-430b1f35c0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:17.933551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaad7d-f49e-4992-93ca-430b1f35c0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:17.950486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaad7d-f49e-4992-93ca-430b1f35c0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:17.954091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaad7d-f49e-4992-93ca-430b1f35c0e2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:17.973496 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4192/8385] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:21:18.555895 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3ae30-fdaf-4ee2-b91e-a834ec87b6a5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:18.558192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-91e3ae30-fdaf-4ee2-b91e-a834ec87b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:18.571402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3ae30-fdaf-4ee2-b91e-a834ec87b6a5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:18.578630 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:18.579764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:18.580063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:18.580422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] PATH_INFO: `/v3/projects/11e2a227c87942d7ad7e2c9d8329fd65` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:18.582004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e2a227c87942d7ad7e2c9d8329fd65)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:18.585439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:18.655069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e2a227c87942d7ad7e2c9d8329fd65', 'request_id': 'req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:18.670687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e2a227c87942d7ad7e2c9d8329fd65', 'request_id': 'req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:18.693363 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e2a227c87942d7ad7e2c9d8329fd65', 'request_id': 'req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:18.714543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] The token cache is being invalidate because project 11e2a227c87942d7ad7e2c9d8329fd65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:18.716687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:18.717466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5a00ce2b-ba7c-4129-88a0-2de2f8e9fbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:18.719142 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4194/8386] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:18 2022] DELETE /identity/v3/projects/11e2a227c87942d7ad7e2c9d8329fd65 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:18.725234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f796-d2a3-45c5-bd7f-2fc3829583a3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:18.735295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f796-d2a3-45c5-bd7f-2fc3829583a3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:18.735769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f796-d2a3-45c5-bd7f-2fc3829583a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:18.764602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0d42f796-d2a3-45c5-bd7f-2fc3829583a3 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:18.766313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0d42f796-d2a3-45c5-bd7f-2fc3829583a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:18.857900 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4193/8387] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:18.860945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ffef4-9f94-4f3b-98be-07d43fd43834 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:18.862326 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ffef4-9f94-4f3b-98be-07d43fd43834 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:18.863332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ffef4-9f94-4f3b-98be-07d43fd43834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:18.887257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-227ffef4-9f94-4f3b-98be-07d43fd43834 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:18.889190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-227ffef4-9f94-4f3b-98be-07d43fd43834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:18.900809 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4195/8388] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:18.905555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42f796-d2a3-45c5-bd7f-2fc3829583a3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:18.916668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42f796-d2a3-45c5-bd7f-2fc3829583a3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:18.923447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:18.924405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:18.924837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:18.925316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:18.926304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:21:18.927504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:18.928882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:18.944147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4194/8389] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:21:18.958601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ffef4-9f94-4f3b-98be-07d43fd43834 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:18.970144 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ffef4-9f94-4f3b-98be-07d43fd43834 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:18.976806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:18.977501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:18.977893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:18.978255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:18.979025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:18.981046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.032127 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4196/8390] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:21:18 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:19.036778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.053157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe82a-dae3-41ab-b43e-f3ffd1906b31 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.173868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fccd24-d376-4d27-887b-11e6cdaa21ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.174682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fccd24-d376-4d27-887b-11e6cdaa21ed admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.174971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fccd24-d376-4d27-887b-11e6cdaa21ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.175242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fccd24-d376-4d27-887b-11e6cdaa21ed admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.175950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fccd24-d376-4d27-887b-11e6cdaa21ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.178439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fccd24-d376-4d27-887b-11e6cdaa21ed admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.186595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.188597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:19.206685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef403b-72f0-47e6-ad9e-6c9f24c292e2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.208524 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4195/8391] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:21:19 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:21:19.213784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.214005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fccd24-d376-4d27-887b-11e6cdaa21ed admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.214766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.215287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.215570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] PATH_INFO: `/v3/users/75acfc9921fc44bb8b307616ae5da163` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.217036 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=75acfc9921fc44bb8b307616ae5da163)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.219227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.227304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fccd24-d376-4d27-887b-11e6cdaa21ed admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.235534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f905c45-328e-414d-8ab9-d508960dde54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.236728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f905c45-328e-414d-8ab9-d508960dde54 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.237383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f905c45-328e-414d-8ab9-d508960dde54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.237504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f905c45-328e-414d-8ab9-d508960dde54 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.238291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f905c45-328e-414d-8ab9-d508960dde54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.240192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f905c45-328e-414d-8ab9-d508960dde54 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.256381 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4196/8392] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:19.258253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f905c45-328e-414d-8ab9-d508960dde54 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.272392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f905c45-328e-414d-8ab9-d508960dde54 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.279354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.280084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.280421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.280737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.281533 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.283406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.287790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75acfc9921fc44bb8b307616ae5da163'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.290800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75acfc9921fc44bb8b307616ae5da163'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.291773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75acfc9921fc44bb8b307616ae5da163'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.299435 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4197/8393] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:21:19.300805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.303182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:19.313432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75acfc9921fc44bb8b307616ae5da163'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.323303 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-5092fd1b-0a9c-4311-bcd9-ae11be5e33ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75acfc9921fc44bb8b307616ae5da163'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.329463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec543ba6-ab07-4cf1-bc60-53c4254b07f2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.339807 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4197/8394] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:19 2022] DELETE /identity/v3/users/75acfc9921fc44bb8b307616ae5da163 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:21:19.340070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc929c6-8ece-4c2c-a76c-c3be13c20ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.341573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc929c6-8ece-4c2c-a76c-c3be13c20ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.341956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc929c6-8ece-4c2c-a76c-c3be13c20ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.342600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc929c6-8ece-4c2c-a76c-c3be13c20ae2 admin admin] PATH_INFO: `/v3/projects/6d70683f9faa4d26bf5d04413711de7f/users/0dbd1b5c72d3493ca1a72612d31076ec/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.365555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc929c6-8ece-4c2c-a76c-c3be13c20ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d70683f9faa4d26bf5d04413711de7f, user_id=0dbd1b5c72d3493ca1a72612d31076ec, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.368722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc929c6-8ece-4c2c-a76c-c3be13c20ae2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.387993 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4198/8395] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:19 2022] PUT /identity/v3/projects/6d70683f9faa4d26bf5d04413711de7f/users/0dbd1b5c72d3493ca1a72612d31076ec/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:21:19.402522 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb3e20-4f55-4e6e-8e7e-4648bca48f69 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.402989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb3e20-4f55-4e6e-8e7e-4648bca48f69 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.403419 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb3e20-4f55-4e6e-8e7e-4648bca48f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.442823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f4fb3e20-4f55-4e6e-8e7e-4648bca48f69 None None] MFA Rules not processed for user `0dbd1b5c72d3493ca1a72612d31076ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:19.444278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f4fb3e20-4f55-4e6e-8e7e-4648bca48f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:19.534360 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4198/8396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:19.539605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc929c6-8ece-4c2c-a76c-c3be13c20ae2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.581261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb3e20-4f55-4e6e-8e7e-4648bca48f69 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.583871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f4fb3e20-4f55-4e6e-8e7e-4648bca48f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:19.642713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc929c6-8ece-4c2c-a76c-c3be13c20ae2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.648718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55919f0-78a6-4be5-9d59-35d119e62874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.649416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55919f0-78a6-4be5-9d59-35d119e62874 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.650600 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55919f0-78a6-4be5-9d59-35d119e62874 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.650943 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55919f0-78a6-4be5-9d59-35d119e62874 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.651751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55919f0-78a6-4be5-9d59-35d119e62874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.653959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55919f0-78a6-4be5-9d59-35d119e62874 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.685557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4199/8397] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:21:19 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:19.690366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb3e20-4f55-4e6e-8e7e-4648bca48f69 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.698907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55919f0-78a6-4be5-9d59-35d119e62874 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.783430 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.784304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.784627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.784909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] PATH_INFO: `/v3/projects/f355422bbc4a402597f285f02ca85a3a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.791887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f355422bbc4a402597f285f02ca85a3a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.791887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.795462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55919f0-78a6-4be5-9d59-35d119e62874 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.800499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a736949-6c82-4d33-bf94-271631bb9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.801243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a736949-6c82-4d33-bf94-271631bb9d17 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.801527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a736949-6c82-4d33-bf94-271631bb9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.801805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a736949-6c82-4d33-bf94-271631bb9d17 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.802497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a736949-6c82-4d33-bf94-271631bb9d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.804463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a736949-6c82-4d33-bf94-271631bb9d17 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.832084 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4200/8398] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:21:19 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:21:19.836266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a736949-6c82-4d33-bf94-271631bb9d17 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.841542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f355422bbc4a402597f285f02ca85a3a', 'request_id': 'req-1a6e52da-445d-4efa-a26e-107dc34c5d2d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.847495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a736949-6c82-4d33-bf94-271631bb9d17 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.847678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f355422bbc4a402597f285f02ca85a3a', 'request_id': 'req-1a6e52da-445d-4efa-a26e-107dc34c5d2d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.855294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f355422bbc4a402597f285f02ca85a3a', 'request_id': 'req-1a6e52da-445d-4efa-a26e-107dc34c5d2d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.868014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] The token cache is being invalidate because project f355422bbc4a402597f285f02ca85a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:19.868977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.869697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:19.871624 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4199/8399] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:19 2022] DELETE /identity/v3/projects/f355422bbc4a402597f285f02ca85a3a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:19.875414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.877716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:19.911180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.912249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.912682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.912971 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.913686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.915388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.925798 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4201/8400] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:21:19.929839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.932033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:19.944487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278f41-0dd6-4feb-abc7-dd673074e469 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.944879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e52da-445d-4efa-a26e-107dc34c5d2d admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.950044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a086-c69b-418a-bcbc-b379a1f4eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.951009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a086-c69b-418a-bcbc-b379a1f4eb78 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.951009 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a086-c69b-418a-bcbc-b379a1f4eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.951567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a086-c69b-418a-bcbc-b379a1f4eb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.951667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30294832-e041-4633-830f-c51683201e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.952223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529a086-c69b-418a-bcbc-b379a1f4eb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.952558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30294832-e041-4633-830f-c51683201e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.952838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30294832-e041-4633-830f-c51683201e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.953113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30294832-e041-4633-830f-c51683201e33 admin admin] PATH_INFO: `/v3/users/2e873eae00f544f19c64f3ec6817530e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:19.953868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529a086-c69b-418a-bcbc-b379a1f4eb78 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.954332 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30294832-e041-4633-830f-c51683201e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e873eae00f544f19c64f3ec6817530e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:19.956241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30294832-e041-4633-830f-c51683201e33 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:19.964539 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4202/8401] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:21:19.974762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a086-c69b-418a-bcbc-b379a1f4eb78 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:19.985686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a086-c69b-418a-bcbc-b379a1f4eb78 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:19.990712 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574f3df-dd1e-4b65-b1b7-0f52759664e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:19.991634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574f3df-dd1e-4b65-b1b7-0f52759664e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:19.991898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574f3df-dd1e-4b65-b1b7-0f52759664e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:19.992187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574f3df-dd1e-4b65-b1b7-0f52759664e0 admin admin] PATH_INFO: `/v3/projects/9274f410321c4361978aafe385452834/users/09b0d21953104ee0aeacc915313c3b19/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.008633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30294832-e041-4633-830f-c51683201e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e873eae00f544f19c64f3ec6817530e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.009912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30294832-e041-4633-830f-c51683201e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e873eae00f544f19c64f3ec6817530e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.010567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30294832-e041-4633-830f-c51683201e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e873eae00f544f19c64f3ec6817530e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.010707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574f3df-dd1e-4b65-b1b7-0f52759664e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9274f410321c4361978aafe385452834, user_id=09b0d21953104ee0aeacc915313c3b19, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:20.013515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574f3df-dd1e-4b65-b1b7-0f52759664e0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:20.024421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30294832-e041-4633-830f-c51683201e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e873eae00f544f19c64f3ec6817530e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.030064 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4203/8402] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:19 2022] PUT /identity/v3/projects/9274f410321c4361978aafe385452834/users/09b0d21953104ee0aeacc915313c3b19/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:21:20.039505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-30294832-e041-4633-830f-c51683201e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e873eae00f544f19c64f3ec6817530e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.042341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f65d7-b906-4bda-80b2-88bc4f95bcd5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.042637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f65d7-b906-4bda-80b2-88bc4f95bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.043511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f65d7-b906-4bda-80b2-88bc4f95bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.054812 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4200/8403] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:19 2022] DELETE /identity/v3/users/2e873eae00f544f19c64f3ec6817530e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:21:20.075683 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-980f65d7-b906-4bda-80b2-88bc4f95bcd5 None None] MFA Rules not processed for user `09b0d21953104ee0aeacc915313c3b19`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:20.077269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-980f65d7-b906-4bda-80b2-88bc4f95bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:20.157941 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4204/8404] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:20.163051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30294832-e041-4633-830f-c51683201e33 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:20.165305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-30294832-e041-4633-830f-c51683201e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:20.240838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f65d7-b906-4bda-80b2-88bc4f95bcd5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:20.243435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-980f65d7-b906-4bda-80b2-88bc4f95bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:20.244270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30294832-e041-4633-830f-c51683201e33 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:20.256481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b27d5-7678-4bd0-ac54-106f7b06097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:20.257883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b27d5-7678-4bd0-ac54-106f7b06097b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.257883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b27d5-7678-4bd0-ac54-106f7b06097b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.258142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b27d5-7678-4bd0-ac54-106f7b06097b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.258838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b27d5-7678-4bd0-ac54-106f7b06097b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:20.261298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b27d5-7678-4bd0-ac54-106f7b06097b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:20.268733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f65d7-b906-4bda-80b2-88bc4f95bcd5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:20.273637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:20.274546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.275369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.275803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] PATH_INFO: `/v3/projects/f9ee52aba69e494e86667326d2d1b5e4` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.277302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ee52aba69e494e86667326d2d1b5e4)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:20.279260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:20.296385 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4201/8405] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:21:20 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:20.300111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b27d5-7678-4bd0-ac54-106f7b06097b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:20.342939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ee52aba69e494e86667326d2d1b5e4', 'request_id': 'req-7e9d599e-9eb5-4af9-bfc6-fe8309835345'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.349115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ee52aba69e494e86667326d2d1b5e4', 'request_id': 'req-7e9d599e-9eb5-4af9-bfc6-fe8309835345'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.357273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ee52aba69e494e86667326d2d1b5e4', 'request_id': 'req-7e9d599e-9eb5-4af9-bfc6-fe8309835345'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.370482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] The token cache is being invalidate because project f9ee52aba69e494e86667326d2d1b5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:20.370848 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.371539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:20.371999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b27d5-7678-4bd0-ac54-106f7b06097b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:20.373192 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4205/8406] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:20 2022] DELETE /identity/v3/projects/f9ee52aba69e494e86667326d2d1b5e4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:20.454345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dc030-4fd7-40ac-a6fd-d20fb5daf00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:20.455261 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc030-4fd7-40ac-a6fd-d20fb5daf00e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.455518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc030-4fd7-40ac-a6fd-d20fb5daf00e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.455948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc030-4fd7-40ac-a6fd-d20fb5daf00e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.456709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dc030-4fd7-40ac-a6fd-d20fb5daf00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:20.458946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dc030-4fd7-40ac-a6fd-d20fb5daf00e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:20.490081 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4202/8407] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:21:20 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:21:20.494745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:20.496401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:20.511028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d599e-9eb5-4af9-bfc6-fe8309835345 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:20.518392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125fea-a4d9-411a-b288-39cccfb8876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:20.518392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125fea-a4d9-411a-b288-39cccfb8876d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.518392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125fea-a4d9-411a-b288-39cccfb8876d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.518392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125fea-a4d9-411a-b288-39cccfb8876d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.518870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125fea-a4d9-411a-b288-39cccfb8876d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:20.520679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125fea-a4d9-411a-b288-39cccfb8876d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:20.532611 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4206/8408] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:20.537295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dc030-4fd7-40ac-a6fd-d20fb5daf00e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:20.549737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dc030-4fd7-40ac-a6fd-d20fb5daf00e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:20.561170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15ed9-27dc-4df2-bbdc-1ecbed904043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:20.562147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15ed9-27dc-4df2-bbdc-1ecbed904043 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.562436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15ed9-27dc-4df2-bbdc-1ecbed904043 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.562718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15ed9-27dc-4df2-bbdc-1ecbed904043 admin admin] PATH_INFO: `/v3/projects/f0fce3e70c27497692d320f8d0242217/users/df2b77e49c3942b1a5f86abe5754988e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.584993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf15ed9-27dc-4df2-bbdc-1ecbed904043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fce3e70c27497692d320f8d0242217, user_id=df2b77e49c3942b1a5f86abe5754988e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:20.588695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf15ed9-27dc-4df2-bbdc-1ecbed904043 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:20.604205 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4203/8409] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:20 2022] PUT /identity/v3/projects/f0fce3e70c27497692d320f8d0242217/users/df2b77e49c3942b1a5f86abe5754988e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:20.608680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125fea-a4d9-411a-b288-39cccfb8876d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:20.620671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125fea-a4d9-411a-b288-39cccfb8876d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:20.688440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6496f-5a10-4462-b522-ef11930881a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:20.689144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6496f-5a10-4462-b522-ef11930881a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.689422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6496f-5a10-4462-b522-ef11930881a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.689701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6496f-5a10-4462-b522-ef11930881a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.690462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6496f-5a10-4462-b522-ef11930881a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:20.692131 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6496f-5a10-4462-b522-ef11930881a7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:20.706840 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4207/8410] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:20.711654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15ed9-27dc-4df2-bbdc-1ecbed904043 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:20.725559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15ed9-27dc-4df2-bbdc-1ecbed904043 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:20.732424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:20.733512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.733796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.734077 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] PATH_INFO: `/v3/projects/f0fce3e70c27497692d320f8d0242217/users/df2b77e49c3942b1a5f86abe5754988e/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.736293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fce3e70c27497692d320f8d0242217, user_id=df2b77e49c3942b1a5f86abe5754988e, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:20.739069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:20.752083 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4204/8411] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:20 2022] PUT /identity/v3/projects/f0fce3e70c27497692d320f8d0242217/users/df2b77e49c3942b1a5f86abe5754988e/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:20.764056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5fbc-d46f-435f-929d-8683d3d787af None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.764382 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5fbc-d46f-435f-929d-8683d3d787af None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.764671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5fbc-d46f-435f-929d-8683d3d787af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.796369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8a0b5fbc-d46f-435f-929d-8683d3d787af None None] MFA Rules not processed for user `df2b77e49c3942b1a5f86abe5754988e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:20.797602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8a0b5fbc-d46f-435f-929d-8683d3d787af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:20.882670 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4208/8412] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:20.894067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:20.896508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:20.958579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bc61-682f-4f74-8fb5-cfb637b54699 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:20.962897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:20.963538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:20.963814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:20.964083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:20.965940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:21.031576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:21.033067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:21.042665 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4205/8413] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:22.562352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b5fbc-d46f-435f-929d-8683d3d787af None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:22.576753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b5fbc-d46f-435f-929d-8683d3d787af None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:22.581553 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:22.582253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:22.582541 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:22.582955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:22.584910 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:22.652280 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:22.653772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:22.664402 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4209/8414] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:23.210239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:23.212016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:23.228543 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6561098-0a65-463c-9345-64d5cba2369b service cinder] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:23.232318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb467bf-1518-4307-a107-df6ec4d125f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:23.233016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb467bf-1518-4307-a107-df6ec4d125f8 service cinder] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:23.233302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb467bf-1518-4307-a107-df6ec4d125f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:23.233588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb467bf-1518-4307-a107-df6ec4d125f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:23.246004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb467bf-1518-4307-a107-df6ec4d125f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:23.248599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb467bf-1518-4307-a107-df6ec4d125f8 service cinder] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:23.262671 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4206/8415] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:27.170015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:27.243993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996598e-27d3-4b18-9c06-0515c60bc37e service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:27.249345 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:27.250237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:27.250511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:27.250791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] PATH_INFO: `/v3/users/0dbd1b5c72d3493ca1a72612d31076ec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:27.252122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dbd1b5c72d3493ca1a72612d31076ec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:27.254185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:27.319798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dbd1b5c72d3493ca1a72612d31076ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:27.337933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dbd1b5c72d3493ca1a72612d31076ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:27.347656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dbd1b5c72d3493ca1a72612d31076ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:27.348376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dbd1b5c72d3493ca1a72612d31076ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:27.348970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dbd1b5c72d3493ca1a72612d31076ec'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:27.365256 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4210/8416] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:27 2022] DELETE /identity/v3/users/0dbd1b5c72d3493ca1a72612d31076ec => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:27.370502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1c88-6f75-4b83-8182-6fe71b474956 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:27.371102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1c88-6f75-4b83-8182-6fe71b474956 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:27.371425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1c88-6f75-4b83-8182-6fe71b474956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:27.399323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f8df1c88-6f75-4b83-8182-6fe71b474956 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:27.401432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f8df1c88-6f75-4b83-8182-6fe71b474956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:27.480867 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4207/8417] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:27.492744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:27.495341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:27.568745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e2637-b582-4982-a9de-75ed8997fbee admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:27.573739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a408f14-fe9e-4f90-9f2c-a55cc8160a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:27.574427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408f14-fe9e-4f90-9f2c-a55cc8160a97 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:27.574723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408f14-fe9e-4f90-9f2c-a55cc8160a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:27.575010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408f14-fe9e-4f90-9f2c-a55cc8160a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:27.591358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a408f14-fe9e-4f90-9f2c-a55cc8160a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:27.593153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a408f14-fe9e-4f90-9f2c-a55cc8160a97 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:27.606059 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4211/8418] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:27.939495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df1c88-6f75-4b83-8182-6fe71b474956 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:27.941461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f8df1c88-6f75-4b83-8182-6fe71b474956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:27.958042 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df1c88-6f75-4b83-8182-6fe71b474956 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:27.965797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:27.966923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:27.967208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:27.967612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] PATH_INFO: `/v3/projects/6d70683f9faa4d26bf5d04413711de7f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:27.969525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d70683f9faa4d26bf5d04413711de7f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:27.972030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:28.031972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d70683f9faa4d26bf5d04413711de7f', 'request_id': 'req-efe0268e-18d5-44bf-830b-5e8980b2f46a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.044485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d70683f9faa4d26bf5d04413711de7f', 'request_id': 'req-efe0268e-18d5-44bf-830b-5e8980b2f46a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.064472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d70683f9faa4d26bf5d04413711de7f', 'request_id': 'req-efe0268e-18d5-44bf-830b-5e8980b2f46a'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.079600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] The token cache is being invalidate because project 6d70683f9faa4d26bf5d04413711de7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:28.079888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.080591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.082157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4208/8419] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:27 2022] DELETE /identity/v3/projects/6d70683f9faa4d26bf5d04413711de7f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:28.086302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a408f14-fe9e-4f90-9f2c-a55cc8160a97 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:28.100851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a408f14-fe9e-4f90-9f2c-a55cc8160a97 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:28.168594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:28.169478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:28.169762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:28.170037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] PATH_INFO: `/v3/users/09b0d21953104ee0aeacc915313c3b19` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:28.171290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b0d21953104ee0aeacc915313c3b19)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:28.173266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:28.231196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b0d21953104ee0aeacc915313c3b19'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.251934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b0d21953104ee0aeacc915313c3b19'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.260742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b0d21953104ee0aeacc915313c3b19'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.261375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b0d21953104ee0aeacc915313c3b19'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.261982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b0d21953104ee0aeacc915313c3b19'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.277596 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4212/8420] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:28 2022] DELETE /identity/v3/users/09b0d21953104ee0aeacc915313c3b19 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:21:28.636118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:28.638157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:28.656366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0268e-18d5-44bf-830b-5e8980b2f46a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:28.745555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:28.746561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:28.747032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:28.747217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] PATH_INFO: `/v3/projects/9274f410321c4361978aafe385452834` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:28.749537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9274f410321c4361978aafe385452834)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:28.754150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:28.850330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9274f410321c4361978aafe385452834', 'request_id': 'req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.866111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9274f410321c4361978aafe385452834', 'request_id': 'req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.880289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9274f410321c4361978aafe385452834', 'request_id': 'req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.904921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] The token cache is being invalidate because project 9274f410321c4361978aafe385452834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:28.905604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.906778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:28.910011 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4209/8421] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:28 2022] DELETE /identity/v3/projects/9274f410321c4361978aafe385452834 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:28.915753 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:28.918515 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:28.944750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c468e0-e924-4994-9a87-59993e37066e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:29.013801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:29.019463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:29.019463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:29.019463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] PATH_INFO: `/v3/users/df2b77e49c3942b1a5f86abe5754988e` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:29.019463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2b77e49c3942b1a5f86abe5754988e)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:29.019463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:29.076113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2b77e49c3942b1a5f86abe5754988e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.091608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2b77e49c3942b1a5f86abe5754988e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.102121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2b77e49c3942b1a5f86abe5754988e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.103072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2b77e49c3942b1a5f86abe5754988e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.103716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-43e14328-54fc-482c-88be-263853287c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2b77e49c3942b1a5f86abe5754988e'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.117614 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4213/8422] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:28 2022] DELETE /identity/v3/users/df2b77e49c3942b1a5f86abe5754988e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:29.434620 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:29.436425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:29.458220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20029a-778f-4bde-a7b1-ac87cb7ca89e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:29.534095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:29.534095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:29.534095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:29.534095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] PATH_INFO: `/v3/projects/f0fce3e70c27497692d320f8d0242217` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:29.534594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0fce3e70c27497692d320f8d0242217)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:29.534594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:29.587490 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0fce3e70c27497692d320f8d0242217', 'request_id': 'req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.592955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0fce3e70c27497692d320f8d0242217', 'request_id': 'req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.600745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0fce3e70c27497692d320f8d0242217', 'request_id': 'req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.612183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] The token cache is being invalidate because project f0fce3e70c27497692d320f8d0242217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:29.612512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.613343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de9ed30a-3ea2-451d-99bb-83c8a5f0af60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:29.614951 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4210/8423] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:29 2022] DELETE /identity/v3/projects/f0fce3e70c27497692d320f8d0242217 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:29.621705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f517-d56f-4cb1-84e8-5b5df820b38e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:29.622206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f517-d56f-4cb1-84e8-5b5df820b38e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:29.622399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f517-d56f-4cb1-84e8-5b5df820b38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:29.643970 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5223f517-d56f-4cb1-84e8-5b5df820b38e None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:29.645287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5223f517-d56f-4cb1-84e8-5b5df820b38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:29.710130 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4214/8424] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:29.717854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927ccc-5ad8-4148-8e0c-524de9ec6971 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:29.718337 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927ccc-5ad8-4148-8e0c-524de9ec6971 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:29.718426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927ccc-5ad8-4148-8e0c-524de9ec6971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:29.740497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d8927ccc-5ad8-4148-8e0c-524de9ec6971 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:29.741726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d8927ccc-5ad8-4148-8e0c-524de9ec6971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:29.751825 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4211/8425] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:29.756118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f517-d56f-4cb1-84e8-5b5df820b38e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:29.767236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f517-d56f-4cb1-84e8-5b5df820b38e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:29.774003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:29.774837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:29.775130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:29.775416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:29.776219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:21:29.776569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:29.778225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:29.791589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4215/8426] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:21:29.796411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927ccc-5ad8-4148-8e0c-524de9ec6971 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:29.807756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927ccc-5ad8-4148-8e0c-524de9ec6971 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:29.813860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974cece-0eef-4c55-b192-f6a902d774eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:29.814793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974cece-0eef-4c55-b192-f6a902d774eb admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:29.815092 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974cece-0eef-4c55-b192-f6a902d774eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:29.815377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974cece-0eef-4c55-b192-f6a902d774eb admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:29.816096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974cece-0eef-4c55-b192-f6a902d774eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:29.818653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974cece-0eef-4c55-b192-f6a902d774eb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:29.856604 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4212/8427] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:21:29 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:29.860763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:29.871932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a4b40-46e5-4f09-afb2-32b31f93f084 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:29.937604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ed455-2545-4c3b-89e7-1401db38b56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:29.938287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed455-2545-4c3b-89e7-1401db38b56c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:29.938569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed455-2545-4c3b-89e7-1401db38b56c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:29.938851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed455-2545-4c3b-89e7-1401db38b56c admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:29.939667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ed455-2545-4c3b-89e7-1401db38b56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:29.941606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ed455-2545-4c3b-89e7-1401db38b56c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:29.963691 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4216/8428] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:21:29 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:29.967922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974cece-0eef-4c55-b192-f6a902d774eb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:29.979187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974cece-0eef-4c55-b192-f6a902d774eb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:29.983985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31111a58-ca1e-4777-b9de-c8a8cac3b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:29.984694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31111a58-ca1e-4777-b9de-c8a8cac3b192 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:29.984978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31111a58-ca1e-4777-b9de-c8a8cac3b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:29.985258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31111a58-ca1e-4777-b9de-c8a8cac3b192 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:29.985991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31111a58-ca1e-4777-b9de-c8a8cac3b192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:29.987624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31111a58-ca1e-4777-b9de-c8a8cac3b192 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.000761 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4213/8429] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:21:30.006161 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ed455-2545-4c3b-89e7-1401db38b56c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.016706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ed455-2545-4c3b-89e7-1401db38b56c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:30.021581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52920c3-627b-4d3a-89c4-610903d3c81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:30.022252 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920c3-627b-4d3a-89c4-610903d3c81f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.022566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920c3-627b-4d3a-89c4-610903d3c81f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.022860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920c3-627b-4d3a-89c4-610903d3c81f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.023578 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52920c3-627b-4d3a-89c4-610903d3c81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:30.025272 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52920c3-627b-4d3a-89c4-610903d3c81f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.036911 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4217/8430] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:30.045560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31111a58-ca1e-4777-b9de-c8a8cac3b192 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.056539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31111a58-ca1e-4777-b9de-c8a8cac3b192 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:30.061696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309003b-9431-4024-9fba-27cd9e6807f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:30.062592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309003b-9431-4024-9fba-27cd9e6807f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.062875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309003b-9431-4024-9fba-27cd9e6807f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.063161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309003b-9431-4024-9fba-27cd9e6807f1 admin admin] PATH_INFO: `/v3/projects/4cf8d04b22744889a736817e2226b3d0/users/17132069f0e64e5a8647e5712f8e6533/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.079175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309003b-9431-4024-9fba-27cd9e6807f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf8d04b22744889a736817e2226b3d0, user_id=17132069f0e64e5a8647e5712f8e6533, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:30.081898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309003b-9431-4024-9fba-27cd9e6807f1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.097127 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4214/8431] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:30 2022] PUT /identity/v3/projects/4cf8d04b22744889a736817e2226b3d0/users/17132069f0e64e5a8647e5712f8e6533/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:30.109365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc284c-77f5-4a8a-808d-274613681625 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.109569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc284c-77f5-4a8a-808d-274613681625 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.109829 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc284c-77f5-4a8a-808d-274613681625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.141489 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-00cc284c-77f5-4a8a-808d-274613681625 None None] MFA Rules not processed for user `17132069f0e64e5a8647e5712f8e6533`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:30.142706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-00cc284c-77f5-4a8a-808d-274613681625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:30.211397 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4218/8432] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:30.216677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309003b-9431-4024-9fba-27cd9e6807f1 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.280912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309003b-9431-4024-9fba-27cd9e6807f1 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:30.287214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5081373-44f7-4eb6-977e-b7a465e3dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:30.288057 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081373-44f7-4eb6-977e-b7a465e3dc1b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.288460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081373-44f7-4eb6-977e-b7a465e3dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.288864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081373-44f7-4eb6-977e-b7a465e3dc1b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.289748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5081373-44f7-4eb6-977e-b7a465e3dc1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:30.292578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5081373-44f7-4eb6-977e-b7a465e3dc1b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.319969 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4215/8433] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:21:30 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:30.324866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc284c-77f5-4a8a-808d-274613681625 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.338069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc284c-77f5-4a8a-808d-274613681625 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:30.428418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3ef27-2f68-4922-a7ca-870949c6b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:30.429021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3ef27-2f68-4922-a7ca-870949c6b6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.429309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3ef27-2f68-4922-a7ca-870949c6b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.429594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3ef27-2f68-4922-a7ca-870949c6b6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.430287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3ef27-2f68-4922-a7ca-870949c6b6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:30.432202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3ef27-2f68-4922-a7ca-870949c6b6e9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.458064 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4219/8434] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:21:30 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:21:30.464181 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5081373-44f7-4eb6-977e-b7a465e3dc1b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.475662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5081373-44f7-4eb6-977e-b7a465e3dc1b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:30.481435 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089ade-2bc6-494e-be17-0d95891995ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:30.482103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089ade-2bc6-494e-be17-0d95891995ab admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.482523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089ade-2bc6-494e-be17-0d95891995ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.482804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089ade-2bc6-494e-be17-0d95891995ab admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.483533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a089ade-2bc6-494e-be17-0d95891995ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:30.485179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a089ade-2bc6-494e-be17-0d95891995ab admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.497012 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4216/8435] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:30.502742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3ef27-2f68-4922-a7ca-870949c6b6e9 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.515755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3ef27-2f68-4922-a7ca-870949c6b6e9 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:30.522301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee4c2-a369-4202-b590-9f8074c9887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:30.523203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee4c2-a369-4202-b590-9f8074c9887c admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.523485 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee4c2-a369-4202-b590-9f8074c9887c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.523761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee4c2-a369-4202-b590-9f8074c9887c admin admin] PATH_INFO: `/v3/projects/b79f18c17dc34e7aab590042dec72705/users/29d56ddcc91e4058a79c475296502045/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.541445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ee4c2-a369-4202-b590-9f8074c9887c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79f18c17dc34e7aab590042dec72705, user_id=29d56ddcc91e4058a79c475296502045, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:30.544093 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ee4c2-a369-4202-b590-9f8074c9887c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.563268 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4220/8436] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:30 2022] PUT /identity/v3/projects/b79f18c17dc34e7aab590042dec72705/users/29d56ddcc91e4058a79c475296502045/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:30.567416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089ade-2bc6-494e-be17-0d95891995ab admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.578607 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089ade-2bc6-494e-be17-0d95891995ab admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:30.650460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337b721-c45f-4447-b3b7-66e5c68158fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:30.651433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b721-c45f-4447-b3b7-66e5c68158fb admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.651723 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b721-c45f-4447-b3b7-66e5c68158fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.652010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b721-c45f-4447-b3b7-66e5c68158fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.652767 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337b721-c45f-4447-b3b7-66e5c68158fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:30.654423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337b721-c45f-4447-b3b7-66e5c68158fb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.668526 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4217/8437] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:21:30.674593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee4c2-a369-4202-b590-9f8074c9887c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.685343 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee4c2-a369-4202-b590-9f8074c9887c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:30.690134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:30.691027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.691308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.691582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] PATH_INFO: `/v3/projects/b79f18c17dc34e7aab590042dec72705/users/29d56ddcc91e4058a79c475296502045/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.693582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79f18c17dc34e7aab590042dec72705, user_id=29d56ddcc91e4058a79c475296502045, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:30.696765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:30.708858 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4221/8438] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:21:30 2022] PUT /identity/v3/projects/b79f18c17dc34e7aab590042dec72705/users/29d56ddcc91e4058a79c475296502045/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:30.720019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701812-3702-4be0-8cc5-be40dfb3d4a8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:30.720904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701812-3702-4be0-8cc5-be40dfb3d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:30.720904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701812-3702-4be0-8cc5-be40dfb3d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:30.755510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ea701812-3702-4be0-8cc5-be40dfb3d4a8 None None] MFA Rules not processed for user `29d56ddcc91e4058a79c475296502045`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:30.757175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ea701812-3702-4be0-8cc5-be40dfb3d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:30.858755 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4218/8439] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:30.875552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:30.877506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:31.007554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fd8c1-c0d6-4457-b90c-cd0309a9a686 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:31.013825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:31.014655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:31.015037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:31.015418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:31.083618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:31.084920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:31.096097 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4222/8440] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:33.338219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a34fa-a670-4847-ace4-93385f6ff40a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:33.338745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a34fa-a670-4847-ace4-93385f6ff40a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:33.338844 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a34fa-a670-4847-ace4-93385f6ff40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:33.357296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-714a34fa-a670-4847-ace4-93385f6ff40a None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:33.358530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-714a34fa-a670-4847-ace4-93385f6ff40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:33.441279 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4219/8441] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:21:33.499969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:33.501456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:33.590373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe00c-86b9-4920-b58e-1eade7fb2b8b service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:33.596261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5a897-4771-4805-bb47-fa47ef89fd7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:33.597228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a897-4771-4805-bb47-fa47ef89fd7e service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:33.597520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a897-4771-4805-bb47-fa47ef89fd7e service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:33.597796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a897-4771-4805-bb47-fa47ef89fd7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:33.607483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5a897-4771-4805-bb47-fa47ef89fd7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:33.609145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5a897-4771-4805-bb47-fa47ef89fd7e service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:33.618161 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4223/8442] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:21:35.096359 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a34fa-a670-4847-ace4-93385f6ff40a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:35.098487 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-714a34fa-a670-4847-ace4-93385f6ff40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:35.172317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a34fa-a670-4847-ace4-93385f6ff40a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:35.176622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105b8b-b78f-4808-a2db-18df33579c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:35.177318 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b8b-b78f-4808-a2db-18df33579c90 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:35.177598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b8b-b78f-4808-a2db-18df33579c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:35.177911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b8b-b78f-4808-a2db-18df33579c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:35.190217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105b8b-b78f-4808-a2db-18df33579c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:35.192053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105b8b-b78f-4808-a2db-18df33579c90 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:35.207044 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4220/8443] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:38.428044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b85cb-307e-44ee-ad8a-f6cb37a6ac4f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:38.428886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b85cb-307e-44ee-ad8a-f6cb37a6ac4f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:38.428886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b85cb-307e-44ee-ad8a-f6cb37a6ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:38.433836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f356dc5-ef2d-4913-a9f5-01ff71f86fba None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:38.434880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f356dc5-ef2d-4913-a9f5-01ff71f86fba None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:38.435349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f356dc5-ef2d-4913-a9f5-01ff71f86fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:38.452860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ec6b85cb-307e-44ee-ad8a-f6cb37a6ac4f None None] MFA Rules not processed for user `2af13ad54ab048d495e5ff0c0453abb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:38.454747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec6b85cb-307e-44ee-ad8a-f6cb37a6ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:38.459112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9f356dc5-ef2d-4913-a9f5-01ff71f86fba None None] MFA Rules not processed for user `17132069f0e64e5a8647e5712f8e6533`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:38.460948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f356dc5-ef2d-4913-a9f5-01ff71f86fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:38.471310 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4221/8444] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:21:38.522682 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4224/8445] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:21:54.095207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f356dc5-ef2d-4913-a9f5-01ff71f86fba None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:54.116308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f356dc5-ef2d-4913-a9f5-01ff71f86fba None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:54.123380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7570b26-a6c1-458b-99c1-0690249d5510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:54.124002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570b26-a6c1-458b-99c1-0690249d5510 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:54.124285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570b26-a6c1-458b-99c1-0690249d5510 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:54.124666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570b26-a6c1-458b-99c1-0690249d5510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:54.126773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d7570b26-a6c1-458b-99c1-0690249d5510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:54.273903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570b26-a6c1-458b-99c1-0690249d5510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:54.275566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570b26-a6c1-458b-99c1-0690249d5510 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:54.287415 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4222/8446] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:55.312716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b85cb-307e-44ee-ad8a-f6cb37a6ac4f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:55.315974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec6b85cb-307e-44ee-ad8a-f6cb37a6ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:55.505703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b85cb-307e-44ee-ad8a-f6cb37a6ac4f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:55.511516 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:55.512703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:55.513390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:55.514880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] PATH_INFO: `/v3/users/e1fde410660b47939139960a9420179a` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:55.516663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1fde410660b47939139960a9420179a)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:55.520097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:55.587372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1fde410660b47939139960a9420179a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:55.606035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1fde410660b47939139960a9420179a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:55.624715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1fde410660b47939139960a9420179a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:55.625776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1fde410660b47939139960a9420179a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:55.626722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1fde410660b47939139960a9420179a'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:55.645462 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4225/8447] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:55 2022] DELETE /identity/v3/users/e1fde410660b47939139960a9420179a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:55.650517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27852-600f-440c-80d8-463cca7813bb None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:55.655622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27852-600f-440c-80d8-463cca7813bb None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:55.656080 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27852-600f-440c-80d8-463cca7813bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:55.683886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-88b27852-600f-440c-80d8-463cca7813bb None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:21:55.685923 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-88b27852-600f-440c-80d8-463cca7813bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:55.792227 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4223/8448] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:21:55.823373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:55.824892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:55.902158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7664b3-64d0-4cce-8507-075bfcb8f523 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:55.906802 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757c394-b79f-4bab-9d84-b5b2acde4391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:55.907473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757c394-b79f-4bab-9d84-b5b2acde4391 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:55.907748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757c394-b79f-4bab-9d84-b5b2acde4391 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:55.908028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757c394-b79f-4bab-9d84-b5b2acde4391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:55.922857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757c394-b79f-4bab-9d84-b5b2acde4391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:55.924629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757c394-b79f-4bab-9d84-b5b2acde4391 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:55.936570 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4226/8449] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:21:56.577794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b27852-600f-440c-80d8-463cca7813bb None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:56.579568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-88b27852-600f-440c-80d8-463cca7813bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:56.605395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b27852-600f-440c-80d8-463cca7813bb None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:56.610608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:56.612087 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:56.612666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:56.612939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] PATH_INFO: `/v3/projects/e2dcdf87966c4cc5899afcfb6f2b6b1f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:56.614699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dcdf87966c4cc5899afcfb6f2b6b1f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:56.617058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:56.670937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'request_id': 'req-1e0a5aa4-5791-41e6-b625-c21b28696876'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.677286 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'request_id': 'req-1e0a5aa4-5791-41e6-b625-c21b28696876'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.685438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'request_id': 'req-1e0a5aa4-5791-41e6-b625-c21b28696876'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.697797 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] The token cache is being invalidate because project e2dcdf87966c4cc5899afcfb6f2b6b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:56.698098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.698741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.701022 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4224/8450] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:56 2022] DELETE /identity/v3/projects/e2dcdf87966c4cc5899afcfb6f2b6b1f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:56.705532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757c394-b79f-4bab-9d84-b5b2acde4391 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:56.716441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757c394-b79f-4bab-9d84-b5b2acde4391 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:56.779857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:56.780784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:56.781065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:56.781338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] PATH_INFO: `/v3/users/b69db7bd77d0429ca25495aec2882cac` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:56.782536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69db7bd77d0429ca25495aec2882cac)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:56.784484 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:56.831091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69db7bd77d0429ca25495aec2882cac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.843339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69db7bd77d0429ca25495aec2882cac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.851806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69db7bd77d0429ca25495aec2882cac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.852497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69db7bd77d0429ca25495aec2882cac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.853320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69db7bd77d0429ca25495aec2882cac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:56.870135 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4227/8451] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:21:56 2022] DELETE /identity/v3/users/b69db7bd77d0429ca25495aec2882cac => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:21:57.392238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:21:57.393762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:21:57.409664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5aa4-5791-41e6-b625-c21b28696876 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:21:57.475367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:21:57.476246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:21:57.476730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:21:57.477246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] PATH_INFO: `/v3/projects/5f7e3cbf221a45dd95bfe721e4bb18f0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:21:57.479152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7e3cbf221a45dd95bfe721e4bb18f0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:21:57.481221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:21:57.538223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7e3cbf221a45dd95bfe721e4bb18f0', 'request_id': 'req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:57.544270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7e3cbf221a45dd95bfe721e4bb18f0', 'request_id': 'req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:57.555978 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7e3cbf221a45dd95bfe721e4bb18f0', 'request_id': 'req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:57.568426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] The token cache is being invalidate because project 5f7e3cbf221a45dd95bfe721e4bb18f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:21:57.568816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:57.569492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:21:57.571846 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4225/8452] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:21:57 2022] DELETE /identity/v3/projects/5f7e3cbf221a45dd95bfe721e4bb18f0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:22:30.656821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:22:30.658467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:22:30.723864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8263d7-02f9-46d1-880c-5d74af706b1b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:22:30.782068 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:22:30.782850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:22:30.783138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:22:30.783521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:22:30.785721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:22:30.798931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:22:30.800406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:22:30.812061 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4228/8453] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:22:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:23:08.865524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:23:08.866944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:08.942334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068bbde-b7a0-4c3e-a326-bbc4b09783e2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:23:08.948434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400e0a-903c-4227-97a7-4845b67b3fb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:23:08.949161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400e0a-903c-4227-97a7-4845b67b3fb3 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:08.949442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400e0a-903c-4227-97a7-4845b67b3fb3 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:08.949719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400e0a-903c-4227-97a7-4845b67b3fb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:08.951650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-42400e0a-903c-4227-97a7-4845b67b3fb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:08.966428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400e0a-903c-4227-97a7-4845b67b3fb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:23:08.968018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400e0a-903c-4227-97a7-4845b67b3fb3 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:23:08.980940 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4226/8454] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:23:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:23:09.136838 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:23:09.138432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:09.151715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c95e1-93aa-4fef-8cf9-bb8beba26302 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:23:09.155477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba812fd8-56eb-4447-9f41-ea0faadb4441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:23:09.156147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba812fd8-56eb-4447-9f41-ea0faadb4441 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:09.156462 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba812fd8-56eb-4447-9f41-ea0faadb4441 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:09.156745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba812fd8-56eb-4447-9f41-ea0faadb4441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:09.158540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ba812fd8-56eb-4447-9f41-ea0faadb4441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:09.179290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba812fd8-56eb-4447-9f41-ea0faadb4441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:23:09.181306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba812fd8-56eb-4447-9f41-ea0faadb4441 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:23:09.195285 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4229/8455] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:23:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:23:09.300019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbabb29-2a34-430c-a3bd-5fad19ac4c27 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:09.300019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbabb29-2a34-430c-a3bd-5fad19ac4c27 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:09.300019 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbabb29-2a34-430c-a3bd-5fad19ac4c27 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:09.300019 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4227/8456] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:23:09.306154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb208c-7d90-42f1-9167-94e72029d6db None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:09.306499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb208c-7d90-42f1-9167-94e72029d6db None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:09.306862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb208c-7d90-42f1-9167-94e72029d6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:09.349264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-50bb208c-7d90-42f1-9167-94e72029d6db None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:23:09.350459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-50bb208c-7d90-42f1-9167-94e72029d6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:09.360086 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4230/8457] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:23:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:23:09.381552 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbabb29-2a34-430c-a3bd-5fad19ac4c27 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:23:09.398685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbabb29-2a34-430c-a3bd-5fad19ac4c27 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:23:09.403658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c581a-9b63-4061-adfd-873a409fcb61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:23:09.404369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c581a-9b63-4061-adfd-873a409fcb61 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:09.404613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c581a-9b63-4061-adfd-873a409fcb61 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:09.404886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c581a-9b63-4061-adfd-873a409fcb61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:09.413927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c581a-9b63-4061-adfd-873a409fcb61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:23:09.416162 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c581a-9b63-4061-adfd-873a409fcb61 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:23:09.426601 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4228/8458] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:23:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:23:09.603619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb208c-7d90-42f1-9167-94e72029d6db None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:23:09.614497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-50bb208c-7d90-42f1-9167-94e72029d6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:09.629482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb208c-7d90-42f1-9167-94e72029d6db None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:23:09.633130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:23:09.633778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:09.634056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:09.634333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:09.636098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:09.712423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:23:09.713882 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:23:09.728836 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4231/8459] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:23:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:23:29.546798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c581a-9b63-4061-adfd-873a409fcb61 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:23:29.561825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c581a-9b63-4061-adfd-873a409fcb61 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:23:29.576156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:23:29.576870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:29.577156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:29.577438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:29.579542 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:29.592986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:23:29.594463 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:23:29.606687 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4229/8460] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:23:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:23:30.232539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:23:30.246590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd549-77af-4415-aa14-2af6ce5c8d3e service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:23:30.251939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f958c4-ba58-4d58-bb11-b0916f46b0ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:23:30.252645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f958c4-ba58-4d58-bb11-b0916f46b0ac service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:30.252933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f958c4-ba58-4d58-bb11-b0916f46b0ac service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:30.253215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f958c4-ba58-4d58-bb11-b0916f46b0ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:30.255060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-91f958c4-ba58-4d58-bb11-b0916f46b0ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:30.282959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f958c4-ba58-4d58-bb11-b0916f46b0ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:23:30.284623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f958c4-ba58-4d58-bb11-b0916f46b0ac service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:23:30.297071 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4232/8461] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:23:38.906988 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:23:38.922360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd88c-379d-45f6-89dd-335a5a5aaed3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:23:38.927312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:23:38.927947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:23:38.928229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:23:38.928535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:23:38.930347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:23:38.946444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:23:38.948032 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:23:38.961347 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4230/8462] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:24:07.540807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00d76-0cc4-4f6e-a165-f559f6b167ff None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:24:07.541892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00d76-0cc4-4f6e-a165-f559f6b167ff None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:24:07.542401 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00d76-0cc4-4f6e-a165-f559f6b167ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:24:07.570141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-40b00d76-0cc4-4f6e-a165-f559f6b167ff None None] MFA Rules not processed for user `2af13ad54ab048d495e5ff0c0453abb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:24:07.571383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-40b00d76-0cc4-4f6e-a165-f559f6b167ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:24:07.631820 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4233/8463] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:24:08.013295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:24:08.025932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae0261-6066-4ba9-bd5a-7f5bd730cc59 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:24:08.029775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:24:08.030450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:24:08.030733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:24:08.031008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:24:08.032816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:24:08.046079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:24:08.047448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:24:08.058709 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4231/8464] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:24:19.790695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548701-a2a7-4855-b7c5-a85050a5732a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:24:19.791254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548701-a2a7-4855-b7c5-a85050a5732a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:24:19.791456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13548701-a2a7-4855-b7c5-a85050a5732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:24:19.813599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-13548701-a2a7-4855-b7c5-a85050a5732a None None] MFA Rules not processed for user `17132069f0e64e5a8647e5712f8e6533`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:24:19.814872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-13548701-a2a7-4855-b7c5-a85050a5732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:24:19.885652 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4234/8465] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:24:20.586186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:24:20.587788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:24:20.625819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853419-4b98-4482-97a6-78d3454d7e06 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:24:20.640175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2e581-dd4f-4603-af9d-bdf9da041408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:24:20.642300 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e581-dd4f-4603-af9d-bdf9da041408 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:24:20.645340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e581-dd4f-4603-af9d-bdf9da041408 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:24:20.645753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e581-dd4f-4603-af9d-bdf9da041408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:24:20.648142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ebd2e581-dd4f-4603-af9d-bdf9da041408 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:24:20.686034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2e581-dd4f-4603-af9d-bdf9da041408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:24:20.688270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2e581-dd4f-4603-af9d-bdf9da041408 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:24:20.706018 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4232/8466] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:25:06.965734 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07334196-f245-47a3-b69a-396cb393cebc None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:06.966285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07334196-f245-47a3-b69a-396cb393cebc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:06.966285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07334196-f245-47a3-b69a-396cb393cebc None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:06.968059 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4235/8467] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:25:06.973175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ae74-7a7f-4b7d-a600-5ec69b8fee66 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:06.973627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ae74-7a7f-4b7d-a600-5ec69b8fee66 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:06.973760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ae74-7a7f-4b7d-a600-5ec69b8fee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:07.001106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-db66ae74-7a7f-4b7d-a600-5ec69b8fee66 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:25:07.002289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-db66ae74-7a7f-4b7d-a600-5ec69b8fee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:25:07.012457 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4233/8468] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:25:07.035384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07334196-f245-47a3-b69a-396cb393cebc None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:25:07.051439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07334196-f245-47a3-b69a-396cb393cebc None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:25:07.056830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d076-674c-441b-bf98-ab4cceaed5ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:25:07.057464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d076-674c-441b-bf98-ab4cceaed5ed service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:07.058689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d076-674c-441b-bf98-ab4cceaed5ed service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:07.058984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d076-674c-441b-bf98-ab4cceaed5ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:07.069141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471d076-674c-441b-bf98-ab4cceaed5ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:25:07.071867 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471d076-674c-441b-bf98-ab4cceaed5ed service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:25:07.083228 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4236/8469] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:25:07.276581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ae74-7a7f-4b7d-a600-5ec69b8fee66 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:25:07.288450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ae74-7a7f-4b7d-a600-5ec69b8fee66 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:25:07.292276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b5690-007f-432e-b1ed-8f26d1ed6979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:25:07.293296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5690-007f-432e-b1ed-8f26d1ed6979 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:07.293585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5690-007f-432e-b1ed-8f26d1ed6979 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:07.293866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5690-007f-432e-b1ed-8f26d1ed6979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:07.295800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bc4b5690-007f-432e-b1ed-8f26d1ed6979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:25:07.308845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b5690-007f-432e-b1ed-8f26d1ed6979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:25:07.310291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b5690-007f-432e-b1ed-8f26d1ed6979 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:25:07.322200 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4234/8470] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:25:07.463085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2fec2-ace0-48e0-9ab5-7eba294a6533 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:07.463374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2fec2-ace0-48e0-9ab5-7eba294a6533 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:07.463652 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2fec2-ace0-48e0-9ab5-7eba294a6533 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:07.465490 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4237/8471] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:25:07.470347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061d52-05a2-42ee-b997-3497975dcee2 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:07.470635 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061d52-05a2-42ee-b997-3497975dcee2 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:07.470912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061d52-05a2-42ee-b997-3497975dcee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:07.490615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5e061d52-05a2-42ee-b997-3497975dcee2 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:25:07.491741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5e061d52-05a2-42ee-b997-3497975dcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:25:07.500888 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4235/8472] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:25:07.521205 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2fec2-ace0-48e0-9ab5-7eba294a6533 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:25:07.537347 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2fec2-ace0-48e0-9ab5-7eba294a6533 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:25:07.542721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e3890-5003-44ff-ad57-82615bd2df05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:25:07.543356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3890-5003-44ff-ad57-82615bd2df05 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:07.543640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3890-5003-44ff-ad57-82615bd2df05 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:07.543916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3890-5003-44ff-ad57-82615bd2df05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:07.552428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e3890-5003-44ff-ad57-82615bd2df05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:25:07.553991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e3890-5003-44ff-ad57-82615bd2df05 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:25:07.564233 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4238/8473] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:25:07.725745 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061d52-05a2-42ee-b997-3497975dcee2 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:25:07.738827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061d52-05a2-42ee-b997-3497975dcee2 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:25:07.742528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:25:07.743663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:07.743943 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:07.744214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:07.745983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:25:07.761987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:25:07.763395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:25:07.776899 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4236/8474] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:25:29.200890 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e3890-5003-44ff-ad57-82615bd2df05 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:25:29.215720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e3890-5003-44ff-ad57-82615bd2df05 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:25:29.220409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:25:29.220798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:29.221076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:29.221536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:29.223944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:25:29.243558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:25:29.245147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:25:29.260427 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4239/8475] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:25:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:25:30.448689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:25:30.460768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564a7c0-c2a4-42e7-8403-c512f246296a service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:25:30.464539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db1ffe-78ae-438e-8d28-dc47b4c5e29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:25:30.465175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1ffe-78ae-438e-8d28-dc47b4c5e29a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:25:30.465458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1ffe-78ae-438e-8d28-dc47b4c5e29a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:25:30.465781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1ffe-78ae-438e-8d28-dc47b4c5e29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:25:30.467583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a0db1ffe-78ae-438e-8d28-dc47b4c5e29a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:25:30.483776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db1ffe-78ae-438e-8d28-dc47b4c5e29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:25:30.485239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db1ffe-78ae-438e-8d28-dc47b4c5e29a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:25:30.499082 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4237/8476] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:26:06.206776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:26:06.208204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:06.275001 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169a032-89ad-44a7-8d9c-6da8c39efed3 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:26:06.278591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398233d060c43048d49d758695153a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:26:06.279819 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:06.280109 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:06.280415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:06.282155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:06.293204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:26:06.295240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:26:06.304961 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4240/8477] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:26:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:26:09.968897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30979cd2-8f9e-45bf-8696-ced8cd8544f4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:09.969412 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30979cd2-8f9e-45bf-8696-ced8cd8544f4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:09.969515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30979cd2-8f9e-45bf-8696-ced8cd8544f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:09.987721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-30979cd2-8f9e-45bf-8696-ced8cd8544f4 None None] MFA Rules not processed for user `2af13ad54ab048d495e5ff0c0453abb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:26:09.991187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-30979cd2-8f9e-45bf-8696-ced8cd8544f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:10.001520 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4238/8478] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:26:10.166414 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:26:10.183357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5559e-c158-4827-8a69-91abda4093c3 service cinder] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:26:10.189307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:26:10.190039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:10.190402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:10.190759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:10.192843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:10.209074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:26:10.210823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:26:10.227120 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4241/8479] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:26:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:26:10.417431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30979cd2-8f9e-45bf-8696-ced8cd8544f4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:26:10.439220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30979cd2-8f9e-45bf-8696-ced8cd8544f4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:26:10.445602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:26:10.446732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:10.447254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:10.448167 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:10.451779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:10.469016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:26:10.470835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:26:10.485028 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4239/8480] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:26:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:26:10.939334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:26:10.940803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:10.959083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d15f7-74f3-4ddf-870e-776dc97b63dc service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:26:10.964134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f48a58-1a6a-4785-99cb-bcb1059a874d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:26:10.965534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f48a58-1a6a-4785-99cb-bcb1059a874d service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:10.965814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f48a58-1a6a-4785-99cb-bcb1059a874d service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:10.966092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f48a58-1a6a-4785-99cb-bcb1059a874d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:10.968110 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d6f48a58-1a6a-4785-99cb-bcb1059a874d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:10.992097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f48a58-1a6a-4785-99cb-bcb1059a874d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:26:10.993723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f48a58-1a6a-4785-99cb-bcb1059a874d service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:26:11.008510 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4242/8481] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:26:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:26:11.996494 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:26:12.021661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3ceb1-9a44-4c7e-8e90-39b0375807d3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:26:12.037715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:26:12.038681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:12.039093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:12.039584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:12.041530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:12.057675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:26:12.059615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:26:12.075757 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4240/8482] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:26:23.805099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e28649-f48b-4c2f-a5ba-3320c78fceff None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:23.805917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e28649-f48b-4c2f-a5ba-3320c78fceff None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:23.806367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e28649-f48b-4c2f-a5ba-3320c78fceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:23.831154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-19e28649-f48b-4c2f-a5ba-3320c78fceff None None] MFA Rules not processed for user `17132069f0e64e5a8647e5712f8e6533`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:26:23.832831 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19e28649-f48b-4c2f-a5ba-3320c78fceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:23.847614 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4243/8483] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:26:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:26:31.117539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:26:31.131730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5095737-2384-47d9-819d-f5fb2a763758 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:26:31.138105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:26:31.138755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:31.139214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:31.139529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:31.143400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:31.155692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:26:31.157413 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:26:31.167101 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4241/8484] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:26:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:26:37.565106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e28649-f48b-4c2f-a5ba-3320c78fceff None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:26:37.581304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e28649-f48b-4c2f-a5ba-3320c78fceff None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:26:37.585759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183337b-f24e-4f69-8d78-deccec19e307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:26:37.586407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183337b-f24e-4f69-8d78-deccec19e307 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:26:37.586690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183337b-f24e-4f69-8d78-deccec19e307 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:26:37.586966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183337b-f24e-4f69-8d78-deccec19e307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:26:37.588775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f183337b-f24e-4f69-8d78-deccec19e307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:26:37.649912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183337b-f24e-4f69-8d78-deccec19e307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:26:37.651263 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183337b-f24e-4f69-8d78-deccec19e307 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:26:37.661309 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4244/8485] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:27:32.657007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:27:32.678396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e65d7-e317-4735-a26a-815f4f2d1096 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:27:32.681962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd5b67-785a-41b2-a18c-350c8f5da64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:27:32.682599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5b67-785a-41b2-a18c-350c8f5da64c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:27:32.683372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5b67-785a-41b2-a18c-350c8f5da64c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:27:32.683643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5b67-785a-41b2-a18c-350c8f5da64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:27:32.693208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd5b67-785a-41b2-a18c-350c8f5da64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:27:32.694618 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd5b67-785a-41b2-a18c-350c8f5da64c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:27:32.705823 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4242/8486] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:27:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:27:44.639385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d245-ef65-447e-8f7c-fb1097aa1955 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:27:44.639939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d245-ef65-447e-8f7c-fb1097aa1955 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:27:44.639939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d245-ef65-447e-8f7c-fb1097aa1955 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:27:44.641788 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4245/8487] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:27:44.646504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4a8a-4b08-49a5-8141-362cbadde2d3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:27:44.646966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4a8a-4b08-49a5-8141-362cbadde2d3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:27:44.647072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4a8a-4b08-49a5-8141-362cbadde2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:27:44.665459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ecfc4a8a-4b08-49a5-8141-362cbadde2d3 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:27:44.666705 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ecfc4a8a-4b08-49a5-8141-362cbadde2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:27:44.676551 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4243/8488] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:27:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:27:44.696588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4d245-ef65-447e-8f7c-fb1097aa1955 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:27:44.713410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4d245-ef65-447e-8f7c-fb1097aa1955 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:27:44.718937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179e50-3ec0-4dea-9df0-71dcfb423448 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:27:44.719571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179e50-3ec0-4dea-9df0-71dcfb423448 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:27:44.719856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179e50-3ec0-4dea-9df0-71dcfb423448 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:27:44.720153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179e50-3ec0-4dea-9df0-71dcfb423448 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:27:44.728470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179e50-3ec0-4dea-9df0-71dcfb423448 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:27:44.730049 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179e50-3ec0-4dea-9df0-71dcfb423448 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:27:44.739932 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4246/8489] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:27:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:28:08.193959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5e32-83d0-4633-8ec0-fc1de3c20cbc None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:28:08.194550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5e32-83d0-4633-8ec0-fc1de3c20cbc None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:28:08.195390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5e32-83d0-4633-8ec0-fc1de3c20cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:28:08.218141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4ffd5e32-83d0-4633-8ec0-fc1de3c20cbc None None] MFA Rules not processed for user `17132069f0e64e5a8647e5712f8e6533`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:28:08.219730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4ffd5e32-83d0-4633-8ec0-fc1de3c20cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:28:08.229858 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4244/8490] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:28:40.099486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179e50-3ec0-4dea-9df0-71dcfb423448 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:28:40.122057 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179e50-3ec0-4dea-9df0-71dcfb423448 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:28:40.127640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a05e1-f271-4711-b53e-ef138baaa90e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:28:40.128270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a05e1-f271-4711-b53e-ef138baaa90e service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:28:40.128581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a05e1-f271-4711-b53e-ef138baaa90e service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:28:40.128855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a05e1-f271-4711-b53e-ef138baaa90e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:28:40.139519 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a05e1-f271-4711-b53e-ef138baaa90e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:28:40.141194 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a05e1-f271-4711-b53e-ef138baaa90e service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:28:40.153164 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4247/8491] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:28:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:28:41.894996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd5e32-83d0-4633-8ec0-fc1de3c20cbc None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:28:41.909488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd5e32-83d0-4633-8ec0-fc1de3c20cbc None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:28:41.914495 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:28:41.915130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:28:41.915415 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:28:41.915689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:28:41.927117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:28:41.928825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:28:41.941052 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4245/8492] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:28:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:28:51.543713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a05e1-f271-4711-b53e-ef138baaa90e service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:28:51.555358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a05e1-f271-4711-b53e-ef138baaa90e service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:28:51.558937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:28:51.559564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:28:51.559842 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:28:51.560119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:28:51.562448 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:28:51.624915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:28:51.626339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:28:51.645411 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4248/8493] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:28:58.034962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:28:58.036545 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:28:58.055837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346787f0-2ed0-4e9a-94f5-8f4d2237694d service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:28:58.060785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:28:58.062638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:28:58.062990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:28:58.063346 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] PATH_INFO: `/v3/users/2af13ad54ab048d495e5ff0c0453abb2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:28:58.065352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af13ad54ab048d495e5ff0c0453abb2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:28:58.067452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:28:58.116213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af13ad54ab048d495e5ff0c0453abb2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.116902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af13ad54ab048d495e5ff0c0453abb2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.117511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af13ad54ab048d495e5ff0c0453abb2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.129081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af13ad54ab048d495e5ff0c0453abb2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.136369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af13ad54ab048d495e5ff0c0453abb2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.148116 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4246/8494] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:28:58 2022] DELETE /identity/v3/users/2af13ad54ab048d495e5ff0c0453abb2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:28:58.326954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:28:58.338028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8809e3-c8b6-4d70-a531-d5eb0c21e942 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:28:58.400936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:28:58.401863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:28:58.402157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:28:58.402438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] PATH_INFO: `/v3/projects/c88a055c429b4b9e8e86a370c8571785` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:28:58.403627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88a055c429b4b9e8e86a370c8571785)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:28:58.406088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:28:58.449887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88a055c429b4b9e8e86a370c8571785', 'request_id': 'req-678004cf-9f8f-46ad-a495-9115e5ce2afe'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.455235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88a055c429b4b9e8e86a370c8571785', 'request_id': 'req-678004cf-9f8f-46ad-a495-9115e5ce2afe'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.462443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88a055c429b4b9e8e86a370c8571785', 'request_id': 'req-678004cf-9f8f-46ad-a495-9115e5ce2afe'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.474419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] The token cache is being invalidate because project c88a055c429b4b9e8e86a370c8571785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:28:58.474707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.475341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.476916 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4249/8495] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:28:58 2022] DELETE /identity/v3/projects/c88a055c429b4b9e8e86a370c8571785 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:28:58.480944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:28:58.482440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:28:58.496684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ff49-76f6-4a5b-a67d-c0f40acfb409 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:28:58.552113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:28:58.553012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:28:58.553296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:28:58.553573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] PATH_INFO: `/v3/users/3cebe98eca534f919bde143936e10f4c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:28:58.554787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cebe98eca534f919bde143936e10f4c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:28:58.556754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:28:58.600941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cebe98eca534f919bde143936e10f4c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.601579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cebe98eca534f919bde143936e10f4c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.602182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cebe98eca534f919bde143936e10f4c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.613338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cebe98eca534f919bde143936e10f4c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.620583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cebe98eca534f919bde143936e10f4c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.632763 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4247/8496] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:28:58 2022] DELETE /identity/v3/users/3cebe98eca534f919bde143936e10f4c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:28:58.803675 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:28:58.805181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:28:58.821828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678004cf-9f8f-46ad-a495-9115e5ce2afe admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:28:58.880285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:28:58.881181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:28:58.881461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:28:58.881737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] PATH_INFO: `/v3/projects/23d1e8bdb8cc4a4d98556d0d7995b580` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:28:58.882912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d1e8bdb8cc4a4d98556d0d7995b580)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:28:58.885123 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:28:58.929757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d1e8bdb8cc4a4d98556d0d7995b580', 'request_id': 'req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.934909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d1e8bdb8cc4a4d98556d0d7995b580', 'request_id': 'req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.942422 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d1e8bdb8cc4a4d98556d0d7995b580', 'request_id': 'req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.953597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] The token cache is being invalidate because project 23d1e8bdb8cc4a4d98556d0d7995b580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:28:58.953878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.954508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:28:58.956040 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4250/8497] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:28:58 2022] DELETE /identity/v3/projects/23d1e8bdb8cc4a4d98556d0d7995b580 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:29:51.658597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:29:51.660975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:29:51.768959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eac768-ca74-4c3f-9b42-d4cfbaf582c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:29:51.834034 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:29:51.834700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:29:51.834985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:29:51.835280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:29:51.837096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:29:51.851093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:29:51.852734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:29:51.866073 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4248/8498] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:29:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:31:00.239072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:00.240544 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:00.348078 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd6f90-06c1-42c2-90a4-9b41daab5fc4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:00.352208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:00.352873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:00.353159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:00.353482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:00.355351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:00.399907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:00.401394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:00.415948 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4251/8499] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:01.666880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:01.689035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4213-8d8d-4359-91c1-cd9a564a647b service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:01.692685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fc79e-92d8-4ea3-ac9e-d3f3d00508d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:01.693339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fc79e-92d8-4ea3-ac9e-d3f3d00508d3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:01.693606 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fc79e-92d8-4ea3-ac9e-d3f3d00508d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:01.693885 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fc79e-92d8-4ea3-ac9e-d3f3d00508d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:01.695676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ab4fc79e-92d8-4ea3-ac9e-d3f3d00508d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:01.711860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fc79e-92d8-4ea3-ac9e-d3f3d00508d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:01.713313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fc79e-92d8-4ea3-ac9e-d3f3d00508d3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:01.726892 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4249/8500] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:07.387012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:07.388785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:07.475839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7868b5-7ad4-4c70-9f84-3c1792f5c456 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:07.480243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:07.481132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:07.481409 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:07.481682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] PATH_INFO: `/v3/users/17132069f0e64e5a8647e5712f8e6533` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:07.482905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17132069f0e64e5a8647e5712f8e6533)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:07.484844 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:07.530825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17132069f0e64e5a8647e5712f8e6533'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:07.542437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17132069f0e64e5a8647e5712f8e6533'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:07.548860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17132069f0e64e5a8647e5712f8e6533'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:07.549466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17132069f0e64e5a8647e5712f8e6533'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:07.550129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17132069f0e64e5a8647e5712f8e6533'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:07.562225 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4252/8501] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:31:07 2022] DELETE /identity/v3/users/17132069f0e64e5a8647e5712f8e6533 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:07.566795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a26bd-a47c-4625-a06c-7f5ce972a18a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:07.567284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a26bd-a47c-4625-a06c-7f5ce972a18a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:07.567390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a26bd-a47c-4625-a06c-7f5ce972a18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:07.594547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-585a26bd-a47c-4625-a06c-7f5ce972a18a None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:07.596409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-585a26bd-a47c-4625-a06c-7f5ce972a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:07.653931 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4250/8502] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:31:07.663570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:07.664999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:07.725278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4dc4-3e88-4e93-9746-88c199b8be77 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:07.732452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0a94-50ae-4241-9cce-1ae5b31e9903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:07.733255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0a94-50ae-4241-9cce-1ae5b31e9903 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:07.733644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0a94-50ae-4241-9cce-1ae5b31e9903 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:07.733935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0a94-50ae-4241-9cce-1ae5b31e9903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:07.745022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e0a94-50ae-4241-9cce-1ae5b31e9903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:07.746590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e0a94-50ae-4241-9cce-1ae5b31e9903 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:07.758522 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4253/8503] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:07.943643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a26bd-a47c-4625-a06c-7f5ce972a18a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:07.945573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-585a26bd-a47c-4625-a06c-7f5ce972a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:07.957966 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a26bd-a47c-4625-a06c-7f5ce972a18a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:07.962808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:07.963662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:07.963945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:07.964222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] PATH_INFO: `/v3/projects/4cf8d04b22744889a736817e2226b3d0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:07.965718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf8d04b22744889a736817e2226b3d0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:07.967613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.014307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf8d04b22744889a736817e2226b3d0', 'request_id': 'req-3acf87b4-8176-4a48-8390-7383160e4833'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.020059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf8d04b22744889a736817e2226b3d0', 'request_id': 'req-3acf87b4-8176-4a48-8390-7383160e4833'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.027160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf8d04b22744889a736817e2226b3d0', 'request_id': 'req-3acf87b4-8176-4a48-8390-7383160e4833'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.038504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] The token cache is being invalidate because project 4cf8d04b22744889a736817e2226b3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:31:08.038739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.039360 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.040938 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4251/8504] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:31:07 2022] DELETE /identity/v3/projects/4cf8d04b22744889a736817e2226b3d0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:08.045024 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0a94-50ae-4241-9cce-1ae5b31e9903 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:08.054642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0a94-50ae-4241-9cce-1ae5b31e9903 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:08.109461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:08.110317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.111180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.111460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] PATH_INFO: `/v3/users/29d56ddcc91e4058a79c475296502045` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.112718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d56ddcc91e4058a79c475296502045)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:08.114630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.160809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d56ddcc91e4058a79c475296502045'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.171927 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d56ddcc91e4058a79c475296502045'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.179821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d56ddcc91e4058a79c475296502045'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.180720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d56ddcc91e4058a79c475296502045'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.181463 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-c5f778b0-3b26-4b28-ad5c-1457ec5c4b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d56ddcc91e4058a79c475296502045'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.194387 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4254/8505] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:31:08 2022] DELETE /identity/v3/users/29d56ddcc91e4058a79c475296502045 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:08.358648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:08.360058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:08.374387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf87b4-8176-4a48-8390-7383160e4833 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:08.444582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:08.445473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.445746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.446060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] PATH_INFO: `/v3/projects/b79f18c17dc34e7aab590042dec72705` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.447221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79f18c17dc34e7aab590042dec72705)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:08.449231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.494804 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79f18c17dc34e7aab590042dec72705', 'request_id': 'req-04339533-9155-4603-b8ad-6d4b5428f33e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.500789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79f18c17dc34e7aab590042dec72705', 'request_id': 'req-04339533-9155-4603-b8ad-6d4b5428f33e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.508500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79f18c17dc34e7aab590042dec72705', 'request_id': 'req-04339533-9155-4603-b8ad-6d4b5428f33e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.519267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] The token cache is being invalidate because project b79f18c17dc34e7aab590042dec72705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:31:08.519551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.520185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04339533-9155-4603-b8ad-6d4b5428f33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:08.521783 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4252/8506] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:31:08 2022] DELETE /identity/v3/projects/b79f18c17dc34e7aab590042dec72705 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:08.528459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db434ad-2874-47d8-b571-7ecb2dd94e58 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.528953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db434ad-2874-47d8-b571-7ecb2dd94e58 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.529055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db434ad-2874-47d8-b571-7ecb2dd94e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.575397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1db434ad-2874-47d8-b571-7ecb2dd94e58 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:08.576680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1db434ad-2874-47d8-b571-7ecb2dd94e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:08.636107 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4255/8507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:31:08.645219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01acde-245d-4e4a-bceb-9dfc81e94826 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.645693 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01acde-245d-4e4a-bceb-9dfc81e94826 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.645788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01acde-245d-4e4a-bceb-9dfc81e94826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.664399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bb01acde-245d-4e4a-bceb-9dfc81e94826 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:08.665601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bb01acde-245d-4e4a-bceb-9dfc81e94826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:08.674202 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4253/8508] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:08.678398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db434ad-2874-47d8-b571-7ecb2dd94e58 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:08.687957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db434ad-2874-47d8-b571-7ecb2dd94e58 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:08.692550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:08.693198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.693482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.693759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.694468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:31:08.694774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:08.696392 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.708445 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4256/8509] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:31:08.712613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01acde-245d-4e4a-bceb-9dfc81e94826 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:08.722277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01acde-245d-4e4a-bceb-9dfc81e94826 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:08.727059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92969e-4909-42f5-9380-44bb3f92820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:08.727711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92969e-4909-42f5-9380-44bb3f92820a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.727995 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92969e-4909-42f5-9380-44bb3f92820a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.728273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92969e-4909-42f5-9380-44bb3f92820a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.729007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92969e-4909-42f5-9380-44bb3f92820a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:08.730904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92969e-4909-42f5-9380-44bb3f92820a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.766555 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4254/8510] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:31:08 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:31:08.770742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:08.780780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11080-9bba-44f7-9ccc-9d7650c37999 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:08.836044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc281f45-53e2-460c-8114-278479e89739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:08.836736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281f45-53e2-460c-8114-278479e89739 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.837020 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281f45-53e2-460c-8114-278479e89739 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.837301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281f45-53e2-460c-8114-278479e89739 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.837991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc281f45-53e2-460c-8114-278479e89739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:08.839905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc281f45-53e2-460c-8114-278479e89739 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.860001 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4257/8511] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:31:08 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:31:08.864104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92969e-4909-42f5-9380-44bb3f92820a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:08.874230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92969e-4909-42f5-9380-44bb3f92820a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:08.879130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e533e-55bf-42a1-99dc-0cca906b1969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:08.879775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e533e-55bf-42a1-99dc-0cca906b1969 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.880055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e533e-55bf-42a1-99dc-0cca906b1969 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.880369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e533e-55bf-42a1-99dc-0cca906b1969 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.881086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e533e-55bf-42a1-99dc-0cca906b1969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:08.882704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e533e-55bf-42a1-99dc-0cca906b1969 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.893342 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4255/8512] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:31:08.897170 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc281f45-53e2-460c-8114-278479e89739 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:08.908051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc281f45-53e2-460c-8114-278479e89739 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:08.912839 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68675c5d-712b-4f24-b276-8918e5bb3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:08.913487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675c5d-712b-4f24-b276-8918e5bb3815 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.913769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675c5d-712b-4f24-b276-8918e5bb3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.914072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675c5d-712b-4f24-b276-8918e5bb3815 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.914780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68675c5d-712b-4f24-b276-8918e5bb3815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:08.916374 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68675c5d-712b-4f24-b276-8918e5bb3815 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.926100 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4258/8513] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:31:08.930009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e533e-55bf-42a1-99dc-0cca906b1969 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:08.939846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e533e-55bf-42a1-99dc-0cca906b1969 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:08.944498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54f81a-6c70-4bd0-9a17-5e3ccb3c6299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:08.945358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f81a-6c70-4bd0-9a17-5e3ccb3c6299 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.945636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f81a-6c70-4bd0-9a17-5e3ccb3c6299 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.945906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54f81a-6c70-4bd0-9a17-5e3ccb3c6299 admin admin] PATH_INFO: `/v3/projects/e6fcfbedd58a4f10a117636521ca7e8d/users/8a22f736be004661b42eee35917e4c81/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:08.960738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54f81a-6c70-4bd0-9a17-5e3ccb3c6299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fcfbedd58a4f10a117636521ca7e8d, user_id=8a22f736be004661b42eee35917e4c81, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:08.963367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54f81a-6c70-4bd0-9a17-5e3ccb3c6299 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:08.976967 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4256/8514] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:31:08 2022] PUT /identity/v3/projects/e6fcfbedd58a4f10a117636521ca7e8d/users/8a22f736be004661b42eee35917e4c81/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:08.987373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346506c-538a-490d-99b8-527a2c20f7d5 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:08.987663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346506c-538a-490d-99b8-527a2c20f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:08.987941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346506c-538a-490d-99b8-527a2c20f7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:09.013716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-c346506c-538a-490d-99b8-527a2c20f7d5 None None] MFA Rules not processed for user `8a22f736be004661b42eee35917e4c81`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:09.014919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c346506c-538a-490d-99b8-527a2c20f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:09.077461 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4259/8515] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:09.082382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54f81a-6c70-4bd0-9a17-5e3ccb3c6299 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:09.141572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54f81a-6c70-4bd0-9a17-5e3ccb3c6299 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:09.146196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cfd0f-6781-4ab1-9482-fc098b2a4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:09.146837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cfd0f-6781-4ab1-9482-fc098b2a4208 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:09.147120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cfd0f-6781-4ab1-9482-fc098b2a4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:09.147398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cfd0f-6781-4ab1-9482-fc098b2a4208 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:09.148084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cfd0f-6781-4ab1-9482-fc098b2a4208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:09.150002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cfd0f-6781-4ab1-9482-fc098b2a4208 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:09.175290 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4257/8516] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:31:09 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:31:09.179307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346506c-538a-490d-99b8-527a2c20f7d5 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:09.190558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346506c-538a-490d-99b8-527a2c20f7d5 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:09.246599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5556b-3cf9-4f2e-b189-495f23cc8b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:09.247269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5556b-3cf9-4f2e-b189-495f23cc8b8d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:09.247555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5556b-3cf9-4f2e-b189-495f23cc8b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:09.247855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5556b-3cf9-4f2e-b189-495f23cc8b8d admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:09.248569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5556b-3cf9-4f2e-b189-495f23cc8b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:09.250482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5556b-3cf9-4f2e-b189-495f23cc8b8d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:09.275514 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4260/8517] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:31:09 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:31:09.279561 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cfd0f-6781-4ab1-9482-fc098b2a4208 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:09.290557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cfd0f-6781-4ab1-9482-fc098b2a4208 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:09.295220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34dd3-58ac-4bdb-ac36-4f3658a2491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:09.295871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34dd3-58ac-4bdb-ac36-4f3658a2491f admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:09.296157 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34dd3-58ac-4bdb-ac36-4f3658a2491f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:09.296476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34dd3-58ac-4bdb-ac36-4f3658a2491f admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:09.297191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a34dd3-58ac-4bdb-ac36-4f3658a2491f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:09.299457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a34dd3-58ac-4bdb-ac36-4f3658a2491f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:09.309871 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4258/8518] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:31:09.313937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5556b-3cf9-4f2e-b189-495f23cc8b8d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:09.323966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5556b-3cf9-4f2e-b189-495f23cc8b8d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:09.328908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:09.329801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:09.330089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:09.330363 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] PATH_INFO: `/v3/projects/57314ea738a24ce4b632438b38da2db0/users/ca233e54aa07422f8040f9c65d9b557d/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:09.345424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57314ea738a24ce4b632438b38da2db0, user_id=ca233e54aa07422f8040f9c65d9b557d, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:09.348061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:09.362515 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4261/8519] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:31:09 2022] PUT /identity/v3/projects/57314ea738a24ce4b632438b38da2db0/users/ca233e54aa07422f8040f9c65d9b557d/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:31:09.373742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489f50-101f-402b-993f-0c92593293bf None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:09.374031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489f50-101f-402b-993f-0c92593293bf None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:09.374333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489f50-101f-402b-993f-0c92593293bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:09.400779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-fe489f50-101f-402b-993f-0c92593293bf None None] MFA Rules not processed for user `ca233e54aa07422f8040f9c65d9b557d`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:09.401954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-fe489f50-101f-402b-993f-0c92593293bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:09.464430 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4259/8520] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:09.493421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:09.495183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:09.587121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69c727-72f0-4f8b-b3e1-733d585ce361 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:09.592292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0a399-d391-4e51-85f7-9ca2634f4dd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:09.593048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0a399-d391-4e51-85f7-9ca2634f4dd9 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:09.593335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0a399-d391-4e51-85f7-9ca2634f4dd9 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:09.593631 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0a399-d391-4e51-85f7-9ca2634f4dd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:09.601942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0a399-d391-4e51-85f7-9ca2634f4dd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:09.603522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0a399-d391-4e51-85f7-9ca2634f4dd9 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:09.611532 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4262/8521] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:31:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:31:10.160730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489f50-101f-402b-993f-0c92593293bf None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:10.222123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489f50-101f-402b-993f-0c92593293bf None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:10.226645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:10.227507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:10.227785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:10.228061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] PATH_INFO: `/v3/users/8a22f736be004661b42eee35917e4c81` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:10.229324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a22f736be004661b42eee35917e4c81)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:10.231249 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:10.275971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a22f736be004661b42eee35917e4c81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.276632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a22f736be004661b42eee35917e4c81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.277232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a22f736be004661b42eee35917e4c81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.289504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a22f736be004661b42eee35917e4c81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.296588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a22f736be004661b42eee35917e4c81'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.308595 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4260/8522] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:31:10 2022] DELETE /identity/v3/users/8a22f736be004661b42eee35917e4c81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:10.313136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8779cc-2660-42bc-b9e5-cf3a7eac3870 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:10.313456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8779cc-2660-42bc-b9e5-cf3a7eac3870 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:10.313991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8779cc-2660-42bc-b9e5-cf3a7eac3870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:10.331429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8c8779cc-2660-42bc-b9e5-cf3a7eac3870 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:10.332659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c8779cc-2660-42bc-b9e5-cf3a7eac3870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:10.388801 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4263/8523] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:10.399086 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:10.400512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:10.458591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156ff8-33ce-4efe-8f30-2dcf0aa0fa76 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:10.462191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4f58-686b-479b-8549-e482ff7f485a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:10.462823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4f58-686b-479b-8549-e482ff7f485a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:10.463103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4f58-686b-479b-8549-e482ff7f485a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:10.463378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4f58-686b-479b-8549-e482ff7f485a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:10.473021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4f58-686b-479b-8549-e482ff7f485a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:10.474438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4f58-686b-479b-8549-e482ff7f485a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:10.484046 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4261/8524] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:31:10.765604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8779cc-2660-42bc-b9e5-cf3a7eac3870 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:10.767644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c8779cc-2660-42bc-b9e5-cf3a7eac3870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:10.779853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8779cc-2660-42bc-b9e5-cf3a7eac3870 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:10.784549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:10.785465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:10.785747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:10.786218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] PATH_INFO: `/v3/projects/e6fcfbedd58a4f10a117636521ca7e8d` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:10.787603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fcfbedd58a4f10a117636521ca7e8d)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:10.789534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:10.836253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fcfbedd58a4f10a117636521ca7e8d', 'request_id': 'req-87bf3632-a68c-4aff-8714-110b9ef73002'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.841451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fcfbedd58a4f10a117636521ca7e8d', 'request_id': 'req-87bf3632-a68c-4aff-8714-110b9ef73002'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.848572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fcfbedd58a4f10a117636521ca7e8d', 'request_id': 'req-87bf3632-a68c-4aff-8714-110b9ef73002'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.859564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] The token cache is being invalidate because project e6fcfbedd58a4f10a117636521ca7e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:31:10.859857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.860525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.862085 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4264/8525] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:31:10 2022] DELETE /identity/v3/projects/e6fcfbedd58a4f10a117636521ca7e8d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:10.866048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4f58-686b-479b-8549-e482ff7f485a service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:10.875654 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4f58-686b-479b-8549-e482ff7f485a service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:10.931887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:10.932784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:10.933066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:10.933374 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] PATH_INFO: `/v3/users/ca233e54aa07422f8040f9c65d9b557d` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:10.934558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca233e54aa07422f8040f9c65d9b557d)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:10.936509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:10.981441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca233e54aa07422f8040f9c65d9b557d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.982025 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca233e54aa07422f8040f9c65d9b557d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.982661 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca233e54aa07422f8040f9c65d9b557d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:10.995185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca233e54aa07422f8040f9c65d9b557d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:11.003886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-1de8a257-31ca-4ad8-bbd7-e79d675ce10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca233e54aa07422f8040f9c65d9b557d'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:11.016085 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4262/8526] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:31:10 2022] DELETE /identity/v3/users/ca233e54aa07422f8040f9c65d9b557d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:11.276704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:11.278227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:11.296259 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf3632-a68c-4aff-8714-110b9ef73002 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:11.352968 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:11.353855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.354140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.354418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] PATH_INFO: `/v3/projects/57314ea738a24ce4b632438b38da2db0` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.355703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57314ea738a24ce4b632438b38da2db0)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:11.357680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:11.405060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57314ea738a24ce4b632438b38da2db0', 'request_id': 'req-062e3989-fd2b-4e69-87ec-39e896e2c11b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:11.410980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57314ea738a24ce4b632438b38da2db0', 'request_id': 'req-062e3989-fd2b-4e69-87ec-39e896e2c11b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:11.417531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57314ea738a24ce4b632438b38da2db0', 'request_id': 'req-062e3989-fd2b-4e69-87ec-39e896e2c11b'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:11.428859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] The token cache is being invalidate because project 57314ea738a24ce4b632438b38da2db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:31:11.429147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:11.429779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-062e3989-fd2b-4e69-87ec-39e896e2c11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:11.431314 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4265/8527] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:31:11 2022] DELETE /identity/v3/projects/57314ea738a24ce4b632438b38da2db0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:11.436393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4635-2cc7-47e8-b502-ae25c9ca94e1 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.436888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4635-2cc7-47e8-b502-ae25c9ca94e1 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.437003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4635-2cc7-47e8-b502-ae25c9ca94e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.454678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c84a4635-2cc7-47e8-b502-ae25c9ca94e1 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:11.455886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c84a4635-2cc7-47e8-b502-ae25c9ca94e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:11.514179 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4263/8528] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:11.522041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31c550-6fff-49fc-aed5-1a8fce274890 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.522274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31c550-6fff-49fc-aed5-1a8fce274890 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.522552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31c550-6fff-49fc-aed5-1a8fce274890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.541084 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8d31c550-6fff-49fc-aed5-1a8fce274890 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:11.542304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8d31c550-6fff-49fc-aed5-1a8fce274890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:11.550910 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4266/8529] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:11.555082 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4635-2cc7-47e8-b502-ae25c9ca94e1 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:11.565358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4635-2cc7-47e8-b502-ae25c9ca94e1 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:11.570052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:11.570704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.570987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.571265 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.571986 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:31:11.572293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:11.573916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:11.586078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4264/8530] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:31:11.590255 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31c550-6fff-49fc-aed5-1a8fce274890 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:11.599512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31c550-6fff-49fc-aed5-1a8fce274890 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:11.604211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbceedc-09f1-4adb-96fd-c0697df8769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:11.604887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbceedc-09f1-4adb-96fd-c0697df8769c admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.605172 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbceedc-09f1-4adb-96fd-c0697df8769c admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.605446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbceedc-09f1-4adb-96fd-c0697df8769c admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.606134 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbceedc-09f1-4adb-96fd-c0697df8769c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:11.608018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbceedc-09f1-4adb-96fd-c0697df8769c admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:11.634263 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4267/8531] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:31:11 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:31:11.638262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:11.648849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a1a2-1ce1-48b5-8835-5e738f22e61c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:11.704937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd020743-c56b-432a-9306-5dc2eccaa04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:11.705619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020743-c56b-432a-9306-5dc2eccaa04e admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.705902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020743-c56b-432a-9306-5dc2eccaa04e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.706176 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020743-c56b-432a-9306-5dc2eccaa04e admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.706876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd020743-c56b-432a-9306-5dc2eccaa04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:11.708829 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd020743-c56b-432a-9306-5dc2eccaa04e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:11.727875 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4265/8532] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:31:11 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:31:11.732017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbceedc-09f1-4adb-96fd-c0697df8769c admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:11.743466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbceedc-09f1-4adb-96fd-c0697df8769c admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:11.748688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097968ee-0ac7-4a57-9806-6fca7ee3a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:11.749365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097968ee-0ac7-4a57-9806-6fca7ee3a1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.749671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097968ee-0ac7-4a57-9806-6fca7ee3a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.749950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097968ee-0ac7-4a57-9806-6fca7ee3a1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.750709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097968ee-0ac7-4a57-9806-6fca7ee3a1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:11.752930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097968ee-0ac7-4a57-9806-6fca7ee3a1d4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:11.763876 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4268/8533] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:31:11.767889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd020743-c56b-432a-9306-5dc2eccaa04e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:11.778098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd020743-c56b-432a-9306-5dc2eccaa04e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:11.782744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ce0c3-8036-4c81-a9a1-3d696723a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:11.783398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ce0c3-8036-4c81-a9a1-3d696723a4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.783683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ce0c3-8036-4c81-a9a1-3d696723a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.783960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ce0c3-8036-4c81-a9a1-3d696723a4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.784837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ce0c3-8036-4c81-a9a1-3d696723a4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:11.786421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ce0c3-8036-4c81-a9a1-3d696723a4d5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:11.797462 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4266/8534] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:31:11.802456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097968ee-0ac7-4a57-9806-6fca7ee3a1d4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:11.812482 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097968ee-0ac7-4a57-9806-6fca7ee3a1d4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:11.817864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:11.818745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.819032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.819312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] PATH_INFO: `/v3/projects/aa6788e394884661b4434d1b0c3fbb69/users/ff62fa1fbdbd4696898f3b85040cd68f/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.834158 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6788e394884661b4434d1b0c3fbb69, user_id=ff62fa1fbdbd4696898f3b85040cd68f, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:11.836939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:11.849714 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4269/8535] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:31:11 2022] PUT /identity/v3/projects/aa6788e394884661b4434d1b0c3fbb69/users/ff62fa1fbdbd4696898f3b85040cd68f/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:11.855010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8544847-afc1-42f4-90d4-7e09e90fb71f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:11.855306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8544847-afc1-42f4-90d4-7e09e90fb71f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:11.855651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8544847-afc1-42f4-90d4-7e09e90fb71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:11.874845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b8544847-afc1-42f4-90d4-7e09e90fb71f None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:11.876665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b8544847-afc1-42f4-90d4-7e09e90fb71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:11.932894 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4267/8536] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:31:11.943010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:11.944777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:12.002357 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca5f4b-681c-4cc1-a9c7-498553f13b59 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:12.006288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcd33b-bfea-4cf8-90e4-7d487c2773b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:12.006934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcd33b-bfea-4cf8-90e4-7d487c2773b9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:12.007248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcd33b-bfea-4cf8-90e4-7d487c2773b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:12.007529 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcd33b-bfea-4cf8-90e4-7d487c2773b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:12.016558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcd33b-bfea-4cf8-90e4-7d487c2773b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:12.017982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcd33b-bfea-4cf8-90e4-7d487c2773b9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:12.027354 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4270/8537] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:15.930222 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce3b68-73a6-4966-b477-3c7dbcf3b363 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:15.931263 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce3b68-73a6-4966-b477-3c7dbcf3b363 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:15.931627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce3b68-73a6-4966-b477-3c7dbcf3b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:15.962096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-32ce3b68-73a6-4966-b477-3c7dbcf3b363 None None] MFA Rules not processed for user `ff62fa1fbdbd4696898f3b85040cd68f`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:15.963446 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-32ce3b68-73a6-4966-b477-3c7dbcf3b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:16.034095 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4268/8538] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:16.038679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcd33b-bfea-4cf8-90e4-7d487c2773b9 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:16.049231 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcd33b-bfea-4cf8-90e4-7d487c2773b9 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:16.054153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581982-7dfb-4b86-8109-67af72b4be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:16.054808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581982-7dfb-4b86-8109-67af72b4be88 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:16.055095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581982-7dfb-4b86-8109-67af72b4be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:16.055372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e581982-7dfb-4b86-8109-67af72b4be88 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:16.056059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e581982-7dfb-4b86-8109-67af72b4be88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:16.057996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e581982-7dfb-4b86-8109-67af72b4be88 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:16.090537 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4271/8539] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:31:16 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:31:16.091678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce3b68-73a6-4966-b477-3c7dbcf3b363 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:16.102861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce3b68-73a6-4966-b477-3c7dbcf3b363 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:16.160631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fcb35-788f-453f-b342-bee5c3f0de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:16.161312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fcb35-788f-453f-b342-bee5c3f0de14 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:16.161595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fcb35-788f-453f-b342-bee5c3f0de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:16.161873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fcb35-788f-453f-b342-bee5c3f0de14 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:16.162586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fcb35-788f-453f-b342-bee5c3f0de14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:16.164691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fcb35-788f-453f-b342-bee5c3f0de14 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:16.186052 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4269/8540] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:31:16 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:31:16.190655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581982-7dfb-4b86-8109-67af72b4be88 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:16.201908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e581982-7dfb-4b86-8109-67af72b4be88 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:16.207779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c1287-5830-4d34-bb96-5c6a5a16df24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:16.208493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c1287-5830-4d34-bb96-5c6a5a16df24 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:16.208778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c1287-5830-4d34-bb96-5c6a5a16df24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:16.209056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c1287-5830-4d34-bb96-5c6a5a16df24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:16.209778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c1287-5830-4d34-bb96-5c6a5a16df24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:16.211377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c1287-5830-4d34-bb96-5c6a5a16df24 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:16.222890 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4272/8541] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:31:16.228699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fcb35-788f-453f-b342-bee5c3f0de14 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:16.239611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fcb35-788f-453f-b342-bee5c3f0de14 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:16.244513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6c770-4633-46c2-902b-20bfffc9bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:16.245493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6c770-4633-46c2-902b-20bfffc9bc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:16.245947 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6c770-4633-46c2-902b-20bfffc9bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:16.246235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6c770-4633-46c2-902b-20bfffc9bc3c admin admin] PATH_INFO: `/v3/projects/743163568cef44aeaa073c0f5273e82f/users/d1fa3059049c46909ec90740b64ea359/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:16.262459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6c770-4633-46c2-902b-20bfffc9bc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=743163568cef44aeaa073c0f5273e82f, user_id=d1fa3059049c46909ec90740b64ea359, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:16.265164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6c770-4633-46c2-902b-20bfffc9bc3c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:16.279773 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4270/8542] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:31:16 2022] PUT /identity/v3/projects/743163568cef44aeaa073c0f5273e82f/users/d1fa3059049c46909ec90740b64ea359/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:16.285796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c1287-5830-4d34-bb96-5c6a5a16df24 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:16.300913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c1287-5830-4d34-bb96-5c6a5a16df24 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:16.376538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f295a15-e3b9-4e9d-a246-77bdc500535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:16.376982 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295a15-e3b9-4e9d-a246-77bdc500535f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:16.377269 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295a15-e3b9-4e9d-a246-77bdc500535f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:16.377548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295a15-e3b9-4e9d-a246-77bdc500535f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:16.378306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f295a15-e3b9-4e9d-a246-77bdc500535f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:16.379989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f295a15-e3b9-4e9d-a246-77bdc500535f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:16.395162 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4273/8543] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:31:16.396563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6c770-4633-46c2-902b-20bfffc9bc3c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:16.407913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6c770-4633-46c2-902b-20bfffc9bc3c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:16.412815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:16.413725 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:16.414004 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:16.414278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] PATH_INFO: `/v3/projects/743163568cef44aeaa073c0f5273e82f/users/d1fa3059049c46909ec90740b64ea359/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:16.416383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743163568cef44aeaa073c0f5273e82f, user_id=d1fa3059049c46909ec90740b64ea359, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:16.419454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:16.430843 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4271/8544] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:31:16 2022] PUT /identity/v3/projects/743163568cef44aeaa073c0f5273e82f/users/d1fa3059049c46909ec90740b64ea359/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:31:21.255306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550937d-0fcf-4d66-811b-606612b0a6dc None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:21.256119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550937d-0fcf-4d66-811b-606612b0a6dc None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:21.256440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550937d-0fcf-4d66-811b-606612b0a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:21.289985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f550937d-0fcf-4d66-811b-606612b0a6dc None None] MFA Rules not processed for user `d1fa3059049c46909ec90740b64ea359`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:21.292136 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f550937d-0fcf-4d66-811b-606612b0a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:21.430306 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4274/8545] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:21.441922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:21.444041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:21.530777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f422e-6644-4cf6-8389-24ec878fb9e5 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:21.539854 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:21.540617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:21.540848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:21.541131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:21.551152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:21.552754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:21.565125 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4272/8546] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:21.626704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5bf99-4464-4be5-95dd-6a550d760f4e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:21.627004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5bf99-4464-4be5-95dd-6a550d760f4e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:21.627291 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5bf99-4464-4be5-95dd-6a550d760f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:21.647499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f8f5bf99-4464-4be5-95dd-6a550d760f4e None None] MFA Rules not processed for user `ff62fa1fbdbd4696898f3b85040cd68f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:21.648811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8f5bf99-4464-4be5-95dd-6a550d760f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:21.713936 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4275/8547] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:22.026334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:22.027857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:22.089187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926d66-b2b3-48cd-84a3-1418dacd4b45 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:22.092788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:22.093547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:22.093830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:22.094623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:22.096453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:22.108627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:22.110685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:22.121700 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4273/8548] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:22.469016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5bf99-4464-4be5-95dd-6a550d760f4e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:22.470972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f8f5bf99-4464-4be5-95dd-6a550d760f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:22.543043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5bf99-4464-4be5-95dd-6a550d760f4e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:22.548818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098faf51-c16a-40f7-9f8f-4650904d412c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:22.549468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098faf51-c16a-40f7-9f8f-4650904d412c service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:22.549751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098faf51-c16a-40f7-9f8f-4650904d412c service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:22.550031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098faf51-c16a-40f7-9f8f-4650904d412c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:22.551820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-098faf51-c16a-40f7-9f8f-4650904d412c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:22.566410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098faf51-c16a-40f7-9f8f-4650904d412c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:22.567980 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098faf51-c16a-40f7-9f8f-4650904d412c service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:22.580391 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4276/8549] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:24.970887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:24.972525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:24.994783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e1f8-0433-447b-894b-fc6e781367ec service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:25.009875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:25.010781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:25.011450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:25.011738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:25.015650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:25.036905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:25.038520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:25.059476 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4274/8550] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:34.561901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f0415-6e02-4ddb-879c-e7c2ab3cbfad None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:34.562385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f0415-6e02-4ddb-879c-e7c2ab3cbfad None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:34.562499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f0415-6e02-4ddb-879c-e7c2ab3cbfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:34.580032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5e4f0415-6e02-4ddb-879c-e7c2ab3cbfad None None] MFA Rules not processed for user `ff62fa1fbdbd4696898f3b85040cd68f`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:34.581260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e4f0415-6e02-4ddb-879c-e7c2ab3cbfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:34.588130 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4277/8551] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:36.522467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:36.535586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535519b3-28a4-405f-a695-5ad7062c586e service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:36.540751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:36.541408 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:36.541862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:36.542414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:36.545385 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:36.558836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:36.560305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:36.571905 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4275/8552] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:37.186428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f0415-6e02-4ddb-879c-e7c2ab3cbfad None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:37.223641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f0415-6e02-4ddb-879c-e7c2ab3cbfad None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:37.233538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:37.234466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:37.234814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:37.235187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:37.237210 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:37.273607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:37.275238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:37.290610 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4278/8553] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:31:56.221776 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:56.292383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8339e0e-82b3-48ec-ba79-eab80ae21884 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:56.297170 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:56.298029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:56.298311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:56.298591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] PATH_INFO: `/v3/users/ff62fa1fbdbd4696898f3b85040cd68f` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:56.299790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff62fa1fbdbd4696898f3b85040cd68f)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:56.301766 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:56.353099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff62fa1fbdbd4696898f3b85040cd68f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.353772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff62fa1fbdbd4696898f3b85040cd68f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.354449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff62fa1fbdbd4696898f3b85040cd68f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.366453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff62fa1fbdbd4696898f3b85040cd68f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.376650 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff62fa1fbdbd4696898f3b85040cd68f'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.389642 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4276/8554] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:31:56 2022] DELETE /identity/v3/users/ff62fa1fbdbd4696898f3b85040cd68f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:56.563619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:56.575249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad855aa9-3eed-4c2d-8ca3-cc2b707efdf4 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:56.631577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:56.632469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:56.632754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:56.633031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] PATH_INFO: `/v3/projects/aa6788e394884661b4434d1b0c3fbb69` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:56.634213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6788e394884661b4434d1b0c3fbb69)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:56.636573 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:56.682614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6788e394884661b4434d1b0c3fbb69', 'request_id': 'req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.688471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6788e394884661b4434d1b0c3fbb69', 'request_id': 'req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.695537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6788e394884661b4434d1b0c3fbb69', 'request_id': 'req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.707779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] The token cache is being invalidate because project aa6788e394884661b4434d1b0c3fbb69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:31:56.708069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.708760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.710415 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4279/8555] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:31:56 2022] DELETE /identity/v3/projects/aa6788e394884661b4434d1b0c3fbb69 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:56.714479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:56.715889 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:56.728818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054bf53-e84f-43b7-b2dc-45a286075892 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:56.785112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:56.785976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:56.786256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:56.786531 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] PATH_INFO: `/v3/users/d1fa3059049c46909ec90740b64ea359` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:56.787755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1fa3059049c46909ec90740b64ea359)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:56.789746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:56.833972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1fa3059049c46909ec90740b64ea359'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.834528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1fa3059049c46909ec90740b64ea359'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.835133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1fa3059049c46909ec90740b64ea359'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.846756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1fa3059049c46909ec90740b64ea359'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.853644 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e393f81d-4c7f-4f59-a38b-6e49fac9f2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1fa3059049c46909ec90740b64ea359'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:56.865989 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4277/8556] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:31:56 2022] DELETE /identity/v3/users/d1fa3059049c46909ec90740b64ea359 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:57.038135 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:57.039715 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:57.054696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a9f0-e8e8-4cf1-ba9a-ecdcda4c59f0 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:57.113919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:57.114704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.114988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.115266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] PATH_INFO: `/v3/projects/743163568cef44aeaa073c0f5273e82f` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.116497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=743163568cef44aeaa073c0f5273e82f)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:57.118476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:57.165244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743163568cef44aeaa073c0f5273e82f', 'request_id': 'req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:57.170527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743163568cef44aeaa073c0f5273e82f', 'request_id': 'req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:57.178459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743163568cef44aeaa073c0f5273e82f', 'request_id': 'req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:57.189714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] The token cache is being invalidate because project 743163568cef44aeaa073c0f5273e82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:31:57.189999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:57.190637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-2b284a3d-16e5-46ac-aed8-33f6ca757c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:31:57.192202 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4280/8557] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:31:57 2022] DELETE /identity/v3/projects/743163568cef44aeaa073c0f5273e82f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:57.197456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091b852-eae5-489c-ad06-f05372b1a394 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.197746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091b852-eae5-489c-ad06-f05372b1a394 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.198027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091b852-eae5-489c-ad06-f05372b1a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.215868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d091b852-eae5-489c-ad06-f05372b1a394 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:57.217138 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d091b852-eae5-489c-ad06-f05372b1a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:57.275140 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4278/8558] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:31:57.283091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac350e2-3713-4382-965d-576981e5a6f4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.283380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac350e2-3713-4382-965d-576981e5a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.283667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac350e2-3713-4382-965d-576981e5a6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.302156 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7ac350e2-3713-4382-965d-576981e5a6f4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:57.303341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7ac350e2-3713-4382-965d-576981e5a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:57.311145 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4281/8559] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:57.315135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091b852-eae5-489c-ad06-f05372b1a394 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:57.325122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091b852-eae5-489c-ad06-f05372b1a394 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:57.330008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:57.330651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.330932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.331205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.331913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:31:57.332217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:57.333828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:57.345484 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4279/8560] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:31:57.349758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac350e2-3713-4382-965d-576981e5a6f4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:57.359730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac350e2-3713-4382-965d-576981e5a6f4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:57.364691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d9f18-4054-47a3-bca7-3a4f7b97f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:57.365306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9f18-4054-47a3-bca7-3a4f7b97f663 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.365586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9f18-4054-47a3-bca7-3a4f7b97f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.365862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9f18-4054-47a3-bca7-3a4f7b97f663 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.366581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d9f18-4054-47a3-bca7-3a4f7b97f663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:57.368496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d9f18-4054-47a3-bca7-3a4f7b97f663 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:57.393689 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4282/8561] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:31:57 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:31:57.397714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:57.409279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5980d3-6c0b-464f-b77b-3359be5dbd92 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:57.472651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736001c5-ece2-4f77-a9b1-e9348265779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:57.473315 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736001c5-ece2-4f77-a9b1-e9348265779a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.473595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736001c5-ece2-4f77-a9b1-e9348265779a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.473870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736001c5-ece2-4f77-a9b1-e9348265779a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.474554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736001c5-ece2-4f77-a9b1-e9348265779a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:57.476486 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736001c5-ece2-4f77-a9b1-e9348265779a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:57.495648 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4280/8562] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:31:57 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:31:57.499688 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d9f18-4054-47a3-bca7-3a4f7b97f663 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:57.509940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d9f18-4054-47a3-bca7-3a4f7b97f663 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:57.514560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fa156-4341-4c52-a7c1-9ea5c8e7bbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:57.515711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fa156-4341-4c52-a7c1-9ea5c8e7bbfc admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.515988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fa156-4341-4c52-a7c1-9ea5c8e7bbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.516260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fa156-4341-4c52-a7c1-9ea5c8e7bbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.517017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fa156-4341-4c52-a7c1-9ea5c8e7bbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:57.518599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fa156-4341-4c52-a7c1-9ea5c8e7bbfc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:57.531973 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4283/8563] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:31:57.536117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736001c5-ece2-4f77-a9b1-e9348265779a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:57.546090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736001c5-ece2-4f77-a9b1-e9348265779a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:57.550915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933b03-0732-4cee-8d1e-41c9fc138f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:57.551524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933b03-0732-4cee-8d1e-41c9fc138f9b admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.551807 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933b03-0732-4cee-8d1e-41c9fc138f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.552084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933b03-0732-4cee-8d1e-41c9fc138f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.552840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1933b03-0732-4cee-8d1e-41c9fc138f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:57.554416 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1933b03-0732-4cee-8d1e-41c9fc138f9b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:57.564250 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4281/8564] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:31:57.568171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fa156-4341-4c52-a7c1-9ea5c8e7bbfc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:57.578807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fa156-4341-4c52-a7c1-9ea5c8e7bbfc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:57.583493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:57.584368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.584655 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.584931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] PATH_INFO: `/v3/projects/72f5105ec09c4f3c82c087633532c76a/users/f489d295f12b43719f3ba84f7d2dc683/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.600536 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f5105ec09c4f3c82c087633532c76a, user_id=f489d295f12b43719f3ba84f7d2dc683, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:57.603183 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:57.617769 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4284/8565] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:31:57 2022] PUT /identity/v3/projects/72f5105ec09c4f3c82c087633532c76a/users/f489d295f12b43719f3ba84f7d2dc683/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:31:57.622903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df832c4a-8607-4c32-9bcd-2c9d9a78de08 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.623193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df832c4a-8607-4c32-9bcd-2c9d9a78de08 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.623500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df832c4a-8607-4c32-9bcd-2c9d9a78de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.643922 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-df832c4a-8607-4c32-9bcd-2c9d9a78de08 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:31:57.645177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-df832c4a-8607-4c32-9bcd-2c9d9a78de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:57.707415 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4282/8566] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:31:57.716917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:31:57.719223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:31:57.778335 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59d80a-d6f2-46cf-b5f7-7a99ccb9730b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:31:57.782676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689167-410b-467f-bc5f-4b975dc12786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:31:57.783320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689167-410b-467f-bc5f-4b975dc12786 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:31:57.783601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689167-410b-467f-bc5f-4b975dc12786 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:31:57.783881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689167-410b-467f-bc5f-4b975dc12786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:31:57.793364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3689167-410b-467f-bc5f-4b975dc12786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:31:57.794792 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3689167-410b-467f-bc5f-4b975dc12786 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:31:57.804911 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4285/8567] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:32:01.734827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd6e54-1cf9-4440-bcbf-620bc8044d7f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:01.735333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd6e54-1cf9-4440-bcbf-620bc8044d7f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:01.735418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd6e54-1cf9-4440-bcbf-620bc8044d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:01.770466 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-41dd6e54-1cf9-4440-bcbf-620bc8044d7f None None] MFA Rules not processed for user `f489d295f12b43719f3ba84f7d2dc683`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:32:01.771076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41dd6e54-1cf9-4440-bcbf-620bc8044d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:32:01.845151 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4283/8568] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:32:01.849585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689167-410b-467f-bc5f-4b975dc12786 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:01.859922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689167-410b-467f-bc5f-4b975dc12786 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:01.867356 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9564a2-213d-49e9-82d2-4d81ba8413e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:01.868022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9564a2-213d-49e9-82d2-4d81ba8413e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:01.868302 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9564a2-213d-49e9-82d2-4d81ba8413e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:01.868595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9564a2-213d-49e9-82d2-4d81ba8413e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:01.869399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9564a2-213d-49e9-82d2-4d81ba8413e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:01.872607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9564a2-213d-49e9-82d2-4d81ba8413e5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:01.904383 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4286/8569] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:32:01 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:32:01.908472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd6e54-1cf9-4440-bcbf-620bc8044d7f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:01.922143 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd6e54-1cf9-4440-bcbf-620bc8044d7f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:01.991845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208a37-16b3-4a36-bcbc-77bd3cccb476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:01.992748 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208a37-16b3-4a36-bcbc-77bd3cccb476 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:01.993116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208a37-16b3-4a36-bcbc-77bd3cccb476 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:01.993470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208a37-16b3-4a36-bcbc-77bd3cccb476 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:01.994239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c208a37-16b3-4a36-bcbc-77bd3cccb476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:01.996406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c208a37-16b3-4a36-bcbc-77bd3cccb476 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:02.019847 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4284/8570] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:32:01 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:32:02.024010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9564a2-213d-49e9-82d2-4d81ba8413e5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:02.036174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9564a2-213d-49e9-82d2-4d81ba8413e5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:02.042372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67085e92-aca9-49d2-af12-472cf57a51c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:02.043035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67085e92-aca9-49d2-af12-472cf57a51c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:02.043570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67085e92-aca9-49d2-af12-472cf57a51c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:02.043860 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67085e92-aca9-49d2-af12-472cf57a51c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:02.045000 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67085e92-aca9-49d2-af12-472cf57a51c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:02.046730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67085e92-aca9-49d2-af12-472cf57a51c8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:02.061028 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4287/8571] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:32:02.065774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208a37-16b3-4a36-bcbc-77bd3cccb476 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:02.078563 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208a37-16b3-4a36-bcbc-77bd3cccb476 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:02.085550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec109e-4188-4281-9ff9-4c054da66f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:02.086636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec109e-4188-4281-9ff9-4c054da66f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:02.087029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec109e-4188-4281-9ff9-4c054da66f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:02.087409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec109e-4188-4281-9ff9-4c054da66f54 admin admin] PATH_INFO: `/v3/projects/2ca425862fb14ceaba03ebbc8d87c2cf/users/e2ec01be1c8a44739d5f32e3d53453db/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:02.104640 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec109e-4188-4281-9ff9-4c054da66f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca425862fb14ceaba03ebbc8d87c2cf, user_id=e2ec01be1c8a44739d5f32e3d53453db, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:02.107437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec109e-4188-4281-9ff9-4c054da66f54 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:02.127616 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4285/8572] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:32:02 2022] PUT /identity/v3/projects/2ca425862fb14ceaba03ebbc8d87c2cf/users/e2ec01be1c8a44739d5f32e3d53453db/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:32:02.128884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67085e92-aca9-49d2-af12-472cf57a51c8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:02.139557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67085e92-aca9-49d2-af12-472cf57a51c8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:02.199278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851b5e-a50e-46c5-872a-cf145077299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:02.199960 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851b5e-a50e-46c5-872a-cf145077299f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:02.200250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851b5e-a50e-46c5-872a-cf145077299f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:02.200571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851b5e-a50e-46c5-872a-cf145077299f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:02.201296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49851b5e-a50e-46c5-872a-cf145077299f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:02.203189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49851b5e-a50e-46c5-872a-cf145077299f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:02.216592 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4288/8573] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:32:02.217699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec109e-4188-4281-9ff9-4c054da66f54 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:02.228140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec109e-4188-4281-9ff9-4c054da66f54 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:02.232757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:02.234164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:02.234450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:02.234729 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] PATH_INFO: `/v3/projects/2ca425862fb14ceaba03ebbc8d87c2cf/users/e2ec01be1c8a44739d5f32e3d53453db/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:02.236964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca425862fb14ceaba03ebbc8d87c2cf, user_id=e2ec01be1c8a44739d5f32e3d53453db, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:02.239669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:02.252073 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4286/8574] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:32:02 2022] PUT /identity/v3/projects/2ca425862fb14ceaba03ebbc8d87c2cf/users/e2ec01be1c8a44739d5f32e3d53453db/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:32:07.085954 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68b09-27ad-4e55-bb7d-3a5fadaf61ed None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:07.086547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68b09-27ad-4e55-bb7d-3a5fadaf61ed None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:07.086547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68b09-27ad-4e55-bb7d-3a5fadaf61ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:07.117718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d1d68b09-27ad-4e55-bb7d-3a5fadaf61ed None None] MFA Rules not processed for user `e2ec01be1c8a44739d5f32e3d53453db`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:32:07.119140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d1d68b09-27ad-4e55-bb7d-3a5fadaf61ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:32:07.209014 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4289/8575] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:32:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:32:07.226687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:07.228478 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:32:07.315378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27d21f-15bc-4a85-bd5a-32f4d72a790e admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:07.319053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beaf68-7eec-461c-9ea9-cd6fd24c19d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:07.319704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beaf68-7eec-461c-9ea9-cd6fd24c19d8 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:07.319984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beaf68-7eec-461c-9ea9-cd6fd24c19d8 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:07.320320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beaf68-7eec-461c-9ea9-cd6fd24c19d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:07.378443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beaf68-7eec-461c-9ea9-cd6fd24c19d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:07.379921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beaf68-7eec-461c-9ea9-cd6fd24c19d8 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:07.389871 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4287/8576] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:32:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:32:25.064114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b245b7-eb0a-4b0c-ae5a-5a09816eb4b3 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:25.064685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b245b7-eb0a-4b0c-ae5a-5a09816eb4b3 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:25.064791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b245b7-eb0a-4b0c-ae5a-5a09816eb4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:25.082512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-19b245b7-eb0a-4b0c-ae5a-5a09816eb4b3 None None] MFA Rules not processed for user `f489d295f12b43719f3ba84f7d2dc683`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:32:25.083717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-19b245b7-eb0a-4b0c-ae5a-5a09816eb4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:32:25.090735 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4290/8577] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:32:25.403587 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beaf68-7eec-461c-9ea9-cd6fd24c19d8 service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:25.459059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beaf68-7eec-461c-9ea9-cd6fd24c19d8 service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:25.462742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:25.463390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:25.463672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:25.463952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:25.465843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:32:25.478496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:25.479952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:25.490542 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4288/8578] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:32:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:32:36.488929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b245b7-eb0a-4b0c-ae5a-5a09816eb4b3 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:36.500923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b245b7-eb0a-4b0c-ae5a-5a09816eb4b3 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:36.506385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:36.507124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:36.507419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:36.507701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:36.509538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:32:36.522017 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:36.523456 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:36.534302 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4291/8579] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:32:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:32:38.286142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:32:38.296989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b8c7c-527c-48ba-b18f-f1e94d202bb3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:32:38.300572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b5594-bcca-4af1-9048-d8df8a29bd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:32:38.301199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b5594-bcca-4af1-9048-d8df8a29bd80 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:32:38.301477 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b5594-bcca-4af1-9048-d8df8a29bd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:32:38.301751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b5594-bcca-4af1-9048-d8df8a29bd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:32:38.310944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b5594-bcca-4af1-9048-d8df8a29bd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:32:38.312434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b5594-bcca-4af1-9048-d8df8a29bd80 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:32:38.321819 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4289/8580] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:32:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:33:32.858915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:32.921373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31396a4-3130-4278-bf66-25c50989bf98 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:32.925926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:32.926787 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:32.927070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:32.927349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] PATH_INFO: `/v3/users/f489d295f12b43719f3ba84f7d2dc683` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:32.928572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f489d295f12b43719f3ba84f7d2dc683)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:32.930480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:32.975477 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f489d295f12b43719f3ba84f7d2dc683'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:32.987514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f489d295f12b43719f3ba84f7d2dc683'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:32.995657 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f489d295f12b43719f3ba84f7d2dc683'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:32.996314 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f489d295f12b43719f3ba84f7d2dc683'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:32.997072 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f489d295f12b43719f3ba84f7d2dc683'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.008963 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4292/8581] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:33:32 2022] DELETE /identity/v3/users/f489d295f12b43719f3ba84f7d2dc683 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:33.175876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b5594-bcca-4af1-9048-d8df8a29bd80 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:33.191150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b5594-bcca-4af1-9048-d8df8a29bd80 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:33.255622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:33.256516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:33.256790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:33.257063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] PATH_INFO: `/v3/projects/72f5105ec09c4f3c82c087633532c76a` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:33.258812 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f5105ec09c4f3c82c087633532c76a)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:33.261278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:33.306484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f5105ec09c4f3c82c087633532c76a', 'request_id': 'req-83ab9de9-5d06-4075-84a7-e0a1dde05503'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.311624 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f5105ec09c4f3c82c087633532c76a', 'request_id': 'req-83ab9de9-5d06-4075-84a7-e0a1dde05503'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.318904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f5105ec09c4f3c82c087633532c76a', 'request_id': 'req-83ab9de9-5d06-4075-84a7-e0a1dde05503'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.330914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] The token cache is being invalidate because project 72f5105ec09c4f3c82c087633532c76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:33:33.331204 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.331843 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.333451 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4290/8582] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:33:33 2022] DELETE /identity/v3/projects/72f5105ec09c4f3c82c087633532c76a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:33:33.338008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:33.339459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:33.352498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac04b8-124d-4638-8a3f-5dc62423f827 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:33.407952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:33.408854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:33.409146 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:33.409420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] PATH_INFO: `/v3/users/e2ec01be1c8a44739d5f32e3d53453db` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:33.410619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ec01be1c8a44739d5f32e3d53453db)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:33.412567 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:33.456825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ec01be1c8a44739d5f32e3d53453db'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.469037 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ec01be1c8a44739d5f32e3d53453db'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.476465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ec01be1c8a44739d5f32e3d53453db'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.477125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ec01be1c8a44739d5f32e3d53453db'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.477740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d59b487e-84f9-4e1f-a5ab-364356a19db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ec01be1c8a44739d5f32e3d53453db'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.490919 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4293/8583] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:33:33 2022] DELETE /identity/v3/users/e2ec01be1c8a44739d5f32e3d53453db => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:33.668353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:33.669792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:33.686515 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab9de9-5d06-4075-84a7-e0a1dde05503 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:33.750252 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:33.751117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:33.751401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:33.751680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] PATH_INFO: `/v3/projects/2ca425862fb14ceaba03ebbc8d87c2cf` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:33.752937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca425862fb14ceaba03ebbc8d87c2cf)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:33.754849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:33.801379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca425862fb14ceaba03ebbc8d87c2cf', 'request_id': 'req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.807165 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca425862fb14ceaba03ebbc8d87c2cf', 'request_id': 'req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.814361 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca425862fb14ceaba03ebbc8d87c2cf', 'request_id': 'req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.826824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] The token cache is being invalidate because project 2ca425862fb14ceaba03ebbc8d87c2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:33:33.827115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.827773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-91ccc6b7-48e9-4016-b7ca-55d0ea7ddd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:33.829500 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4291/8584] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:33:33 2022] DELETE /identity/v3/projects/2ca425862fb14ceaba03ebbc8d87c2cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:43.373735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84d30-1155-42d4-98c2-e1f9dad8fd42 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.374304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84d30-1155-42d4-98c2-e1f9dad8fd42 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.374304 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84d30-1155-42d4-98c2-e1f9dad8fd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.394432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-dec84d30-1155-42d4-98c2-e1f9dad8fd42 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:43.395641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dec84d30-1155-42d4-98c2-e1f9dad8fd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:43.453084 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4294/8585] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:33:43.462427 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e4ca6-bab1-44e9-944e-f657c7a538b6 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.462984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e4ca6-bab1-44e9-944e-f657c7a538b6 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.462984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e4ca6-bab1-44e9-944e-f657c7a538b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.480834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-240e4ca6-bab1-44e9-944e-f657c7a538b6 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:43.482015 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-240e4ca6-bab1-44e9-944e-f657c7a538b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:43.489784 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4292/8586] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:33:43.495012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec84d30-1155-42d4-98c2-e1f9dad8fd42 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:43.504506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec84d30-1155-42d4-98c2-e1f9dad8fd42 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:43.509705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:43.510353 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.510634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.510912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.511626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:33:43.511931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:43.513558 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:43.525174 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4295/8587] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:33:43.537802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e4ca6-bab1-44e9-944e-f657c7a538b6 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:43.547053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e4ca6-bab1-44e9-944e-f657c7a538b6 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:43.551737 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e48c2-6c27-4759-92fe-4b49b1bf32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:43.552409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e48c2-6c27-4759-92fe-4b49b1bf32e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.552721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e48c2-6c27-4759-92fe-4b49b1bf32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.553002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e48c2-6c27-4759-92fe-4b49b1bf32e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.553720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e48c2-6c27-4759-92fe-4b49b1bf32e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:43.556108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e48c2-6c27-4759-92fe-4b49b1bf32e9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:43.583289 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4293/8588] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:33:43 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:33:43.585886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:43.596082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dad88-e633-4743-b4d9-94af5cef607a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:43.651754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd7b0-a98e-4dcc-88d0-6d916c25841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:43.652523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd7b0-a98e-4dcc-88d0-6d916c25841a admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.652808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd7b0-a98e-4dcc-88d0-6d916c25841a admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.653085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd7b0-a98e-4dcc-88d0-6d916c25841a admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.653782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddd7b0-a98e-4dcc-88d0-6d916c25841a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:43.655677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddd7b0-a98e-4dcc-88d0-6d916c25841a admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:43.678242 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4296/8589] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:33:43 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:33:43.679387 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e48c2-6c27-4759-92fe-4b49b1bf32e9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:43.690147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e48c2-6c27-4759-92fe-4b49b1bf32e9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:43.694735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6d2b2-4ac2-4dbf-bc6b-af148f42f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:43.695420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6d2b2-4ac2-4dbf-bc6b-af148f42f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.695710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6d2b2-4ac2-4dbf-bc6b-af148f42f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.695992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6d2b2-4ac2-4dbf-bc6b-af148f42f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.696742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6d2b2-4ac2-4dbf-bc6b-af148f42f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:43.698340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6d2b2-4ac2-4dbf-bc6b-af148f42f4c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:43.710246 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4294/8590] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:33:43.714268 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd7b0-a98e-4dcc-88d0-6d916c25841a admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:43.724240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd7b0-a98e-4dcc-88d0-6d916c25841a admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:43.730795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675f60-e885-4e4f-b5af-d3366b7c7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:43.731472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675f60-e885-4e4f-b5af-d3366b7c7c20 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.731758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675f60-e885-4e4f-b5af-d3366b7c7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.732039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675f60-e885-4e4f-b5af-d3366b7c7c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.732814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0675f60-e885-4e4f-b5af-d3366b7c7c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:43.734438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0675f60-e885-4e4f-b5af-d3366b7c7c20 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:43.745317 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4297/8591] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:33:43.749451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6d2b2-4ac2-4dbf-bc6b-af148f42f4c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:43.759673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6d2b2-4ac2-4dbf-bc6b-af148f42f4c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:43.764445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a1a1c-77e7-49ad-a477-7bc1404ee126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:43.765307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a1a1c-77e7-49ad-a477-7bc1404ee126 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.765592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a1a1c-77e7-49ad-a477-7bc1404ee126 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.765882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a1a1c-77e7-49ad-a477-7bc1404ee126 admin admin] PATH_INFO: `/v3/projects/f8a13e8c6ae549eba718354fd84a93bf/users/d62343fbfc5f410da668e6547ce9b57e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.780230 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a1a1c-77e7-49ad-a477-7bc1404ee126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a13e8c6ae549eba718354fd84a93bf, user_id=d62343fbfc5f410da668e6547ce9b57e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:43.782935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a1a1c-77e7-49ad-a477-7bc1404ee126 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:43.797697 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4295/8592] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:33:43 2022] PUT /identity/v3/projects/f8a13e8c6ae549eba718354fd84a93bf/users/d62343fbfc5f410da668e6547ce9b57e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:43.811404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471c8d-ce04-4365-9b07-175b612c3a29 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.811696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471c8d-ce04-4365-9b07-175b612c3a29 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.811977 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471c8d-ce04-4365-9b07-175b612c3a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.844480 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f3471c8d-ce04-4365-9b07-175b612c3a29 None None] MFA Rules not processed for user `d62343fbfc5f410da668e6547ce9b57e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:43.845697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f3471c8d-ce04-4365-9b07-175b612c3a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:43.909020 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4298/8593] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:33:43.913442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a1a1c-77e7-49ad-a477-7bc1404ee126 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:43.973824 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a1a1c-77e7-49ad-a477-7bc1404ee126 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:43.979064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038d362-924d-490c-ada8-f5ed795cbdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:43.979772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038d362-924d-490c-ada8-f5ed795cbdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:43.980058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038d362-924d-490c-ada8-f5ed795cbdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:43.980349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038d362-924d-490c-ada8-f5ed795cbdd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:43.981068 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038d362-924d-490c-ada8-f5ed795cbdd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:43.982965 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038d362-924d-490c-ada8-f5ed795cbdd9 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:44.008644 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4296/8594] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:33:43 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:33:44.012760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3471c8d-ce04-4365-9b07-175b612c3a29 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:44.023903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3471c8d-ce04-4365-9b07-175b612c3a29 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:44.080815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857c6d8-9be2-498c-bf32-c72795a6b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:44.081487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c6d8-9be2-498c-bf32-c72795a6b1fc admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:44.081775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c6d8-9be2-498c-bf32-c72795a6b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:44.082056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c6d8-9be2-498c-bf32-c72795a6b1fc admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:44.082754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857c6d8-9be2-498c-bf32-c72795a6b1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:44.084703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857c6d8-9be2-498c-bf32-c72795a6b1fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:44.104849 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4299/8595] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:33:44 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:33:44.108879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038d362-924d-490c-ada8-f5ed795cbdd9 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:44.119118 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038d362-924d-490c-ada8-f5ed795cbdd9 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:44.123822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acd80d-bacf-42f0-a2de-041b9aba0671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:44.124519 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acd80d-bacf-42f0-a2de-041b9aba0671 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:44.124808 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acd80d-bacf-42f0-a2de-041b9aba0671 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:44.125091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acd80d-bacf-42f0-a2de-041b9aba0671 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:44.125811 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acd80d-bacf-42f0-a2de-041b9aba0671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:44.127516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acd80d-bacf-42f0-a2de-041b9aba0671 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:44.139615 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4297/8596] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:33:44.144098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857c6d8-9be2-498c-bf32-c72795a6b1fc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:44.155251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857c6d8-9be2-498c-bf32-c72795a6b1fc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:44.160043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07b9ae-6286-4dbb-bc3c-9a811fe19af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:44.160904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07b9ae-6286-4dbb-bc3c-9a811fe19af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:44.161189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07b9ae-6286-4dbb-bc3c-9a811fe19af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:44.161464 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07b9ae-6286-4dbb-bc3c-9a811fe19af8 admin admin] PATH_INFO: `/v3/projects/94ba2437855d4d92b40557b165483e95/users/3e10a99da55a450593fb7bcd4f66ef78/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:44.176653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07b9ae-6286-4dbb-bc3c-9a811fe19af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ba2437855d4d92b40557b165483e95, user_id=3e10a99da55a450593fb7bcd4f66ef78, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:44.179298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07b9ae-6286-4dbb-bc3c-9a811fe19af8 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:44.191688 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4300/8597] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:33:44 2022] PUT /identity/v3/projects/94ba2437855d4d92b40557b165483e95/users/3e10a99da55a450593fb7bcd4f66ef78/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:33:44.195658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acd80d-bacf-42f0-a2de-041b9aba0671 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:44.205933 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acd80d-bacf-42f0-a2de-041b9aba0671 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:44.259810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8607dc-1add-4d08-8070-73b3647369c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:44.260567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8607dc-1add-4d08-8070-73b3647369c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:44.260862 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8607dc-1add-4d08-8070-73b3647369c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:44.261122 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8607dc-1add-4d08-8070-73b3647369c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:44.261823 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8607dc-1add-4d08-8070-73b3647369c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:44.263395 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8607dc-1add-4d08-8070-73b3647369c6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:44.272888 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4298/8598] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:33:44.277580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07b9ae-6286-4dbb-bc3c-9a811fe19af8 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:44.287621 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07b9ae-6286-4dbb-bc3c-9a811fe19af8 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:44.292899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298557f-1f2c-4c99-b12d-debae0fbb70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:44.293774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298557f-1f2c-4c99-b12d-debae0fbb70b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:44.294056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298557f-1f2c-4c99-b12d-debae0fbb70b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:44.294330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298557f-1f2c-4c99-b12d-debae0fbb70b admin admin] PATH_INFO: `/v3/projects/94ba2437855d4d92b40557b165483e95/users/3e10a99da55a450593fb7bcd4f66ef78/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:44.296283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298557f-1f2c-4c99-b12d-debae0fbb70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ba2437855d4d92b40557b165483e95, user_id=3e10a99da55a450593fb7bcd4f66ef78, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:44.298933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298557f-1f2c-4c99-b12d-debae0fbb70b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:44.309020 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4301/8599] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:33:44 2022] PUT /identity/v3/projects/94ba2437855d4d92b40557b165483e95/users/3e10a99da55a450593fb7bcd4f66ef78/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:44.319030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c06d-6fa4-449f-af01-a9a8b7692c1b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:44.319317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c06d-6fa4-449f-af01-a9a8b7692c1b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:44.319595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c06d-6fa4-449f-af01-a9a8b7692c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:44.345912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c859c06d-6fa4-449f-af01-a9a8b7692c1b None None] MFA Rules not processed for user `3e10a99da55a450593fb7bcd4f66ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:44.347105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c859c06d-6fa4-449f-af01-a9a8b7692c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:44.412315 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4299/8600] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:33:44.424144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b723-7470-4fe6-b43c-bc6ea592d2c2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:44.424667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b723-7470-4fe6-b43c-bc6ea592d2c2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:44.424765 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b723-7470-4fe6-b43c-bc6ea592d2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:44.442116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6470b723-7470-4fe6-b43c-bc6ea592d2c2 None None] MFA Rules not processed for user `d62343fbfc5f410da668e6547ce9b57e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:44.443311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6470b723-7470-4fe6-b43c-bc6ea592d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:44.496473 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4302/8601] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:33:44.507704 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c06d-6fa4-449f-af01-a9a8b7692c1b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:44.509699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c859c06d-6fa4-449f-af01-a9a8b7692c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:44.582781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c06d-6fa4-449f-af01-a9a8b7692c1b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:44.589038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:44.589676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:44.589956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:44.590228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:44.598020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:44.599582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:44.608236 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4300/8602] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:33:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:33:45.416742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b723-7470-4fe6-b43c-bc6ea592d2c2 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:45.418133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6470b723-7470-4fe6-b43c-bc6ea592d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:45.504748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b723-7470-4fe6-b43c-bc6ea592d2c2 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:45.510745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:45.511411 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:45.511698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:45.511979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:45.513851 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:45.528680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:45.530277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:45.542875 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4303/8603] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:33:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:33:46.844198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:46.845645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:46.864734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19f7e-ef70-43d1-9e27-eb883e5aaf4e service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:46.870879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643d37e-2d44-41c4-b61d-c4bb13155005 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:46.871540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643d37e-2d44-41c4-b61d-c4bb13155005 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:46.871825 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643d37e-2d44-41c4-b61d-c4bb13155005 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:46.872102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643d37e-2d44-41c4-b61d-c4bb13155005 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:46.885613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a643d37e-2d44-41c4-b61d-c4bb13155005 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:46.901353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643d37e-2d44-41c4-b61d-c4bb13155005 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:46.902970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643d37e-2d44-41c4-b61d-c4bb13155005 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:46.918476 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4301/8604] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:33:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:33:54.354939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:54.369471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4ff2b-2c3c-470d-9f4f-fe9bf518c950 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:54.375040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:54.375673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:54.375958 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:54.376237 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:54.384861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:54.386429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:54.395949 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4304/8605] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:33:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:33:54.409935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc75ae-62c7-4fde-b140-4d943934484e None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:54.410396 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc75ae-62c7-4fde-b140-4d943934484e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:54.410509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc75ae-62c7-4fde-b140-4d943934484e None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:54.412388 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4302/8606] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:33:54.416992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 21:33:54.430396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:54.438676 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dd2b7-887b-4530-b01f-a94499f12360 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:54.443520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e10a99da55a450593fb7bcd4f66ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ba2437855d4d92b40557b165483e95', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:54.444394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:54.444686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:54.444974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] PATH_INFO: `/v3/projects/94ba2437855d4d92b40557b165483e95` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:54.446682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] RBAC: Authorizing `identity:get_project(project_id=94ba2437855d4d92b40557b165483e95)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:54.448501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:54.450514 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4305/8607] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 21:33:54 2022] GET /identity/v3/projects/94ba2437855d4d92b40557b165483e95 => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 19 21:33:54.727684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cd9e7-0d1c-4aee-8a80-a0e971380d5a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:54.727993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cd9e7-0d1c-4aee-8a80-a0e971380d5a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:54.728267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cd9e7-0d1c-4aee-8a80-a0e971380d5a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:54.730125 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4303/8608] 10.222.0.30 () {54 vars in 912 bytes} [Sat Feb 19 21:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:33:54.734854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Authenticating service token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Feb 19 21:33:54.736711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:54.755449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:54.764855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525b80-3e35-46d5-895c-5b5826d0480f tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:54.769565 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a60e9-b018-44b3-9535-136030f95ee9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e10a99da55a450593fb7bcd4f66ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ba2437855d4d92b40557b165483e95', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:54.770415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a60e9-b018-44b3-9535-136030f95ee9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:54.770695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a60e9-b018-44b3-9535-136030f95ee9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:54.770972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a60e9-b018-44b3-9535-136030f95ee9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] PATH_INFO: `/v3/projects/94ba2437855d4d92b40557b165483e95` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:54.772150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a60e9-b018-44b3-9535-136030f95ee9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] RBAC: Authorizing `identity:get_project(project_id=94ba2437855d4d92b40557b165483e95)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:54.773992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a60e9-b018-44b3-9535-136030f95ee9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:54.775698 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4306/8609] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Feb 19 21:33:54 2022] GET /identity/v3/projects/94ba2437855d4d92b40557b165483e95 => generated 393 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:33:57.783271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cd9e7-0d1c-4aee-8a80-a0e971380d5a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:57.847109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cd9e7-0d1c-4aee-8a80-a0e971380d5a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:57.851603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:57.853003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:57.853285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:57.853560 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] PATH_INFO: `/v3/users/d62343fbfc5f410da668e6547ce9b57e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:57.854762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d62343fbfc5f410da668e6547ce9b57e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:57.856718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:57.901199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd62343fbfc5f410da668e6547ce9b57e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:57.901794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd62343fbfc5f410da668e6547ce9b57e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:57.902422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd62343fbfc5f410da668e6547ce9b57e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:57.913610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd62343fbfc5f410da668e6547ce9b57e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:57.920905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd62343fbfc5f410da668e6547ce9b57e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:57.933645 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4304/8610] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:33:57 2022] DELETE /identity/v3/users/d62343fbfc5f410da668e6547ce9b57e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:57.938152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760990-480b-4598-9fbe-d35d9e794060 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:57.938646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760990-480b-4598-9fbe-d35d9e794060 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:57.938755 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760990-480b-4598-9fbe-d35d9e794060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:57.956145 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-74760990-480b-4598-9fbe-d35d9e794060 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:57.957384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-74760990-480b-4598-9fbe-d35d9e794060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:58.014587 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4307/8611] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:33:58.024840 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:58.026276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:58.084202 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6aa05-a632-4d3a-b3c0-01efc52fc943 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:58.087908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce535c73-a71c-4856-a4f5-e247048bde41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:58.088581 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535c73-a71c-4856-a4f5-e247048bde41 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:58.088867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535c73-a71c-4856-a4f5-e247048bde41 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:58.089146 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535c73-a71c-4856-a4f5-e247048bde41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:58.098191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce535c73-a71c-4856-a4f5-e247048bde41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:58.099614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce535c73-a71c-4856-a4f5-e247048bde41 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:58.109622 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4305/8612] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:33:58.271466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74760990-480b-4598-9fbe-d35d9e794060 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:58.272922 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-74760990-480b-4598-9fbe-d35d9e794060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:58.285510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74760990-480b-4598-9fbe-d35d9e794060 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:58.291054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:58.291907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:58.292198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:58.292513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] PATH_INFO: `/v3/projects/f8a13e8c6ae549eba718354fd84a93bf` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:58.293840 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a13e8c6ae549eba718354fd84a93bf)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:58.295784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:58.342803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a13e8c6ae549eba718354fd84a93bf', 'request_id': 'req-e2f4743d-645a-41be-b73b-1df4c3463c8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.348063 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a13e8c6ae549eba718354fd84a93bf', 'request_id': 'req-e2f4743d-645a-41be-b73b-1df4c3463c8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.355656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a13e8c6ae549eba718354fd84a93bf', 'request_id': 'req-e2f4743d-645a-41be-b73b-1df4c3463c8d'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.366543 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] The token cache is being invalidate because project f8a13e8c6ae549eba718354fd84a93bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:33:58.366836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.367514 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.369106 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4308/8613] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:33:58 2022] DELETE /identity/v3/projects/f8a13e8c6ae549eba718354fd84a93bf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:58.373112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce535c73-a71c-4856-a4f5-e247048bde41 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:58.382633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce535c73-a71c-4856-a4f5-e247048bde41 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:58.437088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:58.437946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:58.438225 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:58.438502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] PATH_INFO: `/v3/users/3e10a99da55a450593fb7bcd4f66ef78` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:58.439721 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e10a99da55a450593fb7bcd4f66ef78)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:58.441637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:58.489030 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e10a99da55a450593fb7bcd4f66ef78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.489604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e10a99da55a450593fb7bcd4f66ef78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.490201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e10a99da55a450593fb7bcd4f66ef78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.501688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e10a99da55a450593fb7bcd4f66ef78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.508636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-f8e30e57-80a0-4639-ba2b-16b32b79c125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e10a99da55a450593fb7bcd4f66ef78'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.520252 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4306/8614] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:33:58 2022] DELETE /identity/v3/users/3e10a99da55a450593fb7bcd4f66ef78 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:58.789587 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:58.791025 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:58.803951 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4743d-645a-41be-b73b-1df4c3463c8d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:58.860601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:58.861478 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:58.861759 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:58.862038 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] PATH_INFO: `/v3/projects/94ba2437855d4d92b40557b165483e95` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:58.863248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ba2437855d4d92b40557b165483e95)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:58.865254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:58.910030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ba2437855d4d92b40557b165483e95', 'request_id': 'req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.915213 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ba2437855d4d92b40557b165483e95', 'request_id': 'req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.922299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ba2437855d4d92b40557b165483e95', 'request_id': 'req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.933058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] The token cache is being invalidate because project 94ba2437855d4d92b40557b165483e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:33:58.933358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.933975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-0d9ef7e7-bb20-4178-91ca-fd8e8b1b2df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:33:58.935535 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4309/8615] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:33:58 2022] DELETE /identity/v3/projects/94ba2437855d4d92b40557b165483e95 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:58.941528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66b45-ae7e-4e17-9a5c-1567f85ca79c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:58.942012 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66b45-ae7e-4e17-9a5c-1567f85ca79c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:58.942110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66b45-ae7e-4e17-9a5c-1567f85ca79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:58.960206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4bf66b45-ae7e-4e17-9a5c-1567f85ca79c None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:58.962163 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4bf66b45-ae7e-4e17-9a5c-1567f85ca79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:59.019765 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4307/8616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:33:59.027722 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df470-3114-4640-8a93-7e79d066b81d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.028174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df470-3114-4640-8a93-7e79d066b81d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.028271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df470-3114-4640-8a93-7e79d066b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.047368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7c2df470-3114-4640-8a93-7e79d066b81d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:59.048622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7c2df470-3114-4640-8a93-7e79d066b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:59.057990 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4310/8617] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:33:59.062179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66b45-ae7e-4e17-9a5c-1567f85ca79c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:59.072460 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66b45-ae7e-4e17-9a5c-1567f85ca79c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:59.077336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:59.077981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.078262 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.078536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.079243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:33:59.079547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:59.081180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:59.092509 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4308/8618] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:33:59.096834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2df470-3114-4640-8a93-7e79d066b81d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:59.106106 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2df470-3114-4640-8a93-7e79d066b81d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:59.110728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f546733-2fe3-4a34-8285-17c2c326acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:59.111377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f546733-2fe3-4a34-8285-17c2c326acf7 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.111659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f546733-2fe3-4a34-8285-17c2c326acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.111935 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f546733-2fe3-4a34-8285-17c2c326acf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.112769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f546733-2fe3-4a34-8285-17c2c326acf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:59.114670 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f546733-2fe3-4a34-8285-17c2c326acf7 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:59.140901 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4311/8619] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:33:59 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:33:59.144714 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:59.154492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53be0d-26ee-4adb-8c90-24af1bc69d35 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:59.208569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941846-3f8a-4631-888e-60dfc1921340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:59.209229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941846-3f8a-4631-888e-60dfc1921340 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.209509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941846-3f8a-4631-888e-60dfc1921340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.209785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941846-3f8a-4631-888e-60dfc1921340 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.210471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941846-3f8a-4631-888e-60dfc1921340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:59.212452 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941846-3f8a-4631-888e-60dfc1921340 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:59.231401 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4309/8620] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:33:59 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:33:59.235446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f546733-2fe3-4a34-8285-17c2c326acf7 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:59.247677 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f546733-2fe3-4a34-8285-17c2c326acf7 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:59.252359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d834695-ba6d-4908-8683-5425d64f15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:59.253032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d834695-ba6d-4908-8683-5425d64f15c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.253318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d834695-ba6d-4908-8683-5425d64f15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.253598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d834695-ba6d-4908-8683-5425d64f15c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.254316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d834695-ba6d-4908-8683-5425d64f15c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:59.255903 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d834695-ba6d-4908-8683-5425d64f15c6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:59.267114 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4312/8621] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:33:59.271179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941846-3f8a-4631-888e-60dfc1921340 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:59.281096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941846-3f8a-4631-888e-60dfc1921340 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:59.285786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a9e45-1e43-4cbb-81a8-7121c16bb6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:59.286433 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9e45-1e43-4cbb-81a8-7121c16bb6ee admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.286715 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9e45-1e43-4cbb-81a8-7121c16bb6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.286996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9e45-1e43-4cbb-81a8-7121c16bb6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.287713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a9e45-1e43-4cbb-81a8-7121c16bb6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:59.289322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a9e45-1e43-4cbb-81a8-7121c16bb6ee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:59.299326 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4310/8622] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:33:59.303551 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d834695-ba6d-4908-8683-5425d64f15c6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:59.313992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d834695-ba6d-4908-8683-5425d64f15c6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:59.318832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:59.319704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.319989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.320318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] PATH_INFO: `/v3/projects/456ee08e460d4b61a0db66627b1aaa91/users/526c1165def845fbb5d29610983f6da2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.335779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=456ee08e460d4b61a0db66627b1aaa91, user_id=526c1165def845fbb5d29610983f6da2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:59.338503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:59.351174 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4313/8623] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:33:59 2022] PUT /identity/v3/projects/456ee08e460d4b61a0db66627b1aaa91/users/526c1165def845fbb5d29610983f6da2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:33:59.356773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630cbfe-8db7-4f08-a48d-36e124647f17 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.357078 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630cbfe-8db7-4f08-a48d-36e124647f17 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.357383 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630cbfe-8db7-4f08-a48d-36e124647f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.376873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-3630cbfe-8db7-4f08-a48d-36e124647f17 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:33:59.378070 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-3630cbfe-8db7-4f08-a48d-36e124647f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:59.436360 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4311/8624] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:33:59.445969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:33:59.447598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:33:59.505612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba180816-d39a-47b2-81d7-584fc4a73daa admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:33:59.509423 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8790b92-cd9b-4df0-b96b-a27d423d8eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:33:59.510060 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8790b92-cd9b-4df0-b96b-a27d423d8eff service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:33:59.510344 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8790b92-cd9b-4df0-b96b-a27d423d8eff service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:33:59.510641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8790b92-cd9b-4df0-b96b-a27d423d8eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:33:59.519737 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8790b92-cd9b-4df0-b96b-a27d423d8eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:33:59.521181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8790b92-cd9b-4df0-b96b-a27d423d8eff service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:33:59.530506 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4314/8625] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:34:00.142890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18b2d-7b3d-4f68-a21c-d0de41f8cfb7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:00.143447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18b2d-7b3d-4f68-a21c-d0de41f8cfb7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:00.143447 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18b2d-7b3d-4f68-a21c-d0de41f8cfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:00.171369 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f1a18b2d-7b3d-4f68-a21c-d0de41f8cfb7 None None] MFA Rules not processed for user `526c1165def845fbb5d29610983f6da2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:34:00.172779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f1a18b2d-7b3d-4f68-a21c-d0de41f8cfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:00.238157 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4312/8626] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:34:00.249933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293bec6-466d-4e7d-93ea-cca340e5d7be None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:00.250437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293bec6-466d-4e7d-93ea-cca340e5d7be None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:00.250695 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293bec6-466d-4e7d-93ea-cca340e5d7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:00.268452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7293bec6-466d-4e7d-93ea-cca340e5d7be None None] MFA Rules not processed for user `526c1165def845fbb5d29610983f6da2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:34:00.269777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7293bec6-466d-4e7d-93ea-cca340e5d7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:00.277199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4315/8627] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:34:00.289549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a18b2d-7b3d-4f68-a21c-d0de41f8cfb7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:00.290980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f1a18b2d-7b3d-4f68-a21c-d0de41f8cfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:00.366887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a18b2d-7b3d-4f68-a21c-d0de41f8cfb7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:00.372365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf79656-c1af-42d0-b15b-ea6a9780859a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:00.373013 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79656-c1af-42d0-b15b-ea6a9780859a service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:00.373295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79656-c1af-42d0-b15b-ea6a9780859a service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:00.373569 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79656-c1af-42d0-b15b-ea6a9780859a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:00.381108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf79656-c1af-42d0-b15b-ea6a9780859a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:00.382685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf79656-c1af-42d0-b15b-ea6a9780859a service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:00.391901 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4313/8628] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:34:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:34:11.761904 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293bec6-466d-4e7d-93ea-cca340e5d7be None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:11.774162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293bec6-466d-4e7d-93ea-cca340e5d7be None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:11.777770 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcef96-5340-4df8-b145-0e4fdfd569b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:11.778413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcef96-5340-4df8-b145-0e4fdfd569b2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:11.778701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcef96-5340-4df8-b145-0e4fdfd569b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:11.778974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcef96-5340-4df8-b145-0e4fdfd569b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:11.780827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-22bcef96-5340-4df8-b145-0e4fdfd569b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:11.793419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcef96-5340-4df8-b145-0e4fdfd569b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:11.794919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcef96-5340-4df8-b145-0e4fdfd569b2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:11.806338 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4316/8629] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:34:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:34:11.900084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0776-35ed-4637-8d78-a59872e778f4 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:11.900641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0776-35ed-4637-8d78-a59872e778f4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:11.900641 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0776-35ed-4637-8d78-a59872e778f4 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:11.902457 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4314/8630] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:34:11.907290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9dfb8-4a2a-4666-86fb-7ed3e724e27c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:11.907603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9dfb8-4a2a-4666-86fb-7ed3e724e27c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:11.907888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9dfb8-4a2a-4666-86fb-7ed3e724e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:11.944406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3ee9dfb8-4a2a-4666-86fb-7ed3e724e27c None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:34:11.945689 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ee9dfb8-4a2a-4666-86fb-7ed3e724e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:12.007672 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4317/8631] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:34:12.028257 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0776-35ed-4637-8d78-a59872e778f4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:12.029964 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1eab0776-35ed-4637-8d78-a59872e778f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:12.049508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0776-35ed-4637-8d78-a59872e778f4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:12.054444 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279b920-724c-422d-9d39-1b7e2a9c3f9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:12.055065 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279b920-724c-422d-9d39-1b7e2a9c3f9a service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:12.055345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279b920-724c-422d-9d39-1b7e2a9c3f9a service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:12.055621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279b920-724c-422d-9d39-1b7e2a9c3f9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:12.063686 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279b920-724c-422d-9d39-1b7e2a9c3f9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:12.065270 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279b920-724c-422d-9d39-1b7e2a9c3f9a service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:12.075020 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4315/8632] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:34:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:34:12.229502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9dfb8-4a2a-4666-86fb-7ed3e724e27c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:12.230967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3ee9dfb8-4a2a-4666-86fb-7ed3e724e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:12.244884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9dfb8-4a2a-4666-86fb-7ed3e724e27c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:12.248576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:12.249228 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:12.249513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:12.249790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:12.251548 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:12.267969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:12.269352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:12.283128 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4318/8633] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:34:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:34:48.560830 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279b920-724c-422d-9d39-1b7e2a9c3f9a service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:48.574441 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279b920-724c-422d-9d39-1b7e2a9c3f9a service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:48.579059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:48.579894 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:48.580166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:48.580476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] PATH_INFO: `/v3/users/526c1165def845fbb5d29610983f6da2` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:48.581651 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=526c1165def845fbb5d29610983f6da2)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:48.583583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:48.629598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526c1165def845fbb5d29610983f6da2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.630236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526c1165def845fbb5d29610983f6da2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.630834 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526c1165def845fbb5d29610983f6da2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.642674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526c1165def845fbb5d29610983f6da2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.649876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8175f7f7-bbca-4bea-9594-033122b32b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526c1165def845fbb5d29610983f6da2'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.662850 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4316/8634] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:34:48 2022] DELETE /identity/v3/users/526c1165def845fbb5d29610983f6da2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:34:48.838195 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:48.852305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1929e-d177-4e4d-9a08-7a3ad1e292a7 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:48.909555 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:48.910418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:48.910694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:48.910964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] PATH_INFO: `/v3/projects/456ee08e460d4b61a0db66627b1aaa91` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:48.912130 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=456ee08e460d4b61a0db66627b1aaa91)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:48.914041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:48.959493 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456ee08e460d4b61a0db66627b1aaa91', 'request_id': 'req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.965530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456ee08e460d4b61a0db66627b1aaa91', 'request_id': 'req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.973873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456ee08e460d4b61a0db66627b1aaa91', 'request_id': 'req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.985030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] The token cache is being invalidate because project 456ee08e460d4b61a0db66627b1aaa91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:34:48.985320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.985952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-f1d82f99-b12d-4ba9-8e56-f4c4e9febb24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:34:48.987521 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4319/8635] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:34:48 2022] DELETE /identity/v3/projects/456ee08e460d4b61a0db66627b1aaa91 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:34:48.992653 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f1c91-d531-42a2-ac4d-c0577b395db0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:48.992940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f1c91-d531-42a2-ac4d-c0577b395db0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:48.993217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f1c91-d531-42a2-ac4d-c0577b395db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.011096 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-c36f1c91-d531-42a2-ac4d-c0577b395db0 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:34:49.012366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-c36f1c91-d531-42a2-ac4d-c0577b395db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:49.068577 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4317/8636] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:34:49.077500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18135b82-6ccb-4179-b4a6-30747d2a638d None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.077783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18135b82-6ccb-4179-b4a6-30747d2a638d None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.078095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18135b82-6ccb-4179-b4a6-30747d2a638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.099332 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-18135b82-6ccb-4179-b4a6-30747d2a638d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:34:49.100628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-18135b82-6ccb-4179-b4a6-30747d2a638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:49.108818 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4320/8637] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:34:49.113199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f1c91-d531-42a2-ac4d-c0577b395db0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:49.123280 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f1c91-d531-42a2-ac4d-c0577b395db0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:49.127865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:49.128546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.128826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.129099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.129835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:34:49.130277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:49.131857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:49.143669 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4318/8638] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:34:49.147849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18135b82-6ccb-4179-b4a6-30747d2a638d None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:49.157166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18135b82-6ccb-4179-b4a6-30747d2a638d None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:49.161859 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea840-0873-4a2c-8d05-f06d75e27ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:49.162502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea840-0873-4a2c-8d05-f06d75e27ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.162791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea840-0873-4a2c-8d05-f06d75e27ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.163064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea840-0873-4a2c-8d05-f06d75e27ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.163740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea840-0873-4a2c-8d05-f06d75e27ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:49.165664 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea840-0873-4a2c-8d05-f06d75e27ab3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:49.190619 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4321/8639] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:34:49 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:34:49.194703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:49.205577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6daefd-d76e-4b47-9f71-f721ad492909 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:49.259577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e0803-4f80-437a-ab82-5bb054fd276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:49.260877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e0803-4f80-437a-ab82-5bb054fd276b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.261161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e0803-4f80-437a-ab82-5bb054fd276b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.261440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e0803-4f80-437a-ab82-5bb054fd276b admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.262121 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e0803-4f80-437a-ab82-5bb054fd276b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:49.264076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e0803-4f80-437a-ab82-5bb054fd276b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:49.285897 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4319/8640] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:34:49 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:34:49.287309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea840-0873-4a2c-8d05-f06d75e27ab3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:49.297671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea840-0873-4a2c-8d05-f06d75e27ab3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:49.302225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725633d-5edb-41ce-97fe-e3b794a519c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:49.302877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725633d-5edb-41ce-97fe-e3b794a519c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.303159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725633d-5edb-41ce-97fe-e3b794a519c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.303437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725633d-5edb-41ce-97fe-e3b794a519c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.304182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725633d-5edb-41ce-97fe-e3b794a519c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:49.305835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725633d-5edb-41ce-97fe-e3b794a519c2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:49.318356 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4322/8641] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:34:49.322188 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e0803-4f80-437a-ab82-5bb054fd276b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:49.333010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e0803-4f80-437a-ab82-5bb054fd276b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:49.337567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf94909-82e8-428d-8c0a-433883f1dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:49.338572 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94909-82e8-428d-8c0a-433883f1dcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.338872 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94909-82e8-428d-8c0a-433883f1dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.339151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94909-82e8-428d-8c0a-433883f1dcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.339863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf94909-82e8-428d-8c0a-433883f1dcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:49.341500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf94909-82e8-428d-8c0a-433883f1dcd6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:49.351812 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4320/8642] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:34:49.355923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725633d-5edb-41ce-97fe-e3b794a519c2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:49.365738 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725633d-5edb-41ce-97fe-e3b794a519c2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:49.371040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:49.371909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.372192 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.372510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] PATH_INFO: `/v3/projects/6d4e54e969224337acfc6a178ca33422/users/dcbdf20935dc41a79864b7520ebc72cb/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.387342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4e54e969224337acfc6a178ca33422, user_id=dcbdf20935dc41a79864b7520ebc72cb, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:49.390030 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:49.402373 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4323/8643] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:34:49 2022] PUT /identity/v3/projects/6d4e54e969224337acfc6a178ca33422/users/dcbdf20935dc41a79864b7520ebc72cb/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:34:49.407719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbf1e-52a5-4764-b0d1-c92365b27345 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.408009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbf1e-52a5-4764-b0d1-c92365b27345 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.408293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbf1e-52a5-4764-b0d1-c92365b27345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.425803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-72fdbf1e-52a5-4764-b0d1-c92365b27345 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:34:49.427007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-72fdbf1e-52a5-4764-b0d1-c92365b27345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:49.484908 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4321/8644] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:34:49.495245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:49.497266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:49.554932 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df88a8-3156-4f1c-8024-39616664e580 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:49.559233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a40556-ddf1-4a4b-b26f-cf6ff5431b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:49.559877 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40556-ddf1-4a4b-b26f-cf6ff5431b6f service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:49.560162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40556-ddf1-4a4b-b26f-cf6ff5431b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:49.560479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40556-ddf1-4a4b-b26f-cf6ff5431b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:49.569405 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a40556-ddf1-4a4b-b26f-cf6ff5431b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:49.570820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a40556-ddf1-4a4b-b26f-cf6ff5431b6f service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:49.580477 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4324/8645] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:34:50.198021 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8037b-b1b6-48f2-9a4c-f94dcfb7a0c9 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:50.198555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8037b-b1b6-48f2-9a4c-f94dcfb7a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:50.198555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8037b-b1b6-48f2-9a4c-f94dcfb7a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:50.225962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4ce8037b-b1b6-48f2-9a4c-f94dcfb7a0c9 None None] MFA Rules not processed for user `dcbdf20935dc41a79864b7520ebc72cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:34:50.227358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4ce8037b-b1b6-48f2-9a4c-f94dcfb7a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:50.293884 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4322/8646] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:34:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:34:50.304711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d710-0ba9-4b4b-97f8-5518f26bd757 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:50.305692 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d710-0ba9-4b4b-97f8-5518f26bd757 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:50.305992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d710-0ba9-4b4b-97f8-5518f26bd757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:50.324267 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-60e0d710-0ba9-4b4b-97f8-5518f26bd757 None None] MFA Rules not processed for user `dcbdf20935dc41a79864b7520ebc72cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:34:50.325433 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-60e0d710-0ba9-4b4b-97f8-5518f26bd757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:50.333064 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4325/8647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:34:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:34:50.345939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8037b-b1b6-48f2-9a4c-f94dcfb7a0c9 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:50.347450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4ce8037b-b1b6-48f2-9a4c-f94dcfb7a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:50.426338 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8037b-b1b6-48f2-9a4c-f94dcfb7a0c9 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:50.431997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd358a3-ee73-4d01-acb6-e64dd2ebc088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:50.432675 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd358a3-ee73-4d01-acb6-e64dd2ebc088 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:50.432955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd358a3-ee73-4d01-acb6-e64dd2ebc088 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:50.433231 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd358a3-ee73-4d01-acb6-e64dd2ebc088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:50.440908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd358a3-ee73-4d01-acb6-e64dd2ebc088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:50.442482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd358a3-ee73-4d01-acb6-e64dd2ebc088 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:50.451931 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4323/8648] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:34:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:34:59.047398 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d710-0ba9-4b4b-97f8-5518f26bd757 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:34:59.048949 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-60e0d710-0ba9-4b4b-97f8-5518f26bd757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:59.067373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d710-0ba9-4b4b-97f8-5518f26bd757 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:34:59.073128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540ffe0-4103-40e9-bc86-04c7f13c0f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:34:59.074090 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ffe0-4103-40e9-bc86-04c7f13c0f60 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:34:59.074377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ffe0-4103-40e9-bc86-04c7f13c0f60 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:34:59.074651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ffe0-4103-40e9-bc86-04c7f13c0f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:34:59.076476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6540ffe0-4103-40e9-bc86-04c7f13c0f60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:34:59.092244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540ffe0-4103-40e9-bc86-04c7f13c0f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:34:59.093871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540ffe0-4103-40e9-bc86-04c7f13c0f60 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:34:59.108510 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4326/8649] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:34:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:35:02.641058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f798eb1-7bfb-4232-8ae4-775e62ca1e4b None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:35:02.641570 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f798eb1-7bfb-4232-8ae4-775e62ca1e4b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:35:02.641688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f798eb1-7bfb-4232-8ae4-775e62ca1e4b None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:35:02.643401 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4324/8650] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:35:02.648224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c9f6-f397-4de2-afd7-41b389e88f8a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:35:02.648729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c9f6-f397-4de2-afd7-41b389e88f8a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:35:02.648729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c9f6-f397-4de2-afd7-41b389e88f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:35:02.669253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1f92c9f6-f397-4de2-afd7-41b389e88f8a None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:35:02.670481 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1f92c9f6-f397-4de2-afd7-41b389e88f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:35:02.740350 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4327/8651] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:35:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:35:02.760944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f798eb1-7bfb-4232-8ae4-775e62ca1e4b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:35:02.762609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-8f798eb1-7bfb-4232-8ae4-775e62ca1e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:35:02.781838 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f798eb1-7bfb-4232-8ae4-775e62ca1e4b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:35:02.786822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091e5cb-4289-46d9-9fd4-cbd7f7d19b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:35:02.787457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091e5cb-4289-46d9-9fd4-cbd7f7d19b5c service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:35:02.787739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091e5cb-4289-46d9-9fd4-cbd7f7d19b5c service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:35:02.788014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091e5cb-4289-46d9-9fd4-cbd7f7d19b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:35:02.798038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091e5cb-4289-46d9-9fd4-cbd7f7d19b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:35:02.799944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091e5cb-4289-46d9-9fd4-cbd7f7d19b5c service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:35:02.811334 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4325/8652] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:35:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:35:36.871752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5d38-ca6d-4ab9-8912-a1e231dd5a93 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:35:36.872311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5d38-ca6d-4ab9-8912-a1e231dd5a93 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:35:36.872479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5d38-ca6d-4ab9-8912-a1e231dd5a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:35:36.890701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a34b5d38-ca6d-4ab9-8912-a1e231dd5a93 None None] MFA Rules not processed for user `dcbdf20935dc41a79864b7520ebc72cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:35:36.891807 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a34b5d38-ca6d-4ab9-8912-a1e231dd5a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:35:36.898677 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4328/8653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:35:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:35:47.229220 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9592c0-a4ab-4a0e-bb62-e0cba5d6d099 None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:35:47.229780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9592c0-a4ab-4a0e-bb62-e0cba5d6d099 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:35:47.229780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9592c0-a4ab-4a0e-bb62-e0cba5d6d099 None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:35:47.231577 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4326/8654] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 21:35:47.236610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c653a-a31c-47a8-a4f8-5e68d74386d7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:35:47.237069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c653a-a31c-47a8-a4f8-5e68d74386d7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:35:47.237188 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c653a-a31c-47a8-a4f8-5e68d74386d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:35:47.265424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a27c653a-a31c-47a8-a4f8-5e68d74386d7 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:35:47.266651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a27c653a-a31c-47a8-a4f8-5e68d74386d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:35:47.276175 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4329/8655] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:35:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:35:47.296216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9592c0-a4ab-4a0e-bb62-e0cba5d6d099 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:35:47.297904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6b9592c0-a4ab-4a0e-bb62-e0cba5d6d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:35:47.317472 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9592c0-a4ab-4a0e-bb62-e0cba5d6d099 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:35:47.323192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524db9-a880-48be-921a-ce9818551671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:35:47.323821 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524db9-a880-48be-921a-ce9818551671 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:35:47.324102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524db9-a880-48be-921a-ce9818551671 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:35:47.324436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524db9-a880-48be-921a-ce9818551671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:35:47.332599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e524db9-a880-48be-921a-ce9818551671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:35:47.334161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e524db9-a880-48be-921a-ce9818551671 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:35:47.344358 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4327/8656] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:35:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:36:01.220919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c653a-a31c-47a8-a4f8-5e68d74386d7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:01.222317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a27c653a-a31c-47a8-a4f8-5e68d74386d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:01.236614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c653a-a31c-47a8-a4f8-5e68d74386d7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:01.240181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:01.240856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:01.241140 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:01.241418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:01.243137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:01.258570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:01.260035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:01.273324 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4330/8657] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:36:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:36:02.445939 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524db9-a880-48be-921a-ce9818551671 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:02.457883 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524db9-a880-48be-921a-ce9818551671 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:02.461497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:02.462125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:02.462406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:02.462681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:02.464507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:02.480507 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:02.481963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:02.495836 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4328/8658] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:36:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:36:25.463193 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:25.473733 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10fb58-177b-4880-afa7-c4a5bddd9c41 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:25.478338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:25.479929 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:25.480204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:25.480520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] PATH_INFO: `/v3/users/dcbdf20935dc41a79864b7520ebc72cb` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:25.481708 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbdf20935dc41a79864b7520ebc72cb)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:25.483616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:25.529855 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbdf20935dc41a79864b7520ebc72cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.542274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbdf20935dc41a79864b7520ebc72cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.549488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbdf20935dc41a79864b7520ebc72cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.550105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbdf20935dc41a79864b7520ebc72cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.550713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-6665c1a4-e82d-416f-8a40-acce3bd994ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbdf20935dc41a79864b7520ebc72cb'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.562497 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4331/8659] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:36:25 2022] DELETE /identity/v3/users/dcbdf20935dc41a79864b7520ebc72cb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:36:25.740159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:25.750629 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f0d7-748e-4489-840e-02efda751c97 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:25.806580 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:25.807948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:25.808227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:25.808544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] PATH_INFO: `/v3/projects/6d4e54e969224337acfc6a178ca33422` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:25.809717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4e54e969224337acfc6a178ca33422)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:25.811600 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:25.855336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4e54e969224337acfc6a178ca33422', 'request_id': 'req-7eb6137c-941d-4fad-a372-bf8fe1b7b922'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.862239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4e54e969224337acfc6a178ca33422', 'request_id': 'req-7eb6137c-941d-4fad-a372-bf8fe1b7b922'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.869124 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4e54e969224337acfc6a178ca33422', 'request_id': 'req-7eb6137c-941d-4fad-a372-bf8fe1b7b922'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.880174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] The token cache is being invalidate because project 6d4e54e969224337acfc6a178ca33422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:36:25.880493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.881123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-7eb6137c-941d-4fad-a372-bf8fe1b7b922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:36:25.882641 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4329/8660] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:36:25 2022] DELETE /identity/v3/projects/6d4e54e969224337acfc6a178ca33422 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:36:25.888491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a55a41-5350-4c35-9586-8d1ce9d1ce83 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:25.888780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a55a41-5350-4c35-9586-8d1ce9d1ce83 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:25.889062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a55a41-5350-4c35-9586-8d1ce9d1ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:25.906674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-02a55a41-5350-4c35-9586-8d1ce9d1ce83 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:36:25.907895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-02a55a41-5350-4c35-9586-8d1ce9d1ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:25.966007 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4332/8661] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:36:25.973773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bad0-842c-40b4-9323-81ee32023fac None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:25.974061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bad0-842c-40b4-9323-81ee32023fac None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:25.974341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bad0-842c-40b4-9323-81ee32023fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:25.993835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b2f8bad0-842c-40b4-9323-81ee32023fac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:36:25.995594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b2f8bad0-842c-40b4-9323-81ee32023fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:26.003721 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4330/8662] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:36:26.007779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a55a41-5350-4c35-9586-8d1ce9d1ce83 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:26.017937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a55a41-5350-4c35-9586-8d1ce9d1ce83 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:26.022467 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:26.023116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:26.023394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:26.023674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:26.024421 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:36:26.024731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:26.026309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:26.037481 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4333/8663] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:36:26.041554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8bad0-842c-40b4-9323-81ee32023fac None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:26.050667 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8bad0-842c-40b4-9323-81ee32023fac None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:26.055294 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d7f7a-a2f0-4622-92e6-539cae48559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:26.055945 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7f7a-a2f0-4622-92e6-539cae48559c admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:26.056214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7f7a-a2f0-4622-92e6-539cae48559c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:26.056517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7f7a-a2f0-4622-92e6-539cae48559c admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:26.057701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d7f7a-a2f0-4622-92e6-539cae48559c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:26.059590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d7f7a-a2f0-4622-92e6-539cae48559c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:26.085468 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4331/8664] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:36:26 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:36:26.089920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:26.099864 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab8963-d916-4803-86de-338133fd178d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:26.155254 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cd7b9-27a0-4a5e-9694-f4b2fddd3d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:26.155915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cd7b9-27a0-4a5e-9694-f4b2fddd3d78 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:26.156201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cd7b9-27a0-4a5e-9694-f4b2fddd3d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:26.156513 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cd7b9-27a0-4a5e-9694-f4b2fddd3d78 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:26.157208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cd7b9-27a0-4a5e-9694-f4b2fddd3d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:26.159121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cd7b9-27a0-4a5e-9694-f4b2fddd3d78 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:26.179589 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4334/8665] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:36:26 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:36:26.184299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d7f7a-a2f0-4622-92e6-539cae48559c admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:26.194611 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d7f7a-a2f0-4622-92e6-539cae48559c admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:26.199546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc081d2-f04c-4e9b-9c59-d22d774fa886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:26.200199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc081d2-f04c-4e9b-9c59-d22d774fa886 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:26.200509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc081d2-f04c-4e9b-9c59-d22d774fa886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:26.200786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc081d2-f04c-4e9b-9c59-d22d774fa886 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:26.202125 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc081d2-f04c-4e9b-9c59-d22d774fa886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:26.203731 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc081d2-f04c-4e9b-9c59-d22d774fa886 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:26.214570 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4332/8666] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:36:26.218527 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cd7b9-27a0-4a5e-9694-f4b2fddd3d78 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:26.228496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cd7b9-27a0-4a5e-9694-f4b2fddd3d78 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:26.233711 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a222eb-9db9-47b9-9874-fd8640d0cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:26.234358 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a222eb-9db9-47b9-9874-fd8640d0cd1d admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:26.234640 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a222eb-9db9-47b9-9874-fd8640d0cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:26.234918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a222eb-9db9-47b9-9874-fd8640d0cd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:26.235632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a222eb-9db9-47b9-9874-fd8640d0cd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:26.237637 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a222eb-9db9-47b9-9874-fd8640d0cd1d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:26.248311 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4335/8667] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:36:26.252349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc081d2-f04c-4e9b-9c59-d22d774fa886 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:26.262414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc081d2-f04c-4e9b-9c59-d22d774fa886 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:26.267185 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:26.268059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:26.268353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:26.268683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] PATH_INFO: `/v3/projects/9f6be5d4ae2946bb9304ae0a31f2c325/users/f14d8011b7c241f7b5ecdee4c3f44ae4/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:26.283540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6be5d4ae2946bb9304ae0a31f2c325, user_id=f14d8011b7c241f7b5ecdee4c3f44ae4, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:26.286250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:26.299639 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4333/8668] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:36:26 2022] PUT /identity/v3/projects/9f6be5d4ae2946bb9304ae0a31f2c325/users/f14d8011b7c241f7b5ecdee4c3f44ae4/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:36:26.304994 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d3c2-784c-45da-ab57-8b4faae057ed None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:26.305293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d3c2-784c-45da-ab57-8b4faae057ed None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:26.305581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d3c2-784c-45da-ab57-8b4faae057ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:26.324064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5e61d3c2-784c-45da-ab57-8b4faae057ed None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:36:26.325324 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5e61d3c2-784c-45da-ab57-8b4faae057ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:26.384187 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4336/8669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:36:26.393924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:26.395617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:26.454887 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26343-267c-453b-8628-451cf62ba6a3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:26.458608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:26.459282 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:26.459567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:26.459875 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:26.468985 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:26.470356 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:26.480233 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4334/8670] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:36:30.512796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9ceb-ac36-4566-a564-ac7d11b5acde None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:30.513318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9ceb-ac36-4566-a564-ac7d11b5acde None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:30.513622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9ceb-ac36-4566-a564-ac7d11b5acde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:30.542420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9ebf9ceb-ac36-4566-a564-ac7d11b5acde None None] MFA Rules not processed for user `f14d8011b7c241f7b5ecdee4c3f44ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:36:30.543629 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9ebf9ceb-ac36-4566-a564-ac7d11b5acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:30.610201 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4337/8671] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:36:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:36:30.622836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:30.624912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:30.726364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091b0e1-996d-41fd-a115-719c8ae52819 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:30.732827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:30.733496 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:30.733790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:30.734069 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:30.742901 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:30.745190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:30.755097 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4335/8672] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:36:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:36:32.228502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5a7f-b7c5-489b-905f-c83144a1640c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:32.228921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5a7f-b7c5-489b-905f-c83144a1640c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:32.229211 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5a7f-b7c5-489b-905f-c83144a1640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:32.247552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-98ca5a7f-b7c5-489b-905f-c83144a1640c None None] MFA Rules not processed for user `f14d8011b7c241f7b5ecdee4c3f44ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:36:32.248803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-98ca5a7f-b7c5-489b-905f-c83144a1640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:32.256059 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4338/8673] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:36:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:36:32.904969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:32.906473 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:32.981174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc0018-1ba5-4d0d-9f7e-8b1563d156d3 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:32.986172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae8713-1a62-4b97-a324-859193840a39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:32.986816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae8713-1a62-4b97-a324-859193840a39 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:32.987097 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae8713-1a62-4b97-a324-859193840a39 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:32.987377 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae8713-1a62-4b97-a324-859193840a39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:32.989151 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9dae8713-1a62-4b97-a324-859193840a39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:33.003454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae8713-1a62-4b97-a324-859193840a39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:33.005071 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae8713-1a62-4b97-a324-859193840a39 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:33.017550 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4336/8674] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:36:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:36:35.549843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca5a7f-b7c5-489b-905f-c83144a1640c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:35.552535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-98ca5a7f-b7c5-489b-905f-c83144a1640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:35.583125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca5a7f-b7c5-489b-905f-c83144a1640c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:35.589698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf82a0f-7fcd-4cb8-a560-1db7a40e23f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:35.590371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82a0f-7fcd-4cb8-a560-1db7a40e23f0 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:35.590660 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82a0f-7fcd-4cb8-a560-1db7a40e23f0 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:35.590933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82a0f-7fcd-4cb8-a560-1db7a40e23f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:35.593141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-eaf82a0f-7fcd-4cb8-a560-1db7a40e23f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:35.613656 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf82a0f-7fcd-4cb8-a560-1db7a40e23f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:35.615593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf82a0f-7fcd-4cb8-a560-1db7a40e23f0 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:35.629782 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4339/8675] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:36:47.101368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fabafe-2a15-4135-bc17-62edc459a55a None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:47.101926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fabafe-2a15-4135-bc17-62edc459a55a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:47.101926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fabafe-2a15-4135-bc17-62edc459a55a None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:47.104521 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4337/8676] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:36:47.109618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca87ce-968b-4387-920f-76bf3975f389 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:47.110039 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca87ce-968b-4387-920f-76bf3975f389 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:47.110342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca87ce-968b-4387-920f-76bf3975f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:47.128747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-f3ca87ce-968b-4387-920f-76bf3975f389 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:36:47.129955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f3ca87ce-968b-4387-920f-76bf3975f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:47.139731 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4340/8677] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:36:47.161060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fabafe-2a15-4135-bc17-62edc459a55a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:36:47.162760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-56fabafe-2a15-4135-bc17-62edc459a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:36:47.183787 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fabafe-2a15-4135-bc17-62edc459a55a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:36:47.188956 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa70fd9-8f1d-4f37-98e6-3c4d551381c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:36:47.189586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa70fd9-8f1d-4f37-98e6-3c4d551381c6 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:36:47.189865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa70fd9-8f1d-4f37-98e6-3c4d551381c6 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:36:47.190139 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa70fd9-8f1d-4f37-98e6-3c4d551381c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:36:47.199622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa70fd9-8f1d-4f37-98e6-3c4d551381c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:36:47.201227 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa70fd9-8f1d-4f37-98e6-3c4d551381c6 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:36:47.210962 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4338/8678] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:36:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:37:05.609277 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca87ce-968b-4387-920f-76bf3975f389 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:37:05.610798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-f3ca87ce-968b-4387-920f-76bf3975f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:37:05.625432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca87ce-968b-4387-920f-76bf3975f389 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:37:05.629212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925c97-f300-405b-8d89-d4cf311728d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:37:05.629889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925c97-f300-405b-8d89-d4cf311728d3 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:37:05.630173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925c97-f300-405b-8d89-d4cf311728d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:37:05.630449 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925c97-f300-405b-8d89-d4cf311728d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:37:05.632206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b7925c97-f300-405b-8d89-d4cf311728d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:37:05.644253 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925c97-f300-405b-8d89-d4cf311728d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:37:05.645686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925c97-f300-405b-8d89-d4cf311728d3 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:37:05.656393 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4341/8679] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:37:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:37:06.068655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa70fd9-8f1d-4f37-98e6-3c4d551381c6 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:37:06.085508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa70fd9-8f1d-4f37-98e6-3c4d551381c6 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:37:06.091536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:37:06.092182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:37:06.092506 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:37:06.092884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:37:06.094655 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:37:06.109740 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:37:06.111372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:37:06.130308 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4339/8680] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:37:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:37:13.984572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e992e-2fdf-4a4d-bebb-a75c6a0d6669 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:37:13.985077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e992e-2fdf-4a4d-bebb-a75c6a0d6669 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:37:13.985294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e992e-2fdf-4a4d-bebb-a75c6a0d6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:37:14.003244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5a0e992e-2fdf-4a4d-bebb-a75c6a0d6669 None None] MFA Rules not processed for user `f14d8011b7c241f7b5ecdee4c3f44ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:37:14.004469 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5a0e992e-2fdf-4a4d-bebb-a75c6a0d6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:37:14.014606 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4342/8681] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:37:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:37:14.323232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:37:14.335049 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449abce4-00a2-47ef-9c03-4cb09e36b280 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:37:14.339456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac41f0-d2ac-4428-8ac9-597f75b21fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:37:14.340098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac41f0-d2ac-4428-8ac9-597f75b21fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:37:14.340418 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac41f0-d2ac-4428-8ac9-597f75b21fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:37:14.340703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac41f0-d2ac-4428-8ac9-597f75b21fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:37:14.342467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-03ac41f0-d2ac-4428-8ac9-597f75b21fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:37:14.355062 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac41f0-d2ac-4428-8ac9-597f75b21fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:37:14.356536 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac41f0-d2ac-4428-8ac9-597f75b21fa6 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:37:14.367006 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4340/8682] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:37:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:37:50.253375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c0ee-4142-4060-93e1-7f87f9ec6a39 None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:37:50.253921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c0ee-4142-4060-93e1-7f87f9ec6a39 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:37:50.253921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c0ee-4142-4060-93e1-7f87f9ec6a39 None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:37:50.255678 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4343/8683] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:37:50.260997 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8eb45-202f-4614-8b4c-a98920ad18ab None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:37:50.261445 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8eb45-202f-4614-8b4c-a98920ad18ab None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:37:50.261551 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8eb45-202f-4614-8b4c-a98920ad18ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:37:50.279610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7be8eb45-202f-4614-8b4c-a98920ad18ab None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:37:50.280822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7be8eb45-202f-4614-8b4c-a98920ad18ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:37:50.289995 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4341/8684] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:37:50.312521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c0ee-4142-4060-93e1-7f87f9ec6a39 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:37:50.329651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c0ee-4142-4060-93e1-7f87f9ec6a39 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:37:50.334626 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c65965-3210-45f9-ad8c-572776ae9a98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:37:50.335266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65965-3210-45f9-ad8c-572776ae9a98 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:37:50.335556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65965-3210-45f9-ad8c-572776ae9a98 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:37:50.335835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65965-3210-45f9-ad8c-572776ae9a98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:37:50.344780 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c65965-3210-45f9-ad8c-572776ae9a98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:37:50.346415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c65965-3210-45f9-ad8c-572776ae9a98 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:37:50.356683 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4344/8685] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:37:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:37:53.759516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8eb45-202f-4614-8b4c-a98920ad18ab None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:37:53.782008 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8eb45-202f-4614-8b4c-a98920ad18ab None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:37:53.786316 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ca304-8011-4368-95f4-dc50a649dfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:37:53.786962 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca304-8011-4368-95f4-dc50a649dfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:37:53.787239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca304-8011-4368-95f4-dc50a649dfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:37:53.787509 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca304-8011-4368-95f4-dc50a649dfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:37:53.789996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7f2ca304-8011-4368-95f4-dc50a649dfb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:37:53.802284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca304-8011-4368-95f4-dc50a649dfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:37:53.803652 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca304-8011-4368-95f4-dc50a649dfb7 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:37:53.814906 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4342/8686] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:37:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:38:05.427178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a13e-80f8-40f7-b2d7-d0746d3dbbf7 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:38:05.427687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a13e-80f8-40f7-b2d7-d0746d3dbbf7 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:38:05.427796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a13e-80f8-40f7-b2d7-d0746d3dbbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:38:05.445893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ef90a13e-80f8-40f7-b2d7-d0746d3dbbf7 None None] MFA Rules not processed for user `f14d8011b7c241f7b5ecdee4c3f44ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:38:05.447419 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ef90a13e-80f8-40f7-b2d7-d0746d3dbbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:38:05.454630 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4345/8687] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:38:05.754198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c410-3fff-42b4-a512-ab158949bc12 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:38:05.754793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c410-3fff-42b4-a512-ab158949bc12 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:38:05.754793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c410-3fff-42b4-a512-ab158949bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:38:05.790549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-67a0c410-3fff-42b4-a512-ab158949bc12 None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:38:05.791850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-67a0c410-3fff-42b4-a512-ab158949bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:38:05.798713 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4343/8688] 10.222.0.30 () {58 vars in 1061 bytes} [Sat Feb 19 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:38:05.804581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90a13e-80f8-40f7-b2d7-d0746d3dbbf7 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:38:05.813964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90a13e-80f8-40f7-b2d7-d0746d3dbbf7 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:38:05.817750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1424ee-e33d-4148-ada8-eb9eb5d5faa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:38:05.818410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1424ee-e33d-4148-ada8-eb9eb5d5faa0 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:38:05.818691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1424ee-e33d-4148-ada8-eb9eb5d5faa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:38:05.818965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1424ee-e33d-4148-ada8-eb9eb5d5faa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:38:05.820761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2d1424ee-e33d-4148-ada8-eb9eb5d5faa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:38:05.832745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1424ee-e33d-4148-ada8-eb9eb5d5faa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:38:05.834196 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1424ee-e33d-4148-ada8-eb9eb5d5faa0 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:38:05.844822 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4346/8689] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:38:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:38:17.304676 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ebadc-00e4-45ec-99d9-ae42f733b00b None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:38:17.305734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ebadc-00e4-45ec-99d9-ae42f733b00b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:38:17.306639 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ebadc-00e4-45ec-99d9-ae42f733b00b None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:38:17.308784 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4344/8690] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:38:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:38:17.314372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539ea6-b264-4375-8052-8f69908d7612 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:38:17.314941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539ea6-b264-4375-8052-8f69908d7612 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:38:17.314941 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539ea6-b264-4375-8052-8f69908d7612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:38:17.333779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-d9539ea6-b264-4375-8052-8f69908d7612 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:38:17.335102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d9539ea6-b264-4375-8052-8f69908d7612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:38:17.344291 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4347/8691] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:38:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:38:17.367673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ebadc-00e4-45ec-99d9-ae42f733b00b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:38:17.385963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ebadc-00e4-45ec-99d9-ae42f733b00b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:38:17.391272 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e81b-6eae-4072-9ddd-5b8f374ac80d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:38:17.391940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e81b-6eae-4072-9ddd-5b8f374ac80d service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:38:17.392223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e81b-6eae-4072-9ddd-5b8f374ac80d service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:38:17.392530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e81b-6eae-4072-9ddd-5b8f374ac80d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:38:17.401913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751e81b-6eae-4072-9ddd-5b8f374ac80d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:38:17.403219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751e81b-6eae-4072-9ddd-5b8f374ac80d service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:38:17.414946 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4345/8692] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:38:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:38:47.788052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9539ea6-b264-4375-8052-8f69908d7612 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:38:47.811294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9539ea6-b264-4375-8052-8f69908d7612 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:38:47.816438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9d856-6441-4fc6-a262-927751eca8b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:38:47.817083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9d856-6441-4fc6-a262-927751eca8b4 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:38:47.817365 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9d856-6441-4fc6-a262-927751eca8b4 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:38:47.817638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9d856-6441-4fc6-a262-927751eca8b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:38:47.819364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8bb9d856-6441-4fc6-a262-927751eca8b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:38:47.834083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9d856-6441-4fc6-a262-927751eca8b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:38:47.835699 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9d856-6441-4fc6-a262-927751eca8b4 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:38:47.849240 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4348/8693] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:38:53.072277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e81b-6eae-4072-9ddd-5b8f374ac80d service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:38:53.095189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e81b-6eae-4072-9ddd-5b8f374ac80d service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:38:53.100212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49400f4-f1cc-4439-be56-0686223b73cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:38:53.100888 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49400f4-f1cc-4439-be56-0686223b73cd service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:38:53.101187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49400f4-f1cc-4439-be56-0686223b73cd service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:38:53.101457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49400f4-f1cc-4439-be56-0686223b73cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:38:53.103223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a49400f4-f1cc-4439-be56-0686223b73cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:38:53.117439 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49400f4-f1cc-4439-be56-0686223b73cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:38:53.119003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49400f4-f1cc-4439-be56-0686223b73cd service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:38:53.132049 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4346/8694] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:38:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:39:02.479595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3ace3-b680-4306-9326-33b07ada3f0a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:02.480586 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3ace3-b680-4306-9326-33b07ada3f0a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:02.480879 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3ace3-b680-4306-9326-33b07ada3f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:02.498866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-e1f3ace3-b680-4306-9326-33b07ada3f0a None None] MFA Rules not processed for user `f14d8011b7c241f7b5ecdee4c3f44ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:39:02.500144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-e1f3ace3-b680-4306-9326-33b07ada3f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:39:02.507103 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4349/8695] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:39:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:39:03.112344 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6804b75-0ac8-4834-a746-598d32de4e27 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:03.112831 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6804b75-0ac8-4834-a746-598d32de4e27 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:03.113115 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6804b75-0ac8-4834-a746-598d32de4e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:03.132459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d6804b75-0ac8-4834-a746-598d32de4e27 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:39:03.133701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6804b75-0ac8-4834-a746-598d32de4e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:39:03.142777 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4347/8696] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:39:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:39:03.154914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3ace3-b680-4306-9326-33b07ada3f0a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:39:03.170185 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3ace3-b680-4306-9326-33b07ada3f0a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:39:03.175178 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad9f3-165b-4367-8005-d66883461465 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:39:03.175814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad9f3-165b-4367-8005-d66883461465 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:03.176094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad9f3-165b-4367-8005-d66883461465 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:03.176487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad9f3-165b-4367-8005-d66883461465 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:03.185021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad9f3-165b-4367-8005-d66883461465 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:39:03.186581 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad9f3-165b-4367-8005-d66883461465 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:39:03.196284 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4350/8697] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:39:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:39:19.244852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc1ee-5d1b-45fa-bf30-d97a8ad330cd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:19.245426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc1ee-5d1b-45fa-bf30-d97a8ad330cd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:19.245426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc1ee-5d1b-45fa-bf30-d97a8ad330cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:19.265623 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-36fdc1ee-5d1b-45fa-bf30-d97a8ad330cd None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:39:19.266826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-36fdc1ee-5d1b-45fa-bf30-d97a8ad330cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:39:19.273422 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4348/8698] 10.222.0.30 () {58 vars in 1061 bytes} [Sat Feb 19 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:39:19.280703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad9f3-165b-4367-8005-d66883461465 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:39:19.289679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad9f3-165b-4367-8005-d66883461465 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:39:19.293828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeb9bd-6d7b-4294-b228-d9c45d6303d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:39:19.294466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb9bd-6d7b-4294-b228-d9c45d6303d9 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:19.294948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb9bd-6d7b-4294-b228-d9c45d6303d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:19.295234 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb9bd-6d7b-4294-b228-d9c45d6303d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:19.297029 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ecdeb9bd-6d7b-4294-b228-d9c45d6303d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:39:19.309628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeb9bd-6d7b-4294-b228-d9c45d6303d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:39:19.311067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeb9bd-6d7b-4294-b228-d9c45d6303d9 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:39:19.322289 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4351/8699] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:39:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:39:19.402208 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7cfc7-d260-4fee-bcbc-d9bba627420e None None] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:19.402492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7cfc7-d260-4fee-bcbc-d9bba627420e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:19.403402 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7cfc7-d260-4fee-bcbc-d9bba627420e None None] PATH_INFO: `/` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:19.405259 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4349/8700] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 19 21:39:19.410097 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073fe2-fdae-4a36-92e9-b306f1c22f73 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:19.410430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073fe2-fdae-4a36-92e9-b306f1c22f73 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:19.410714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073fe2-fdae-4a36-92e9-b306f1c22f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:19.428686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3f073fe2-fdae-4a36-92e9-b306f1c22f73 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:39:19.429883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3f073fe2-fdae-4a36-92e9-b306f1c22f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:39:19.438476 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4352/8701] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:39:19.458674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7cfc7-d260-4fee-bcbc-d9bba627420e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:39:19.475297 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7cfc7-d260-4fee-bcbc-d9bba627420e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:39:19.480253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b202-541c-4f50-9e88-9ce508a1e2f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:39:19.480916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b202-541c-4f50-9e88-9ce508a1e2f7 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:19.481196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b202-541c-4f50-9e88-9ce508a1e2f7 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:19.481474 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b202-541c-4f50-9e88-9ce508a1e2f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:19.489677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b202-541c-4f50-9e88-9ce508a1e2f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:39:19.491238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b202-541c-4f50-9e88-9ce508a1e2f7 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:39:19.500756 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4350/8702] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:39:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:39:19.655713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073fe2-fdae-4a36-92e9-b306f1c22f73 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:39:19.664923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073fe2-fdae-4a36-92e9-b306f1c22f73 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:39:19.668461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:39:19.669094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:19.669373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:19.669646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:19.671376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:39:19.687876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:39:19.689338 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:39:19.703587 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4353/8703] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:39:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:39:19.757657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffffa46-344b-4e2d-a640-e3915e231eb0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:19.757948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffffa46-344b-4e2d-a640-e3915e231eb0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:19.758277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffffa46-344b-4e2d-a640-e3915e231eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:19.776870 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9ffffa46-344b-4e2d-a640-e3915e231eb0 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:39:19.778047 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9ffffa46-344b-4e2d-a640-e3915e231eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:39:19.786656 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4351/8704] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:39:19.798111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:39:19.812035 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407dfb-be79-4d11-98b7-a678fc495be2 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:39:19.817094 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc72cc-4969-46b5-9298-904663456092 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:39:19.817730 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc72cc-4969-46b5-9298-904663456092 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:39:19.818013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc72cc-4969-46b5-9298-904663456092 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:39:19.818290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc72cc-4969-46b5-9298-904663456092 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:39:19.827373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc72cc-4969-46b5-9298-904663456092 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:39:19.828866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc72cc-4969-46b5-9298-904663456092 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:39:19.838494 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4354/8705] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:39:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:03.344984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffffa46-344b-4e2d-a640-e3915e231eb0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:03.368649 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffffa46-344b-4e2d-a640-e3915e231eb0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:03.373480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:03.374340 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:03.374617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:03.374892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] PATH_INFO: `/v3/users/f14d8011b7c241f7b5ecdee4c3f44ae4` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:03.376059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14d8011b7c241f7b5ecdee4c3f44ae4)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:03.378035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:03.424117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14d8011b7c241f7b5ecdee4c3f44ae4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.424866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14d8011b7c241f7b5ecdee4c3f44ae4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.425504 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14d8011b7c241f7b5ecdee4c3f44ae4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.438602 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14d8011b7c241f7b5ecdee4c3f44ae4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.446409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-462c29e6-af8c-44a0-9faa-ca344c7f1445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14d8011b7c241f7b5ecdee4c3f44ae4'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.459307 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4352/8706] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:40:03 2022] DELETE /identity/v3/users/f14d8011b7c241f7b5ecdee4c3f44ae4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:03.628618 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc72cc-4969-46b5-9298-904663456092 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:03.640593 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc72cc-4969-46b5-9298-904663456092 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:03.697706 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:03.698604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:03.698914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:03.699216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] PATH_INFO: `/v3/projects/9f6be5d4ae2946bb9304ae0a31f2c325` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:03.700447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6be5d4ae2946bb9304ae0a31f2c325)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:03.702984 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:03.749560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6be5d4ae2946bb9304ae0a31f2c325', 'request_id': 'req-ad1eac81-4fc6-402c-acac-2dabf7385ec4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.754799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6be5d4ae2946bb9304ae0a31f2c325', 'request_id': 'req-ad1eac81-4fc6-402c-acac-2dabf7385ec4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.762041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6be5d4ae2946bb9304ae0a31f2c325', 'request_id': 'req-ad1eac81-4fc6-402c-acac-2dabf7385ec4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.773564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] The token cache is being invalidate because project 9f6be5d4ae2946bb9304ae0a31f2c325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:40:03.773857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.774479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-ad1eac81-4fc6-402c-acac-2dabf7385ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:03.776024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4355/8707] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:40:03 2022] DELETE /identity/v3/projects/9f6be5d4ae2946bb9304ae0a31f2c325 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:40:03.781240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b64482-f00e-48f1-93cb-000c7a13b397 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:03.781528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b64482-f00e-48f1-93cb-000c7a13b397 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:03.781857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b64482-f00e-48f1-93cb-000c7a13b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:03.799109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-08b64482-f00e-48f1-93cb-000c7a13b397 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:03.800306 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-08b64482-f00e-48f1-93cb-000c7a13b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:03.858245 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4353/8708] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:03.866880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0b24-2e39-48b8-aaee-3a46444b38fd None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:03.867167 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0b24-2e39-48b8-aaee-3a46444b38fd None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:03.867444 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0b24-2e39-48b8-aaee-3a46444b38fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:03.886339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0d2d0b24-2e39-48b8-aaee-3a46444b38fd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:03.887539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0d2d0b24-2e39-48b8-aaee-3a46444b38fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:03.898618 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4356/8709] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:03.902873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b64482-f00e-48f1-93cb-000c7a13b397 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:03.912989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b64482-f00e-48f1-93cb-000c7a13b397 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:03.918634 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:03.919421 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:03.919710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:03.920033 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:03.920798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:40:03.921106 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:03.922863 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:03.936148 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4354/8710] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:40:03.940006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d0b24-2e39-48b8-aaee-3a46444b38fd None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:03.950653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d0b24-2e39-48b8-aaee-3a46444b38fd None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:03.956564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b6a8-d026-4e02-a9fd-20f35441d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:03.957225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b6a8-d026-4e02-a9fd-20f35441d9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:03.957509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b6a8-d026-4e02-a9fd-20f35441d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:03.957785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b6a8-d026-4e02-a9fd-20f35441d9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:03.958487 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339b6a8-d026-4e02-a9fd-20f35441d9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:03.960494 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339b6a8-d026-4e02-a9fd-20f35441d9c6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:03.989402 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4357/8711] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:40:03 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:40:03.991325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:04.001865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2459-9657-4faf-8dfa-ab0ee8b082ab admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:04.055927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e62e68-61b6-4d99-82e7-a0791b684f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:04.056622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62e68-61b6-4d99-82e7-a0791b684f82 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:04.056907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62e68-61b6-4d99-82e7-a0791b684f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:04.057186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62e68-61b6-4d99-82e7-a0791b684f82 admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:04.057892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e62e68-61b6-4d99-82e7-a0791b684f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:04.059800 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e62e68-61b6-4d99-82e7-a0791b684f82 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:04.080273 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4355/8712] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:40:03 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:40:04.084451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b6a8-d026-4e02-a9fd-20f35441d9c6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:04.094874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b6a8-d026-4e02-a9fd-20f35441d9c6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:04.099406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb8226-275a-485d-8d6e-ee5f51bddf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:04.100071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb8226-275a-485d-8d6e-ee5f51bddf48 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:04.100439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb8226-275a-485d-8d6e-ee5f51bddf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:04.100719 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb8226-275a-485d-8d6e-ee5f51bddf48 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:04.101426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb8226-275a-485d-8d6e-ee5f51bddf48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:04.102996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb8226-275a-485d-8d6e-ee5f51bddf48 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:04.115195 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4358/8713] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:40:04.119055 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e62e68-61b6-4d99-82e7-a0791b684f82 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:04.129595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e62e68-61b6-4d99-82e7-a0791b684f82 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:04.134255 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee722e-cf72-46a3-86a8-684b152560cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:04.134907 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee722e-cf72-46a3-86a8-684b152560cd admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:04.135191 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee722e-cf72-46a3-86a8-684b152560cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:04.135491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee722e-cf72-46a3-86a8-684b152560cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:04.136200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee722e-cf72-46a3-86a8-684b152560cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:04.137822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee722e-cf72-46a3-86a8-684b152560cd admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:04.148061 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4356/8714] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:04.152293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb8226-275a-485d-8d6e-ee5f51bddf48 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:04.162511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb8226-275a-485d-8d6e-ee5f51bddf48 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:04.167511 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:04.168458 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:04.168747 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:04.169051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] PATH_INFO: `/v3/projects/7722259605b44471bf91ed3ba30b3373/users/0166be843e8446df80616100c521aaf2/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:04.183835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7722259605b44471bf91ed3ba30b3373, user_id=0166be843e8446df80616100c521aaf2, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:04.187092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:04.200197 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4359/8715] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:40:04 2022] PUT /identity/v3/projects/7722259605b44471bf91ed3ba30b3373/users/0166be843e8446df80616100c521aaf2/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:04.205276 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81911b5f-5d03-485d-8564-29432a7fea4d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:04.205590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81911b5f-5d03-485d-8564-29432a7fea4d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:04.205869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81911b5f-5d03-485d-8564-29432a7fea4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:04.223456 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-81911b5f-5d03-485d-8564-29432a7fea4d None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:04.224701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-81911b5f-5d03-485d-8564-29432a7fea4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:04.280968 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4357/8716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:40:04.290686 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:04.292385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:04.347716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ecd30-d2c6-49ab-ade7-2689d10f27f1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:04.351413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc5ba0-b4b5-4231-854a-e6d69c636b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:04.352088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5ba0-b4b5-4231-854a-e6d69c636b70 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:04.352394 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5ba0-b4b5-4231-854a-e6d69c636b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:04.352674 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5ba0-b4b5-4231-854a-e6d69c636b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:04.362166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc5ba0-b4b5-4231-854a-e6d69c636b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:04.363638 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc5ba0-b4b5-4231-854a-e6d69c636b70 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:04.373819 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4360/8717] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:04.975886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d1a3b-2d2f-4858-b7d0-c646eecde68c None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:04.976434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d1a3b-2d2f-4858-b7d0-c646eecde68c None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:04.976538 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d1a3b-2d2f-4858-b7d0-c646eecde68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:05.002711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-a89d1a3b-2d2f-4858-b7d0-c646eecde68c None None] MFA Rules not processed for user `0166be843e8446df80616100c521aaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:05.003926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a89d1a3b-2d2f-4858-b7d0-c646eecde68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:05.068660 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4358/8718] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:05.080661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf517-0161-4b29-8c78-7860e883df9e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:05.081173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf517-0161-4b29-8c78-7860e883df9e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:05.081173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf517-0161-4b29-8c78-7860e883df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:05.099089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0e3bf517-0161-4b29-8c78-7860e883df9e None None] MFA Rules not processed for user `0166be843e8446df80616100c521aaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:05.100427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0e3bf517-0161-4b29-8c78-7860e883df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:05.107426 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4361/8719] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:05.118878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d1a3b-2d2f-4858-b7d0-c646eecde68c None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:05.120379 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a89d1a3b-2d2f-4858-b7d0-c646eecde68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:05.205035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d1a3b-2d2f-4858-b7d0-c646eecde68c None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:05.210679 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41e5e9-cbf3-457d-8be9-d57ed5c3e2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:05.211327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e5e9-cbf3-457d-8be9-d57ed5c3e2cd service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:05.211613 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e5e9-cbf3-457d-8be9-d57ed5c3e2cd service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:05.211897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e5e9-cbf3-457d-8be9-d57ed5c3e2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:05.220501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41e5e9-cbf3-457d-8be9-d57ed5c3e2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:05.222110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41e5e9-cbf3-457d-8be9-d57ed5c3e2cd service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:05.230965 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4359/8720] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:12.257601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bf517-0161-4b29-8c78-7860e883df9e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:12.273318 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bf517-0161-4b29-8c78-7860e883df9e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:12.278815 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:12.279985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:12.280271 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:12.280589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:12.282375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:12.298166 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:12.299775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:12.313859 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4362/8721] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:13.952906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f090-a3d2-451d-b62a-9d0db242be8a None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:13.953457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f090-a3d2-451d-b62a-9d0db242be8a None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:13.953457 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667f090-a3d2-451d-b62a-9d0db242be8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:13.970687 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-0667f090-a3d2-451d-b62a-9d0db242be8a None None] MFA Rules not processed for user `0166be843e8446df80616100c521aaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:13.971819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0667f090-a3d2-451d-b62a-9d0db242be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:13.978626 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4360/8722] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:30.982936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:30.993452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1f262-2751-4ad9-869a-538a828fef86 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:30.998129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:30.999512 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:30.999884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.000165 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] PATH_INFO: `/v3/users/0166be843e8446df80616100c521aaf2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.001387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0166be843e8446df80616100c521aaf2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:31.003289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:31.057118 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0166be843e8446df80616100c521aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.073242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0166be843e8446df80616100c521aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.081099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0166be843e8446df80616100c521aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.081758 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0166be843e8446df80616100c521aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.082359 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1a411d0b-c055-4736-b902-55d9bd668acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0166be843e8446df80616100c521aaf2'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.094517 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4363/8723] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:40:30 2022] DELETE /identity/v3/users/0166be843e8446df80616100c521aaf2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:31.268269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667f090-a3d2-451d-b62a-9d0db242be8a None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:31.279930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667f090-a3d2-451d-b62a-9d0db242be8a None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:31.336141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:31.337028 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.337311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.337593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] PATH_INFO: `/v3/projects/7722259605b44471bf91ed3ba30b3373` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.338777 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7722259605b44471bf91ed3ba30b3373)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:31.340744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:31.388442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7722259605b44471bf91ed3ba30b3373', 'request_id': 'req-c30b0011-7f73-464e-b4d9-782b67316c5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.394386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7722259605b44471bf91ed3ba30b3373', 'request_id': 'req-c30b0011-7f73-464e-b4d9-782b67316c5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.402647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7722259605b44471bf91ed3ba30b3373', 'request_id': 'req-c30b0011-7f73-464e-b4d9-782b67316c5c'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.413736 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] The token cache is being invalidate because project 7722259605b44471bf91ed3ba30b3373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:40:31.414026 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.414663 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-c30b0011-7f73-464e-b4d9-782b67316c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:31.416344 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4361/8724] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:40:31 2022] DELETE /identity/v3/projects/7722259605b44471bf91ed3ba30b3373 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:31.421931 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a1de1-8929-4620-b2c4-a0e10dda9539 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.422220 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a1de1-8929-4620-b2c4-a0e10dda9539 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.422500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a1de1-8929-4620-b2c4-a0e10dda9539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.442739 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-7e7a1de1-8929-4620-b2c4-a0e10dda9539 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:31.443940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7e7a1de1-8929-4620-b2c4-a0e10dda9539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:31.505349 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4364/8725] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:40:31.513897 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81e4d8-cfc6-4c57-af33-425d6370b201 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.514187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81e4d8-cfc6-4c57-af33-425d6370b201 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.514470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81e4d8-cfc6-4c57-af33-425d6370b201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.534573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dc81e4d8-cfc6-4c57-af33-425d6370b201 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:31.535782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dc81e4d8-cfc6-4c57-af33-425d6370b201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:31.543763 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4362/8726] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:31.548604 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a1de1-8929-4620-b2c4-a0e10dda9539 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:31.558312 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a1de1-8929-4620-b2c4-a0e10dda9539 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:31.563056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:31.563717 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.563997 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.564273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.565138 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:40:31.565451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:31.567102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:31.578812 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4365/8727] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:40:31.582899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81e4d8-cfc6-4c57-af33-425d6370b201 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:31.592043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81e4d8-cfc6-4c57-af33-425d6370b201 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:31.597467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09304a6a-c6d1-4da6-94ff-5d8650456558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:31.598111 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09304a6a-c6d1-4da6-94ff-5d8650456558 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.598391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09304a6a-c6d1-4da6-94ff-5d8650456558 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.598666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09304a6a-c6d1-4da6-94ff-5d8650456558 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.599351 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09304a6a-c6d1-4da6-94ff-5d8650456558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:31.601293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09304a6a-c6d1-4da6-94ff-5d8650456558 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:31.626115 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4363/8728] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:40:31 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:40:31.630275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:31.640059 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3597d-2585-49ad-9b03-f6077972ee76 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:31.694041 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc121eb9-02ad-491f-88b8-4fffba9897c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:31.694641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121eb9-02ad-491f-88b8-4fffba9897c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.694956 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121eb9-02ad-491f-88b8-4fffba9897c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.695509 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121eb9-02ad-491f-88b8-4fffba9897c2 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.696251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc121eb9-02ad-491f-88b8-4fffba9897c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:31.698349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc121eb9-02ad-491f-88b8-4fffba9897c2 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:31.718205 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4366/8729] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:40:31 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:40:31.722700 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09304a6a-c6d1-4da6-94ff-5d8650456558 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:31.733928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09304a6a-c6d1-4da6-94ff-5d8650456558 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:31.738778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e76cb2-dd89-430a-9fa6-cef885f428e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:31.739462 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e76cb2-dd89-430a-9fa6-cef885f428e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.739744 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e76cb2-dd89-430a-9fa6-cef885f428e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.740020 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e76cb2-dd89-430a-9fa6-cef885f428e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.740781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e76cb2-dd89-430a-9fa6-cef885f428e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:31.742450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e76cb2-dd89-430a-9fa6-cef885f428e2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:31.753416 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4364/8730] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:31.757488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc121eb9-02ad-491f-88b8-4fffba9897c2 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:31.767399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc121eb9-02ad-491f-88b8-4fffba9897c2 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:31.772257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddd908-8df4-4e47-998d-ee91cd95db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:31.772967 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd908-8df4-4e47-998d-ee91cd95db33 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.773246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd908-8df4-4e47-998d-ee91cd95db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.773520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd908-8df4-4e47-998d-ee91cd95db33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.774415 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddd908-8df4-4e47-998d-ee91cd95db33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:31.776119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddd908-8df4-4e47-998d-ee91cd95db33 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:31.789044 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4367/8731] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:31.793668 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e76cb2-dd89-430a-9fa6-cef885f428e2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:31.804790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e76cb2-dd89-430a-9fa6-cef885f428e2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:31.809530 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:31.810405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.810689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.811016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] PATH_INFO: `/v3/projects/50ffb1cd73004f4b82c01f8518318eaa/users/ff100604679649709d256e9e0995ddb7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.827177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ffb1cd73004f4b82c01f8518318eaa, user_id=ff100604679649709d256e9e0995ddb7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:31.829898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:31.842189 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4365/8732] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:40:31 2022] PUT /identity/v3/projects/50ffb1cd73004f4b82c01f8518318eaa/users/ff100604679649709d256e9e0995ddb7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:40:31.852817 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7cd9-908f-4d8c-b78b-28bbd016e01b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:31.853111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7cd9-908f-4d8c-b78b-28bbd016e01b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:31.853412 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7cd9-908f-4d8c-b78b-28bbd016e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:31.879496 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9beb7cd9-908f-4d8c-b78b-28bbd016e01b None None] MFA Rules not processed for user `ff100604679649709d256e9e0995ddb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:31.880742 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9beb7cd9-908f-4d8c-b78b-28bbd016e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:31.942085 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4368/8733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:31.952852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:31.954541 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:32.009459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb4abb-e05f-45a9-b7bc-294e8eec3b28 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:32.013094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0173555-8963-44a3-9cca-97b69b8a6246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:32.013730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0173555-8963-44a3-9cca-97b69b8a6246 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:32.014010 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0173555-8963-44a3-9cca-97b69b8a6246 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:32.014775 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0173555-8963-44a3-9cca-97b69b8a6246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:32.022982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0173555-8963-44a3-9cca-97b69b8a6246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:32.024431 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0173555-8963-44a3-9cca-97b69b8a6246 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:32.033598 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4366/8734] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:42.350532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb7cd9-908f-4d8c-b78b-28bbd016e01b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:42.412716 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb7cd9-908f-4d8c-b78b-28bbd016e01b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:42.417147 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:42.418007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:42.418287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:42.418563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] PATH_INFO: `/v3/users/ff100604679649709d256e9e0995ddb7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:42.419743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff100604679649709d256e9e0995ddb7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:42.422209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:42.466993 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff100604679649709d256e9e0995ddb7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.478114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff100604679649709d256e9e0995ddb7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.485723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff100604679649709d256e9e0995ddb7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.486534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff100604679649709d256e9e0995ddb7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.487202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff100604679649709d256e9e0995ddb7'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.499984 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4369/8735] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:40:42 2022] DELETE /identity/v3/users/ff100604679649709d256e9e0995ddb7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:42.504792 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05103e-9a17-4e27-9ab6-3756524fd0ea None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:42.505281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05103e-9a17-4e27-9ab6-3756524fd0ea None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:42.505564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05103e-9a17-4e27-9ab6-3756524fd0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:42.522409 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ed05103e-9a17-4e27-9ab6-3756524fd0ea None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:42.523591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ed05103e-9a17-4e27-9ab6-3756524fd0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:42.579272 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4367/8736] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:42.588850 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:42.590212 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:42.647748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e10119-f383-4c88-9faa-7889a1ef8fea admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:42.651346 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9ea66-08ab-4307-b94e-4b087c09fffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:42.651983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ea66-08ab-4307-b94e-4b087c09fffc service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:42.652262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ea66-08ab-4307-b94e-4b087c09fffc service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:42.652564 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ea66-08ab-4307-b94e-4b087c09fffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:42.661334 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9ea66-08ab-4307-b94e-4b087c09fffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:42.662800 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9ea66-08ab-4307-b94e-4b087c09fffc service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:42.672542 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4370/8737] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:42.841329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05103e-9a17-4e27-9ab6-3756524fd0ea None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:42.843438 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ed05103e-9a17-4e27-9ab6-3756524fd0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:42.856437 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05103e-9a17-4e27-9ab6-3756524fd0ea None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:42.861764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:42.862612 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:42.862924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:42.863601 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] PATH_INFO: `/v3/projects/50ffb1cd73004f4b82c01f8518318eaa` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:42.865002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ffb1cd73004f4b82c01f8518318eaa)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:42.866890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:42.913088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ffb1cd73004f4b82c01f8518318eaa', 'request_id': 'req-4a14aab6-835b-4dda-a38c-f6289363aaf5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.918422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ffb1cd73004f4b82c01f8518318eaa', 'request_id': 'req-4a14aab6-835b-4dda-a38c-f6289363aaf5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.926067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ffb1cd73004f4b82c01f8518318eaa', 'request_id': 'req-4a14aab6-835b-4dda-a38c-f6289363aaf5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.937037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] The token cache is being invalidate because project 50ffb1cd73004f4b82c01f8518318eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:40:42.937325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.937977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-4a14aab6-835b-4dda-a38c-f6289363aaf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:42.939547 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4368/8738] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:40:42 2022] DELETE /identity/v3/projects/50ffb1cd73004f4b82c01f8518318eaa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:42.944856 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec73d-4d93-46d4-8462-878f3abd83f4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:42.945429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec73d-4d93-46d4-8462-878f3abd83f4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:42.945705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec73d-4d93-46d4-8462-878f3abd83f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:42.963983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-02eec73d-4d93-46d4-8462-878f3abd83f4 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:42.965207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-02eec73d-4d93-46d4-8462-878f3abd83f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:43.022876 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4371/8739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:40:43.031183 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f333-28ce-4db6-ad74-2541ebd93936 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.031476 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f333-28ce-4db6-ad74-2541ebd93936 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.031762 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f333-28ce-4db6-ad74-2541ebd93936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.050598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5223f333-28ce-4db6-ad74-2541ebd93936 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:43.051801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5223f333-28ce-4db6-ad74-2541ebd93936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:43.060131 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4369/8740] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:43.064279 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eec73d-4d93-46d4-8462-878f3abd83f4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:43.073959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eec73d-4d93-46d4-8462-878f3abd83f4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:43.078921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:43.079563 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.079843 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.080116 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.080861 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:40:43.081163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:43.082744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:43.094761 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4372/8741] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:40:43.098753 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f333-28ce-4db6-ad74-2541ebd93936 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:43.107890 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f333-28ce-4db6-ad74-2541ebd93936 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:43.112664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4426ad-ec33-4886-b92c-f9333a9ac04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:43.113312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4426ad-ec33-4886-b92c-f9333a9ac04b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.113592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4426ad-ec33-4886-b92c-f9333a9ac04b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.113869 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4426ad-ec33-4886-b92c-f9333a9ac04b admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.114604 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4426ad-ec33-4886-b92c-f9333a9ac04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:43.116517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4426ad-ec33-4886-b92c-f9333a9ac04b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:43.141497 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4370/8742] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:40:43 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:40:43.145682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:43.156199 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0529d2-d63a-4736-a68d-ddce1033f734 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:43.212266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d7ad-f559-4f25-aaf6-a96f6d5dafa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:43.212886 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d7ad-f559-4f25-aaf6-a96f6d5dafa6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.213168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d7ad-f559-4f25-aaf6-a96f6d5dafa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.213443 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d7ad-f559-4f25-aaf6-a96f6d5dafa6 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.214114 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d7ad-f559-4f25-aaf6-a96f6d5dafa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:43.215998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d7ad-f559-4f25-aaf6-a96f6d5dafa6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:43.235751 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4373/8743] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:40:43 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:40:43.239847 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4426ad-ec33-4886-b92c-f9333a9ac04b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:43.249972 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4426ad-ec33-4886-b92c-f9333a9ac04b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:43.254636 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02b702-9630-489e-8d90-f31544849e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:43.255291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02b702-9630-489e-8d90-f31544849e54 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.255575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02b702-9630-489e-8d90-f31544849e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.255851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02b702-9630-489e-8d90-f31544849e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.256594 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02b702-9630-489e-8d90-f31544849e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:43.258175 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02b702-9630-489e-8d90-f31544849e54 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:43.269160 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4371/8744] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:43.272908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d7ad-f559-4f25-aaf6-a96f6d5dafa6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:43.283377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d7ad-f559-4f25-aaf6-a96f6d5dafa6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:43.288074 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b97b9-e0d2-4da9-8187-d197873b80e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:43.288754 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b97b9-e0d2-4da9-8187-d197873b80e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.289043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b97b9-e0d2-4da9-8187-d197873b80e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.289323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b97b9-e0d2-4da9-8187-d197873b80e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.290040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b97b9-e0d2-4da9-8187-d197873b80e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:43.291616 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b97b9-e0d2-4da9-8187-d197873b80e9 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:43.301474 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4374/8745] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:43.305295 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02b702-9630-489e-8d90-f31544849e54 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:43.315258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02b702-9630-489e-8d90-f31544849e54 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:43.319857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:43.321009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.321290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.321566 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] PATH_INFO: `/v3/projects/e558f20762144273a8aa06a22988ad09/users/67acca9e878843b1851a6b10c262f978/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.336555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e558f20762144273a8aa06a22988ad09, user_id=67acca9e878843b1851a6b10c262f978, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:43.339182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:43.351991 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4372/8746] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:40:43 2022] PUT /identity/v3/projects/e558f20762144273a8aa06a22988ad09/users/67acca9e878843b1851a6b10c262f978/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:40:43.361736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90a0dd-2195-4081-b47e-d8c769762f82 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.362250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90a0dd-2195-4081-b47e-d8c769762f82 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.362354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90a0dd-2195-4081-b47e-d8c769762f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.389219 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ee90a0dd-2195-4081-b47e-d8c769762f82 None None] MFA Rules not processed for user `67acca9e878843b1851a6b10c262f978`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:43.390425 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ee90a0dd-2195-4081-b47e-d8c769762f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:43.453042 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4375/8747] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:43.463056 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:43.464711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:43.521099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0698bc-5eb6-4ade-a235-28bfd6e1ae02 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:43.524999 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4baa24-f16e-4c56-b205-7a492f922068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:43.525638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4baa24-f16e-4c56-b205-7a492f922068 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:43.525920 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4baa24-f16e-4c56-b205-7a492f922068 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:43.526199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4baa24-f16e-4c56-b205-7a492f922068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:43.534706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4baa24-f16e-4c56-b205-7a492f922068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:43.536174 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4baa24-f16e-4c56-b205-7a492f922068 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:43.544871 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4373/8748] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:47.956925 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90a0dd-2195-4081-b47e-d8c769762f82 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.022126 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90a0dd-2195-4081-b47e-d8c769762f82 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.026760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.027624 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.027908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.028187 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] PATH_INFO: `/v3/users/67acca9e878843b1851a6b10c262f978` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.029934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67acca9e878843b1851a6b10c262f978)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.031874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.076575 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67acca9e878843b1851a6b10c262f978'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.087963 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67acca9e878843b1851a6b10c262f978'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.095957 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67acca9e878843b1851a6b10c262f978'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.096627 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67acca9e878843b1851a6b10c262f978'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.097232 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67acca9e878843b1851a6b10c262f978'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.109814 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4376/8749] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:40:47 2022] DELETE /identity/v3/users/67acca9e878843b1851a6b10c262f978 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:48.114399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c2cd-f077-4582-a6ef-3be297d8d8fd None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.114879 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c2cd-f077-4582-a6ef-3be297d8d8fd None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.115002 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c2cd-f077-4582-a6ef-3be297d8d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.132232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7174c2cd-f077-4582-a6ef-3be297d8d8fd None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:48.133453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7174c2cd-f077-4582-a6ef-3be297d8d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:48.188924 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4374/8750] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:48.198796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.200177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:48.255988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e07e4-dbf6-4c67-b580-16a1853b0627 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.259912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34a8db-d773-4277-9040-edf8f0d28da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.260580 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a8db-d773-4277-9040-edf8f0d28da3 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.260885 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a8db-d773-4277-9040-edf8f0d28da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.261144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a8db-d773-4277-9040-edf8f0d28da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.270044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34a8db-d773-4277-9040-edf8f0d28da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.271460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34a8db-d773-4277-9040-edf8f0d28da3 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.281540 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4377/8751] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:48.446364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c2cd-f077-4582-a6ef-3be297d8d8fd None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.447832 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7174c2cd-f077-4582-a6ef-3be297d8d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:48.461816 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c2cd-f077-4582-a6ef-3be297d8d8fd None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.466442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.467951 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.468193 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.468622 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] PATH_INFO: `/v3/projects/e558f20762144273a8aa06a22988ad09` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.469928 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e558f20762144273a8aa06a22988ad09)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.471892 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.517009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e558f20762144273a8aa06a22988ad09', 'request_id': 'req-8e0fe6ed-a648-4a14-9429-41dd1bc21940'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.522898 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e558f20762144273a8aa06a22988ad09', 'request_id': 'req-8e0fe6ed-a648-4a14-9429-41dd1bc21940'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.530786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e558f20762144273a8aa06a22988ad09', 'request_id': 'req-8e0fe6ed-a648-4a14-9429-41dd1bc21940'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.541453 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] The token cache is being invalidate because project e558f20762144273a8aa06a22988ad09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:40:48.541674 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.542296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-8e0fe6ed-a648-4a14-9429-41dd1bc21940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:40:48.543823 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4375/8752] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:40:48 2022] DELETE /identity/v3/projects/e558f20762144273a8aa06a22988ad09 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:48.550091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4530d-9de5-4ff6-b1bd-810a61d4a487 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.550387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4530d-9de5-4ff6-b1bd-810a61d4a487 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.550659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4530d-9de5-4ff6-b1bd-810a61d4a487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.568238 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6cb4530d-9de5-4ff6-b1bd-810a61d4a487 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:48.569475 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6cb4530d-9de5-4ff6-b1bd-810a61d4a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:48.628050 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4378/8753] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:48.636550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741d8ec-2b91-4f71-bf61-20ec6cff8af7 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.636837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741d8ec-2b91-4f71-bf61-20ec6cff8af7 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.637117 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741d8ec-2b91-4f71-bf61-20ec6cff8af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.657908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2741d8ec-2b91-4f71-bf61-20ec6cff8af7 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:48.659132 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2741d8ec-2b91-4f71-bf61-20ec6cff8af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:48.667005 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4376/8754] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:48.671137 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4530d-9de5-4ff6-b1bd-810a61d4a487 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.680940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4530d-9de5-4ff6-b1bd-810a61d4a487 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.686278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.686926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.687208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.687483 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.688197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:40:48.688540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.690124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.703172 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4379/8755] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:40:48.707301 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741d8ec-2b91-4f71-bf61-20ec6cff8af7 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.716671 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741d8ec-2b91-4f71-bf61-20ec6cff8af7 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.721364 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747472ff-0ef0-4de7-8205-0bf6d840c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.721993 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747472ff-0ef0-4de7-8205-0bf6d840c2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.722271 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747472ff-0ef0-4de7-8205-0bf6d840c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.722544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747472ff-0ef0-4de7-8205-0bf6d840c2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.723226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747472ff-0ef0-4de7-8205-0bf6d840c2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.725190 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747472ff-0ef0-4de7-8205-0bf6d840c2d8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.750467 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4377/8756] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:40:48 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:40:48.754607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.765144 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdbe2a-f531-4cc6-958b-bc46bde2c681 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.819076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec33f-d7b4-47ce-a29c-729cd191c7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.819662 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec33f-d7b4-47ce-a29c-729cd191c7de admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.820201 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec33f-d7b4-47ce-a29c-729cd191c7de admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.820534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec33f-d7b4-47ce-a29c-729cd191c7de admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.821550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec33f-d7b4-47ce-a29c-729cd191c7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.823491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec33f-d7b4-47ce-a29c-729cd191c7de admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.843380 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4380/8757] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:40:48 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:40:48.847236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747472ff-0ef0-4de7-8205-0bf6d840c2d8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.857305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747472ff-0ef0-4de7-8205-0bf6d840c2d8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.862114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7f2f0-1808-4f61-9378-177fdcf4d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.862769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f2f0-1808-4f61-9378-177fdcf4d336 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.863054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f2f0-1808-4f61-9378-177fdcf4d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.863331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f2f0-1808-4f61-9378-177fdcf4d336 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.864048 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7f2f0-1808-4f61-9378-177fdcf4d336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.865691 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7f2f0-1808-4f61-9378-177fdcf4d336 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.876497 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4378/8758] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:48.880163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec33f-d7b4-47ce-a29c-729cd191c7de admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.890438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec33f-d7b4-47ce-a29c-729cd191c7de admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.895121 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe77659-5896-411a-a6b1-14d39842520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.895768 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77659-5896-411a-a6b1-14d39842520e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.896056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77659-5896-411a-a6b1-14d39842520e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.896361 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77659-5896-411a-a6b1-14d39842520e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.897077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77659-5896-411a-a6b1-14d39842520e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.898651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77659-5896-411a-a6b1-14d39842520e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.908440 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4381/8759] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:48.912298 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7f2f0-1808-4f61-9378-177fdcf4d336 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:48.922088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7f2f0-1808-4f61-9378-177fdcf4d336 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:48.926733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:48.927585 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.927867 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.928142 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] PATH_INFO: `/v3/projects/5ff3f023fc254bbea87959ce0e95a1ae/users/9e9155525bc1486da02f94f41e30fc4e/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.943724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff3f023fc254bbea87959ce0e95a1ae, user_id=9e9155525bc1486da02f94f41e30fc4e, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:48.946638 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:48.959906 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4379/8760] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:40:48 2022] PUT /identity/v3/projects/5ff3f023fc254bbea87959ce0e95a1ae/users/9e9155525bc1486da02f94f41e30fc4e/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:40:48.965761 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c217a65-3d79-4d0d-aef6-479dae794e00 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:48.966222 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c217a65-3d79-4d0d-aef6-479dae794e00 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:48.966438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c217a65-3d79-4d0d-aef6-479dae794e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:48.988075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-2c217a65-3d79-4d0d-aef6-479dae794e00 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:48.989307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2c217a65-3d79-4d0d-aef6-479dae794e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:49.046423 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4382/8761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:49.055980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:49.057688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:49.113380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff5534-410d-4a73-8d22-20096600c521 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:49.117061 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb580bd-fb31-4b22-b815-7def8d6c3e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:49.117703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb580bd-fb31-4b22-b815-7def8d6c3e6e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:49.117983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb580bd-fb31-4b22-b815-7def8d6c3e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:49.118258 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb580bd-fb31-4b22-b815-7def8d6c3e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:49.127781 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb580bd-fb31-4b22-b815-7def8d6c3e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:49.129233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb580bd-fb31-4b22-b815-7def8d6c3e6e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:49.138496 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4380/8762] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:53.235051 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edeeb6-eba9-4f5f-857b-1ecc1cb23f7c None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:53.235538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edeeb6-eba9-4f5f-857b-1ecc1cb23f7c None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:53.235647 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edeeb6-eba9-4f5f-857b-1ecc1cb23f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:53.274950 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-74edeeb6-eba9-4f5f-857b-1ecc1cb23f7c None None] MFA Rules not processed for user `9e9155525bc1486da02f94f41e30fc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:53.285367 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-74edeeb6-eba9-4f5f-857b-1ecc1cb23f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:53.368624 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4383/8763] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:53.373134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb580bd-fb31-4b22-b815-7def8d6c3e6e service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:53.384432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb580bd-fb31-4b22-b815-7def8d6c3e6e service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:53.389308 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb775d6-a65c-465b-9452-5538f0761f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:53.390101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb775d6-a65c-465b-9452-5538f0761f87 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:53.390480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb775d6-a65c-465b-9452-5538f0761f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:53.390820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb775d6-a65c-465b-9452-5538f0761f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:53.391717 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb775d6-a65c-465b-9452-5538f0761f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:53.393958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb775d6-a65c-465b-9452-5538f0761f87 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:53.425459 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4381/8764] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:40:53 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:40:53.429560 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edeeb6-eba9-4f5f-857b-1ecc1cb23f7c None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:53.440952 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edeeb6-eba9-4f5f-857b-1ecc1cb23f7c None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:53.500459 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b7c2a-e262-4a49-8e8b-64236e29eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:53.501132 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7c2a-e262-4a49-8e8b-64236e29eaac admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:53.501432 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7c2a-e262-4a49-8e8b-64236e29eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:53.501704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7c2a-e262-4a49-8e8b-64236e29eaac admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:53.502384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b7c2a-e262-4a49-8e8b-64236e29eaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:53.504319 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b7c2a-e262-4a49-8e8b-64236e29eaac admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:53.530013 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4384/8765] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:40:53 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:40:53.531292 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb775d6-a65c-465b-9452-5538f0761f87 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:53.542031 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb775d6-a65c-465b-9452-5538f0761f87 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:53.547493 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432be36-b084-444d-898e-86aa08e374d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:53.548160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432be36-b084-444d-898e-86aa08e374d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:53.548484 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432be36-b084-444d-898e-86aa08e374d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:53.548763 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432be36-b084-444d-898e-86aa08e374d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:53.549491 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432be36-b084-444d-898e-86aa08e374d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:53.551098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432be36-b084-444d-898e-86aa08e374d7 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:53.562566 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4382/8766] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:53.566707 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b7c2a-e262-4a49-8e8b-64236e29eaac admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:53.577845 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b7c2a-e262-4a49-8e8b-64236e29eaac admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:53.582837 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2182b9-183e-4385-aad4-77c633220e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:53.583948 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2182b9-183e-4385-aad4-77c633220e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:53.584313 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2182b9-183e-4385-aad4-77c633220e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:53.584623 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2182b9-183e-4385-aad4-77c633220e2b admin admin] PATH_INFO: `/v3/projects/7fb4e8e471a2429f99d1ccc60cd5a9c7/users/b3d5f4ef2ea14f4ea0100c6ecca1ebbb/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:53.601182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2182b9-183e-4385-aad4-77c633220e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb4e8e471a2429f99d1ccc60cd5a9c7, user_id=b3d5f4ef2ea14f4ea0100c6ecca1ebbb, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:53.603872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2182b9-183e-4385-aad4-77c633220e2b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:53.618259 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4385/8767] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:40:53 2022] PUT /identity/v3/projects/7fb4e8e471a2429f99d1ccc60cd5a9c7/users/b3d5f4ef2ea14f4ea0100c6ecca1ebbb/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:40:53.622291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432be36-b084-444d-898e-86aa08e374d7 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:53.633497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432be36-b084-444d-898e-86aa08e374d7 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:53.694533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb418b2-f346-4b40-85e3-4c7a2667ecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:53.695475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb418b2-f346-4b40-85e3-4c7a2667ecf6 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:53.695764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb418b2-f346-4b40-85e3-4c7a2667ecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:53.696104 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb418b2-f346-4b40-85e3-4c7a2667ecf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:53.697003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb418b2-f346-4b40-85e3-4c7a2667ecf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:53.698637 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb418b2-f346-4b40-85e3-4c7a2667ecf6 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:53.717319 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4383/8768] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:40:53.720989 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2182b9-183e-4385-aad4-77c633220e2b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:53.732377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2182b9-183e-4385-aad4-77c633220e2b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:53.737454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca29c5-72f0-4eb2-809b-3924938c2694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:53.738376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca29c5-72f0-4eb2-809b-3924938c2694 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:53.738658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca29c5-72f0-4eb2-809b-3924938c2694 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:53.738930 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca29c5-72f0-4eb2-809b-3924938c2694 admin admin] PATH_INFO: `/v3/projects/7fb4e8e471a2429f99d1ccc60cd5a9c7/users/b3d5f4ef2ea14f4ea0100c6ecca1ebbb/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:53.740966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca29c5-72f0-4eb2-809b-3924938c2694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb4e8e471a2429f99d1ccc60cd5a9c7, user_id=b3d5f4ef2ea14f4ea0100c6ecca1ebbb, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:53.743597 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca29c5-72f0-4eb2-809b-3924938c2694 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:53.754395 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4386/8769] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:40:53 2022] PUT /identity/v3/projects/7fb4e8e471a2429f99d1ccc60cd5a9c7/users/b3d5f4ef2ea14f4ea0100c6ecca1ebbb/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:40:58.579499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60be8-1df8-4198-8704-1ddb4314f306 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:58.579499 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60be8-1df8-4198-8704-1ddb4314f306 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:58.580072 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60be8-1df8-4198-8704-1ddb4314f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:58.615732 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-5ce60be8-1df8-4198-8704-1ddb4314f306 None None] MFA Rules not processed for user `b3d5f4ef2ea14f4ea0100c6ecca1ebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:58.617035 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5ce60be8-1df8-4198-8704-1ddb4314f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:58.707108 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4384/8770] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:58.742372 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8acac-1924-4075-a992-7e13f9907d00 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:58.742853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8acac-1924-4075-a992-7e13f9907d00 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:58.742953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8acac-1924-4075-a992-7e13f9907d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:58.784534 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-93d8acac-1924-4075-a992-7e13f9907d00 None None] MFA Rules not processed for user `f02b510f78c341c29320f011ef4beaca`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:58.785964 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-93d8acac-1924-4075-a992-7e13f9907d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:58.843680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4387/8771] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Feb 19 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:58.849666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce60be8-1df8-4198-8704-1ddb4314f306 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:58.860113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce60be8-1df8-4198-8704-1ddb4314f306 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:58.864741 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fe827-cdbe-4ad2-8e17-9b21a0c6cd7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:58.865511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe827-cdbe-4ad2-8e17-9b21a0c6cd7c service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:58.865866 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe827-cdbe-4ad2-8e17-9b21a0c6cd7c service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:58.866213 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe827-cdbe-4ad2-8e17-9b21a0c6cd7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:58.926559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fe827-cdbe-4ad2-8e17-9b21a0c6cd7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:58.928017 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fe827-cdbe-4ad2-8e17-9b21a0c6cd7c service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:58.938154 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4385/8772] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:40:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:40:59.056790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c5a16-d6c8-4481-9f80-e431ba049d5e None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:59.057399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c5a16-d6c8-4481-9f80-e431ba049d5e None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:59.057679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c5a16-d6c8-4481-9f80-e431ba049d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:59.111447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8b1c5a16-d6c8-4481-9f80-e431ba049d5e None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:59.112723 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8b1c5a16-d6c8-4481-9f80-e431ba049d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:59.183036 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4388/8773] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:59.242845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814329bb-8dd7-413e-a154-a229fc017d5f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:59.243133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814329bb-8dd7-413e-a154-a229fc017d5f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:59.243406 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814329bb-8dd7-413e-a154-a229fc017d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:59.280976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-814329bb-8dd7-413e-a154-a229fc017d5f None None] MFA Rules not processed for user `4b7a16fa195446e18f5c5982a127b88e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:40:59.282207 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-814329bb-8dd7-413e-a154-a229fc017d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:40:59.345078 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4386/8774] 10.222.0.30 () {58 vars in 1039 bytes} [Sat Feb 19 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:40:59.351325 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c5a16-d6c8-4481-9f80-e431ba049d5e None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:40:59.363745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c5a16-d6c8-4481-9f80-e431ba049d5e None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:40:59.369322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5eefc-ea19-4991-b120-b919bfe69645 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:40:59.369988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5eefc-ea19-4991-b120-b919bfe69645 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:40:59.370274 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5eefc-ea19-4991-b120-b919bfe69645 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:40:59.370554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5eefc-ea19-4991-b120-b919bfe69645 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:40:59.379698 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5eefc-ea19-4991-b120-b919bfe69645 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:40:59.381350 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5eefc-ea19-4991-b120-b919bfe69645 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:40:59.390624 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4389/8775] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:40:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 19 21:41:09.641009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf26b-4a66-4065-a131-5c896be548b4 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:41:09.641579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf26b-4a66-4065-a131-5c896be548b4 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:41:09.641579 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cf26b-4a66-4065-a131-5c896be548b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:41:09.669120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-627cf26b-4a66-4065-a131-5c896be548b4 None None] MFA Rules not processed for user `9e9155525bc1486da02f94f41e30fc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:41:09.670322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-627cf26b-4a66-4065-a131-5c896be548b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:41:09.693987 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4387/8776] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:41:09.728577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5eefc-ea19-4991-b120-b919bfe69645 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:41:09.747923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5eefc-ea19-4991-b120-b919bfe69645 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:41:09.751658 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defde6ae-93a3-45fd-b0e7-5b7d0d79f073 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:41:09.752292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defde6ae-93a3-45fd-b0e7-5b7d0d79f073 service glance] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:41:09.752607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defde6ae-93a3-45fd-b0e7-5b7d0d79f073 service glance] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:41:09.752914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defde6ae-93a3-45fd-b0e7-5b7d0d79f073 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:41:09.754724 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-defde6ae-93a3-45fd-b0e7-5b7d0d79f073 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:41:09.840537 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defde6ae-93a3-45fd-b0e7-5b7d0d79f073 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:41:09.841920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defde6ae-93a3-45fd-b0e7-5b7d0d79f073 service glance] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:41:09.855029 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4390/8777] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:41:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:41:10.390108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cf26b-4a66-4065-a131-5c896be548b4 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:41:10.445802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cf26b-4a66-4065-a131-5c896be548b4 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:41:10.449407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:41:10.450046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:41:10.450357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:41:10.450631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:41:10.452467 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:41:10.469501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:41:10.471101 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:41:10.486423 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4388/8778] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:41:11.442342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b974-3956-4b6e-84d4-7ac98ae94682 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:41:11.442870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b974-3956-4b6e-84d4-7ac98ae94682 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:41:11.443052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b974-3956-4b6e-84d4-7ac98ae94682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:41:11.460898 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-1a17b974-3956-4b6e-84d4-7ac98ae94682 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:41:11.462225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a17b974-3956-4b6e-84d4-7ac98ae94682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:41:11.470541 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4391/8779] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:41:11.484256 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:41:11.505688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa44ef-fa6d-4bdb-9054-2a7d4b57ee32 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:41:11.510727 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:41:11.511368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:41:11.511648 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:41:11.511953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:41:11.520955 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:41:11.522597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:41:11.531983 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4389/8780] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:41:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:41:36.284285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17b974-3956-4b6e-84d4-7ac98ae94682 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:41:36.293610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17b974-3956-4b6e-84d4-7ac98ae94682 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:41:36.297865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852f1d9-45ed-4d44-aac1-5c069dc18abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:41:36.298501 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852f1d9-45ed-4d44-aac1-5c069dc18abd service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:41:36.298784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852f1d9-45ed-4d44-aac1-5c069dc18abd service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:41:36.299061 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852f1d9-45ed-4d44-aac1-5c069dc18abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:41:36.307782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852f1d9-45ed-4d44-aac1-5c069dc18abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:41:36.309235 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852f1d9-45ed-4d44-aac1-5c069dc18abd service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:41:36.319192 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4392/8781] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:41:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:41:38.260083 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:41:38.261768 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:41:38.304589 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3af7b-e14b-460a-ab9c-19525eac6433 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:41:38.311692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:41:38.312724 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:41:38.313145 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:41:38.313498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:41:38.316259 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:41:38.334232 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:41:38.335932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:41:38.352585 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4390/8782] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:41:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:43:49.590086 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852f1d9-45ed-4d44-aac1-5c069dc18abd service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:43:49.598644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852f1d9-45ed-4d44-aac1-5c069dc18abd service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:43:49.602305 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:43:49.602933 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:43:49.603227 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:43:49.603505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:43:49.605273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:43:49.630125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:43:49.631547 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:43:49.642862 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4393/8783] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:43:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:43:56.903219 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:43:56.904778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:43:57.001646 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48499-b1db-4b78-b4a9-d293c83584cb service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:43:57.009173 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fd94a-dbfa-4921-a1e9-cec0db3e6f20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:43:57.009927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fd94a-dbfa-4921-a1e9-cec0db3e6f20 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:43:57.010309 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fd94a-dbfa-4921-a1e9-cec0db3e6f20 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:43:57.010755 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fd94a-dbfa-4921-a1e9-cec0db3e6f20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:43:57.012706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-542fd94a-dbfa-4921-a1e9-cec0db3e6f20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:43:57.027826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fd94a-dbfa-4921-a1e9-cec0db3e6f20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:43:57.029614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fd94a-dbfa-4921-a1e9-cec0db3e6f20 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:43:57.052263 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4391/8784] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:43:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:43:57.073454 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:43:57.075416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:43:57.095224 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18069f-5a7f-4e0d-8122-a82d2441f87c service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:43:57.101479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:43:57.102289 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:43:57.102622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:43:57.102966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:43:57.104975 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:43:57.120375 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:43:57.122047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:43:57.136041 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4394/8785] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:43:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:44:04.534523 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9644346-94a9-4838-8b48-8a6ce0aabf3e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:04.535003 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9644346-94a9-4838-8b48-8a6ce0aabf3e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:04.535108 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9644346-94a9-4838-8b48-8a6ce0aabf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:04.552963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-f9644346-94a9-4838-8b48-8a6ce0aabf3e None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:44:04.554192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-f9644346-94a9-4838-8b48-8a6ce0aabf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:04.561390 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4392/8786] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:44:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:44:04.602385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:04.613329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d20aa-67ea-42a6-b9c2-5d17ab081cdd service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:04.618257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206edb8-23c5-44dc-a797-c9ab237e1a70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:04.618889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206edb8-23c5-44dc-a797-c9ab237e1a70 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:04.619174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206edb8-23c5-44dc-a797-c9ab237e1a70 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:04.619452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206edb8-23c5-44dc-a797-c9ab237e1a70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:04.627215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206edb8-23c5-44dc-a797-c9ab237e1a70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:04.628820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206edb8-23c5-44dc-a797-c9ab237e1a70 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:04.636681 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4395/8787] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:44:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:44:11.301172 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9644346-94a9-4838-8b48-8a6ce0aabf3e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:11.374198 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9644346-94a9-4838-8b48-8a6ce0aabf3e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:11.378699 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:11.379555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:11.379836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:11.380112 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] PATH_INFO: `/v3/users/9e9155525bc1486da02f94f41e30fc4e` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:11.381353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9155525bc1486da02f94f41e30fc4e)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:11.383977 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:11.427284 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9155525bc1486da02f94f41e30fc4e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.427941 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9155525bc1486da02f94f41e30fc4e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.429120 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9155525bc1486da02f94f41e30fc4e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.440669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9155525bc1486da02f94f41e30fc4e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.448549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9155525bc1486da02f94f41e30fc4e'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.460594 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4393/8788] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:44:11 2022] DELETE /identity/v3/users/9e9155525bc1486da02f94f41e30fc4e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:44:11.637452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206edb8-23c5-44dc-a797-c9ab237e1a70 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:11.649654 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206edb8-23c5-44dc-a797-c9ab237e1a70 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:11.705854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:11.706729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:11.707018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:11.707298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] PATH_INFO: `/v3/projects/5ff3f023fc254bbea87959ce0e95a1ae` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:11.708517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff3f023fc254bbea87959ce0e95a1ae)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:11.711096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:11.756490 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff3f023fc254bbea87959ce0e95a1ae', 'request_id': 'req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.762251 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff3f023fc254bbea87959ce0e95a1ae', 'request_id': 'req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.770182 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff3f023fc254bbea87959ce0e95a1ae', 'request_id': 'req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.798508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] The token cache is being invalidate because project 5ff3f023fc254bbea87959ce0e95a1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:44:11.798805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.799468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.801095 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4396/8789] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:44:11 2022] DELETE /identity/v3/projects/5ff3f023fc254bbea87959ce0e95a1ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:44:11.805304 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:11.806778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:11.821305 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d34b-c31c-4ad4-8885-780016f049f8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:11.876628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:11.877492 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:11.877778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:11.878059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] PATH_INFO: `/v3/users/b3d5f4ef2ea14f4ea0100c6ecca1ebbb` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:11.879537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d5f4ef2ea14f4ea0100c6ecca1ebbb)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:11.881508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:11.926982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d5f4ef2ea14f4ea0100c6ecca1ebbb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.927626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d5f4ef2ea14f4ea0100c6ecca1ebbb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.928235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d5f4ef2ea14f4ea0100c6ecca1ebbb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.940432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d5f4ef2ea14f4ea0100c6ecca1ebbb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.948229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e185a28d-5231-4871-9745-164630c4cc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d5f4ef2ea14f4ea0100c6ecca1ebbb'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:11.960068 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4394/8790] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:44:11 2022] DELETE /identity/v3/users/b3d5f4ef2ea14f4ea0100c6ecca1ebbb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:44:12.141615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.143117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:12.155909 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f6a1e-40fb-47df-886b-798a7a2e80a4 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:12.212942 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:12.213798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.214082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.214364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] PATH_INFO: `/v3/projects/7fb4e8e471a2429f99d1ccc60cd5a9c7` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.215545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb4e8e471a2429f99d1ccc60cd5a9c7)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:12.217500 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:12.261915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb4e8e471a2429f99d1ccc60cd5a9c7', 'request_id': 'req-95974a3d-a019-422b-a140-3cdef74af68f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:12.266996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb4e8e471a2429f99d1ccc60cd5a9c7', 'request_id': 'req-95974a3d-a019-422b-a140-3cdef74af68f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:12.274047 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb4e8e471a2429f99d1ccc60cd5a9c7', 'request_id': 'req-95974a3d-a019-422b-a140-3cdef74af68f'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:12.285174 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] The token cache is being invalidate because project 7fb4e8e471a2429f99d1ccc60cd5a9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:44:12.285460 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:12.286082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-95974a3d-a019-422b-a140-3cdef74af68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:44:12.287664 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4397/8791] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:44:12 2022] DELETE /identity/v3/projects/7fb4e8e471a2429f99d1ccc60cd5a9c7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:44:12.292780 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f342dd-aee3-4f3a-9646-bb4c4de56cac None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.293073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f342dd-aee3-4f3a-9646-bb4c4de56cac None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.293357 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f342dd-aee3-4f3a-9646-bb4c4de56cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.349100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-91f342dd-aee3-4f3a-9646-bb4c4de56cac None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:44:12.350229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-91f342dd-aee3-4f3a-9646-bb4c4de56cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:12.406975 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4395/8792] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:44:12.415180 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94691330-ea88-402e-99e7-22a18d1e21ec None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.415470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94691330-ea88-402e-99e7-22a18d1e21ec None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.415752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94691330-ea88-402e-99e7-22a18d1e21ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.435065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-94691330-ea88-402e-99e7-22a18d1e21ec None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:44:12.436303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-94691330-ea88-402e-99e7-22a18d1e21ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:12.444557 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4398/8793] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:44:12.448627 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f342dd-aee3-4f3a-9646-bb4c4de56cac None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.458159 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f342dd-aee3-4f3a-9646-bb4c4de56cac None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:12.462749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:12.463391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.463673 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.463948 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.464690 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:44:12.464998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:12.466584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:12.478376 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4396/8794] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:44:12.482646 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94691330-ea88-402e-99e7-22a18d1e21ec None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.492546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94691330-ea88-402e-99e7-22a18d1e21ec None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:12.497384 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0be54-3169-4aa3-8c92-32b17b4f970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:12.497996 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0be54-3169-4aa3-8c92-32b17b4f970e admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.498294 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0be54-3169-4aa3-8c92-32b17b4f970e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.498561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0be54-3169-4aa3-8c92-32b17b4f970e admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.499246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0be54-3169-4aa3-8c92-32b17b4f970e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:12.501470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0be54-3169-4aa3-8c92-32b17b4f970e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:12.535601 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4399/8795] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:44:12 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:44:12.540343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.550211 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2c09-ac8e-402b-89a3-f132456a0cda admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:12.604709 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228fb6-a63c-4fc5-b2ef-ba9505ddcf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:12.605279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228fb6-a63c-4fc5-b2ef-ba9505ddcf3a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.605559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228fb6-a63c-4fc5-b2ef-ba9505ddcf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.605836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228fb6-a63c-4fc5-b2ef-ba9505ddcf3a admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.606547 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13228fb6-a63c-4fc5-b2ef-ba9505ddcf3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:12.608483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13228fb6-a63c-4fc5-b2ef-ba9505ddcf3a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:12.628197 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4397/8796] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:44:12 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:44:12.632309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0be54-3169-4aa3-8c92-32b17b4f970e admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.642601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0be54-3169-4aa3-8c92-32b17b4f970e admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:12.647355 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ab91-e038-413d-88bf-6545b4f35ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:12.648013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ab91-e038-413d-88bf-6545b4f35ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.648301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ab91-e038-413d-88bf-6545b4f35ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.648644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ab91-e038-413d-88bf-6545b4f35ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.649364 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711ab91-e038-413d-88bf-6545b4f35ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:12.650959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711ab91-e038-413d-88bf-6545b4f35ff3 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:12.660878 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4400/8797] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:44:12.665199 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228fb6-a63c-4fc5-b2ef-ba9505ddcf3a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.675584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228fb6-a63c-4fc5-b2ef-ba9505ddcf3a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:12.680924 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822878e0-4acc-488a-9e1c-aa231ffd3879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:12.681575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822878e0-4acc-488a-9e1c-aa231ffd3879 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.681860 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822878e0-4acc-488a-9e1c-aa231ffd3879 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.682141 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822878e0-4acc-488a-9e1c-aa231ffd3879 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.682859 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822878e0-4acc-488a-9e1c-aa231ffd3879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:12.684468 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822878e0-4acc-488a-9e1c-aa231ffd3879 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:12.694859 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4398/8798] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:44:12.698998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ab91-e038-413d-88bf-6545b4f35ff3 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.709430 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ab91-e038-413d-88bf-6545b4f35ff3 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:12.714622 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105d35-ae39-4b4c-afd2-70c7acd938a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:12.715499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d35-ae39-4b4c-afd2-70c7acd938a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.715786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d35-ae39-4b4c-afd2-70c7acd938a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.716062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d35-ae39-4b4c-afd2-70c7acd938a5 admin admin] PATH_INFO: `/v3/projects/0b842c60e89342ae92bbc9f9b568e4c2/users/d4322cc0fa954031bbf07e95c5cf1fb7/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.731095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9105d35-ae39-4b4c-afd2-70c7acd938a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b842c60e89342ae92bbc9f9b568e4c2, user_id=d4322cc0fa954031bbf07e95c5cf1fb7, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:12.733905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9105d35-ae39-4b4c-afd2-70c7acd938a5 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:12.747704 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4401/8799] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:44:12 2022] PUT /identity/v3/projects/0b842c60e89342ae92bbc9f9b568e4c2/users/d4322cc0fa954031bbf07e95c5cf1fb7/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:44:12.758164 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5700a2-6fb8-4cc9-99a8-e6e1688871be None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.758578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5700a2-6fb8-4cc9-99a8-e6e1688871be None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.758932 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5700a2-6fb8-4cc9-99a8-e6e1688871be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.786023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bb5700a2-6fb8-4cc9-99a8-e6e1688871be None None] MFA Rules not processed for user `d4322cc0fa954031bbf07e95c5cf1fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:44:12.787243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bb5700a2-6fb8-4cc9-99a8-e6e1688871be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:12.850099 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4399/8800] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:44:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:44:12.855273 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105d35-ae39-4b4c-afd2-70c7acd938a5 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.915069 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105d35-ae39-4b4c-afd2-70c7acd938a5 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:12.919907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4922a9-b3c8-4e0e-9b03-2cf253f6ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:12.920599 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4922a9-b3c8-4e0e-9b03-2cf253f6ed75 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:12.920884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4922a9-b3c8-4e0e-9b03-2cf253f6ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:12.921173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4922a9-b3c8-4e0e-9b03-2cf253f6ed75 admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:12.921865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4922a9-b3c8-4e0e-9b03-2cf253f6ed75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:12.923777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4922a9-b3c8-4e0e-9b03-2cf253f6ed75 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:12.948164 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4402/8801] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:44:12 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:44:12.952150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5700a2-6fb8-4cc9-99a8-e6e1688871be None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:12.963217 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5700a2-6fb8-4cc9-99a8-e6e1688871be None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:13.017331 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1107ad2-01fa-4224-a87e-66c6300ee0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:13.017990 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1107ad2-01fa-4224-a87e-66c6300ee0af admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:13.018278 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1107ad2-01fa-4224-a87e-66c6300ee0af admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:13.018554 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1107ad2-01fa-4224-a87e-66c6300ee0af admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:13.019239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1107ad2-01fa-4224-a87e-66c6300ee0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:13.021194 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1107ad2-01fa-4224-a87e-66c6300ee0af admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:13.041389 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4400/8802] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:44:12 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 21:44:13.045368 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4922a9-b3c8-4e0e-9b03-2cf253f6ed75 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:13.055417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4922a9-b3c8-4e0e-9b03-2cf253f6ed75 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:13.060155 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8fbdb-bc09-4586-a24c-030419917959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:13.060827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8fbdb-bc09-4586-a24c-030419917959 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:13.061111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8fbdb-bc09-4586-a24c-030419917959 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:13.061388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8fbdb-bc09-4586-a24c-030419917959 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:13.062096 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8fbdb-bc09-4586-a24c-030419917959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:13.063672 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8fbdb-bc09-4586-a24c-030419917959 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:13.074864 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4403/8803] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:44:13.078846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1107ad2-01fa-4224-a87e-66c6300ee0af admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:13.089341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1107ad2-01fa-4224-a87e-66c6300ee0af admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:13.098525 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822ab88-8f6a-417b-8eef-97a3678ea93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:13.099414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822ab88-8f6a-417b-8eef-97a3678ea93b admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:13.099681 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822ab88-8f6a-417b-8eef-97a3678ea93b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:13.099950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822ab88-8f6a-417b-8eef-97a3678ea93b admin admin] PATH_INFO: `/v3/projects/4a665c7638db4b23b57fc76d3c3ab6c2/users/06f0a65f42c74237a898f4c3fc71e626/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:13.114754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822ab88-8f6a-417b-8eef-97a3678ea93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a665c7638db4b23b57fc76d3c3ab6c2, user_id=06f0a65f42c74237a898f4c3fc71e626, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:13.117434 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822ab88-8f6a-417b-8eef-97a3678ea93b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:13.130230 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4401/8804] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:44:13 2022] PUT /identity/v3/projects/4a665c7638db4b23b57fc76d3c3ab6c2/users/06f0a65f42c74237a898f4c3fc71e626/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:44:13.134666 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8fbdb-bc09-4586-a24c-030419917959 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:13.144546 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8fbdb-bc09-4586-a24c-030419917959 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:13.199868 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19720b6b-d59d-4a8a-9337-c273afe07125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:13.200602 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720b6b-d59d-4a8a-9337-c273afe07125 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:13.200888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720b6b-d59d-4a8a-9337-c273afe07125 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:13.201169 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720b6b-d59d-4a8a-9337-c273afe07125 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:13.202019 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19720b6b-d59d-4a8a-9337-c273afe07125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:13.203642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19720b6b-d59d-4a8a-9337-c273afe07125 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:13.214244 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4404/8805] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:44:13.218317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822ab88-8f6a-417b-8eef-97a3678ea93b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:13.228502 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822ab88-8f6a-417b-8eef-97a3678ea93b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:13.233184 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:13.234052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:13.234335 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:13.234615 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] PATH_INFO: `/v3/projects/4a665c7638db4b23b57fc76d3c3ab6c2/users/06f0a65f42c74237a898f4c3fc71e626/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:13.236726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a665c7638db4b23b57fc76d3c3ab6c2, user_id=06f0a65f42c74237a898f4c3fc71e626, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:13.239367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:13.249451 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4402/8806] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:44:13 2022] PUT /identity/v3/projects/4a665c7638db4b23b57fc76d3c3ab6c2/users/06f0a65f42c74237a898f4c3fc71e626/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:44:13.259378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55203b-4e5a-4ded-8dd5-ab5dc285fbb8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:13.259667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55203b-4e5a-4ded-8dd5-ab5dc285fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:13.259947 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55203b-4e5a-4ded-8dd5-ab5dc285fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:13.285889 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cd55203b-4e5a-4ded-8dd5-ab5dc285fbb8 None None] MFA Rules not processed for user `06f0a65f42c74237a898f4c3fc71e626`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:44:13.287071 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cd55203b-4e5a-4ded-8dd5-ab5dc285fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:13.353410 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4405/8807] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:44:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:44:13.364719 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:13.366511 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:13.440814 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dfb43-f149-4eb5-9ecb-403859620cd8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:13.447079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb982ec3-adaa-45bc-b800-4076c7a92392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:13.447720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982ec3-adaa-45bc-b800-4076c7a92392 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:13.448007 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982ec3-adaa-45bc-b800-4076c7a92392 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:13.448288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982ec3-adaa-45bc-b800-4076c7a92392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:13.501324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb982ec3-adaa-45bc-b800-4076c7a92392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:13.502914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb982ec3-adaa-45bc-b800-4076c7a92392 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:13.512728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4403/8808] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:44:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:44:16.857005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55203b-4e5a-4ded-8dd5-ab5dc285fbb8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:16.858608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cd55203b-4e5a-4ded-8dd5-ab5dc285fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:16.914216 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55203b-4e5a-4ded-8dd5-ab5dc285fbb8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:16.917870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde52d0-759a-4c33-a6f4-870abdf3e015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:16.918522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde52d0-759a-4c33-a6f4-870abdf3e015 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:16.918809 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde52d0-759a-4c33-a6f4-870abdf3e015 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:16.919087 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde52d0-759a-4c33-a6f4-870abdf3e015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:16.928153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde52d0-759a-4c33-a6f4-870abdf3e015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:16.929614 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde52d0-759a-4c33-a6f4-870abdf3e015 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:16.940122 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4406/8809] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:44:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:44:19.911608 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ec51e-156b-4fc3-9ae5-6f6c3d4eda3b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:19.912179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ec51e-156b-4fc3-9ae5-6f6c3d4eda3b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:19.912179 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ec51e-156b-4fc3-9ae5-6f6c3d4eda3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:19.930051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-df4ec51e-156b-4fc3-9ae5-6f6c3d4eda3b None None] MFA Rules not processed for user `d4322cc0fa954031bbf07e95c5cf1fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:44:19.931336 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-df4ec51e-156b-4fc3-9ae5-6f6c3d4eda3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:19.939517 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4404/8810] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:44:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:44:20.312955 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde52d0-759a-4c33-a6f4-870abdf3e015 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:20.322308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde52d0-759a-4c33-a6f4-870abdf3e015 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:20.326083 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:20.326731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:20.327010 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:20.327285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:20.329200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:20.342803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:20.344276 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:20.358141 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4407/8811] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:44:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:44:20.681348 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ec51e-156b-4fc3-9ae5-6f6c3d4eda3b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:20.683212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-df4ec51e-156b-4fc3-9ae5-6f6c3d4eda3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:20.776076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ec51e-156b-4fc3-9ae5-6f6c3d4eda3b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:20.781324 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:20.782043 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:20.782325 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:20.782598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:20.784555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:20.796818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:20.798401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:20.808769 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4405/8812] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:44:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:44:22.870853 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:22.872913 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:22.884053 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4348d21-86f0-48cb-bbc3-778f3556f94a service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:22.888077 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab25a3-4131-4349-8f5f-57ea7b8736db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:22.888783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab25a3-4131-4349-8f5f-57ea7b8736db service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:22.889067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab25a3-4131-4349-8f5f-57ea7b8736db service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:22.889520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab25a3-4131-4349-8f5f-57ea7b8736db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:22.891685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8bab25a3-4131-4349-8f5f-57ea7b8736db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:22.905133 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab25a3-4131-4349-8f5f-57ea7b8736db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:22.906584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab25a3-4131-4349-8f5f-57ea7b8736db service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:22.919523 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4408/8813] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:44:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:44:23.582900 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:44:23.584773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:23.605713 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad48d-e46a-46b7-9710-b971d596f168 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:44:23.611815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:44:23.613339 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:44:23.613722 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:44:23.614223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:44:23.616689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:44:23.634119 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:44:23.635853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:44:23.651865 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4406/8814] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:44:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:45:21.667461 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b837-5e55-491c-a35a-250515647fe8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:45:21.668006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b837-5e55-491c-a35a-250515647fe8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:45:21.668181 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b837-5e55-491c-a35a-250515647fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:45:21.687632 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fb10b837-5e55-491c-a35a-250515647fe8 None None] MFA Rules not processed for user `d4322cc0fa954031bbf07e95c5cf1fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:45:21.688905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fb10b837-5e55-491c-a35a-250515647fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:45:21.700990 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4409/8815] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:45:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:45:22.489313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:45:22.490989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:45:22.516206 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1c28a-a937-4313-b33d-877fc4916b9f service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:45:22.543726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6ebbb-f70c-4c6b-a01b-0615fb1d3566 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:45:22.544448 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6ebbb-f70c-4c6b-a01b-0615fb1d3566 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:45:22.544739 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6ebbb-f70c-4c6b-a01b-0615fb1d3566 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:45:22.545018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6ebbb-f70c-4c6b-a01b-0615fb1d3566 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:45:22.546973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-56d6ebbb-f70c-4c6b-a01b-0615fb1d3566 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:45:22.569114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6ebbb-f70c-4c6b-a01b-0615fb1d3566 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:45:22.574950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6ebbb-f70c-4c6b-a01b-0615fb1d3566 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:45:22.600395 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4407/8816] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:45:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:45:31.715366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10b837-5e55-491c-a35a-250515647fe8 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:45:31.733373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10b837-5e55-491c-a35a-250515647fe8 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:45:31.739426 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:45:31.740082 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:45:31.740397 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:45:31.740679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:45:31.742486 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:45:31.757823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:45:31.759748 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:45:31.773665 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4410/8817] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:45:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:46:00.843909 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3ad5-b1a5-4154-81ab-519914f40414 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:46:00.844559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3ad5-b1a5-4154-81ab-519914f40414 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:46:00.844559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce3ad5-b1a5-4154-81ab-519914f40414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:46:00.889795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-bbce3ad5-b1a5-4154-81ab-519914f40414 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:46:00.890989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bbce3ad5-b1a5-4154-81ab-519914f40414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:46:00.899717 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4408/8818] 10.222.0.67 () {58 vars in 1015 bytes} [Sat Feb 19 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:46:00.912079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:46:00.925431 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eade2-563c-424d-a075-5d063ce080ec service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:46:00.930893 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77fef-d026-43c6-bcd2-ecec5a22ec2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:46:00.931521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77fef-d026-43c6-bcd2-ecec5a22ec2e service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:46:00.931799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77fef-d026-43c6-bcd2-ecec5a22ec2e service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:46:00.932075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77fef-d026-43c6-bcd2-ecec5a22ec2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:46:00.940091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f77fef-d026-43c6-bcd2-ecec5a22ec2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:46:00.941691 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f77fef-d026-43c6-bcd2-ecec5a22ec2e service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:46:00.952105 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4411/8819] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:46:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:46:01.056803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce78e88-cde3-435a-a4ba-7c37b79539a5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:46:01.057093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce78e88-cde3-435a-a4ba-7c37b79539a5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:46:01.057372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce78e88-cde3-435a-a4ba-7c37b79539a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:46:01.075828 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-6ce78e88-cde3-435a-a4ba-7c37b79539a5 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:46:01.077088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6ce78e88-cde3-435a-a4ba-7c37b79539a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:46:01.085641 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4409/8820] 10.222.0.10 () {58 vars in 1015 bytes} [Sat Feb 19 21:46:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:46:01.098887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77fef-d026-43c6-bcd2-ecec5a22ec2e service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:46:01.112248 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77fef-d026-43c6-bcd2-ecec5a22ec2e service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:46:01.118124 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620ebb-66e3-49ab-a783-e7a88d3acc1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:46:01.118750 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620ebb-66e3-49ab-a783-e7a88d3acc1b service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:46:01.119028 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620ebb-66e3-49ab-a783-e7a88d3acc1b service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:46:01.119303 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620ebb-66e3-49ab-a783-e7a88d3acc1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:46:01.127455 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77620ebb-66e3-49ab-a783-e7a88d3acc1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:46:01.129058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77620ebb-66e3-49ab-a783-e7a88d3acc1b service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:46:01.138655 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4412/8821] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:46:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:46:38.933223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce78e88-cde3-435a-a4ba-7c37b79539a5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:46:38.943349 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce78e88-cde3-435a-a4ba-7c37b79539a5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:46:38.947786 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:46:38.948465 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:46:38.949312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:46:38.949312 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:46:38.950784 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:46:38.967989 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:46:38.969471 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:46:38.983424 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4410/8822] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:46:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:46:40.261322 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620ebb-66e3-49ab-a783-e7a88d3acc1b service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:46:40.270387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620ebb-66e3-49ab-a783-e7a88d3acc1b service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:46:40.274495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2dd13-561a-4e9c-9035-7345a9e111e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:46:40.275115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2dd13-561a-4e9c-9035-7345a9e111e3 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:46:40.275391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2dd13-561a-4e9c-9035-7345a9e111e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:46:40.275661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2dd13-561a-4e9c-9035-7345a9e111e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:46:40.277440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-48e2dd13-561a-4e9c-9035-7345a9e111e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:46:40.293408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2dd13-561a-4e9c-9035-7345a9e111e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:46:40.294811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2dd13-561a-4e9c-9035-7345a9e111e3 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:46:40.307825 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4413/8823] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:46:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:47:40.577153 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:47:40.593805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb211bea-efbf-4e34-933f-345717ecab48 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:47:40.600480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:47:40.601299 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:47:40.601586 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:47:40.602333 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:47:40.604283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:47:40.621937 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:47:40.623537 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:47:40.637329 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4411/8824] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:47:53.533297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dbd3b-5345-4c4b-9e2e-434981cc9175 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:47:53.533863 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dbd3b-5345-4c4b-9e2e-434981cc9175 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:47:53.534075 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dbd3b-5345-4c4b-9e2e-434981cc9175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:47:53.554887 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6d0dbd3b-5345-4c4b-9e2e-434981cc9175 None None] MFA Rules not processed for user `d4322cc0fa954031bbf07e95c5cf1fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:47:53.556446 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6d0dbd3b-5345-4c4b-9e2e-434981cc9175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:47:53.564748 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4414/8825] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:47:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:48:35.777882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:35.795984 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7857fe5-7e54-4c8e-be71-ac185ec4de19 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:35.799610 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144b809-655e-49e1-aa0e-89731f531377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:35.800234 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144b809-655e-49e1-aa0e-89731f531377 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:35.800544 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144b809-655e-49e1-aa0e-89731f531377 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:35.800820 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144b809-655e-49e1-aa0e-89731f531377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:35.802534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9144b809-655e-49e1-aa0e-89731f531377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:35.814187 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144b809-655e-49e1-aa0e-89731f531377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:35.815603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144b809-655e-49e1-aa0e-89731f531377 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:35.826869 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4412/8826] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:36.970883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dbd3b-5345-4c4b-9e2e-434981cc9175 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:36.974619 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b749-4d82-4761-ba4b-2ed7da132c9b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:36.975044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b749-4d82-4761-ba4b-2ed7da132c9b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:36.975216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b749-4d82-4761-ba4b-2ed7da132c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:36.981731 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dbd3b-5345-4c4b-9e2e-434981cc9175 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:36.985298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57543dca-9104-40e1-af7d-44050a7f9837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:36.985938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543dca-9104-40e1-af7d-44050a7f9837 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:36.986218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543dca-9104-40e1-af7d-44050a7f9837 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:36.986491 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543dca-9104-40e1-af7d-44050a7f9837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:36.988240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-57543dca-9104-40e1-af7d-44050a7f9837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:37.000605 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543dca-9104-40e1-af7d-44050a7f9837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:37.002644 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543dca-9104-40e1-af7d-44050a7f9837 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:37.012470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-4915b749-4d82-4761-ba4b-2ed7da132c9b None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:37.013660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4915b749-4d82-4761-ba4b-2ed7da132c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:37.013808 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4415/8827] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:37.023608 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4413/8828] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Feb 19 21:48:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:48:37.029908 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aca44-f140-4b7e-9421-df03a72546c2 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:37.030197 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aca44-f140-4b7e-9421-df03a72546c2 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:37.030479 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aca44-f140-4b7e-9421-df03a72546c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:37.048470 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-988aca44-f140-4b7e-9421-df03a72546c2 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:37.049709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-988aca44-f140-4b7e-9421-df03a72546c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:37.059463 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4416/8829] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:48:37.076281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b749-4d82-4761-ba4b-2ed7da132c9b None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:37.085609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b749-4d82-4761-ba4b-2ed7da132c9b None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:37.089963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472252c-3919-4635-83bf-87624c50f3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:37.090598 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472252c-3919-4635-83bf-87624c50f3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:37.090876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472252c-3919-4635-83bf-87624c50f3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:37.091150 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472252c-3919-4635-83bf-87624c50f3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:37.102273 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472252c-3919-4635-83bf-87624c50f3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:37.103734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472252c-3919-4635-83bf-87624c50f3f2 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:37.109805 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2d752-d467-4597-9c08-3caaddf90afe None None] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:37.110173 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2d752-d467-4597-9c08-3caaddf90afe None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:37.110522 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2d752-d467-4597-9c08-3caaddf90afe None None] PATH_INFO: `/` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:37.112561 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4417/8830] 10.222.0.30 () {54 vars in 921 bytes} [Sat Feb 19 21:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 19 21:48:37.115346 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4414/8831] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:37.117545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4eea-f5a7-4765-8748-22c5210446c4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:37.117918 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4eea-f5a7-4765-8748-22c5210446c4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:37.118275 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4eea-f5a7-4765-8748-22c5210446c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:37.137727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9d0e4eea-f5a7-4765-8748-22c5210446c4 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:37.139044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9d0e4eea-f5a7-4765-8748-22c5210446c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:37.150509 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4418/8832] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:48:37.170483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047a97-370c-47e0-83c4-3155c90cbdc0 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:37.170778 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047a97-370c-47e0-83c4-3155c90cbdc0 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:37.171063 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047a97-370c-47e0-83c4-3155c90cbdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:37.189882 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-32047a97-370c-47e0-83c4-3155c90cbdc0 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:37.191098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-32047a97-370c-47e0-83c4-3155c90cbdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:37.201205 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4415/8833] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Feb 19 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:48:37.207285 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e4eea-f5a7-4765-8748-22c5210446c4 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:37.218317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e4eea-f5a7-4765-8748-22c5210446c4 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:37.223796 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a05ee0-3244-4010-b035-78f183d22c2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:37.224495 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a05ee0-3244-4010-b035-78f183d22c2a service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:37.224779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a05ee0-3244-4010-b035-78f183d22c2a service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:37.225899 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a05ee0-3244-4010-b035-78f183d22c2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:37.234694 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a05ee0-3244-4010-b035-78f183d22c2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:37.236520 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a05ee0-3244-4010-b035-78f183d22c2a service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:37.247040 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4419/8834] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:37.406546 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32047a97-370c-47e0-83c4-3155c90cbdc0 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:37.415749 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32047a97-370c-47e0-83c4-3155c90cbdc0 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:37.419432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:37.420099 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:37.420399 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:37.420672 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:37.422414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:37.438516 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:37.439934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:37.453926 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4416/8835] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:38.227125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcf75-ceed-4c98-846d-3aa341b19b45 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:38.227685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcf75-ceed-4c98-846d-3aa341b19b45 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:38.227685 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcf75-ceed-4c98-846d-3aa341b19b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:38.263089 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-af6fcf75-ceed-4c98-846d-3aa341b19b45 None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:38.264288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-af6fcf75-ceed-4c98-846d-3aa341b19b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:38.271538 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4420/8836] 10.222.0.10 () {58 vars in 1015 bytes} [Sat Feb 19 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:48:38.282782 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:38.291556 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51eb36-744b-42d2-bfe1-3d29a60116f3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:38.295290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53df92-0dc4-4f87-b507-dca30c2ab5e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:38.295983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53df92-0dc4-4f87-b507-dca30c2ab5e0 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:38.296479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53df92-0dc4-4f87-b507-dca30c2ab5e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:38.296760 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53df92-0dc4-4f87-b507-dca30c2ab5e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:38.304014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53df92-0dc4-4f87-b507-dca30c2ab5e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:38.305475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53df92-0dc4-4f87-b507-dca30c2ab5e0 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:38.314132 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4417/8837] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:38.314298 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d7134-5637-435e-a56d-274ef0680d30 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:38.314471 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d7134-5637-435e-a56d-274ef0680d30 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:38.314777 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d7134-5637-435e-a56d-274ef0680d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:38.333834 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ce7d7134-5637-435e-a56d-274ef0680d30 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:38.335055 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ce7d7134-5637-435e-a56d-274ef0680d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:38.345078 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4421/8838] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Feb 19 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:48:38.351279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf274c3-5e3b-4fd1-9813-81772e9a20b3 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:38.351568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf274c3-5e3b-4fd1-9813-81772e9a20b3 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:38.351845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf274c3-5e3b-4fd1-9813-81772e9a20b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:38.371089 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-1bf274c3-5e3b-4fd1-9813-81772e9a20b3 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:38.372205 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-1bf274c3-5e3b-4fd1-9813-81772e9a20b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:38.383943 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4418/8839] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:48:38.394874 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d7134-5637-435e-a56d-274ef0680d30 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:38.404974 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d7134-5637-435e-a56d-274ef0680d30 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:38.408663 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ecf34-1fe8-4f69-a695-ea319d5b4f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:38.409326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecf34-1fe8-4f69-a695-ea319d5b4f72 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:38.409610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecf34-1fe8-4f69-a695-ea319d5b4f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:38.409891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecf34-1fe8-4f69-a695-ea319d5b4f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:38.421466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ecf34-1fe8-4f69-a695-ea319d5b4f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:38.422921 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ecf34-1fe8-4f69-a695-ea319d5b4f72 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:38.434748 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4422/8840] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:51.066180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf274c3-5e3b-4fd1-9813-81772e9a20b3 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:51.075593 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf274c3-5e3b-4fd1-9813-81772e9a20b3 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:51.079287 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:51.079916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:51.080224 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:51.080524 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:51.082241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:51.094822 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:51.096432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:51.107500 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4419/8841] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:51.581125 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abf3e4-d304-45f1-8b0f-f3101b1224a6 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:51.581612 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abf3e4-d304-45f1-8b0f-f3101b1224a6 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:51.581745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abf3e4-d304-45f1-8b0f-f3101b1224a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:51.600105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-86abf3e4-d304-45f1-8b0f-f3101b1224a6 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:51.601354 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-86abf3e4-d304-45f1-8b0f-f3101b1224a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:51.610730 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4423/8842] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:48:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:48:51.634738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:51.654058 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ae2f5-79bb-42f5-97af-c8394854017d service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:51.659953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16309-893b-4413-bf46-98658023821f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:51.660703 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16309-893b-4413-bf46-98658023821f service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:51.660987 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16309-893b-4413-bf46-98658023821f service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:51.661264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16309-893b-4413-bf46-98658023821f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:51.671575 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf16309-893b-4413-bf46-98658023821f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:51.673391 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf16309-893b-4413-bf46-98658023821f service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:51.685540 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4420/8843] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:48:58.695391 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0a5b-98f3-4819-a2c6-73e3f513c944 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:58.696258 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0a5b-98f3-4819-a2c6-73e3f513c944 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:58.696588 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0a5b-98f3-4819-a2c6-73e3f513c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:58.721149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-235d0a5b-98f3-4819-a2c6-73e3f513c944 None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:48:58.722406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-235d0a5b-98f3-4819-a2c6-73e3f513c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:48:58.738964 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4424/8844] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:48:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:48:58.870382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16309-893b-4413-bf46-98658023821f service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:48:58.883905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16309-893b-4413-bf46-98658023821f service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:48:58.890228 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120fd0-1774-45c2-890e-4505b5503a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:48:58.890864 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120fd0-1774-45c2-890e-4505b5503a36 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:48:58.891147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120fd0-1774-45c2-890e-4505b5503a36 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:48:58.891459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120fd0-1774-45c2-890e-4505b5503a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:48:58.901426 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120fd0-1774-45c2-890e-4505b5503a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:48:58.903313 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120fd0-1774-45c2-890e-4505b5503a36 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:48:58.917057 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4421/8845] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:48:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:49:28.246779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0a5b-98f3-4819-a2c6-73e3f513c944 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:49:28.258011 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0a5b-98f3-4819-a2c6-73e3f513c944 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:49:28.264044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcff08-7b32-473a-89c3-caeba24b2cc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:49:28.264721 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcff08-7b32-473a-89c3-caeba24b2cc2 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:28.265012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcff08-7b32-473a-89c3-caeba24b2cc2 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:28.265292 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcff08-7b32-473a-89c3-caeba24b2cc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:28.272998 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcff08-7b32-473a-89c3-caeba24b2cc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:49:28.274569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcff08-7b32-473a-89c3-caeba24b2cc2 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:49:28.284215 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4425/8846] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:49:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:49:45.631411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6ec78-b852-4931-bf91-ba88571f7f7f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:45.632366 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6ec78-b852-4931-bf91-ba88571f7f7f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:45.632853 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6ec78-b852-4931-bf91-ba88571f7f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:45.656908 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b3a6ec78-b852-4931-bf91-ba88571f7f7f None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:49:45.658131 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b3a6ec78-b852-4931-bf91-ba88571f7f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:49:45.669468 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4422/8847] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:49:45.681705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcff08-7b32-473a-89c3-caeba24b2cc2 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:49:45.695122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcff08-7b32-473a-89c3-caeba24b2cc2 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:49:45.701914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f1e8-6bad-453c-a6bb-f5c7ce5f61c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:49:45.702609 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f1e8-6bad-453c-a6bb-f5c7ce5f61c5 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:45.702897 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f1e8-6bad-453c-a6bb-f5c7ce5f61c5 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:45.703177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f1e8-6bad-453c-a6bb-f5c7ce5f61c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:45.714659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2f1e8-6bad-453c-a6bb-f5c7ce5f61c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:49:45.715878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2f1e8-6bad-453c-a6bb-f5c7ce5f61c5 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:49:45.735843 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4426/8848] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:49:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:49:45.803161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0914e6-19b6-4492-beab-02ce849a801f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:45.803489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0914e6-19b6-4492-beab-02ce849a801f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:45.803772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0914e6-19b6-4492-beab-02ce849a801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:45.823697 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-dd0914e6-19b6-4492-beab-02ce849a801f None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:49:45.824954 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-dd0914e6-19b6-4492-beab-02ce849a801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:49:45.831761 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4423/8849] 10.222.0.67 () {58 vars in 1015 bytes} [Sat Feb 19 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:49:45.848813 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f1e8-6bad-453c-a6bb-f5c7ce5f61c5 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:49:45.859208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f1e8-6bad-453c-a6bb-f5c7ce5f61c5 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:49:45.863892 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ef95f-945d-46a7-b415-53bdbb59f3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:49:45.864849 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef95f-945d-46a7-b415-53bdbb59f3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:45.865348 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef95f-945d-46a7-b415-53bdbb59f3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:45.865888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef95f-945d-46a7-b415-53bdbb59f3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:45.874206 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ef95f-945d-46a7-b415-53bdbb59f3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:49:45.876062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ef95f-945d-46a7-b415-53bdbb59f3c4 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:49:45.884705 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4427/8850] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:49:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:49:55.475846 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0914e6-19b6-4492-beab-02ce849a801f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:49:55.484392 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0914e6-19b6-4492-beab-02ce849a801f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:49:55.488245 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd7b46-1561-4a57-8aea-8169c86589de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:49:55.488983 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd7b46-1561-4a57-8aea-8169c86589de service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:55.489358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd7b46-1561-4a57-8aea-8169c86589de service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:55.489696 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd7b46-1561-4a57-8aea-8169c86589de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:55.499884 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd7b46-1561-4a57-8aea-8169c86589de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:49:55.501424 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd7b46-1561-4a57-8aea-8169c86589de service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:49:55.511971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4424/8851] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:49:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:49:58.562965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4a7e-7e4e-4d4a-b430-934f8228f235 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:58.562965 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4a7e-7e4e-4d4a-b430-934f8228f235 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:58.563729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4a7e-7e4e-4d4a-b430-934f8228f235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:58.583043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fdff4a7e-7e4e-4d4a-b430-934f8228f235 None None] MFA Rules not processed for user `d4322cc0fa954031bbf07e95c5cf1fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:49:58.584940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fdff4a7e-7e4e-4d4a-b430-934f8228f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:49:58.594148 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4428/8852] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:49:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:49:58.946098 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0b85-ccaf-4fec-a881-5704c2c4ae4e None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:58.946658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0b85-ccaf-4fec-a881-5704c2c4ae4e None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:58.946658 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0b85-ccaf-4fec-a881-5704c2c4ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:58.970902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-be7a0b85-ccaf-4fec-a881-5704c2c4ae4e None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:49:58.972734 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-be7a0b85-ccaf-4fec-a881-5704c2c4ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:49:58.981758 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4425/8853] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:49:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:49:58.995472 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff4a7e-7e4e-4d4a-b430-934f8228f235 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:49:59.010584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff4a7e-7e4e-4d4a-b430-934f8228f235 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:49:59.014598 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e26e6-5d4b-4e60-b30b-f3f88e23fc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:49:59.015243 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e26e6-5d4b-4e60-b30b-f3f88e23fc73 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:59.015801 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e26e6-5d4b-4e60-b30b-f3f88e23fc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:59.016079 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e26e6-5d4b-4e60-b30b-f3f88e23fc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:59.024250 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e26e6-5d4b-4e60-b30b-f3f88e23fc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:49:59.026330 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e26e6-5d4b-4e60-b30b-f3f88e23fc73 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:49:59.040210 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4429/8854] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:49:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:49:59.472773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a0b85-ccaf-4fec-a881-5704c2c4ae4e None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:49:59.496751 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a0b85-ccaf-4fec-a881-5704c2c4ae4e None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:49:59.502149 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78d15-25b1-4354-bf17-5e35e642b055 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:49:59.502899 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78d15-25b1-4354-bf17-5e35e642b055 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:49:59.503239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78d15-25b1-4354-bf17-5e35e642b055 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:49:59.503592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78d15-25b1-4354-bf17-5e35e642b055 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:49:59.513657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a78d15-25b1-4354-bf17-5e35e642b055 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:49:59.515461 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a78d15-25b1-4354-bf17-5e35e642b055 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:49:59.527465 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4426/8855] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:49:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:51:06.036122 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e26e6-5d4b-4e60-b30b-f3f88e23fc73 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:51:06.047938 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e26e6-5d4b-4e60-b30b-f3f88e23fc73 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:51:06.053261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b23880-4889-46d5-a5a9-161c1f38b738 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:51:06.053901 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b23880-4889-46d5-a5a9-161c1f38b738 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:51:06.054186 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b23880-4889-46d5-a5a9-161c1f38b738 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:51:06.054468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b23880-4889-46d5-a5a9-161c1f38b738 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:51:06.063157 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b23880-4889-46d5-a5a9-161c1f38b738 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:51:06.064775 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b23880-4889-46d5-a5a9-161c1f38b738 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:51:06.076423 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4430/8856] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:51:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:51:07.842128 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770640-4d40-4d9a-884c-4fbcb8a92191 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:51:07.842573 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770640-4d40-4d9a-884c-4fbcb8a92191 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:51:07.842684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770640-4d40-4d9a-884c-4fbcb8a92191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:51:07.860540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-55770640-4d40-4d9a-884c-4fbcb8a92191 None None] MFA Rules not processed for user `ca7ebf0dddfe43509871a447460f6e36`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:51:07.861730 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-55770640-4d40-4d9a-884c-4fbcb8a92191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:51:07.870519 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4427/8857] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Feb 19 21:51:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:51:07.876309 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b23880-4889-46d5-a5a9-161c1f38b738 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:51:07.886991 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b23880-4889-46d5-a5a9-161c1f38b738 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:51:07.892012 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762b26-33d7-4f86-bc4b-2f7003977435 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:51:07.892682 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762b26-33d7-4f86-bc4b-2f7003977435 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:51:07.892969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762b26-33d7-4f86-bc4b-2f7003977435 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:51:07.893249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762b26-33d7-4f86-bc4b-2f7003977435 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:51:07.902115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762b26-33d7-4f86-bc4b-2f7003977435 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:51:07.903709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762b26-33d7-4f86-bc4b-2f7003977435 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:51:07.913443 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4431/8858] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:51:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:51:45.456275 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591de2-13d0-4a14-a447-71dd2b9b277d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:51:45.456798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591de2-13d0-4a14-a447-71dd2b9b277d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:51:45.456913 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591de2-13d0-4a14-a447-71dd2b9b277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:51:45.496105 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d6591de2-13d0-4a14-a447-71dd2b9b277d None None] MFA Rules not processed for user `d4322cc0fa954031bbf07e95c5cf1fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:51:45.497400 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6591de2-13d0-4a14-a447-71dd2b9b277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:51:45.526400 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4428/8859] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:51:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:51:46.217306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878f4d-81cd-45af-845b-b02232785bde None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:51:46.217865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878f4d-81cd-45af-845b-b02232785bde None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:51:46.217865 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878f4d-81cd-45af-845b-b02232785bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:51:46.238582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-9d878f4d-81cd-45af-845b-b02232785bde None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:51:46.239808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-9d878f4d-81cd-45af-845b-b02232785bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:51:46.272125 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4432/8860] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:51:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:51:46.278334 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591de2-13d0-4a14-a447-71dd2b9b277d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:51:46.287819 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591de2-13d0-4a14-a447-71dd2b9b277d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:51:46.292773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b9dce-4fa4-4b34-8e2b-add8e6ec9f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:51:46.293685 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b9dce-4fa4-4b34-8e2b-add8e6ec9f02 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:51:46.293960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b9dce-4fa4-4b34-8e2b-add8e6ec9f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:51:46.294407 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b9dce-4fa4-4b34-8e2b-add8e6ec9f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:51:46.302677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b9dce-4fa4-4b34-8e2b-add8e6ec9f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:51:46.304358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b9dce-4fa4-4b34-8e2b-add8e6ec9f02 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:51:46.313971 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4429/8861] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:51:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:51:46.648317 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878f4d-81cd-45af-845b-b02232785bde None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:51:46.673995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878f4d-81cd-45af-845b-b02232785bde None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:51:46.680233 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd745b-7e5e-486e-b910-01d610793ef0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:51:46.682385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd745b-7e5e-486e-b910-01d610793ef0 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:51:46.682701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd745b-7e5e-486e-b910-01d610793ef0 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:51:46.683572 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd745b-7e5e-486e-b910-01d610793ef0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:51:46.702818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd745b-7e5e-486e-b910-01d610793ef0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:51:46.704502 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd745b-7e5e-486e-b910-01d610793ef0 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:51:46.715271 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4433/8862] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:51:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:53:18.427783 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b9dce-4fa4-4b34-8e2b-add8e6ec9f02 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:18.503728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b9dce-4fa4-4b34-8e2b-add8e6ec9f02 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:18.508381 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:18.509277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:18.509555 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:18.509827 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] PATH_INFO: `/v3/users/d4322cc0fa954031bbf07e95c5cf1fb7` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:18.511706 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4322cc0fa954031bbf07e95c5cf1fb7)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:18.516029 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:18.562799 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4322cc0fa954031bbf07e95c5cf1fb7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:18.563459 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4322cc0fa954031bbf07e95c5cf1fb7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:18.564100 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4322cc0fa954031bbf07e95c5cf1fb7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:18.577246 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4322cc0fa954031bbf07e95c5cf1fb7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:18.584852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4322cc0fa954031bbf07e95c5cf1fb7'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:18.597441 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4430/8863] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:53:18 2022] DELETE /identity/v3/users/d4322cc0fa954031bbf07e95c5cf1fb7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:53:18.602120 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c85f3-9202-4a1b-beaa-705a2a714539 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:18.602625 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c85f3-9202-4a1b-beaa-705a2a714539 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:18.602728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c85f3-9202-4a1b-beaa-705a2a714539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:18.621179 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-0b3c85f3-9202-4a1b-beaa-705a2a714539 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:53:18.622407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0b3c85f3-9202-4a1b-beaa-705a2a714539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:18.722396 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4434/8864] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:53:18.734410 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:18.735802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:18.800041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45f7e7-6e30-4eac-9013-dd0a750e17c8 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:18.804024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8cb64-d6e8-4eb3-9e67-90a33b72fcf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:18.804645 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8cb64-d6e8-4eb3-9e67-90a33b72fcf8 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:18.804930 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8cb64-d6e8-4eb3-9e67-90a33b72fcf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:18.805237 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8cb64-d6e8-4eb3-9e67-90a33b72fcf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:18.814521 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8cb64-d6e8-4eb3-9e67-90a33b72fcf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:18.816027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8cb64-d6e8-4eb3-9e67-90a33b72fcf8 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:18.825961 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4431/8865] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:53:19.001403 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c85f3-9202-4a1b-beaa-705a2a714539 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:19.002825 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0b3c85f3-9202-4a1b-beaa-705a2a714539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:19.016005 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c85f3-9202-4a1b-beaa-705a2a714539 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:19.021532 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:19.022407 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:19.022697 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:19.023111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] PATH_INFO: `/v3/projects/0b842c60e89342ae92bbc9f9b568e4c2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:19.024473 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b842c60e89342ae92bbc9f9b568e4c2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:19.026402 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:19.074207 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b842c60e89342ae92bbc9f9b568e4c2', 'request_id': 'req-4055dab3-333f-4e51-b565-c59b5ea868bf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.079562 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b842c60e89342ae92bbc9f9b568e4c2', 'request_id': 'req-4055dab3-333f-4e51-b565-c59b5ea868bf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.087476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b842c60e89342ae92bbc9f9b568e4c2', 'request_id': 'req-4055dab3-333f-4e51-b565-c59b5ea868bf'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.099329 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] The token cache is being invalidate because project 0b842c60e89342ae92bbc9f9b568e4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:53:19.099620 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.100528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.102120 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4435/8866] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:53:19 2022] DELETE /identity/v3/projects/0b842c60e89342ae92bbc9f9b568e4c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:53:19.106134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8cb64-d6e8-4eb3-9e67-90a33b72fcf8 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:19.115878 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8cb64-d6e8-4eb3-9e67-90a33b72fcf8 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:19.173743 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:19.174529 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:19.174809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:19.175085 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] PATH_INFO: `/v3/users/06f0a65f42c74237a898f4c3fc71e626` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:19.176343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f0a65f42c74237a898f4c3fc71e626)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:19.178365 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:19.226314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f0a65f42c74237a898f4c3fc71e626'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.227210 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f0a65f42c74237a898f4c3fc71e626'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.227810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f0a65f42c74237a898f4c3fc71e626'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.239935 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f0a65f42c74237a898f4c3fc71e626'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.247291 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-e1898ac7-2002-4fa7-8581-df90f3885a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f0a65f42c74237a898f4c3fc71e626'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.259128 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4432/8867] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 21:53:19 2022] DELETE /identity/v3/users/06f0a65f42c74237a898f4c3fc71e626 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:53:19.534538 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:19.536018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:19.552349 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055dab3-333f-4e51-b565-c59b5ea868bf admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:19.612606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:19.613503 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:19.613784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:19.614058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] PATH_INFO: `/v3/projects/4a665c7638db4b23b57fc76d3c3ab6c2` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:19.615261 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a665c7638db4b23b57fc76d3c3ab6c2)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:19.617184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:19.663293 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a665c7638db4b23b57fc76d3c3ab6c2', 'request_id': 'req-86a68ce2-a470-4c11-921f-9287836e8b60'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.668700 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a665c7638db4b23b57fc76d3c3ab6c2', 'request_id': 'req-86a68ce2-a470-4c11-921f-9287836e8b60'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.676190 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a665c7638db4b23b57fc76d3c3ab6c2', 'request_id': 'req-86a68ce2-a470-4c11-921f-9287836e8b60'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.687628 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] The token cache is being invalidate because project 4a665c7638db4b23b57fc76d3c3ab6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 21:53:19.687912 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.688590 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-86a68ce2-a470-4c11-921f-9287836e8b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 21:53:19.690680 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4436/8868] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:53:19 2022] DELETE /identity/v3/projects/4a665c7638db4b23b57fc76d3c3ab6c2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:53:19.696375 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9097-dc3b-46f5-9626-1a4ac1dfacbe None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:19.696871 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9097-dc3b-46f5-9626-1a4ac1dfacbe None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:19.696960 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9097-dc3b-46f5-9626-1a4ac1dfacbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:19.715994 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ffcb9097-dc3b-46f5-9626-1a4ac1dfacbe None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:53:19.717240 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ffcb9097-dc3b-46f5-9626-1a4ac1dfacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:19.776989 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4433/8869] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:53:19.785327 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779223d-27db-477f-88f1-5e6c235aeb22 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:19.785641 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779223d-27db-477f-88f1-5e6c235aeb22 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:19.785923 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779223d-27db-477f-88f1-5e6c235aeb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:19.807115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-3779223d-27db-477f-88f1-5e6c235aeb22 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:53:19.808420 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-3779223d-27db-477f-88f1-5e6c235aeb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:19.817337 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4437/8870] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:53:19.821927 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb9097-dc3b-46f5-9626-1a4ac1dfacbe None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:19.831770 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb9097-dc3b-46f5-9626-1a4ac1dfacbe None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:19.836411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:19.837064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:19.837350 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:19.837632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:19.838353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96909) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 21:53:19.838660 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:19.840253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:19.851831 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4434/8871] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 21:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 21:53:19.856278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779223d-27db-477f-88f1-5e6c235aeb22 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:19.866007 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779223d-27db-477f-88f1-5e6c235aeb22 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:19.870762 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278e88-575c-4e3b-9896-376e5db8de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:19.871400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278e88-575c-4e3b-9896-376e5db8de6d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:19.871678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278e88-575c-4e3b-9896-376e5db8de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:19.871946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278e88-575c-4e3b-9896-376e5db8de6d admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:19.872703 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278e88-575c-4e3b-9896-376e5db8de6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:19.874583 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278e88-575c-4e3b-9896-376e5db8de6d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:19.901442 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4438/8872] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:53:19 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:53:19.906701 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:19.916833 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a78cf-3a5d-4404-9ca5-ed0c390e99c2 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:19.980689 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef827-84a0-434a-9540-47ba50a0366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:19.981370 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef827-84a0-434a-9540-47ba50a0366f admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:19.981656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef827-84a0-434a-9540-47ba50a0366f admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:19.982281 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef827-84a0-434a-9540-47ba50a0366f admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:19.983376 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbef827-84a0-434a-9540-47ba50a0366f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:19.986550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbef827-84a0-434a-9540-47ba50a0366f admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:20.018232 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4435/8873] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:53:19 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:53:20.022497 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278e88-575c-4e3b-9896-376e5db8de6d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:20.033673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278e88-575c-4e3b-9896-376e5db8de6d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:20.038729 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9b9c5-6221-4e57-8f65-8060faa2d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:20.039408 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9b9c5-6221-4e57-8f65-8060faa2d22f admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:20.039690 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9b9c5-6221-4e57-8f65-8060faa2d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:20.039972 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9b9c5-6221-4e57-8f65-8060faa2d22f admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:20.040735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9b9c5-6221-4e57-8f65-8060faa2d22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:20.042352 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9b9c5-6221-4e57-8f65-8060faa2d22f admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:20.057746 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4439/8874] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:53:20.063235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef827-84a0-434a-9540-47ba50a0366f admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:20.075269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef827-84a0-434a-9540-47ba50a0366f admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:20.084891 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153f84b-3690-4a56-be49-ea9dd2fafcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:20.085617 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f84b-3690-4a56-be49-ea9dd2fafcca admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:20.085971 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f84b-3690-4a56-be49-ea9dd2fafcca admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:20.086288 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f84b-3690-4a56-be49-ea9dd2fafcca admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:20.087060 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153f84b-3690-4a56-be49-ea9dd2fafcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:20.088857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153f84b-3690-4a56-be49-ea9dd2fafcca admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:20.100513 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4436/8875] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:53:20.106366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9b9c5-6221-4e57-8f65-8060faa2d22f admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:20.117508 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9b9c5-6221-4e57-8f65-8060faa2d22f admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:20.123056 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:20.124288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:20.124740 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:20.125117 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] PATH_INFO: `/v3/projects/8f56cec0383d41f097d9ec75bbddc499/users/e56dfa82fd8f439fabb876411484f2fc/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:20.140917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f56cec0383d41f097d9ec75bbddc499, user_id=e56dfa82fd8f439fabb876411484f2fc, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:20.143594 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:20.156443 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4440/8876] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:53:20 2022] PUT /identity/v3/projects/8f56cec0383d41f097d9ec75bbddc499/users/e56dfa82fd8f439fabb876411484f2fc/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:53:20.162401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180ac54-01b3-4346-aa03-e605a2a49a62 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:20.162852 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180ac54-01b3-4346-aa03-e605a2a49a62 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:20.163166 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180ac54-01b3-4346-aa03-e605a2a49a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:20.182991 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9180ac54-01b3-4346-aa03-e605a2a49a62 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:53:20.184201 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9180ac54-01b3-4346-aa03-e605a2a49a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:20.251257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4437/8877] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:53:20.261085 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:20.262790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:20.326561 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8baba0-9243-40a0-a1ad-db95e1c97763 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:20.330383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e7280-86b1-4a25-a896-176fe3d75098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:20.331043 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e7280-86b1-4a25-a896-176fe3d75098 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:20.331333 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e7280-86b1-4a25-a896-176fe3d75098 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:20.331615 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e7280-86b1-4a25-a896-176fe3d75098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:20.341218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e7280-86b1-4a25-a896-176fe3d75098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:20.342680 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e7280-86b1-4a25-a896-176fe3d75098 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:20.352562 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4441/8878] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:53:24.749180 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826650-c6bd-49a4-a110-1d0932d7549f None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:24.750022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826650-c6bd-49a4-a110-1d0932d7549f None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:24.750022 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826650-c6bd-49a4-a110-1d0932d7549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:24.782662 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-d4826650-c6bd-49a4-a110-1d0932d7549f None None] MFA Rules not processed for user `e56dfa82fd8f439fabb876411484f2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:53:24.784677 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d4826650-c6bd-49a4-a110-1d0932d7549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:24.868452 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4438/8879] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:53:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:53:24.874015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e7280-86b1-4a25-a896-176fe3d75098 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:24.884505 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e7280-86b1-4a25-a896-176fe3d75098 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:24.889468 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da50127-4d07-4751-a31f-84d58c61c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:24.890152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da50127-4d07-4751-a31f-84d58c61c22d admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:24.890427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da50127-4d07-4751-a31f-84d58c61c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:24.890878 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da50127-4d07-4751-a31f-84d58c61c22d admin admin] PATH_INFO: `/v3/projects` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:24.891752 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da50127-4d07-4751-a31f-84d58c61c22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:24.893937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da50127-4d07-4751-a31f-84d58c61c22d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:24.928726 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4442/8880] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 21:53:24 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:53:24.933039 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4826650-c6bd-49a4-a110-1d0932d7549f None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:24.944595 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4826650-c6bd-49a4-a110-1d0932d7549f None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:25.008688 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db9df-3baa-45e5-a6f4-1dba984de60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:25.009401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db9df-3baa-45e5-a6f4-1dba984de60b admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:25.009684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db9df-3baa-45e5-a6f4-1dba984de60b admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:25.010152 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db9df-3baa-45e5-a6f4-1dba984de60b admin admin] PATH_INFO: `/v3/users` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:25.011027 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01db9df-3baa-45e5-a6f4-1dba984de60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:25.013214 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01db9df-3baa-45e5-a6f4-1dba984de60b admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:25.037912 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4439/8881] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 21:53:24 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 21:53:25.042113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da50127-4d07-4751-a31f-84d58c61c22d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:25.053678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da50127-4d07-4751-a31f-84d58c61c22d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:25.058661 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a78fa-21b2-4249-8b7c-047d18e6cc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:25.059323 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a78fa-21b2-4249-8b7c-047d18e6cc32 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:25.059606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a78fa-21b2-4249-8b7c-047d18e6cc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:25.059884 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a78fa-21b2-4249-8b7c-047d18e6cc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:25.060642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a78fa-21b2-4249-8b7c-047d18e6cc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:25.062262 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a78fa-21b2-4249-8b7c-047d18e6cc32 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:25.074371 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4443/8882] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 21:53:25.078692 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db9df-3baa-45e5-a6f4-1dba984de60b admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:25.091079 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db9df-3baa-45e5-a6f4-1dba984de60b admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:25.097000 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927537cb-0897-4670-8b31-3be46776c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:25.097946 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927537cb-0897-4670-8b31-3be46776c089 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:25.098221 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927537cb-0897-4670-8b31-3be46776c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:25.098503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927537cb-0897-4670-8b31-3be46776c089 admin admin] PATH_INFO: `/v3/projects/a4b01cf1d791487bace5a0b5e1e85430/users/571273ff895b4c34844077d6b33adcac/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:25.115046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927537cb-0897-4670-8b31-3be46776c089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b01cf1d791487bace5a0b5e1e85430, user_id=571273ff895b4c34844077d6b33adcac, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:25.117798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927537cb-0897-4670-8b31-3be46776c089 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:25.132792 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4440/8883] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:53:25 2022] PUT /identity/v3/projects/a4b01cf1d791487bace5a0b5e1e85430/users/571273ff895b4c34844077d6b33adcac/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 21:53:25.137281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a78fa-21b2-4249-8b7c-047d18e6cc32 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:25.148153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a78fa-21b2-4249-8b7c-047d18e6cc32 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:25.222648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a96fd0-2743-4188-8b3c-45022f69032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:25.223466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a96fd0-2743-4188-8b3c-45022f69032e admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:25.223818 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a96fd0-2743-4188-8b3c-45022f69032e admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:25.224168 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a96fd0-2743-4188-8b3c-45022f69032e admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:25.225249 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a96fd0-2743-4188-8b3c-45022f69032e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:25.227159 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a96fd0-2743-4188-8b3c-45022f69032e admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:25.238230 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4444/8884] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 21:53:25.242290 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927537cb-0897-4670-8b31-3be46776c089 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:25.255591 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927537cb-0897-4670-8b31-3be46776c089 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:25.257916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:25.258794 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:25.259076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:25.259347 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] PATH_INFO: `/v3/projects/a4b01cf1d791487bace5a0b5e1e85430/users/571273ff895b4c34844077d6b33adcac/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:25.262330 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b01cf1d791487bace5a0b5e1e85430, user_id=571273ff895b4c34844077d6b33adcac, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:25.265054 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:25.277262 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4441/8885] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 21:53:25 2022] PUT /identity/v3/projects/a4b01cf1d791487bace5a0b5e1e85430/users/571273ff895b4c34844077d6b33adcac/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 21:53:30.510149 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10dc7f-7178-4e6f-9cc0-6f16c138e7c8 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:30.510693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10dc7f-7178-4e6f-9cc0-6f16c138e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:30.510693 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10dc7f-7178-4e6f-9cc0-6f16c138e7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:30.551888 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-fc10dc7f-7178-4e6f-9cc0-6f16c138e7c8 None None] MFA Rules not processed for user `571273ff895b4c34844077d6b33adcac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:53:30.553966 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-fc10dc7f-7178-4e6f-9cc0-6f16c138e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:30.638394 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4445/8886] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:53:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:53:30.650678 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:30.652442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:30.787633 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde836fd-c47c-4c31-8e22-bbb8c6ebbaac admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:30.794367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:30.795158 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:30.795513 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:30.795865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:30.862805 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:30.864528 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:30.875169 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4442/8887] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:53:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:53:32.243713 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe484c7-a028-4e8c-bd25-8eface9e8d01 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:32.244296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe484c7-a028-4e8c-bd25-8eface9e8d01 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:32.244296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe484c7-a028-4e8c-bd25-8eface9e8d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:32.271034 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-6fe484c7-a028-4e8c-bd25-8eface9e8d01 None None] MFA Rules not processed for user `e56dfa82fd8f439fabb876411484f2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:53:32.272297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-6fe484c7-a028-4e8c-bd25-8eface9e8d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:32.279839 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4446/8888] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:53:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:53:37.723916 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:37.725475 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:37.787264 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3292f-242f-499c-ae43-8db1b8530686 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:37.794973 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:37.795643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:37.795921 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:37.796212 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:37.798113 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:37.813116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:37.815116 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:37.827060 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4443/8889] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:53:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:53:39.038854 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe484c7-a028-4e8c-bd25-8eface9e8d01 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:39.050705 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe484c7-a028-4e8c-bd25-8eface9e8d01 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:39.060175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:39.060175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:39.060175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:39.060175 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:39.060744 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:39.072198 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:39.073701 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:39.090199 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4447/8890] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:53:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:53:42.129798 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:42.140789 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40b836-6cd6-4117-bdef-618d47e7b8e7 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:42.145279 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b5c73-c9f7-44cf-b871-3c005193a24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:42.146024 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5c73-c9f7-44cf-b871-3c005193a24c service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:42.146311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5c73-c9f7-44cf-b871-3c005193a24c service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:42.146682 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5c73-c9f7-44cf-b871-3c005193a24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:42.148578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-706b5c73-c9f7-44cf-b871-3c005193a24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:53:42.159239 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b5c73-c9f7-44cf-b871-3c005193a24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:42.160912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b5c73-c9f7-44cf-b871-3c005193a24c service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:42.170001 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4444/8891] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:53:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:53:44.208103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:53:44.217062 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ee8bc-b55b-402d-b267-5d116d2a35f5 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:53:44.221953 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:53:44.222649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:53:44.222959 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:53:44.223240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:53:44.233789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:53:44.235215 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:53:44.245496 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4448/8892] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:53:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:55:54.807902 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b96bff-8715-4fdb-af71-aac3f38f5639 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:55:54.808479 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b96bff-8715-4fdb-af71-aac3f38f5639 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:55:54.809088 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b96bff-8715-4fdb-af71-aac3f38f5639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:55:54.858896 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-96b96bff-8715-4fdb-af71-aac3f38f5639 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:55:54.860023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-96b96bff-8715-4fdb-af71-aac3f38f5639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:55:54.926547 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4445/8893] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:55:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:55:54.977385 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:55:54.978779 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:55:55.068112 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c2455-c915-4498-9dc3-102544a1b6db service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:55:55.073377 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:55:55.074018 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:55:55.074300 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:55:55.074569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:55:55.082659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:55:55.084208 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:55:55.092243 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4449/8894] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:55:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:55:56.623567 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b96bff-8715-4fdb-af71-aac3f38f5639 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:55:56.640285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b96bff-8715-4fdb-af71-aac3f38f5639 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:55:56.646449 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8900b99-1387-4063-8911-6dbb6d217534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:55:56.647498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900b99-1387-4063-8911-6dbb6d217534 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:55:56.648091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900b99-1387-4063-8911-6dbb6d217534 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:55:56.648684 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8900b99-1387-4063-8911-6dbb6d217534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:55:56.651481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d8900b99-1387-4063-8911-6dbb6d217534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:55:56.667329 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8900b99-1387-4063-8911-6dbb6d217534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:55:56.670126 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8900b99-1387-4063-8911-6dbb6d217534 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:55:56.683766 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4446/8895] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:55:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:56:06.379673 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:06.381209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:06.462928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254e0d-adad-42c8-af6e-0fb322391ded service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:06.468044 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32efe3-25af-4e00-b608-4ac7abe90f05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:06.468735 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32efe3-25af-4e00-b608-4ac7abe90f05 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:06.469021 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32efe3-25af-4e00-b608-4ac7abe90f05 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:06.469301 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32efe3-25af-4e00-b608-4ac7abe90f05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:06.471073 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1c32efe3-25af-4e00-b608-4ac7abe90f05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:06.482202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32efe3-25af-4e00-b608-4ac7abe90f05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:06.484316 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32efe3-25af-4e00-b608-4ac7abe90f05 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:06.493993 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4450/8896] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:56:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:56:08.000323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ffaff-7626-4362-a2c9-3f4e0200695d None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:08.000893 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ffaff-7626-4362-a2c9-3f4e0200695d None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:08.001192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ffaff-7626-4362-a2c9-3f4e0200695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:08.039850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-7d4ffaff-7626-4362-a2c9-3f4e0200695d None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:56:08.041267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-7d4ffaff-7626-4362-a2c9-3f4e0200695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:08.051646 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4447/8897] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:56:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:56:08.063540 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d20f7-487f-4783-929f-9469f5cf70b4 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:08.063990 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d20f7-487f-4783-929f-9469f5cf70b4 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:08.064164 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d20f7-487f-4783-929f-9469f5cf70b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:08.115939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-ae9d20f7-487f-4783-929f-9469f5cf70b4 None None] MFA Rules not processed for user `f02b510f78c341c29320f011ef4beaca`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:56:08.117200 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-ae9d20f7-487f-4783-929f-9469f5cf70b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:08.180252 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4451/8898] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Feb 19 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:56:08.186371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ffaff-7626-4362-a2c9-3f4e0200695d None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:08.195664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ffaff-7626-4362-a2c9-3f4e0200695d None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:08.199647 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cfc5e-c22e-4a09-a4f8-dac32178d587 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:08.200283 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfc5e-c22e-4a09-a4f8-dac32178d587 service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:08.200605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfc5e-c22e-4a09-a4f8-dac32178d587 service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:08.200886 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cfc5e-c22e-4a09-a4f8-dac32178d587 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:08.211041 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cfc5e-c22e-4a09-a4f8-dac32178d587 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:08.212517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cfc5e-c22e-4a09-a4f8-dac32178d587 service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:08.223763 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4448/8899] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:56:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:56:08.281709 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710947-33ad-4d56-a642-d383cf389041 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:08.281999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710947-33ad-4d56-a642-d383cf389041 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:08.282278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710947-33ad-4d56-a642-d383cf389041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:08.311920 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8c710947-33ad-4d56-a642-d383cf389041 None None] MFA Rules not processed for user `700225331647423aa8bc458f1ac82fac`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:56:08.313141 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c710947-33ad-4d56-a642-d383cf389041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:08.319870 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4452/8900] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:56:08.331134 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cfc5e-c22e-4a09-a4f8-dac32178d587 service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:08.340498 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cfc5e-c22e-4a09-a4f8-dac32178d587 service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:08.344666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1be033-e68b-4512-8ab5-bcd8c43d05ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:08.345296 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1be033-e68b-4512-8ab5-bcd8c43d05ae service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:08.345576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1be033-e68b-4512-8ab5-bcd8c43d05ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:08.345850 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1be033-e68b-4512-8ab5-bcd8c43d05ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:08.352981 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1be033-e68b-4512-8ab5-bcd8c43d05ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:08.354428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1be033-e68b-4512-8ab5-bcd8c43d05ae service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:08.362792 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4449/8901] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:56:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:56:09.444244 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c73dd-1378-4d0d-82c6-ada9d94d502b None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:09.444743 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c73dd-1378-4d0d-82c6-ada9d94d502b None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:09.444872 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c73dd-1378-4d0d-82c6-ada9d94d502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:09.463076 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-bd5c73dd-1378-4d0d-82c6-ada9d94d502b None None] MFA Rules not processed for user `a20eaaff207f4d1b870c6abf0a50f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:56:09.464266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-bd5c73dd-1378-4d0d-82c6-ada9d94d502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:09.473548 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4453/8902] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Feb 19 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:56:09.484577 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1be033-e68b-4512-8ab5-bcd8c43d05ae service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:09.493226 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1be033-e68b-4512-8ab5-bcd8c43d05ae service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:09.496881 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dcf3f-9293-4930-89c1-e5294779d63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:09.497512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dcf3f-9293-4930-89c1-e5294779d63b service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:09.497796 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dcf3f-9293-4930-89c1-e5294779d63b service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:09.498754 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dcf3f-9293-4930-89c1-e5294779d63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:09.508969 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dcf3f-9293-4930-89c1-e5294779d63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:09.510393 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dcf3f-9293-4930-89c1-e5294779d63b service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:09.521176 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4450/8903] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:56:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:56:09.904052 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c73dd-1378-4d0d-82c6-ada9d94d502b None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:09.915769 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c73dd-1378-4d0d-82c6-ada9d94d502b None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:09.921404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:09.922042 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:09.922328 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:09.922610 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:09.924429 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:09.935606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:09.937163 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:09.947102 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4454/8904] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:56:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:56:10.325440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dcf3f-9293-4930-89c1-e5294779d63b service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:10.334501 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dcf3f-9293-4930-89c1-e5294779d63b service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:10.338130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31615-41af-4f7d-99ca-40f386683e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:10.338774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31615-41af-4f7d-99ca-40f386683e0e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:10.339147 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31615-41af-4f7d-99ca-40f386683e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:10.339317 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31615-41af-4f7d-99ca-40f386683e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:10.341052 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-42d31615-41af-4f7d-99ca-40f386683e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:10.351405 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31615-41af-4f7d-99ca-40f386683e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:10.352865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31615-41af-4f7d-99ca-40f386683e0e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:10.361019 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4451/8905] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:56:11.603492 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:11.604939 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:11.623264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732263-2d82-4dd4-9f20-1c6d83b24128 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:11.641260 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:11.642290 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:11.643619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:11.644081 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:11.646203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:11.661506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:11.663113 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:11.676306 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4455/8906] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:56:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:56:12.355442 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd9dce-2fa5-46e4-bea8-ba861a718e57 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:12.355967 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd9dce-2fa5-46e4-bea8-ba861a718e57 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:12.356075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd9dce-2fa5-46e4-bea8-ba861a718e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:12.375861 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-ccfd9dce-2fa5-46e4-bea8-ba861a718e57 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:56:12.377037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-ccfd9dce-2fa5-46e4-bea8-ba861a718e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:12.384473 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4452/8907] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:56:12.396428 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:12.407906 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499e29e-3413-4418-9ee4-2da5c4ae9e7b service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:12.412937 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c9a7-8832-49b7-bbbe-f4da99fade4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:12.413585 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c9a7-8832-49b7-bbbe-f4da99fade4e service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:12.413871 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c9a7-8832-49b7-bbbe-f4da99fade4e service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:12.414150 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c9a7-8832-49b7-bbbe-f4da99fade4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:12.422891 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5c9a7-8832-49b7-bbbe-f4da99fade4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:12.424499 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5c9a7-8832-49b7-bbbe-f4da99fade4e service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:12.432759 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4456/8908] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:56:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:56:32.661539 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc16b08-d570-4348-9c86-bea1f8a87ad8 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:32.662081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc16b08-d570-4348-9c86-bea1f8a87ad8 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:32.662081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc16b08-d570-4348-9c86-bea1f8a87ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:32.680016 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-abc16b08-d570-4348-9c86-bea1f8a87ad8 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:56:32.681267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-abc16b08-d570-4348-9c86-bea1f8a87ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:56:32.689195 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4453/8909] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 21:56:32.701596 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c9a7-8832-49b7-bbbe-f4da99fade4e service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:56:32.712435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c9a7-8832-49b7-bbbe-f4da99fade4e service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:56:32.717427 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8226a-1d9b-40f0-b21e-e3a503a23754 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:56:32.718798 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8226a-1d9b-40f0-b21e-e3a503a23754 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:56:32.719105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8226a-1d9b-40f0-b21e-e3a503a23754 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:56:32.719396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8226a-1d9b-40f0-b21e-e3a503a23754 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:56:32.727264 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8226a-1d9b-40f0-b21e-e3a503a23754 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:56:32.728876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8226a-1d9b-40f0-b21e-e3a503a23754 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:56:32.737026 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4457/8910] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 21:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 21:58:27.196712 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5153-97e1-48f8-b7ef-e54924f62d61 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:27.197371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5153-97e1-48f8-b7ef-e54924f62d61 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:27.197371 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5153-97e1-48f8-b7ef-e54924f62d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:27.220394 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-46df5153-97e1-48f8-b7ef-e54924f62d61 None None] MFA Rules not processed for user `e56dfa82fd8f439fabb876411484f2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 21:58:27.221726 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-46df5153-97e1-48f8-b7ef-e54924f62d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:58:27.229376 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4454/8911] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 19 21:58:30.377171 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8226a-1d9b-40f0-b21e-e3a503a23754 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:58:30.386642 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8226a-1d9b-40f0-b21e-e3a503a23754 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:58:30.390341 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:58:30.390973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:30.391257 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:30.391535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:30.393413 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:58:30.403189 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:58:30.404736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:58:30.413008 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4458/8912] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:58:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:58:31.877583 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df5153-97e1-48f8-b7ef-e54924f62d61 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:58:31.893189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df5153-97e1-48f8-b7ef-e54924f62d61 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:58:31.898931 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df213b4-4f6d-496a-8830-77e07a8f1d35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:58:31.899582 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df213b4-4f6d-496a-8830-77e07a8f1d35 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:31.899868 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df213b4-4f6d-496a-8830-77e07a8f1d35 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:31.900156 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df213b4-4f6d-496a-8830-77e07a8f1d35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:31.908710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df213b4-4f6d-496a-8830-77e07a8f1d35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:58:31.910386 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df213b4-4f6d-496a-8830-77e07a8f1d35 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:58:31.920469 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4455/8913] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:58:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:58:32.917905 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:58:32.932064 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eea59b-9bbe-4a13-896a-ab52fa38f179 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:58:32.938281 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:58:32.938928 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:32.939225 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:32.939498 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:32.941824 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:58:32.955373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:58:32.956934 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:58:32.967937 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4459/8914] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:58:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:58:38.621320 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df213b4-4f6d-496a-8830-77e07a8f1d35 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:58:38.669761 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df213b4-4f6d-496a-8830-77e07a8f1d35 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:58:38.675656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3236b7-b915-4591-9e43-ecba6902b74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:58:38.676817 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3236b7-b915-4591-9e43-ecba6902b74a service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:38.677314 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3236b7-b915-4591-9e43-ecba6902b74a service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:38.677813 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3236b7-b915-4591-9e43-ecba6902b74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:38.698614 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3236b7-b915-4591-9e43-ecba6902b74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:58:38.701470 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3236b7-b915-4591-9e43-ecba6902b74a service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:58:38.723914 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4456/8915] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:58:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:58:38.956552 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:58:38.977858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f99152-7363-441d-973e-f6b8cc4b452b service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:58:38.989811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:58:38.990653 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:38.991142 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:38.991595 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:38.995763 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 21:58:39.017399 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:58:39.020351 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:58:39.037942 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4460/8916] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:58:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:58:41.244443 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3236b7-b915-4591-9e43-ecba6902b74a service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:58:41.255018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3236b7-b915-4591-9e43-ecba6902b74a service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:58:41.259880 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158277b6-80c0-4611-ae53-d01fe0621661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:58:41.260565 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277b6-80c0-4611-ae53-d01fe0621661 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:41.260845 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277b6-80c0-4611-ae53-d01fe0621661 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:41.261123 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277b6-80c0-4611-ae53-d01fe0621661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:41.273382 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158277b6-80c0-4611-ae53-d01fe0621661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:58:41.275023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158277b6-80c0-4611-ae53-d01fe0621661 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:58:41.288302 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4457/8917] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:58:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 21:58:45.681283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:58:45.695033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9059-fb39-46d3-b091-b1ece4c25f19 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:58:45.699823 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc9bc9-e8eb-4a52-b39a-55e23a60abf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:58:45.700524 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9bc9-e8eb-4a52-b39a-55e23a60abf2 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:45.700811 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9bc9-e8eb-4a52-b39a-55e23a60abf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:45.701095 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9bc9-e8eb-4a52-b39a-55e23a60abf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:45.709308 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9bc9-e8eb-4a52-b39a-55e23a60abf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:58:45.710749 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9bc9-e8eb-4a52-b39a-55e23a60abf2 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:58:45.720122 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4461/8918] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:58:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 21:58:47.688037 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158277b6-80c0-4611-ae53-d01fe0621661 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 21:58:47.697998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158277b6-80c0-4611-ae53-d01fe0621661 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 21:58:47.702378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc531a-8e80-4dd8-932f-df9d122b7944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 21:58:47.703091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc531a-8e80-4dd8-932f-df9d122b7944 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 21:58:47.703596 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc531a-8e80-4dd8-932f-df9d122b7944 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 21:58:47.704023 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc531a-8e80-4dd8-932f-df9d122b7944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 21:58:47.720059 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc531a-8e80-4dd8-932f-df9d122b7944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 21:58:47.722795 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc531a-8e80-4dd8-932f-df9d122b7944 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 21:58:47.737680 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4458/8919] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 21:58:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:01:13.023022 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc9bc9-e8eb-4a52-b39a-55e23a60abf2 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:01:13.045270 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc9bc9-e8eb-4a52-b39a-55e23a60abf2 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:01:13.053803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991ce9-71d8-44da-b93b-b161f4ee0832 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:01:13.053803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991ce9-71d8-44da-b93b-b161f4ee0832 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:01:13.053803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991ce9-71d8-44da-b93b-b161f4ee0832 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:01:13.053803 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991ce9-71d8-44da-b93b-b161f4ee0832 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:01:13.061745 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991ce9-71d8-44da-b93b-b161f4ee0832 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:01:13.066940 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991ce9-71d8-44da-b93b-b161f4ee0832 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:01:13.074147 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4462/8920] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:01:17.053401 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc531a-8e80-4dd8-932f-df9d122b7944 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:01:17.062876 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc531a-8e80-4dd8-932f-df9d122b7944 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:01:17.067848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd141d0-cf1b-4135-b84d-28e911c2fb58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:01:17.069534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd141d0-cf1b-4135-b84d-28e911c2fb58 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:01:17.070076 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd141d0-cf1b-4135-b84d-28e911c2fb58 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:01:17.070842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd141d0-cf1b-4135-b84d-28e911c2fb58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:01:17.081075 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd141d0-cf1b-4135-b84d-28e911c2fb58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:01:17.082518 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd141d0-cf1b-4135-b84d-28e911c2fb58 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:01:17.090883 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4459/8921] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:01:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:01:18.225203 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991ce9-71d8-44da-b93b-b161f4ee0832 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:01:18.237830 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991ce9-71d8-44da-b93b-b161f4ee0832 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:01:18.241582 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:01:18.242204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:01:18.242488 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:01:18.242767 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:01:18.254241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:01:18.255727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:01:18.267781 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4463/8922] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:01:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:01:18.362718 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd141d0-cf1b-4135-b84d-28e911c2fb58 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:01:18.376855 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd141d0-cf1b-4135-b84d-28e911c2fb58 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:01:18.382839 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:01:18.383497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:01:18.383835 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:01:18.384390 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:01:18.386915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:01:18.400628 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:01:18.402378 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:01:18.413147 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4460/8923] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:01:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:01:18.797633 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:01:18.799032 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:01:18.813506 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c487da-4677-45c3-b85b-281296999669 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:01:18.818568 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131d2c0-18b6-4e2c-bcd1-86c81cb1fe42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:01:18.819202 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d2c0-18b6-4e2c-bcd1-86c81cb1fe42 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:01:18.819566 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d2c0-18b6-4e2c-bcd1-86c81cb1fe42 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:01:18.819880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d2c0-18b6-4e2c-bcd1-86c81cb1fe42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:01:18.829584 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131d2c0-18b6-4e2c-bcd1-86c81cb1fe42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:01:18.831154 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131d2c0-18b6-4e2c-bcd1-86c81cb1fe42 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:01:18.841665 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4464/8924] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:01:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:01:20.201260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:01:20.215307 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515af1a-303d-4a65-af54-b9aac3bdf205 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:01:20.224233 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c140d-df93-4695-a889-fead6a411e9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:01:20.225512 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c140d-df93-4695-a889-fead6a411e9b service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:01:20.226051 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c140d-df93-4695-a889-fead6a411e9b service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:01:20.226568 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c140d-df93-4695-a889-fead6a411e9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:01:20.238540 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c140d-df93-4695-a889-fead6a411e9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:01:20.240526 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c140d-df93-4695-a889-fead6a411e9b service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:01:20.252924 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4461/8925] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:02:53.454265 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131d2c0-18b6-4e2c-bcd1-86c81cb1fe42 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:02:53.508789 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131d2c0-18b6-4e2c-bcd1-86c81cb1fe42 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:02:53.514915 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a84625-d8e5-48e6-bd53-b99e749e8d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:02:53.515577 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a84625-d8e5-48e6-bd53-b99e749e8d65 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:02:53.515858 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a84625-d8e5-48e6-bd53-b99e749e8d65 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:02:53.516129 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a84625-d8e5-48e6-bd53-b99e749e8d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:02:53.527378 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a84625-d8e5-48e6-bd53-b99e749e8d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:02:53.529366 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a84625-d8e5-48e6-bd53-b99e749e8d65 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:02:53.547119 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4465/8926] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:02:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:02:58.807716 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c140d-df93-4695-a889-fead6a411e9b service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:02:58.829747 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c140d-df93-4695-a889-fead6a411e9b service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:02:58.833857 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf170-2cd8-4e31-a588-14fbb00a2e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:02:58.834803 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf170-2cd8-4e31-a588-14fbb00a2e19 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:02:58.835189 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf170-2cd8-4e31-a588-14fbb00a2e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:02:58.835584 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf170-2cd8-4e31-a588-14fbb00a2e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:02:58.915423 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf170-2cd8-4e31-a588-14fbb00a2e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:02:58.917168 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf170-2cd8-4e31-a588-14fbb00a2e19 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:02:58.928079 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4462/8927] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 22:03:06.248476 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a84625-d8e5-48e6-bd53-b99e749e8d65 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:06.267388 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a84625-d8e5-48e6-bd53-b99e749e8d65 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:06.275004 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:06.276634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:06.277306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:06.278256 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] PATH_INFO: `/v3/users/e56dfa82fd8f439fabb876411484f2fc` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:06.279630 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56dfa82fd8f439fabb876411484f2fc)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:06.282410 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:06.343246 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56dfa82fd8f439fabb876411484f2fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.356832 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56dfa82fd8f439fabb876411484f2fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.369876 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56dfa82fd8f439fabb876411484f2fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.370668 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56dfa82fd8f439fabb876411484f2fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.371299 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56dfa82fd8f439fabb876411484f2fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.384833 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4466/8928] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 22:03:06 2022] DELETE /identity/v3/users/e56dfa82fd8f439fabb876411484f2fc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 22:03:06.575311 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf170-2cd8-4e31-a588-14fbb00a2e19 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:06.587764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf170-2cd8-4e31-a588-14fbb00a2e19 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:06.662196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:06.662196 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:06.662669 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:06.662905 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] PATH_INFO: `/v3/projects/8f56cec0383d41f097d9ec75bbddc499` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:06.664186 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f56cec0383d41f097d9ec75bbddc499)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:06.666429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:06.727411 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f56cec0383d41f097d9ec75bbddc499', 'request_id': 'req-66636ae1-931a-4429-911d-6ef2ec2dc6c3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.737482 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f56cec0383d41f097d9ec75bbddc499', 'request_id': 'req-66636ae1-931a-4429-911d-6ef2ec2dc6c3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.745735 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f56cec0383d41f097d9ec75bbddc499', 'request_id': 'req-66636ae1-931a-4429-911d-6ef2ec2dc6c3'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.784102 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] The token cache is being invalidate because project 8f56cec0383d41f097d9ec75bbddc499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 22:03:06.784534 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.785081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.786698 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4463/8929] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 22:03:06 2022] DELETE /identity/v3/projects/8f56cec0383d41f097d9ec75bbddc499 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 22:03:06.791603 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:06.793987 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:06.831067 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0e590-0142-4e6f-b00a-efda94eb90b1 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:06.891531 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:06.893027 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:06.893296 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:06.893570 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] PATH_INFO: `/v3/users/571273ff895b4c34844077d6b33adcac` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:06.894776 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571273ff895b4c34844077d6b33adcac)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:06.896718 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:06.947153 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571273ff895b4c34844077d6b33adcac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.962636 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571273ff895b4c34844077d6b33adcac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.974504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571273ff895b4c34844077d6b33adcac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.975218 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571273ff895b4c34844077d6b33adcac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.975895 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-a6c1692c-3e73-414c-bb59-dd9730222524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571273ff895b4c34844077d6b33adcac'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:06.988902 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4467/8930] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 22:03:06 2022] DELETE /identity/v3/users/571273ff895b4c34844077d6b33adcac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 22:03:07.190756 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:07.192926 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:07.213209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636ae1-931a-4429-911d-6ef2ec2dc6c3 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:07.274708 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:07.276254 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.276774 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.277109 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] PATH_INFO: `/v3/projects/a4b01cf1d791487bace5a0b5e1e85430` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.279136 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b01cf1d791487bace5a0b5e1e85430)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:07.282557 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:07.347757 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b01cf1d791487bace5a0b5e1e85430', 'request_id': 'req-04434695-1515-4714-a5b3-453facf4a1a5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:07.354958 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b01cf1d791487bace5a0b5e1e85430', 'request_id': 'req-04434695-1515-4714-a5b3-453facf4a1a5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:07.364963 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b01cf1d791487bace5a0b5e1e85430', 'request_id': 'req-04434695-1515-4714-a5b3-453facf4a1a5'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:07.377785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] The token cache is being invalidate because project a4b01cf1d791487bace5a0b5e1e85430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96909) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 22:03:07.378094 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:07.378950 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-04434695-1515-4714-a5b3-453facf4a1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:03:07.380728 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4464/8931] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 22:03:07 2022] DELETE /identity/v3/projects/a4b01cf1d791487bace5a0b5e1e85430 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 22:03:07.386016 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0cb6b-aff2-4425-a228-00224f5a0c13 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.386504 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0cb6b-aff2-4425-a228-00224f5a0c13 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.386650 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0cb6b-aff2-4425-a228-00224f5a0c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.435437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-5ef0cb6b-aff2-4425-a228-00224f5a0c13 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:03:07.436559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-5ef0cb6b-aff2-4425-a228-00224f5a0c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:07.510114 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4468/8932] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 22:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:03:07.519140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432e7c-8d3a-4a97-85b8-d7376dc265b5 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.519517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432e7c-8d3a-4a97-85b8-d7376dc265b5 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.519959 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432e7c-8d3a-4a97-85b8-d7376dc265b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.549353 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-25432e7c-8d3a-4a97-85b8-d7376dc265b5 None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:03:07.551485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-25432e7c-8d3a-4a97-85b8-d7376dc265b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:07.561782 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4465/8933] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 22:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:03:07.567105 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0cb6b-aff2-4425-a228-00224f5a0c13 None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:07.581437 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0cb6b-aff2-4425-a228-00224f5a0c13 None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:07.586452 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:07.587177 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.587466 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.587778 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] PATH_INFO: `/v3/domains` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.588601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96910) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 19 22:03:07.588919 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:07.590521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:07.605056 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4469/8934] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Feb 19 22:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 19 22:03:07.609590 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432e7c-8d3a-4a97-85b8-d7376dc265b5 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:07.621532 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432e7c-8d3a-4a97-85b8-d7376dc265b5 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:07.627432 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5033-b7c2-41b8-867d-e4a5e0cd5671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:07.628133 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5033-b7c2-41b8-867d-e4a5e0cd5671 admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.628451 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5033-b7c2-41b8-867d-e4a5e0cd5671 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.628728 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5033-b7c2-41b8-867d-e4a5e0cd5671 admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.629440 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce5033-b7c2-41b8-867d-e4a5e0cd5671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:07.631666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce5033-b7c2-41b8-867d-e4a5e0cd5671 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:07.687267 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4466/8935] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 22:03:07 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 22:03:07.693139 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:07.705362 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fa83-8710-4d72-b20c-d0be3856a458 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:07.769241 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa5a66-9222-4c28-bae2-966b6f028e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:07.769786 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5a66-9222-4c28-bae2-966b6f028e4b admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.770046 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5a66-9222-4c28-bae2-966b6f028e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.770611 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5a66-9222-4c28-bae2-966b6f028e4b admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.771048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa5a66-9222-4c28-bae2-966b6f028e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:07.773008 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa5a66-9222-4c28-bae2-966b6f028e4b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:07.799908 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4470/8936] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 22:03:07 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 22:03:07.802066 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5033-b7c2-41b8-867d-e4a5e0cd5671 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:07.813343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5033-b7c2-41b8-867d-e4a5e0cd5671 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:07.818711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc2b9d-c48e-4347-9cc3-e2844f4de863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:07.819483 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc2b9d-c48e-4347-9cc3-e2844f4de863 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.819772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc2b9d-c48e-4347-9cc3-e2844f4de863 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.820053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc2b9d-c48e-4347-9cc3-e2844f4de863 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.820925 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc2b9d-c48e-4347-9cc3-e2844f4de863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:07.822742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc2b9d-c48e-4347-9cc3-e2844f4de863 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:07.834122 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4467/8937] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 22:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 22:03:07.839790 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa5a66-9222-4c28-bae2-966b6f028e4b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:07.850557 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa5a66-9222-4c28-bae2-966b6f028e4b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:07.855451 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72d747-dbba-4b71-8a8b-c08ac218aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:07.856127 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72d747-dbba-4b71-8a8b-c08ac218aa18 admin admin] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.856447 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72d747-dbba-4b71-8a8b-c08ac218aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.856728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72d747-dbba-4b71-8a8b-c08ac218aa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.857465 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72d747-dbba-4b71-8a8b-c08ac218aa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:07.859091 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72d747-dbba-4b71-8a8b-c08ac218aa18 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:07.873361 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4471/8938] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 22:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 22:03:07.877680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc2b9d-c48e-4347-9cc3-e2844f4de863 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:07.888285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc2b9d-c48e-4347-9cc3-e2844f4de863 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:07.894323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:07.895961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.896243 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.896558 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] PATH_INFO: `/v3/projects/57600659895e4232b2c6533b3c277c0c/users/ac4eb10318e6452cbe3ccaa35ac40e92/roles/ee0b0a89e5e9450e8a292e5c29635e9c` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.923481 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57600659895e4232b2c6533b3c277c0c, user_id=ac4eb10318e6452cbe3ccaa35ac40e92, role_id=ee0b0a89e5e9450e8a292e5c29635e9c)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:07.926695 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:07.946222 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4468/8939] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 22:03:07 2022] PUT /identity/v3/projects/57600659895e4232b2c6533b3c277c0c/users/ac4eb10318e6452cbe3ccaa35ac40e92/roles/ee0b0a89e5e9450e8a292e5c29635e9c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 22:03:07.953015 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb3e5-8547-41b1-9d72-f3eba5ff87db None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:07.953311 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb3e5-8547-41b1-9d72-f3eba5ff87db None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:07.953601 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb3e5-8547-41b1-9d72-f3eba5ff87db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:07.975678 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-cf5bb3e5-8547-41b1-9d72-f3eba5ff87db None None] MFA Rules not processed for user `e41a610bfe5c492388b0f1e7872c9a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:03:07.976979 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-cf5bb3e5-8547-41b1-9d72-f3eba5ff87db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:08.069252 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4472/8940] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 22:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:03:08.081849 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:08.084809 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:08.173216 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac242a8-b4a3-488f-97da-057f0f8a6a67 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:08.177632 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27441-36f2-4db7-b08d-1e0f3efaf5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:08.178368 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27441-36f2-4db7-b08d-1e0f3efaf5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:08.178578 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27441-36f2-4db7-b08d-1e0f3efaf5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:08.178865 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27441-36f2-4db7-b08d-1e0f3efaf5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:08.192576 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27441-36f2-4db7-b08d-1e0f3efaf5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:08.193975 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27441-36f2-4db7-b08d-1e0f3efaf5d6 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:08.212101 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4469/8941] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:03:13.255883 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22230f34-0c0d-4296-969a-03b95472f50a None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:13.256523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22230f34-0c0d-4296-969a-03b95472f50a None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:13.256649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22230f34-0c0d-4296-969a-03b95472f50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:13.289649 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-22230f34-0c0d-4296-969a-03b95472f50a None None] MFA Rules not processed for user `ac4eb10318e6452cbe3ccaa35ac40e92`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:03:13.290873 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-22230f34-0c0d-4296-969a-03b95472f50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:13.359865 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4473/8942] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 22:03:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:03:13.364485 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27441-36f2-4db7-b08d-1e0f3efaf5d6 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:13.374903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27441-36f2-4db7-b08d-1e0f3efaf5d6 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:13.380285 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8b683-42be-4b6f-aad9-22530b500a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:13.380980 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8b683-42be-4b6f-aad9-22530b500a8a admin admin] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:13.381267 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8b683-42be-4b6f-aad9-22530b500a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:13.381549 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8b683-42be-4b6f-aad9-22530b500a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:13.382253 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8b683-42be-4b6f-aad9-22530b500a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:13.384160 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8b683-42be-4b6f-aad9-22530b500a8a admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:13.430404 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4470/8943] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Feb 19 22:03:13 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 19 22:03:13.434440 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22230f34-0c0d-4296-969a-03b95472f50a None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:13.445881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22230f34-0c0d-4296-969a-03b95472f50a None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:13.509760 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d58e-ff97-4d4f-baac-5a80d3017ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:13.510438 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d58e-ff97-4d4f-baac-5a80d3017ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:13.510727 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d58e-ff97-4d4f-baac-5a80d3017ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:13.511003 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d58e-ff97-4d4f-baac-5a80d3017ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:13.511835 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099d58e-ff97-4d4f-baac-5a80d3017ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:13.513814 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099d58e-ff97-4d4f-baac-5a80d3017ed6 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:13.539123 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4474/8944] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Feb 19 22:03:13 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 19 22:03:13.541738 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8b683-42be-4b6f-aad9-22530b500a8a admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:13.554665 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8b683-42be-4b6f-aad9-22530b500a8a admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:13.559599 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b469d-9ac2-4e75-a05e-4bc36427b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:13.560389 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b469d-9ac2-4e75-a05e-4bc36427b243 admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:13.560742 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b469d-9ac2-4e75-a05e-4bc36427b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:13.561091 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b469d-9ac2-4e75-a05e-4bc36427b243 admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:13.561906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b469d-9ac2-4e75-a05e-4bc36427b243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:13.563562 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b469d-9ac2-4e75-a05e-4bc36427b243 admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:13.584706 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4471/8945] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 22:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 19 22:03:13.585881 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d58e-ff97-4d4f-baac-5a80d3017ed6 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:13.597033 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d58e-ff97-4d4f-baac-5a80d3017ed6 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:13.601806 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f31c1-bd83-4ae6-8315-7f89fb0bc99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:13.602728 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f31c1-bd83-4ae6-8315-7f89fb0bc99b admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:13.603006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f31c1-bd83-4ae6-8315-7f89fb0bc99b admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:13.603283 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f31c1-bd83-4ae6-8315-7f89fb0bc99b admin admin] PATH_INFO: `/v3/projects/94b19231703c4ade8315cf8c24a83347/users/c5bc2cd035754fc6ae0dca82d80e8ab0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:13.624836 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f31c1-bd83-4ae6-8315-7f89fb0bc99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b19231703c4ade8315cf8c24a83347, user_id=c5bc2cd035754fc6ae0dca82d80e8ab0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:13.627772 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f31c1-bd83-4ae6-8315-7f89fb0bc99b admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:13.645076 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4475/8946] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 22:03:13 2022] PUT /identity/v3/projects/94b19231703c4ade8315cf8c24a83347/users/c5bc2cd035754fc6ae0dca82d80e8ab0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 22:03:13.649177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b469d-9ac2-4e75-a05e-4bc36427b243 admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:13.664533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b469d-9ac2-4e75-a05e-4bc36427b243 admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:13.731480 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d449ccc-b2b6-4550-9f41-cb7eacdf21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:13.732140 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d449ccc-b2b6-4550-9f41-cb7eacdf21bf admin admin] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:13.732454 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d449ccc-b2b6-4550-9f41-cb7eacdf21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:13.732733 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d449ccc-b2b6-4550-9f41-cb7eacdf21bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:13.733750 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d449ccc-b2b6-4550-9f41-cb7eacdf21bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:13.735380 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d449ccc-b2b6-4550-9f41-cb7eacdf21bf admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:13.746263 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4472/8947] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 22:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 19 22:03:13.750383 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f31c1-bd83-4ae6-8315-7f89fb0bc99b admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:13.761607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f31c1-bd83-4ae6-8315-7f89fb0bc99b admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:13.766679 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:13.768128 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:13.768441 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:13.768720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] PATH_INFO: `/v3/projects/94b19231703c4ade8315cf8c24a83347/users/c5bc2cd035754fc6ae0dca82d80e8ab0/roles/bafeb2a265a54d848f2281c61dd3eaec` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:13.770799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b19231703c4ade8315cf8c24a83347, user_id=c5bc2cd035754fc6ae0dca82d80e8ab0, role_id=bafeb2a265a54d848f2281c61dd3eaec)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:13.773525 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:13.785878 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4476/8948] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Feb 19 22:03:13 2022] PUT /identity/v3/projects/94b19231703c4ade8315cf8c24a83347/users/c5bc2cd035754fc6ae0dca82d80e8ab0/roles/bafeb2a265a54d848f2281c61dd3eaec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 22:03:18.386643 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f048-8c50-49b5-a089-5b17bf1abc8b None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:18.387489 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f048-8c50-49b5-a089-5b17bf1abc8b None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:18.387769 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f048-8c50-49b5-a089-5b17bf1abc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:18.415911 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9416f048-8c50-49b5-a089-5b17bf1abc8b None None] MFA Rules not processed for user `c5bc2cd035754fc6ae0dca82d80e8ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:03:18.417177 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9416f048-8c50-49b5-a089-5b17bf1abc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:18.507957 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4473/8949] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 22:03:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:03:18.519278 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:18.521050 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:18.609040 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac4467-7c86-49ee-b192-ab820c823f1d admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:18.615866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c77c1a-804c-47f3-a9f1-24f51339d780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:18.616418 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c77c1a-804c-47f3-a9f1-24f51339d780 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:18.616704 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c77c1a-804c-47f3-a9f1-24f51339d780 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:18.616981 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c77c1a-804c-47f3-a9f1-24f51339d780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:18.686521 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c77c1a-804c-47f3-a9f1-24f51339d780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:18.692550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c77c1a-804c-47f3-a9f1-24f51339d780 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:18.705595 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4477/8950] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:03:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:03:21.076182 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd242-16e0-4dde-a856-a7b040befc25 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:21.076836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd242-16e0-4dde-a856-a7b040befc25 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:21.076836 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd242-16e0-4dde-a856-a7b040befc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:21.094818 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-2e1fd242-16e0-4dde-a856-a7b040befc25 None None] MFA Rules not processed for user `ac4eb10318e6452cbe3ccaa35ac40e92`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:03:21.096046 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2e1fd242-16e0-4dde-a856-a7b040befc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:21.105711 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4474/8951] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 22:03:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:03:21.443545 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c77c1a-804c-47f3-a9f1-24f51339d780 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:21.499946 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c77c1a-804c-47f3-a9f1-24f51339d780 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:21.503862 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:21.504549 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:21.504827 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:21.505099 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:21.507006 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:21.517757 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:21.519242 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:21.530464 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4478/8952] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:03:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:03:31.665500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd242-16e0-4dde-a856-a7b040befc25 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:03:31.667014 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-2e1fd242-16e0-4dde-a856-a7b040befc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:03:31.680559 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd242-16e0-4dde-a856-a7b040befc25 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:03:31.686093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:03:31.686996 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:03:31.687450 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:03:31.687826 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:03:31.698510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:03:31.699998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:03:31.711216 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4475/8953] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:03:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 22:04:05.753115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:04:05.761569 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07a404-a75c-4fad-8055-0987179cd253 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:04:05.765204 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc7c29-0f63-435f-80a4-c09e4e605c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:04:05.765833 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7c29-0f63-435f-80a4-c09e4e605c8d service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:04:05.766115 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7c29-0f63-435f-80a4-c09e4e605c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:04:05.766387 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7c29-0f63-435f-80a4-c09e4e605c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:04:05.768098 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dffc7c29-0f63-435f-80a4-c09e4e605c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:04:05.777245 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc7c29-0f63-435f-80a4-c09e4e605c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:04:05.778659 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc7c29-0f63-435f-80a4-c09e4e605c8d service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:04:05.786839 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4479/8954] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:04:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:05:28.058510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:05:28.059976 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:28.121982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cde7e-0960-455a-b108-e7060a3364a3 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:05:28.125851 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02b510f78c341c29320f011ef4beaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:05:28.126510 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:28.126793 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:28.127073 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:28.128982 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:28.178801 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:05:28.180269 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:05:28.201542 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4476/8955] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 22:05:32.658080 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd42b3-1479-42ce-b2e4-ba0839ab8025 None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:32.658606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd42b3-1479-42ce-b2e4-ba0839ab8025 None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:32.658606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd42b3-1479-42ce-b2e4-ba0839ab8025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:32.679424 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-a6cd42b3-1479-42ce-b2e4-ba0839ab8025 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:05:32.680969 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-a6cd42b3-1479-42ce-b2e4-ba0839ab8025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:32.741044 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4480/8956] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 22:05:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:05:32.795130 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:05:32.796609 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:32.886720 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ff612-9e6a-4396-9807-21761a56e3da service glance] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:05:32.892657 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aae9a3-dbf7-4c50-a635-ae96e4aa4627 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:05:32.893488 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae9a3-dbf7-4c50-a635-ae96e4aa4627 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:32.893764 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae9a3-dbf7-4c50-a635-ae96e4aa4627 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:32.894038 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae9a3-dbf7-4c50-a635-ae96e4aa4627 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:32.903535 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aae9a3-dbf7-4c50-a635-ae96e4aa4627 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:05:32.905352 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aae9a3-dbf7-4c50-a635-ae96e4aa4627 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:05:32.916185 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4477/8957] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 22:05:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 22:05:42.027191 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c677092-4313-46e7-8281-096504e5657f None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:42.027726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c677092-4313-46e7-8281-096504e5657f None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:42.027726 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c677092-4313-46e7-8281-096504e5657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:42.047406 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-8c677092-4313-46e7-8281-096504e5657f None None] MFA Rules not processed for user `ac4eb10318e6452cbe3ccaa35ac40e92`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:05:42.048648 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-8c677092-4313-46e7-8281-096504e5657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:42.055734 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4481/8958] 10.222.0.30 () {58 vars in 957 bytes} [Sat Feb 19 22:05:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:05:42.376067 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aae9a3-dbf7-4c50-a635-ae96e4aa4627 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:05:42.385293 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aae9a3-dbf7-4c50-a635-ae96e4aa4627 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:05:42.388771 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626573-6212-443d-839b-70bd0448141e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:05:42.389398 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626573-6212-443d-839b-70bd0448141e service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:42.389680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626573-6212-443d-839b-70bd0448141e service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:42.389952 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626573-6212-443d-839b-70bd0448141e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:42.392345 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-41626573-6212-443d-839b-70bd0448141e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:42.402458 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626573-6212-443d-839b-70bd0448141e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:05:42.403877 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626573-6212-443d-839b-70bd0448141e service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:05:42.411679 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4478/8959] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:05:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:05:42.775058 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c677092-4313-46e7-8281-096504e5657f None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:05:42.785523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c677092-4313-46e7-8281-096504e5657f None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:05:42.789162 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:05:42.789870 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:42.790240 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:42.790589 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:42.792523 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:42.806223 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:05:42.807785 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:05:42.820267 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4482/8960] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:05:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:05:43.865772 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb7c5d-9f27-4dd3-9d90-3ebd69b09287 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:43.866302 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb7c5d-9f27-4dd3-9d90-3ebd69b09287 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:43.866420 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb7c5d-9f27-4dd3-9d90-3ebd69b09287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:43.885260 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-b0fb7c5d-9f27-4dd3-9d90-3ebd69b09287 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:05:43.885998 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-b0fb7c5d-9f27-4dd3-9d90-3ebd69b09287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:43.894260 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4479/8961] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 22:05:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:05:43.908944 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:05:43.921209 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f6d3f-b246-4ef2-8f0d-feb7ef04a173 service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:05:43.927528 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6081c00-5094-40b7-a02a-2a46ad41c469 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:05:43.928297 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081c00-5094-40b7-a02a-2a46ad41c469 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:43.928764 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081c00-5094-40b7-a02a-2a46ad41c469 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:43.929696 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081c00-5094-40b7-a02a-2a46ad41c469 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:43.938376 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6081c00-5094-40b7-a02a-2a46ad41c469 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:05:43.939988 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6081c00-5094-40b7-a02a-2a46ad41c469 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:05:43.949410 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4483/8962] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 22:05:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 22:05:53.444790 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb7c5d-9f27-4dd3-9d90-3ebd69b09287 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:05:53.457497 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb7c5d-9f27-4dd3-9d90-3ebd69b09287 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:05:53.466505 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:05:53.468229 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:05:53.469323 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:05:53.470436 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:05:53.474914 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:05:53.486694 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:05:53.488135 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:05:53.496040 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4480/8963] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:05:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:06:04.423907 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6081c00-5094-40b7-a02a-2a46ad41c469 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:06:04.436550 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6081c00-5094-40b7-a02a-2a46ad41c469 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:06:04.449808 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:06:04.450936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:06:04.451230 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:06:04.451510 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:06:04.453917 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:06:04.468445 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:06:04.469736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:06:04.481649 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4484/8964] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:06:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:06:20.982514 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:06:20.983934 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:06:21.068550 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d05e8-601b-4395-b8ec-e031d5614175 service neutron] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:06:21.073603 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:06:21.074503 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:06:21.074779 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:06:21.075053 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:06:21.076848 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:06:21.091095 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:06:21.092759 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:06:21.102741 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4481/8965] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:06:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:06:24.805307 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:06:24.806720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:06:24.821102 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aaf27-dc19-40a7-8366-47eccac2d9c5 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:06:24.826373 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:06:24.827013 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:06:24.827288 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:06:24.827574 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:06:24.829671 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:06:24.841556 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:06:24.843119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:06:24.853281 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4485/8966] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:06:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:08:17.889837 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:17.891223 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:08:17.906417 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8b44-6b1b-4dfe-8d71-f3ebc8ba0d2a service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:17.912018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85bde0-8ddc-4233-a35c-2ad421ceba07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:17.912680 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85bde0-8ddc-4233-a35c-2ad421ceba07 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:17.912961 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85bde0-8ddc-4233-a35c-2ad421ceba07 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:17.913238 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85bde0-8ddc-4233-a35c-2ad421ceba07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:17.922209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85bde0-8ddc-4233-a35c-2ad421ceba07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:17.923785 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85bde0-8ddc-4233-a35c-2ad421ceba07 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:17.932584 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4482/8967] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:08:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:08:24.747571 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:24.759591 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e340000-1610-4fe1-bcb6-1bac88ba8993 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:24.765184 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:24.765828 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:24.766119 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:24.766400 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:24.768152 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:08:24.783784 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:24.785435 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:24.797163 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4486/8968] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:08:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 19 22:08:25.861810 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee588d-71e0-46cf-b0fc-b3d0e210e067 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:25.862322 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee588d-71e0-46cf-b0fc-b3d0e210e067 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:25.862429 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee588d-71e0-46cf-b0fc-b3d0e210e067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:25.919842 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-9bee588d-71e0-46cf-b0fc-b3d0e210e067 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:08:25.921009 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-9bee588d-71e0-46cf-b0fc-b3d0e210e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:08:25.937218 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4483/8969] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Feb 19 22:08:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:08:25.977148 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:25.998606 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908851-ac63-4530-a937-162517bb0071 service nova] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:26.006088 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edce3a1-ba50-4d51-a825-de98d4a36437 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:26.006766 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce3a1-ba50-4d51-a825-de98d4a36437 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:26.007054 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce3a1-ba50-4d51-a825-de98d4a36437 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:26.007336 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce3a1-ba50-4d51-a825-de98d4a36437 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:26.016841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edce3a1-ba50-4d51-a825-de98d4a36437 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:26.018417 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edce3a1-ba50-4d51-a825-de98d4a36437 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:26.026359 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4487/8970] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 22:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 22:08:35.803500 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378f5ba-1dff-40ca-a775-ecc97e6a2257 None None] REQUEST_METHOD: `POST` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:35.804422 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378f5ba-1dff-40ca-a775-ecc97e6a2257 None None] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:35.804711 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378f5ba-1dff-40ca-a775-ecc97e6a2257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:35.825114 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.auth.core [None req-e378f5ba-1dff-40ca-a775-ecc97e6a2257 None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96909) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:08:35.826358 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-e378f5ba-1dff-40ca-a775-ecc97e6a2257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:08:35.833772 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4484/8971] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 22:08:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:08:35.846320 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edce3a1-ba50-4d51-a825-de98d4a36437 service swift] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:35.858559 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edce3a1-ba50-4d51-a825-de98d4a36437 service swift] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:35.864065 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690996b-747b-4ec0-90ce-b5c5b9542ee0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:35.864736 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690996b-747b-4ec0-90ce-b5c5b9542ee0 service swift] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:35.865111 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690996b-747b-4ec0-90ce-b5c5b9542ee0 service swift] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:35.865390 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690996b-747b-4ec0-90ce-b5c5b9542ee0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:35.874048 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690996b-747b-4ec0-90ce-b5c5b9542ee0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:35.875608 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690996b-747b-4ec0-90ce-b5c5b9542ee0 service swift] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:35.883928 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4488/8972] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 22:08:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 22:08:39.658746 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378f5ba-1dff-40ca-a775-ecc97e6a2257 None None] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:39.680605 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378f5ba-1dff-40ca-a775-ecc97e6a2257 None None] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:39.687873 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20eaaff207f4d1b870c6abf0a50f1c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:39.689084 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:39.689597 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:39.690103 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:39.693428 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:08:39.709592 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:39.712517 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:39.729525 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4485/8973] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:08:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:08:41.313339 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6fd3-740a-4eb0-82d3-4189d15f45ad None None] REQUEST_METHOD: `POST` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:41.313866 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6fd3-740a-4eb0-82d3-4189d15f45ad None None] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:41.313973 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6fd3-740a-4eb0-82d3-4189d15f45ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:41.336791 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.auth.core [None req-4dba6fd3-740a-4eb0-82d3-4189d15f45ad None None] MFA Rules not processed for user `6793b09e5394441bb1f700e1aca9a7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96910) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 19 22:08:41.338554 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-4dba6fd3-740a-4eb0-82d3-4189d15f45ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:08:41.345994 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4489/8974] 10.222.0.30 () {58 vars in 967 bytes} [Sat Feb 19 22:08:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 19 22:08:41.358277 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:41.369815 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c72336-8f2d-452b-8739-5be9b52985c8 service nova] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:41.375414 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7b05-25a4-4bad-8aa4-9b51362650f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b7a16fa195446e18f5c5982a127b88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:41.376064 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7b05-25a4-4bad-8aa4-9b51362650f0 service swift] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:41.376372 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7b05-25a4-4bad-8aa4-9b51362650f0 service swift] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:41.376656 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7b05-25a4-4bad-8aa4-9b51362650f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:41.386209 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7b05-25a4-4bad-8aa4-9b51362650f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:41.387806 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7b05-25a4-4bad-8aa4-9b51362650f0 service swift] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:41.396606 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4486/8975] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Feb 19 22:08:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 19 22:08:45.542687 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6fd3-740a-4eb0-82d3-4189d15f45ad None None] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:45.562371 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6fd3-740a-4eb0-82d3-4189d15f45ad None None] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:45.566651 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16a07-8382-4dc2-bc53-7ad974e7abed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '700225331647423aa8bc458f1ac82fac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:45.567295 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16a07-8382-4dc2-bc53-7ad974e7abed service neutron] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:45.567576 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16a07-8382-4dc2-bc53-7ad974e7abed service neutron] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:45.567847 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16a07-8382-4dc2-bc53-7ad974e7abed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:45.640517 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16a07-8382-4dc2-bc53-7ad974e7abed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:45.641985 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16a07-8382-4dc2-bc53-7ad974e7abed service neutron] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:45.660868 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4490/8976] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:08:52.402912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7b05-25a4-4bad-8aa4-9b51362650f0 service swift] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:52.421944 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7b05-25a4-4bad-8aa4-9b51362650f0 service swift] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:52.427327 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:52.428192 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:52.428564 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:52.428906 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] PATH_INFO: `/v3/users/ac4eb10318e6452cbe3ccaa35ac40e92` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:52.430236 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4eb10318e6452cbe3ccaa35ac40e92)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:52.432788 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:52.500940 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4eb10318e6452cbe3ccaa35ac40e92'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.501588 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4eb10318e6452cbe3ccaa35ac40e92'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.502631 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4eb10318e6452cbe3ccaa35ac40e92'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.515250 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4eb10318e6452cbe3ccaa35ac40e92'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.525915 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4eb10318e6452cbe3ccaa35ac40e92'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.542369 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4487/8977] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 22:08:52 2022] DELETE /identity/v3/users/ac4eb10318e6452cbe3ccaa35ac40e92 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 22:08:52.731619 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16a07-8382-4dc2-bc53-7ad974e7abed service neutron] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:52.746799 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16a07-8382-4dc2-bc53-7ad974e7abed service neutron] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:52.823999 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:52.825326 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:52.825607 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:52.825880 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] PATH_INFO: `/v3/projects/57600659895e4232b2c6533b3c277c0c` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:52.827103 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57600659895e4232b2c6533b3c277c0c)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:52.829070 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:52.886306 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57600659895e4232b2c6533b3c277c0c', 'request_id': 'req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.892914 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57600659895e4232b2c6533b3c277c0c', 'request_id': 'req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.901404 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57600659895e4232b2c6533b3c277c0c', 'request_id': 'req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.913439 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] The token cache is being invalidate because project 57600659895e4232b2c6533b3c277c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 22:08:52.914031 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.914857 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:52.917078 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4491/8978] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 22:08:52 2022] DELETE /identity/v3/projects/57600659895e4232b2c6533b3c277c0c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 19 22:08:52.921425 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:52.923090 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:08:52.940953 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290e9d6-af5a-43ac-b609-337e9f425fee admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:53.000081 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:53.001235 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:53.001520 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:53.001802 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] PATH_INFO: `/v3/users/c5bc2cd035754fc6ae0dca82d80e8ab0` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:53.003110 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5bc2cd035754fc6ae0dca82d80e8ab0)` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:53.005508 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:53.062343 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5bc2cd035754fc6ae0dca82d80e8ab0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.063664 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5bc2cd035754fc6ae0dca82d80e8ab0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.065018 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5bc2cd035754fc6ae0dca82d80e8ab0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.077093 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5bc2cd035754fc6ae0dca82d80e8ab0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.085527 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.notifications [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5bc2cd035754fc6ae0dca82d80e8ab0'} {{(pid=96909) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.099692 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4488/8979] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 22:08:52 2022] DELETE /identity/v3/users/c5bc2cd035754fc6ae0dca82d80e8ab0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 22:08:53.293369 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:08:53.294782 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:08:53.311841 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1176b-0ae6-45bc-94f8-fc6c172ce097 admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:08:53.378936 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a610bfe5c492388b0f1e7872c9a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:08:53.379821 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:08:53.380100 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:08:53.380416 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] PATH_INFO: `/v3/projects/94b19231703c4ade8315cf8c24a83347` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:08:53.381751 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b19231703c4ade8315cf8c24a83347)` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:08:53.383774 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:08:53.436714 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b19231703c4ade8315cf8c24a83347', 'request_id': 'req-d86ad66e-f501-4b13-a68b-45dab45f49fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.443092 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b19231703c4ade8315cf8c24a83347', 'request_id': 'req-d86ad66e-f501-4b13-a68b-45dab45f49fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.454342 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b19231703c4ade8315cf8c24a83347', 'request_id': 'req-d86ad66e-f501-4b13-a68b-45dab45f49fc'} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.467667 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] The token cache is being invalidate because project 94b19231703c4ade8315cf8c24a83347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96910) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 19 22:08:53.467995 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.468634 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.notifications [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96910) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 19 22:08:53.470465 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4492/8980] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 22:08:53 2022] DELETE /identity/v3/projects/94b19231703c4ade8315cf8c24a83347 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 19 22:11:27.002200 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:11:27.005992 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:11:27.095161 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd25fe-fe15-4a7e-be5c-c9c6493085eb admin admin] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:11:27.156683 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:11:27.157341 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:11:27.157626 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:11:27.157903 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:11:27.159666 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:11:27.170912 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:11:27.172533 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:11:27.182257 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4489/8981] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:11:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:11:27.780393 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:11:27.781795 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:11:27.796783 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ad66e-f501-4b13-a68b-45dab45f49fc admin admin] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:11:27.801720 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:11:27.802983 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:11:27.803266 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:11:27.803539 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:11:27.805287 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.fernet_utils [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96910) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:11:27.816926 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:11:27.818530 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:11:27.828491 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4493/8982] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:11:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:16:30.754773 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] Authenticating user token {{(pid=96909) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:16:30.756241 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.fernet_utils [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96909) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 19 22:16:30.836044 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4bf19-44ac-4282-9b8e-c67f80982319 service placement] Validating token access rules against request {{(pid=96909) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:16:30.841970 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb1954-ebe9-4c28-af23-9bc73c8f668d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96909) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:16:30.842621 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb1954-ebe9-4c28-af23-9bc73c8f668d service placement] REQUEST_METHOD: `GET` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:16:30.842904 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb1954-ebe9-4c28-af23-9bc73c8f668d service placement] SCRIPT_NAME: `/identity` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:16:30.843289 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb1954-ebe9-4c28-af23-9bc73c8f668d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96909) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:16:30.852710 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb1954-ebe9-4c28-af23-9bc73c8f668d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:16:30.854367 ncdv-master-1 devstack@keystone.service[96909]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb1954-ebe9-4c28-af23-9bc73c8f668d service placement] RBAC: Authorization granted {{(pid=96909) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:16:30.864939 ncdv-master-1 devstack@keystone.service[96909]: [pid: 96909|app: 0|req: 4490/8983] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:16:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 19 22:16:33.068396 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] Authenticating user token {{(pid=96910) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 19 22:16:33.126645 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0cb2-e40c-4a07-9f7d-4b2c08294722 service placement] Validating token access rules against request {{(pid=96910) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 19 22:16:33.131916 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f34d8-9f1e-4f76-a1f3-a51092163f83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7ebf0dddfe43509871a447460f6e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96910) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 19 22:16:33.132820 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f34d8-9f1e-4f76-a1f3-a51092163f83 service placement] REQUEST_METHOD: `GET` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 19 22:16:33.132992 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f34d8-9f1e-4f76-a1f3-a51092163f83 service placement] SCRIPT_NAME: `/identity` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 19 22:16:33.133236 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f34d8-9f1e-4f76-a1f3-a51092163f83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96910) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 19 22:16:33.142535 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f34d8-9f1e-4f76-a1f3-a51092163f83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 19 22:16:33.144380 ncdv-master-1 devstack@keystone.service[96910]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f34d8-9f1e-4f76-a1f3-a51092163f83 service placement] RBAC: Authorization granted {{(pid=96910) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 19 22:16:33.155024 ncdv-master-1 devstack@keystone.service[96910]: [pid: 96910|app: 0|req: 4494/8984] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Feb 19 22:16:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)